2024-09-12T02:17:40.290 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:17:41.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:17:41.304 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/journal-repair} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901623' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - bad backtrace on directory inode - error reading table object - Metadata damage detected - slow requests are blocked - Behind on trimming - error reading sessionmap sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBO3e4UQxPR+byhVVn5OR6P8UCFSYLFyavpO4XclUrg7itJoYCJXt5gIIWdHBTIdJhkL3aPh3fLPhdt4AH9Idf4= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpFyZG0+uYQ2JoOHhr0Q2B+g9QFcX/DleBeGoYXhU9XrJ5bmheuluhe8szdY9Mw5sbpKs6GaMFLS5NdKDhTCjw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_journal_repair teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:17:41.304 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:17:41.305 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:17:41.305 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:17:41.306 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:17:41.327 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:17:41.328 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:17:41.328 INFO:teuthology.packaging:ref: None 2024-09-12T02:17:41.328 INFO:teuthology.packaging:tag: None 2024-09-12T02:17:41.328 INFO:teuthology.packaging:branch: squid 2024-09-12T02:17:41.328 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:17:41.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:17:41.569 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:17:41.570 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:17:41.577 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:17:41.578 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:17:41.604 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:17:41.622 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:17:41.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:17:41.659 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:12:26.084113', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBO3e4UQxPR+byhVVn5OR6P8UCFSYLFyavpO4XclUrg7itJoYCJXt5gIIWdHBTIdJhkL3aPh3fLPhdt4AH9Idf4='} 2024-09-12T02:17:41.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:12:26.082226', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpFyZG0+uYQ2JoOHhr0Q2B+g9QFcX/DleBeGoYXhU9XrJ5bmheuluhe8szdY9Mw5sbpKs6GaMFLS5NdKDhTCjw='} 2024-09-12T02:17:41.682 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:17:41.689 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-12T02:17:41.689 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-12T02:17:41.689 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:17:41.749 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa1261d7be0>, signals=[15]) 2024-09-12T02:17:41.749 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:17:41.758 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:17:41.758 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:17:41.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:17:41.837 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:17:41.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:17:41.913 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:17:41.922 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-12T02:17:41.940 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-12T02:17:41.941 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-12T02:17:41.998 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-09-12T02:17:41.998 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:17:41.999 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:17:42.000 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-12T02:17:42.026 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-09-12T02:17:42.044 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-09-12T02:17:42.044 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-09-12T02:17:42.101 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-09-12T02:17:42.101 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-09-12T02:17:42.101 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-09-12T02:17:42.101 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:17:42.101 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-09-12T02:17:42.101 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:17:42.102 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:17:42.102 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-09-12T02:17:42.126 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:17:42.139 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:17:42.150 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:17:42.150 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:17:42.153 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:17:42.169 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:17:42.182 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:17:42.182 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:17:42.210 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:17:42.319 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:17:42.378 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:17:42.397 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:17:42.397 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T02:17:42.397 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:17:42.398 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:17:42.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:17:42.414 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-12T02:17:42.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:17:42.415 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-12T02:17:42.473 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:17:42.473 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.14.0-503.el9.x86_64 2024-09-12T02:17:42.473 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum install -y kernel 2024-09-12T02:17:42.474 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:17:42.474 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-503.el9.x86_64 2024-09-12T02:17:42.474 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2024-09-12T02:17:46.115 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-12T02:17:47.508 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.2 MB 00:03 2024-09-12T02:17:51.499 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 20 MB 00:04 2024-09-12T02:17:52.209 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 20 MB 00:03 2024-09-12T02:17:55.950 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T02:17:56.651 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T02:17:57.384 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-12T02:17:58.118 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-12T02:17:58.272 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T02:17:59.006 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T02:18:03.711 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T02:18:04.461 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-12T02:18:05.701 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:18:05.701 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:18:05.784 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T02:18:05.790 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T02:18:05.790 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-09-12T02:18:05.790 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T02:18:05.790 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T02:18:05.790 INFO:teuthology.orchestra.run.smithi204.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout:Install 4 Packages 2024-09-12T02:18:05.791 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:18:05.792 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 79 M 2024-09-12T02:18:05.792 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 126 M 2024-09-12T02:18:05.792 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T02:18:05.887 INFO:teuthology.orchestra.run.smithi204.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 304 kB/s | 23 kB 00:00 2024-09-12T02:18:06.426 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:18:06.426 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:18:06.513 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:18:06.530 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 79 M 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 126 M 2024-09-12T02:18:06.531 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-12T02:18:06.654 INFO:teuthology.orchestra.run.smithi204.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-12T02:18:06.838 INFO:teuthology.orchestra.run.smithi204.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-12T02:18:06.929 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 242 kB/s | 23 kB 00:00 2024-09-12T02:18:07.313 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-12T02:18:07.613 INFO:teuthology.orchestra.run.smithi204.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-12T02:18:07.613 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:18:07.613 INFO:teuthology.orchestra.run.smithi204.stdout:Total 43 MB/s | 79 MB 00:01 2024-09-12T02:18:07.672 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 38 MB/s | 29 MB 00:00 2024-09-12T02:18:07.989 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-12T02:18:07.989 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:18:07.989 INFO:teuthology.orchestra.run.smithi181.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-12T02:18:08.295 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T02:18:08.646 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T02:18:08.647 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T02:18:08.672 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-12T02:18:09.023 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-12T02:18:09.024 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-12T02:18:09.655 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T02:18:09.656 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T02:18:09.991 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-12T02:18:09.992 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-12T02:18:12.135 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T02:18:12.425 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-12T02:18:12.785 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:18:12.872 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:18:13.080 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:18:13.163 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:18:15.688 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:18:15.828 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:18:15.972 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:18:16.109 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:18:20.673 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:18:20.712 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:18:20.972 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:18:21.010 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:18:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:18:25.875 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:03.828 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:03.868 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:04.238 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:04.239 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:19:04.239 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:19:04.239 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:19:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:04.515 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:04.908 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:04.908 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:19:04.908 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:19:04.908 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:19:05.110 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:19:05.111 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T02:19:05.504 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:19:05.589 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.589 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:19:05.589 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:19:05.590 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:19:05.590 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:19:05.590 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T02:19:05.590 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:19:05.590 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:19:05.649 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.649 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:19:05.650 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-09-12T02:19:05.681 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 82.el9 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8274670 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:19:05.682 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:19:05.683 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:19:05.684 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:19:05.684 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:19:05.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:19:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:19:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:19:05.774 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-12T02:19:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:19:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:19:05.775 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-12T02:19:06.120 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:19:06.206 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:19:06.206 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:19:06.206 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:19:06.207 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:19:06.207 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:19:06.207 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T02:19:06.207 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:19:06.207 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:19:06.265 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:19:06.266 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:19:06.266 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-09-12T02:19:06.279 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-09-12T02:19:06.305 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-09-12T02:19:06.305 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-09-12T02:19:06.305 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 82.el9 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8274670 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-09-12T02:19:06.306 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:19:06.307 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:19:06.308 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:19:06.308 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:19:06.308 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:19:06.969 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-09-12T02:19:07.580 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:19:07.611 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-09-12T02:19:07.613 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-12T02:19:07.629 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.qYqANvaDNF 2024-09-12T02:19:07.629 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qYqANvaDNF 2024-09-12T02:19:07.697 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.qYqANvaDNF 2024-09-12T02:19:07.837 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.qYqANvaDNF is 6KB 2024-09-12T02:19:07.886 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.qYqANvaDNF 2024-09-12T02:19:07.901 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:19:07.964 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:19:07.964 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:19:07.964 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:19:07.964 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:19:07.966 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:19:08.132 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-09-12T02:19:08.268 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:19:08.303 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-09-12T02:19:08.306 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-12T02:19:08.321 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.u598yDy46V 2024-09-12T02:19:08.321 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.u598yDy46V 2024-09-12T02:19:08.402 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.u598yDy46V 2024-09-12T02:19:08.549 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.u598yDy46V is 6KB 2024-09-12T02:19:08.597 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.u598yDy46V 2024-09-12T02:19:08.612 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:19:08.675 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:19:08.675 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:19:08.675 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:19:08.675 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:19:08.676 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:19:08.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-09-12T02:19:38.161 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T02:19:38.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T02:19:38.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:19:38.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T02:19:38.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T02:19:38.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:19:56.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-12T02:19:57.373 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-12T02:20:05.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T02:20:05.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:20:06.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T02:20:06.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:20:08.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-12T02:20:09.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-12T02:20:20.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T02:20:20.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:20:21.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T02:20:21.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:20:53.590 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-12T02:20:53.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T02:20:53.975 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:20:53.975 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-12T02:20:53.989 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:20:53.989 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:20:53.989 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:20:53.990 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:20:54.991 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T02:20:54.991 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T02:20:55.060 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-09-12T02:20:55.090 DEBUG:teuthology.parallel:result is None 2024-09-12T02:21:20.685 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T02:21:35.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T02:21:35.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:21:36.065 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-12T02:21:36.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T02:21:36.419 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:21:36.419 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-12T02:21:36.435 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:21:36.436 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:21:36.436 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:21:36.436 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:21:37.437 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T02:21:37.437 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T02:21:37.543 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-09-12T02:21:37.567 DEBUG:teuthology.parallel:result is None 2024-09-12T02:21:37.567 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:21:37.576 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:21:37.576 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:21:37.580 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:21:37.597 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:21:37.620 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:21:37.627 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:21:37.628 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:21:37.639 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:21:37.720 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:21:37.726 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:21:37.727 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:21:37.729 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:21:37.760 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:21:37.771 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:21:37.773 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:21:37.783 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:21:37.785 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:21:37.795 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:21:37.795 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:21:37.817 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:21:37.852 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:21:37.861 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:21:37.861 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:21:37.885 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:21:37.909 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:21:37.984 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:21:38.029 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:21:38.116 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:21:38.154 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:21:38.154 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:21:38.220 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:21:38.261 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:21:38.312 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:21:38.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:21:38.437 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:21:38.438 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:21:38.503 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-12T02:21:38.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-09-12T02:21:38.555 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:21:38.590 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:21:38.939 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:21:38.947 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:21:38.947 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:21:38.973 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:21:38.982 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:21:38.982 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-09-12T02:21:39.037 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-09-12T02:21:39.039 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-09-12T02:21:39.090 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-09-12T02:21:39.091 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:21:39.091 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-09-12T02:21:39.117 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-09-12T02:21:39.118 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-09-12T02:21:39.149 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-09-12T02:21:39.150 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi181.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:21:39.150 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:21:39.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:21:39.184 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:21:39.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:21:39.216 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:21:39.216 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:21:39.256 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:21:39.284 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:21:39.293 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T02:21:39.296 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T02:21:39.415 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:21:39.426 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:21:39.427 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi181.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:25:23.334 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi181.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-09-12T02:25:23.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T02:25:23.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:25:23.413 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-12T02:25:23.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T02:25:23.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T02:25:23.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:25:23.576 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-12T02:25:23.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-12T02:25:23.657 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:25:23.666 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:25:23.666 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:25:23.667 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:25:23.670 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:25:23.670 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:25:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:25:23.716 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:25:23.728 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:25:23.742 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-09-12T02:25:23.742 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:25:23.754 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-09-12T02:25:23.768 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-09-12T02:25:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:25:23.779 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-09-12T02:25:23.783 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:25:23.794 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:25:23.808 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:25:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:25:23.841 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:25:23.842 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-12T02:25:23.842 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.842 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.842 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.842 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.868 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:25:23.872 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:25:23.872 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-12T02:25:23.872 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.873 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.873 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.873 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:25:23.873 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:25:23.881 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:25:23.881 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:25:23.881 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:25:23.881 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:25:23.886 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:25:23.886 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:25:23.887 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:25:23.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:23.890 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:25:23.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:24.039 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:25:24.039 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:25:24.044 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:25:24.045 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:25:24.150 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:25:24.151 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:25:24.151 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:25:24.156 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:25:24.156 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:25:24.156 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:25:24.177 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:25:24.178 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:25:24.183 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:25:24.184 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:25:24.243 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:25:24.249 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:25:24.318 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:25:24.327 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:25:24.382 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-09-12T02:25:24.384 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-09-12T02:25:24.392 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-09-12T02:25:24.394 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-09-12T02:25:24.608 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-09-12T02:25:24.615 INFO:teuthology.orchestra.run.smithi204.stdout:45 files removed 2024-09-12T02:25:24.635 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:25:24.642 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:25:25.202 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-12T02:25:25.204 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-12T02:25:25.485 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:25:25.488 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:25:25.764 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T02:25:25.786 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-09-12T02:25:29.972 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.2 MB 00:04 2024-09-12T02:25:30.744 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.2 MB 00:04 2024-09-12T02:25:31.657 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-12T02:25:34.379 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 20 MB 00:02 2024-09-12T02:25:36.074 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-12T02:25:37.666 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-12T02:25:38.512 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T02:25:38.655 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T02:25:40.539 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T02:25:41.435 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T02:25:43.993 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T02:25:46.354 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:25:46.354 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:25:46.365 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:25:46.366 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:25:46.367 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:25:46.368 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:25:46.370 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:25:46.372 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:25:46.373 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:25:46.436 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-12T02:25:46.460 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-09-12T02:25:46.460 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-12T02:25:46.460 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-09-12T02:25:46.460 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-12T02:25:46.460 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:25:46.460 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:25:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:25:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:25:46.463 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:25:46.464 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:25:46.465 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:25:46.466 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:25:46.467 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:25:46.468 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:25:46.469 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:25:46.470 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:25:46.471 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:25:46.472 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-09-12T02:25:46.473 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:25:46.473 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:25:46.473 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-12T02:25:46.473 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-09-12T02:25:46.473 INFO:teuthology.orchestra.run.smithi181.stdout:Install 148 Packages 2024-09-12T02:25:46.473 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 8 Packages 2024-09-12T02:25:46.473 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:25:46.474 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 226 M 2024-09-12T02:25:46.474 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-12T02:25:46.799 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T02:25:47.186 INFO:teuthology.orchestra.run.smithi181.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 42 kB/s | 6.5 kB 00:00 2024-09-12T02:25:47.511 INFO:teuthology.orchestra.run.smithi181.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.7 MB/s | 897 kB 00:00 2024-09-12T02:25:47.578 INFO:teuthology.orchestra.run.smithi181.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-12T02:25:48.212 INFO:teuthology.orchestra.run.smithi181.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.8 MB/s | 2.4 MB 00:00 2024-09-12T02:25:48.279 INFO:teuthology.orchestra.run.smithi181.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.3 MB/s | 5.4 MB 00:01 2024-09-12T02:25:48.487 INFO:teuthology.orchestra.run.smithi181.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.5 MB/s | 1.5 MB 00:00 2024-09-12T02:25:48.854 INFO:teuthology.orchestra.run.smithi181.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.2 MB/s | 4.7 MB 00:00 2024-09-12T02:25:49.154 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:25:49.155 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:25:49.169 INFO:teuthology.orchestra.run.smithi204.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:25:49.170 INFO:teuthology.orchestra.run.smithi204.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:25:49.171 INFO:teuthology.orchestra.run.smithi204.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:25:49.172 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:25:49.174 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:25:49.176 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:25:49.177 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:25:49.240 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-12T02:25:49.264 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================== 2024-09-12T02:25:49.264 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-12T02:25:49.264 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================== 2024-09-12T02:25:49.264 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-12T02:25:49.264 INFO:teuthology.orchestra.run.smithi204.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:25:49.264 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:25:49.265 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:25:49.266 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:25:49.267 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:25:49.268 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:25:49.269 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:25:49.271 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:25:49.272 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:25:49.273 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:25:49.274 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:25:49.275 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-09-12T02:25:49.276 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:25:49.277 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:25:49.277 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-12T02:25:49.277 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================== 2024-09-12T02:25:49.277 INFO:teuthology.orchestra.run.smithi204.stdout:Install 148 Packages 2024-09-12T02:25:49.277 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 8 Packages 2024-09-12T02:25:49.277 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:25:49.280 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 226 M 2024-09-12T02:25:49.280 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-12T02:25:49.705 INFO:teuthology.orchestra.run.smithi181.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 7.9 MB/s | 21 MB 00:02 2024-09-12T02:25:49.754 INFO:teuthology.orchestra.run.smithi181.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 508 kB/s | 25 kB 00:00 2024-09-12T02:25:49.921 INFO:teuthology.orchestra.run.smithi181.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 9.9 MB/s | 11 MB 00:01 2024-09-12T02:25:49.972 INFO:teuthology.orchestra.run.smithi181.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:25:50.030 INFO:teuthology.orchestra.run.smithi181.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 463 kB/s | 27 kB 00:00 2024-09-12T02:25:50.089 INFO:teuthology.orchestra.run.smithi181.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 544 kB/s | 32 kB 00:00 2024-09-12T02:25:50.134 INFO:teuthology.orchestra.run.smithi204.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-12T02:25:50.189 INFO:teuthology.orchestra.run.smithi181.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 752 kB 00:00 2024-09-12T02:25:50.364 INFO:teuthology.orchestra.run.smithi181.stdout:(15/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.0 MB/s | 17 MB 00:01 2024-09-12T02:25:50.381 INFO:teuthology.orchestra.run.smithi181.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 852 kB/s | 163 kB 00:00 2024-09-12T02:25:50.465 INFO:teuthology.orchestra.run.smithi181.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.2 MB/s | 127 kB 00:00 2024-09-12T02:25:50.467 INFO:teuthology.orchestra.run.smithi204.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.6 MB/s | 897 kB 00:00 2024-09-12T02:25:50.560 INFO:teuthology.orchestra.run.smithi204.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T02:25:50.635 INFO:teuthology.orchestra.run.smithi204.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 8.4 MB/s | 5.4 MB 00:00 2024-09-12T02:25:50.785 INFO:teuthology.orchestra.run.smithi204.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-12T02:25:50.840 INFO:teuthology.orchestra.run.smithi181.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 1.1 MB/s | 506 kB 00:00 2024-09-12T02:25:50.982 INFO:teuthology.orchestra.run.smithi181.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 319 kB/s | 45 kB 00:00 2024-09-12T02:25:51.116 INFO:teuthology.orchestra.run.smithi181.stdout:(20/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 8.2 MB/s | 5.3 MB 00:00 2024-09-12T02:25:51.144 INFO:teuthology.orchestra.run.smithi204.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.1 MB/s | 2.4 MB 00:00 2024-09-12T02:25:51.166 INFO:teuthology.orchestra.run.smithi181.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-12T02:25:51.191 INFO:teuthology.orchestra.run.smithi181.stdout:(22/156): python3-ceph-common-19.1.1-298.gb53b6 649 kB/s | 136 kB 00:00 2024-09-12T02:25:51.211 INFO:teuthology.orchestra.run.smithi204.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-12T02:25:51.217 INFO:teuthology.orchestra.run.smithi181.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.2 MB/s | 321 kB 00:00 2024-09-12T02:25:51.284 INFO:teuthology.orchestra.run.smithi181.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.5 MB/s | 100 kB 00:00 2024-09-12T02:25:51.334 INFO:teuthology.orchestra.run.smithi181.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:25:51.436 INFO:teuthology.orchestra.run.smithi204.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 21 MB 00:01 2024-09-12T02:25:51.442 INFO:teuthology.orchestra.run.smithi181.stdout:(26/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 301 kB 00:00 2024-09-12T02:25:51.478 INFO:teuthology.orchestra.run.smithi204.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 604 kB/s | 25 kB 00:00 2024-09-12T02:25:51.643 INFO:teuthology.orchestra.run.smithi181.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 854 kB/s | 171 kB 00:00 2024-09-12T02:25:51.718 INFO:teuthology.orchestra.run.smithi181.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 8.1 MB/s | 3.1 MB 00:00 2024-09-12T02:25:51.743 INFO:teuthology.orchestra.run.smithi181.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 317 kB/s | 32 kB 00:00 2024-09-12T02:25:51.802 INFO:teuthology.orchestra.run.smithi181.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-12T02:25:51.970 INFO:teuthology.orchestra.run.smithi204.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 14 MB/s | 11 MB 00:00 2024-09-12T02:25:52.054 INFO:teuthology.orchestra.run.smithi204.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 228 kB 00:00 2024-09-12T02:25:52.137 INFO:teuthology.orchestra.run.smithi204.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 324 kB/s | 27 kB 00:00 2024-09-12T02:25:52.221 INFO:teuthology.orchestra.run.smithi204.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 381 kB/s | 32 kB 00:00 2024-09-12T02:25:52.338 INFO:teuthology.orchestra.run.smithi204.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 6.3 MB/s | 752 kB 00:00 2024-09-12T02:25:52.430 INFO:teuthology.orchestra.run.smithi204.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.7 MB/s | 163 kB 00:00 2024-09-12T02:25:52.522 INFO:teuthology.orchestra.run.smithi204.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.4 MB/s | 127 kB 00:00 2024-09-12T02:25:52.630 INFO:teuthology.orchestra.run.smithi204.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.6 MB/s | 506 kB 00:00 2024-09-12T02:25:52.769 INFO:teuthology.orchestra.run.smithi181.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 7.7 MB/s | 7.4 MB 00:00 2024-09-12T02:25:52.844 INFO:teuthology.orchestra.run.smithi181.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-12T02:25:52.894 INFO:teuthology.orchestra.run.smithi181.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 984 kB/s | 49 kB 00:00 2024-09-12T02:25:52.972 INFO:teuthology.orchestra.run.smithi204.stdout:(18/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.2 MB/s | 17 MB 00:01 2024-09-12T02:25:53.073 INFO:teuthology.orchestra.run.smithi204.stdout:(19/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-12T02:25:53.098 INFO:teuthology.orchestra.run.smithi204.stdout:(20/156): python3-ceph-argparse-19.1.1-298.gb53 361 kB/s | 45 kB 00:00 2024-09-12T02:25:53.123 INFO:teuthology.orchestra.run.smithi204.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 2.7 MB/s | 136 kB 00:00 2024-09-12T02:25:53.149 INFO:teuthology.orchestra.run.smithi204.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.1 MB/s | 162 kB 00:00 2024-09-12T02:25:53.174 INFO:teuthology.orchestra.run.smithi204.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T02:25:53.207 INFO:teuthology.orchestra.run.smithi204.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T02:25:53.233 INFO:teuthology.orchestra.run.smithi204.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-12T02:25:53.275 INFO:teuthology.orchestra.run.smithi204.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-12T02:25:53.311 INFO:teuthology.orchestra.run.smithi181.stdout:(34/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T02:25:53.325 INFO:teuthology.orchestra.run.smithi204.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T02:25:53.336 INFO:teuthology.orchestra.run.smithi181.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 37 kB/s | 16 kB 00:00 2024-09-12T02:25:53.362 INFO:teuthology.orchestra.run.smithi181.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T02:25:53.384 INFO:teuthology.orchestra.run.smithi204.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 547 kB/s | 32 kB 00:00 2024-09-12T02:25:53.420 INFO:teuthology.orchestra.run.smithi181.stdout:(37/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 2.1 MB/s | 3.6 MB 00:01 2024-09-12T02:25:53.442 INFO:teuthology.orchestra.run.smithi204.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-12T02:25:53.445 INFO:teuthology.orchestra.run.smithi181.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 218 kB/s | 18 kB 00:00 2024-09-12T02:25:53.468 INFO:teuthology.orchestra.run.smithi204.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-12T02:25:53.479 INFO:teuthology.orchestra.run.smithi181.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.2 MB/s | 765 kB 00:00 2024-09-12T02:25:53.596 INFO:teuthology.orchestra.run.smithi181.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-12T02:25:53.701 INFO:teuthology.orchestra.run.smithi204.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 14 MB/s | 3.6 MB 00:00 2024-09-12T02:25:53.713 INFO:teuthology.orchestra.run.smithi181.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 819 kB/s | 191 kB 00:00 2024-09-12T02:25:53.738 INFO:teuthology.orchestra.run.smithi181.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-12T02:25:53.764 INFO:teuthology.orchestra.run.smithi181.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-12T02:25:53.768 INFO:teuthology.orchestra.run.smithi204.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-12T02:25:53.789 INFO:teuthology.orchestra.run.smithi181.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T02:25:53.822 INFO:teuthology.orchestra.run.smithi181.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T02:25:53.827 INFO:teuthology.orchestra.run.smithi204.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 848 kB/s | 49 kB 00:00 2024-09-12T02:25:53.848 INFO:teuthology.orchestra.run.smithi181.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T02:25:53.881 INFO:teuthology.orchestra.run.smithi181.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T02:25:53.915 INFO:teuthology.orchestra.run.smithi181.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-12T02:25:54.286 INFO:teuthology.orchestra.run.smithi204.stdout:(34/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 17 MB/s | 49 MB 00:02 2024-09-12T02:25:54.311 INFO:teuthology.orchestra.run.smithi204.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 34 kB/s | 16 kB 00:00 2024-09-12T02:25:54.395 INFO:teuthology.orchestra.run.smithi204.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 8.0 MB/s | 7.4 MB 00:00 2024-09-12T02:25:54.420 INFO:teuthology.orchestra.run.smithi204.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.1 MB/s | 285 kB 00:00 2024-09-12T02:25:54.445 INFO:teuthology.orchestra.run.smithi204.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 364 kB/s | 18 kB 00:00 2024-09-12T02:25:54.504 INFO:teuthology.orchestra.run.smithi204.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.9 MB/s | 765 kB 00:00 2024-09-12T02:25:54.582 INFO:teuthology.orchestra.run.smithi181.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-12T02:25:54.904 INFO:teuthology.orchestra.run.smithi204.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 165 kB/s | 80 kB 00:00 2024-09-12T02:25:54.924 INFO:teuthology.orchestra.run.smithi181.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 641 kB/s | 689 kB 00:01 2024-09-12T02:25:55.046 INFO:teuthology.orchestra.run.smithi204.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 353 kB/s | 191 kB 00:00 2024-09-12T02:25:55.149 INFO:teuthology.orchestra.run.smithi181.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-09-12T02:25:55.280 INFO:teuthology.orchestra.run.smithi204.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 675 kB/s | 253 kB 00:00 2024-09-12T02:25:55.355 INFO:teuthology.orchestra.run.smithi204.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 881 kB/s | 801 kB 00:00 2024-09-12T02:25:55.389 INFO:teuthology.orchestra.run.smithi204.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-09-12T02:25:55.464 INFO:teuthology.orchestra.run.smithi204.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-12T02:25:55.498 INFO:teuthology.orchestra.run.smithi204.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-12T02:25:55.531 INFO:teuthology.orchestra.run.smithi204.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-12T02:25:55.549 INFO:teuthology.orchestra.run.smithi181.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 565 kB/s | 943 kB 00:01 2024-09-12T02:25:55.582 INFO:teuthology.orchestra.run.smithi204.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-12T02:25:55.700 INFO:teuthology.orchestra.run.smithi181.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-12T02:25:55.749 INFO:teuthology.orchestra.run.smithi204.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-12T02:25:55.807 INFO:teuthology.orchestra.run.smithi204.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-12T02:25:55.833 INFO:teuthology.orchestra.run.smithi204.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-12T02:25:55.874 INFO:teuthology.orchestra.run.smithi204.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-12T02:25:55.908 INFO:teuthology.orchestra.run.smithi204.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 433 kB/s | 33 kB 00:00 2024-09-12T02:25:55.950 INFO:teuthology.orchestra.run.smithi204.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-12T02:25:55.967 INFO:teuthology.orchestra.run.smithi181.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 301 kB/s | 313 kB 00:01 2024-09-12T02:25:55.975 INFO:teuthology.orchestra.run.smithi204.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-12T02:25:56.001 INFO:teuthology.orchestra.run.smithi204.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T02:25:56.051 INFO:teuthology.orchestra.run.smithi204.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-12T02:25:56.076 INFO:teuthology.orchestra.run.smithi204.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-12T02:25:56.168 INFO:teuthology.orchestra.run.smithi204.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-12T02:25:56.183 INFO:teuthology.orchestra.run.smithi181.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-12T02:25:56.202 INFO:teuthology.orchestra.run.smithi204.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-12T02:25:56.227 INFO:teuthology.orchestra.run.smithi204.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-12T02:25:56.252 INFO:teuthology.orchestra.run.smithi204.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T02:25:56.311 INFO:teuthology.orchestra.run.smithi204.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-12T02:25:56.361 INFO:teuthology.orchestra.run.smithi204.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 773 kB/s | 38 kB 00:00 2024-09-12T02:25:56.395 INFO:teuthology.orchestra.run.smithi204.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-12T02:25:56.442 INFO:teuthology.orchestra.run.smithi181.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-12T02:25:57.001 INFO:teuthology.orchestra.run.smithi181.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 198 kB/s | 160 kB 00:00 2024-09-12T02:25:57.034 INFO:teuthology.orchestra.run.smithi181.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2024-09-12T02:25:57.104 INFO:teuthology.orchestra.run.smithi204.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-09-12T02:25:57.460 INFO:teuthology.orchestra.run.smithi181.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.6 MB/s | 3.0 MB 00:01 2024-09-12T02:25:57.887 INFO:teuthology.orchestra.run.smithi204.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-12T02:25:57.901 INFO:teuthology.orchestra.run.smithi181.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 736 kB/s | 662 kB 00:00 2024-09-12T02:25:57.994 INFO:teuthology.orchestra.run.smithi181.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-12T02:25:58.018 INFO:teuthology.orchestra.run.smithi181.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 590 kB/s | 581 kB 00:00 2024-09-12T02:25:58.354 INFO:teuthology.orchestra.run.smithi204.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 1.9 MB/s | 910 kB 00:00 2024-09-12T02:25:58.454 INFO:teuthology.orchestra.run.smithi204.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.4 MB/s | 4.9 MB 00:02 2024-09-12T02:25:58.505 INFO:teuthology.orchestra.run.smithi204.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 914 kB/s | 137 kB 00:00 2024-09-12T02:25:58.535 INFO:teuthology.orchestra.run.smithi181.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-09-12T02:25:58.655 INFO:teuthology.orchestra.run.smithi204.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-12T02:25:58.738 INFO:teuthology.orchestra.run.smithi204.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-12T02:25:58.802 INFO:teuthology.orchestra.run.smithi181.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 240 kB/s | 188 kB 00:00 2024-09-12T02:25:58.869 INFO:teuthology.orchestra.run.smithi181.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 334 kB/s | 292 kB 00:00 2024-09-12T02:25:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-12T02:25:59.094 INFO:teuthology.orchestra.run.smithi181.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-12T02:25:59.123 INFO:teuthology.orchestra.run.smithi204.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T02:25:59.273 INFO:teuthology.orchestra.run.smithi204.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-12T02:25:59.415 INFO:teuthology.orchestra.run.smithi204.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-12T02:25:59.465 INFO:teuthology.orchestra.run.smithi204.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T02:25:59.515 INFO:teuthology.orchestra.run.smithi204.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T02:25:59.632 INFO:teuthology.orchestra.run.smithi204.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-12T02:25:59.683 INFO:teuthology.orchestra.run.smithi204.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-12T02:26:00.495 INFO:teuthology.orchestra.run.smithi181.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.9 MB/s | 4.9 MB 00:01 2024-09-12T02:26:01.153 INFO:teuthology.orchestra.run.smithi181.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 792 kB/s | 1.6 MB 00:02 2024-09-12T02:26:01.375 INFO:teuthology.orchestra.run.smithi204.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.0 MB/s | 5.8 MB 00:02 2024-09-12T02:26:01.395 INFO:teuthology.orchestra.run.smithi181.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2024-09-12T02:26:01.458 INFO:teuthology.orchestra.run.smithi204.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-12T02:26:01.517 INFO:teuthology.orchestra.run.smithi204.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T02:26:01.576 INFO:teuthology.orchestra.run.smithi204.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 250 kB 00:00 2024-09-12T02:26:01.601 INFO:teuthology.orchestra.run.smithi204.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 923 kB/s | 77 kB 00:00 2024-09-12T02:26:01.626 INFO:teuthology.orchestra.run.smithi204.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-12T02:26:01.679 INFO:teuthology.orchestra.run.smithi204.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.4 MB/s | 269 kB 00:00 2024-09-12T02:26:01.735 INFO:teuthology.orchestra.run.smithi204.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.8 MB/s | 279 kB 00:00 2024-09-12T02:26:01.760 INFO:teuthology.orchestra.run.smithi204.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-12T02:26:01.844 INFO:teuthology.orchestra.run.smithi204.stdout:(90/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-09-12T02:26:01.869 INFO:teuthology.orchestra.run.smithi204.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 381 kB/s | 51 kB 00:00 2024-09-12T02:26:01.894 INFO:teuthology.orchestra.run.smithi204.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 401 kB/s | 54 kB 00:00 2024-09-12T02:26:01.944 INFO:teuthology.orchestra.run.smithi204.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-09-12T02:26:01.945 INFO:teuthology.orchestra.run.smithi181.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 173 kB/s | 137 kB 00:00 2024-09-12T02:26:01.970 INFO:teuthology.orchestra.run.smithi204.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-12T02:26:02.003 INFO:teuthology.orchestra.run.smithi204.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T02:26:02.029 INFO:teuthology.orchestra.run.smithi204.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-12T02:26:02.054 INFO:teuthology.orchestra.run.smithi204.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T02:26:02.104 INFO:teuthology.orchestra.run.smithi204.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:26:02.162 INFO:teuthology.orchestra.run.smithi181.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 546 kB/s | 910 kB 00:01 2024-09-12T02:26:02.163 INFO:teuthology.orchestra.run.smithi204.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T02:26:02.222 INFO:teuthology.orchestra.run.smithi204.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-12T02:26:02.247 INFO:teuthology.orchestra.run.smithi204.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-09-12T02:26:02.272 INFO:teuthology.orchestra.run.smithi204.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T02:26:02.322 INFO:teuthology.orchestra.run.smithi204.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-09-12T02:26:02.373 INFO:teuthology.orchestra.run.smithi204.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T02:26:02.406 INFO:teuthology.orchestra.run.smithi204.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T02:26:02.432 INFO:teuthology.orchestra.run.smithi204.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-12T02:26:02.474 INFO:teuthology.orchestra.run.smithi204.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-12T02:26:02.524 INFO:teuthology.orchestra.run.smithi204.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-12T02:26:02.550 INFO:teuthology.orchestra.run.smithi204.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:26:02.583 INFO:teuthology.orchestra.run.smithi204.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T02:26:02.617 INFO:teuthology.orchestra.run.smithi204.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-12T02:26:02.675 INFO:teuthology.orchestra.run.smithi204.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T02:26:02.718 INFO:teuthology.orchestra.run.smithi204.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T02:26:02.742 INFO:teuthology.orchestra.run.smithi204.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:26:02.768 INFO:teuthology.orchestra.run.smithi204.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:26:02.793 INFO:teuthology.orchestra.run.smithi204.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-12T02:26:02.812 INFO:teuthology.orchestra.run.smithi181.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 135 kB/s | 87 kB 00:00 2024-09-12T02:26:02.818 INFO:teuthology.orchestra.run.smithi204.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-09-12T02:26:02.844 INFO:teuthology.orchestra.run.smithi204.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:26:02.878 INFO:teuthology.orchestra.run.smithi204.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T02:26:02.903 INFO:teuthology.orchestra.run.smithi204.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-12T02:26:02.928 INFO:teuthology.orchestra.run.smithi204.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:26:02.962 INFO:teuthology.orchestra.run.smithi204.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T02:26:02.987 INFO:teuthology.orchestra.run.smithi204.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-12T02:26:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-09-12T02:26:03.012 INFO:teuthology.orchestra.run.smithi204.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-12T02:26:03.038 INFO:teuthology.orchestra.run.smithi204.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-12T02:26:03.055 INFO:teuthology.orchestra.run.smithi204.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T02:26:03.071 INFO:teuthology.orchestra.run.smithi204.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T02:26:03.122 INFO:teuthology.orchestra.run.smithi204.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-12T02:26:03.139 INFO:teuthology.orchestra.run.smithi204.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-12T02:26:03.164 INFO:teuthology.orchestra.run.smithi204.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:26:03.181 INFO:teuthology.orchestra.run.smithi204.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T02:26:03.223 INFO:teuthology.orchestra.run.smithi204.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-12T02:26:03.248 INFO:teuthology.orchestra.run.smithi204.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-12T02:26:03.273 INFO:teuthology.orchestra.run.smithi204.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-12T02:26:03.299 INFO:teuthology.orchestra.run.smithi204.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T02:26:03.324 INFO:teuthology.orchestra.run.smithi204.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T02:26:03.350 INFO:teuthology.orchestra.run.smithi204.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 608 kB/s | 31 kB 00:00 2024-09-12T02:26:03.375 INFO:teuthology.orchestra.run.smithi204.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:26:03.400 INFO:teuthology.orchestra.run.smithi204.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:26:03.426 INFO:teuthology.orchestra.run.smithi204.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T02:26:03.451 INFO:teuthology.orchestra.run.smithi204.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T02:26:03.476 INFO:teuthology.orchestra.run.smithi204.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T02:26:03.502 INFO:teuthology.orchestra.run.smithi204.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T02:26:03.527 INFO:teuthology.orchestra.run.smithi204.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-12T02:26:03.560 INFO:teuthology.orchestra.run.smithi204.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-12T02:26:03.586 INFO:teuthology.orchestra.run.smithi204.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T02:26:03.636 INFO:teuthology.orchestra.run.smithi204.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T02:26:03.663 INFO:teuthology.orchestra.run.smithi181.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 92 kB/s | 61 kB 00:00 2024-09-12T02:26:03.780 INFO:teuthology.orchestra.run.smithi181.stdout:(75/156): protobuf-3.14.0-13.el9.x86_64.rpm 563 kB/s | 1.0 MB 00:01 2024-09-12T02:26:03.912 INFO:teuthology.orchestra.run.smithi204.stdout:(148/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-12T02:26:03.987 INFO:teuthology.orchestra.run.smithi204.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-12T02:26:04.588 INFO:teuthology.orchestra.run.smithi181.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-09-12T02:26:04.613 INFO:teuthology.orchestra.run.smithi181.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 258 kB/s | 245 kB 00:00 2024-09-12T02:26:04.647 INFO:teuthology.orchestra.run.smithi181.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 286 kB/s | 248 kB 00:00 2024-09-12T02:26:04.929 INFO:teuthology.orchestra.run.smithi204.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-12T02:26:05.004 INFO:teuthology.orchestra.run.smithi204.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-09-12T02:26:05.037 INFO:teuthology.orchestra.run.smithi204.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 375 kB/s | 41 kB 00:00 2024-09-12T02:26:05.097 INFO:teuthology.orchestra.run.smithi181.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-12T02:26:05.121 INFO:teuthology.orchestra.run.smithi204.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-12T02:26:05.122 INFO:teuthology.orchestra.run.smithi181.stdout:(80/156): python3-jsonpatch-1.21-16.el9.noarch. 48 kB/s | 26 kB 00:00 2024-09-12T02:26:05.263 INFO:teuthology.orchestra.run.smithi204.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-12T02:26:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 222 kB/s | 172 kB 00:00 2024-09-12T02:26:05.438 INFO:teuthology.orchestra.run.smithi204.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.6 MB/s | 2.4 MB 00:00 2024-09-12T02:26:05.773 INFO:teuthology.orchestra.run.smithi181.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 51 kB/s | 35 kB 00:00 2024-09-12T02:26:06.398 INFO:teuthology.orchestra.run.smithi181.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 257 kB/s | 250 kB 00:00 2024-09-12T02:26:06.532 INFO:teuthology.orchestra.run.smithi181.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 296 kB/s | 222 kB 00:00 2024-09-12T02:26:06.632 INFO:teuthology.orchestra.run.smithi181.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.4 MB/s | 5.1 MB 00:01 2024-09-12T02:26:06.664 INFO:teuthology.orchestra.run.smithi204.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.4 MB/s | 16 MB 00:04 2024-09-12T02:26:06.669 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:26:06.669 INFO:teuthology.orchestra.run.smithi204.stdout:Total 13 MB/s | 226 MB 00:17 2024-09-12T02:26:07.116 INFO:teuthology.orchestra.run.smithi181.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 108 kB/s | 77 kB 00:00 2024-09-12T02:26:07.141 INFO:teuthology.orchestra.run.smithi181.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 69 kB/s | 42 kB 00:00 2024-09-12T02:26:07.491 INFO:teuthology.orchestra.run.smithi181.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 317 kB/s | 269 kB 00:00 2024-09-12T02:26:07.833 INFO:teuthology.orchestra.run.smithi181.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 221 kB/s | 159 kB 00:00 2024-09-12T02:26:07.841 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-12T02:26:07.900 INFO:teuthology.orchestra.run.smithi181.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 368 kB/s | 279 kB 00:00 2024-09-12T02:26:07.996 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-12T02:26:07.996 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-12T02:26:08.100 INFO:teuthology.orchestra.run.smithi181.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-12T02:26:08.434 INFO:teuthology.orchestra.run.smithi181.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-12T02:26:08.659 INFO:teuthology.orchestra.run.smithi181.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-12T02:26:09.018 INFO:teuthology.orchestra.run.smithi181.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 76 kB/s | 44 kB 00:00 2024-09-12T02:26:09.335 INFO:teuthology.orchestra.run.smithi181.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T02:26:09.443 INFO:teuthology.orchestra.run.smithi181.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 282 kB/s | 221 kB 00:00 2024-09-12T02:26:09.752 INFO:teuthology.orchestra.run.smithi181.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 49 kB/s | 36 kB 00:00 2024-09-12T02:26:09.927 INFO:teuthology.orchestra.run.smithi181.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-09-12T02:26:10.232 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-12T02:26:10.233 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-12T02:26:10.235 INFO:teuthology.orchestra.run.smithi181.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 384 kB/s | 304 kB 00:00 2024-09-12T02:26:10.411 INFO:teuthology.orchestra.run.smithi181.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 88 kB/s | 58 kB 00:00 2024-09-12T02:26:10.644 INFO:teuthology.orchestra.run.smithi181.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 134 kB/s | 96 kB 00:00 2024-09-12T02:26:10.744 INFO:teuthology.orchestra.run.smithi181.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-12T02:26:10.853 INFO:teuthology.orchestra.run.smithi181.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-12T02:26:10.903 INFO:teuthology.orchestra.run.smithi181.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T02:26:10.928 INFO:teuthology.orchestra.run.smithi181.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T02:26:10.962 INFO:teuthology.orchestra.run.smithi181.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-12T02:26:10.988 INFO:teuthology.orchestra.run.smithi181.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-12T02:26:11.021 INFO:teuthology.orchestra.run.smithi181.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:26:11.046 INFO:teuthology.orchestra.run.smithi181.stdout:(109/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-12T02:26:11.072 INFO:teuthology.orchestra.run.smithi181.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-12T02:26:11.105 INFO:teuthology.orchestra.run.smithi181.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.7 MB/s | 151 kB 00:00 2024-09-12T02:26:11.147 INFO:teuthology.orchestra.run.smithi181.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 668 kB/s | 67 kB 00:00 2024-09-12T02:26:11.306 INFO:teuthology.orchestra.run.smithi181.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-09-12T02:26:11.331 INFO:teuthology.orchestra.run.smithi181.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:26:11.357 INFO:teuthology.orchestra.run.smithi181.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:26:11.382 INFO:teuthology.orchestra.run.smithi181.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-12T02:26:11.416 INFO:teuthology.orchestra.run.smithi181.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-09-12T02:26:11.441 INFO:teuthology.orchestra.run.smithi181.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T02:26:11.475 INFO:teuthology.orchestra.run.smithi181.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T02:26:11.500 INFO:teuthology.orchestra.run.smithi181.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T02:26:11.525 INFO:teuthology.orchestra.run.smithi181.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:26:11.550 INFO:teuthology.orchestra.run.smithi181.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T02:26:11.576 INFO:teuthology.orchestra.run.smithi181.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T02:26:11.601 INFO:teuthology.orchestra.run.smithi181.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-12T02:26:11.626 INFO:teuthology.orchestra.run.smithi181.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-12T02:26:11.651 INFO:teuthology.orchestra.run.smithi181.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-12T02:26:11.677 INFO:teuthology.orchestra.run.smithi181.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-12T02:26:11.744 INFO:teuthology.orchestra.run.smithi181.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-09-12T02:26:11.769 INFO:teuthology.orchestra.run.smithi181.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:26:11.794 INFO:teuthology.orchestra.run.smithi181.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:26:11.844 INFO:teuthology.orchestra.run.smithi181.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-12T02:26:11.878 INFO:teuthology.orchestra.run.smithi181.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-12T02:26:11.903 INFO:teuthology.orchestra.run.smithi181.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 530 kB/s | 58 kB 00:00 2024-09-12T02:26:11.929 INFO:teuthology.orchestra.run.smithi181.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-12T02:26:11.954 INFO:teuthology.orchestra.run.smithi181.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T02:26:11.979 INFO:teuthology.orchestra.run.smithi181.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T02:26:12.004 INFO:teuthology.orchestra.run.smithi181.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-12T02:26:12.030 INFO:teuthology.orchestra.run.smithi181.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-12T02:26:12.055 INFO:teuthology.orchestra.run.smithi181.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T02:26:12.080 INFO:teuthology.orchestra.run.smithi181.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-12T02:26:12.106 INFO:teuthology.orchestra.run.smithi181.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-12T02:26:12.131 INFO:teuthology.orchestra.run.smithi181.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-12T02:26:12.156 INFO:teuthology.orchestra.run.smithi181.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:26:12.214 INFO:teuthology.orchestra.run.smithi181.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 348 kB/s | 20 kB 00:00 2024-09-12T02:26:12.248 INFO:teuthology.orchestra.run.smithi181.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-09-12T02:26:12.274 INFO:teuthology.orchestra.run.smithi181.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2024-09-12T02:26:12.299 INFO:teuthology.orchestra.run.smithi181.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-12T02:26:12.341 INFO:teuthology.orchestra.run.smithi181.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T02:26:12.558 INFO:teuthology.orchestra.run.smithi181.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:26:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 6.6 MB/s | 3.2 MB 00:00 2024-09-12T02:26:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 350 kB/s | 41 kB 00:00 2024-09-12T02:26:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 3.5 MB/s | 2.3 MB 00:00 2024-09-12T02:26:13.026 INFO:teuthology.orchestra.run.smithi181.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-12T02:26:13.168 INFO:teuthology.orchestra.run.smithi181.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.0 MB/s | 1.8 MB 00:00 2024-09-12T02:26:13.668 INFO:teuthology.orchestra.run.smithi181.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 2.4 MB 00:00 2024-09-12T02:26:13.726 INFO:teuthology.orchestra.run.smithi181.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-12T02:26:13.733 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:26:13.733 INFO:teuthology.orchestra.run.smithi181.stdout:Total 8.3 MB/s | 226 MB 00:27 2024-09-12T02:26:14.915 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-12T02:26:15.068 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-12T02:26:15.068 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-12T02:26:16.690 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-12T02:26:16.813 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:26:16.853 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:26:16.905 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:26:16.938 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:26:16.972 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:26:17.020 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:26:17.255 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-12T02:26:17.255 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-12T02:26:17.423 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:26:17.498 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:26:17.619 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:26:17.649 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:26:17.740 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:26:17.771 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:26:17.945 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:26:18.000 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:26:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:26:18.132 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:26:18.154 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:26:18.221 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:26:18.247 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:26:18.273 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:26:18.465 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:26:18.646 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:26:18.798 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:26:18.916 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:26:18.997 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:26:19.237 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:26:19.357 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:26:19.465 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:26:19.511 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:26:19.554 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:26:19.619 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:26:19.663 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:26:19.729 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:26:19.781 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:26:19.814 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:26:19.842 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:26:19.909 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:26:19.962 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:26:19.995 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:26:20.038 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:26:20.122 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:26:20.165 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:26:20.209 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:26:20.237 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:26:20.306 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:26:20.352 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:26:20.426 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:26:20.558 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:26:20.613 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:26:21.140 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:26:21.234 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:26:21.271 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:26:21.314 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:26:21.352 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:26:21.395 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:26:21.557 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:26:21.622 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:26:21.677 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:26:21.750 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:26:21.790 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:26:21.843 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:26:21.889 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:26:21.926 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:26:21.969 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:26:22.011 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:26:22.145 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:26:22.197 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:26:22.238 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:26:22.347 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:26:22.479 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:26:22.640 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:26:22.671 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:26:22.696 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:26:22.785 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:26:22.912 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:26:22.948 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:26:22.985 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:26:23.022 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:26:23.057 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:26:23.089 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:26:23.119 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:26:23.154 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:26:23.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:26:23.228 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:26:23.272 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:26:23.383 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:26:23.444 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:26:23.489 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:26:23.567 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-12T02:26:23.577 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:26:23.626 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:26:23.672 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:26:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:26:23.772 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:26:23.814 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:26:23.841 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:26:23.897 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:26:24.224 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:26:24.333 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:26:24.341 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:26:24.390 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:26:24.424 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:26:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:26:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:26:24.522 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:26:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:26:24.579 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:26:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:26:24.625 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:26:24.720 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:26:24.760 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:26:24.765 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:26:24.818 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:26:24.847 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:26:24.943 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:26:24.946 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:26:24.973 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:26:24.977 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:26:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:26:25.056 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:26:25.057 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:26:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:26:25.276 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:26:25.450 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:26:25.563 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:26:25.676 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:26:25.708 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:26:25.757 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:26:25.826 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:26:25.972 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:26:26.078 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:26:26.164 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:26:26.210 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:26:26.254 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:26:26.319 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:26:26.363 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:26:26.396 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:26:26.439 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:26:26.472 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:26:26.499 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:26:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:26:26.631 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:26:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:26:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:26:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:26:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:26:26.859 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:26:26.887 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:26:26.957 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:26:27.002 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:26:27.062 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:26:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:26:27.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:26:27.212 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:26:27.220 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:26:27.271 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:26:27.530 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:26:27.575 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:26:27.665 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:26:27.696 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:26:27.733 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:26:27.799 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:26:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:26:27.913 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:26:27.955 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:26:27.993 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:26:28.036 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:26:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:26:28.210 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:26:28.244 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:26:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:26:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:26:28.301 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:26:28.329 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:26:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:26:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:26:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:26:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:26:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:26:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:26:28.618 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:26:28.755 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:26:28.820 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:26:28.862 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:26:28.964 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:26:28.996 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:26:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:26:29.070 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:26:29.094 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:26:29.185 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:26:29.312 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:26:29.343 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:26:29.387 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:26:29.433 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:26:29.469 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:26:29.501 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:26:29.534 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:26:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:26:29.602 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:26:29.643 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:26:29.686 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:26:29.765 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:26:29.808 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:26:29.840 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:26:29.942 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:26:29.991 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:26:30.607 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:26:30.651 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:26:30.710 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:26:30.754 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:26:30.787 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:26:30.887 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:26:30.935 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:26:30.979 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:26:31.068 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:26:31.107 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:26:31.197 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:26:31.238 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:26:31.290 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:26:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:26:31.322 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:26:31.322 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:26:31.322 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:26:31.322 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:31.365 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:26:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:26:32.048 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:26:32.162 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:26:33.413 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:26:33.501 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:26:33.529 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:26:33.562 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:26:33.883 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:26:33.925 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:26:34.015 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:26:34.078 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:26:34.553 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:26:34.586 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:26:34.657 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:26:34.680 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:26:37.019 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:26:37.253 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:26:37.802 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:26:37.839 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:26:37.931 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:26:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:26:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:26:37.932 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:37.966 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:26:43.081 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:26:43.081 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-09-12T02:26:43.081 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-09-12T02:26:43.081 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-09-12T02:26:43.082 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-09-12T02:26:43.082 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-09-12T02:26:43.082 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2024-09-12T02:26:43.082 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-09-12T02:26:43.082 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:43.251 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:26:43.267 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:26:43.267 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:43.267 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:26:43.267 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:44.763 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:26:44.789 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:26:44.789 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:44.789 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:26:44.789 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:26:44.789 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:26:44.790 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:45.023 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:26:45.046 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:26:45.047 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:45.047 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:26:45.047 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:26:45.047 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:26:45.047 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:45.491 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:26:45.514 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:26:45.514 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:45.514 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:26:45.514 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:26:45.514 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:26:45.514 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:45.629 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:26:45.686 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:26:45.741 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:26:45.925 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:26:45.975 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:26:46.052 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:26:46.148 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:26:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:26:46.337 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:26:46.373 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:26:46.402 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:26:46.777 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:26:46.809 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:26:46.849 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:26:46.911 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:26:46.940 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:26:47.975 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:26:48.026 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:26:48.987 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:26:49.018 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:26:49.118 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:26:49.287 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:26:49.320 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:26:49.344 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:26:49.344 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:49.344 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:26:49.344 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:26:49.344 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:26:49.344 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:49.404 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:26:49.416 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:26:49.513 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-09-12T02:26:49.555 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:49.575 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:26:49.736 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:26:49.752 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:26:49.752 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:49.752 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:26:49.752 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:50.503 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:26:50.532 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:26:50.555 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:26:50.555 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:50.555 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:26:50.555 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:26:50.555 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:26:50.555 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:50.599 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:26:50.621 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:26:50.622 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:50.622 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:26:50.622 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:50.666 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:26:50.689 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:26:50.689 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:50.690 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:26:50.690 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:26:50.690 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:26:50.690 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:50.993 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:26:51.016 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:26:51.016 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:51.016 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:26:51.016 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:26:51.016 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:26:51.016 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:26:51.247 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:26:51.274 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:26:51.274 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:51.274 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:26:51.274 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:26:51.274 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:26:51.274 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:51.498 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:26:51.521 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:26:51.521 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:51.521 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:26:51.521 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:26:51.521 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:26:51.521 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:51.957 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:26:51.980 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:26:51.980 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:51.980 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:26:51.980 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:26:51.980 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:26:51.980 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:26:52.143 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:26:52.199 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:26:52.383 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:26:52.440 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:26:52.518 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:26:52.607 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:26:52.746 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:26:52.799 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:26:52.831 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:26:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:26:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:26:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:26:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:26:53.434 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:26:53.464 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:26:54.502 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:26:54.532 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:26:55.491 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:26:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:26:55.555 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:26:55.604 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:26:55.619 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:26:55.644 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:26:55.699 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:26:55.730 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:26:55.777 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:26:55.810 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:26:55.833 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:26:55.833 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:55.833 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:26:55.833 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:26:55.833 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:26:55.833 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:26:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:26:55.920 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:26:55.968 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:26:55.986 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:26:55.998 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:26:56.028 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:26:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:26:56.074 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:26:56.689 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:26:56.723 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:26:56.742 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:26:56.973 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:26:57.004 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:26:57.028 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:26:57.028 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:57.028 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:26:57.028 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:26:57.028 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:26:57.028 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:57.071 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:26:57.094 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:26:57.095 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:57.095 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:26:57.095 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:57.147 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:26:57.170 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:26:57.170 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:57.170 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:26:57.170 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:26:57.171 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:26:57.171 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:57.473 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:26:57.496 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:26:57.496 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:26:57.496 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:26:57.496 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:26:57.496 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:26:57.496 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:26:57.578 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:26:57.669 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:26:57.719 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:26:57.818 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:26:57.848 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:26:57.874 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:26:57.908 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:26:57.908 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:26:58.000 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:26:58.000 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:26:58.092 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:26:58.117 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:26:58.123 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:26:58.123 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:26:58.303 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:26:58.303 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:26:58.395 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:26:58.460 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:02.052 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:27:02.093 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:27:02.134 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:27:02.166 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:27:02.201 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:27:02.393 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:27:02.440 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:27:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:27:02.500 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:27:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:27:03.106 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:03.152 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:03.172 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:27:04.010 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:27:04.090 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:27:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:27:04.221 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:27:04.251 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:27:04.277 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:27:04.319 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:27:04.320 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:27:04.373 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:27:04.374 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:27:04.375 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:27:04.387 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:27:04.475 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:27:04.476 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:27:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:27:04.478 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:27:04.479 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:27:04.480 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:27:04.504 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:27:04.512 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:04.512 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:04.689 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:27:04.689 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:27:04.782 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:27:04.847 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:27:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:27:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:27:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:27:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:27:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:27:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:27:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:27:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:27:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:27:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:27:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:27:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:07.183 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-12T02:27:07.611 DEBUG:teuthology.parallel:result is None 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:27:10.665 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:27:10.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:27:10.667 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:27:10.668 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:27:10.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:27:10.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:27:10.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:27:10.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:27:10.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:27:10.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:27:10.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:27:10.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:27:10.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:27:10.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:27:10.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:27:10.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:27:10.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:27:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:13.440 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:27:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:27:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:27:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:27:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:27:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:27:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:27:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:27:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:27:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:13.452 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-12T02:27:13.863 DEBUG:teuthology.parallel:result is None 2024-09-12T02:27:13.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:27:14.011 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:27:14.034 INFO:teuthology.orchestra.run.smithi181.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:27:14.035 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:27:14.035 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:27:14.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:27:14.172 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:27:14.200 INFO:teuthology.orchestra.run.smithi204.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:27:14.200 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:27:14.200 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:27:14.202 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:27:14.203 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:14.203 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:27:14.231 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:14.231 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:27:14.272 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:27:14.273 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:14.273 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:27:14.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:27:14.363 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:14.363 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:27:14.392 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:27:14.460 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:27:14.460 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:14.461 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:27:14.485 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:27:14.550 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:14.550 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:27:14.578 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:27:14.646 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:27:14.646 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:14.646 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:27:14.670 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:27:14.735 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:14.735 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:27:14.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:27:14.829 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T02:27:14.907 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T02:27:14.907 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-09-12T02:27:14.910 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-09-12T02:27:14.936 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T02:27:14.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:27:14.974 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:27:15.002 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T02:27:15.002 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:27:15.039 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:27:15.074 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T02:27:15.074 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T02:27:15.074 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T02:27:15.075 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:15.075 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:27:15.117 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:15.230 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:15.254 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:15.254 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:27:15.270 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:15.384 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:15.414 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T02:27:15.414 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T02:27:15.414 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/journal-repair}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901623', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBO3e4UQxPR+byhVVn5OR6P8UCFSYLFyavpO4XclUrg7itJoYCJXt5gIIWdHBTIdJhkL3aPh3fLPhdt4AH9Idf4=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpFyZG0+uYQ2JoOHhr0Q2B+g9QFcX/DleBeGoYXhU9XrJ5bmheuluhe8szdY9Mw5sbpKs6GaMFLS5NdKDhTCjw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_journal_repair']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T02:27:15.415 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:27:15.417 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:27:15.465 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:27:15.473 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:27:15.529 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:15.529 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:27:15.551 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:27:15.551 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-12T02:27:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:27:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:15.605 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:27:15.605 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:15.605 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:15.606 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 02:27:05.206656801 +0000 2024-09-12T02:27:15.606 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 02:25:02.415595959 +0000 2024-09-12T02:27:15.606 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 02:25:02.415595959 +0000 2024-09-12T02:27:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 02:25:02.415595959 +0000 2024-09-12T02:27:15.606 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:27:15.668 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T02:27:15.668 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T02:27:15.668 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000240589 s, 2.1 MB/s 2024-09-12T02:27:15.669 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:27:15.725 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 02:27:05.206656801 +0000 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 02:25:02.742589319 +0000 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 02:25:02.742589319 +0000 2024-09-12T02:27:15.781 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 02:25:02.742589319 +0000 2024-09-12T02:27:15.782 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:27:15.845 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T02:27:15.845 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T02:27:15.845 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000210118 s, 2.4 MB/s 2024-09-12T02:27:15.846 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:27:15.902 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 02:27:05.206656801 +0000 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 02:25:03.061582842 +0000 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 02:25:03.061582842 +0000 2024-09-12T02:27:15.960 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 02:25:03.061582842 +0000 2024-09-12T02:27:15.961 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:27:16.023 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T02:27:16.023 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T02:27:16.023 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000189089 s, 2.7 MB/s 2024-09-12T02:27:16.024 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:27:16.080 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-12T02:27:16.135 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 02:27:05.206656801 +0000 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 02:25:03.373576506 +0000 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 02:25:03.373576506 +0000 2024-09-12T02:27:16.136 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 02:25:03.373576506 +0000 2024-09-12T02:27:16.136 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:27:16.198 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T02:27:16.198 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T02:27:16.198 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000187727 s, 2.7 MB/s 2024-09-12T02:27:16.200 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:27:16.256 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:16.256 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:16.257 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:27:16.274 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:27:16.274 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-09-12T02:27:16.331 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:27:16.331 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:16.332 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T02:27:16.332 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:16.332 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:16.332 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 02:26:58.827611836 +0000 2024-09-12T02:27:16.332 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 02:25:02.410052338 +0000 2024-09-12T02:27:16.332 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 02:25:02.410052338 +0000 2024-09-12T02:27:16.332 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 02:25:02.410052338 +0000 2024-09-12T02:27:16.332 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:27:16.397 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T02:27:16.397 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T02:27:16.397 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000272684 s, 1.9 MB/s 2024-09-12T02:27:16.398 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:27:16.456 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 02:26:58.828611822 +0000 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 02:25:02.730047916 +0000 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 02:25:02.730047916 +0000 2024-09-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 02:25:02.730047916 +0000 2024-09-12T02:27:16.514 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:27:16.578 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T02:27:16.578 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T02:27:16.578 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000193394 s, 2.6 MB/s 2024-09-12T02:27:16.579 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:27:16.636 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-09-12T02:27:16.692 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 02:26:58.828611822 +0000 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 02:25:03.055043427 +0000 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 02:25:03.055043427 +0000 2024-09-12T02:27:16.693 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 02:25:03.055043427 +0000 2024-09-12T02:27:16.693 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:27:16.756 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T02:27:16.756 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T02:27:16.757 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000192664 s, 2.7 MB/s 2024-09-12T02:27:16.758 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:27:16.814 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-12 02:26:58.828611822 +0000 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-12 02:25:03.374039020 +0000 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-12 02:25:03.374039020 +0000 2024-09-12T02:27:16.870 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-12 02:25:03.374039020 +0000 2024-09-12T02:27:16.871 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:27:16.933 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-12T02:27:16.933 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-12T02:27:16.934 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000190689 s, 2.7 MB/s 2024-09-12T02:27:16.935 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:27:16.991 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:16.991 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:27:16.991 INFO:tasks.ceph:Generating config... 2024-09-12T02:27:16.992 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T02:27:16.993 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T02:27:16.993 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T02:27:16.993 INFO:tasks.ceph:[client] pid file = 2024-09-12T02:27:16.993 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T02:27:16.993 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T02:27:16.993 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T02:27:16.994 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T02:27:16.994 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T02:27:16.994 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T02:27:16.994 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T02:27:16.994 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T02:27:16.995 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T02:27:16.995 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T02:27:16.996 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T02:27:17.071 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T02:27:17.073 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T02:27:17.117 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:27:17.183 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.181'), ('mon.b', '172.21.15.204'), ('mon.c', '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]')] 2024-09-12T02:27:17.184 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.181,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T02:27:17.185 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:17.185 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:27:17.237 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.181 --add b 172.21.15.204 --addv c '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:17.323 INFO:teuthology.orchestra.run.smithi181.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:monmaptool: generated fsid d365410a-fe63-4420-b203-62c6d59c25dd 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:setting min_mon_release = quincy 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:epoch 0 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:fsid d365410a-fe63-4420-b203-62c6d59c25dd 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:last_changed 2024-09-12T02:27:17.324233+0000 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:created 2024-09-12T02:27:17.324233+0000 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:min_mon_release 17 (quincy) 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:election_strategy: 1 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:0: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.a 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:2: [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] mon.c 2024-09-12T02:27:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T02:27:17.326 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:27:17.341 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d365410a-fe63-4420-b203-62c6d59c25dd... 2024-09-12T02:27:17.341 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:27:17.383 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:27:17.423 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-09-12T02:27:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-09-12T02:27:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:27:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-09-12T02:27:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.181,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = d365410a-fe63-4420-b203-62c6d59c25dd 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-09-12T02:27:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 1/20 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T02:27:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-12T02:27:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-09-12T02:27:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-09-12T02:27:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: mon down mkfs grace = 300 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on pool no app = False 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:27:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = "" 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-09-12T02:27:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-12T02:27:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-09-12T02:27:17.436 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-09-12T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-09-12T02:27:17.438 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.181,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = d365410a-fe63-4420-b203-62c6d59c25dd 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.439 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-09-12T02:27:17.440 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-09-12T02:27:17.441 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 1/20 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T02:27:17.442 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-12T02:27:17.443 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:27:17.444 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: mon down mkfs grace = 300 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on pool no app = False 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:27:17.445 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = "" 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2024-09-12T02:27:17.446 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-09-12T02:27:17.447 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-09-12T02:27:17.448 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T02:27:17.449 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T02:27:17.543 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T02:27:17.543 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:17.543 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T02:27:17.558 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:17.558 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T02:27:17.613 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:27:17.614 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:17.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:27:17.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:27:17.688 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:17.688 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:17.743 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:27:17.744 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:17.744 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:27:17.744 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:27:17.779 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:17.780 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:17.835 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T02:27:17.835 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T02:27:17.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:27:17.886 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:27:17.888 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:27:17.956 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:27:17.959 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T02:27:17.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:27:18.010 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:27:18.013 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T02:27:18.037 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:27:18.127 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:27:18.130 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T02:27:18.155 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:27:18.208 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:27:18.210 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T02:27:18.235 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:27:18.327 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:27:18.330 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T02:27:18.354 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T02:27:18.355 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:27:18.396 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T02:27:18.408 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-12T02:27:18.490 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-12T02:27:18.503 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T02:27:18.544 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T02:27:18.557 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-12T02:27:18.638 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-12T02:27:18.651 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T02:27:18.651 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:27:18.652 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T02:27:18.677 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:18.677 INFO:tasks.ceph:role: osd.0 2024-09-12T02:27:18.677 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:27:18.677 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:27:18.749 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:18.749 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:18.749 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:18.749 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:18.749 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:18.749 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:18.749 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:18.750 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:18.750 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:18.750 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:19.252 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T02:27:19.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T02:27:19.254 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T02:27:19.363 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T02:27:19.393 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T02:27:19.459 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:19.459 INFO:tasks.ceph:role: osd.1 2024-09-12T02:27:19.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:27:19.459 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:27:19.532 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:19.532 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:19.532 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:19.532 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:19.532 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:19.532 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:19.533 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:19.533 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:19.533 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:19.533 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:19.998 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T02:27:20.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T02:27:20.001 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T02:27:20.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T02:27:20.122 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T02:27:20.187 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:20.187 INFO:tasks.ceph:role: osd.2 2024-09-12T02:27:20.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:27:20.188 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:20.260 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:20.746 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T02:27:20.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T02:27:20.749 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T02:27:20.890 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T02:27:20.920 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T02:27:20.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:20.985 INFO:tasks.ceph:role: osd.3 2024-09-12T02:27:20.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:27:20.985 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:27:21.057 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:21.058 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:21.588 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T02:27:21.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T02:27:21.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T02:27:21.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T02:27:21.766 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:21.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:21.865+0000 7f58cdc18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T02:27:21.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:21.865+0000 7f58cdc18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T02:27:21.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:21.865+0000 7f58cdc18640 -1 bdev(0x563370bab800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:21.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:21.865+0000 7f58cdc18640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T02:27:25.767 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T02:27:25.797 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:25.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:25.887+0000 7faf31fdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T02:27:25.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:25.887+0000 7faf31fdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T02:27:25.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:25.887+0000 7faf31fdd640 -1 bdev(0x55b815fe1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:25.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:25.887+0000 7faf31fdd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T02:27:29.542 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T02:27:29.571 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:29.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:29.660+0000 7f9aa8e13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T02:27:29.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:29.660+0000 7f9aa8e13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T02:27:29.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:29.660+0000 7f9aa8e13640 -1 bdev(0x55f03b675800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:29.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:29.660+0000 7f9aa8e13640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T02:27:33.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T02:27:33.587 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:33.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:33.674+0000 7f6cbf1ae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T02:27:33.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:33.674+0000 7f6cbf1ae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T02:27:33.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:33.675+0000 7f6cbf1ae640 -1 bdev(0x55cccaffd800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:33.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:33.675+0000 7f6cbf1ae640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T02:27:37.573 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T02:27:37.602 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T02:27:37.632 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:37.632 INFO:tasks.ceph:role: osd.4 2024-09-12T02:27:37.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:27:37.632 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:37.709 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:37.710 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:38.209 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T02:27:38.211 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T02:27:38.211 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T02:27:38.320 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T02:27:38.354 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T02:27:38.419 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:38.419 INFO:tasks.ceph:role: osd.5 2024-09-12T02:27:38.419 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:27:38.419 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:27:38.491 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:38.491 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:38.491 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:38.491 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:38.492 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:38.492 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:38.492 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:38.492 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:38.492 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:38.492 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:38.948 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T02:27:38.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T02:27:38.950 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T02:27:39.033 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T02:27:39.102 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T02:27:39.167 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:39.167 INFO:tasks.ceph:role: osd.6 2024-09-12T02:27:39.167 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:27:39.167 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:39.240 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:39.765 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T02:27:39.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T02:27:39.767 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T02:27:39.898 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T02:27:39.929 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T02:27:39.995 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:27:39.995 INFO:tasks.ceph:role: osd.7 2024-09-12T02:27:39.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:27:39.995 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:27:40.067 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:27:40.067 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:27:40.067 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:27:40.067 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:27:40.067 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:27:40.068 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:27:40.068 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:27:40.068 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:27:40.068 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:27:40.068 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:27:40.572 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-12T02:27:40.574 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-12T02:27:40.574 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T02:27:40.686 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T02:27:40.716 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:40.840 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:40.839+0000 7fa634219640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T02:27:40.840 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:40.839+0000 7fa634219640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T02:27:40.840 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:40.839+0000 7fa634219640 -1 bdev(0x55e0e4499800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:40.840 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:40.839+0000 7fa634219640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T02:27:44.745 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T02:27:44.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:44.865 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:44.864+0000 7faeba5dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T02:27:44.865 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:44.864+0000 7faeba5dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T02:27:44.865 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:44.864+0000 7faeba5dd640 -1 bdev(0x55d17abc1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:44.865 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:44.864+0000 7faeba5dd640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T02:27:45.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:45.419 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:48.760 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T02:27:48.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:48.882 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:48.881+0000 7f09a6302640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T02:27:48.882 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:48.881+0000 7f09a6302640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T02:27:48.882 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:48.881+0000 7f09a6302640 -1 bdev(0x558f7f0bf800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:48.882 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:48.881+0000 7f09a6302640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T02:27:52.802 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:52.893 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:52.892+0000 7fe915415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T02:27:52.893 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:52.892+0000 7fe915415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T02:27:52.893 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:52.892+0000 7fe915415640 -1 bdev(0x55d5a3215800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T02:27:52.893 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:27:52.892+0000 7fe915415640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T02:27:56.542 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T02:27:56.571 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T02:27:56.571 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:56.572 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T02:27:56.602 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:56.602 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T02:27:56.671 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:56.671 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T02:27:56.738 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:56.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T02:27:56.805 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:56.805 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T02:27:56.872 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:56.872 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T02:27:56.938 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:56.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T02:27:57.004 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.004 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T02:27:57.034 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.034 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T02:27:57.103 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T02:27:57.171 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.171 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T02:27:57.239 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T02:27:57.306 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.306 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T02:27:57.373 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.373 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T02:27:57.440 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:57.440 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T02:27:57.457 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:57.457 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-12T02:27:57.514 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.514 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T02:27:57.530 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:57.530 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-12T02:27:57.586 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T02:27:57.586 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:27:57.589 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:27:57.629 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCFUeJmMrTWNBAAVU9k50mu969QuqrLSsdtGw== 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmgqStABAAuR5/mEmoQ93BJ/aXTfZ3Vg== 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmA6uoBxAAsY99fp7CzedZ/yS6xKV3Ww== 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCJUeJmXm6kMxAAhxzDDmGdbM/mLqwsr2z0qw== 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCNUeJm3UvvNBAAiZKHPj471Ql3u3MDU+vYrg== 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCRUeJm6pZuJxAABApQFY9e5yj6ehNZsZcerA== 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCVUeJm5e9GKBAA0ZoeZyPDkw7vRVjKLRZIZQ== 2024-09-12T02:27:57.630 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCFUeJmmPEKORAAtnB+3V0qg1BS1zEVF5qImQ== 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmHB1xDBAA9v9urEvVrgq4ujbl1dq0ow== 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmSVuPExAA2lIlASsgadRjRVyKwAD+ig== 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCcUeJmd20TMhAA0MSq5FoRha+jFQ6aJbfs/A== 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCgUeJmcgSVMxAAFDsp8jmrJ2uco7rmn4q9XQ== 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCkUeJmTwSWNBAApWkWkCbc9Mpk7VGR27a4+Q== 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCoUeJmVts/NRAAQ3JpiLZSmnd2VbHLmZyXJQ== 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-12T02:27:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg== 2024-09-12T02:27:57.632 INFO:teuthology.orchestra.run.smithi181.stdout:[client.2] 2024-09-12T02:27:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJm/+dGHRAAw3bdTqnuOcV2umDd/1577Q== 2024-09-12T02:27:57.632 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-09-12T02:27:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJm8f6AIBAA96HxvzttXuXOClAGiYwh7g== 2024-09-12T02:27:57.632 INFO:teuthology.orchestra.run.smithi181.stdout:[client.3] 2024-09-12T02:27:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmCFcdJhAAEpU/Swkitc8CXjG0SKzeLQ== 2024-09-12T02:27:57.650 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2024-09-12T02:27:57.650 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCFUeJmMrTWNBAAVU9k50mu969QuqrLSsdtGw== 2024-09-12T02:27:57.650 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJmgqStABAAuR5/mEmoQ93BJ/aXTfZ3Vg== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJmA6uoBxAAsY99fp7CzedZ/yS6xKV3Ww== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCJUeJmXm6kMxAAhxzDDmGdbM/mLqwsr2z0qw== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCNUeJm3UvvNBAAiZKHPj471Ql3u3MDU+vYrg== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCRUeJm6pZuJxAABApQFY9e5yj6ehNZsZcerA== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCVUeJm5e9GKBAA0ZoeZyPDkw7vRVjKLRZIZQ== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCFUeJmmPEKORAAtnB+3V0qg1BS1zEVF5qImQ== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJmHB1xDBAA9v9urEvVrgq4ujbl1dq0ow== 2024-09-12T02:27:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJmSVuPExAA2lIlASsgadRjRVyKwAD+ig== 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCcUeJmd20TMhAA0MSq5FoRha+jFQ6aJbfs/A== 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCgUeJmcgSVMxAAFDsp8jmrJ2uco7rmn4q9XQ== 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCkUeJmTwSWNBAApWkWkCbc9Mpk7VGR27a4+Q== 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCoUeJmVts/NRAAQ3JpiLZSmnd2VbHLmZyXJQ== 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg== 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout:[client.2] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJm/+dGHRAAw3bdTqnuOcV2umDd/1577Q== 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout:[client.1] 2024-09-12T02:27:57.652 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJm8f6AIBAA96HxvzttXuXOClAGiYwh7g== 2024-09-12T02:27:57.653 INFO:teuthology.orchestra.run.smithi204.stdout:[client.3] 2024-09-12T02:27:57.653 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQCGUeJmCFcdJhAAEpU/Swkitc8CXjG0SKzeLQ== 2024-09-12T02:27:57.653 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:27:57.676 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:27:57.745 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:57.747 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:57.801 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:57.803 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:57.857 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:57.860 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:57.910 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:57.913 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:57.964 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:57.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.017 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.020 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.071 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:27:58.073 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:27:58.124 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:58.126 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:58.180 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:58.182 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:27:58.236 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.238 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.289 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.291 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.342 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.395 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.397 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:27:58.448 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.450 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.504 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.562 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.618 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:27:58.671 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T02:27:58.672 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T02:27:58.696 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:27:58.791 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T02:27:58.816 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T02:27:58.842 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:27:58.939 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T02:27:58.963 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T02:27:59.027 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:27:59.123 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T02:27:59.147 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:59.150 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:27:59.202 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T02:27:59.202 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:27:59.203 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:27:59.207 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:27:59.207 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:27:59.207 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:27:59.244 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:27:59.244 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:27:59.245 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:27:59.247 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:27:59.247 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T02:27:59.247 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T02:27:59.247 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T02:27:59.249 INFO:tasks.ceph.mgr.y:Started 2024-09-12T02:27:59.249 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T02:27:59.249 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T02:27:59.251 INFO:tasks.ceph.mgr.x:Started 2024-09-12T02:27:59.252 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T02:27:59.252 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T02:27:59.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.352+0000 7f45fb998640 1 Processor -- start 2024-09-12T02:27:59.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.352+0000 7f45fb998640 1 -- start start 2024-09-12T02:27:59.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.353+0000 7f45fb998640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 0x7f45f415d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.353+0000 7f45fb998640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45f41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.353+0000 7f45fb998640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f415c890 con 0x7f45f406f2f0 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.353+0000 7f45fb998640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f45f41608d0 con 0x7f45f40b1c50 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.353+0000 7f45fb998640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f45f4160bb0 con 0x7f45f415fe80 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.353+0000 7f45f9f35640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f45f406f2f0 0x7f45f41419f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58294/0 (socket says 172.21.15.181:58294) 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.353+0000 7f45f9f35640 1 -- 172.21.15.181:0/1650976095 learned_addr learned my addr 172.21.15.181:0/1650976095 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f9734640 1 --2- 172.21.15.181:0/1650976095 >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 0x7f45f415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f8f33640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45f41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f9734640 1 -- 172.21.15.181:0/1650976095 >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 msgr2=0x7f45f415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f8f33640 1 -- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 msgr2=0x7f45f41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f9734640 1 -- 172.21.15.181:0/1650976095 >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 msgr2=0x7f45f415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f8f33640 1 -- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 msgr2=0x7f45f41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:59.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f9734640 1 --2- 172.21.15.181:0/1650976095 >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 0x7f45f415d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:59.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f8f33640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45f41602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:59.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f9734640 1 --2- 172.21.15.181:0/1650976095 >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 0x7f45f415d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:59.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.354+0000 7f45f8f33640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45f41602c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594114874 0 0) 0x7f45f415c890 con 0x7f45f406f2f0 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e0003520 con 0x7f45f406f2f0 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 679887618 0 0) 0x7f45e0003520 con 0x7f45f406f2f0 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 msgr2=0x7f45f41602c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45f41602c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 msgr2=0x7f45f415d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 --2- 172.21.15.181:0/1650976095 >> v2:172.21.15.204:3300/0 conn(0x7f45f40b1c50 0x7f45f415d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f415cb50 con 0x7f45f406f2f0 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f45ec0019f0 con 0x7f45f406f2f0 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 >> v1:172.21.15.181:6789/0 conn(0x7f45f406f2f0 legacy=0x7f45f41419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45e00039b0 0x7f45e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41608d0 con 0x7f45e0004d40 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4160bb0 con 0x7f45e00039b0 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f45e000bb20 con 0x7f45f415fe80 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45f9734640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45e00039b0 0x7f45e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45f9f35640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.523+0000 7f45f8f33640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.524+0000 7f45f9f35640 1 -- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 msgr2=0x7f45e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.524+0000 7f45f9f35640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f415fe80 0x7f45e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.524+0000 7f45f9f35640 1 -- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45e00039b0 msgr2=0x7f45e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:59.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.524+0000 7f45f9f35640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45e00039b0 0x7f45e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.524+0000 7f45f9f35640 1 -- 172.21.15.181:0/1650976095 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e0003520 con 0x7f45e0004d40 2024-09-12T02:27:59.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.524+0000 7f45f9734640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45e00039b0 0x7f45e0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.525+0000 7f45f9f35640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0013d0 tx=0x7f45e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcd9c75f4825b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.525+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00a4e0 con 0x7f45e0004d40 2024-09-12T02:27:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.525+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec02f070 con 0x7f45e0004d40 2024-09-12T02:27:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.525+0000 7f45ebfff640 1 -- 172.21.15.181:0/1650976095 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec02bce0 con 0x7f45e0004d40 2024-09-12T02:27:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.526+0000 7f45fb998640 1 -- 172.21.15.181:0/1650976095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0004d40 msgr2=0x7f45e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.526+0000 7f45fb998640 1 --2- 172.21.15.181:0/1650976095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0013d0 tx=0x7f45e0005830 comp rx=0 tx=0).stop 2024-09-12T02:27:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.526+0000 7f45f9f35640 1 -- 172.21.15.181:0/1650976095 reap_dead start 2024-09-12T02:27:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.526+0000 7f45fb998640 1 -- 172.21.15.181:0/1650976095 shutdown_connections 2024-09-12T02:27:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.526+0000 7f45fb998640 1 -- 172.21.15.181:0/1650976095 >> 172.21.15.181:0/1650976095 conn(0x7f45f4067950 msgr2=0x7f45f4067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.526+0000 7f45fb998640 1 -- 172.21.15.181:0/1650976095 shutdown_connections 2024-09-12T02:27:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.526+0000 7f45fb998640 1 -- 172.21.15.181:0/1650976095 wait complete. 2024-09-12T02:27:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.527+0000 7f45fb998640 1 Processor -- start 2024-09-12T02:27:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.527+0000 7f45fb998640 1 -- start start 2024-09-12T02:27:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45fb998640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45e0004d40 0x7f45f415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45fb998640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f40b3910 0x7f45f40b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45fb998640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45f413a960 0x7f45f413ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45fb998640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45f40cf3e0 con 0x7f45f413a960 2024-09-12T02:27:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45fb998640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f45f40cf260 con 0x7f45f40b3910 2024-09-12T02:27:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45fb998640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f45f41602c0 con 0x7f45e0004d40 2024-09-12T02:27:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45f9734640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45e0004d40 0x7f45f415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45f9f35640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45f413a960 0x7f45f413ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45f9734640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45e0004d40 0x7f45f415b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:51434/0 (socket says 172.21.15.181:51434) 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45f9734640 1 -- 172.21.15.181:0/1332080403 learned_addr learned my addr 172.21.15.181:0/1332080403 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.528+0000 7f45f8f33640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f40b3910 0x7f45f40b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45f9f35640 1 -- 172.21.15.181:0/1332080403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45e0004d40 msgr2=0x7f45f415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45f9f35640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45e0004d40 0x7f45f415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45f9f35640 1 -- 172.21.15.181:0/1332080403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f40b3910 msgr2=0x7f45f40b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45f9f35640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f40b3910 0x7f45f40b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45f9f35640 1 -- 172.21.15.181:0/1332080403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f4134cd0 con 0x7f45f413a960 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45f9f35640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45f413a960 0x7f45f413ade0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45ec030000 tx=0x7f45ec001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45e9ffb640 1 -- 172.21.15.181:0/1332080403 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f000b5e0 con 0x7f45f413a960 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45e9ffb640 1 -- 172.21.15.181:0/1332080403 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec00a4c0 con 0x7f45f413a960 2024-09-12T02:27:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45e9ffb640 1 -- 172.21.15.181:0/1332080403 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec002040 con 0x7f45f413a960 2024-09-12T02:27:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f4134fb0 con 0x7f45f413a960 2024-09-12T02:27:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f4135570 con 0x7f45f413a960 2024-09-12T02:27:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45e9ffb640 1 -- 172.21.15.181:0/1332080403 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f45ec034690 con 0x7f45f413a960 2024-09-12T02:27:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.529+0000 7f45e9ffb640 1 -- 172.21.15.181:0/1332080403 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f45ec040cc0 con 0x7f45f413a960 2024-09-12T02:27:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.530+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f40b42d0 con 0x7f45f413a960 2024-09-12T02:27:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.532+0000 7f45e9ffb640 1 -- 172.21.15.181:0/1332080403 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f45ec0602d0 con 0x7f45f413a960 2024-09-12T02:27:59.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.595+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f45f415d350 con 0x7f45f413a960 2024-09-12T02:27:59.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.597+0000 7f45e9ffb640 1 -- 172.21.15.181:0/1332080403 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f45ec04e070 con 0x7f45f413a960 2024-09-12T02:27:59.598 INFO:teuthology.orchestra.run.smithi181.stderr:adjusted tunables profile to default 2024-09-12T02:27:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.597+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45f413a960 msgr2=0x7f45f413ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.597+0000 7f45fb998640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45f413a960 0x7f45f413ade0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45ec030000 tx=0x7f45ec001dc0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.598+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 shutdown_connections 2024-09-12T02:27:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.598+0000 7f45fb998640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f40b3910 0x7f45f40b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.598+0000 7f45fb998640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45f413a960 0x7f45f413ade0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.598+0000 7f45fb998640 1 --2- 172.21.15.181:0/1332080403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45e0004d40 0x7f45f415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.598+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 >> 172.21.15.181:0/1332080403 conn(0x7f45f4067950 msgr2=0x7f45f4145820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.598+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 shutdown_connections 2024-09-12T02:27:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:27:59.598+0000 7f45fb998640 1 -- 172.21.15.181:0/1332080403 wait complete. 2024-09-12T02:27:59.610 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T02:27:59.610 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T02:27:59.611 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:59.611 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T02:27:59.627 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:27:59.627+0000 7fd67392f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:27:59.637 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:59.637 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T02:27:59.638 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:27:59.638+0000 7fda3fc93040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:27:59.662 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:59.662 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T02:27:59.667 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:27:59.667+0000 7fd67392f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:27:59.681 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:27:59.681+0000 7fda3fc93040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:27:59.706 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:27:59.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T02:27:59.771 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:59.771 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T02:27:59.796 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:59.796 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T02:27:59.810 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:27:59.810+0000 7fd67392f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:27:59.828 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:27:59.827+0000 7fda3fc93040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:27:59.835 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:59.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T02:27:59.865 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:27:59.864+0000 7fd67392f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:27:59.878 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:27:59.878+0000 7fda3fc93040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:27:59.889 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:27:59.889 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T02:27:59.955 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1 0 2024-09-12T02:28:00.038 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:00.037+0000 7fd67392f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:00.044 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:00.043+0000 7fda3fc93040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:00.095 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.094+0000 7f4427bc4640 1 Processor -- start 2024-09-12T02:28:00.095 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.094+0000 7f4427bc4640 1 -- start start 2024-09-12T02:28:00.096 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f4427bc4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f44200ceed0 0x7f44200b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.096 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f4427bc4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200cd430 0x7f44200b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.096 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f4427bc4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44200b3af0 con 0x7f442015e540 2024-09-12T02:28:00.097 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f4427bc4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f44200b3dd0 con 0x7f44200ceed0 2024-09-12T02:28:00.097 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f4427bc4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f44200b40b0 con 0x7f44200cd430 2024-09-12T02:28:00.097 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f4426161640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200cd430 0x7f44200b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.097 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f442515f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f44200ceed0 0x7f44200b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.097 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f442515f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f44200ceed0 0x7f44200b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56032/0 (socket says 172.21.15.204:56032) 2024-09-12T02:28:00.097 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f4426161640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200cd430 0x7f44200b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:60804/0 (socket says 172.21.15.204:60804) 2024-09-12T02:28:00.098 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.095+0000 7f442515f640 1 -- 172.21.15.204:0/391483198 learned_addr learned my addr 172.21.15.204:0/391483198 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.098 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442515f640 1 -- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200cd430 msgr2=0x7f44200b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:00.098 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442515f640 1 --2- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200cd430 0x7f44200b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.098 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442515f640 1 -- 172.21.15.204:0/391483198 >> v1:172.21.15.181:6789/0 conn(0x7f442015e540 legacy=0x7f44200ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.098 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442515f640 1 -- 172.21.15.204:0/391483198 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44200b4390 con 0x7f44200ceed0 2024-09-12T02:28:00.099 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f4426161640 1 --2- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200cd430 0x7f44200b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442515f640 1 --2- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200ceed0 0x7f44200b4b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4414009870 tx=0x7f441402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=644d915dafd08ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442495e640 1 -- 172.21.15.204:0/391483198 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414037070 con 0x7f44200ceed0 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442495e640 1 -- 172.21.15.204:0/391483198 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4414032440 con 0x7f44200ceed0 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.096+0000 7f442495e640 1 -- 172.21.15.204:0/391483198 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414032810 con 0x7f44200ceed0 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 -- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200ceed0 msgr2=0x7f44200b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 --2- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200ceed0 0x7f44200b4b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4414009870 tx=0x7f441402a270 comp rx=0 tx=0).stop 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 -- 172.21.15.204:0/391483198 shutdown_connections 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 --2- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200cd430 0x7f44200b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 --2- 172.21.15.204:0/391483198 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200ceed0 0x7f44200b4b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.105 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 -- 172.21.15.204:0/391483198 >> 172.21.15.204:0/391483198 conn(0x7f44200b06c0 msgr2=0x7f44200b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 -- 172.21.15.204:0/391483198 shutdown_connections 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.097+0000 7f4427bc4640 1 -- 172.21.15.204:0/391483198 wait complete. 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.098+0000 7f4427bc4640 1 Processor -- start 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.098+0000 7f4427bc4640 1 -- start start 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4427bc4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200cd430 0x7f44200aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4427bc4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200ceed0 0x7f442014a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4427bc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442015e540 0x7f44201f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4427bc4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f44200ce570 con 0x7f442015e540 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4427bc4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f44200ce3f0 con 0x7f44200cd430 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4427bc4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f442015e920 con 0x7f44200ceed0 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f442515f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200ceed0 0x7f442014a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.106 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4425960640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200cd430 0x7f44200aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f442515f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200ceed0 0x7f442014a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:60818/0 (socket says 172.21.15.204:60818) 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f442515f640 1 -- 172.21.15.204:0/3012229725 learned_addr learned my addr 172.21.15.204:0/3012229725 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.099+0000 7f4426161640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442015e540 0x7f44201f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f442515f640 1 -- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200cd430 msgr2=0x7f44200aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f442515f640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200cd430 0x7f44200aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f442515f640 1 -- 172.21.15.204:0/3012229725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442015e540 msgr2=0x7f44201f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f442515f640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442015e540 0x7f44201f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f442515f640 1 -- 172.21.15.204:0/3012229725 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442015ba80 con 0x7f44200ceed0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f4425960640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200cd430 0x7f44200aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f442515f640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200ceed0 0x7f442014a060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4414000c00 tx=0x7f44140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f44127fc640 1 -- 172.21.15.204:0/3012229725 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414037040 con 0x7f44200ceed0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f44127fc640 1 -- 172.21.15.204:0/3012229725 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4414042070 con 0x7f44200ceed0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f44127fc640 1 -- 172.21.15.204:0/3012229725 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44140308a0 con 0x7f44200ceed0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442015bd60 con 0x7f44200ceed0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f442015c320 con 0x7f44200ceed0 2024-09-12T02:28:00.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f44127fc640 1 -- 172.21.15.204:0/3012229725 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4414030a40 con 0x7f44200ceed0 2024-09-12T02:28:00.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.100+0000 7f44127fc640 1 -- 172.21.15.204:0/3012229725 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4414047b30 con 0x7f44200ceed0 2024-09-12T02:28:00.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.101+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44200b01c0 con 0x7f44200ceed0 2024-09-12T02:28:00.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.103+0000 7f44127fc640 1 -- 172.21.15.204:0/3012229725 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4414047460 con 0x7f44200ceed0 2024-09-12T02:28:00.153 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:00.153+0000 7fda3fc93040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:28:00.155 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:00.154+0000 7fd67392f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:28:00.173 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.172+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1", "id": 0} v 0) -- 0x7f44200b5c20 con 0x7f44200ceed0 2024-09-12T02:28:00.179 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.178+0000 7f44127fc640 1 -- 172.21.15.204:0/3012229725 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4414047640 con 0x7f44200ceed0 2024-09-12T02:28:00.179 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-09-12T02:28:00.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200ceed0 msgr2=0x7f442014a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200ceed0 0x7f442014a060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4414000c00 tx=0x7f44140046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 shutdown_connections 2024-09-12T02:28:00.181 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442015e540 0x7f44201f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.182 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f44200ceed0 0x7f442014a060 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.182 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 --2- 172.21.15.204:0/3012229725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f44200cd430 0x7f44200aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.182 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 >> 172.21.15.204:0/3012229725 conn(0x7f44200b06c0 msgr2=0x7f44200cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.182 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 shutdown_connections 2024-09-12T02:28:00.182 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.179+0000 7f4427bc4640 1 -- 172.21.15.204:0/3012229725 wait complete. 2024-09-12T02:28:00.190 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 29a06fed-cc29-450c-9b21-db2a7bf77fc1 1 2024-09-12T02:28:00.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.328+0000 7f2990f26640 1 Processor -- start 2024-09-12T02:28:00.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.328+0000 7f2990f26640 1 -- start start 2024-09-12T02:28:00.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2990f26640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f298c06d640 0x7f298c06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2990f26640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c15ea20 con 0x7f298c06f830 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2990f26640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c15ece0 con 0x7f298c158ac0 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2990f26640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f298c06d430 con 0x7f298c06d640 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2989d9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f298c06d640 0x7f298c06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2989d9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f298c06d640 0x7f298c06f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56050/0 (socket says 172.21.15.204:56050) 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2989d9b640 1 -- 172.21.15.204:0/4183135367 learned_addr learned my addr 172.21.15.204:0/4183135367 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2989d9b640 1 -- 172.21.15.204:0/4183135367 >> v1:172.21.15.204:6789/0 conn(0x7f298c158ac0 legacy=0x7f298c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2989d9b640 1 -- 172.21.15.204:0/4183135367 >> v1:172.21.15.181:6789/0 conn(0x7f298c06f830 legacy=0x7f298c1622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.329+0000 7f2989d9b640 1 -- 172.21.15.204:0/4183135367 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c15efc0 con 0x7f298c06d640 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.330+0000 7f2989d9b640 1 --2- 172.21.15.204:0/4183135367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c06d640 0x7f298c06f2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2974009870 tx=0x7f297402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5111f2e81e7e48d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.330+0000 7f298959a640 1 -- 172.21.15.204:0/4183135367 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974037070 con 0x7f298c06d640 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.330+0000 7f298959a640 1 -- 172.21.15.204:0/4183135367 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297402ae50 con 0x7f298c06d640 2024-09-12T02:28:00.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.330+0000 7f298959a640 1 -- 172.21.15.204:0/4183135367 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974032860 con 0x7f298c06d640 2024-09-12T02:28:00.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.331+0000 7f2990f26640 1 -- 172.21.15.204:0/4183135367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c06d640 msgr2=0x7f298c06f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.331+0000 7f2990f26640 1 --2- 172.21.15.204:0/4183135367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c06d640 0x7f298c06f2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2974009870 tx=0x7f297402a300 comp rx=0 tx=0).stop 2024-09-12T02:28:00.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.331+0000 7f2990f26640 1 -- 172.21.15.204:0/4183135367 shutdown_connections 2024-09-12T02:28:00.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.331+0000 7f2990f26640 1 --2- 172.21.15.204:0/4183135367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c06d640 0x7f298c06f2f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.331+0000 7f2990f26640 1 -- 172.21.15.204:0/4183135367 >> 172.21.15.204:0/4183135367 conn(0x7f298c067950 msgr2=0x7f298c067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.331+0000 7f2990f26640 1 -- 172.21.15.204:0/4183135367 shutdown_connections 2024-09-12T02:28:00.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.331+0000 7f2990f26640 1 -- 172.21.15.204:0/4183135367 wait complete. 2024-09-12T02:28:00.336 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.332+0000 7f2990f26640 1 Processor -- start 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.332+0000 7f2990f26640 1 -- start start 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2990f26640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f298c06d640 0x7f298c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2990f26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f298c06f830 0x7f298c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2990f26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c158ac0 0x7f298c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2990f26640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f298c06fc80 con 0x7f298c06d640 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2990f26640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f298c158ea0 con 0x7f298c158ac0 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2990f26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f298c15f580 con 0x7f298c06f830 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f298ad9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c158ac0 0x7f298c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f298c06f830 0x7f298c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f298c06f830 0x7f298c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:60834/0 (socket says 172.21.15.204:60834) 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 -- 172.21.15.204:0/2009170079 learned_addr learned my addr 172.21.15.204:0/2009170079 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f298ad9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c158ac0 0x7f298c0b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56060/0 (socket says 172.21.15.204:56060) 2024-09-12T02:28:00.337 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f298a59c640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f298c06d640 0x7f298c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 -- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c158ac0 msgr2=0x7f298c0b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c158ac0 0x7f298c0b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 -- 172.21.15.204:0/2009170079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f298c06d640 msgr2=0x7f298c1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f298c06d640 0x7f298c1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f2989d9b640 1 -- 172.21.15.204:0/2009170079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0cc3c0 con 0x7f298c06f830 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.333+0000 7f298ad9d640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c158ac0 0x7f298c0b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2989d9b640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f298c06f830 0x7f298c0cf6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f29740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2982ffd640 1 -- 172.21.15.204:0/2009170079 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974041070 con 0x7f298c06f830 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2982ffd640 1 -- 172.21.15.204:0/2009170079 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297403c890 con 0x7f298c06f830 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c0cc6a0 con 0x7f298c06f830 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2982ffd640 1 -- 172.21.15.204:0/2009170079 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974037040 con 0x7f298c06f830 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c0ccc60 con 0x7f298c06f830 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2982ffd640 1 -- 172.21.15.204:0/2009170079 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2974044070 con 0x7f298c06f830 2024-09-12T02:28:00.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.334+0000 7f2982ffd640 1 -- 172.21.15.204:0/2009170079 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f297403d7a0 con 0x7f298c06f830 2024-09-12T02:28:00.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.335+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298c069ac0 con 0x7f298c06f830 2024-09-12T02:28:00.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.337+0000 7f2982ffd640 1 -- 172.21.15.204:0/2009170079 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f297403cc80 con 0x7f298c06f830 2024-09-12T02:28:00.406 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.405+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "29a06fed-cc29-450c-9b21-db2a7bf77fc1", "id": 1} v 0) -- 0x7f298c0b61a0 con 0x7f298c06f830 2024-09-12T02:28:00.411 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.411+0000 7f2982ffd640 1 -- 172.21.15.204:0/2009170079 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29a06fed-cc29-450c-9b21-db2a7bf77fc1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2974046c20 con 0x7f298c06f830 2024-09-12T02:28:00.412 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f298c06f830 msgr2=0x7f298c0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f298c06f830 0x7f298c0cf6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f29740046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 shutdown_connections 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f298c158ac0 0x7f298c0b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f298c06f830 0x7f298c0cf6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 --2- 172.21.15.204:0/2009170079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f298c06d640 0x7f298c1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 >> 172.21.15.204:0/2009170079 conn(0x7f298c067950 msgr2=0x7f298c0b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 shutdown_connections 2024-09-12T02:28:00.413 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.412+0000 7f2990f26640 1 -- 172.21.15.204:0/2009170079 wait complete. 2024-09-12T02:28:00.423 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 19c8ae7a-8bff-43ac-b645-f2a4b7aacdea 2 2024-09-12T02:28:00.468 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:00.467+0000 7fda3fc93040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:28:00.504 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:00.503+0000 7fd67392f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:28:00.516 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:00.516+0000 7fda3fc93040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:28:00.521 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.521+0000 7f9101a4c640 1 Processor -- start 2024-09-12T02:28:00.521 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.521+0000 7f9101a4c640 1 -- start start 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f9101a4c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f90fc15e640 0x7f90fc0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f9101a4c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90fc0b39d0 con 0x7f90fc0d4710 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f9101a4c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90fc0cf520 con 0x7f90fc0cef60 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f9101a4c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f90fc0cf800 con 0x7f90fc15e640 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f90fa7fc640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f90fc0cef60 0x7f90fc0d2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:45150/0 (socket says 172.21.15.204:45150) 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f90fa7fc640 1 -- 172.21.15.204:0/64410633 learned_addr learned my addr 172.21.15.204:0/64410633 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f90faffd640 1 --2- 172.21.15.204:0/64410633 >> v2:172.21.15.181:3300/0 conn(0x7f90fc15e640 0x7f90fc0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f90faffd640 1 -- 172.21.15.204:0/64410633 >> v1:172.21.15.204:6789/0 conn(0x7f90fc0cef60 legacy=0x7f90fc0d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f90faffd640 1 -- 172.21.15.204:0/64410633 >> v1:172.21.15.181:6789/0 conn(0x7f90fc0d4710 legacy=0x7f90fc0d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.522+0000 7f90faffd640 1 -- 172.21.15.204:0/64410633 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc0cfae0 con 0x7f90fc15e640 2024-09-12T02:28:00.524 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.523+0000 7f90faffd640 1 --2- 172.21.15.204:0/64410633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc15e640 0x7f90fc0b3bf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0097a0 tx=0x7f90ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873d2bab650a3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.524 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.523+0000 7f90f9ffb640 1 -- 172.21.15.204:0/64410633 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec037070 con 0x7f90fc15e640 2024-09-12T02:28:00.524 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.523+0000 7f90f9ffb640 1 -- 172.21.15.204:0/64410633 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ec032440 con 0x7f90fc15e640 2024-09-12T02:28:00.524 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.523+0000 7f90f9ffb640 1 -- 172.21.15.204:0/64410633 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec032810 con 0x7f90fc15e640 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.524+0000 7f9101a4c640 1 -- 172.21.15.204:0/64410633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc15e640 msgr2=0x7f90fc0b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.524+0000 7f9101a4c640 1 --2- 172.21.15.204:0/64410633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc15e640 0x7f90fc0b3bf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0097a0 tx=0x7f90ec02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.524+0000 7f9101a4c640 1 -- 172.21.15.204:0/64410633 shutdown_connections 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.524+0000 7f9101a4c640 1 --2- 172.21.15.204:0/64410633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc15e640 0x7f90fc0b3bf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.524+0000 7f9101a4c640 1 -- 172.21.15.204:0/64410633 >> 172.21.15.204:0/64410633 conn(0x7f90fc067d70 msgr2=0x7f90fc068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.524+0000 7f9101a4c640 1 -- 172.21.15.204:0/64410633 shutdown_connections 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.524+0000 7f9101a4c640 1 -- 172.21.15.204:0/64410633 wait complete. 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.525+0000 7f9101a4c640 1 Processor -- start 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f9101a4c640 1 -- start start 2024-09-12T02:28:00.527 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f9101a4c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc0cef60 0x7f90fc155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f9101a4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90fc0d4710 0x7f90fc0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f9101a4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90fc15e640 0x7f90fc0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f9101a4c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc0d3590 con 0x7f90fc0cef60 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f9101a4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc15ea20 con 0x7f90fc0d4710 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f9101a4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc0d3710 con 0x7f90fc15e640 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f90fa7fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90fc0d4710 0x7f90fc0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f90fb7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90fc15e640 0x7f90fc0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f90fa7fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90fc0d4710 0x7f90fc0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56074/0 (socket says 172.21.15.204:56074) 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.526+0000 7f90fa7fc640 1 -- 172.21.15.204:0/3317213318 learned_addr learned my addr 172.21.15.204:0/3317213318 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.527+0000 7f90faffd640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc0cef60 0x7f90fc155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.527+0000 7f90fa7fc640 1 -- 172.21.15.204:0/3317213318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90fc15e640 msgr2=0x7f90fc0c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.527+0000 7f90fa7fc640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90fc15e640 0x7f90fc0c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.529 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.527+0000 7f90fa7fc640 1 -- 172.21.15.204:0/3317213318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc0cef60 msgr2=0x7f90fc155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.529 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.527+0000 7f90fa7fc640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc0cef60 0x7f90fc155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.529 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.527+0000 7f90fa7fc640 1 -- 172.21.15.204:0/3317213318 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc1561e0 con 0x7f90fc0d4710 2024-09-12T02:28:00.529 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.527+0000 7f90fa7fc640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90fc0d4710 0x7f90fc0c83d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f90f000c4a0 tx=0x7f90f000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.528+0000 7f90e3fff640 1 -- 172.21.15.204:0/3317213318 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0017070 con 0x7f90fc0d4710 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.528+0000 7f90e3fff640 1 -- 172.21.15.204:0/3317213318 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f0005ce0 con 0x7f90fc0d4710 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.528+0000 7f90e3fff640 1 -- 172.21.15.204:0/3317213318 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0007270 con 0x7f90fc0d4710 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.528+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc0cb850 con 0x7f90fc0d4710 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.528+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc0cbaf0 con 0x7f90fc0d4710 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.528+0000 7f90e3fff640 1 -- 172.21.15.204:0/3317213318 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90f001a070 con 0x7f90fc0d4710 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.528+0000 7f90e3fff640 1 -- 172.21.15.204:0/3317213318 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f90f001cc10 con 0x7f90fc0d4710 2024-09-12T02:28:00.530 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.529+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90fc0b3bf0 con 0x7f90fc0d4710 2024-09-12T02:28:00.534 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.533+0000 7f90e3fff640 1 -- 172.21.15.204:0/3317213318 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f90fc1561e0 con 0x7f90fc0d4710 2024-09-12T02:28:00.565 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:00.565+0000 7fd67392f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:28:00.602 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.602+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19c8ae7a-8bff-43ac-b645-f2a4b7aacdea", "id": 2} v 0) -- 0x7f90fc0b9880 con 0x7f90fc0d4710 2024-09-12T02:28:00.608 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.608+0000 7f90e3fff640 1 -- 172.21.15.204:0/3317213318 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19c8ae7a-8bff-43ac-b645-f2a4b7aacdea", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f90f0007410 con 0x7f90fc0d4710 2024-09-12T02:28:00.608 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-09-12T02:28:00.609 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.608+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90fc0d4710 msgr2=0x7f90fc0c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.609 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.608+0000 7f9101a4c640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90fc0d4710 0x7f90fc0c83d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f90f000c4a0 tx=0x7f90f000c960 comp rx=0 tx=0).stop 2024-09-12T02:28:00.609 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.609+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 shutdown_connections 2024-09-12T02:28:00.610 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.609+0000 7f9101a4c640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90fc0d4710 0x7f90fc0c83d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.610 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.609+0000 7f9101a4c640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90fc15e640 0x7f90fc0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.610 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.609+0000 7f9101a4c640 1 --2- 172.21.15.204:0/3317213318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90fc0cef60 0x7f90fc155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.610 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.609+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 >> 172.21.15.204:0/3317213318 conn(0x7f90fc067d70 msgr2=0x7f90fc0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.610 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.609+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 shutdown_connections 2024-09-12T02:28:00.610 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.609+0000 7f9101a4c640 1 -- 172.21.15.204:0/3317213318 wait complete. 2024-09-12T02:28:00.619 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 9c94f42d-d96a-4dd2-a8bf-a6a92939b002 3 2024-09-12T02:28:00.667 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:00.666+0000 7fda3fc93040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:28:00.720 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.719+0000 7f119d56d640 1 Processor -- start 2024-09-12T02:28:00.720 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.719+0000 7f119d56d640 1 -- start start 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f119d56d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f119815e540 0x7f11980ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f119d56d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11980cd430 0x7f11980ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f119d56d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11980b5ba0 con 0x7f119815e920 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f119d56d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f11980b3af0 con 0x7f11980cd430 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f119d56d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f11980b3dd0 con 0x7f119815e540 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f1196ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f119815e540 0x7f11980ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f1196ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f119815e540 0x7f11980ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56078/0 (socket says 172.21.15.204:56078) 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f1196ffd640 1 -- 172.21.15.204:0/1198387603 learned_addr learned my addr 172.21.15.204:0/1198387603 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f11967fc640 1 --2- 172.21.15.204:0/1198387603 >> v2:172.21.15.181:3300/0 conn(0x7f11980cd430 0x7f11980ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f1196ffd640 1 -- 172.21.15.204:0/1198387603 >> v2:172.21.15.181:3300/0 conn(0x7f11980cd430 msgr2=0x7f11980ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f1196ffd640 1 --2- 172.21.15.204:0/1198387603 >> v2:172.21.15.181:3300/0 conn(0x7f11980cd430 0x7f11980ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.722 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f1196ffd640 1 -- 172.21.15.204:0/1198387603 >> v1:172.21.15.181:6789/0 conn(0x7f119815e920 legacy=0x7f1198162060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.723 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f1196ffd640 1 -- 172.21.15.204:0/1198387603 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11980b40b0 con 0x7f119815e540 2024-09-12T02:28:00.723 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.720+0000 7f11967fc640 1 --2- 172.21.15.204:0/1198387603 >> v2:172.21.15.181:3300/0 conn(0x7f11980cd430 0x7f11980ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:00.723 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.721+0000 7f1196ffd640 1 --2- 172.21.15.204:0/1198387603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f11980ce7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f11980757d0 tx=0x7f118802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e4322be5a308b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.723 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.721+0000 7f1195ffb640 1 -- 172.21.15.204:0/1198387603 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188037070 con 0x7f119815e540 2024-09-12T02:28:00.723 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.721+0000 7f1195ffb640 1 -- 172.21.15.204:0/1198387603 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1188032440 con 0x7f119815e540 2024-09-12T02:28:00.723 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.721+0000 7f1195ffb640 1 -- 172.21.15.204:0/1198387603 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188032810 con 0x7f119815e540 2024-09-12T02:28:00.724 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 -- 172.21.15.204:0/1198387603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 msgr2=0x7f11980ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.724 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 --2- 172.21.15.204:0/1198387603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f11980ce7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f11980757d0 tx=0x7f118802a270 comp rx=0 tx=0).stop 2024-09-12T02:28:00.724 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 -- 172.21.15.204:0/1198387603 shutdown_connections 2024-09-12T02:28:00.724 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 --2- 172.21.15.204:0/1198387603 >> v2:172.21.15.181:3300/0 conn(0x7f11980cd430 0x7f11980ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.724 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 --2- 172.21.15.204:0/1198387603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f11980ce7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.724 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 -- 172.21.15.204:0/1198387603 >> 172.21.15.204:0/1198387603 conn(0x7f11980b06c0 msgr2=0x7f11980b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.724 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 -- 172.21.15.204:0/1198387603 shutdown_connections 2024-09-12T02:28:00.725 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.722+0000 7f119d56d640 1 -- 172.21.15.204:0/1198387603 wait complete. 2024-09-12T02:28:00.725 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.723+0000 7f119d56d640 1 Processor -- start 2024-09-12T02:28:00.725 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.723+0000 7f119d56d640 1 -- start start 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f119d56d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11980cd430 0x7f119815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f119d56d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f119815d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f119d56d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f119815e920 0x7f1198143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f119d56d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11980ce3f0 con 0x7f11980cd430 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f119d56d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f11980b4670 con 0x7f119815e540 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f119d56d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11980ce570 con 0x7f119815e920 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f119815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f119815d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56082/0 (socket says 172.21.15.204:56082) 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 -- 172.21.15.204:0/217587254 learned_addr learned my addr 172.21.15.204:0/217587254 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f1196ffd640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11980cd430 0x7f119815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11977fe640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f119815e920 0x7f1198143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.727 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 -- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f119815e920 msgr2=0x7f1198143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f119815e920 0x7f1198143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 -- 172.21.15.204:0/217587254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11980cd430 msgr2=0x7f119815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11980cd430 0x7f119815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f11967fc640 1 -- 172.21.15.204:0/217587254 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119814fad0 con 0x7f119815e540 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.724+0000 7f1196ffd640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11980cd430 0x7f119815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f11967fc640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f119815d180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f118000e810 tx=0x7f118000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f118f7fe640 1 -- 172.21.15.204:0/217587254 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118000f040 con 0x7f119815e540 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f118f7fe640 1 -- 172.21.15.204:0/217587254 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180004030 con 0x7f119815e540 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119814fdb0 con 0x7f119815e540 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f118f7fe640 1 -- 172.21.15.204:0/217587254 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180004400 con 0x7f119815e540 2024-09-12T02:28:00.728 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119815d6c0 con 0x7f119815e540 2024-09-12T02:28:00.729 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:00.725+0000 7fd67392f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:28:00.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f118f7fe640 1 -- 172.21.15.204:0/217587254 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f118000ca60 con 0x7f119815e540 2024-09-12T02:28:00.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.725+0000 7f118f7fe640 1 -- 172.21.15.204:0/217587254 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f118000cd50 con 0x7f119815e540 2024-09-12T02:28:00.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.726+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11980b01c0 con 0x7f119815e540 2024-09-12T02:28:00.729 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.728+0000 7f118f7fe640 1 -- 172.21.15.204:0/217587254 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1180017020 con 0x7f119815e540 2024-09-12T02:28:00.798 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.798+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9c94f42d-d96a-4dd2-a8bf-a6a92939b002", "id": 3} v 0) -- 0x7f11980b1820 con 0x7f119815e540 2024-09-12T02:28:00.803 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.803+0000 7f118f7fe640 1 -- 172.21.15.204:0/217587254 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c94f42d-d96a-4dd2-a8bf-a6a92939b002", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f11800036f0 con 0x7f119815e540 2024-09-12T02:28:00.804 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-09-12T02:28:00.805 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.804+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 msgr2=0x7f119815d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.804+0000 7f119d56d640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f119815d180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f118000e810 tx=0x7f118000ecd0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.804+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 shutdown_connections 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.805+0000 7f119d56d640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f119815e540 0x7f119815d180 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.805+0000 7f119d56d640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f119815e920 0x7f1198143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.805+0000 7f119d56d640 1 --2- 172.21.15.204:0/217587254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11980cd430 0x7f119815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.805+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 >> 172.21.15.204:0/217587254 conn(0x7f11980b06c0 msgr2=0x7f11980729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.805+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 shutdown_connections 2024-09-12T02:28:00.806 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.805+0000 7f119d56d640 1 -- 172.21.15.204:0/217587254 wait complete. 2024-09-12T02:28:00.818 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 3c05e764-f178-4109-8429-5d8c25753834 4 2024-09-12T02:28:00.918 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.917+0000 7ff98ede4640 1 Processor -- start 2024-09-12T02:28:00.918 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.917+0000 7ff98ede4640 1 -- start start 2024-09-12T02:28:00.920 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98ede4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff9880b5d40 0x7ff98806f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.920 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98ede4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff98815c050 0x7ff9880b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.920 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98ede4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98806ff70 con 0x7ff98806fb50 2024-09-12T02:28:00.920 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98ede4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff9880729a0 con 0x7ff98815c050 2024-09-12T02:28:00.920 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98ede4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff98815c4a0 con 0x7ff9880b5d40 2024-09-12T02:28:00.920 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98cb80640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff9880b5d40 0x7ff98806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98cb80640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff9880b5d40 0x7ff98806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56094/0 (socket says 172.21.15.204:56094) 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98cb80640 1 -- 172.21.15.204:0/888680491 learned_addr learned my addr 172.21.15.204:0/888680491 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98d381640 1 --2- 172.21.15.204:0/888680491 >> v2:172.21.15.181:3300/0 conn(0x7ff98815c050 0x7ff9880b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98cb80640 1 -- 172.21.15.204:0/888680491 >> v2:172.21.15.181:3300/0 conn(0x7ff98815c050 msgr2=0x7ff9880b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98cb80640 1 --2- 172.21.15.204:0/888680491 >> v2:172.21.15.181:3300/0 conn(0x7ff98815c050 0x7ff9880b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98cb80640 1 -- 172.21.15.204:0/888680491 >> v1:172.21.15.181:6789/0 conn(0x7ff98806fb50 legacy=0x7ff98815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98cb80640 1 -- 172.21.15.204:0/888680491 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9880b6120 con 0x7ff9880b5d40 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.918+0000 7ff98d381640 1 --2- 172.21.15.204:0/888680491 >> v2:172.21.15.181:3300/0 conn(0x7ff98815c050 0x7ff9880b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.919+0000 7ff98cb80640 1 --2- 172.21.15.204:0/888680491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9880b5d40 0x7ff98806f610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9880706d0 tx=0x7ff97c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a899bfa2e9848840 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.919+0000 7ff9877fe640 1 -- 172.21.15.204:0/888680491 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c037070 con 0x7ff9880b5d40 2024-09-12T02:28:00.921 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.919+0000 7ff9877fe640 1 -- 172.21.15.204:0/888680491 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97c032440 con 0x7ff9880b5d40 2024-09-12T02:28:00.922 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.919+0000 7ff9877fe640 1 -- 172.21.15.204:0/888680491 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c032810 con 0x7ff9880b5d40 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 -- 172.21.15.204:0/888680491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9880b5d40 msgr2=0x7ff98806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 --2- 172.21.15.204:0/888680491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9880b5d40 0x7ff98806f610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9880706d0 tx=0x7ff97c02a270 comp rx=0 tx=0).stop 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 -- 172.21.15.204:0/888680491 shutdown_connections 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 --2- 172.21.15.204:0/888680491 >> v2:172.21.15.181:3300/0 conn(0x7ff98815c050 0x7ff9880b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 --2- 172.21.15.204:0/888680491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9880b5d40 0x7ff98806f610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 -- 172.21.15.204:0/888680491 >> 172.21.15.204:0/888680491 conn(0x7ff9880b2fa0 msgr2=0x7ff9880b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 -- 172.21.15.204:0/888680491 shutdown_connections 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.920+0000 7ff98ede4640 1 -- 172.21.15.204:0/888680491 wait complete. 2024-09-12T02:28:00.925 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.921+0000 7ff98ede4640 1 Processor -- start 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.921+0000 7ff98ede4640 1 -- start start 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98ede4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff98806fb50 0x7ff9880ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98ede4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9880b5d40 0x7ff98815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98ede4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff98815c050 0x7ff9881e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98ede4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff988072630 con 0x7ff98815c050 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98ede4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff988072350 con 0x7ff98806fb50 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98ede4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff988072e30 con 0x7ff9880b5d40 2024-09-12T02:28:00.926 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff98806fb50 0x7ff9880ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff98806fb50 0x7ff9880ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:56102/0 (socket says 172.21.15.204:56102) 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 -- 172.21.15.204:0/470910269 learned_addr learned my addr 172.21.15.204:0/470910269 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff987fff640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9880b5d40 0x7ff98815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98d381640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff98815c050 0x7ff9881e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 -- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9880b5d40 msgr2=0x7ff98815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9880b5d40 0x7ff98815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 -- 172.21.15.204:0/470910269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff98815c050 msgr2=0x7ff9881e5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff98815c050 0x7ff9881e5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.922+0000 7ff98cb80640 1 -- 172.21.15.204:0/470910269 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9880aaf40 con 0x7ff98806fb50 2024-09-12T02:28:00.927 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff98cb80640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff98806fb50 0x7ff9880ac2c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff97c02a2b0 tx=0x7ff97c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff9857fa640 1 -- 172.21.15.204:0/470910269 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c03f070 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff9857fa640 1 -- 172.21.15.204:0/470910269 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97c030a80 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9880ab220 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff9857fa640 1 -- 172.21.15.204:0/470910269 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c037040 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9880ab7e0 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff9857fa640 1 -- 172.21.15.204:0/470910269 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff97c04c7c0 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.923+0000 7ff9857fa640 1 -- 172.21.15.204:0/470910269 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff97c039900 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.924+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98806f610 con 0x7ff98806fb50 2024-09-12T02:28:00.928 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.928+0000 7ff9857fa640 1 -- 172.21.15.204:0/470910269 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff9880b6120 con 0x7ff98806fb50 2024-09-12T02:28:00.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:00.998+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3c05e764-f178-4109-8429-5d8c25753834", "id": 4} v 0) -- 0x7ff9880b1860 con 0x7ff98806fb50 2024-09-12T02:28:01.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.001+0000 7ff9857fa640 1 -- 172.21.15.204:0/470910269 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c05e764-f178-4109-8429-5d8c25753834", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff97c04cbf0 con 0x7ff98806fb50 2024-09-12T02:28:01.001 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-09-12T02:28:01.002 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff98806fb50 msgr2=0x7ff9880ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.002 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff98806fb50 0x7ff9880ac2c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff97c02a2b0 tx=0x7ff97c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 shutdown_connections 2024-09-12T02:28:01.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff98815c050 0x7ff9881e5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9880b5d40 0x7ff98815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 --2- 172.21.15.204:0/470910269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff98806fb50 0x7ff9880ac2c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 >> 172.21.15.204:0/470910269 conn(0x7ff9880b2fa0 msgr2=0x7ff9880cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 shutdown_connections 2024-09-12T02:28:01.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.002+0000 7ff98ede4640 1 -- 172.21.15.204:0/470910269 wait complete. 2024-09-12T02:28:01.012 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c88060c6-2a6e-472b-bfc4-2fb186734d4a 5 2024-09-12T02:28:01.112 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.111+0000 7f8ab3b0a640 1 Processor -- start 2024-09-12T02:28:01.112 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.112+0000 7f8ab3b0a640 1 -- start start 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.112+0000 7f8ab3b0a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8aac0b6470 0x7f8aac0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.112+0000 7f8ab3b0a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.112+0000 7f8ab3b0a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac0b0530 con 0x7f8aac0cee90 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.112+0000 7f8ab3b0a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac15eb80 con 0x7f8aac0b6470 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.112+0000 7f8ab3b0a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac15ee60 con 0x7f8aac0b5a80 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab20a7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab10a5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8aac0b6470 0x7f8aac0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab20a7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:50994/0 (socket says 172.21.15.204:50994) 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab20a7640 1 -- 172.21.15.204:0/3294474592 learned_addr learned my addr 172.21.15.204:0/3294474592 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab10a5640 1 -- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 msgr2=0x7f8aac154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:01.114 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab10a5640 1 --2- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.115 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab10a5640 1 -- 172.21.15.204:0/3294474592 >> v1:172.21.15.204:6789/0 conn(0x7f8aac0cee90 legacy=0x7f8aac0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.115 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab10a5640 1 -- 172.21.15.204:0/3294474592 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac15f140 con 0x7f8aac0b6470 2024-09-12T02:28:01.115 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.113+0000 7f8ab20a7640 1 --2- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.116 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab10a5640 1 --2- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac0d01e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097a0 tx=0x7f8a9c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ccdaad5f215d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.116 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab08a4640 1 -- 172.21.15.204:0/3294474592 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c037070 con 0x7f8aac0b6470 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab08a4640 1 -- 172.21.15.204:0/3294474592 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c032440 con 0x7f8aac0b6470 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab08a4640 1 -- 172.21.15.204:0/3294474592 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c032810 con 0x7f8aac0b6470 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 msgr2=0x7f8aac0d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab3b0a640 1 --2- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac0d01e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097a0 tx=0x7f8a9c02a180 comp rx=0 tx=0).stop 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3294474592 shutdown_connections 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab3b0a640 1 --2- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab3b0a640 1 --2- 172.21.15.204:0/3294474592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac0d01e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.114+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3294474592 >> 172.21.15.204:0/3294474592 conn(0x7f8aac071620 msgr2=0x7f8aac0b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.115+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3294474592 shutdown_connections 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.115+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3294474592 wait complete. 2024-09-12T02:28:01.117 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 Processor -- start 2024-09-12T02:28:01.118 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 -- start start 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8aac0cee90 0x7f8aac14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0cf270 con 0x7f8aac0cee90 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac15f940 con 0x7f8aac0b6470 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.116+0000 7f8ab3b0a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0cf3f0 con 0x7f8aac0b5a80 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab10a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.120 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac1538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:51008/0 (socket says 172.21.15.204:51008) 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab10a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:37576/0 (socket says 172.21.15.204:37576) 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 -- 172.21.15.204:0/3283694375 learned_addr learned my addr 172.21.15.204:0/3283694375 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab20a7640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8aac0cee90 0x7f8aac14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 -- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 msgr2=0x7f8aac14e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac14e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 -- 172.21.15.204:0/3283694375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8aac0cee90 msgr2=0x7f8aac14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8aac0cee90 0x7f8aac14ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 -- 172.21.15.204:0/3283694375 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac153ed0 con 0x7f8aac0b5a80 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab10a5640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab20a7640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8aac0cee90 0x7f8aac14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab18a6640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac1538f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c3c0 tx=0x7f8aa800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8aa27fc640 1 -- 172.21.15.204:0/3283694375 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80052d0 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8aa27fc640 1 -- 172.21.15.204:0/3283694375 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8005490 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac1541b0 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8aa27fc640 1 -- 172.21.15.204:0/3283694375 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8007260 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac154770 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8aa27fc640 1 -- 172.21.15.204:0/3283694375 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8aa8007400 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.117+0000 7f8aa27fc640 1 -- 172.21.15.204:0/3283694375 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8aa8011590 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.118+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac158a50 con 0x7f8aac0b5a80 2024-09-12T02:28:01.122 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.122+0000 7f8aa27fc640 1 -- 172.21.15.204:0/3283694375 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8aa8020070 con 0x7f8aac0b5a80 2024-09-12T02:28:01.192 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.192+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c88060c6-2a6e-472b-bfc4-2fb186734d4a", "id": 5} v 0) -- 0x7f8aac075420 con 0x7f8aac0b5a80 2024-09-12T02:28:01.198 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.197+0000 7f8aa27fc640 1 -- 172.21.15.204:0/3283694375 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c88060c6-2a6e-472b-bfc4-2fb186734d4a", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8aa80035f0 con 0x7f8aac0b5a80 2024-09-12T02:28:01.198 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-09-12T02:28:01.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 msgr2=0x7f8aac1538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac1538f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c3c0 tx=0x7f8aa800c880 comp rx=0 tx=0).stop 2024-09-12T02:28:01.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 shutdown_connections 2024-09-12T02:28:01.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8aac0b6470 0x7f8aac14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8aac0cee90 0x7f8aac14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 --2- 172.21.15.204:0/3283694375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8aac0b5a80 0x7f8aac1538f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 >> 172.21.15.204:0/3283694375 conn(0x7f8aac071620 msgr2=0x7f8aac160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.198+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 shutdown_connections 2024-09-12T02:28:01.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.199+0000 7f8ab3b0a640 1 -- 172.21.15.204:0/3283694375 wait complete. 2024-09-12T02:28:01.210 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new e16fb49f-de57-4edf-85ff-3b5df78f9622 6 2024-09-12T02:28:01.310 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.309+0000 7f1c2af91640 1 Processor -- start 2024-09-12T02:28:01.310 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.309+0000 7f1c2af91640 1 -- start start 2024-09-12T02:28:01.311 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2af91640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1c240b6470 0x7f1c240d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.311 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2af91640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c240b5a80 0x7f1c24154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.311 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2af91640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c240b0530 con 0x7f1c240cee90 2024-09-12T02:28:01.311 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2af91640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2415eb80 con 0x7f1c240b6470 2024-09-12T02:28:01.311 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2af91640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2415ee60 con 0x7f1c240b5a80 2024-09-12T02:28:01.311 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2952e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c240b5a80 0x7f1c24154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.311 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2952e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c240b5a80 0x7f1c24154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:37580/0 (socket says 172.21.15.204:37580) 2024-09-12T02:28:01.312 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c23fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1c240b6470 0x7f1c240d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.312 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.310+0000 7f1c2952e640 1 -- 172.21.15.204:0/2890226890 learned_addr learned my addr 172.21.15.204:0/2890226890 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:01.312 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c2952e640 1 -- 172.21.15.204:0/2890226890 >> v2:172.21.15.181:3300/0 conn(0x7f1c240b6470 msgr2=0x7f1c240d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:01.312 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c2952e640 1 --2- 172.21.15.204:0/2890226890 >> v2:172.21.15.181:3300/0 conn(0x7f1c240b6470 0x7f1c240d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.312 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c2952e640 1 -- 172.21.15.204:0/2890226890 >> v1:172.21.15.181:6789/0 conn(0x7f1c240cee90 legacy=0x7f1c240b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.312 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c2952e640 1 -- 172.21.15.204:0/2890226890 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2415f140 con 0x7f1c240b5a80 2024-09-12T02:28:01.313 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c2952e640 1 --2- 172.21.15.204:0/2890226890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240b5a80 0x7f1c24154be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c240aad30 tx=0x7f1c1c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3d3189a60cbc1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.313 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c237fe640 1 -- 172.21.15.204:0/2890226890 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c036070 con 0x7f1c240b5a80 2024-09-12T02:28:01.313 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c237fe640 1 -- 172.21.15.204:0/2890226890 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c031600 con 0x7f1c240b5a80 2024-09-12T02:28:01.313 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.311+0000 7f1c237fe640 1 -- 172.21.15.204:0/2890226890 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0319d0 con 0x7f1c240b5a80 2024-09-12T02:28:01.313 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 -- 172.21.15.204:0/2890226890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240b5a80 msgr2=0x7f1c24154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.313 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 --2- 172.21.15.204:0/2890226890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240b5a80 0x7f1c24154be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c240aad30 tx=0x7f1c1c02a730 comp rx=0 tx=0).stop 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 -- 172.21.15.204:0/2890226890 shutdown_connections 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 --2- 172.21.15.204:0/2890226890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240b5a80 0x7f1c24154be0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 --2- 172.21.15.204:0/2890226890 >> v2:172.21.15.181:3300/0 conn(0x7f1c240b6470 0x7f1c240d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 -- 172.21.15.204:0/2890226890 >> 172.21.15.204:0/2890226890 conn(0x7f1c24071620 msgr2=0x7f1c240b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 -- 172.21.15.204:0/2890226890 shutdown_connections 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.312+0000 7f1c2af91640 1 -- 172.21.15.204:0/2890226890 wait complete. 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.313+0000 7f1c2af91640 1 Processor -- start 2024-09-12T02:28:01.314 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.313+0000 7f1c2af91640 1 -- start start 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2af91640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c240b5a80 0x7f1c241f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2af91640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c240b6470 0x7f1c240ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2af91640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240cee90 0x7f1c240ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2af91640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240cf270 con 0x7f1c240b5a80 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2af91640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2415f940 con 0x7f1c240cee90 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2af91640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240cf3f0 con 0x7f1c240b6470 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c240b6470 0x7f1c240ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.317 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2952e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240cee90 0x7f1c240ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c240b6470 0x7f1c240ab7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:51022/0 (socket says 172.21.15.204:51022) 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c2952e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240cee90 0x7f1c240ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:37588/0 (socket says 172.21.15.204:37588) 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c23fff640 1 -- 172.21.15.204:0/2937618035 learned_addr learned my addr 172.21.15.204:0/2937618035 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.314+0000 7f1c28d2d640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c240b5a80 0x7f1c241f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c23fff640 1 -- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240cee90 msgr2=0x7f1c240ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c23fff640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240cee90 0x7f1c240ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c23fff640 1 -- 172.21.15.204:0/2937618035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c240b5a80 msgr2=0x7f1c241f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c23fff640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c240b5a80 0x7f1c241f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c23fff640 1 -- 172.21.15.204:0/2937618035 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c241f80b0 con 0x7f1c240b6470 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c2952e640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240cee90 0x7f1c240ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c28d2d640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c240b5a80 0x7f1c241f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c23fff640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c240b6470 0x7f1c240ab7d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e8b0 tx=0x7f1c1000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c217fa640 1 -- 172.21.15.204:0/2937618035 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c10017070 con 0x7f1c240b6470 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c217fa640 1 -- 172.21.15.204:0/2937618035 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1000c940 con 0x7f1c240b6470 2024-09-12T02:28:01.318 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c241f8390 con 0x7f1c240b6470 2024-09-12T02:28:01.319 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c217fa640 1 -- 172.21.15.204:0/2937618035 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000cd10 con 0x7f1c240b6470 2024-09-12T02:28:01.319 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c24153920 con 0x7f1c240b6470 2024-09-12T02:28:01.319 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c217fa640 1 -- 172.21.15.204:0/2937618035 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c1001a070 con 0x7f1c240b6470 2024-09-12T02:28:01.319 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.315+0000 7f1c217fa640 1 -- 172.21.15.204:0/2937618035 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1c1001ca90 con 0x7f1c240b6470 2024-09-12T02:28:01.319 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.316+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c241f88b0 con 0x7f1c240b6470 2024-09-12T02:28:01.320 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.320+0000 7f1c217fa640 1 -- 172.21.15.204:0/2937618035 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1c241f88b0 con 0x7f1c240b6470 2024-09-12T02:28:01.389 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.389+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e16fb49f-de57-4edf-85ff-3b5df78f9622", "id": 6} v 0) -- 0x7f1c24154600 con 0x7f1c240b6470 2024-09-12T02:28:01.394 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.394+0000 7f1c217fa640 1 -- 172.21.15.204:0/2937618035 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e16fb49f-de57-4edf-85ff-3b5df78f9622", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1c1001c5d0 con 0x7f1c240b6470 2024-09-12T02:28:01.395 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-09-12T02:28:01.396 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c240b6470 msgr2=0x7f1c240ab7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.396 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c240b6470 0x7f1c240ab7d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e8b0 tx=0x7f1c1000ed70 comp rx=0 tx=0).stop 2024-09-12T02:28:01.396 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 shutdown_connections 2024-09-12T02:28:01.396 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c240cee90 0x7f1c240ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.396 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c240b6470 0x7f1c240ab7d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.396 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 --2- 172.21.15.204:0/2937618035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c240b5a80 0x7f1c241f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.396 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 >> 172.21.15.204:0/2937618035 conn(0x7f1c24071620 msgr2=0x7f1c24160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.397 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 shutdown_connections 2024-09-12T02:28:01.397 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.395+0000 7f1c2af91640 1 -- 172.21.15.204:0/2937618035 wait complete. 2024-09-12T02:28:01.406 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 5cfac978-c0fc-4a3d-a935-cb18a6751dab 7 2024-09-12T02:28:01.505 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.504+0000 7f8fb9903640 1 Processor -- start 2024-09-12T02:28:01.505 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.504+0000 7f8fb9903640 1 -- start start 2024-09-12T02:28:01.506 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.505+0000 7f8fb9903640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8fb40b5e40 0x7f8fb40aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.506 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.505+0000 7f8fb9903640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fb40b6290 0x7f8fb40b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.505+0000 7f8fb9903640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb415eb10 con 0x7f8fb415e730 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.505+0000 7f8fb9903640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb406cb70 con 0x7f8fb40b5e40 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.505+0000 7f8fb9903640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb40b09e0 con 0x7f8fb40b6290 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.505+0000 7f8fb37fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fb40b6290 0x7f8fb40b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.505+0000 7f8fb37fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fb40b6290 0x7f8fb40b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:37600/0 (socket says 172.21.15.204:37600) 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.506+0000 7f8fb37fe640 1 -- 172.21.15.204:0/1090704942 learned_addr learned my addr 172.21.15.204:0/1090704942 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.506+0000 7f8fb27fc640 1 --2- 172.21.15.204:0/1090704942 >> v2:172.21.15.181:3300/0 conn(0x7f8fb40b5e40 0x7f8fb40aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.506+0000 7f8fb37fe640 1 -- 172.21.15.204:0/1090704942 >> v2:172.21.15.181:3300/0 conn(0x7f8fb40b5e40 msgr2=0x7f8fb40aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.506+0000 7f8fb37fe640 1 --2- 172.21.15.204:0/1090704942 >> v2:172.21.15.181:3300/0 conn(0x7f8fb40b5e40 0x7f8fb40aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.506+0000 7f8fb37fe640 1 -- 172.21.15.204:0/1090704942 >> v1:172.21.15.181:6789/0 conn(0x7f8fb415e730 legacy=0x7f8fb41621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.506+0000 7f8fb37fe640 1 -- 172.21.15.204:0/1090704942 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb406bff0 con 0x7f8fb40b6290 2024-09-12T02:28:01.508 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.506+0000 7f8fb37fe640 1 --2- 172.21.15.204:0/1090704942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b6290 0x7f8fb40b04a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40b6220 tx=0x7f8fac02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e962b24efb9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb1ffb640 1 -- 172.21.15.204:0/1090704942 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac036070 con 0x7f8fb40b6290 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb1ffb640 1 -- 172.21.15.204:0/1090704942 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fac031600 con 0x7f8fb40b6290 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb1ffb640 1 -- 172.21.15.204:0/1090704942 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0319d0 con 0x7f8fb40b6290 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 -- 172.21.15.204:0/1090704942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b6290 msgr2=0x7f8fb40b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 --2- 172.21.15.204:0/1090704942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b6290 0x7f8fb40b04a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40b6220 tx=0x7f8fac02a730 comp rx=0 tx=0).stop 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 -- 172.21.15.204:0/1090704942 shutdown_connections 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 --2- 172.21.15.204:0/1090704942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b6290 0x7f8fb40b04a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 --2- 172.21.15.204:0/1090704942 >> v2:172.21.15.181:3300/0 conn(0x7f8fb40b5e40 0x7f8fb40aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 -- 172.21.15.204:0/1090704942 >> 172.21.15.204:0/1090704942 conn(0x7f8fb40b2fa0 msgr2=0x7f8fb40b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 -- 172.21.15.204:0/1090704942 shutdown_connections 2024-09-12T02:28:01.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.507+0000 7f8fb9903640 1 -- 172.21.15.204:0/1090704942 wait complete. 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.508+0000 7f8fb9903640 1 Processor -- start 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb9903640 1 -- start start 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb9903640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b5e40 0x7f8fb40cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb9903640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40b6290 0x7f8fb4152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb9903640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fb415e730 0x7f8fb41f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb9903640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb406c890 con 0x7f8fb415e730 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb9903640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb406c5b0 con 0x7f8fb40b5e40 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb9903640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb406bc10 con 0x7f8fb40b6290 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.509+0000 7f8fb2ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b5e40 0x7f8fb40cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.512 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b5e40 0x7f8fb40cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:37616/0 (socket says 172.21.15.204:37616) 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 -- 172.21.15.204:0/3402766946 learned_addr learned my addr 172.21.15.204:0/3402766946 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb27fc640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40b6290 0x7f8fb4152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb37fe640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fb415e730 0x7f8fb41f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 -- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40b6290 msgr2=0x7f8fb4152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40b6290 0x7f8fb4152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 -- 172.21.15.204:0/3402766946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fb415e730 msgr2=0x7f8fb41f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fb415e730 0x7f8fb41f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 -- 172.21.15.204:0/3402766946 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb41f64d0 con 0x7f8fb40b5e40 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb27fc640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40b6290 0x7f8fb4152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb37fe640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fb415e730 0x7f8fb41f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb2ffd640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b5e40 0x7f8fb40cb340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c450 tx=0x7f8f9c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fabfff640 1 -- 172.21.15.204:0/3402766946 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0052d0 con 0x7f8fb40b5e40 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fabfff640 1 -- 172.21.15.204:0/3402766946 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c005470 con 0x7f8fb40b5e40 2024-09-12T02:28:01.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb41f67b0 con 0x7f8fb40b5e40 2024-09-12T02:28:01.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fabfff640 1 -- 172.21.15.204:0/3402766946 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c012870 con 0x7f8fb40b5e40 2024-09-12T02:28:01.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41f6d70 con 0x7f8fb40b5e40 2024-09-12T02:28:01.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.510+0000 7f8fabfff640 1 -- 172.21.15.204:0/3402766946 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f9c012a10 con 0x7f8fb40b5e40 2024-09-12T02:28:01.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.511+0000 7f8fabfff640 1 -- 172.21.15.204:0/3402766946 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8f9c003c50 con 0x7f8fb40b5e40 2024-09-12T02:28:01.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.511+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb41621b0 con 0x7f8fb40b5e40 2024-09-12T02:28:01.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.513+0000 7f8fabfff640 1 -- 172.21.15.204:0/3402766946 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8f9c012d00 con 0x7f8fb40b5e40 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.584+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5cfac978-c0fc-4a3d-a935-cb18a6751dab", "id": 7} v 0) -- 0x7f8fb40b2ce0 con 0x7f8fb40b5e40 2024-09-12T02:28:01.589 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.589+0000 7f8fabfff640 1 -- 172.21.15.204:0/3402766946 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5cfac978-c0fc-4a3d-a935-cb18a6751dab", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8f9c0035f0 con 0x7f8fb40b5e40 2024-09-12T02:28:01.590 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b5e40 msgr2=0x7f8fb40cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b5e40 0x7f8fb40cb340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c450 tx=0x7f8f9c00c910 comp rx=0 tx=0).stop 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 shutdown_connections 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fb415e730 0x7f8fb41f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fb40b6290 0x7f8fb4152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 --2- 172.21.15.204:0/3402766946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fb40b5e40 0x7f8fb40cb340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 >> 172.21.15.204:0/3402766946 conn(0x7f8fb40b2fa0 msgr2=0x7f8fb415dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 shutdown_connections 2024-09-12T02:28:01.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:01.590+0000 7f8fb9903640 1 -- 172.21.15.204:0/3402766946 wait complete. 2024-09-12T02:28:01.601 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T02:28:01.601 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T02:28:01.604 INFO:tasks.ceph.osd.0:Started 2024-09-12T02:28:01.604 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T02:28:01.604 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T02:28:01.606 INFO:tasks.ceph.osd.1:Started 2024-09-12T02:28:01.606 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T02:28:01.607 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T02:28:01.609 INFO:tasks.ceph.osd.2:Started 2024-09-12T02:28:01.609 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T02:28:01.609 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T02:28:01.611 INFO:tasks.ceph.osd.3:Started 2024-09-12T02:28:01.611 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T02:28:01.612 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T02:28:01.616 INFO:tasks.ceph.osd.4:Started 2024-09-12T02:28:01.616 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T02:28:01.616 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T02:28:01.618 INFO:tasks.ceph.osd.5:Started 2024-09-12T02:28:01.618 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T02:28:01.619 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T02:28:01.620 INFO:tasks.ceph.osd.6:Started 2024-09-12T02:28:01.621 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T02:28:01.621 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T02:28:01.623 INFO:tasks.ceph.osd.7:Started 2024-09-12T02:28:01.623 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:01.648 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:01.648+0000 7fda3fc93040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:28:01.722 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:01.722+0000 7fda3fc93040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:28:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.750+0000 7fb2dd04c640 1 Processor -- start 2024-09-12T02:28:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.750+0000 7fb2dd04c640 1 -- start start 2024-09-12T02:28:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2dd04c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb2d815c4a0 0x7fb2d80cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2dd04c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d815c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2dd04c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d80d0a30 con 0x7fb2d80d2da0 2024-09-12T02:28:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2dd04c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d80d0d30 con 0x7fb2d815c4a0 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2dd04c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d80b76f0 con 0x7fb2d80b47a0 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d6d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb2d815c4a0 0x7fb2d80cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d6d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb2d815c4a0 0x7fb2d80cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:59756/0 (socket says 172.21.15.181:59756) 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d815c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:51472/0 (socket says 172.21.15.181:51472) 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d6d9d640 1 -- 172.21.15.181:0/1338327524 learned_addr learned my addr 172.21.15.181:0/1338327524 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d6d9d640 1 -- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 msgr2=0x7fb2d815c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d6d9d640 1 --2- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d815c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d6d9d640 1 -- 172.21.15.181:0/1338327524 >> v1:172.21.15.204:6789/0 conn(0x7fb2d80d2da0 legacy=0x7fb2d80b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.751+0000 7fb2d6d9d640 1 -- 172.21.15.181:0/1338327524 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d8073710 con 0x7fb2d815c4a0 2024-09-12T02:28:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.752+0000 7fb2d759e640 1 --2- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.752+0000 7fb2d6d9d640 1 --2- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d815c4a0 0x7fb2d80cff80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009870 tx=0x7fb2c802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7f2edbe5be4b2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.752+0000 7fb2d659c640 1 -- 172.21.15.181:0/1338327524 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8037070 con 0x7fb2d815c4a0 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.752+0000 7fb2d659c640 1 -- 172.21.15.181:0/1338327524 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c8032440 con 0x7fb2d815c4a0 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.752+0000 7fb2d659c640 1 -- 172.21.15.181:0/1338327524 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8032810 con 0x7fb2d815c4a0 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d815c4a0 msgr2=0x7fb2d80cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 --2- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d815c4a0 0x7fb2d80cff80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009870 tx=0x7fb2c802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1338327524 shutdown_connections 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 --2- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 --2- 172.21.15.181:0/1338327524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d815c4a0 0x7fb2d80cff80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1338327524 >> 172.21.15.181:0/1338327524 conn(0x7fb2d8067950 msgr2=0x7fb2d8067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1338327524 shutdown_connections 2024-09-12T02:28:01.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.753+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1338327524 wait complete. 2024-09-12T02:28:01.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.754+0000 7fb2dd04c640 1 Processor -- start 2024-09-12T02:28:01.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.754+0000 7fb2dd04c640 1 -- start start 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2dd04c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d8153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2dd04c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d80d2da0 0x7fb2d814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2dd04c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d815c4a0 0x7fb2d8150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2dd04c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8166030 con 0x7fb2d815c4a0 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2dd04c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d80d28e0 con 0x7fb2d80d2da0 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2dd04c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d81661b0 con 0x7fb2d80b47a0 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2d759e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d815c4a0 0x7fb2d8150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2d6d9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d8153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2cffff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d80d2da0 0x7fb2d814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2d6d9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d8153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:51482/0 (socket says 172.21.15.181:51482) 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2cffff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d80d2da0 0x7fb2d814f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:59760/0 (socket says 172.21.15.181:59760) 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.755+0000 7fb2d6d9d640 1 -- 172.21.15.181:0/1519742175 learned_addr learned my addr 172.21.15.181:0/1519742175 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:01.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2d759e640 1 -- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 msgr2=0x7fb2d8153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2d759e640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d8153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2d759e640 1 -- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d80d2da0 msgr2=0x7fb2d814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2d759e640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d80d2da0 0x7fb2d814f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2d759e640 1 -- 172.21.15.181:0/1519742175 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d81496b0 con 0x7fb2d815c4a0 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2d6d9d640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d8153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2cffff640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d80d2da0 0x7fb2d814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2d759e640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d815c4a0 0x7fb2d8150bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80b4c70 tx=0x7fb2d000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2cf7fe640 1 -- 172.21.15.181:0/1519742175 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0018020 con 0x7fb2d815c4a0 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2cf7fe640 1 -- 172.21.15.181:0/1519742175 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d0014480 con 0x7fb2d815c4a0 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d814fba0 con 0x7fb2d815c4a0 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2cf7fe640 1 -- 172.21.15.181:0/1519742175 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0014870 con 0x7fb2d815c4a0 2024-09-12T02:28:01.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d8150160 con 0x7fb2d815c4a0 2024-09-12T02:28:01.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2cf7fe640 1 -- 172.21.15.181:0/1519742175 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb2d0005d10 con 0x7fb2d815c4a0 2024-09-12T02:28:01.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.756+0000 7fb2cf7fe640 1 -- 172.21.15.181:0/1519742175 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb2d0013ab0 con 0x7fb2d815c4a0 2024-09-12T02:28:01.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.757+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d814ec20 con 0x7fb2d815c4a0 2024-09-12T02:28:01.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.759+0000 7fb2cf7fe640 1 -- 172.21.15.181:0/1519742175 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb2d814ec20 con 0x7fb2d815c4a0 2024-09-12T02:28:01.771 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:01.771+0000 7fd67392f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:28:01.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.817+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2d80cff80 con 0x7fb2d815c4a0 2024-09-12T02:28:01.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.818+0000 7fb2cf7fe640 1 -- 172.21.15.181:0/1519742175 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb2d0022030 con 0x7fb2d815c4a0 2024-09-12T02:28:01.821 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":10,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:01.585954+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:01.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d815c4a0 msgr2=0x7fb2d8150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d815c4a0 0x7fb2d8150bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80b4c70 tx=0x7fb2d000ef90 comp rx=0 tx=0).stop 2024-09-12T02:28:01.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 shutdown_connections 2024-09-12T02:28:01.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2d80d2da0 0x7fb2d814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d815c4a0 0x7fb2d8150bc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 --2- 172.21.15.181:0/1519742175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2d80b47a0 0x7fb2d8153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 >> 172.21.15.181:0/1519742175 conn(0x7fb2d8067950 msgr2=0x7fb2d814e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 shutdown_connections 2024-09-12T02:28:01.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:01.819+0000 7fb2dd04c640 1 -- 172.21.15.181:0/1519742175 wait complete. 2024-09-12T02:28:01.823 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:01.823+0000 7fd67392f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:28:01.834 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T02:28:01.834 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T02:28:02.105 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.104+0000 7fda3fc93040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:28:02.188 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.188+0000 7fda3fc93040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:28:02.189 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.189+0000 7fd67392f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:28:02.276 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.275+0000 7fd67392f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:28:02.298 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.297+0000 7fda3fc93040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:02.345 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.344+0000 7fda3fc93040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:28:02.382 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.382+0000 7fd67392f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:02.428 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.427+0000 7fd67392f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:28:02.455 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.455+0000 7fda3fc93040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:28:02.508 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.508+0000 7fda3fc93040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:28:02.542 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.541+0000 7fd67392f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:28:02.554 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.554+0000 7fda3fc93040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:28:02.596 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.595+0000 7fd67392f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:28:02.640 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:02.641 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.640+0000 7fd67392f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:28:02.670 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.670+0000 7fda3fc93040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:28:02.723 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.723+0000 7fda3fc93040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:28:02.731 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.730+0000 7fc2690c9640 1 Processor -- start 2024-09-12T02:28:02.731 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.731+0000 7fc2690c9640 1 -- start start 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.731+0000 7fc2690c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc264071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.731+0000 7fc2690c9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2640d1ba0 0x7fc264073740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.731+0000 7fc2690c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc264073c80 con 0x7fc26406ce20 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.731+0000 7fc2690c9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc2640d20f0 con 0x7fc2640d1ba0 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.731+0000 7fc2690c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc264070a80 con 0x7fc26415e650 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc26359e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2640d1ba0 0x7fc264073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc26359e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2640d1ba0 0x7fc264073740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:47474/0 (socket says 172.21.15.181:47474) 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc26359e640 1 -- 172.21.15.181:0/3326673753 learned_addr learned my addr 172.21.15.181:0/3326673753 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:02.733 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc262d9d640 1 --2- 172.21.15.181:0/3326673753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc264071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:02.734 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc26359e640 1 -- 172.21.15.181:0/3326673753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 msgr2=0x7fc264071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:02.734 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc261d9b640 1 -- 172.21.15.181:0/3326673753 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439712990 0 0) 0x7fc264073c80 con 0x7fc26406ce20 2024-09-12T02:28:02.734 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc26359e640 1 --2- 172.21.15.181:0/3326673753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc264071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.734 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc26359e640 1 -- 172.21.15.181:0/3326673753 >> v1:172.21.15.204:6789/0 conn(0x7fc26406ce20 legacy=0x7fc264073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:02.734 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.732+0000 7fc26359e640 1 -- 172.21.15.181:0/3326673753 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc264070d60 con 0x7fc2640d1ba0 2024-09-12T02:28:02.735 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.733+0000 7fc26359e640 1 --2- 172.21.15.181:0/3326673753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2640d1ba0 0x7fc264073740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009e50 tx=0x7fc25c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86afa586507bc06e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:02.735 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.733+0000 7fc261d9b640 1 -- 172.21.15.181:0/3326673753 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c036070 con 0x7fc2640d1ba0 2024-09-12T02:28:02.735 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.733+0000 7fc261d9b640 1 -- 172.21.15.181:0/3326673753 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25c031600 con 0x7fc2640d1ba0 2024-09-12T02:28:02.735 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.733+0000 7fc261d9b640 1 -- 172.21.15.181:0/3326673753 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0319d0 con 0x7fc2640d1ba0 2024-09-12T02:28:02.735 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 -- 172.21.15.181:0/3326673753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2640d1ba0 msgr2=0x7fc264073740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:02.735 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 --2- 172.21.15.181:0/3326673753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2640d1ba0 0x7fc264073740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009e50 tx=0x7fc25c02a710 comp rx=0 tx=0).stop 2024-09-12T02:28:02.736 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 -- 172.21.15.181:0/3326673753 shutdown_connections 2024-09-12T02:28:02.736 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 --2- 172.21.15.181:0/3326673753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2640d1ba0 0x7fc264073740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.736 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 --2- 172.21.15.181:0/3326673753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc264071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.736 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 -- 172.21.15.181:0/3326673753 >> 172.21.15.181:0/3326673753 conn(0x7fc2640b4280 msgr2=0x7fc2640b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:02.736 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 -- 172.21.15.181:0/3326673753 shutdown_connections 2024-09-12T02:28:02.736 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.734+0000 7fc2690c9640 1 -- 172.21.15.181:0/3326673753 wait complete. 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.735+0000 7fc2690c9640 1 Processor -- start 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.735+0000 7fc2690c9640 1 -- start start 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc2690c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26406ce20 0x7fc26415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc2690c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2640d1ba0 0x7fc2640b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc2690c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc2640b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc2690c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc26415ebb0 con 0x7fc26406ce20 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc2690c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc26415ea30 con 0x7fc2640d1ba0 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc2690c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc26415ed30 con 0x7fc26415e650 2024-09-12T02:28:02.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc262d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26406ce20 0x7fc26415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc262d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26406ce20 0x7fc26415a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:47486/0 (socket says 172.21.15.181:47486) 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc262d9d640 1 -- 172.21.15.181:0/3664701071 learned_addr learned my addr 172.21.15.181:0/3664701071 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc26259c640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2640d1ba0 0x7fc2640b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.736+0000 7fc26359e640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc2640b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc262d9d640 1 -- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 msgr2=0x7fc2640b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc262d9d640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc2640b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc262d9d640 1 -- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2640d1ba0 msgr2=0x7fc2640b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc262d9d640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2640d1ba0 0x7fc2640b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc262d9d640 1 -- 172.21.15.181:0/3664701071 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2640b3140 con 0x7fc26406ce20 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc262d9d640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26406ce20 0x7fc26415a050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc25400e8a0 tx=0x7fc25400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc24b7fe640 1 -- 172.21.15.181:0/3664701071 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254017070 con 0x7fc26406ce20 2024-09-12T02:28:02.740 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc24b7fe640 1 -- 172.21.15.181:0/3664701071 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25400c940 con 0x7fc26406ce20 2024-09-12T02:28:02.741 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc24b7fe640 1 -- 172.21.15.181:0/3664701071 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25400cd30 con 0x7fc26406ce20 2024-09-12T02:28:02.741 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2640b33f0 con 0x7fc26406ce20 2024-09-12T02:28:02.741 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2640b39b0 con 0x7fc26406ce20 2024-09-12T02:28:02.741 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc24b7fe640 1 -- 172.21.15.181:0/3664701071 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc25401a070 con 0x7fc26406ce20 2024-09-12T02:28:02.741 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.737+0000 7fc24b7fe640 1 -- 172.21.15.181:0/3664701071 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc254013b40 con 0x7fc26406ce20 2024-09-12T02:28:02.741 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.738+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc264071560 con 0x7fc26406ce20 2024-09-12T02:28:02.742 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.740+0000 7fc24b7fe640 1 -- 172.21.15.181:0/3664701071 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc254006480 con 0x7fc26406ce20 2024-09-12T02:28:02.752 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.751+0000 7fd67392f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:28:02.778 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.778+0000 7fda3fc93040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:28:02.799 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.799+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2641545d0 con 0x7fc26406ce20 2024-09-12T02:28:02.800 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.799+0000 7fc24b7fe640 1 -- 172.21.15.181:0/3664701071 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc254006660 con 0x7fc26406ce20 2024-09-12T02:28:02.800 INFO:teuthology.misc.health.smithi181.stdout: 2024-09-12T02:28:02.800 INFO:teuthology.misc.health.smithi181.stdout:{"epoch":10,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:01.585954+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:02.801 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26406ce20 msgr2=0x7fc26415a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:02.801 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26406ce20 0x7fc26415a050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc25400e8a0 tx=0x7fc25400ed60 comp rx=0 tx=0).stop 2024-09-12T02:28:02.801 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 shutdown_connections 2024-09-12T02:28:02.801 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2640d1ba0 0x7fc2640b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.802 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc26415e650 0x7fc2640b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.802 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 --2- 172.21.15.181:0/3664701071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26406ce20 0x7fc26415a050 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:02.802 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 >> 172.21.15.181:0/3664701071 conn(0x7fc2640b4280 msgr2=0x7fc26406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:02.802 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 shutdown_connections 2024-09-12T02:28:02.802 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:02.800+0000 7fc2690c9640 1 -- 172.21.15.181:0/3664701071 wait complete. 2024-09-12T02:28:02.803 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.802+0000 7fd67392f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:28:02.810 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T02:28:02.849 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.849+0000 7fda3fc93040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:28:02.856 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.855+0000 7fd67392f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:28:02.895 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.895+0000 7fda3fc93040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:28:02.922 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.922+0000 7fd67392f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:28:02.941 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:02.940+0000 7fda3fc93040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:28:02.966 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:02.966+0000 7fd67392f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:28:03.009 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:03.009+0000 7fd67392f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:28:03.112 INFO:tasks.ceph.osd.3.smithi181.stderr:2024-09-12T02:28:03.111+0000 7fede360d640 -1 Falling back to public interface 2024-09-12T02:28:03.121 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-12T02:28:03.120+0000 7f7ffc21b640 -1 Falling back to public interface 2024-09-12T02:28:03.319 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T02:28:03.318+0000 7f6625285640 -1 Falling back to public interface 2024-09-12T02:28:03.338 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T02:28:03.338+0000 7f94b800f640 -1 Falling back to public interface 2024-09-12T02:28:03.358 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-12T02:28:03.357+0000 7f0f17fae640 -1 Falling back to public interface 2024-09-12T02:28:03.588 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T02:28:03.587+0000 7f74d2db0640 -1 Falling back to public interface 2024-09-12T02:28:03.591 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T02:28:03.591+0000 7f8c2960f640 -1 Falling back to public interface 2024-09-12T02:28:03.601 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:03.600+0000 7fda3fc93040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:28:03.617 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-12T02:28:03.616+0000 7f5871618640 -1 Falling back to public interface 2024-09-12T02:28:03.673 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-12T02:28:03.672+0000 7fd67392f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:28:04.618 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:04.617+0000 7fd9e0554640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T02:28:04.618 INFO:tasks.ceph.mgr.y.smithi181.stderr:2024-09-12T02:28:04.618+0000 7fd9e0554640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T02:28:07.427 INFO:tasks.ceph.osd.3.smithi181.stderr:2024-09-12T02:28:07.426+0000 7fede360d640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:28:07.445 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-12T02:28:07.444+0000 7f7ffc21b640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:28:07.648 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T02:28:07.647+0000 7f8c2960f640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:28:07.889 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-12T02:28:07.889+0000 7f0f17fae640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:28:07.891 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T02:28:07.891+0000 7f6625285640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:28:07.899 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T02:28:07.899+0000 7f94b800f640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:28:08.079 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T02:28:08.078+0000 7f74d2db0640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:28:08.112 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-12T02:28:08.111+0000 7f5871618640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:28:09.617 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:09.736 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.736+0000 7f78c6eaf640 1 Processor -- start 2024-09-12T02:28:09.737 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.736+0000 7f78c6eaf640 1 -- start start 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c6eaf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c015e7d0 0x7f78c0072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c6eaf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78c00d0ec0 0x7f78c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c6eaf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c0073560 con 0x7f78c0071140 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c6eaf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f78c0073840 con 0x7f78c00d0ec0 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c6eaf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78c0073b20 con 0x7f78c015e7d0 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c4c4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c015e7d0 0x7f78c0072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c544c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78c00d0ec0 0x7f78c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:09.738 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78bffff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f78c0071140 0x7f78c00d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:53720/0 (socket says 172.21.15.181:53720) 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c544c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78c00d0ec0 0x7f78c006d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:36708/0 (socket says 172.21.15.181:36708) 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c4c4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c015e7d0 0x7f78c0072f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:39434/0 (socket says 172.21.15.181:39434) 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78bffff640 1 -- 172.21.15.181:0/1594650195 learned_addr learned my addr 172.21.15.181:0/1594650195 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c544c640 1 -- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c015e7d0 msgr2=0x7f78c0072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c544c640 1 --2- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c015e7d0 0x7f78c0072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c544c640 1 -- 172.21.15.181:0/1594650195 >> v1:172.21.15.204:6789/0 conn(0x7f78c0071140 legacy=0x7f78c00d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c544c640 1 -- 172.21.15.181:0/1594650195 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c0073e00 con 0x7f78c00d0ec0 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.737+0000 7f78c4c4b640 1 --2- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c015e7d0 0x7f78c0072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:09.739 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.738+0000 7f78c544c640 1 --2- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c00d0ec0 0x7f78c006d360 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009d90 tx=0x7f78b802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e614f3993d01f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:09.753 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.753+0000 7f78bf7fe640 1 -- 172.21.15.181:0/1594650195 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007740 con 0x7f78c00d0ec0 2024-09-12T02:28:09.754 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.753+0000 7f78bf7fe640 1 -- 172.21.15.181:0/1594650195 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b80078e0 con 0x7f78c00d0ec0 2024-09-12T02:28:09.754 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.753+0000 7f78bf7fe640 1 -- 172.21.15.181:0/1594650195 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007cb0 con 0x7f78c00d0ec0 2024-09-12T02:28:09.754 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 -- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c00d0ec0 msgr2=0x7f78c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:09.754 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c00d0ec0 0x7f78c006d360 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009d90 tx=0x7f78b802a660 comp rx=0 tx=0).stop 2024-09-12T02:28:09.755 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 -- 172.21.15.181:0/1594650195 shutdown_connections 2024-09-12T02:28:09.755 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c00d0ec0 0x7f78c006d360 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:09.755 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/1594650195 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c015e7d0 0x7f78c0072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:09.755 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 -- 172.21.15.181:0/1594650195 >> 172.21.15.181:0/1594650195 conn(0x7f78c00d2380 msgr2=0x7f78c00d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:09.755 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 -- 172.21.15.181:0/1594650195 shutdown_connections 2024-09-12T02:28:09.755 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.754+0000 7f78c6eaf640 1 -- 172.21.15.181:0/1594650195 wait complete. 2024-09-12T02:28:09.756 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.755+0000 7f78c6eaf640 1 Processor -- start 2024-09-12T02:28:09.756 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.755+0000 7f78c6eaf640 1 -- start start 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c6eaf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c0071140 0x7f78c00ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c6eaf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c00d0ec0 0x7f78c01f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c6eaf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c015e7d0 0x7f78c01f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c6eaf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f78c006d8a0 con 0x7f78c00d0ec0 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c6eaf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f78c0071580 con 0x7f78c015e7d0 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c6eaf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78c006da20 con 0x7f78c0071140 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c00d0ec0 0x7f78c01f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:09.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c00d0ec0 0x7f78c01f51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41630/0 (socket says 172.21.15.181:41630) 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 -- 172.21.15.181:0/502558004 learned_addr learned my addr 172.21.15.181:0/502558004 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c544c640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c015e7d0 0x7f78c01f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78c4c4b640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c0071140 0x7f78c00ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 -- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c0071140 msgr2=0x7f78c00ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c0071140 0x7f78c00ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 -- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c015e7d0 msgr2=0x7f78c01f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c015e7d0 0x7f78c01f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.757+0000 7f78bffff640 1 -- 172.21.15.181:0/502558004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c01529c0 con 0x7f78c00d0ec0 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.758+0000 7f78c544c640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c015e7d0 0x7f78c01f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.758+0000 7f78bffff640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c00d0ec0 0x7f78c01f51f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c440 tx=0x7f78ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.758+0000 7f78bd7fa640 1 -- 172.21.15.181:0/502558004 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac017070 con 0x7f78c00d0ec0 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.758+0000 7f78bd7fa640 1 -- 172.21.15.181:0/502558004 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ac005ce0 con 0x7f78c00d0ec0 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.758+0000 7f78bd7fa640 1 -- 172.21.15.181:0/502558004 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0072f0 con 0x7f78c00d0ec0 2024-09-12T02:28:09.760 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.758+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c0152ca0 con 0x7f78c00d0ec0 2024-09-12T02:28:09.761 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.758+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c0153260 con 0x7f78c00d0ec0 2024-09-12T02:28:09.761 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.760+0000 7f78bd7fa640 1 -- 172.21.15.181:0/502558004 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f78ac01a070 con 0x7f78c00d0ec0 2024-09-12T02:28:09.761 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.761+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c006d360 con 0x7f78c00d0ec0 2024-09-12T02:28:09.761 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.761+0000 7f78bd7fa640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f78a406bdd0 0x7f78a406e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:09.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.761+0000 7f78bd7fa640 1 -- 172.21.15.181:0/502558004 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f78ac089230 con 0x7f78c00d0ec0 2024-09-12T02:28:09.764 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.763+0000 7f78c4c4b640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f78a406bdd0 0x7f78a406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:09.764 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.764+0000 7f78c4c4b640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f78a406bdd0 0x7f78a406e290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009a30 tx=0x7f78b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:09.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:09.768+0000 7f78bd7fa640 1 -- 172.21.15.181:0/502558004 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78ac0583f0 con 0x7f78c00d0ec0 2024-09-12T02:28:10.036 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.035+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78c00d0380 con 0x7f78c00d0ec0 2024-09-12T02:28:10.037 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.036+0000 7f78bd7fa640 1 -- 172.21.15.181:0/502558004 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f78ac05c6f0 con 0x7f78c00d0ec0 2024-09-12T02:28:10.037 INFO:teuthology.misc.health.smithi181.stdout: 2024-09-12T02:28:10.037 INFO:teuthology.misc.health.smithi181.stdout:{"epoch":13,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:09.626928+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:10.039 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f78a406bdd0 msgr2=0x7f78a406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.039 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f78a406bdd0 0x7f78a406e290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009a30 tx=0x7f78b4008040 comp rx=0 tx=0).stop 2024-09-12T02:28:10.039 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c00d0ec0 msgr2=0x7f78c01f51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c00d0ec0 0x7f78c01f51f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c440 tx=0x7f78ac001e70 comp rx=0 tx=0).stop 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 shutdown_connections 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f78a406bdd0 0x7f78a406e290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78c015e7d0 0x7f78c01f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c00d0ec0 0x7f78c01f51f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 --2- 172.21.15.181:0/502558004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78c0071140 0x7f78c00ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 >> 172.21.15.181:0/502558004 conn(0x7f78c00d2380 msgr2=0x7f78c00b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.038+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 shutdown_connections 2024-09-12T02:28:10.040 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:10.039+0000 7f78c6eaf640 1 -- 172.21.15.181:0/502558004 wait complete. 2024-09-12T02:28:10.041 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-12T02:28:10.041+0000 7f7ff73e5640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:28:10.047 INFO:tasks.ceph.osd.3.smithi181.stderr:2024-09-12T02:28:10.047+0000 7fedde7f9640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:28:10.051 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T02:28:10.060 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-12T02:28:10.060+0000 7f7fefa17640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:10.157 INFO:tasks.ceph.osd.3.smithi181.stderr:2024-09-12T02:28:10.157+0000 7fedd6e2b640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:10.928 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-12T02:28:10.928+0000 7f0f1371a640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:28:10.939 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-12T02:28:10.939+0000 7f0f0bd4c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:10.945 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-12T02:28:10.944+0000 7f586c757640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:28:10.957 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-12T02:28:10.957+0000 7f5864d89640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:11.642 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T02:28:11.641+0000 7f8c247d6640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:28:11.656 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-12T02:28:11.656+0000 7f8c1ce08640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:11.678 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T02:28:11.678+0000 7f74cf553640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:28:11.691 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T02:28:11.691+0000 7f66209f1640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:28:11.696 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-12T02:28:11.696+0000 7f74c6b4e640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:11.708 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-12T02:28:11.708+0000 7f6619023640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:11.722 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T02:28:11.722+0000 7f94b31d6640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:28:11.734 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-12T02:28:11.734+0000 7f94ab808640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:28:15.498 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:28:15.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:28:16.857 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:16.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.958+0000 7f990f7cf640 1 Processor -- start 2024-09-12T02:28:16.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.958+0000 7f990f7cf640 1 -- start start 2024-09-12T02:28:16.960 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f990f7cf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9908147de0 0x7f990815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.960 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f990f7cf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99081481c0 con 0x7f99080727b0 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f990f7cf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990815fdc0 con 0x7f990806c2d0 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f990f7cf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f99081606f0 con 0x7f9908147de0 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f990cd6a640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f99080727b0 0x7f990806bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51716/0 (socket says 172.21.15.181:51716) 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f990cd6a640 1 -- 172.21.15.181:0/2937210258 learned_addr learned my addr 172.21.15.181:0/2937210258 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f990d56b640 1 --2- 172.21.15.181:0/2937210258 >> v2:172.21.15.204:3300/0 conn(0x7f9908147de0 0x7f990815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f98fffff640 1 -- 172.21.15.181:0/2937210258 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649056239 0 0) 0x7f99081481c0 con 0x7f99080727b0 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.959+0000 7f98fffff640 1 -- 172.21.15.181:0/2937210258 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98f4003520 con 0x7f99080727b0 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.960+0000 7f990d56b640 1 -- 172.21.15.181:0/2937210258 >> v1:172.21.15.204:6789/0 conn(0x7f990806c2d0 legacy=0x7f9908160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.960+0000 7f98fffff640 1 -- 172.21.15.181:0/2937210258 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1797342168 0 0) 0x7f98f4003520 con 0x7f99080727b0 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.960+0000 7f990d56b640 1 -- 172.21.15.181:0/2937210258 >> v1:172.21.15.181:6789/0 conn(0x7f99080727b0 legacy=0x7f990806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.961 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.960+0000 7f990d56b640 1 -- 172.21.15.181:0/2937210258 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99081600a0 con 0x7f9908147de0 2024-09-12T02:28:16.963 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.960+0000 7f990d56b640 1 --2- 172.21.15.181:0/2937210258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f990815f6e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99040097a0 tx=0x7f990402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f80b31df6dc82a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:16.963 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f98fffff640 1 -- 172.21.15.181:0/2937210258 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9904037070 con 0x7f9908147de0 2024-09-12T02:28:16.963 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f98fffff640 1 -- 172.21.15.181:0/2937210258 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990402ab60 con 0x7f9908147de0 2024-09-12T02:28:16.963 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f98fffff640 1 -- 172.21.15.181:0/2937210258 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8001670 con 0x7f9908147de0 2024-09-12T02:28:16.963 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f990f7cf640 1 -- 172.21.15.181:0/2937210258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 msgr2=0x7f990815f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.963 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2937210258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f990815f6e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99040097a0 tx=0x7f990402a0d0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.963 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f990f7cf640 1 -- 172.21.15.181:0/2937210258 shutdown_connections 2024-09-12T02:28:16.964 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2937210258 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f990815f6e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.964 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f990f7cf640 1 -- 172.21.15.181:0/2937210258 >> 172.21.15.181:0/2937210258 conn(0x7f990806e1b0 msgr2=0x7f990806e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:16.964 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f990f7cf640 1 -- 172.21.15.181:0/2937210258 shutdown_connections 2024-09-12T02:28:16.964 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.961+0000 7f990f7cf640 1 -- 172.21.15.181:0/2937210258 wait complete. 2024-09-12T02:28:16.964 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.962+0000 7f990f7cf640 1 Processor -- start 2024-09-12T02:28:16.964 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.962+0000 7f990f7cf640 1 -- start start 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990f7cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f990806c2d0 0x7f9908142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990f7cf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080727b0 0x7f990815deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990f7cf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f9908140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990f7cf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9908072bb0 con 0x7f99080727b0 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990f7cf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9908072fc0 con 0x7f9908147de0 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990f7cf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9908072d30 con 0x7f990806c2d0 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990cd6a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080727b0 0x7f990815deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990cd6a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080727b0 0x7f990815deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41670/0 (socket says 172.21.15.181:41670) 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990cd6a640 1 -- 172.21.15.181:0/2279359375 learned_addr learned my addr 172.21.15.181:0/2279359375 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:16.967 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.963+0000 7f990dd6c640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f9908140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990d56b640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f990806c2d0 0x7f9908142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990cd6a640 1 -- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f990806c2d0 msgr2=0x7f9908142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990cd6a640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f990806c2d0 0x7f9908142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990cd6a640 1 -- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 msgr2=0x7f9908140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990cd6a640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f9908140a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990cd6a640 1 -- 172.21.15.181:0/2279359375 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9908141480 con 0x7f99080727b0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990dd6c640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f9908140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990cd6a640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080727b0 0x7f990815deb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c750 tx=0x7f98f800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f98fdffb640 1 -- 172.21.15.181:0/2279359375 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8018070 con 0x7f99080727b0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f98fdffb640 1 -- 172.21.15.181:0/2279359375 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80072f0 con 0x7f99080727b0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f98fdffb640 1 -- 172.21.15.181:0/2279359375 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80047e0 con 0x7f99080727b0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9908141760 con 0x7f99080727b0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.964+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9908141d20 con 0x7f99080727b0 2024-09-12T02:28:16.968 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.965+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990815f6e0 con 0x7f99080727b0 2024-09-12T02:28:16.969 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.965+0000 7f98fdffb640 1 -- 172.21.15.181:0/2279359375 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98f801b070 con 0x7f99080727b0 2024-09-12T02:28:16.969 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.966+0000 7f98fdffb640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ec06be60 0x7f98ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.969 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.966+0000 7f98fdffb640 1 -- 172.21.15.181:0/2279359375 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f98f8089f30 con 0x7f99080727b0 2024-09-12T02:28:16.969 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.966+0000 7f990d56b640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ec06be60 0x7f98ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.969 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.966+0000 7f990d56b640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ec06be60 0x7f98ec06e320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9904034000 tx=0x7f990402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:16.971 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:16.970+0000 7f98fdffb640 1 -- 172.21.15.181:0/2279359375 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98f8058c30 con 0x7f99080727b0 2024-09-12T02:28:17.137 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.137+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9908068520 con 0x7f99080727b0 2024-09-12T02:28:17.138 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.138+0000 7f98fdffb640 1 -- 172.21.15.181:0/2279359375 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12968 (secure 0 0 0) 0x7f98f8058530 con 0x7f99080727b0 2024-09-12T02:28:17.139 INFO:teuthology.misc.health.smithi181.stdout: 2024-09-12T02:28:17.139 INFO:teuthology.misc.health.smithi181.stdout:{"epoch":17,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:13.888707+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ec06be60 msgr2=0x7f98ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ec06be60 0x7f98ec06e320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9904034000 tx=0x7f990402e000 comp rx=0 tx=0).stop 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080727b0 msgr2=0x7f990815deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080727b0 0x7f990815deb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c750 tx=0x7f98f800cc10 comp rx=0 tx=0).stop 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 shutdown_connections 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ec06be60 0x7f98ec06e320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9908147de0 0x7f9908140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99080727b0 0x7f990815deb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.141 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 --2- 172.21.15.181:0/2279359375 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f990806c2d0 0x7f9908142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.142 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 >> 172.21.15.181:0/2279359375 conn(0x7f990806e1b0 msgr2=0x7f990806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:17.142 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 shutdown_connections 2024-09-12T02:28:17.142 INFO:teuthology.misc.health.smithi181.stderr:2024-09-12T02:28:17.140+0000 7f990f7cf640 1 -- 172.21.15.181:0/2279359375 wait complete. 2024-09-12T02:28:17.150 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T02:28:17.150 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T02:28:17.151 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:28:17.151 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:28:17.153 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:28:17.153 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:28:17.153 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:28:17.155 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:28:17.156 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:28:17.156 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:28:17.159 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:28:17.159 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:28:17.159 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:28:17.161 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:28:17.161 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T02:28:17.162 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:17.228 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:28:17.228 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:28:17.244 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:28:17.245 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:28:17.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.265+0000 7fdae0f5f640 1 Processor -- start 2024-09-12T02:28:17.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.265+0000 7fdae0f5f640 1 -- start start 2024-09-12T02:28:17.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.265+0000 7fdae0f5f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdadc0cf720 0x7fdadc0d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.265+0000 7fdae0f5f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdadc15ea20 con 0x7fdadc0cf2b0 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdae0f5f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdadc0b1c50 con 0x7fdadc15e640 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdae0f5f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fdadc0b3d00 con 0x7fdadc0cf720 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdadc0cf2b0 0x7fdadc0d2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51738/0 (socket says 172.21.15.181:51738) 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 -- 172.21.15.181:0/3224806293 learned_addr learned my addr 172.21.15.181:0/3224806293 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdadad9d640 1 --2- 172.21.15.181:0/3224806293 >> v2:172.21.15.204:3300/0 conn(0x7fdadc0cf720 0x7fdadc0d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175309718 0 0) 0x7fdadc15ea20 con 0x7fdadc0cf2b0 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac8003520 con 0x7fdadc0cf2b0 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1119288762 0 0) 0x7fdac8003520 con 0x7fdadc0cf2b0 2024-09-12T02:28:17.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 >> v2:172.21.15.204:3300/0 conn(0x7fdadc0cf720 msgr2=0x7fdadc0d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 --2- 172.21.15.181:0/3224806293 >> v2:172.21.15.204:3300/0 conn(0x7fdadc0cf720 0x7fdadc0d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 >> v1:172.21.15.204:6789/0 conn(0x7fdadc15e640 legacy=0x7fdadc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc0b1f30 con 0x7fdadc0cf2b0 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fdac4001670 con 0x7fdadc0cf2b0 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 >> v1:172.21.15.181:6789/0 conn(0x7fdadc0cf2b0 legacy=0x7fdadc0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac80039b0 0x7fdac8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdac8004800 0x7fdac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac80051c0 0x7fdac800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdac800c130 con 0x7fdac8004800 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdac800c2e0 con 0x7fdac80051c0 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdac800c4e0 con 0x7fdac80039b0 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdac8004800 0x7fdac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdada59c640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac80039b0 0x7fdac8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdadad9d640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac80051c0 0x7fdac800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 -- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac80039b0 msgr2=0x7fdac8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac80039b0 0x7fdac8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 -- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac80051c0 msgr2=0x7fdac800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdac80051c0 0x7fdac800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdad9d9b640 1 -- 172.21.15.181:0/3224806293 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac8003520 con 0x7fdac8004800 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.266+0000 7fdadad9d640 1 -- 172.21.15.181:0/3224806293 reap_dead start 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.267+0000 7fdad9d9b640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdac8004800 0x7fdac8004c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c240 tx=0x7fdac8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b26a21a1e1fcf42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.267+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4007d10 con 0x7fdac8004800 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.267+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac4005ad0 con 0x7fdac8004800 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.267+0000 7fdad959a640 1 -- 172.21.15.181:0/3224806293 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4007070 con 0x7fdac8004800 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.268+0000 7fdae0f5f640 1 -- 172.21.15.181:0/3224806293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdac8004800 msgr2=0x7fdac8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.268+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdac8004800 0x7fdac8004c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c240 tx=0x7fdac8005830 comp rx=0 tx=0).stop 2024-09-12T02:28:17.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.268+0000 7fdae0f5f640 1 -- 172.21.15.181:0/3224806293 shutdown_connections 2024-09-12T02:28:17.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.268+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/3224806293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdac8004800 0x7fdac8004c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.268+0000 7fdae0f5f640 1 -- 172.21.15.181:0/3224806293 >> 172.21.15.181:0/3224806293 conn(0x7fdadc09d820 msgr2=0x7fdadc0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:17.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.268+0000 7fdae0f5f640 1 -- 172.21.15.181:0/3224806293 shutdown_connections 2024-09-12T02:28:17.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.268+0000 7fdae0f5f640 1 -- 172.21.15.181:0/3224806293 wait complete. 2024-09-12T02:28:17.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.269+0000 7fdae0f5f640 1 Processor -- start 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.269+0000 7fdae0f5f640 1 -- start start 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdae0f5f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac8004800 0x7fdadc0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdae0f5f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdadc1589c0 0x7fdadc0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdae0f5f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdadc0ca8a0 0x7fdadc1f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdae0f5f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0b24f0 con 0x7fdadc1589c0 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdae0f5f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0b2860 con 0x7fdadc0ca8a0 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdae0f5f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc0cfe40 con 0x7fdac8004800 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdad9d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdadc1589c0 0x7fdadc0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdad9d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdadc1589c0 0x7fdadc0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41698/0 (socket says 172.21.15.181:41698) 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdad9d9b640 1 -- 172.21.15.181:0/390020993 learned_addr learned my addr 172.21.15.181:0/390020993 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdada59c640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac8004800 0x7fdadc0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.270+0000 7fdadad9d640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdadc0ca8a0 0x7fdadc1f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad9d9b640 1 -- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac8004800 msgr2=0x7fdadc0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad9d9b640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac8004800 0x7fdadc0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad9d9b640 1 -- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdadc0ca8a0 msgr2=0x7fdadc1f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad9d9b640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdadc0ca8a0 0x7fdadc1f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad9d9b640 1 -- 172.21.15.181:0/390020993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc0c9340 con 0x7fdadc1589c0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad9d9b640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdadc1589c0 0x7fdadc0ca360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c240 tx=0x7fdadc0b1e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad2ffd640 1 -- 172.21.15.181:0/390020993 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac403f020 con 0x7fdadc1589c0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad2ffd640 1 -- 172.21.15.181:0/390020993 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac4001470 con 0x7fdadc1589c0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdad2ffd640 1 -- 172.21.15.181:0/390020993 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac40049e0 con 0x7fdadc1589c0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc0c9ae0 con 0x7fdadc1589c0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.271+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc158fc0 con 0x7fdadc1589c0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.272+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc068eb0 con 0x7fdadc1589c0 2024-09-12T02:28:17.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.272+0000 7fdad2ffd640 1 -- 172.21.15.181:0/390020993 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdac4042020 con 0x7fdadc1589c0 2024-09-12T02:28:17.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.273+0000 7fdad2ffd640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdabc06be60 0x7fdabc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:17.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.273+0000 7fdad2ffd640 1 -- 172.21.15.181:0/390020993 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdac40aa560 con 0x7fdadc1589c0 2024-09-12T02:28:17.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.273+0000 7fdada59c640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdabc06be60 0x7fdabc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:17.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.273+0000 7fdada59c640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdabc06be60 0x7fdabc06e320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000f80 tx=0x7fdad4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:17.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.277+0000 7fdad2ffd640 1 -- 172.21.15.181:0/390020993 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdac4079270 con 0x7fdadc1589c0 2024-09-12T02:28:17.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.477+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdadc0cacb0 con 0x7fdadc1589c0 2024-09-12T02:28:17.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.478+0000 7fdad2ffd640 1 -- 172.21.15.181:0/390020993 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7fdadc0cacb0 con 0x7fdadc1589c0 2024-09-12T02:28:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:17.479 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"btime":"2024-09-12T02:28:17:233023+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:28:17.479 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 2 2024-09-12T02:28:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdabc06be60 msgr2=0x7fdabc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdabc06be60 0x7fdabc06e320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000f80 tx=0x7fdad4009040 comp rx=0 tx=0).stop 2024-09-12T02:28:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdadc1589c0 msgr2=0x7fdadc0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdadc1589c0 0x7fdadc0ca360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c240 tx=0x7fdadc0b1e20 comp rx=0 tx=0).stop 2024-09-12T02:28:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 shutdown_connections 2024-09-12T02:28:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdabc06be60 0x7fdabc06e320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdadc0ca8a0 0x7fdadc1f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdadc1589c0 0x7fdadc0ca360 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 --2- 172.21.15.181:0/390020993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdac8004800 0x7fdadc0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 >> 172.21.15.181:0/390020993 conn(0x7fdadc09d820 msgr2=0x7fdadc0d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 shutdown_connections 2024-09-12T02:28:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:17.480+0000 7fdae0f5f640 1 -- 172.21.15.181:0/390020993 wait complete. 2024-09-12T02:28:19.492 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:19.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.602+0000 7f4e26853640 1 Processor -- start 2024-09-12T02:28:19.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.602+0000 7f4e26853640 1 -- start start 2024-09-12T02:28:19.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e26853640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2015eab0 0x7f4e2006d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e26853640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e200d3480 0x7f4e200b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e26853640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e200d17e0 con 0x7f4e2006dae0 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e26853640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4e200d09d0 con 0x7f4e200d3480 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e26853640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2015ee90 con 0x7f4e2015eab0 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e24df0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e200d3480 0x7f4e200b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e1f7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4e2006dae0 0x7f4e200b7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56100/0 (socket says 172.21.15.181:56100) 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e1f7fe640 1 -- 172.21.15.181:0/346254363 learned_addr learned my addr 172.21.15.181:0/346254363 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.603+0000 7f4e1ffff640 1 --2- 172.21.15.181:0/346254363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2015eab0 0x7f4e2006d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e24df0640 1 -- 172.21.15.181:0/346254363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2015eab0 msgr2=0x7f4e2006d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e24df0640 1 --2- 172.21.15.181:0/346254363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2015eab0 0x7f4e2006d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e24df0640 1 -- 172.21.15.181:0/346254363 >> v1:172.21.15.181:6789/0 conn(0x7f4e2006dae0 legacy=0x7f4e200b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e1effd640 1 -- 172.21.15.181:0/346254363 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245568968 0 0) 0x7f4e200d17e0 con 0x7f4e2006dae0 2024-09-12T02:28:19.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e24df0640 1 -- 172.21.15.181:0/346254363 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e200cfc10 con 0x7f4e200d3480 2024-09-12T02:28:19.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e24df0640 1 --2- 172.21.15.181:0/346254363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e200d3480 0x7f4e200b8290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009dc0 tx=0x7f4e1802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aca26cb104b7196 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e1effd640 1 -- 172.21.15.181:0/346254363 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18007740 con 0x7f4e200d3480 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e1effd640 1 -- 172.21.15.181:0/346254363 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e180078e0 con 0x7f4e200d3480 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.604+0000 7f4e1effd640 1 -- 172.21.15.181:0/346254363 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18007cb0 con 0x7f4e200d3480 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 -- 172.21.15.181:0/346254363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e200d3480 msgr2=0x7f4e200b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 --2- 172.21.15.181:0/346254363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e200d3480 0x7f4e200b8290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009dc0 tx=0x7f4e1802a710 comp rx=0 tx=0).stop 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 -- 172.21.15.181:0/346254363 shutdown_connections 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 --2- 172.21.15.181:0/346254363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e200d3480 0x7f4e200b8290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 --2- 172.21.15.181:0/346254363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2015eab0 0x7f4e2006d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 -- 172.21.15.181:0/346254363 >> 172.21.15.181:0/346254363 conn(0x7f4e200d4b30 msgr2=0x7f4e200d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 -- 172.21.15.181:0/346254363 shutdown_connections 2024-09-12T02:28:19.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.605+0000 7f4e26853640 1 -- 172.21.15.181:0/346254363 wait complete. 2024-09-12T02:28:19.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.606+0000 7f4e26853640 1 Processor -- start 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e26853640 1 -- start start 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e26853640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2006dae0 0x7f4e200ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e26853640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e200d3480 0x7f4e2015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e26853640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e2015eab0 0x7f4e201f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e26853640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4e200d01d0 con 0x7f4e2015eab0 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e26853640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2006df20 con 0x7f4e200d3480 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e26853640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4e200d04b0 con 0x7f4e2006dae0 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e24df0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e2015eab0 0x7f4e201f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e24df0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e2015eab0 0x7f4e201f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39900/0 (socket says 172.21.15.181:39900) 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.607+0000 7f4e24df0640 1 -- 172.21.15.181:0/1536745944 learned_addr learned my addr 172.21.15.181:0/1536745944 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e1ffff640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2006dae0 0x7f4e200ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e1f7fe640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e200d3480 0x7f4e2015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e24df0640 1 -- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2006dae0 msgr2=0x7f4e200ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e24df0640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2006dae0 0x7f4e200ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e24df0640 1 -- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e200d3480 msgr2=0x7f4e2015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e24df0640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e200d3480 0x7f4e2015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e24df0640 1 -- 172.21.15.181:0/1536745944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e200abb50 con 0x7f4e2015eab0 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e1ffff640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2006dae0 0x7f4e200ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e1f7fe640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e200d3480 0x7f4e2015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e24df0640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e2015eab0 0x7f4e201f4ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e1802ad00 tx=0x7f4e18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e1cff9640 1 -- 172.21.15.181:0/1536745944 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18040070 con 0x7f4e2015eab0 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e1cff9640 1 -- 172.21.15.181:0/1536745944 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e18031c40 con 0x7f4e2015eab0 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e201f5220 con 0x7f4e2015eab0 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e1cff9640 1 -- 172.21.15.181:0/1536745944 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18009450 con 0x7f4e2015eab0 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.608+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e200abdc0 con 0x7f4e2015eab0 2024-09-12T02:28:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.609+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e200ce040 con 0x7f4e2015eab0 2024-09-12T02:28:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.610+0000 7f4e1cff9640 1 -- 172.21.15.181:0/1536745944 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e18039040 con 0x7f4e2015eab0 2024-09-12T02:28:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.610+0000 7f4e1cff9640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4e0c06be30 0x7f4e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.610+0000 7f4e1ffff640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4e0c06be30 0x7f4e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.610+0000 7f4e1cff9640 1 -- 172.21.15.181:0/1536745944 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4e180abd00 con 0x7f4e2015eab0 2024-09-12T02:28:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.610+0000 7f4e1ffff640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4e0c06be30 0x7f4e0c06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e200ce3c0 tx=0x7f4e10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:19.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.614+0000 7f4e1cff9640 1 -- 172.21.15.181:0/1536745944 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e200ce040 con 0x7f4e2015eab0 2024-09-12T02:28:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.817+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e200b9ac0 con 0x7f4e2015eab0 2024-09-12T02:28:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.818+0000 7f4e1cff9640 1 -- 172.21.15.181:0/1536745944 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7f4e201f5220 con 0x7f4e2015eab0 2024-09-12T02:28:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:19.819 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"btime":"2024-09-12T02:28:18:234121+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T02:28:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 3 2024-09-12T02:28:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4e0c06be30 msgr2=0x7f4e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4e0c06be30 0x7f4e0c06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e200ce3c0 tx=0x7f4e10008040 comp rx=0 tx=0).stop 2024-09-12T02:28:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e2015eab0 msgr2=0x7f4e201f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e2015eab0 0x7f4e201f4ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e1802ad00 tx=0x7f4e18004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 shutdown_connections 2024-09-12T02:28:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4e0c06be30 0x7f4e0c06e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e200d3480 0x7f4e2015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e2015eab0 0x7f4e201f4ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 --2- 172.21.15.181:0/1536745944 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e2006dae0 0x7f4e200ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 >> 172.21.15.181:0/1536745944 conn(0x7f4e200d4b30 msgr2=0x7f4e200b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 shutdown_connections 2024-09-12T02:28:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.820+0000 7f4e26853640 1 -- 172.21.15.181:0/1536745944 wait complete. 2024-09-12T02:28:19.832 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:28:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.928+0000 7f22dbe17640 1 Processor -- start 2024-09-12T02:28:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.928+0000 7f22dbe17640 1 -- start start 2024-09-12T02:28:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22dbe17640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 0x7f22d40d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22dbe17640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d406cec0 con 0x7f22d415e8c0 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22dbe17640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d406d160 con 0x7f22d415e4e0 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22dbe17640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40d2d40 con 0x7f22d40b6ee0 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22d93b2640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f22d415e8c0 0x7f22d40d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56106/0 (socket says 172.21.15.181:56106) 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22d93b2640 1 -- 172.21.15.181:0/759133066 learned_addr learned my addr 172.21.15.181:0/759133066 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348877189 0 0) 0x7f22d406cec0 con 0x7f22d415e8c0 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22da3b4640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 0x7f22d40d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.929+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22bc003520 con 0x7f22d415e8c0 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2819947511 0 0) 0x7f22bc003520 con 0x7f22d415e8c0 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 msgr2=0x7f22d40d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 0x7f22d40d26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 >> v1:172.21.15.204:6789/0 conn(0x7f22d415e4e0 legacy=0x7f22d40b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d406d440 con 0x7f22d415e8c0 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f22c80019f0 con 0x7f22d415e8c0 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 >> v1:172.21.15.181:6789/0 conn(0x7f22d415e8c0 legacy=0x7f22d40d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 0x7f22bc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc003f60 0x7f22bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22bc004d40 0x7f22bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40d2d40 con 0x7f22bc004d40 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc00bb50 con 0x7f22bc003f60 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc00bd50 con 0x7f22d40b6ee0 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22da3b4640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22bc004d40 0x7f22bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d93b2640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc003f60 0x7f22bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22d9bb3640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 0x7f22bc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22da3b4640 1 -- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 msgr2=0x7f22bc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22da3b4640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d40b6ee0 0x7f22bc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22da3b4640 1 -- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc003f60 msgr2=0x7f22bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22da3b4640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc003f60 0x7f22bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.930+0000 7f22da3b4640 1 -- 172.21.15.181:0/759133066 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc003520 con 0x7f22bc004d40 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.931+0000 7f22da3b4640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22bc004d40 0x7f22bc0051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009ac0 tx=0x7f22bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5709de9535c23798 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.931+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4036070 con 0x7f22bc004d40 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.931+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4031400 con 0x7f22bc004d40 2024-09-12T02:28:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.931+0000 7f22d8bb1640 1 -- 172.21.15.181:0/759133066 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4009690 con 0x7f22bc004d40 2024-09-12T02:28:19.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.931+0000 7f22dbe17640 1 -- 172.21.15.181:0/759133066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22bc004d40 msgr2=0x7f22bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.931+0000 7f22dbe17640 1 --2- 172.21.15.181:0/759133066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22bc004d40 0x7f22bc0051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009ac0 tx=0x7f22bc005830 comp rx=0 tx=0).stop 2024-09-12T02:28:19.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.931+0000 7f22da3b4640 1 -- 172.21.15.181:0/759133066 reap_dead start 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.932+0000 7f22dbe17640 1 -- 172.21.15.181:0/759133066 shutdown_connections 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.932+0000 7f22dbe17640 1 -- 172.21.15.181:0/759133066 >> 172.21.15.181:0/759133066 conn(0x7f22d406f400 msgr2=0x7f22d406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.932+0000 7f22dbe17640 1 -- 172.21.15.181:0/759133066 shutdown_connections 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.932+0000 7f22dbe17640 1 -- 172.21.15.181:0/759133066 wait complete. 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 Processor -- start 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 -- start start 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc004d40 0x7f22d40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d4154020 0x7f22d40b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22d414de70 0x7f22d41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40d26d0 con 0x7f22d414de70 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f22d406ec50 con 0x7f22bc004d40 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.933+0000 7f22dbe17640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40d2850 con 0x7f22d4154020 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22d414de70 0x7f22d41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22d414de70 0x7f22d41575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39922/0 (socket says 172.21.15.181:39922) 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 -- 172.21.15.181:0/186984721 learned_addr learned my addr 172.21.15.181:0/186984721 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22d9bb3640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc004d40 0x7f22d40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22d93b2640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d4154020 0x7f22d40b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 -- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d4154020 msgr2=0x7f22d40b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d4154020 0x7f22d40b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 -- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc004d40 msgr2=0x7f22d40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc004d40 0x7f22d40b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 -- 172.21.15.181:0/186984721 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40b06e0 con 0x7f22d414de70 2024-09-12T02:28:19.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22d9bb3640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc004d40 0x7f22d40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22da3b4640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22d414de70 0x7f22d41575d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009be0 tx=0x7f22c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22d27fc640 1 -- 172.21.15.181:0/186984721 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4036040 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22d27fc640 1 -- 172.21.15.181:0/186984721 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4041070 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22d27fc640 1 -- 172.21.15.181:0/186984721 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4009690 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d40b0980 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.934+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d40b0f40 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.935+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d4073840 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.936+0000 7f22d27fc640 1 -- 172.21.15.181:0/186984721 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22c4039070 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.936+0000 7f22d27fc640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f22c006be30 0x7f22c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.936+0000 7f22d27fc640 1 -- 172.21.15.181:0/186984721 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f22c40aa900 con 0x7f22d414de70 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.936+0000 7f22d9bb3640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f22c006be30 0x7f22c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:19.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.936+0000 7f22d9bb3640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f22c006be30 0x7f22c006e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001bd0 tx=0x7f22cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:19.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:19.940+0000 7f22d27fc640 1 -- 172.21.15.181:0/186984721 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22d4073840 con 0x7f22d414de70 2024-09-12T02:28:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.107+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f22d40d0940 con 0x7f22d414de70 2024-09-12T02:28:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.108+0000 7f22d27fc640 1 -- 172.21.15.181:0/186984721 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f22c4078f20 con 0x7f22d414de70 2024-09-12T02:28:20.109 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:20.109 INFO:teuthology.orchestra.run.smithi181.stdout:[ 2024-09-12T02:28:20.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:20.109 INFO:teuthology.orchestra.run.smithi181.stdout: "poolnum": 1, 2024-09-12T02:28:20.109 INFO:teuthology.orchestra.run.smithi181.stdout: "poolname": ".mgr" 2024-09-12T02:28:20.109 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:20.109 INFO:teuthology.orchestra.run.smithi181.stdout:] 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f22c006be30 msgr2=0x7f22c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f22c006be30 0x7f22c006e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001bd0 tx=0x7f22cc009040 comp rx=0 tx=0).stop 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22d414de70 msgr2=0x7f22d41575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22d414de70 0x7f22d41575d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009be0 tx=0x7f22c4004730 comp rx=0 tx=0).stop 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 shutdown_connections 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f22c006be30 0x7f22c006e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f22d414de70 0x7f22d41575d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22d4154020 0x7f22d40b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 --2- 172.21.15.181:0/186984721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22bc004d40 0x7f22d40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 >> 172.21.15.181:0/186984721 conn(0x7f22d406f400 msgr2=0x7f22d40d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 shutdown_connections 2024-09-12T02:28:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.110+0000 7f22dbe17640 1 -- 172.21.15.181:0/186984721 wait complete. 2024-09-12T02:28:20.121 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:28:20.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:28:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.223+0000 7f7e9f9c4640 1 Processor -- start 2024-09-12T02:28:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.223+0000 7f7e9f9c4640 1 -- start start 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9f9c4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7e98147f50 0x7f7e98073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9f9c4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e98074000 con 0x7f7e98162d10 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9f9c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e98162230 con 0x7f7e980b0960 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9f9c4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7e980742e0 con 0x7f7e98147f50 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9d760640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7e98147f50 0x7f7e98073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9cf5f640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7e98162d10 0x7f7e980b0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56112/0 (socket says 172.21.15.181:56112) 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9cf5f640 1 -- 172.21.15.181:0/4125190833 learned_addr learned my addr 172.21.15.181:0/4125190833 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9d760640 1 -- 172.21.15.181:0/4125190833 >> v1:172.21.15.204:6789/0 conn(0x7f7e980b0960 legacy=0x7f7e980ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9d760640 1 -- 172.21.15.181:0/4125190833 >> v1:172.21.15.181:6789/0 conn(0x7f7e98162d10 legacy=0x7f7e980b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e8ffff640 1 -- 172.21.15.181:0/4125190833 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478194726 0 0) 0x7f7e98074000 con 0x7f7e98162d10 2024-09-12T02:28:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.224+0000 7f7e9d760640 1 -- 172.21.15.181:0/4125190833 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e98162510 con 0x7f7e98147f50 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.225+0000 7f7e9d760640 1 --2- 172.21.15.181:0/4125190833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e98147f50 0x7f7e98073460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e940097a0 tx=0x7f7e9402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbd977ac9554d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.225+0000 7f7e8ffff640 1 -- 172.21.15.181:0/4125190833 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94037070 con 0x7f7e98147f50 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.225+0000 7f7e8ffff640 1 -- 172.21.15.181:0/4125190833 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e94032440 con 0x7f7e98147f50 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.225+0000 7f7e8ffff640 1 -- 172.21.15.181:0/4125190833 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94032810 con 0x7f7e98147f50 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.225+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/4125190833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e98147f50 msgr2=0x7f7e98073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.225+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/4125190833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e98147f50 0x7f7e98073460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e940097a0 tx=0x7f7e9402a230 comp rx=0 tx=0).stop 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.226+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/4125190833 shutdown_connections 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.226+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/4125190833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e98147f50 0x7f7e98073460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.226+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/4125190833 >> 172.21.15.181:0/4125190833 conn(0x7f7e980b2fa0 msgr2=0x7f7e980b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.226+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/4125190833 shutdown_connections 2024-09-12T02:28:20.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.226+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/4125190833 wait complete. 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.227+0000 7f7e9f9c4640 1 Processor -- start 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.227+0000 7f7e9f9c4640 1 -- start start 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e980b0960 0x7f7e981f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e98147f50 0x7f7e9813abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e98162d10 0x7f7e9813cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7e980739a0 con 0x7f7e980b0960 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98070680 con 0x7f7e98162d10 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e98073b20 con 0x7f7e98147f50 2024-09-12T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e980b0960 0x7f7e981f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e980b0960 0x7f7e981f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39940/0 (socket says 172.21.15.181:39940) 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 -- 172.21.15.181:0/2996335303 learned_addr learned my addr 172.21.15.181:0/2996335303 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9cf5f640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e98147f50 0x7f7e9813abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9df61640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e98162d10 0x7f7e9813cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 -- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e98147f50 msgr2=0x7f7e9813abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e98147f50 0x7f7e9813abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 -- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e98162d10 msgr2=0x7f7e9813cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e98162d10 0x7f7e9813cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 -- 172.21.15.181:0/2996335303 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9815f6b0 con 0x7f7e980b0960 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9cf5f640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e98147f50 0x7f7e9813abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9df61640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e98162d10 0x7f7e9813cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9d760640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e980b0960 0x7f7e981f4880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e940098c0 tx=0x7f7e940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e8dffb640 1 -- 172.21.15.181:0/2996335303 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94037040 con 0x7f7e980b0960 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e8dffb640 1 -- 172.21.15.181:0/2996335303 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e94042070 con 0x7f7e980b0960 2024-09-12T02:28:20.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9815f990 con 0x7f7e980b0960 2024-09-12T02:28:20.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e8dffb640 1 -- 172.21.15.181:0/2996335303 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94030a70 con 0x7f7e980b0960 2024-09-12T02:28:20.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.228+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e981f4080 con 0x7f7e980b0960 2024-09-12T02:28:20.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.229+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e98073460 con 0x7f7e980b0960 2024-09-12T02:28:20.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.230+0000 7f7e8dffb640 1 -- 172.21.15.181:0/2996335303 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e94030c10 con 0x7f7e980b0960 2024-09-12T02:28:20.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.230+0000 7f7e8dffb640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.230+0000 7f7e8dffb640 1 -- 172.21.15.181:0/2996335303 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7e940ab520 con 0x7f7e980b0960 2024-09-12T02:28:20.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.230+0000 7f7e9cf5f640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.231+0000 7f7e9cf5f640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e88007fd0 tx=0x7f7e88007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.234+0000 7f7e8dffb640 1 -- 172.21.15.181:0/2996335303 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e94045360 con 0x7f7e980b0960 2024-09-12T02:28:20.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.399+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7e980b61f0 con 0x7f7e980b0960 2024-09-12T02:28:20.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.430+0000 7f7e8dffb640 1 -- 172.21.15.181:0/2996335303 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f7e9407a2b0 con 0x7f7e980b0960 2024-09-12T02:28:20.431 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' created 2024-09-12T02:28:20.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.432+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e7c06be30 msgr2=0x7f7e7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e88007fd0 tx=0x7f7e88007dc0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e980b0960 msgr2=0x7f7e981f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e980b0960 0x7f7e981f4880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e940098c0 tx=0x7f7e940046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 shutdown_connections 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e98162d10 0x7f7e9813cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e98147f50 0x7f7e9813abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 --2- 172.21.15.181:0/2996335303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e980b0960 0x7f7e981f4880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 >> 172.21.15.181:0/2996335303 conn(0x7f7e980b2fa0 msgr2=0x7f7e980b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 shutdown_connections 2024-09-12T02:28:20.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.433+0000 7f7e9f9c4640 1 -- 172.21.15.181:0/2996335303 wait complete. 2024-09-12T02:28:20.447 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:28:20.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.551+0000 7f2214042640 1 Processor -- start 2024-09-12T02:28:20.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.551+0000 7f2214042640 1 -- start start 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f2214042640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c161970 0x7f220c0b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f2214042640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f220c0b66c0 0x7f220c0cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f2214042640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220c161d50 con 0x7f220c0ce6c0 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f2214042640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f220c162d20 con 0x7f220c0b66c0 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f2214042640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f220c0cf130 con 0x7f220c161970 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f22125df640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f220c0b66c0 0x7f220c0cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f22125df640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f220c0b66c0 0x7f220c0cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39944/0 (socket says 172.21.15.181:39944) 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.552+0000 7f22125df640 1 -- 172.21.15.181:0/2400182669 learned_addr learned my addr 172.21.15.181:0/2400182669 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.553+0000 7f2211dde640 1 --2- 172.21.15.181:0/2400182669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c161970 0x7f220c0b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.553+0000 7f22125df640 1 -- 172.21.15.181:0/2400182669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c161970 msgr2=0x7f220c0b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.553+0000 7f22125df640 1 --2- 172.21.15.181:0/2400182669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c161970 0x7f220c0b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.553+0000 7f22125df640 1 -- 172.21.15.181:0/2400182669 >> v1:172.21.15.204:6789/0 conn(0x7f220c0ce6c0 legacy=0x7f220c0b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.553+0000 7f22125df640 1 -- 172.21.15.181:0/2400182669 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220c0cf410 con 0x7f220c0b66c0 2024-09-12T02:28:20.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.553+0000 7f22125df640 1 --2- 172.21.15.181:0/2400182669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c0b66c0 0x7f220c0cfef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2204009e50 tx=0x7f220402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc19c946d180312 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.553+0000 7f2210ddc640 1 -- 172.21.15.181:0/2400182669 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204036070 con 0x7f220c0b66c0 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2210ddc640 1 -- 172.21.15.181:0/2400182669 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2204031600 con 0x7f220c0b66c0 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2210ddc640 1 -- 172.21.15.181:0/2400182669 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22040319d0 con 0x7f220c0b66c0 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 -- 172.21.15.181:0/2400182669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c0b66c0 msgr2=0x7f220c0cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 --2- 172.21.15.181:0/2400182669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c0b66c0 0x7f220c0cfef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2204009e50 tx=0x7f220402a7a0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 -- 172.21.15.181:0/2400182669 shutdown_connections 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 --2- 172.21.15.181:0/2400182669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c0b66c0 0x7f220c0cfef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 --2- 172.21.15.181:0/2400182669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c161970 0x7f220c0b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 -- 172.21.15.181:0/2400182669 >> 172.21.15.181:0/2400182669 conn(0x7f220c067f80 msgr2=0x7f220c0d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 -- 172.21.15.181:0/2400182669 shutdown_connections 2024-09-12T02:28:20.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.554+0000 7f2214042640 1 -- 172.21.15.181:0/2400182669 wait complete. 2024-09-12T02:28:20.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.555+0000 7f2214042640 1 Processor -- start 2024-09-12T02:28:20.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.555+0000 7f2214042640 1 -- start start 2024-09-12T02:28:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f2214042640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c0b66c0 0x7f220c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f2214042640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f220c0ce6c0 0x7f220c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f2214042640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c161970 0x7f220c0b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f2214042640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f220c162980 con 0x7f220c161970 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f2214042640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f220c0cf9d0 con 0x7f220c0ce6c0 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f2214042640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f220c162b00 con 0x7f220c0b66c0 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f22125df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c161970 0x7f220c0b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f22125df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c161970 0x7f220c0b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39952/0 (socket says 172.21.15.181:39952) 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f22125df640 1 -- 172.21.15.181:0/817389331 learned_addr learned my addr 172.21.15.181:0/817389331 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f2211dde640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c0b66c0 0x7f220c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.556+0000 7f22115dd640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f220c0ce6c0 0x7f220c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f22125df640 1 -- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c0b66c0 msgr2=0x7f220c15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f22125df640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c0b66c0 0x7f220c15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f22125df640 1 -- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f220c0ce6c0 msgr2=0x7f220c158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f22125df640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f220c0ce6c0 0x7f220c158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f22125df640 1 -- 172.21.15.181:0/817389331 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220c0b78a0 con 0x7f220c161970 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f22125df640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c161970 0x7f220c0b7360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2204034040 tx=0x7f2204004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f21fe7fc640 1 -- 172.21.15.181:0/817389331 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204036050 con 0x7f220c161970 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f21fe7fc640 1 -- 172.21.15.181:0/817389331 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2204042070 con 0x7f220c161970 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f21fe7fc640 1 -- 172.21.15.181:0/817389331 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204009510 con 0x7f220c161970 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220c0b7b70 con 0x7f220c161970 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.557+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f220c0b8130 con 0x7f220c161970 2024-09-12T02:28:20.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.558+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220c0d2980 con 0x7f220c161970 2024-09-12T02:28:20.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.558+0000 7f21fe7fc640 1 -- 172.21.15.181:0/817389331 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2204007bb0 con 0x7f220c161970 2024-09-12T02:28:20.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.559+0000 7f21fe7fc640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f21f006be60 0x7f21f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.559+0000 7f21fe7fc640 1 -- 172.21.15.181:0/817389331 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f22040ab960 con 0x7f220c161970 2024-09-12T02:28:20.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.559+0000 7f2211dde640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f21f006be60 0x7f21f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.559+0000 7f2211dde640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f21f006be60 0x7f21f006e320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22000079a0 tx=0x7f2200008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.563+0000 7f21fe7fc640 1 -- 172.21.15.181:0/817389331 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2204079e10 con 0x7f220c161970 2024-09-12T02:28:20.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:20.728+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f220c0d0b70 con 0x7f220c161970 2024-09-12T02:28:21.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.436+0000 7f21fe7fc640 1 -- 172.21.15.181:0/817389331 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f220407e110 con 0x7f220c161970 2024-09-12T02:28:21.437 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' created 2024-09-12T02:28:21.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f21f006be60 msgr2=0x7f21f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f21f006be60 0x7f21f006e320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22000079a0 tx=0x7f2200008040 comp rx=0 tx=0).stop 2024-09-12T02:28:21.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c161970 msgr2=0x7f220c0b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c161970 0x7f220c0b7360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2204034040 tx=0x7f2204004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:21.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 shutdown_connections 2024-09-12T02:28:21.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f21f006be60 0x7f21f006e320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f220c0ce6c0 0x7f220c158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f220c161970 0x7f220c0b7360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 --2- 172.21.15.181:0/817389331 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f220c0b66c0 0x7f220c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 >> 172.21.15.181:0/817389331 conn(0x7f220c067f80 msgr2=0x7f220c161f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 shutdown_connections 2024-09-12T02:28:21.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.440+0000 7f2214042640 1 -- 172.21.15.181:0/817389331 wait complete. 2024-09-12T02:28:21.462 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:28:21.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.563+0000 7fa833f98640 1 Processor -- start 2024-09-12T02:28:21.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.564+0000 7fa833f98640 1 -- start start 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.564+0000 7fa833f98640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c15b3c0 0x7fa82c0739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.564+0000 7fa833f98640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa82c06de30 0x7fa82c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.564+0000 7fa833f98640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0b4410 con 0x7fa82c06f460 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.564+0000 7fa833f98640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c15b7a0 con 0x7fa82c06de30 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.564+0000 7fa833f98640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c0b5020 con 0x7fa82c15b3c0 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831d34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c15b3c0 0x7fa82c0739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831533640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa82c06de30 0x7fa82c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831d34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c15b3c0 0x7fa82c0739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:44990/0 (socket says 172.21.15.181:44990) 2024-09-12T02:28:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831d34640 1 -- 172.21.15.181:0/2965853718 learned_addr learned my addr 172.21.15.181:0/2965853718 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:21.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831d34640 1 -- 172.21.15.181:0/2965853718 >> v2:172.21.15.204:3300/0 conn(0x7fa82c06de30 msgr2=0x7fa82c06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:21.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831d34640 1 --2- 172.21.15.181:0/2965853718 >> v2:172.21.15.204:3300/0 conn(0x7fa82c06de30 0x7fa82c06e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831d34640 1 -- 172.21.15.181:0/2965853718 >> v1:172.21.15.204:6789/0 conn(0x7fa82c06f460 legacy=0x7fa82c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.565+0000 7fa831d34640 1 -- 172.21.15.181:0/2965853718 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c0b46f0 con 0x7fa82c15b3c0 2024-09-12T02:28:21.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.566+0000 7fa831d34640 1 --2- 172.21.15.181:0/2965853718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c15b3c0 0x7fa82c0739e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa820009870 tx=0x7fa82002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=496d64c7b4328a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.566+0000 7fa830d32640 1 -- 172.21.15.181:0/2965853718 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820037070 con 0x7fa82c15b3c0 2024-09-12T02:28:21.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.566+0000 7fa830d32640 1 -- 172.21.15.181:0/2965853718 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82002ae50 con 0x7fa82c15b3c0 2024-09-12T02:28:21.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.566+0000 7fa830d32640 1 -- 172.21.15.181:0/2965853718 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820032860 con 0x7fa82c15b3c0 2024-09-12T02:28:21.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 -- 172.21.15.181:0/2965853718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c15b3c0 msgr2=0x7fa82c0739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 --2- 172.21.15.181:0/2965853718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c15b3c0 0x7fa82c0739e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa820009870 tx=0x7fa82002a300 comp rx=0 tx=0).stop 2024-09-12T02:28:21.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 -- 172.21.15.181:0/2965853718 shutdown_connections 2024-09-12T02:28:21.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 --2- 172.21.15.181:0/2965853718 >> v2:172.21.15.204:3300/0 conn(0x7fa82c06de30 0x7fa82c06e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 --2- 172.21.15.181:0/2965853718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c15b3c0 0x7fa82c0739e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 -- 172.21.15.181:0/2965853718 >> 172.21.15.181:0/2965853718 conn(0x7fa82c0b2e00 msgr2=0x7fa82c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 -- 172.21.15.181:0/2965853718 shutdown_connections 2024-09-12T02:28:21.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.567+0000 7fa833f98640 1 -- 172.21.15.181:0/2965853718 wait complete. 2024-09-12T02:28:21.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.568+0000 7fa833f98640 1 Processor -- start 2024-09-12T02:28:21.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.568+0000 7fa833f98640 1 -- start start 2024-09-12T02:28:21.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa833f98640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c06de30 0x7fa82c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa833f98640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c06f460 0x7fa82c1f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa833f98640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c15b3c0 0x7fa82c14fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa833f98640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0b4cb0 con 0x7fa82c06de30 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa833f98640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c06e7b0 con 0x7fa82c15b3c0 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa833f98640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c0b4100 con 0x7fa82c06f460 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c06de30 0x7fa82c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c06de30 0x7fa82c0b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39958/0 (socket says 172.21.15.181:39958) 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 -- 172.21.15.181:0/1372446680 learned_addr learned my addr 172.21.15.181:0/1372446680 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831533640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c06f460 0x7fa82c1f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa832535640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c15b3c0 0x7fa82c14fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 -- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c06f460 msgr2=0x7fa82c1f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c06f460 0x7fa82c1f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 -- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c15b3c0 msgr2=0x7fa82c14fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c15b3c0 0x7fa82c14fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 -- 172.21.15.181:0/1372446680 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c1568d0 con 0x7fa82c06de30 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.569+0000 7fa831d34640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c06de30 0x7fa82c0b0190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa820000c00 tx=0x7fa8200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.570+0000 7fa81e7fc640 1 -- 172.21.15.181:0/1372446680 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820041070 con 0x7fa82c06de30 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.570+0000 7fa81e7fc640 1 -- 172.21.15.181:0/1372446680 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82003c660 con 0x7fa82c06de30 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.570+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c156bb0 con 0x7fa82c06de30 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.570+0000 7fa81e7fc640 1 -- 172.21.15.181:0/1372446680 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820037040 con 0x7fa82c06de30 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.570+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c14ff70 con 0x7fa82c06de30 2024-09-12T02:28:21.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.570+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c06e270 con 0x7fa82c06de30 2024-09-12T02:28:21.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.571+0000 7fa81e7fc640 1 -- 172.21.15.181:0/1372446680 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa820044070 con 0x7fa82c06de30 2024-09-12T02:28:21.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.571+0000 7fa81e7fc640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa81006be60 0x7fa81006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.572+0000 7fa831533640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa81006be60 0x7fa81006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.572+0000 7fa81e7fc640 1 -- 172.21.15.181:0/1372446680 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fa8200ab490 con 0x7fa82c06de30 2024-09-12T02:28:21.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.572+0000 7fa831533640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa81006be60 0x7fa81006e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0b26b0 tx=0x7fa828009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.576+0000 7fa81e7fc640 1 -- 172.21.15.181:0/1372446680 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa820079970 con 0x7fa82c06de30 2024-09-12T02:28:21.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:21.774+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa82c157fd0 con 0x7fa82c06de30 2024-09-12T02:28:22.458 INFO:teuthology.orchestra.run.smithi181.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:28:22.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.455+0000 7fa81e7fc640 1 -- 172.21.15.181:0/1372446680 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa82007dc70 con 0x7fa82c06de30 2024-09-12T02:28:22.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.462+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa81006be60 msgr2=0x7fa81006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.462+0000 7fa833f98640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa81006be60 0x7fa81006e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0b26b0 tx=0x7fa828009190 comp rx=0 tx=0).stop 2024-09-12T02:28:22.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.462+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c06de30 msgr2=0x7fa82c0b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.462+0000 7fa833f98640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c06de30 0x7fa82c0b0190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa820000c00 tx=0x7fa8200046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 shutdown_connections 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa81006be60 0x7fa81006e320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c15b3c0 0x7fa82c14fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c06f460 0x7fa82c1f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 --2- 172.21.15.181:0/1372446680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c06de30 0x7fa82c0b0190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 >> 172.21.15.181:0/1372446680 conn(0x7fa82c0b2e00 msgr2=0x7fa82c15cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 shutdown_connections 2024-09-12T02:28:22.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.465+0000 7fa833f98640 1 -- 172.21.15.181:0/1372446680 wait complete. 2024-09-12T02:28:22.484 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:22.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.583+0000 7f16a54ba640 1 Processor -- start 2024-09-12T02:28:22.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.583+0000 7f16a54ba640 1 -- start start 2024-09-12T02:28:22.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f16a54ba640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f16a015e640 0x7f16a00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f16a54ba640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 0x7f16a00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f16a54ba640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a015ea20 con 0x7f16a00b2cf0 2024-09-12T02:28:22.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f16a54ba640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f16a00b2860 con 0x7f16a015e640 2024-09-12T02:28:22.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f16a54ba640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f16a00b1c50 con 0x7f16a00cf0e0 2024-09-12T02:28:22.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f169f7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f16a00b2cf0 0x7f16a00b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56116/0 (socket says 172.21.15.181:56116) 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f169f7fe640 1 -- 172.21.15.181:0/2124710538 learned_addr learned my addr 172.21.15.181:0/2124710538 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f169e7fc640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 0x7f16a00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275984397 0 0) 0x7f16a015ea20 con 0x7f16a00b2cf0 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f169effd640 1 --2- 172.21.15.181:0/2124710538 >> v2:172.21.15.204:3300/0 conn(0x7f16a015e640 0x7f16a00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.584+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1688003520 con 0x7f16a00b2cf0 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 728154529 0 0) 0x7f1688003520 con 0x7f16a00b2cf0 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 msgr2=0x7f16a00cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 0x7f16a00cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 >> v2:172.21.15.204:3300/0 conn(0x7f16a015e640 msgr2=0x7f16a00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 --2- 172.21.15.181:0/2124710538 >> v2:172.21.15.204:3300/0 conn(0x7f16a015e640 0x7f16a00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a00b1f30 con 0x7f16a00b2cf0 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f16980019f0 con 0x7f16a00b2cf0 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 >> v1:172.21.15.181:6789/0 conn(0x7f16a00b2cf0 legacy=0x7f16a00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16880039b0 0x7f1688003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 0x7f1688004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004d40 0x7f16880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f16a00b2860 con 0x7f16880039b0 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f16a00b1c50 con 0x7f1688004d40 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f168800b9f0 con 0x7f16a00cf0e0 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169effd640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16880039b0 0x7f1688003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169e7fc640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 0x7f1688004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169f7fe640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004d40 0x7f16880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169effd640 1 -- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 msgr2=0x7f1688004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169effd640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16a00cf0e0 0x7f1688004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169effd640 1 -- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004d40 msgr2=0x7f16880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169effd640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1688004d40 0x7f16880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.585+0000 7f169effd640 1 -- 172.21.15.181:0/2124710538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1688003520 con 0x7f16880039b0 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f169effd640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16880039b0 0x7f1688003df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1690009ac0 tx=0x7f1688005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b179bfca9a58d345 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690036070 con 0x7f16880039b0 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1690031400 con 0x7f16880039b0 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f169dffb640 1 -- 172.21.15.181:0/2124710538 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690009690 con 0x7f16880039b0 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f16a54ba640 1 -- 172.21.15.181:0/2124710538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16880039b0 msgr2=0x7f1688003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f16a54ba640 1 --2- 172.21.15.181:0/2124710538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16880039b0 0x7f1688003df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1690009ac0 tx=0x7f1688005830 comp rx=0 tx=0).stop 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f169f7fe640 1 -- 172.21.15.181:0/2124710538 reap_dead start 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f16a54ba640 1 -- 172.21.15.181:0/2124710538 shutdown_connections 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f16a54ba640 1 -- 172.21.15.181:0/2124710538 >> 172.21.15.181:0/2124710538 conn(0x7f16a009d820 msgr2=0x7f16a00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f16a54ba640 1 -- 172.21.15.181:0/2124710538 shutdown_connections 2024-09-12T02:28:22.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.586+0000 7f16a54ba640 1 -- 172.21.15.181:0/2124710538 wait complete. 2024-09-12T02:28:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 Processor -- start 2024-09-12T02:28:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 -- start start 2024-09-12T02:28:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16880039b0 0x7f16a0161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a01609d0 0x7f16a00cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16a01e8e10 0x7f16a01e9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f16a00cfe40 con 0x7f16a01e8e10 2024-09-12T02:28:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f16a00b24f0 con 0x7f16a01609d0 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.588+0000 7f16a54ba640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f16a00b73a0 con 0x7f16880039b0 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16a01e8e10 0x7f16a01e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16a01e8e10 0x7f16a01e9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39970/0 (socket says 172.21.15.181:39970) 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 -- 172.21.15.181:0/2320611993 learned_addr learned my addr 172.21.15.181:0/2320611993 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169e7fc640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a01609d0 0x7f16a00cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169effd640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16880039b0 0x7f16a0161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 -- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16880039b0 msgr2=0x7f16a0161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16880039b0 0x7f16a0161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 -- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a01609d0 msgr2=0x7f16a00cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a01609d0 0x7f16a00cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 -- 172.21.15.181:0/2320611993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a00cd8f0 con 0x7f16a01e8e10 2024-09-12T02:28:22.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f169f7fe640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16a01e8e10 0x7f16a01e9290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16a008ed10 tx=0x7f1698007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f16877fe640 1 -- 172.21.15.181:0/2320611993 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698017020 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f16877fe640 1 -- 172.21.15.181:0/2320611993 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169800ac40 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f16877fe640 1 -- 172.21.15.181:0/2320611993 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16980133f0 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a00cdb90 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.589+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a00ce150 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.590+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a0068eb0 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.591+0000 7f16877fe640 1 -- 172.21.15.181:0/2320611993 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f169801a020 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.591+0000 7f16877fe640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f168c06be30 0x7f168c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.591+0000 7f16877fe640 1 -- 172.21.15.181:0/2320611993 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f169808b730 con 0x7f16a01e8e10 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.591+0000 7f169effd640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f168c06be30 0x7f168c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.592+0000 7f169effd640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f168c06be30 0x7f168c06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1690033000 tx=0x7f1690008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.595+0000 7f16877fe640 1 -- 172.21.15.181:0/2320611993 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1698021020 con 0x7f16a01e8e10 2024-09-12T02:28:22.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.762+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16a00c7e90 con 0x7f16a01e8e10 2024-09-12T02:28:22.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.763+0000 7f16877fe640 1 -- 172.21.15.181:0/2320611993 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16750 (secure 0 0 0) 0x7f169805a170 con 0x7f16a01e8e10 2024-09-12T02:28:22.764 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:22.764 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":20,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:21.776108+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f168c06be30 msgr2=0x7f168c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f168c06be30 0x7f168c06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1690033000 tx=0x7f1690008030 comp rx=0 tx=0).stop 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16a01e8e10 msgr2=0x7f16a01e9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16a01e8e10 0x7f16a01e9290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16a008ed10 tx=0x7f1698007bd0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 shutdown_connections 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f168c06be30 0x7f168c06e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16a01609d0 0x7f16a00cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16a01e8e10 0x7f16a01e9290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 --2- 172.21.15.181:0/2320611993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16880039b0 0x7f16a0161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 >> 172.21.15.181:0/2320611993 conn(0x7f16a009d820 msgr2=0x7f16a00b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 shutdown_connections 2024-09-12T02:28:22.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.765+0000 7f16a54ba640 1 -- 172.21.15.181:0/2320611993 wait complete. 2024-09-12T02:28:22.777 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:22.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.874+0000 7fe0ee8e4640 1 Processor -- start 2024-09-12T02:28:22.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.874+0000 7fe0ee8e4640 1 -- start start 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0ee8e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0ee8e4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe0e80d08f0 0x7fe0e80b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0ee8e4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe0e8143bb0 0x7fe0e80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0ee8e4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e80b2820 con 0x7fe0e80d08f0 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0ee8e4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e80b2b00 con 0x7fe0e8143bb0 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0ee8e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e8141730 con 0x7fe0e80d0510 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe0e80d08f0 0x7fe0e80b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe0e80d08f0 0x7fe0e80b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39984/0 (socket says 172.21.15.181:39984) 2024-09-12T02:28:22.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1399381745 learned_addr learned my addr 172.21.15.181:0/1399381745 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e7fff640 1 --2- 172.21.15.181:0/1399381745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0ece81640 1 --2- 172.21.15.181:0/1399381745 >> v2:172.21.15.204:3300/0 conn(0x7fe0e8143bb0 0x7fe0e80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1399381745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 msgr2=0x7fe0e815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 --2- 172.21.15.181:0/1399381745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e815ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1399381745 >> v2:172.21.15.204:3300/0 conn(0x7fe0e8143bb0 msgr2=0x7fe0e80b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 --2- 172.21.15.181:0/1399381745 >> v2:172.21.15.204:3300/0 conn(0x7fe0e8143bb0 0x7fe0e80b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.875+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1399381745 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e8144320 con 0x7fe0e80d08f0 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.876+0000 7fe0e77fe640 1 --2- 172.21.15.181:0/1399381745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e80b30f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0e81445b0 tx=0x7fe0dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724139ebe7803fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.876+0000 7fe0e6ffd640 1 -- 172.21.15.181:0/1399381745 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc037070 con 0x7fe0e80d08f0 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.876+0000 7fe0e6ffd640 1 -- 172.21.15.181:0/1399381745 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0dc032440 con 0x7fe0e80d08f0 2024-09-12T02:28:22.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.876+0000 7fe0e6ffd640 1 -- 172.21.15.181:0/1399381745 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc032810 con 0x7fe0e80d08f0 2024-09-12T02:28:22.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1399381745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 msgr2=0x7fe0e80b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1399381745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e80b30f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0e81445b0 tx=0x7fe0dc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1399381745 shutdown_connections 2024-09-12T02:28:22.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1399381745 >> v2:172.21.15.204:3300/0 conn(0x7fe0e8143bb0 0x7fe0e80b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1399381745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e80b30f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1399381745 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1399381745 >> 172.21.15.181:0/1399381745 conn(0x7fe0e806bc10 msgr2=0x7fe0e806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1399381745 shutdown_connections 2024-09-12T02:28:22.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.877+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1399381745 wait complete. 2024-09-12T02:28:22.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.878+0000 7fe0ee8e4640 1 Processor -- start 2024-09-12T02:28:22.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.878+0000 7fe0ee8e4640 1 -- start start 2024-09-12T02:28:22.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0ee8e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e8072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0ee8e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e813cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0ee8e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0e8143bb0 0x7fe0e813dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0ee8e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e80b21c0 con 0x7fe0e80d08f0 2024-09-12T02:28:22.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0ee8e4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e80b2040 con 0x7fe0e8143bb0 2024-09-12T02:28:22.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0ee8e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e80b2340 con 0x7fe0e80d0510 2024-09-12T02:28:22.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e813cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e813cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39994/0 (socket says 172.21.15.181:39994) 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1703732317 learned_addr learned my addr 172.21.15.181:0/1703732317 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e7fff640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e8072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0ece81640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0e8143bb0 0x7fe0e813dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 msgr2=0x7fe0e8072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e8072650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0e8143bb0 msgr2=0x7fe0e813dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0e8143bb0 0x7fe0e813dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.879+0000 7fe0e77fe640 1 -- 172.21.15.181:0/1703732317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e8072dc0 con 0x7fe0e80d08f0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.880+0000 7fe0e77fe640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e813cb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc02a200 tx=0x7fe0dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.880+0000 7fe0e4ff9640 1 -- 172.21.15.181:0/1703732317 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc041020 con 0x7fe0e80d08f0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.880+0000 7fe0e4ff9640 1 -- 172.21.15.181:0/1703732317 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0dc03d620 con 0x7fe0e80d08f0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.880+0000 7fe0e4ff9640 1 -- 172.21.15.181:0/1703732317 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc037040 con 0x7fe0e80d08f0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.880+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e80730a0 con 0x7fe0e80d08f0 2024-09-12T02:28:22.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.880+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e813d7c0 con 0x7fe0e80d08f0 2024-09-12T02:28:22.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.881+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e815ef90 con 0x7fe0e80d08f0 2024-09-12T02:28:22.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.881+0000 7fe0e4ff9640 1 -- 172.21.15.181:0/1703732317 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0dc044020 con 0x7fe0e80d08f0 2024-09-12T02:28:22.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.881+0000 7fe0e4ff9640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe0d406be30 0x7fe0d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.882+0000 7fe0e4ff9640 1 -- 172.21.15.181:0/1703732317 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0dc0ab3b0 con 0x7fe0e80d08f0 2024-09-12T02:28:22.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.882+0000 7fe0e7fff640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe0d406be30 0x7fe0d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.882+0000 7fe0e7fff640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe0d406be30 0x7fe0d406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800aba0 tx=0x7fe0d800a2a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:22.886+0000 7fe0e4ff9640 1 -- 172.21.15.181:0/1703732317 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0dc04b030 con 0x7fe0e80d08f0 2024-09-12T02:28:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.052+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0e8073270 con 0x7fe0e80d08f0 2024-09-12T02:28:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.053+0000 7fe0e4ff9640 1 -- 172.21.15.181:0/1703732317 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16750 (secure 0 0 0) 0x7fe0dc079df0 con 0x7fe0e80d08f0 2024-09-12T02:28:23.054 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:23.054 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":20,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:21.776108+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe0d406be30 msgr2=0x7fe0d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe0d406be30 0x7fe0d406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800aba0 tx=0x7fe0d800a2a0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 msgr2=0x7fe0e813cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e813cb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc02a200 tx=0x7fe0dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 shutdown_connections 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe0d406be30 0x7fe0d406e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0e8143bb0 0x7fe0e813dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e80d08f0 0x7fe0e813cb40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 --2- 172.21.15.181:0/1703732317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0e80d0510 0x7fe0e8072650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 >> 172.21.15.181:0/1703732317 conn(0x7fe0e806bc10 msgr2=0x7fe0e80b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 shutdown_connections 2024-09-12T02:28:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.055+0000 7fe0ee8e4640 1 -- 172.21.15.181:0/1703732317 wait complete. 2024-09-12T02:28:23.067 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:28:23.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.167+0000 7fd8b559d640 1 Processor -- start 2024-09-12T02:28:23.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.167+0000 7fd8b559d640 1 -- start start 2024-09-12T02:28:23.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8b559d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8b00d0c00 0x7fd8b006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8b559d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b015e970 0x7fd8b006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8b559d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b0074090 con 0x7fd8b00d0820 2024-09-12T02:28:23.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8b559d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b00b5a10 con 0x7fd8b00d0c00 2024-09-12T02:28:23.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8b559d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b00b5c70 con 0x7fd8b015e970 2024-09-12T02:28:23.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8af7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8b00d0c00 0x7fd8b006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8affff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd8b00d0820 0x7fd8b0073790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56120/0 (socket says 172.21.15.181:56120) 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8af7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8b00d0c00 0x7fd8b006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40004/0 (socket says 172.21.15.181:40004) 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8affff640 1 -- 172.21.15.181:0/1446694026 learned_addr learned my addr 172.21.15.181:0/1446694026 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8b4d9c640 1 --2- 172.21.15.181:0/1446694026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b015e970 0x7fd8b006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8af7fe640 1 -- 172.21.15.181:0/1446694026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b015e970 msgr2=0x7fd8b006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8af7fe640 1 --2- 172.21.15.181:0/1446694026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b015e970 0x7fd8b006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8af7fe640 1 -- 172.21.15.181:0/1446694026 >> v1:172.21.15.181:6789/0 conn(0x7fd8b00d0820 legacy=0x7fd8b0073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8aeffd640 1 -- 172.21.15.181:0/1446694026 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529799973 0 0) 0x7fd8b0074090 con 0x7fd8b00d0820 2024-09-12T02:28:23.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.168+0000 7fd8af7fe640 1 -- 172.21.15.181:0/1446694026 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b00b5f50 con 0x7fd8b00d0c00 2024-09-12T02:28:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.169+0000 7fd8af7fe640 1 --2- 172.21.15.181:0/1446694026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b00d0c00 0x7fd8b006bc10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8980097a0 tx=0x7fd89802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b76e665a845ddd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.169+0000 7fd8aeffd640 1 -- 172.21.15.181:0/1446694026 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898037070 con 0x7fd8b00d0c00 2024-09-12T02:28:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.169+0000 7fd8aeffd640 1 -- 172.21.15.181:0/1446694026 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89802ae50 con 0x7fd8b00d0c00 2024-09-12T02:28:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.169+0000 7fd8aeffd640 1 -- 172.21.15.181:0/1446694026 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898032660 con 0x7fd8b00d0c00 2024-09-12T02:28:23.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 -- 172.21.15.181:0/1446694026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b00d0c00 msgr2=0x7fd8b006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 --2- 172.21.15.181:0/1446694026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b00d0c00 0x7fd8b006bc10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8980097a0 tx=0x7fd89802a100 comp rx=0 tx=0).stop 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 -- 172.21.15.181:0/1446694026 shutdown_connections 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 --2- 172.21.15.181:0/1446694026 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b015e970 0x7fd8b006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 --2- 172.21.15.181:0/1446694026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b00d0c00 0x7fd8b006bc10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 -- 172.21.15.181:0/1446694026 >> 172.21.15.181:0/1446694026 conn(0x7fd8b0067d70 msgr2=0x7fd8b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 -- 172.21.15.181:0/1446694026 shutdown_connections 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.170+0000 7fd8b559d640 1 -- 172.21.15.181:0/1446694026 wait complete. 2024-09-12T02:28:23.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.171+0000 7fd8b559d640 1 Processor -- start 2024-09-12T02:28:23.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.171+0000 7fd8b559d640 1 -- start start 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b559d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b00d0820 0x7fd8b01f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b559d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b00d0c00 0x7fd8b015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b559d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b015e970 0x7fd8b01f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b559d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b006ef30 con 0x7fd8b015e970 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b559d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b006edb0 con 0x7fd8b00d0820 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b559d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b0161fc0 con 0x7fd8b00d0c00 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b015e970 0x7fd8b01f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b015e970 0x7fd8b01f6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40008/0 (socket says 172.21.15.181:40008) 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 -- 172.21.15.181:0/3984297637 learned_addr learned my addr 172.21.15.181:0/3984297637 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8affff640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b00d0820 0x7fd8b01f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8af7fe640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b00d0c00 0x7fd8b015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 -- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b00d0c00 msgr2=0x7fd8b015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b00d0c00 0x7fd8b015c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 -- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b00d0820 msgr2=0x7fd8b01f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b00d0820 0x7fd8b01f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 -- 172.21.15.181:0/3984297637 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b01f4490 con 0x7fd8b015e970 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8af7fe640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b00d0c00 0x7fd8b015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8affff640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b00d0820 0x7fd8b01f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.172+0000 7fd8b4d9c640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b015e970 0x7fd8b01f6d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800efc0 tx=0x7fd8a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.173+0000 7fd8acff9640 1 -- 172.21.15.181:0/3984297637 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8018020 con 0x7fd8b015e970 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.173+0000 7fd8acff9640 1 -- 172.21.15.181:0/3984297637 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a8014480 con 0x7fd8b015e970 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.173+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b01f4770 con 0x7fd8b015e970 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.173+0000 7fd8acff9640 1 -- 172.21.15.181:0/3984297637 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8014870 con 0x7fd8b015e970 2024-09-12T02:28:23.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.173+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b0157010 con 0x7fd8b015e970 2024-09-12T02:28:23.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.174+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b0073790 con 0x7fd8b015e970 2024-09-12T02:28:23.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.174+0000 7fd8acff9640 1 -- 172.21.15.181:0/3984297637 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8a8005d10 con 0x7fd8b015e970 2024-09-12T02:28:23.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.174+0000 7fd8acff9640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.175+0000 7fd8acff9640 1 -- 172.21.15.181:0/3984297637 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd8a808bdb0 con 0x7fd8b015e970 2024-09-12T02:28:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.175+0000 7fd8affff640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.175+0000 7fd8affff640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0000f60 tx=0x7fd8a0007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.179+0000 7fd8acff9640 1 -- 172.21.15.181:0/3984297637 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8a8022030 con 0x7fd8b015e970 2024-09-12T02:28:23.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.379+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd8b0162d90 con 0x7fd8b015e970 2024-09-12T02:28:23.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.452+0000 7fd8acff9640 1 -- 172.21.15.181:0/3984297637 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fd8a8010040 con 0x7fd8b015e970 2024-09-12T02:28:23.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd89006be30 msgr2=0x7fd89006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0000f60 tx=0x7fd8a0007cc0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b015e970 msgr2=0x7fd8b01f6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b015e970 0x7fd8b01f6d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800efc0 tx=0x7fd8a800c490 comp rx=0 tx=0).stop 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 shutdown_connections 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8b015e970 0x7fd8b01f6d30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8b00d0c00 0x7fd8b015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 --2- 172.21.15.181:0/3984297637 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8b00d0820 0x7fd8b01f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.455+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 >> 172.21.15.181:0/3984297637 conn(0x7fd8b0067d70 msgr2=0x7fd8b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.456+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 shutdown_connections 2024-09-12T02:28:23.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.456+0000 7fd8b559d640 1 -- 172.21.15.181:0/3984297637 wait complete. 2024-09-12T02:28:23.468 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:28:23.468 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:28:23.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.569+0000 7fd74ed86640 1 Processor -- start 2024-09-12T02:28:23.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.569+0000 7fd74ed86640 1 -- start start 2024-09-12T02:28:23.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74ed86640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7480b4e80 0x7fd748165540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74ed86640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7480b40a0 con 0x7fd74815ab40 2024-09-12T02:28:23.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74ed86640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7480d0350 con 0x7fd7480b3c30 2024-09-12T02:28:23.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74ed86640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd7480ce6e0 con 0x7fd7480b4e80 2024-09-12T02:28:23.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74d323640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7480b4e80 0x7fd748165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74cb22640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd74815ab40 0x7fd7480cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56136/0 (socket says 172.21.15.181:56136) 2024-09-12T02:28:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74cb22640 1 -- 172.21.15.181:0/671421890 learned_addr learned my addr 172.21.15.181:0/671421890 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74d323640 1 -- 172.21.15.181:0/671421890 >> v1:172.21.15.204:6789/0 conn(0x7fd7480b3c30 legacy=0x7fd7480b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74d323640 1 -- 172.21.15.181:0/671421890 >> v1:172.21.15.181:6789/0 conn(0x7fd74815ab40 legacy=0x7fd7480cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.570+0000 7fd74d323640 1 -- 172.21.15.181:0/671421890 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7480d0630 con 0x7fd7480b4e80 2024-09-12T02:28:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.571+0000 7fd74d323640 1 --2- 172.21.15.181:0/671421890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b4e80 0x7fd748165540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7480b4690 tx=0x7fd74002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67128c0c49085170 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.571+0000 7fd7477fe640 1 -- 172.21.15.181:0/671421890 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd740037070 con 0x7fd7480b4e80 2024-09-12T02:28:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.571+0000 7fd7477fe640 1 -- 172.21.15.181:0/671421890 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74002ae20 con 0x7fd7480b4e80 2024-09-12T02:28:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.571+0000 7fd7477fe640 1 -- 172.21.15.181:0/671421890 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd740032660 con 0x7fd7480b4e80 2024-09-12T02:28:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.572+0000 7fd74ed86640 1 -- 172.21.15.181:0/671421890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b4e80 msgr2=0x7fd748165540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.572+0000 7fd74ed86640 1 --2- 172.21.15.181:0/671421890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b4e80 0x7fd748165540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7480b4690 tx=0x7fd74002a110 comp rx=0 tx=0).stop 2024-09-12T02:28:23.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.572+0000 7fd74ed86640 1 -- 172.21.15.181:0/671421890 shutdown_connections 2024-09-12T02:28:23.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.572+0000 7fd74ed86640 1 --2- 172.21.15.181:0/671421890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b4e80 0x7fd748165540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.572+0000 7fd74ed86640 1 -- 172.21.15.181:0/671421890 >> 172.21.15.181:0/671421890 conn(0x7fd74806bc10 msgr2=0x7fd74806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:23.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.572+0000 7fd74ed86640 1 -- 172.21.15.181:0/671421890 shutdown_connections 2024-09-12T02:28:23.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.572+0000 7fd74ed86640 1 -- 172.21.15.181:0/671421890 wait complete. 2024-09-12T02:28:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.573+0000 7fd74ed86640 1 Processor -- start 2024-09-12T02:28:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.573+0000 7fd74ed86640 1 -- start start 2024-09-12T02:28:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74ed86640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b3c30 0x7fd748157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74ed86640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7480b4e80 0x7fd748150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74ed86640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd74815ab40 0x7fd748150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74ed86640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd74815c250 con 0x7fd7480b3c30 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74ed86640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd74815c0d0 con 0x7fd74815ab40 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74ed86640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd7480b1e90 con 0x7fd7480b4e80 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b3c30 0x7fd748157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b3c30 0x7fd748157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40012/0 (socket says 172.21.15.181:40012) 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 -- 172.21.15.181:0/4174222129 learned_addr learned my addr 172.21.15.181:0/4174222129 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd747fff640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7480b4e80 0x7fd748150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74d323640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd74815ab40 0x7fd748150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 -- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7480b4e80 msgr2=0x7fd748150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7480b4e80 0x7fd748150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 -- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd74815ab40 msgr2=0x7fd748150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd74815ab40 0x7fd748150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 -- 172.21.15.181:0/4174222129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7480735a0 con 0x7fd7480b3c30 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74d323640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd74815ab40 0x7fd748150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.574+0000 7fd74cb22640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b3c30 0x7fd748157360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd73800c3f0 tx=0x7fd73800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.575+0000 7fd7457fa640 1 -- 172.21.15.181:0/4174222129 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738017070 con 0x7fd7480b3c30 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.575+0000 7fd7457fa640 1 -- 172.21.15.181:0/4174222129 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd738005ce0 con 0x7fd7480b3c30 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.575+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7481562c0 con 0x7fd7480b3c30 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.575+0000 7fd7457fa640 1 -- 172.21.15.181:0/4174222129 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380072f0 con 0x7fd7480b3c30 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.575+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd748156880 con 0x7fd7480b3c30 2024-09-12T02:28:23.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.576+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd748069170 con 0x7fd7480b3c30 2024-09-12T02:28:23.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.576+0000 7fd7457fa640 1 -- 172.21.15.181:0/4174222129 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd73801a070 con 0x7fd7480b3c30 2024-09-12T02:28:23.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.576+0000 7fd7457fa640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd73406be30 0x7fd73406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.576+0000 7fd7457fa640 1 -- 172.21.15.181:0/4174222129 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd73808a0c0 con 0x7fd7480b3c30 2024-09-12T02:28:23.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.576+0000 7fd747fff640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd73406be30 0x7fd73406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.577+0000 7fd747fff640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd73406be30 0x7fd73406e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7480743d0 tx=0x7fd73c003d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.581+0000 7fd7457fa640 1 -- 172.21.15.181:0/4174222129 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7380584b0 con 0x7fd7480b3c30 2024-09-12T02:28:23.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:23.783+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd748158150 con 0x7fd7480b3c30 2024-09-12T02:28:24.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.461+0000 7fd7457fa640 1 -- 172.21.15.181:0/4174222129 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fd73805c7b0 con 0x7fd7480b3c30 2024-09-12T02:28:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd73406be30 msgr2=0x7fd73406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd73406be30 0x7fd73406e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7480743d0 tx=0x7fd73c003d90 comp rx=0 tx=0).stop 2024-09-12T02:28:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b3c30 msgr2=0x7fd748157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b3c30 0x7fd748157360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd73800c3f0 tx=0x7fd73800c8b0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 shutdown_connections 2024-09-12T02:28:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd73406be30 0x7fd73406e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd74815ab40 0x7fd748150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7480b4e80 0x7fd748150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 --2- 172.21.15.181:0/4174222129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7480b3c30 0x7fd748157360 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 >> 172.21.15.181:0/4174222129 conn(0x7fd74806bc10 msgr2=0x7fd74806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 shutdown_connections 2024-09-12T02:28:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.464+0000 7fd74ed86640 1 -- 172.21.15.181:0/4174222129 wait complete. 2024-09-12T02:28:24.478 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:28:24.478 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.582+0000 7f587e667640 1 Processor -- start 2024-09-12T02:28:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.582+0000 7f587e667640 1 -- start start 2024-09-12T02:28:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f587e667640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f587815e670 0x7f5878070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f587e667640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f58780cef50 0x7f587815f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f587e667640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58780731d0 con 0x7f58780ceaf0 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f587e667640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f58780d0040 con 0x7f587815e670 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f587e667640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5878072f80 con 0x7f58780cef50 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f5877fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f587815e670 0x7f5878070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f5877fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f587815e670 0x7f5878070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40024/0 (socket says 172.21.15.181:40024) 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f5877fff640 1 -- 172.21.15.181:0/2833902466 learned_addr learned my addr 172.21.15.181:0/2833902466 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f587cc04640 1 --2- 172.21.15.181:0/2833902466 >> v2:172.21.15.204:3300/0 conn(0x7f58780cef50 0x7f587815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f5877fff640 1 -- 172.21.15.181:0/2833902466 >> v2:172.21.15.204:3300/0 conn(0x7f58780cef50 msgr2=0x7f587815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.583+0000 7f5877fff640 1 --2- 172.21.15.181:0/2833902466 >> v2:172.21.15.204:3300/0 conn(0x7f58780cef50 0x7f587815f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.584+0000 7f5877fff640 1 -- 172.21.15.181:0/2833902466 >> v1:172.21.15.204:6789/0 conn(0x7f58780ceaf0 legacy=0x7f587815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.584+0000 7f5877fff640 1 -- 172.21.15.181:0/2833902466 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58780734b0 con 0x7f587815e670 2024-09-12T02:28:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.584+0000 7f5877fff640 1 --2- 172.21.15.181:0/2833902466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f587815e670 0x7f5878070a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5878072f10 tx=0x7f586802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff3986d036c982e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.584+0000 7f5876ffd640 1 -- 172.21.15.181:0/2833902466 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868037070 con 0x7f587815e670 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.584+0000 7f5876ffd640 1 -- 172.21.15.181:0/2833902466 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5868032440 con 0x7f587815e670 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.584+0000 7f5876ffd640 1 -- 172.21.15.181:0/2833902466 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868032810 con 0x7f587815e670 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 -- 172.21.15.181:0/2833902466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f587815e670 msgr2=0x7f5878070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 --2- 172.21.15.181:0/2833902466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f587815e670 0x7f5878070a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5878072f10 tx=0x7f586802a2c0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 -- 172.21.15.181:0/2833902466 shutdown_connections 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 --2- 172.21.15.181:0/2833902466 >> v2:172.21.15.204:3300/0 conn(0x7f58780cef50 0x7f587815f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 --2- 172.21.15.181:0/2833902466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f587815e670 0x7f5878070a50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 -- 172.21.15.181:0/2833902466 >> 172.21.15.181:0/2833902466 conn(0x7f587806f400 msgr2=0x7f587806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 -- 172.21.15.181:0/2833902466 shutdown_connections 2024-09-12T02:28:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.585+0000 7f587e667640 1 -- 172.21.15.181:0/2833902466 wait complete. 2024-09-12T02:28:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.586+0000 7f587e667640 1 Processor -- start 2024-09-12T02:28:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.586+0000 7f587e667640 1 -- start start 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f587e667640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780ceaf0 0x7f5878151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f587e667640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780cef50 0x7f5878160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f587e667640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f587815e670 0x7f58781f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f587e667640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5878073a70 con 0x7f58780cef50 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f587e667640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5878073de0 con 0x7f587815e670 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f587e667640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f58780cf380 con 0x7f58780ceaf0 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f58777fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780cef50 0x7f5878160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f58777fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780cef50 0x7f5878160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40040/0 (socket says 172.21.15.181:40040) 2024-09-12T02:28:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f58777fe640 1 -- 172.21.15.181:0/3440251502 learned_addr learned my addr 172.21.15.181:0/3440251502 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f587cc04640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f587815e670 0x7f58781f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.587+0000 7f5877fff640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780ceaf0 0x7f5878151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f58777fe640 1 -- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780ceaf0 msgr2=0x7f5878151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f58777fe640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780ceaf0 0x7f5878151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f58777fe640 1 -- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f587815e670 msgr2=0x7f58781f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f58777fe640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f587815e670 0x7f58781f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f58777fe640 1 -- 172.21.15.181:0/3440251502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5878160030 con 0x7f58780cef50 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f58777fe640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780cef50 0x7f5878160ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f586c00b420 tx=0x7f586c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f5874ff9640 1 -- 172.21.15.181:0/3440251502 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c011830 con 0x7f58780cef50 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f5874ff9640 1 -- 172.21.15.181:0/3440251502 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586c016070 con 0x7f58780cef50 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58781f8a50 con 0x7f58780cef50 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f5874ff9640 1 -- 172.21.15.181:0/3440251502 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c011c10 con 0x7f58780cef50 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.588+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58781602d0 con 0x7f58780cef50 2024-09-12T02:28:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.589+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5878071410 con 0x7f58780cef50 2024-09-12T02:28:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.589+0000 7f5874ff9640 1 -- 172.21.15.181:0/3440251502 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f586c01b460 con 0x7f58780cef50 2024-09-12T02:28:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.590+0000 7f5874ff9640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586406be30 0x7f586406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.590+0000 7f5874ff9640 1 -- 172.21.15.181:0/3440251502 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f586c08a7f0 con 0x7f58780cef50 2024-09-12T02:28:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.590+0000 7f5877fff640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586406be30 0x7f586406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.590+0000 7f5877fff640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586406be30 0x7f586406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f586802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.594+0000 7f5874ff9640 1 -- 172.21.15.181:0/3440251502 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f586c020020 con 0x7f58780cef50 2024-09-12T02:28:24.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.792+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58780b33f0 con 0x7f58780cef50 2024-09-12T02:28:24.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.792+0000 7f5874ff9640 1 -- 172.21.15.181:0/3440251502 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7f586c058b50 con 0x7f58780cef50 2024-09-12T02:28:24.793 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:24.793 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:24.794 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586406be30 msgr2=0x7f586406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586406be30 0x7f586406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f586802e000 comp rx=0 tx=0).stop 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780cef50 msgr2=0x7f5878160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780cef50 0x7f5878160ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f586c00b420 tx=0x7f586c00b8e0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 shutdown_connections 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586406be30 0x7f586406e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f587815e670 0x7f58781f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780cef50 0x7f5878160ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 --2- 172.21.15.181:0/3440251502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780ceaf0 0x7f5878151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 >> 172.21.15.181:0/3440251502 conn(0x7f587806f400 msgr2=0x7f58780b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:24.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 shutdown_connections 2024-09-12T02:28:24.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.795+0000 7f587e667640 1 -- 172.21.15.181:0/3440251502 wait complete. 2024-09-12T02:28:24.807 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:24.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.904+0000 7fd070a0a640 1 Processor -- start 2024-09-12T02:28:24.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.904+0000 7fd070a0a640 1 -- start start 2024-09-12T02:28:24.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd070a0a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd06c0ceaf0 0x7fd06c0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd070a0a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd06c0b5320 0x7fd06c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd070a0a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06c0731d0 con 0x7fd06c15e670 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd070a0a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c0d0040 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd070a0a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c0cf490 con 0x7fd06c0b5320 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd069d9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd06c0ceaf0 0x7fd06c0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd069d9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd06c0ceaf0 0x7fd06c0cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40044/0 (socket says 172.21.15.181:40044) 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd069d9b640 1 -- 172.21.15.181:0/1454509782 learned_addr learned my addr 172.21.15.181:0/1454509782 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.905+0000 7fd06ad9d640 1 --2- 172.21.15.181:0/1454509782 >> v2:172.21.15.204:3300/0 conn(0x7fd06c0b5320 0x7fd06c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd069d9b640 1 -- 172.21.15.181:0/1454509782 >> v2:172.21.15.204:3300/0 conn(0x7fd06c0b5320 msgr2=0x7fd06c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd069d9b640 1 --2- 172.21.15.181:0/1454509782 >> v2:172.21.15.204:3300/0 conn(0x7fd06c0b5320 0x7fd06c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd069d9b640 1 -- 172.21.15.181:0/1454509782 >> v1:172.21.15.204:6789/0 conn(0x7fd06c15e670 legacy=0x7fd06c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd069d9b640 1 -- 172.21.15.181:0/1454509782 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c0734b0 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd069d9b640 1 --2- 172.21.15.181:0/1454509782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c0cef50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd06c072f10 tx=0x7fd06002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb191c86eede2121 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd06959a640 1 -- 172.21.15.181:0/1454509782 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060037070 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd06959a640 1 -- 172.21.15.181:0/1454509782 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06002ae50 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.906+0000 7fd06959a640 1 -- 172.21.15.181:0/1454509782 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060032860 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 -- 172.21.15.181:0/1454509782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 msgr2=0x7fd06c0cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 --2- 172.21.15.181:0/1454509782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c0cef50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd06c072f10 tx=0x7fd06002a300 comp rx=0 tx=0).stop 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 -- 172.21.15.181:0/1454509782 shutdown_connections 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 --2- 172.21.15.181:0/1454509782 >> v2:172.21.15.204:3300/0 conn(0x7fd06c0b5320 0x7fd06c0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 --2- 172.21.15.181:0/1454509782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c0cef50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 -- 172.21.15.181:0/1454509782 >> 172.21.15.181:0/1454509782 conn(0x7fd06c06f400 msgr2=0x7fd06c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 -- 172.21.15.181:0/1454509782 shutdown_connections 2024-09-12T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.907+0000 7fd070a0a640 1 -- 172.21.15.181:0/1454509782 wait complete. 2024-09-12T02:28:24.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.908+0000 7fd070a0a640 1 Processor -- start 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.908+0000 7fd070a0a640 1 -- start start 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd070a0a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd06c0b5320 0x7fd06c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd070a0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd070a0a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd06c15e670 0x7fd06c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd070a0a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c072f80 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd070a0a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c15fa60 con 0x7fd06c0b5320 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd070a0a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c073de0 con 0x7fd06c15e670 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd069d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd069d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40046/0 (socket says 172.21.15.181:40046) 2024-09-12T02:28:24.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd069d9b640 1 -- 172.21.15.181:0/3668615507 learned_addr learned my addr 172.21.15.181:0/3668615507 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd06a59c640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd06c0b5320 0x7fd06c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.909+0000 7fd06ad9d640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd06c15e670 0x7fd06c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd069d9b640 1 -- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd06c15e670 msgr2=0x7fd06c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd069d9b640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd06c15e670 0x7fd06c1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd069d9b640 1 -- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd06c0b5320 msgr2=0x7fd06c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd069d9b640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd06c0b5320 0x7fd06c0d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd069d9b640 1 -- 172.21.15.181:0/3668615507 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c156a90 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd069d9b640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c156550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd060000c00 tx=0x7fd0600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd05affd640 1 -- 172.21.15.181:0/3668615507 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060041020 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd05affd640 1 -- 172.21.15.181:0/3668615507 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06003c670 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd05affd640 1 -- 172.21.15.181:0/3668615507 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060037040 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c1550d0 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.910+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c1545f0 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.911+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06c071410 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.911+0000 7fd05affd640 1 -- 172.21.15.181:0/3668615507 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd060044020 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.912+0000 7fd05affd640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.912+0000 7fd05affd640 1 -- 172.21.15.181:0/3668615507 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd0600ab4e0 con 0x7fd06c0ceaf0 2024-09-12T02:28:24.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.912+0000 7fd06a59c640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.912+0000 7fd06a59c640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd04c06be30 0x7fd04c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd06c15fce0 tx=0x7fd05c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:24.917+0000 7fd05affd640 1 -- 172.21.15.181:0/3668615507 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd06004b030 con 0x7fd06c0ceaf0 2024-09-12T02:28:25.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.081+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd06c15fd10 con 0x7fd06c0ceaf0 2024-09-12T02:28:25.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.082+0000 7fd05affd640 1 -- 172.21.15.181:0/3668615507 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16737 (secure 0 0 0) 0x7fd0600797c0 con 0x7fd06c0ceaf0 2024-09-12T02:28:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:25.083 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:23.452762+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:25.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd04c06be30 msgr2=0x7fd04c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd04c06be30 0x7fd04c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd06c15fce0 tx=0x7fd05c009040 comp rx=0 tx=0).stop 2024-09-12T02:28:25.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 msgr2=0x7fd06c156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c156550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd060000c00 tx=0x7fd0600046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 shutdown_connections 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd06c15e670 0x7fd06c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd06c0ceaf0 0x7fd06c156550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 --2- 172.21.15.181:0/3668615507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd06c0b5320 0x7fd06c0d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 >> 172.21.15.181:0/3668615507 conn(0x7fd06c06f400 msgr2=0x7fd06c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 shutdown_connections 2024-09-12T02:28:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.084+0000 7fd070a0a640 1 -- 172.21.15.181:0/3668615507 wait complete. 2024-09-12T02:28:25.096 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:28:25.097 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:28:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.194+0000 7f86a7477640 1 Processor -- start 2024-09-12T02:28:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.194+0000 7f86a7477640 1 -- start start 2024-09-12T02:28:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a7477640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f86a015e670 0x7f86a0070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a7477640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86a00ceaf0 0x7f86a00cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a7477640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86a00731d0 con 0x7f86a015ea50 2024-09-12T02:28:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a7477640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f86a00d0040 con 0x7f86a00ceaf0 2024-09-12T02:28:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a7477640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f86a00cf490 con 0x7f86a015e670 2024-09-12T02:28:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a4a12640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86a00ceaf0 0x7f86a00cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a4a12640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86a00ceaf0 0x7f86a00cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40058/0 (socket says 172.21.15.181:40058) 2024-09-12T02:28:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a4a12640 1 -- 172.21.15.181:0/1102847193 learned_addr learned my addr 172.21.15.181:0/1102847193 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a5213640 1 --2- 172.21.15.181:0/1102847193 >> v2:172.21.15.204:3300/0 conn(0x7f86a015e670 0x7f86a0070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a4a12640 1 -- 172.21.15.181:0/1102847193 >> v2:172.21.15.204:3300/0 conn(0x7f86a015e670 msgr2=0x7f86a0070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a4a12640 1 --2- 172.21.15.181:0/1102847193 >> v2:172.21.15.204:3300/0 conn(0x7f86a015e670 0x7f86a0070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a4a12640 1 -- 172.21.15.181:0/1102847193 >> v1:172.21.15.204:6789/0 conn(0x7f86a015ea50 legacy=0x7f86a015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.195+0000 7f86a4a12640 1 -- 172.21.15.181:0/1102847193 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a00734b0 con 0x7f86a00ceaf0 2024-09-12T02:28:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.196+0000 7f86a4a12640 1 --2- 172.21.15.181:0/1102847193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a00cef50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f86a00b5030 tx=0x7f869002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca99adcb3464a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.196+0000 7f8697fff640 1 -- 172.21.15.181:0/1102847193 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690037070 con 0x7f86a00ceaf0 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.196+0000 7f8697fff640 1 -- 172.21.15.181:0/1102847193 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869002ae50 con 0x7f86a00ceaf0 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.196+0000 7f8697fff640 1 -- 172.21.15.181:0/1102847193 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690032860 con 0x7f86a00ceaf0 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 -- 172.21.15.181:0/1102847193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 msgr2=0x7f86a00cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 --2- 172.21.15.181:0/1102847193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a00cef50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f86a00b5030 tx=0x7f869002a300 comp rx=0 tx=0).stop 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 -- 172.21.15.181:0/1102847193 shutdown_connections 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 --2- 172.21.15.181:0/1102847193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a00cef50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 --2- 172.21.15.181:0/1102847193 >> v2:172.21.15.204:3300/0 conn(0x7f86a015e670 0x7f86a0070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 -- 172.21.15.181:0/1102847193 >> 172.21.15.181:0/1102847193 conn(0x7f86a006f400 msgr2=0x7f86a006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 -- 172.21.15.181:0/1102847193 shutdown_connections 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.197+0000 7f86a7477640 1 -- 172.21.15.181:0/1102847193 wait complete. 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.198+0000 7f86a7477640 1 Processor -- start 2024-09-12T02:28:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.198+0000 7f86a7477640 1 -- start start 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a7477640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a7477640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86a015e670 0x7f86a00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a7477640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86a015ea50 0x7f86a00d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a7477640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0073de0 con 0x7f86a00ceaf0 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a7477640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0072f80 con 0x7f86a015ea50 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a7477640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f86a0073a70 con 0x7f86a015e670 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40070/0 (socket says 172.21.15.181:40070) 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 -- 172.21.15.181:0/2860098247 learned_addr learned my addr 172.21.15.181:0/2860098247 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5a14640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86a015ea50 0x7f86a00d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a4a12640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86a015e670 0x7f86a00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 -- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86a015e670 msgr2=0x7f86a00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86a015e670 0x7f86a00d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 -- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86a015ea50 msgr2=0x7f86a00d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86a015ea50 0x7f86a00d10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 -- 172.21.15.181:0/2860098247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a00d16a0 con 0x7f86a00ceaf0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a4a12640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86a015e670 0x7f86a00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5a14640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86a015ea50 0x7f86a00d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a5213640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a015a220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f869c00e960 tx=0x7f869c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f8695ffb640 1 -- 172.21.15.181:0/2860098247 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c017070 con 0x7f86a00ceaf0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f8695ffb640 1 -- 172.21.15.181:0/2860098247 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c00ca00 con 0x7f86a00ceaf0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f8695ffb640 1 -- 172.21.15.181:0/2860098247 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c00cdf0 con 0x7f86a00ceaf0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.199+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a00d1980 con 0x7f86a00ceaf0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.200+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a00d1f40 con 0x7f86a00ceaf0 2024-09-12T02:28:25.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.201+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a0069ac0 con 0x7f86a00ceaf0 2024-09-12T02:28:25.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.201+0000 7f8695ffb640 1 -- 172.21.15.181:0/2860098247 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f869c01a070 con 0x7f86a00ceaf0 2024-09-12T02:28:25.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.202+0000 7f8695ffb640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f868406be30 0x7f868406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.202+0000 7f86a4a12640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f868406be30 0x7f868406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.202+0000 7f8695ffb640 1 -- 172.21.15.181:0/2860098247 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f869c08b280 con 0x7f86a00ceaf0 2024-09-12T02:28:25.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.202+0000 7f86a4a12640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f868406be30 0x7f868406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8690034000 tx=0x7f869002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.206+0000 7f8695ffb640 1 -- 172.21.15.181:0/2860098247 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f869c059c30 con 0x7f86a00ceaf0 2024-09-12T02:28:25.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.368+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86a00b34c0 con 0x7f868406be30 2024-09-12T02:28:25.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.375+0000 7f8695ffb640 1 -- 172.21.15.181:0/2860098247 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250815 (secure 0 0 0) 0x7f86a00b34c0 con 0x7f868406be30 2024-09-12T02:28:25.378 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:25.379 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:28:25.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f868406be30 msgr2=0x7f868406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f868406be30 0x7f868406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8690034000 tx=0x7f869002e000 comp rx=0 tx=0).stop 2024-09-12T02:28:25.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 msgr2=0x7f86a015a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a015a220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f869c00e960 tx=0x7f869c00ee20 comp rx=0 tx=0).stop 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 shutdown_connections 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f868406be30 0x7f868406e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86a015ea50 0x7f86a00d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f86a015e670 0x7f86a00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 --2- 172.21.15.181:0/2860098247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86a00ceaf0 0x7f86a015a220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 >> 172.21.15.181:0/2860098247 conn(0x7f86a006f400 msgr2=0x7f86a015c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 shutdown_connections 2024-09-12T02:28:25.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.378+0000 7f86a7477640 1 -- 172.21.15.181:0/2860098247 wait complete. 2024-09-12T02:28:25.389 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T02:28:23.612174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218840,"kb_used_data":2600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755880,"statfs":{"total":773094113280,"available":772870021120,"internally_reserved":0,"allocated":2662400,"data_stored":1651872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000623"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466895+0000","last_change":"2024-09-12T02:28:22.461189+0000","last_active":"2024-09-12T02:28:22.466895+0000","last_peered":"2024-09-12T02:28:22.466895+0000","last_clean":"2024-09-12T02:28:22.466895+0000","last_became_active":"2024-09-12T02:28:22.460880+0000","last_became_peered":"2024-09-12T02:28:22.460880+0000","last_unstale":"2024-09-12T02:28:22.466895+0000","last_undegraded":"2024-09-12T02:28:22.466895+0000","last_fullsized":"2024-09-12T02:28:22.466895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464423+0000","last_change":"2024-09-12T02:28:22.462152+0000","last_active":"2024-09-12T02:28:22.464423+0000","last_peered":"2024-09-12T02:28:22.464423+0000","last_clean":"2024-09-12T02:28:22.464423+0000","last_became_active":"2024-09-12T02:28:22.461892+0000","last_became_peered":"2024-09-12T02:28:22.461892+0000","last_unstale":"2024-09-12T02:28:22.464423+0000","last_undegraded":"2024-09-12T02:28:22.464423+0000","last_fullsized":"2024-09-12T02:28:22.464423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460940+0000","last_change":"2024-09-12T02:28:22.456793+0000","last_active":"2024-09-12T02:28:22.460940+0000","last_peered":"2024-09-12T02:28:22.460940+0000","last_clean":"2024-09-12T02:28:22.460940+0000","last_became_active":"2024-09-12T02:28:22.456542+0000","last_became_peered":"2024-09-12T02:28:22.456542+0000","last_unstale":"2024-09-12T02:28:22.460940+0000","last_undegraded":"2024-09-12T02:28:22.460940+0000","last_fullsized":"2024-09-12T02:28:22.460940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472493+0000","last_change":"2024-09-12T02:28:22.470469+0000","last_active":"2024-09-12T02:28:22.472493+0000","last_peered":"2024-09-12T02:28:22.472493+0000","last_clean":"2024-09-12T02:28:22.472493+0000","last_became_active":"2024-09-12T02:28:22.470021+0000","last_became_peered":"2024-09-12T02:28:22.470021+0000","last_unstale":"2024-09-12T02:28:22.472493+0000","last_undegraded":"2024-09-12T02:28:22.472493+0000","last_fullsized":"2024-09-12T02:28:22.472493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464005+0000","last_change":"2024-09-12T02:28:22.457601+0000","last_active":"2024-09-12T02:28:22.464005+0000","last_peered":"2024-09-12T02:28:22.464005+0000","last_clean":"2024-09-12T02:28:22.464005+0000","last_became_active":"2024-09-12T02:28:22.454545+0000","last_became_peered":"2024-09-12T02:28:22.454545+0000","last_unstale":"2024-09-12T02:28:22.464005+0000","last_undegraded":"2024-09-12T02:28:22.464005+0000","last_fullsized":"2024-09-12T02:28:22.464005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476329+0000","last_change":"2024-09-12T02:28:22.475342+0000","last_active":"2024-09-12T02:28:22.476329+0000","last_peered":"2024-09-12T02:28:22.476329+0000","last_clean":"2024-09-12T02:28:22.476329+0000","last_became_active":"2024-09-12T02:28:22.475064+0000","last_became_peered":"2024-09-12T02:28:22.475064+0000","last_unstale":"2024-09-12T02:28:22.476329+0000","last_undegraded":"2024-09-12T02:28:22.476329+0000","last_fullsized":"2024-09-12T02:28:22.476329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466857+0000","last_change":"2024-09-12T02:28:22.462932+0000","last_active":"2024-09-12T02:28:22.466857+0000","last_peered":"2024-09-12T02:28:22.466857+0000","last_clean":"2024-09-12T02:28:22.466857+0000","last_became_active":"2024-09-12T02:28:22.462608+0000","last_became_peered":"2024-09-12T02:28:22.462608+0000","last_unstale":"2024-09-12T02:28:22.466857+0000","last_undegraded":"2024-09-12T02:28:22.466857+0000","last_fullsized":"2024-09-12T02:28:22.466857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445684+0000","last_change":"2024-09-12T02:28:21.445684+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445684+0000","last_undegraded":"2024-09-12T02:28:21.445684+0000","last_fullsized":"2024-09-12T02:28:21.445684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468959+0000","last_change":"2024-09-12T02:28:22.464802+0000","last_active":"2024-09-12T02:28:22.468959+0000","last_peered":"2024-09-12T02:28:22.468959+0000","last_clean":"2024-09-12T02:28:22.468959+0000","last_became_active":"2024-09-12T02:28:22.464518+0000","last_became_peered":"2024-09-12T02:28:22.464518+0000","last_unstale":"2024-09-12T02:28:22.468959+0000","last_undegraded":"2024-09-12T02:28:22.468959+0000","last_fullsized":"2024-09-12T02:28:22.468959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472207+0000","last_change":"2024-09-12T02:28:22.467874+0000","last_active":"2024-09-12T02:28:22.472207+0000","last_peered":"2024-09-12T02:28:22.472207+0000","last_clean":"2024-09-12T02:28:22.472207+0000","last_became_active":"2024-09-12T02:28:22.467350+0000","last_became_peered":"2024-09-12T02:28:22.467350+0000","last_unstale":"2024-09-12T02:28:22.472207+0000","last_undegraded":"2024-09-12T02:28:22.472207+0000","last_fullsized":"2024-09-12T02:28:22.472207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472283+0000","last_change":"2024-09-12T02:28:22.468202+0000","last_active":"2024-09-12T02:28:22.472283+0000","last_peered":"2024-09-12T02:28:22.472283+0000","last_clean":"2024-09-12T02:28:22.472283+0000","last_became_active":"2024-09-12T02:28:22.467913+0000","last_became_peered":"2024-09-12T02:28:22.467913+0000","last_unstale":"2024-09-12T02:28:22.472283+0000","last_undegraded":"2024-09-12T02:28:22.472283+0000","last_fullsized":"2024-09-12T02:28:22.472283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466714+0000","last_change":"2024-09-12T02:28:22.460598+0000","last_active":"2024-09-12T02:28:22.466714+0000","last_peered":"2024-09-12T02:28:22.466714+0000","last_clean":"2024-09-12T02:28:22.466714+0000","last_became_active":"2024-09-12T02:28:22.460325+0000","last_became_peered":"2024-09-12T02:28:22.460325+0000","last_unstale":"2024-09-12T02:28:22.466714+0000","last_undegraded":"2024-09-12T02:28:22.466714+0000","last_fullsized":"2024-09-12T02:28:22.466714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445444+0000","last_change":"2024-09-12T02:28:21.445444+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445444+0000","last_undegraded":"2024-09-12T02:28:21.445444+0000","last_fullsized":"2024-09-12T02:28:21.445444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469964+0000","last_change":"2024-09-12T02:28:22.462049+0000","last_active":"2024-09-12T02:28:22.469964+0000","last_peered":"2024-09-12T02:28:22.469964+0000","last_clean":"2024-09-12T02:28:22.469964+0000","last_became_active":"2024-09-12T02:28:22.461571+0000","last_became_peered":"2024-09-12T02:28:22.461571+0000","last_unstale":"2024-09-12T02:28:22.469964+0000","last_undegraded":"2024-09-12T02:28:22.469964+0000","last_fullsized":"2024-09-12T02:28:22.469964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:09.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.465223+0000","last_change":"2024-09-12T02:28:22.463467+0000","last_active":"2024-09-12T02:28:22.465223+0000","last_peered":"2024-09-12T02:28:22.465223+0000","last_clean":"2024-09-12T02:28:22.465223+0000","last_became_active":"2024-09-12T02:28:22.463205+0000","last_became_peered":"2024-09-12T02:28:22.463205+0000","last_unstale":"2024-09-12T02:28:22.465223+0000","last_undegraded":"2024-09-12T02:28:22.465223+0000","last_fullsized":"2024-09-12T02:28:22.465223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476631+0000","last_change":"2024-09-12T02:28:22.475573+0000","last_active":"2024-09-12T02:28:22.476631+0000","last_peered":"2024-09-12T02:28:22.476631+0000","last_clean":"2024-09-12T02:28:22.476631+0000","last_became_active":"2024-09-12T02:28:22.475311+0000","last_became_peered":"2024-09-12T02:28:22.475311+0000","last_unstale":"2024-09-12T02:28:22.476631+0000","last_undegraded":"2024-09-12T02:28:22.476631+0000","last_fullsized":"2024-09-12T02:28:22.476631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471642+0000","last_change":"2024-09-12T02:28:22.468036+0000","last_active":"2024-09-12T02:28:22.471642+0000","last_peered":"2024-09-12T02:28:22.471642+0000","last_clean":"2024-09-12T02:28:22.471642+0000","last_became_active":"2024-09-12T02:28:22.467611+0000","last_became_peered":"2024-09-12T02:28:22.467611+0000","last_unstale":"2024-09-12T02:28:22.471642+0000","last_undegraded":"2024-09-12T02:28:22.471642+0000","last_fullsized":"2024-09-12T02:28:22.471642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441768+0000","last_change":"2024-09-12T02:28:21.441768+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441768+0000","last_undegraded":"2024-09-12T02:28:21.441768+0000","last_fullsized":"2024-09-12T02:28:21.441768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463904+0000","last_change":"2024-09-12T02:28:22.455655+0000","last_active":"2024-09-12T02:28:22.463904+0000","last_peered":"2024-09-12T02:28:22.463904+0000","last_clean":"2024-09-12T02:28:22.463904+0000","last_became_active":"2024-09-12T02:28:22.454802+0000","last_became_peered":"2024-09-12T02:28:22.454802+0000","last_unstale":"2024-09-12T02:28:22.463904+0000","last_undegraded":"2024-09-12T02:28:22.463904+0000","last_fullsized":"2024-09-12T02:28:22.463904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472584+0000","last_change":"2024-09-12T02:28:22.464688+0000","last_active":"2024-09-12T02:28:22.472584+0000","last_peered":"2024-09-12T02:28:22.472584+0000","last_clean":"2024-09-12T02:28:22.472584+0000","last_became_active":"2024-09-12T02:28:22.464285+0000","last_became_peered":"2024-09-12T02:28:22.464285+0000","last_unstale":"2024-09-12T02:28:22.472584+0000","last_undegraded":"2024-09-12T02:28:22.472584+0000","last_fullsized":"2024-09-12T02:28:22.472584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470636+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:22.470636+0000","last_peered":"2024-09-12T02:28:22.470636+0000","last_clean":"2024-09-12T02:28:22.470636+0000","last_became_active":"2024-09-12T02:28:22.464320+0000","last_became_peered":"2024-09-12T02:28:22.464320+0000","last_unstale":"2024-09-12T02:28:22.470636+0000","last_undegraded":"2024-09-12T02:28:22.470636+0000","last_fullsized":"2024-09-12T02:28:22.470636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471607+0000","last_change":"2024-09-12T02:28:22.467576+0000","last_active":"2024-09-12T02:28:22.471607+0000","last_peered":"2024-09-12T02:28:22.471607+0000","last_clean":"2024-09-12T02:28:22.471607+0000","last_became_active":"2024-09-12T02:28:22.467297+0000","last_became_peered":"2024-09-12T02:28:22.467297+0000","last_unstale":"2024-09-12T02:28:22.471607+0000","last_undegraded":"2024-09-12T02:28:22.471607+0000","last_fullsized":"2024-09-12T02:28:22.471607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445576+0000","last_change":"2024-09-12T02:28:21.445576+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445576+0000","last_undegraded":"2024-09-12T02:28:21.445576+0000","last_fullsized":"2024-09-12T02:28:21.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472463+0000","last_change":"2024-09-12T02:28:22.470133+0000","last_active":"2024-09-12T02:28:22.472463+0000","last_peered":"2024-09-12T02:28:22.472463+0000","last_clean":"2024-09-12T02:28:22.472463+0000","last_became_active":"2024-09-12T02:28:22.469748+0000","last_became_peered":"2024-09-12T02:28:22.469748+0000","last_unstale":"2024-09-12T02:28:22.472463+0000","last_undegraded":"2024-09-12T02:28:22.472463+0000","last_fullsized":"2024-09-12T02:28:22.472463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445736+0000","last_change":"2024-09-12T02:28:21.445736+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445736+0000","last_undegraded":"2024-09-12T02:28:21.445736+0000","last_fullsized":"2024-09-12T02:28:21.445736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469678+0000","last_change":"2024-09-12T02:28:22.465019+0000","last_active":"2024-09-12T02:28:22.469678+0000","last_peered":"2024-09-12T02:28:22.469678+0000","last_clean":"2024-09-12T02:28:22.469678+0000","last_became_active":"2024-09-12T02:28:22.464751+0000","last_became_peered":"2024-09-12T02:28:22.464751+0000","last_unstale":"2024-09-12T02:28:22.469678+0000","last_undegraded":"2024-09-12T02:28:22.469678+0000","last_fullsized":"2024-09-12T02:28:22.469678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460624+0000","last_change":"2024-09-12T02:28:22.459615+0000","last_active":"2024-09-12T02:28:22.460624+0000","last_peered":"2024-09-12T02:28:22.460624+0000","last_clean":"2024-09-12T02:28:22.460624+0000","last_became_active":"2024-09-12T02:28:22.459342+0000","last_became_peered":"2024-09-12T02:28:22.459342+0000","last_unstale":"2024-09-12T02:28:22.460624+0000","last_undegraded":"2024-09-12T02:28:22.460624+0000","last_fullsized":"2024-09-12T02:28:22.460624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445619+0000","last_change":"2024-09-12T02:28:21.445619+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445619+0000","last_undegraded":"2024-09-12T02:28:21.445619+0000","last_fullsized":"2024-09-12T02:28:21.445619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470611+0000","last_change":"2024-09-12T02:28:22.464467+0000","last_active":"2024-09-12T02:28:22.470611+0000","last_peered":"2024-09-12T02:28:22.470611+0000","last_clean":"2024-09-12T02:28:22.470611+0000","last_became_active":"2024-09-12T02:28:22.464145+0000","last_became_peered":"2024-09-12T02:28:22.464145+0000","last_unstale":"2024-09-12T02:28:22.470611+0000","last_undegraded":"2024-09-12T02:28:22.470611+0000","last_fullsized":"2024-09-12T02:28:22.470611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472621+0000","last_change":"2024-09-12T02:28:22.470537+0000","last_active":"2024-09-12T02:28:22.472621+0000","last_peered":"2024-09-12T02:28:22.472621+0000","last_clean":"2024-09-12T02:28:22.472621+0000","last_became_active":"2024-09-12T02:28:22.469350+0000","last_became_peered":"2024-09-12T02:28:22.469350+0000","last_unstale":"2024-09-12T02:28:22.472621+0000","last_undegraded":"2024-09-12T02:28:22.472621+0000","last_fullsized":"2024-09-12T02:28:22.472621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441574+0000","last_change":"2024-09-12T02:28:21.441574+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441574+0000","last_undegraded":"2024-09-12T02:28:21.441574+0000","last_fullsized":"2024-09-12T02:28:21.441574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469623+0000","last_change":"2024-09-12T02:28:22.463462+0000","last_active":"2024-09-12T02:28:22.469623+0000","last_peered":"2024-09-12T02:28:22.469623+0000","last_clean":"2024-09-12T02:28:22.469623+0000","last_became_active":"2024-09-12T02:28:22.463170+0000","last_became_peered":"2024-09-12T02:28:22.463170+0000","last_unstale":"2024-09-12T02:28:22.469623+0000","last_undegraded":"2024-09-12T02:28:22.469623+0000","last_fullsized":"2024-09-12T02:28:22.469623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467270+0000","last_change":"2024-09-12T02:28:22.461255+0000","last_active":"2024-09-12T02:28:22.467270+0000","last_peered":"2024-09-12T02:28:22.467270+0000","last_clean":"2024-09-12T02:28:22.467270+0000","last_became_active":"2024-09-12T02:28:22.460994+0000","last_became_peered":"2024-09-12T02:28:22.460994+0000","last_unstale":"2024-09-12T02:28:22.467270+0000","last_undegraded":"2024-09-12T02:28:22.467270+0000","last_fullsized":"2024-09-12T02:28:22.467270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458010+0000","last_change":"2024-09-12T02:28:21.453139+0000","last_active":"2024-09-12T02:28:21.458010+0000","last_peered":"2024-09-12T02:28:21.458010+0000","last_clean":"2024-09-12T02:28:21.458010+0000","last_became_active":"2024-09-12T02:28:21.452853+0000","last_became_peered":"2024-09-12T02:28:21.452853+0000","last_unstale":"2024-09-12T02:28:21.458010+0000","last_undegraded":"2024-09-12T02:28:21.458010+0000","last_fullsized":"2024-09-12T02:28:21.458010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464325+0000","last_change":"2024-09-12T02:28:22.456228+0000","last_active":"2024-09-12T02:28:22.464325+0000","last_peered":"2024-09-12T02:28:22.464325+0000","last_clean":"2024-09-12T02:28:22.464325+0000","last_became_active":"2024-09-12T02:28:22.455958+0000","last_became_peered":"2024-09-12T02:28:22.455958+0000","last_unstale":"2024-09-12T02:28:22.464325+0000","last_undegraded":"2024-09-12T02:28:22.464325+0000","last_fullsized":"2024-09-12T02:28:22.464325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472737+0000","last_change":"2024-09-12T02:28:21.446775+0000","last_active":"2024-09-12T02:28:22.472737+0000","last_peered":"2024-09-12T02:28:22.472737+0000","last_clean":"2024-09-12T02:28:22.472737+0000","last_became_active":"2024-09-12T02:28:21.446028+0000","last_became_peered":"2024-09-12T02:28:21.446028+0000","last_unstale":"2024-09-12T02:28:22.472737+0000","last_undegraded":"2024-09-12T02:28:22.472737+0000","last_fullsized":"2024-09-12T02:28:22.472737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:12.026922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458067+0000","last_change":"2024-09-12T02:28:21.452793+0000","last_active":"2024-09-12T02:28:21.458067+0000","last_peered":"2024-09-12T02:28:21.458067+0000","last_clean":"2024-09-12T02:28:21.458067+0000","last_became_active":"2024-09-12T02:28:21.452354+0000","last_became_peered":"2024-09-12T02:28:21.452354+0000","last_unstale":"2024-09-12T02:28:21.458067+0000","last_undegraded":"2024-09-12T02:28:21.458067+0000","last_fullsized":"2024-09-12T02:28:21.458067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445055+0000","last_change":"2024-09-12T02:28:21.445055+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445055+0000","last_undegraded":"2024-09-12T02:28:21.445055+0000","last_fullsized":"2024-09-12T02:28:21.445055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.458540+0000","last_change":"2024-09-12T02:28:21.454569+0000","last_active":"2024-09-12T02:28:22.458540+0000","last_peered":"2024-09-12T02:28:22.458540+0000","last_clean":"2024-09-12T02:28:22.458540+0000","last_became_active":"2024-09-12T02:28:21.453146+0000","last_became_peered":"2024-09-12T02:28:21.453146+0000","last_unstale":"2024-09-12T02:28:22.458540+0000","last_undegraded":"2024-09-12T02:28:22.458540+0000","last_fullsized":"2024-09-12T02:28:22.458540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460543+0000","last_change":"2024-09-12T02:28:22.458922+0000","last_active":"2024-09-12T02:28:22.460543+0000","last_peered":"2024-09-12T02:28:22.460543+0000","last_clean":"2024-09-12T02:28:22.460543+0000","last_became_active":"2024-09-12T02:28:22.458641+0000","last_became_peered":"2024-09-12T02:28:22.458641+0000","last_unstale":"2024-09-12T02:28:22.460543+0000","last_undegraded":"2024-09-12T02:28:22.460543+0000","last_fullsized":"2024-09-12T02:28:22.460543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455704+0000","last_change":"2024-09-12T02:28:21.455322+0000","last_active":"2024-09-12T02:28:22.455704+0000","last_peered":"2024-09-12T02:28:22.455704+0000","last_clean":"2024-09-12T02:28:22.455704+0000","last_became_active":"2024-09-12T02:28:21.455039+0000","last_became_peered":"2024-09-12T02:28:21.455039+0000","last_unstale":"2024-09-12T02:28:22.455704+0000","last_undegraded":"2024-09-12T02:28:22.455704+0000","last_fullsized":"2024-09-12T02:28:22.455704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471705+0000","last_change":"2024-09-12T02:28:22.467660+0000","last_active":"2024-09-12T02:28:22.471705+0000","last_peered":"2024-09-12T02:28:22.471705+0000","last_clean":"2024-09-12T02:28:22.471705+0000","last_became_active":"2024-09-12T02:28:22.467401+0000","last_became_peered":"2024-09-12T02:28:22.467401+0000","last_unstale":"2024-09-12T02:28:22.471705+0000","last_undegraded":"2024-09-12T02:28:22.471705+0000","last_fullsized":"2024-09-12T02:28:22.471705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459944+0000","last_change":"2024-09-12T02:28:21.456883+0000","last_active":"2024-09-12T02:28:22.459944+0000","last_peered":"2024-09-12T02:28:22.459944+0000","last_clean":"2024-09-12T02:28:22.459944+0000","last_became_active":"2024-09-12T02:28:21.456438+0000","last_became_peered":"2024-09-12T02:28:21.456438+0000","last_unstale":"2024-09-12T02:28:22.459944+0000","last_undegraded":"2024-09-12T02:28:22.459944+0000","last_fullsized":"2024-09-12T02:28:22.459944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471682+0000","last_change":"2024-09-12T02:28:22.467768+0000","last_active":"2024-09-12T02:28:22.471682+0000","last_peered":"2024-09-12T02:28:22.471682+0000","last_clean":"2024-09-12T02:28:22.471682+0000","last_became_active":"2024-09-12T02:28:22.467484+0000","last_became_peered":"2024-09-12T02:28:22.467484+0000","last_unstale":"2024-09-12T02:28:22.471682+0000","last_undegraded":"2024-09-12T02:28:22.471682+0000","last_fullsized":"2024-09-12T02:28:22.471682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476218+0000","last_change":"2024-09-12T02:28:21.453336+0000","last_active":"2024-09-12T02:28:22.476218+0000","last_peered":"2024-09-12T02:28:22.476218+0000","last_clean":"2024-09-12T02:28:22.476218+0000","last_became_active":"2024-09-12T02:28:21.453054+0000","last_became_peered":"2024-09-12T02:28:21.453054+0000","last_unstale":"2024-09-12T02:28:22.476218+0000","last_undegraded":"2024-09-12T02:28:22.476218+0000","last_fullsized":"2024-09-12T02:28:22.476218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467201+0000","last_change":"2024-09-12T02:28:22.462579+0000","last_active":"2024-09-12T02:28:22.467201+0000","last_peered":"2024-09-12T02:28:22.467201+0000","last_clean":"2024-09-12T02:28:22.467201+0000","last_became_active":"2024-09-12T02:28:22.462294+0000","last_became_peered":"2024-09-12T02:28:22.462294+0000","last_unstale":"2024-09-12T02:28:22.467201+0000","last_undegraded":"2024-09-12T02:28:22.467201+0000","last_fullsized":"2024-09-12T02:28:22.467201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.478807+0000","last_change":"2024-09-12T02:28:21.449013+0000","last_active":"2024-09-12T02:28:22.478807+0000","last_peered":"2024-09-12T02:28:22.478807+0000","last_clean":"2024-09-12T02:28:22.478807+0000","last_became_active":"2024-09-12T02:28:21.448493+0000","last_became_peered":"2024-09-12T02:28:21.448493+0000","last_unstale":"2024-09-12T02:28:22.478807+0000","last_undegraded":"2024-09-12T02:28:22.478807+0000","last_fullsized":"2024-09-12T02:28:22.478807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463940+0000","last_change":"2024-09-12T02:28:22.456742+0000","last_active":"2024-09-12T02:28:22.463940+0000","last_peered":"2024-09-12T02:28:22.463940+0000","last_clean":"2024-09-12T02:28:22.463940+0000","last_became_active":"2024-09-12T02:28:22.456477+0000","last_became_peered":"2024-09-12T02:28:22.456477+0000","last_unstale":"2024-09-12T02:28:22.463940+0000","last_undegraded":"2024-09-12T02:28:22.463940+0000","last_fullsized":"2024-09-12T02:28:22.463940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474786+0000","last_change":"2024-09-12T02:28:21.461100+0000","last_active":"2024-09-12T02:28:22.474786+0000","last_peered":"2024-09-12T02:28:22.474786+0000","last_clean":"2024-09-12T02:28:22.474786+0000","last_became_active":"2024-09-12T02:28:21.460785+0000","last_became_peered":"2024-09-12T02:28:21.460785+0000","last_unstale":"2024-09-12T02:28:22.474786+0000","last_undegraded":"2024-09-12T02:28:22.474786+0000","last_fullsized":"2024-09-12T02:28:22.474786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:11.030581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469937+0000","last_change":"2024-09-12T02:28:22.461832+0000","last_active":"2024-09-12T02:28:22.469937+0000","last_peered":"2024-09-12T02:28:22.469937+0000","last_clean":"2024-09-12T02:28:22.469937+0000","last_became_active":"2024-09-12T02:28:22.461223+0000","last_became_peered":"2024-09-12T02:28:22.461223+0000","last_unstale":"2024-09-12T02:28:22.469937+0000","last_undegraded":"2024-09-12T02:28:22.469937+0000","last_fullsized":"2024-09-12T02:28:22.469937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:48.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460521+0000","last_change":"2024-09-12T02:28:21.454178+0000","last_active":"2024-09-12T02:28:22.460521+0000","last_peered":"2024-09-12T02:28:22.460521+0000","last_clean":"2024-09-12T02:28:22.460521+0000","last_became_active":"2024-09-12T02:28:21.453871+0000","last_became_peered":"2024-09-12T02:28:21.453871+0000","last_unstale":"2024-09-12T02:28:22.460521+0000","last_undegraded":"2024-09-12T02:28:22.460521+0000","last_fullsized":"2024-09-12T02:28:22.460521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464025+0000","last_change":"2024-09-12T02:28:22.459853+0000","last_active":"2024-09-12T02:28:22.464025+0000","last_peered":"2024-09-12T02:28:22.464025+0000","last_clean":"2024-09-12T02:28:22.464025+0000","last_became_active":"2024-09-12T02:28:22.459611+0000","last_became_peered":"2024-09-12T02:28:22.459611+0000","last_unstale":"2024-09-12T02:28:22.464025+0000","last_undegraded":"2024-09-12T02:28:22.464025+0000","last_fullsized":"2024-09-12T02:28:22.464025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454995+0000","last_change":"2024-09-12T02:28:21.449223+0000","last_active":"2024-09-12T02:28:22.454995+0000","last_peered":"2024-09-12T02:28:22.454995+0000","last_clean":"2024-09-12T02:28:22.454995+0000","last_became_active":"2024-09-12T02:28:21.448650+0000","last_became_peered":"2024-09-12T02:28:21.448650+0000","last_unstale":"2024-09-12T02:28:22.454995+0000","last_undegraded":"2024-09-12T02:28:22.454995+0000","last_fullsized":"2024-09-12T02:28:22.454995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469646+0000","last_change":"2024-09-12T02:28:22.463479+0000","last_active":"2024-09-12T02:28:22.469646+0000","last_peered":"2024-09-12T02:28:22.469646+0000","last_clean":"2024-09-12T02:28:22.469646+0000","last_became_active":"2024-09-12T02:28:22.463208+0000","last_became_peered":"2024-09-12T02:28:22.463208+0000","last_unstale":"2024-09-12T02:28:22.469646+0000","last_undegraded":"2024-09-12T02:28:22.469646+0000","last_fullsized":"2024-09-12T02:28:22.469646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455931+0000","last_change":"2024-09-12T02:28:21.451427+0000","last_active":"2024-09-12T02:28:21.455931+0000","last_peered":"2024-09-12T02:28:21.455931+0000","last_clean":"2024-09-12T02:28:21.455931+0000","last_became_active":"2024-09-12T02:28:21.451124+0000","last_became_peered":"2024-09-12T02:28:21.451124+0000","last_unstale":"2024-09-12T02:28:21.455931+0000","last_undegraded":"2024-09-12T02:28:21.455931+0000","last_fullsized":"2024-09-12T02:28:21.455931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463744+0000","last_change":"2024-09-12T02:28:22.456047+0000","last_active":"2024-09-12T02:28:22.463744+0000","last_peered":"2024-09-12T02:28:22.463744+0000","last_clean":"2024-09-12T02:28:22.463744+0000","last_became_active":"2024-09-12T02:28:22.455803+0000","last_became_peered":"2024-09-12T02:28:22.455803+0000","last_unstale":"2024-09-12T02:28:22.463744+0000","last_undegraded":"2024-09-12T02:28:22.463744+0000","last_fullsized":"2024-09-12T02:28:22.463744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477262+0000","last_change":"2024-09-12T02:28:21.461510+0000","last_active":"2024-09-12T02:28:22.477262+0000","last_peered":"2024-09-12T02:28:22.477262+0000","last_clean":"2024-09-12T02:28:22.477262+0000","last_became_active":"2024-09-12T02:28:21.461183+0000","last_became_peered":"2024-09-12T02:28:21.461183+0000","last_unstale":"2024-09-12T02:28:22.477262+0000","last_undegraded":"2024-09-12T02:28:22.477262+0000","last_fullsized":"2024-09-12T02:28:22.477262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.909426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463806+0000","last_change":"2024-09-12T02:28:22.459244+0000","last_active":"2024-09-12T02:28:22.463806+0000","last_peered":"2024-09-12T02:28:22.463806+0000","last_clean":"2024-09-12T02:28:22.463806+0000","last_became_active":"2024-09-12T02:28:22.458948+0000","last_became_peered":"2024-09-12T02:28:22.458948+0000","last_unstale":"2024-09-12T02:28:22.463806+0000","last_undegraded":"2024-09-12T02:28:22.463806+0000","last_fullsized":"2024-09-12T02:28:22.463806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450138+0000","last_change":"2024-09-12T02:28:21.448604+0000","last_active":"2024-09-12T02:28:21.450138+0000","last_peered":"2024-09-12T02:28:21.450138+0000","last_clean":"2024-09-12T02:28:21.450138+0000","last_became_active":"2024-09-12T02:28:21.448165+0000","last_became_peered":"2024-09-12T02:28:21.448165+0000","last_unstale":"2024-09-12T02:28:21.450138+0000","last_undegraded":"2024-09-12T02:28:21.450138+0000","last_fullsized":"2024-09-12T02:28:21.450138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:33.333161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463722+0000","last_change":"2024-09-12T02:28:22.458525+0000","last_active":"2024-09-12T02:28:22.463722+0000","last_peered":"2024-09-12T02:28:22.463722+0000","last_clean":"2024-09-12T02:28:22.463722+0000","last_became_active":"2024-09-12T02:28:22.458270+0000","last_became_peered":"2024-09-12T02:28:22.458270+0000","last_unstale":"2024-09-12T02:28:22.463722+0000","last_undegraded":"2024-09-12T02:28:22.463722+0000","last_fullsized":"2024-09-12T02:28:22.463722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.475972+0000","last_change":"2024-09-12T02:28:21.456310+0000","last_active":"2024-09-12T02:28:22.475972+0000","last_peered":"2024-09-12T02:28:22.475972+0000","last_clean":"2024-09-12T02:28:22.475972+0000","last_became_active":"2024-09-12T02:28:21.455875+0000","last_became_peered":"2024-09-12T02:28:21.455875+0000","last_unstale":"2024-09-12T02:28:22.475972+0000","last_undegraded":"2024-09-12T02:28:22.475972+0000","last_fullsized":"2024-09-12T02:28:22.475972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472561+0000","last_change":"2024-09-12T02:28:22.470690+0000","last_active":"2024-09-12T02:28:22.472561+0000","last_peered":"2024-09-12T02:28:22.472561+0000","last_clean":"2024-09-12T02:28:22.472561+0000","last_became_active":"2024-09-12T02:28:22.469379+0000","last_became_peered":"2024-09-12T02:28:22.469379+0000","last_unstale":"2024-09-12T02:28:22.472561+0000","last_undegraded":"2024-09-12T02:28:22.472561+0000","last_fullsized":"2024-09-12T02:28:22.472561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455988+0000","last_change":"2024-09-12T02:28:21.451827+0000","last_active":"2024-09-12T02:28:21.455988+0000","last_peered":"2024-09-12T02:28:21.455988+0000","last_clean":"2024-09-12T02:28:21.455988+0000","last_became_active":"2024-09-12T02:28:21.451567+0000","last_became_peered":"2024-09-12T02:28:21.451567+0000","last_unstale":"2024-09-12T02:28:21.455988+0000","last_undegraded":"2024-09-12T02:28:21.455988+0000","last_fullsized":"2024-09-12T02:28:21.455988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470710+0000","last_change":"2024-09-12T02:28:22.468838+0000","last_active":"2024-09-12T02:28:22.470710+0000","last_peered":"2024-09-12T02:28:22.470710+0000","last_clean":"2024-09-12T02:28:22.470710+0000","last_became_active":"2024-09-12T02:28:22.468221+0000","last_became_peered":"2024-09-12T02:28:22.468221+0000","last_unstale":"2024-09-12T02:28:22.470710+0000","last_undegraded":"2024-09-12T02:28:22.470710+0000","last_fullsized":"2024-09-12T02:28:22.470710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.987815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.449072+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:28:22.449072+0000","last_peered":"2024-09-12T02:28:22.449072+0000","last_clean":"2024-09-12T02:28:22.449072+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:28:22.449072+0000","last_undegraded":"2024-09-12T02:28:22.449072+0000","last_fullsized":"2024-09-12T02:28:22.449072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457174+0000","last_change":"2024-09-12T02:28:21.456961+0000","last_active":"2024-09-12T02:28:22.457174+0000","last_peered":"2024-09-12T02:28:22.457174+0000","last_clean":"2024-09-12T02:28:22.457174+0000","last_became_active":"2024-09-12T02:28:21.456682+0000","last_became_peered":"2024-09-12T02:28:21.456682+0000","last_unstale":"2024-09-12T02:28:22.457174+0000","last_undegraded":"2024-09-12T02:28:22.457174+0000","last_fullsized":"2024-09-12T02:28:22.457174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444080+0000","last_change":"2024-09-12T02:28:21.444080+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444080+0000","last_undegraded":"2024-09-12T02:28:21.444080+0000","last_fullsized":"2024-09-12T02:28:21.444080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.448411+0000","last_change":"2024-09-12T02:28:21.462547+0000","last_active":"2024-09-12T02:28:22.448411+0000","last_peered":"2024-09-12T02:28:22.448411+0000","last_clean":"2024-09-12T02:28:22.448411+0000","last_became_active":"2024-09-12T02:28:21.462186+0000","last_became_peered":"2024-09-12T02:28:21.462186+0000","last_unstale":"2024-09-12T02:28:22.448411+0000","last_undegraded":"2024-09-12T02:28:22.448411+0000","last_fullsized":"2024-09-12T02:28:22.448411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468356+0000","last_change":"2024-09-12T02:28:22.457842+0000","last_active":"2024-09-12T02:28:22.468356+0000","last_peered":"2024-09-12T02:28:22.468356+0000","last_clean":"2024-09-12T02:28:22.468356+0000","last_became_active":"2024-09-12T02:28:22.457001+0000","last_became_peered":"2024-09-12T02:28:22.457001+0000","last_unstale":"2024-09-12T02:28:22.468356+0000","last_undegraded":"2024-09-12T02:28:22.468356+0000","last_fullsized":"2024-09-12T02:28:22.468356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450193+0000","last_change":"2024-09-12T02:28:21.449367+0000","last_active":"2024-09-12T02:28:21.450193+0000","last_peered":"2024-09-12T02:28:21.450193+0000","last_clean":"2024-09-12T02:28:21.450193+0000","last_became_active":"2024-09-12T02:28:21.448265+0000","last_became_peered":"2024-09-12T02:28:21.448265+0000","last_unstale":"2024-09-12T02:28:21.450193+0000","last_undegraded":"2024-09-12T02:28:21.450193+0000","last_fullsized":"2024-09-12T02:28:21.450193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459933+0000","last_change":"2024-09-12T02:28:22.458123+0000","last_active":"2024-09-12T02:28:22.459933+0000","last_peered":"2024-09-12T02:28:22.459933+0000","last_clean":"2024-09-12T02:28:22.459933+0000","last_became_active":"2024-09-12T02:28:22.457250+0000","last_became_peered":"2024-09-12T02:28:22.457250+0000","last_unstale":"2024-09-12T02:28:22.459933+0000","last_undegraded":"2024-09-12T02:28:22.459933+0000","last_fullsized":"2024-09-12T02:28:22.459933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460808+0000","last_change":"2024-09-12T02:28:21.457643+0000","last_active":"2024-09-12T02:28:22.460808+0000","last_peered":"2024-09-12T02:28:22.460808+0000","last_clean":"2024-09-12T02:28:22.460808+0000","last_became_active":"2024-09-12T02:28:21.457340+0000","last_became_peered":"2024-09-12T02:28:21.457340+0000","last_unstale":"2024-09-12T02:28:22.460808+0000","last_undegraded":"2024-09-12T02:28:22.460808+0000","last_fullsized":"2024-09-12T02:28:22.460808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469359+0000","last_change":"2024-09-12T02:28:22.466165+0000","last_active":"2024-09-12T02:28:22.469359+0000","last_peered":"2024-09-12T02:28:22.469359+0000","last_clean":"2024-09-12T02:28:22.469359+0000","last_became_active":"2024-09-12T02:28:22.465870+0000","last_became_peered":"2024-09-12T02:28:22.465870+0000","last_unstale":"2024-09-12T02:28:22.469359+0000","last_undegraded":"2024-09-12T02:28:22.469359+0000","last_fullsized":"2024-09-12T02:28:22.469359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455220+0000","last_change":"2024-09-12T02:28:21.461428+0000","last_active":"2024-09-12T02:28:22.455220+0000","last_peered":"2024-09-12T02:28:22.455220+0000","last_clean":"2024-09-12T02:28:22.455220+0000","last_became_active":"2024-09-12T02:28:21.461117+0000","last_became_peered":"2024-09-12T02:28:21.461117+0000","last_unstale":"2024-09-12T02:28:22.455220+0000","last_undegraded":"2024-09-12T02:28:22.455220+0000","last_fullsized":"2024-09-12T02:28:22.455220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472581+0000","last_change":"2024-09-12T02:28:22.470508+0000","last_active":"2024-09-12T02:28:22.472581+0000","last_peered":"2024-09-12T02:28:22.472581+0000","last_clean":"2024-09-12T02:28:22.472581+0000","last_became_active":"2024-09-12T02:28:22.470220+0000","last_became_peered":"2024-09-12T02:28:22.470220+0000","last_unstale":"2024-09-12T02:28:22.472581+0000","last_undegraded":"2024-09-12T02:28:22.472581+0000","last_fullsized":"2024-09-12T02:28:22.472581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.450227+0000","last_change":"2024-09-12T02:28:21.461899+0000","last_active":"2024-09-12T02:28:22.450227+0000","last_peered":"2024-09-12T02:28:22.450227+0000","last_clean":"2024-09-12T02:28:22.450227+0000","last_became_active":"2024-09-12T02:28:21.461616+0000","last_became_peered":"2024-09-12T02:28:21.461616+0000","last_unstale":"2024-09-12T02:28:22.450227+0000","last_undegraded":"2024-09-12T02:28:22.450227+0000","last_fullsized":"2024-09-12T02:28:22.450227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:55.870005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460282+0000","last_change":"2024-09-12T02:28:22.458683+0000","last_active":"2024-09-12T02:28:22.460282+0000","last_peered":"2024-09-12T02:28:22.460282+0000","last_clean":"2024-09-12T02:28:22.460282+0000","last_became_active":"2024-09-12T02:28:22.458413+0000","last_became_peered":"2024-09-12T02:28:22.458413+0000","last_unstale":"2024-09-12T02:28:22.460282+0000","last_undegraded":"2024-09-12T02:28:22.460282+0000","last_fullsized":"2024-09-12T02:28:22.460282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455432+0000","last_change":"2024-09-12T02:28:21.455450+0000","last_active":"2024-09-12T02:28:22.455432+0000","last_peered":"2024-09-12T02:28:22.455432+0000","last_clean":"2024-09-12T02:28:22.455432+0000","last_became_active":"2024-09-12T02:28:21.455128+0000","last_became_peered":"2024-09-12T02:28:21.455128+0000","last_unstale":"2024-09-12T02:28:22.455432+0000","last_undegraded":"2024-09-12T02:28:22.455432+0000","last_fullsized":"2024-09-12T02:28:22.455432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444057+0000","last_change":"2024-09-12T02:28:21.444057+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444057+0000","last_undegraded":"2024-09-12T02:28:21.444057+0000","last_fullsized":"2024-09-12T02:28:21.444057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474150+0000","last_change":"2024-09-12T02:28:21.457754+0000","last_active":"2024-09-12T02:28:22.474150+0000","last_peered":"2024-09-12T02:28:22.474150+0000","last_clean":"2024-09-12T02:28:22.474150+0000","last_became_active":"2024-09-12T02:28:21.457443+0000","last_became_peered":"2024-09-12T02:28:21.457443+0000","last_unstale":"2024-09-12T02:28:22.474150+0000","last_undegraded":"2024-09-12T02:28:22.474150+0000","last_fullsized":"2024-09-12T02:28:22.474150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470384+0000","last_change":"2024-09-12T02:28:22.463795+0000","last_active":"2024-09-12T02:28:22.470384+0000","last_peered":"2024-09-12T02:28:22.470384+0000","last_clean":"2024-09-12T02:28:22.470384+0000","last_became_active":"2024-09-12T02:28:22.463408+0000","last_became_peered":"2024-09-12T02:28:22.463408+0000","last_unstale":"2024-09-12T02:28:22.470384+0000","last_undegraded":"2024-09-12T02:28:22.470384+0000","last_fullsized":"2024-09-12T02:28:22.470384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.451656+0000","last_change":"2024-09-12T02:28:21.462250+0000","last_active":"2024-09-12T02:28:22.451656+0000","last_peered":"2024-09-12T02:28:22.451656+0000","last_clean":"2024-09-12T02:28:22.451656+0000","last_became_active":"2024-09-12T02:28:21.461734+0000","last_became_peered":"2024-09-12T02:28:21.461734+0000","last_unstale":"2024-09-12T02:28:22.451656+0000","last_undegraded":"2024-09-12T02:28:22.451656+0000","last_fullsized":"2024-09-12T02:28:22.451656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:27.705966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463201+0000","last_change":"2024-09-12T02:28:22.459098+0000","last_active":"2024-09-12T02:28:22.463201+0000","last_peered":"2024-09-12T02:28:22.463201+0000","last_clean":"2024-09-12T02:28:22.463201+0000","last_became_active":"2024-09-12T02:28:22.457658+0000","last_became_peered":"2024-09-12T02:28:22.457658+0000","last_unstale":"2024-09-12T02:28:22.463201+0000","last_undegraded":"2024-09-12T02:28:22.463201+0000","last_fullsized":"2024-09-12T02:28:22.463201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.035027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454312+0000","last_change":"2024-09-12T02:28:21.457547+0000","last_active":"2024-09-12T02:28:22.454312+0000","last_peered":"2024-09-12T02:28:22.454312+0000","last_clean":"2024-09-12T02:28:22.454312+0000","last_became_active":"2024-09-12T02:28:21.457263+0000","last_became_peered":"2024-09-12T02:28:21.457263+0000","last_unstale":"2024-09-12T02:28:22.454312+0000","last_undegraded":"2024-09-12T02:28:22.454312+0000","last_fullsized":"2024-09-12T02:28:22.454312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.443679+0000","last_change":"2024-09-12T02:28:21.443679+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.443679+0000","last_undegraded":"2024-09-12T02:28:21.443679+0000","last_fullsized":"2024-09-12T02:28:21.443679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457445+0000","last_change":"2024-09-12T02:28:21.454638+0000","last_active":"2024-09-12T02:28:22.457445+0000","last_peered":"2024-09-12T02:28:22.457445+0000","last_clean":"2024-09-12T02:28:22.457445+0000","last_became_active":"2024-09-12T02:28:21.454339+0000","last_became_peered":"2024-09-12T02:28:21.454339+0000","last_unstale":"2024-09-12T02:28:22.457445+0000","last_undegraded":"2024-09-12T02:28:22.457445+0000","last_fullsized":"2024-09-12T02:28:22.457445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444408+0000","last_change":"2024-09-12T02:28:21.444408+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444408+0000","last_undegraded":"2024-09-12T02:28:21.444408+0000","last_fullsized":"2024-09-12T02:28:21.444408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476692+0000","last_change":"2024-09-12T02:28:21.462703+0000","last_active":"2024-09-12T02:28:22.476692+0000","last_peered":"2024-09-12T02:28:22.476692+0000","last_clean":"2024-09-12T02:28:22.476692+0000","last_became_active":"2024-09-12T02:28:21.462354+0000","last_became_peered":"2024-09-12T02:28:21.462354+0000","last_unstale":"2024-09-12T02:28:22.476692+0000","last_undegraded":"2024-09-12T02:28:22.476692+0000","last_fullsized":"2024-09-12T02:28:22.476692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:45.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469663+0000","last_change":"2024-09-12T02:28:22.465703+0000","last_active":"2024-09-12T02:28:22.469663+0000","last_peered":"2024-09-12T02:28:22.469663+0000","last_clean":"2024-09-12T02:28:22.469663+0000","last_became_active":"2024-09-12T02:28:22.465439+0000","last_became_peered":"2024-09-12T02:28:22.465439+0000","last_unstale":"2024-09-12T02:28:22.469663+0000","last_undegraded":"2024-09-12T02:28:22.469663+0000","last_fullsized":"2024-09-12T02:28:22.469663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470400+0000","last_change":"2024-09-12T02:28:22.464376+0000","last_active":"2024-09-12T02:28:22.470400+0000","last_peered":"2024-09-12T02:28:22.470400+0000","last_clean":"2024-09-12T02:28:22.470400+0000","last_became_active":"2024-09-12T02:28:22.464058+0000","last_became_peered":"2024-09-12T02:28:22.464058+0000","last_unstale":"2024-09-12T02:28:22.470400+0000","last_undegraded":"2024-09-12T02:28:22.470400+0000","last_fullsized":"2024-09-12T02:28:22.470400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476750+0000","last_change":"2024-09-12T02:28:21.459499+0000","last_active":"2024-09-12T02:28:22.476750+0000","last_peered":"2024-09-12T02:28:22.476750+0000","last_clean":"2024-09-12T02:28:22.476750+0000","last_became_active":"2024-09-12T02:28:21.459190+0000","last_became_peered":"2024-09-12T02:28:21.459190+0000","last_unstale":"2024-09-12T02:28:22.476750+0000","last_undegraded":"2024-09-12T02:28:22.476750+0000","last_fullsized":"2024-09-12T02:28:22.476750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471707+0000","last_change":"2024-09-12T02:28:22.467912+0000","last_active":"2024-09-12T02:28:22.471707+0000","last_peered":"2024-09-12T02:28:22.471707+0000","last_clean":"2024-09-12T02:28:22.471707+0000","last_became_active":"2024-09-12T02:28:22.467615+0000","last_became_peered":"2024-09-12T02:28:22.467615+0000","last_unstale":"2024-09-12T02:28:22.471707+0000","last_undegraded":"2024-09-12T02:28:22.471707+0000","last_fullsized":"2024-09-12T02:28:22.471707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476846+0000","last_change":"2024-09-12T02:28:21.462426+0000","last_active":"2024-09-12T02:28:22.476846+0000","last_peered":"2024-09-12T02:28:22.476846+0000","last_clean":"2024-09-12T02:28:22.476846+0000","last_became_active":"2024-09-12T02:28:21.462107+0000","last_became_peered":"2024-09-12T02:28:21.462107+0000","last_unstale":"2024-09-12T02:28:22.476846+0000","last_undegraded":"2024-09-12T02:28:22.476846+0000","last_fullsized":"2024-09-12T02:28:22.476846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:08.206286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.473779+0000","last_change":"2024-09-12T02:28:22.468618+0000","last_active":"2024-09-12T02:28:22.473779+0000","last_peered":"2024-09-12T02:28:22.473779+0000","last_clean":"2024-09-12T02:28:22.473779+0000","last_became_active":"2024-09-12T02:28:22.468188+0000","last_became_peered":"2024-09-12T02:28:22.468188+0000","last_unstale":"2024-09-12T02:28:22.473779+0000","last_undegraded":"2024-09-12T02:28:22.473779+0000","last_fullsized":"2024-09-12T02:28:22.473779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.464145+0000","last_change":"2024-09-12T02:28:21.462214+0000","last_active":"2024-09-12T02:28:21.464145+0000","last_peered":"2024-09-12T02:28:21.464145+0000","last_clean":"2024-09-12T02:28:21.464145+0000","last_became_active":"2024-09-12T02:28:21.461911+0000","last_became_peered":"2024-09-12T02:28:21.461911+0000","last_unstale":"2024-09-12T02:28:21.464145+0000","last_undegraded":"2024-09-12T02:28:21.464145+0000","last_fullsized":"2024-09-12T02:28:21.464145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445229+0000","last_change":"2024-09-12T02:28:21.445229+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445229+0000","last_undegraded":"2024-09-12T02:28:21.445229+0000","last_fullsized":"2024-09-12T02:28:21.445229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477547+0000","last_change":"2024-09-12T02:28:21.461271+0000","last_active":"2024-09-12T02:28:22.477547+0000","last_peered":"2024-09-12T02:28:22.477547+0000","last_clean":"2024-09-12T02:28:22.477547+0000","last_became_active":"2024-09-12T02:28:21.460986+0000","last_became_peered":"2024-09-12T02:28:21.460986+0000","last_unstale":"2024-09-12T02:28:22.477547+0000","last_undegraded":"2024-09-12T02:28:22.477547+0000","last_fullsized":"2024-09-12T02:28:22.477547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:58.924252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:28:25.394 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:28:25.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.527+0000 7f2f828a5640 1 Processor -- start 2024-09-12T02:28:25.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.527+0000 7f2f828a5640 1 -- start start 2024-09-12T02:28:25.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f828a5640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f7c0b47a0 0x7f2f7c0cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f828a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0d2da0 0x7f2f7c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f828a5640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f7c0d0a30 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f828a5640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7c0d0d30 con 0x7f2f7c0b47a0 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f828a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c0b76f0 con 0x7f2f7c0d2da0 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f7c0b47a0 0x7f2f7c0cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f7c0b47a0 0x7f2f7c0cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40072/0 (socket says 172.21.15.181:40072) 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2f7c15c4a0 0x7f2f7c0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56148/0 (socket says 172.21.15.181:56148) 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7b7fe640 1 -- 172.21.15.181:0/363403346 learned_addr learned my addr 172.21.15.181:0/363403346 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f80e42640 1 --2- 172.21.15.181:0/363403346 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0d2da0 0x7f2f7c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7b7fe640 1 -- 172.21.15.181:0/363403346 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0d2da0 msgr2=0x7f2f7c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7b7fe640 1 --2- 172.21.15.181:0/363403346 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0d2da0 0x7f2f7c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7b7fe640 1 -- 172.21.15.181:0/363403346 >> v1:172.21.15.181:6789/0 conn(0x7f2f7c15c4a0 legacy=0x7f2f7c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7b7fe640 1 -- 172.21.15.181:0/363403346 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c073710 con 0x7f2f7c0b47a0 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.528+0000 7f2f7affd640 1 -- 172.21.15.181:0/363403346 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037191756 0 0) 0x7f2f7c0d0a30 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f7b7fe640 1 --2- 172.21.15.181:0/363403346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c0b47a0 0x7f2f7c0cff80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009870 tx=0x7f2f7002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20be64456458efd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f7affd640 1 -- 172.21.15.181:0/363403346 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70037070 con 0x7f2f7c0b47a0 2024-09-12T02:28:25.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f7affd640 1 -- 172.21.15.181:0/363403346 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f70032440 con 0x7f2f7c0b47a0 2024-09-12T02:28:25.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f7affd640 1 -- 172.21.15.181:0/363403346 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70032810 con 0x7f2f7c0b47a0 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f828a5640 1 -- 172.21.15.181:0/363403346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c0b47a0 msgr2=0x7f2f7c0cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f828a5640 1 --2- 172.21.15.181:0/363403346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c0b47a0 0x7f2f7c0cff80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009870 tx=0x7f2f7002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f828a5640 1 -- 172.21.15.181:0/363403346 shutdown_connections 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f828a5640 1 --2- 172.21.15.181:0/363403346 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0d2da0 0x7f2f7c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f828a5640 1 --2- 172.21.15.181:0/363403346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c0b47a0 0x7f2f7c0cff80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.529+0000 7f2f828a5640 1 -- 172.21.15.181:0/363403346 >> 172.21.15.181:0/363403346 conn(0x7f2f7c067950 msgr2=0x7f2f7c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.530+0000 7f2f828a5640 1 -- 172.21.15.181:0/363403346 shutdown_connections 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.530+0000 7f2f828a5640 1 -- 172.21.15.181:0/363403346 wait complete. 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.531+0000 7f2f828a5640 1 Processor -- start 2024-09-12T02:28:25.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.531+0000 7f2f828a5640 1 -- start start 2024-09-12T02:28:25.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0b47a0 0x7f2f7c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c0d2da0 0x7f2f7c14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c15c4a0 0x7f2f7c0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c166030 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c0d28e0 con 0x7f2f7c0d2da0 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c1661b0 con 0x7f2f7c0b47a0 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c15c4a0 0x7f2f7c0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c15c4a0 0x7f2f7c0b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40074/0 (socket says 172.21.15.181:40074) 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 -- 172.21.15.181:0/4122854087 learned_addr learned my addr 172.21.15.181:0/4122854087 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f7bfff640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0b47a0 0x7f2f7c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f7b7fe640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c0d2da0 0x7f2f7c14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 -- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0b47a0 msgr2=0x7f2f7c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0b47a0 0x7f2f7c06e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 -- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c0d2da0 msgr2=0x7f2f7c14c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c0d2da0 0x7f2f7c14c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 -- 172.21.15.181:0/4122854087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c0aa9a0 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f80e42640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c15c4a0 0x7f2f7c0b56a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f74007e40 tx=0x7f2f7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f78ff9640 1 -- 172.21.15.181:0/4122854087 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74014620 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f78ff9640 1 -- 172.21.15.181:0/4122854087 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f74019070 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7c06cd20 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f78ff9640 1 -- 172.21.15.181:0/4122854087 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74014a20 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.532+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7c06d2e0 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.533+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f7c0cff80 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.534+0000 7f2f78ff9640 1 -- 172.21.15.181:0/4122854087 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f74014bc0 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.534+0000 7f2f78ff9640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f6806be30 0x7f2f6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.534+0000 7f2f7bfff640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f6806be30 0x7f2f6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.534+0000 7f2f78ff9640 1 -- 172.21.15.181:0/4122854087 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2f7408b770 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.535+0000 7f2f7bfff640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f6806be30 0x7f2f6806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f60 tx=0x7f2f6c007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.539+0000 7f2f78ff9640 1 -- 172.21.15.181:0/4122854087 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f7405a120 con 0x7f2f7c15c4a0 2024-09-12T02:28:25.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.703+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f7c158af0 con 0x7f2f6806be30 2024-09-12T02:28:25.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.708+0000 7f2f78ff9640 1 -- 172.21.15.181:0/4122854087 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250815 (secure 0 0 0) 0x7f2f7c158af0 con 0x7f2f6806be30 2024-09-12T02:28:25.712 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:25.713 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f6806be30 msgr2=0x7f2f6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f6806be30 0x7f2f6806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f60 tx=0x7f2f6c007c00 comp rx=0 tx=0).stop 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c15c4a0 msgr2=0x7f2f7c0b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c15c4a0 0x7f2f7c0b56a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f74007e40 tx=0x7f2f7400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 shutdown_connections 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f6806be30 0x7f2f6806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f7c0d2da0 0x7f2f7c14c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c15c4a0 0x7f2f7c0b56a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 --2- 172.21.15.181:0/4122854087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f7c0b47a0 0x7f2f7c06e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 >> 172.21.15.181:0/4122854087 conn(0x7f2f7c067950 msgr2=0x7f2f7c15b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 shutdown_connections 2024-09-12T02:28:25.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.712+0000 7f2f828a5640 1 -- 172.21.15.181:0/4122854087 wait complete. 2024-09-12T02:28:25.723 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T02:28:25.612469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218840,"kb_used_data":2600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755880,"statfs":{"total":773094113280,"available":772870021120,"internally_reserved":0,"allocated":2662400,"data_stored":1651872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.180410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466895+0000","last_change":"2024-09-12T02:28:22.461189+0000","last_active":"2024-09-12T02:28:22.466895+0000","last_peered":"2024-09-12T02:28:22.466895+0000","last_clean":"2024-09-12T02:28:22.466895+0000","last_became_active":"2024-09-12T02:28:22.460880+0000","last_became_peered":"2024-09-12T02:28:22.460880+0000","last_unstale":"2024-09-12T02:28:22.466895+0000","last_undegraded":"2024-09-12T02:28:22.466895+0000","last_fullsized":"2024-09-12T02:28:22.466895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464423+0000","last_change":"2024-09-12T02:28:22.462152+0000","last_active":"2024-09-12T02:28:22.464423+0000","last_peered":"2024-09-12T02:28:22.464423+0000","last_clean":"2024-09-12T02:28:22.464423+0000","last_became_active":"2024-09-12T02:28:22.461892+0000","last_became_peered":"2024-09-12T02:28:22.461892+0000","last_unstale":"2024-09-12T02:28:22.464423+0000","last_undegraded":"2024-09-12T02:28:22.464423+0000","last_fullsized":"2024-09-12T02:28:22.464423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460940+0000","last_change":"2024-09-12T02:28:22.456793+0000","last_active":"2024-09-12T02:28:22.460940+0000","last_peered":"2024-09-12T02:28:22.460940+0000","last_clean":"2024-09-12T02:28:22.460940+0000","last_became_active":"2024-09-12T02:28:22.456542+0000","last_became_peered":"2024-09-12T02:28:22.456542+0000","last_unstale":"2024-09-12T02:28:22.460940+0000","last_undegraded":"2024-09-12T02:28:22.460940+0000","last_fullsized":"2024-09-12T02:28:22.460940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472493+0000","last_change":"2024-09-12T02:28:22.470469+0000","last_active":"2024-09-12T02:28:22.472493+0000","last_peered":"2024-09-12T02:28:22.472493+0000","last_clean":"2024-09-12T02:28:22.472493+0000","last_became_active":"2024-09-12T02:28:22.470021+0000","last_became_peered":"2024-09-12T02:28:22.470021+0000","last_unstale":"2024-09-12T02:28:22.472493+0000","last_undegraded":"2024-09-12T02:28:22.472493+0000","last_fullsized":"2024-09-12T02:28:22.472493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464005+0000","last_change":"2024-09-12T02:28:22.457601+0000","last_active":"2024-09-12T02:28:22.464005+0000","last_peered":"2024-09-12T02:28:22.464005+0000","last_clean":"2024-09-12T02:28:22.464005+0000","last_became_active":"2024-09-12T02:28:22.454545+0000","last_became_peered":"2024-09-12T02:28:22.454545+0000","last_unstale":"2024-09-12T02:28:22.464005+0000","last_undegraded":"2024-09-12T02:28:22.464005+0000","last_fullsized":"2024-09-12T02:28:22.464005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476329+0000","last_change":"2024-09-12T02:28:22.475342+0000","last_active":"2024-09-12T02:28:22.476329+0000","last_peered":"2024-09-12T02:28:22.476329+0000","last_clean":"2024-09-12T02:28:22.476329+0000","last_became_active":"2024-09-12T02:28:22.475064+0000","last_became_peered":"2024-09-12T02:28:22.475064+0000","last_unstale":"2024-09-12T02:28:22.476329+0000","last_undegraded":"2024-09-12T02:28:22.476329+0000","last_fullsized":"2024-09-12T02:28:22.476329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466857+0000","last_change":"2024-09-12T02:28:22.462932+0000","last_active":"2024-09-12T02:28:22.466857+0000","last_peered":"2024-09-12T02:28:22.466857+0000","last_clean":"2024-09-12T02:28:22.466857+0000","last_became_active":"2024-09-12T02:28:22.462608+0000","last_became_peered":"2024-09-12T02:28:22.462608+0000","last_unstale":"2024-09-12T02:28:22.466857+0000","last_undegraded":"2024-09-12T02:28:22.466857+0000","last_fullsized":"2024-09-12T02:28:22.466857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445684+0000","last_change":"2024-09-12T02:28:21.445684+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445684+0000","last_undegraded":"2024-09-12T02:28:21.445684+0000","last_fullsized":"2024-09-12T02:28:21.445684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468959+0000","last_change":"2024-09-12T02:28:22.464802+0000","last_active":"2024-09-12T02:28:22.468959+0000","last_peered":"2024-09-12T02:28:22.468959+0000","last_clean":"2024-09-12T02:28:22.468959+0000","last_became_active":"2024-09-12T02:28:22.464518+0000","last_became_peered":"2024-09-12T02:28:22.464518+0000","last_unstale":"2024-09-12T02:28:22.468959+0000","last_undegraded":"2024-09-12T02:28:22.468959+0000","last_fullsized":"2024-09-12T02:28:22.468959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472207+0000","last_change":"2024-09-12T02:28:22.467874+0000","last_active":"2024-09-12T02:28:22.472207+0000","last_peered":"2024-09-12T02:28:22.472207+0000","last_clean":"2024-09-12T02:28:22.472207+0000","last_became_active":"2024-09-12T02:28:22.467350+0000","last_became_peered":"2024-09-12T02:28:22.467350+0000","last_unstale":"2024-09-12T02:28:22.472207+0000","last_undegraded":"2024-09-12T02:28:22.472207+0000","last_fullsized":"2024-09-12T02:28:22.472207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472283+0000","last_change":"2024-09-12T02:28:22.468202+0000","last_active":"2024-09-12T02:28:22.472283+0000","last_peered":"2024-09-12T02:28:22.472283+0000","last_clean":"2024-09-12T02:28:22.472283+0000","last_became_active":"2024-09-12T02:28:22.467913+0000","last_became_peered":"2024-09-12T02:28:22.467913+0000","last_unstale":"2024-09-12T02:28:22.472283+0000","last_undegraded":"2024-09-12T02:28:22.472283+0000","last_fullsized":"2024-09-12T02:28:22.472283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466714+0000","last_change":"2024-09-12T02:28:22.460598+0000","last_active":"2024-09-12T02:28:22.466714+0000","last_peered":"2024-09-12T02:28:22.466714+0000","last_clean":"2024-09-12T02:28:22.466714+0000","last_became_active":"2024-09-12T02:28:22.460325+0000","last_became_peered":"2024-09-12T02:28:22.460325+0000","last_unstale":"2024-09-12T02:28:22.466714+0000","last_undegraded":"2024-09-12T02:28:22.466714+0000","last_fullsized":"2024-09-12T02:28:22.466714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445444+0000","last_change":"2024-09-12T02:28:21.445444+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445444+0000","last_undegraded":"2024-09-12T02:28:21.445444+0000","last_fullsized":"2024-09-12T02:28:21.445444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469964+0000","last_change":"2024-09-12T02:28:22.462049+0000","last_active":"2024-09-12T02:28:22.469964+0000","last_peered":"2024-09-12T02:28:22.469964+0000","last_clean":"2024-09-12T02:28:22.469964+0000","last_became_active":"2024-09-12T02:28:22.461571+0000","last_became_peered":"2024-09-12T02:28:22.461571+0000","last_unstale":"2024-09-12T02:28:22.469964+0000","last_undegraded":"2024-09-12T02:28:22.469964+0000","last_fullsized":"2024-09-12T02:28:22.469964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:09.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.465223+0000","last_change":"2024-09-12T02:28:22.463467+0000","last_active":"2024-09-12T02:28:22.465223+0000","last_peered":"2024-09-12T02:28:22.465223+0000","last_clean":"2024-09-12T02:28:22.465223+0000","last_became_active":"2024-09-12T02:28:22.463205+0000","last_became_peered":"2024-09-12T02:28:22.463205+0000","last_unstale":"2024-09-12T02:28:22.465223+0000","last_undegraded":"2024-09-12T02:28:22.465223+0000","last_fullsized":"2024-09-12T02:28:22.465223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476631+0000","last_change":"2024-09-12T02:28:22.475573+0000","last_active":"2024-09-12T02:28:22.476631+0000","last_peered":"2024-09-12T02:28:22.476631+0000","last_clean":"2024-09-12T02:28:22.476631+0000","last_became_active":"2024-09-12T02:28:22.475311+0000","last_became_peered":"2024-09-12T02:28:22.475311+0000","last_unstale":"2024-09-12T02:28:22.476631+0000","last_undegraded":"2024-09-12T02:28:22.476631+0000","last_fullsized":"2024-09-12T02:28:22.476631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471642+0000","last_change":"2024-09-12T02:28:22.468036+0000","last_active":"2024-09-12T02:28:22.471642+0000","last_peered":"2024-09-12T02:28:22.471642+0000","last_clean":"2024-09-12T02:28:22.471642+0000","last_became_active":"2024-09-12T02:28:22.467611+0000","last_became_peered":"2024-09-12T02:28:22.467611+0000","last_unstale":"2024-09-12T02:28:22.471642+0000","last_undegraded":"2024-09-12T02:28:22.471642+0000","last_fullsized":"2024-09-12T02:28:22.471642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441768+0000","last_change":"2024-09-12T02:28:21.441768+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441768+0000","last_undegraded":"2024-09-12T02:28:21.441768+0000","last_fullsized":"2024-09-12T02:28:21.441768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463904+0000","last_change":"2024-09-12T02:28:22.455655+0000","last_active":"2024-09-12T02:28:22.463904+0000","last_peered":"2024-09-12T02:28:22.463904+0000","last_clean":"2024-09-12T02:28:22.463904+0000","last_became_active":"2024-09-12T02:28:22.454802+0000","last_became_peered":"2024-09-12T02:28:22.454802+0000","last_unstale":"2024-09-12T02:28:22.463904+0000","last_undegraded":"2024-09-12T02:28:22.463904+0000","last_fullsized":"2024-09-12T02:28:22.463904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472584+0000","last_change":"2024-09-12T02:28:22.464688+0000","last_active":"2024-09-12T02:28:22.472584+0000","last_peered":"2024-09-12T02:28:22.472584+0000","last_clean":"2024-09-12T02:28:22.472584+0000","last_became_active":"2024-09-12T02:28:22.464285+0000","last_became_peered":"2024-09-12T02:28:22.464285+0000","last_unstale":"2024-09-12T02:28:22.472584+0000","last_undegraded":"2024-09-12T02:28:22.472584+0000","last_fullsized":"2024-09-12T02:28:22.472584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470636+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:22.470636+0000","last_peered":"2024-09-12T02:28:22.470636+0000","last_clean":"2024-09-12T02:28:22.470636+0000","last_became_active":"2024-09-12T02:28:22.464320+0000","last_became_peered":"2024-09-12T02:28:22.464320+0000","last_unstale":"2024-09-12T02:28:22.470636+0000","last_undegraded":"2024-09-12T02:28:22.470636+0000","last_fullsized":"2024-09-12T02:28:22.470636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471607+0000","last_change":"2024-09-12T02:28:22.467576+0000","last_active":"2024-09-12T02:28:22.471607+0000","last_peered":"2024-09-12T02:28:22.471607+0000","last_clean":"2024-09-12T02:28:22.471607+0000","last_became_active":"2024-09-12T02:28:22.467297+0000","last_became_peered":"2024-09-12T02:28:22.467297+0000","last_unstale":"2024-09-12T02:28:22.471607+0000","last_undegraded":"2024-09-12T02:28:22.471607+0000","last_fullsized":"2024-09-12T02:28:22.471607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445576+0000","last_change":"2024-09-12T02:28:21.445576+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445576+0000","last_undegraded":"2024-09-12T02:28:21.445576+0000","last_fullsized":"2024-09-12T02:28:21.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472463+0000","last_change":"2024-09-12T02:28:22.470133+0000","last_active":"2024-09-12T02:28:22.472463+0000","last_peered":"2024-09-12T02:28:22.472463+0000","last_clean":"2024-09-12T02:28:22.472463+0000","last_became_active":"2024-09-12T02:28:22.469748+0000","last_became_peered":"2024-09-12T02:28:22.469748+0000","last_unstale":"2024-09-12T02:28:22.472463+0000","last_undegraded":"2024-09-12T02:28:22.472463+0000","last_fullsized":"2024-09-12T02:28:22.472463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445736+0000","last_change":"2024-09-12T02:28:21.445736+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445736+0000","last_undegraded":"2024-09-12T02:28:21.445736+0000","last_fullsized":"2024-09-12T02:28:21.445736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469678+0000","last_change":"2024-09-12T02:28:22.465019+0000","last_active":"2024-09-12T02:28:22.469678+0000","last_peered":"2024-09-12T02:28:22.469678+0000","last_clean":"2024-09-12T02:28:22.469678+0000","last_became_active":"2024-09-12T02:28:22.464751+0000","last_became_peered":"2024-09-12T02:28:22.464751+0000","last_unstale":"2024-09-12T02:28:22.469678+0000","last_undegraded":"2024-09-12T02:28:22.469678+0000","last_fullsized":"2024-09-12T02:28:22.469678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460624+0000","last_change":"2024-09-12T02:28:22.459615+0000","last_active":"2024-09-12T02:28:22.460624+0000","last_peered":"2024-09-12T02:28:22.460624+0000","last_clean":"2024-09-12T02:28:22.460624+0000","last_became_active":"2024-09-12T02:28:22.459342+0000","last_became_peered":"2024-09-12T02:28:22.459342+0000","last_unstale":"2024-09-12T02:28:22.460624+0000","last_undegraded":"2024-09-12T02:28:22.460624+0000","last_fullsized":"2024-09-12T02:28:22.460624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445619+0000","last_change":"2024-09-12T02:28:21.445619+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445619+0000","last_undegraded":"2024-09-12T02:28:21.445619+0000","last_fullsized":"2024-09-12T02:28:21.445619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470611+0000","last_change":"2024-09-12T02:28:22.464467+0000","last_active":"2024-09-12T02:28:22.470611+0000","last_peered":"2024-09-12T02:28:22.470611+0000","last_clean":"2024-09-12T02:28:22.470611+0000","last_became_active":"2024-09-12T02:28:22.464145+0000","last_became_peered":"2024-09-12T02:28:22.464145+0000","last_unstale":"2024-09-12T02:28:22.470611+0000","last_undegraded":"2024-09-12T02:28:22.470611+0000","last_fullsized":"2024-09-12T02:28:22.470611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472621+0000","last_change":"2024-09-12T02:28:22.470537+0000","last_active":"2024-09-12T02:28:22.472621+0000","last_peered":"2024-09-12T02:28:22.472621+0000","last_clean":"2024-09-12T02:28:22.472621+0000","last_became_active":"2024-09-12T02:28:22.469350+0000","last_became_peered":"2024-09-12T02:28:22.469350+0000","last_unstale":"2024-09-12T02:28:22.472621+0000","last_undegraded":"2024-09-12T02:28:22.472621+0000","last_fullsized":"2024-09-12T02:28:22.472621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441574+0000","last_change":"2024-09-12T02:28:21.441574+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441574+0000","last_undegraded":"2024-09-12T02:28:21.441574+0000","last_fullsized":"2024-09-12T02:28:21.441574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469623+0000","last_change":"2024-09-12T02:28:22.463462+0000","last_active":"2024-09-12T02:28:22.469623+0000","last_peered":"2024-09-12T02:28:22.469623+0000","last_clean":"2024-09-12T02:28:22.469623+0000","last_became_active":"2024-09-12T02:28:22.463170+0000","last_became_peered":"2024-09-12T02:28:22.463170+0000","last_unstale":"2024-09-12T02:28:22.469623+0000","last_undegraded":"2024-09-12T02:28:22.469623+0000","last_fullsized":"2024-09-12T02:28:22.469623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467270+0000","last_change":"2024-09-12T02:28:22.461255+0000","last_active":"2024-09-12T02:28:22.467270+0000","last_peered":"2024-09-12T02:28:22.467270+0000","last_clean":"2024-09-12T02:28:22.467270+0000","last_became_active":"2024-09-12T02:28:22.460994+0000","last_became_peered":"2024-09-12T02:28:22.460994+0000","last_unstale":"2024-09-12T02:28:22.467270+0000","last_undegraded":"2024-09-12T02:28:22.467270+0000","last_fullsized":"2024-09-12T02:28:22.467270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458010+0000","last_change":"2024-09-12T02:28:21.453139+0000","last_active":"2024-09-12T02:28:21.458010+0000","last_peered":"2024-09-12T02:28:21.458010+0000","last_clean":"2024-09-12T02:28:21.458010+0000","last_became_active":"2024-09-12T02:28:21.452853+0000","last_became_peered":"2024-09-12T02:28:21.452853+0000","last_unstale":"2024-09-12T02:28:21.458010+0000","last_undegraded":"2024-09-12T02:28:21.458010+0000","last_fullsized":"2024-09-12T02:28:21.458010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464325+0000","last_change":"2024-09-12T02:28:22.456228+0000","last_active":"2024-09-12T02:28:22.464325+0000","last_peered":"2024-09-12T02:28:22.464325+0000","last_clean":"2024-09-12T02:28:22.464325+0000","last_became_active":"2024-09-12T02:28:22.455958+0000","last_became_peered":"2024-09-12T02:28:22.455958+0000","last_unstale":"2024-09-12T02:28:22.464325+0000","last_undegraded":"2024-09-12T02:28:22.464325+0000","last_fullsized":"2024-09-12T02:28:22.464325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472737+0000","last_change":"2024-09-12T02:28:21.446775+0000","last_active":"2024-09-12T02:28:22.472737+0000","last_peered":"2024-09-12T02:28:22.472737+0000","last_clean":"2024-09-12T02:28:22.472737+0000","last_became_active":"2024-09-12T02:28:21.446028+0000","last_became_peered":"2024-09-12T02:28:21.446028+0000","last_unstale":"2024-09-12T02:28:22.472737+0000","last_undegraded":"2024-09-12T02:28:22.472737+0000","last_fullsized":"2024-09-12T02:28:22.472737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:12.026922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458067+0000","last_change":"2024-09-12T02:28:21.452793+0000","last_active":"2024-09-12T02:28:21.458067+0000","last_peered":"2024-09-12T02:28:21.458067+0000","last_clean":"2024-09-12T02:28:21.458067+0000","last_became_active":"2024-09-12T02:28:21.452354+0000","last_became_peered":"2024-09-12T02:28:21.452354+0000","last_unstale":"2024-09-12T02:28:21.458067+0000","last_undegraded":"2024-09-12T02:28:21.458067+0000","last_fullsized":"2024-09-12T02:28:21.458067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445055+0000","last_change":"2024-09-12T02:28:21.445055+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445055+0000","last_undegraded":"2024-09-12T02:28:21.445055+0000","last_fullsized":"2024-09-12T02:28:21.445055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.458540+0000","last_change":"2024-09-12T02:28:21.454569+0000","last_active":"2024-09-12T02:28:22.458540+0000","last_peered":"2024-09-12T02:28:22.458540+0000","last_clean":"2024-09-12T02:28:22.458540+0000","last_became_active":"2024-09-12T02:28:21.453146+0000","last_became_peered":"2024-09-12T02:28:21.453146+0000","last_unstale":"2024-09-12T02:28:22.458540+0000","last_undegraded":"2024-09-12T02:28:22.458540+0000","last_fullsized":"2024-09-12T02:28:22.458540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460543+0000","last_change":"2024-09-12T02:28:22.458922+0000","last_active":"2024-09-12T02:28:22.460543+0000","last_peered":"2024-09-12T02:28:22.460543+0000","last_clean":"2024-09-12T02:28:22.460543+0000","last_became_active":"2024-09-12T02:28:22.458641+0000","last_became_peered":"2024-09-12T02:28:22.458641+0000","last_unstale":"2024-09-12T02:28:22.460543+0000","last_undegraded":"2024-09-12T02:28:22.460543+0000","last_fullsized":"2024-09-12T02:28:22.460543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455704+0000","last_change":"2024-09-12T02:28:21.455322+0000","last_active":"2024-09-12T02:28:22.455704+0000","last_peered":"2024-09-12T02:28:22.455704+0000","last_clean":"2024-09-12T02:28:22.455704+0000","last_became_active":"2024-09-12T02:28:21.455039+0000","last_became_peered":"2024-09-12T02:28:21.455039+0000","last_unstale":"2024-09-12T02:28:22.455704+0000","last_undegraded":"2024-09-12T02:28:22.455704+0000","last_fullsized":"2024-09-12T02:28:22.455704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471705+0000","last_change":"2024-09-12T02:28:22.467660+0000","last_active":"2024-09-12T02:28:22.471705+0000","last_peered":"2024-09-12T02:28:22.471705+0000","last_clean":"2024-09-12T02:28:22.471705+0000","last_became_active":"2024-09-12T02:28:22.467401+0000","last_became_peered":"2024-09-12T02:28:22.467401+0000","last_unstale":"2024-09-12T02:28:22.471705+0000","last_undegraded":"2024-09-12T02:28:22.471705+0000","last_fullsized":"2024-09-12T02:28:22.471705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459944+0000","last_change":"2024-09-12T02:28:21.456883+0000","last_active":"2024-09-12T02:28:22.459944+0000","last_peered":"2024-09-12T02:28:22.459944+0000","last_clean":"2024-09-12T02:28:22.459944+0000","last_became_active":"2024-09-12T02:28:21.456438+0000","last_became_peered":"2024-09-12T02:28:21.456438+0000","last_unstale":"2024-09-12T02:28:22.459944+0000","last_undegraded":"2024-09-12T02:28:22.459944+0000","last_fullsized":"2024-09-12T02:28:22.459944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471682+0000","last_change":"2024-09-12T02:28:22.467768+0000","last_active":"2024-09-12T02:28:22.471682+0000","last_peered":"2024-09-12T02:28:22.471682+0000","last_clean":"2024-09-12T02:28:22.471682+0000","last_became_active":"2024-09-12T02:28:22.467484+0000","last_became_peered":"2024-09-12T02:28:22.467484+0000","last_unstale":"2024-09-12T02:28:22.471682+0000","last_undegraded":"2024-09-12T02:28:22.471682+0000","last_fullsized":"2024-09-12T02:28:22.471682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476218+0000","last_change":"2024-09-12T02:28:21.453336+0000","last_active":"2024-09-12T02:28:22.476218+0000","last_peered":"2024-09-12T02:28:22.476218+0000","last_clean":"2024-09-12T02:28:22.476218+0000","last_became_active":"2024-09-12T02:28:21.453054+0000","last_became_peered":"2024-09-12T02:28:21.453054+0000","last_unstale":"2024-09-12T02:28:22.476218+0000","last_undegraded":"2024-09-12T02:28:22.476218+0000","last_fullsized":"2024-09-12T02:28:22.476218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467201+0000","last_change":"2024-09-12T02:28:22.462579+0000","last_active":"2024-09-12T02:28:22.467201+0000","last_peered":"2024-09-12T02:28:22.467201+0000","last_clean":"2024-09-12T02:28:22.467201+0000","last_became_active":"2024-09-12T02:28:22.462294+0000","last_became_peered":"2024-09-12T02:28:22.462294+0000","last_unstale":"2024-09-12T02:28:22.467201+0000","last_undegraded":"2024-09-12T02:28:22.467201+0000","last_fullsized":"2024-09-12T02:28:22.467201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.478807+0000","last_change":"2024-09-12T02:28:21.449013+0000","last_active":"2024-09-12T02:28:22.478807+0000","last_peered":"2024-09-12T02:28:22.478807+0000","last_clean":"2024-09-12T02:28:22.478807+0000","last_became_active":"2024-09-12T02:28:21.448493+0000","last_became_peered":"2024-09-12T02:28:21.448493+0000","last_unstale":"2024-09-12T02:28:22.478807+0000","last_undegraded":"2024-09-12T02:28:22.478807+0000","last_fullsized":"2024-09-12T02:28:22.478807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463940+0000","last_change":"2024-09-12T02:28:22.456742+0000","last_active":"2024-09-12T02:28:22.463940+0000","last_peered":"2024-09-12T02:28:22.463940+0000","last_clean":"2024-09-12T02:28:22.463940+0000","last_became_active":"2024-09-12T02:28:22.456477+0000","last_became_peered":"2024-09-12T02:28:22.456477+0000","last_unstale":"2024-09-12T02:28:22.463940+0000","last_undegraded":"2024-09-12T02:28:22.463940+0000","last_fullsized":"2024-09-12T02:28:22.463940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474786+0000","last_change":"2024-09-12T02:28:21.461100+0000","last_active":"2024-09-12T02:28:22.474786+0000","last_peered":"2024-09-12T02:28:22.474786+0000","last_clean":"2024-09-12T02:28:22.474786+0000","last_became_active":"2024-09-12T02:28:21.460785+0000","last_became_peered":"2024-09-12T02:28:21.460785+0000","last_unstale":"2024-09-12T02:28:22.474786+0000","last_undegraded":"2024-09-12T02:28:22.474786+0000","last_fullsized":"2024-09-12T02:28:22.474786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:11.030581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469937+0000","last_change":"2024-09-12T02:28:22.461832+0000","last_active":"2024-09-12T02:28:22.469937+0000","last_peered":"2024-09-12T02:28:22.469937+0000","last_clean":"2024-09-12T02:28:22.469937+0000","last_became_active":"2024-09-12T02:28:22.461223+0000","last_became_peered":"2024-09-12T02:28:22.461223+0000","last_unstale":"2024-09-12T02:28:22.469937+0000","last_undegraded":"2024-09-12T02:28:22.469937+0000","last_fullsized":"2024-09-12T02:28:22.469937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:48.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460521+0000","last_change":"2024-09-12T02:28:21.454178+0000","last_active":"2024-09-12T02:28:22.460521+0000","last_peered":"2024-09-12T02:28:22.460521+0000","last_clean":"2024-09-12T02:28:22.460521+0000","last_became_active":"2024-09-12T02:28:21.453871+0000","last_became_peered":"2024-09-12T02:28:21.453871+0000","last_unstale":"2024-09-12T02:28:22.460521+0000","last_undegraded":"2024-09-12T02:28:22.460521+0000","last_fullsized":"2024-09-12T02:28:22.460521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464025+0000","last_change":"2024-09-12T02:28:22.459853+0000","last_active":"2024-09-12T02:28:22.464025+0000","last_peered":"2024-09-12T02:28:22.464025+0000","last_clean":"2024-09-12T02:28:22.464025+0000","last_became_active":"2024-09-12T02:28:22.459611+0000","last_became_peered":"2024-09-12T02:28:22.459611+0000","last_unstale":"2024-09-12T02:28:22.464025+0000","last_undegraded":"2024-09-12T02:28:22.464025+0000","last_fullsized":"2024-09-12T02:28:22.464025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454995+0000","last_change":"2024-09-12T02:28:21.449223+0000","last_active":"2024-09-12T02:28:22.454995+0000","last_peered":"2024-09-12T02:28:22.454995+0000","last_clean":"2024-09-12T02:28:22.454995+0000","last_became_active":"2024-09-12T02:28:21.448650+0000","last_became_peered":"2024-09-12T02:28:21.448650+0000","last_unstale":"2024-09-12T02:28:22.454995+0000","last_undegraded":"2024-09-12T02:28:22.454995+0000","last_fullsized":"2024-09-12T02:28:22.454995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469646+0000","last_change":"2024-09-12T02:28:22.463479+0000","last_active":"2024-09-12T02:28:22.469646+0000","last_peered":"2024-09-12T02:28:22.469646+0000","last_clean":"2024-09-12T02:28:22.469646+0000","last_became_active":"2024-09-12T02:28:22.463208+0000","last_became_peered":"2024-09-12T02:28:22.463208+0000","last_unstale":"2024-09-12T02:28:22.469646+0000","last_undegraded":"2024-09-12T02:28:22.469646+0000","last_fullsized":"2024-09-12T02:28:22.469646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455931+0000","last_change":"2024-09-12T02:28:21.451427+0000","last_active":"2024-09-12T02:28:21.455931+0000","last_peered":"2024-09-12T02:28:21.455931+0000","last_clean":"2024-09-12T02:28:21.455931+0000","last_became_active":"2024-09-12T02:28:21.451124+0000","last_became_peered":"2024-09-12T02:28:21.451124+0000","last_unstale":"2024-09-12T02:28:21.455931+0000","last_undegraded":"2024-09-12T02:28:21.455931+0000","last_fullsized":"2024-09-12T02:28:21.455931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463744+0000","last_change":"2024-09-12T02:28:22.456047+0000","last_active":"2024-09-12T02:28:22.463744+0000","last_peered":"2024-09-12T02:28:22.463744+0000","last_clean":"2024-09-12T02:28:22.463744+0000","last_became_active":"2024-09-12T02:28:22.455803+0000","last_became_peered":"2024-09-12T02:28:22.455803+0000","last_unstale":"2024-09-12T02:28:22.463744+0000","last_undegraded":"2024-09-12T02:28:22.463744+0000","last_fullsized":"2024-09-12T02:28:22.463744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477262+0000","last_change":"2024-09-12T02:28:21.461510+0000","last_active":"2024-09-12T02:28:22.477262+0000","last_peered":"2024-09-12T02:28:22.477262+0000","last_clean":"2024-09-12T02:28:22.477262+0000","last_became_active":"2024-09-12T02:28:21.461183+0000","last_became_peered":"2024-09-12T02:28:21.461183+0000","last_unstale":"2024-09-12T02:28:22.477262+0000","last_undegraded":"2024-09-12T02:28:22.477262+0000","last_fullsized":"2024-09-12T02:28:22.477262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.909426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463806+0000","last_change":"2024-09-12T02:28:22.459244+0000","last_active":"2024-09-12T02:28:22.463806+0000","last_peered":"2024-09-12T02:28:22.463806+0000","last_clean":"2024-09-12T02:28:22.463806+0000","last_became_active":"2024-09-12T02:28:22.458948+0000","last_became_peered":"2024-09-12T02:28:22.458948+0000","last_unstale":"2024-09-12T02:28:22.463806+0000","last_undegraded":"2024-09-12T02:28:22.463806+0000","last_fullsized":"2024-09-12T02:28:22.463806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450138+0000","last_change":"2024-09-12T02:28:21.448604+0000","last_active":"2024-09-12T02:28:21.450138+0000","last_peered":"2024-09-12T02:28:21.450138+0000","last_clean":"2024-09-12T02:28:21.450138+0000","last_became_active":"2024-09-12T02:28:21.448165+0000","last_became_peered":"2024-09-12T02:28:21.448165+0000","last_unstale":"2024-09-12T02:28:21.450138+0000","last_undegraded":"2024-09-12T02:28:21.450138+0000","last_fullsized":"2024-09-12T02:28:21.450138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:33.333161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463722+0000","last_change":"2024-09-12T02:28:22.458525+0000","last_active":"2024-09-12T02:28:22.463722+0000","last_peered":"2024-09-12T02:28:22.463722+0000","last_clean":"2024-09-12T02:28:22.463722+0000","last_became_active":"2024-09-12T02:28:22.458270+0000","last_became_peered":"2024-09-12T02:28:22.458270+0000","last_unstale":"2024-09-12T02:28:22.463722+0000","last_undegraded":"2024-09-12T02:28:22.463722+0000","last_fullsized":"2024-09-12T02:28:22.463722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.475972+0000","last_change":"2024-09-12T02:28:21.456310+0000","last_active":"2024-09-12T02:28:22.475972+0000","last_peered":"2024-09-12T02:28:22.475972+0000","last_clean":"2024-09-12T02:28:22.475972+0000","last_became_active":"2024-09-12T02:28:21.455875+0000","last_became_peered":"2024-09-12T02:28:21.455875+0000","last_unstale":"2024-09-12T02:28:22.475972+0000","last_undegraded":"2024-09-12T02:28:22.475972+0000","last_fullsized":"2024-09-12T02:28:22.475972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472561+0000","last_change":"2024-09-12T02:28:22.470690+0000","last_active":"2024-09-12T02:28:22.472561+0000","last_peered":"2024-09-12T02:28:22.472561+0000","last_clean":"2024-09-12T02:28:22.472561+0000","last_became_active":"2024-09-12T02:28:22.469379+0000","last_became_peered":"2024-09-12T02:28:22.469379+0000","last_unstale":"2024-09-12T02:28:22.472561+0000","last_undegraded":"2024-09-12T02:28:22.472561+0000","last_fullsized":"2024-09-12T02:28:22.472561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455988+0000","last_change":"2024-09-12T02:28:21.451827+0000","last_active":"2024-09-12T02:28:21.455988+0000","last_peered":"2024-09-12T02:28:21.455988+0000","last_clean":"2024-09-12T02:28:21.455988+0000","last_became_active":"2024-09-12T02:28:21.451567+0000","last_became_peered":"2024-09-12T02:28:21.451567+0000","last_unstale":"2024-09-12T02:28:21.455988+0000","last_undegraded":"2024-09-12T02:28:21.455988+0000","last_fullsized":"2024-09-12T02:28:21.455988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470710+0000","last_change":"2024-09-12T02:28:22.468838+0000","last_active":"2024-09-12T02:28:22.470710+0000","last_peered":"2024-09-12T02:28:22.470710+0000","last_clean":"2024-09-12T02:28:22.470710+0000","last_became_active":"2024-09-12T02:28:22.468221+0000","last_became_peered":"2024-09-12T02:28:22.468221+0000","last_unstale":"2024-09-12T02:28:22.470710+0000","last_undegraded":"2024-09-12T02:28:22.470710+0000","last_fullsized":"2024-09-12T02:28:22.470710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.987815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.449072+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:28:22.449072+0000","last_peered":"2024-09-12T02:28:22.449072+0000","last_clean":"2024-09-12T02:28:22.449072+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:28:22.449072+0000","last_undegraded":"2024-09-12T02:28:22.449072+0000","last_fullsized":"2024-09-12T02:28:22.449072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457174+0000","last_change":"2024-09-12T02:28:21.456961+0000","last_active":"2024-09-12T02:28:22.457174+0000","last_peered":"2024-09-12T02:28:22.457174+0000","last_clean":"2024-09-12T02:28:22.457174+0000","last_became_active":"2024-09-12T02:28:21.456682+0000","last_became_peered":"2024-09-12T02:28:21.456682+0000","last_unstale":"2024-09-12T02:28:22.457174+0000","last_undegraded":"2024-09-12T02:28:22.457174+0000","last_fullsized":"2024-09-12T02:28:22.457174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444080+0000","last_change":"2024-09-12T02:28:21.444080+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444080+0000","last_undegraded":"2024-09-12T02:28:21.444080+0000","last_fullsized":"2024-09-12T02:28:21.444080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.448411+0000","last_change":"2024-09-12T02:28:21.462547+0000","last_active":"2024-09-12T02:28:22.448411+0000","last_peered":"2024-09-12T02:28:22.448411+0000","last_clean":"2024-09-12T02:28:22.448411+0000","last_became_active":"2024-09-12T02:28:21.462186+0000","last_became_peered":"2024-09-12T02:28:21.462186+0000","last_unstale":"2024-09-12T02:28:22.448411+0000","last_undegraded":"2024-09-12T02:28:22.448411+0000","last_fullsized":"2024-09-12T02:28:22.448411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468356+0000","last_change":"2024-09-12T02:28:22.457842+0000","last_active":"2024-09-12T02:28:22.468356+0000","last_peered":"2024-09-12T02:28:22.468356+0000","last_clean":"2024-09-12T02:28:22.468356+0000","last_became_active":"2024-09-12T02:28:22.457001+0000","last_became_peered":"2024-09-12T02:28:22.457001+0000","last_unstale":"2024-09-12T02:28:22.468356+0000","last_undegraded":"2024-09-12T02:28:22.468356+0000","last_fullsized":"2024-09-12T02:28:22.468356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450193+0000","last_change":"2024-09-12T02:28:21.449367+0000","last_active":"2024-09-12T02:28:21.450193+0000","last_peered":"2024-09-12T02:28:21.450193+0000","last_clean":"2024-09-12T02:28:21.450193+0000","last_became_active":"2024-09-12T02:28:21.448265+0000","last_became_peered":"2024-09-12T02:28:21.448265+0000","last_unstale":"2024-09-12T02:28:21.450193+0000","last_undegraded":"2024-09-12T02:28:21.450193+0000","last_fullsized":"2024-09-12T02:28:21.450193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459933+0000","last_change":"2024-09-12T02:28:22.458123+0000","last_active":"2024-09-12T02:28:22.459933+0000","last_peered":"2024-09-12T02:28:22.459933+0000","last_clean":"2024-09-12T02:28:22.459933+0000","last_became_active":"2024-09-12T02:28:22.457250+0000","last_became_peered":"2024-09-12T02:28:22.457250+0000","last_unstale":"2024-09-12T02:28:22.459933+0000","last_undegraded":"2024-09-12T02:28:22.459933+0000","last_fullsized":"2024-09-12T02:28:22.459933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460808+0000","last_change":"2024-09-12T02:28:21.457643+0000","last_active":"2024-09-12T02:28:22.460808+0000","last_peered":"2024-09-12T02:28:22.460808+0000","last_clean":"2024-09-12T02:28:22.460808+0000","last_became_active":"2024-09-12T02:28:21.457340+0000","last_became_peered":"2024-09-12T02:28:21.457340+0000","last_unstale":"2024-09-12T02:28:22.460808+0000","last_undegraded":"2024-09-12T02:28:22.460808+0000","last_fullsized":"2024-09-12T02:28:22.460808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469359+0000","last_change":"2024-09-12T02:28:22.466165+0000","last_active":"2024-09-12T02:28:22.469359+0000","last_peered":"2024-09-12T02:28:22.469359+0000","last_clean":"2024-09-12T02:28:22.469359+0000","last_became_active":"2024-09-12T02:28:22.465870+0000","last_became_peered":"2024-09-12T02:28:22.465870+0000","last_unstale":"2024-09-12T02:28:22.469359+0000","last_undegraded":"2024-09-12T02:28:22.469359+0000","last_fullsized":"2024-09-12T02:28:22.469359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455220+0000","last_change":"2024-09-12T02:28:21.461428+0000","last_active":"2024-09-12T02:28:22.455220+0000","last_peered":"2024-09-12T02:28:22.455220+0000","last_clean":"2024-09-12T02:28:22.455220+0000","last_became_active":"2024-09-12T02:28:21.461117+0000","last_became_peered":"2024-09-12T02:28:21.461117+0000","last_unstale":"2024-09-12T02:28:22.455220+0000","last_undegraded":"2024-09-12T02:28:22.455220+0000","last_fullsized":"2024-09-12T02:28:22.455220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472581+0000","last_change":"2024-09-12T02:28:22.470508+0000","last_active":"2024-09-12T02:28:22.472581+0000","last_peered":"2024-09-12T02:28:22.472581+0000","last_clean":"2024-09-12T02:28:22.472581+0000","last_became_active":"2024-09-12T02:28:22.470220+0000","last_became_peered":"2024-09-12T02:28:22.470220+0000","last_unstale":"2024-09-12T02:28:22.472581+0000","last_undegraded":"2024-09-12T02:28:22.472581+0000","last_fullsized":"2024-09-12T02:28:22.472581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.450227+0000","last_change":"2024-09-12T02:28:21.461899+0000","last_active":"2024-09-12T02:28:22.450227+0000","last_peered":"2024-09-12T02:28:22.450227+0000","last_clean":"2024-09-12T02:28:22.450227+0000","last_became_active":"2024-09-12T02:28:21.461616+0000","last_became_peered":"2024-09-12T02:28:21.461616+0000","last_unstale":"2024-09-12T02:28:22.450227+0000","last_undegraded":"2024-09-12T02:28:22.450227+0000","last_fullsized":"2024-09-12T02:28:22.450227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:55.870005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460282+0000","last_change":"2024-09-12T02:28:22.458683+0000","last_active":"2024-09-12T02:28:22.460282+0000","last_peered":"2024-09-12T02:28:22.460282+0000","last_clean":"2024-09-12T02:28:22.460282+0000","last_became_active":"2024-09-12T02:28:22.458413+0000","last_became_peered":"2024-09-12T02:28:22.458413+0000","last_unstale":"2024-09-12T02:28:22.460282+0000","last_undegraded":"2024-09-12T02:28:22.460282+0000","last_fullsized":"2024-09-12T02:28:22.460282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455432+0000","last_change":"2024-09-12T02:28:21.455450+0000","last_active":"2024-09-12T02:28:22.455432+0000","last_peered":"2024-09-12T02:28:22.455432+0000","last_clean":"2024-09-12T02:28:22.455432+0000","last_became_active":"2024-09-12T02:28:21.455128+0000","last_became_peered":"2024-09-12T02:28:21.455128+0000","last_unstale":"2024-09-12T02:28:22.455432+0000","last_undegraded":"2024-09-12T02:28:22.455432+0000","last_fullsized":"2024-09-12T02:28:22.455432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444057+0000","last_change":"2024-09-12T02:28:21.444057+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444057+0000","last_undegraded":"2024-09-12T02:28:21.444057+0000","last_fullsized":"2024-09-12T02:28:21.444057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474150+0000","last_change":"2024-09-12T02:28:21.457754+0000","last_active":"2024-09-12T02:28:22.474150+0000","last_peered":"2024-09-12T02:28:22.474150+0000","last_clean":"2024-09-12T02:28:22.474150+0000","last_became_active":"2024-09-12T02:28:21.457443+0000","last_became_peered":"2024-09-12T02:28:21.457443+0000","last_unstale":"2024-09-12T02:28:22.474150+0000","last_undegraded":"2024-09-12T02:28:22.474150+0000","last_fullsized":"2024-09-12T02:28:22.474150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470384+0000","last_change":"2024-09-12T02:28:22.463795+0000","last_active":"2024-09-12T02:28:22.470384+0000","last_peered":"2024-09-12T02:28:22.470384+0000","last_clean":"2024-09-12T02:28:22.470384+0000","last_became_active":"2024-09-12T02:28:22.463408+0000","last_became_peered":"2024-09-12T02:28:22.463408+0000","last_unstale":"2024-09-12T02:28:22.470384+0000","last_undegraded":"2024-09-12T02:28:22.470384+0000","last_fullsized":"2024-09-12T02:28:22.470384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.451656+0000","last_change":"2024-09-12T02:28:21.462250+0000","last_active":"2024-09-12T02:28:22.451656+0000","last_peered":"2024-09-12T02:28:22.451656+0000","last_clean":"2024-09-12T02:28:22.451656+0000","last_became_active":"2024-09-12T02:28:21.461734+0000","last_became_peered":"2024-09-12T02:28:21.461734+0000","last_unstale":"2024-09-12T02:28:22.451656+0000","last_undegraded":"2024-09-12T02:28:22.451656+0000","last_fullsized":"2024-09-12T02:28:22.451656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:27.705966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463201+0000","last_change":"2024-09-12T02:28:22.459098+0000","last_active":"2024-09-12T02:28:22.463201+0000","last_peered":"2024-09-12T02:28:22.463201+0000","last_clean":"2024-09-12T02:28:22.463201+0000","last_became_active":"2024-09-12T02:28:22.457658+0000","last_became_peered":"2024-09-12T02:28:22.457658+0000","last_unstale":"2024-09-12T02:28:22.463201+0000","last_undegraded":"2024-09-12T02:28:22.463201+0000","last_fullsized":"2024-09-12T02:28:22.463201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.035027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454312+0000","last_change":"2024-09-12T02:28:21.457547+0000","last_active":"2024-09-12T02:28:22.454312+0000","last_peered":"2024-09-12T02:28:22.454312+0000","last_clean":"2024-09-12T02:28:22.454312+0000","last_became_active":"2024-09-12T02:28:21.457263+0000","last_became_peered":"2024-09-12T02:28:21.457263+0000","last_unstale":"2024-09-12T02:28:22.454312+0000","last_undegraded":"2024-09-12T02:28:22.454312+0000","last_fullsized":"2024-09-12T02:28:22.454312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.443679+0000","last_change":"2024-09-12T02:28:21.443679+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.443679+0000","last_undegraded":"2024-09-12T02:28:21.443679+0000","last_fullsized":"2024-09-12T02:28:21.443679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457445+0000","last_change":"2024-09-12T02:28:21.454638+0000","last_active":"2024-09-12T02:28:22.457445+0000","last_peered":"2024-09-12T02:28:22.457445+0000","last_clean":"2024-09-12T02:28:22.457445+0000","last_became_active":"2024-09-12T02:28:21.454339+0000","last_became_peered":"2024-09-12T02:28:21.454339+0000","last_unstale":"2024-09-12T02:28:22.457445+0000","last_undegraded":"2024-09-12T02:28:22.457445+0000","last_fullsized":"2024-09-12T02:28:22.457445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444408+0000","last_change":"2024-09-12T02:28:21.444408+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444408+0000","last_undegraded":"2024-09-12T02:28:21.444408+0000","last_fullsized":"2024-09-12T02:28:21.444408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476692+0000","last_change":"2024-09-12T02:28:21.462703+0000","last_active":"2024-09-12T02:28:22.476692+0000","last_peered":"2024-09-12T02:28:22.476692+0000","last_clean":"2024-09-12T02:28:22.476692+0000","last_became_active":"2024-09-12T02:28:21.462354+0000","last_became_peered":"2024-09-12T02:28:21.462354+0000","last_unstale":"2024-09-12T02:28:22.476692+0000","last_undegraded":"2024-09-12T02:28:22.476692+0000","last_fullsized":"2024-09-12T02:28:22.476692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:45.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469663+0000","last_change":"2024-09-12T02:28:22.465703+0000","last_active":"2024-09-12T02:28:22.469663+0000","last_peered":"2024-09-12T02:28:22.469663+0000","last_clean":"2024-09-12T02:28:22.469663+0000","last_became_active":"2024-09-12T02:28:22.465439+0000","last_became_peered":"2024-09-12T02:28:22.465439+0000","last_unstale":"2024-09-12T02:28:22.469663+0000","last_undegraded":"2024-09-12T02:28:22.469663+0000","last_fullsized":"2024-09-12T02:28:22.469663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470400+0000","last_change":"2024-09-12T02:28:22.464376+0000","last_active":"2024-09-12T02:28:22.470400+0000","last_peered":"2024-09-12T02:28:22.470400+0000","last_clean":"2024-09-12T02:28:22.470400+0000","last_became_active":"2024-09-12T02:28:22.464058+0000","last_became_peered":"2024-09-12T02:28:22.464058+0000","last_unstale":"2024-09-12T02:28:22.470400+0000","last_undegraded":"2024-09-12T02:28:22.470400+0000","last_fullsized":"2024-09-12T02:28:22.470400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476750+0000","last_change":"2024-09-12T02:28:21.459499+0000","last_active":"2024-09-12T02:28:22.476750+0000","last_peered":"2024-09-12T02:28:22.476750+0000","last_clean":"2024-09-12T02:28:22.476750+0000","last_became_active":"2024-09-12T02:28:21.459190+0000","last_became_peered":"2024-09-12T02:28:21.459190+0000","last_unstale":"2024-09-12T02:28:22.476750+0000","last_undegraded":"2024-09-12T02:28:22.476750+0000","last_fullsized":"2024-09-12T02:28:22.476750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471707+0000","last_change":"2024-09-12T02:28:22.467912+0000","last_active":"2024-09-12T02:28:22.471707+0000","last_peered":"2024-09-12T02:28:22.471707+0000","last_clean":"2024-09-12T02:28:22.471707+0000","last_became_active":"2024-09-12T02:28:22.467615+0000","last_became_peered":"2024-09-12T02:28:22.467615+0000","last_unstale":"2024-09-12T02:28:22.471707+0000","last_undegraded":"2024-09-12T02:28:22.471707+0000","last_fullsized":"2024-09-12T02:28:22.471707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476846+0000","last_change":"2024-09-12T02:28:21.462426+0000","last_active":"2024-09-12T02:28:22.476846+0000","last_peered":"2024-09-12T02:28:22.476846+0000","last_clean":"2024-09-12T02:28:22.476846+0000","last_became_active":"2024-09-12T02:28:21.462107+0000","last_became_peered":"2024-09-12T02:28:21.462107+0000","last_unstale":"2024-09-12T02:28:22.476846+0000","last_undegraded":"2024-09-12T02:28:22.476846+0000","last_fullsized":"2024-09-12T02:28:22.476846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:08.206286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.473779+0000","last_change":"2024-09-12T02:28:22.468618+0000","last_active":"2024-09-12T02:28:22.473779+0000","last_peered":"2024-09-12T02:28:22.473779+0000","last_clean":"2024-09-12T02:28:22.473779+0000","last_became_active":"2024-09-12T02:28:22.468188+0000","last_became_peered":"2024-09-12T02:28:22.468188+0000","last_unstale":"2024-09-12T02:28:22.473779+0000","last_undegraded":"2024-09-12T02:28:22.473779+0000","last_fullsized":"2024-09-12T02:28:22.473779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.464145+0000","last_change":"2024-09-12T02:28:21.462214+0000","last_active":"2024-09-12T02:28:21.464145+0000","last_peered":"2024-09-12T02:28:21.464145+0000","last_clean":"2024-09-12T02:28:21.464145+0000","last_became_active":"2024-09-12T02:28:21.461911+0000","last_became_peered":"2024-09-12T02:28:21.461911+0000","last_unstale":"2024-09-12T02:28:21.464145+0000","last_undegraded":"2024-09-12T02:28:21.464145+0000","last_fullsized":"2024-09-12T02:28:21.464145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445229+0000","last_change":"2024-09-12T02:28:21.445229+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445229+0000","last_undegraded":"2024-09-12T02:28:21.445229+0000","last_fullsized":"2024-09-12T02:28:21.445229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477547+0000","last_change":"2024-09-12T02:28:21.461271+0000","last_active":"2024-09-12T02:28:22.477547+0000","last_peered":"2024-09-12T02:28:22.477547+0000","last_clean":"2024-09-12T02:28:22.477547+0000","last_became_active":"2024-09-12T02:28:21.460986+0000","last_became_peered":"2024-09-12T02:28:21.460986+0000","last_unstale":"2024-09-12T02:28:22.477547+0000","last_undegraded":"2024-09-12T02:28:22.477547+0000","last_fullsized":"2024-09-12T02:28:22.477547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:58.924252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:28:25.727 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:28:25.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.862+0000 7f3c53a5e640 1 Processor -- start 2024-09-12T02:28:25.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.862+0000 7f3c53a5e640 1 -- start start 2024-09-12T02:28:25.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c53a5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c53a5e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c06e240 con 0x7f3c4c06c320 2024-09-12T02:28:25.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c53a5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c160380 con 0x7f3c4c15fe70 2024-09-12T02:28:25.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c53a5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c156d30 con 0x7f3c4c156950 2024-09-12T02:28:25.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c51ffb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3c4c06c320 0x7f3c4c0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56154/0 (socket says 172.21.15.181:56154) 2024-09-12T02:28:25.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c51ffb640 1 -- 172.21.15.181:0/3165063624 learned_addr learned my addr 172.21.15.181:0/3165063624 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c517fa640 1 --2- 172.21.15.181:0/3165063624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42927879 0 0) 0x7f3c44001490 con 0x7f3c4c06c320 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c38003520 con 0x7f3c4c06c320 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326932417 0 0) 0x7f3c4c160380 con 0x7f3c4c15fe70 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c44001490 con 0x7f3c4c15fe70 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c517fa640 1 -- 172.21.15.181:0/3165063624 >> v1:172.21.15.204:6789/0 conn(0x7f3c4c15fe70 legacy=0x7f3c4c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c517fa640 1 -- 172.21.15.181:0/3165063624 >> v1:172.21.15.181:6789/0 conn(0x7f3c4c06c320 legacy=0x7f3c4c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 715845116 0 0) 0x7f3c38003520 con 0x7f3c4c06c320 2024-09-12T02:28:25.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.863+0000 7f3c517fa640 1 -- 172.21.15.181:0/3165063624 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c160660 con 0x7f3c4c156950 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.864+0000 7f3c517fa640 1 --2- 172.21.15.181:0/3165063624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c15d140 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c480097d0 tx=0x7f3c4802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7774e9d55babf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.864+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48037070 con 0x7f3c4c156950 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.864+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4802ac30 con 0x7f3c4c156950 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.864+0000 7f3c43fff640 1 -- 172.21.15.181:0/3165063624 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44001bc0 con 0x7f3c4c156950 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.865+0000 7f3c53a5e640 1 -- 172.21.15.181:0/3165063624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 msgr2=0x7f3c4c15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.865+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/3165063624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c15d140 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c480097d0 tx=0x7f3c4802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.865+0000 7f3c53a5e640 1 -- 172.21.15.181:0/3165063624 shutdown_connections 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.865+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/3165063624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c15d140 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.865+0000 7f3c53a5e640 1 -- 172.21.15.181:0/3165063624 >> 172.21.15.181:0/3165063624 conn(0x7f3c4c067b30 msgr2=0x7f3c4c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.865+0000 7f3c53a5e640 1 -- 172.21.15.181:0/3165063624 shutdown_connections 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.865+0000 7f3c53a5e640 1 -- 172.21.15.181:0/3165063624 wait complete. 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.866+0000 7f3c53a5e640 1 Processor -- start 2024-09-12T02:28:25.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.866+0000 7f3c53a5e640 1 -- start start 2024-09-12T02:28:25.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c53a5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c4c06c320 0x7f3c4c073af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c53a5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c53a5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c15fe70 0x7f3c4c0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c53a5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c0cede0 con 0x7f3c4c06c320 2024-09-12T02:28:25.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c53a5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c160c20 con 0x7f3c4c15fe70 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c53a5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c0cef60 con 0x7f3c4c156950 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c4c06c320 0x7f3c4c073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c4c06c320 0x7f3c4c073af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40090/0 (socket says 172.21.15.181:40090) 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 -- 172.21.15.181:0/243704039 learned_addr learned my addr 172.21.15.181:0/243704039 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 -- 172.21.15.181:0/243704039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 msgr2=0x7f3c4c144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 -- 172.21.15.181:0/243704039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c15fe70 msgr2=0x7f3c4c0b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c15fe70 0x7f3c4c0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 -- 172.21.15.181:0/243704039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c0b13c0 con 0x7f3c4c06c320 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c517fa640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c4c06c320 0x7f3c4c073af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3c480098f0 tx=0x7f3c480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.867+0000 7f3c41ffb640 1 -- 172.21.15.181:0/243704039 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48042020 con 0x7f3c4c06c320 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.868+0000 7f3c41ffb640 1 -- 172.21.15.181:0/243704039 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4803d670 con 0x7f3c4c06c320 2024-09-12T02:28:25.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.868+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c150ef0 con 0x7f3c4c06c320 2024-09-12T02:28:25.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.868+0000 7f3c41ffb640 1 -- 172.21.15.181:0/243704039 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48037040 con 0x7f3c4c06c320 2024-09-12T02:28:25.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.868+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c152910 con 0x7f3c4c06c320 2024-09-12T02:28:25.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.869+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c15d140 con 0x7f3c4c06c320 2024-09-12T02:28:25.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.869+0000 7f3c41ffb640 1 -- 172.21.15.181:0/243704039 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c48045020 con 0x7f3c4c06c320 2024-09-12T02:28:25.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.870+0000 7f3c41ffb640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c3006be30 0x7f3c3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.870+0000 7f3c41ffb640 1 -- 172.21.15.181:0/243704039 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c480ab680 con 0x7f3c4c06c320 2024-09-12T02:28:25.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.870+0000 7f3c50ff9640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c3006be30 0x7f3c3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.870+0000 7f3c50ff9640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c3006be30 0x7f3c3006e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0010e0 tx=0x7f3c3c007950 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:25.874+0000 7f3c41ffb640 1 -- 172.21.15.181:0/243704039 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c4804c030 con 0x7f3c4c06c320 2024-09-12T02:28:26.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.037+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c4c0b0c60 con 0x7f3c3006be30 2024-09-12T02:28:26.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.043+0000 7f3c41ffb640 1 -- 172.21.15.181:0/243704039 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250815 (secure 0 0 0) 0x7f3c4c0b0c60 con 0x7f3c3006be30 2024-09-12T02:28:26.045 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:26.046 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:28:26.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c3006be30 msgr2=0x7f3c3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c3006be30 0x7f3c3006e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0010e0 tx=0x7f3c3c007950 comp rx=0 tx=0).stop 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c4c06c320 msgr2=0x7f3c4c073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c4c06c320 0x7f3c4c073af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3c480098f0 tx=0x7f3c480046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 shutdown_connections 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c3006be30 0x7f3c3006e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c15fe70 0x7f3c4c0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c4c156950 0x7f3c4c144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 --2- 172.21.15.181:0/243704039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c4c06c320 0x7f3c4c073af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 >> 172.21.15.181:0/243704039 conn(0x7f3c4c067b30 msgr2=0x7f3c4c1551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 shutdown_connections 2024-09-12T02:28:26.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.046+0000 7f3c53a5e640 1 -- 172.21.15.181:0/243704039 wait complete. 2024-09-12T02:28:26.056 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T02:28:25.612469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218840,"kb_used_data":2600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755880,"statfs":{"total":773094113280,"available":772870021120,"internally_reserved":0,"allocated":2662400,"data_stored":1651872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.180410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466895+0000","last_change":"2024-09-12T02:28:22.461189+0000","last_active":"2024-09-12T02:28:22.466895+0000","last_peered":"2024-09-12T02:28:22.466895+0000","last_clean":"2024-09-12T02:28:22.466895+0000","last_became_active":"2024-09-12T02:28:22.460880+0000","last_became_peered":"2024-09-12T02:28:22.460880+0000","last_unstale":"2024-09-12T02:28:22.466895+0000","last_undegraded":"2024-09-12T02:28:22.466895+0000","last_fullsized":"2024-09-12T02:28:22.466895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464423+0000","last_change":"2024-09-12T02:28:22.462152+0000","last_active":"2024-09-12T02:28:22.464423+0000","last_peered":"2024-09-12T02:28:22.464423+0000","last_clean":"2024-09-12T02:28:22.464423+0000","last_became_active":"2024-09-12T02:28:22.461892+0000","last_became_peered":"2024-09-12T02:28:22.461892+0000","last_unstale":"2024-09-12T02:28:22.464423+0000","last_undegraded":"2024-09-12T02:28:22.464423+0000","last_fullsized":"2024-09-12T02:28:22.464423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460940+0000","last_change":"2024-09-12T02:28:22.456793+0000","last_active":"2024-09-12T02:28:22.460940+0000","last_peered":"2024-09-12T02:28:22.460940+0000","last_clean":"2024-09-12T02:28:22.460940+0000","last_became_active":"2024-09-12T02:28:22.456542+0000","last_became_peered":"2024-09-12T02:28:22.456542+0000","last_unstale":"2024-09-12T02:28:22.460940+0000","last_undegraded":"2024-09-12T02:28:22.460940+0000","last_fullsized":"2024-09-12T02:28:22.460940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472493+0000","last_change":"2024-09-12T02:28:22.470469+0000","last_active":"2024-09-12T02:28:22.472493+0000","last_peered":"2024-09-12T02:28:22.472493+0000","last_clean":"2024-09-12T02:28:22.472493+0000","last_became_active":"2024-09-12T02:28:22.470021+0000","last_became_peered":"2024-09-12T02:28:22.470021+0000","last_unstale":"2024-09-12T02:28:22.472493+0000","last_undegraded":"2024-09-12T02:28:22.472493+0000","last_fullsized":"2024-09-12T02:28:22.472493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464005+0000","last_change":"2024-09-12T02:28:22.457601+0000","last_active":"2024-09-12T02:28:22.464005+0000","last_peered":"2024-09-12T02:28:22.464005+0000","last_clean":"2024-09-12T02:28:22.464005+0000","last_became_active":"2024-09-12T02:28:22.454545+0000","last_became_peered":"2024-09-12T02:28:22.454545+0000","last_unstale":"2024-09-12T02:28:22.464005+0000","last_undegraded":"2024-09-12T02:28:22.464005+0000","last_fullsized":"2024-09-12T02:28:22.464005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476329+0000","last_change":"2024-09-12T02:28:22.475342+0000","last_active":"2024-09-12T02:28:22.476329+0000","last_peered":"2024-09-12T02:28:22.476329+0000","last_clean":"2024-09-12T02:28:22.476329+0000","last_became_active":"2024-09-12T02:28:22.475064+0000","last_became_peered":"2024-09-12T02:28:22.475064+0000","last_unstale":"2024-09-12T02:28:22.476329+0000","last_undegraded":"2024-09-12T02:28:22.476329+0000","last_fullsized":"2024-09-12T02:28:22.476329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466857+0000","last_change":"2024-09-12T02:28:22.462932+0000","last_active":"2024-09-12T02:28:22.466857+0000","last_peered":"2024-09-12T02:28:22.466857+0000","last_clean":"2024-09-12T02:28:22.466857+0000","last_became_active":"2024-09-12T02:28:22.462608+0000","last_became_peered":"2024-09-12T02:28:22.462608+0000","last_unstale":"2024-09-12T02:28:22.466857+0000","last_undegraded":"2024-09-12T02:28:22.466857+0000","last_fullsized":"2024-09-12T02:28:22.466857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445684+0000","last_change":"2024-09-12T02:28:21.445684+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445684+0000","last_undegraded":"2024-09-12T02:28:21.445684+0000","last_fullsized":"2024-09-12T02:28:21.445684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468959+0000","last_change":"2024-09-12T02:28:22.464802+0000","last_active":"2024-09-12T02:28:22.468959+0000","last_peered":"2024-09-12T02:28:22.468959+0000","last_clean":"2024-09-12T02:28:22.468959+0000","last_became_active":"2024-09-12T02:28:22.464518+0000","last_became_peered":"2024-09-12T02:28:22.464518+0000","last_unstale":"2024-09-12T02:28:22.468959+0000","last_undegraded":"2024-09-12T02:28:22.468959+0000","last_fullsized":"2024-09-12T02:28:22.468959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472207+0000","last_change":"2024-09-12T02:28:22.467874+0000","last_active":"2024-09-12T02:28:22.472207+0000","last_peered":"2024-09-12T02:28:22.472207+0000","last_clean":"2024-09-12T02:28:22.472207+0000","last_became_active":"2024-09-12T02:28:22.467350+0000","last_became_peered":"2024-09-12T02:28:22.467350+0000","last_unstale":"2024-09-12T02:28:22.472207+0000","last_undegraded":"2024-09-12T02:28:22.472207+0000","last_fullsized":"2024-09-12T02:28:22.472207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472283+0000","last_change":"2024-09-12T02:28:22.468202+0000","last_active":"2024-09-12T02:28:22.472283+0000","last_peered":"2024-09-12T02:28:22.472283+0000","last_clean":"2024-09-12T02:28:22.472283+0000","last_became_active":"2024-09-12T02:28:22.467913+0000","last_became_peered":"2024-09-12T02:28:22.467913+0000","last_unstale":"2024-09-12T02:28:22.472283+0000","last_undegraded":"2024-09-12T02:28:22.472283+0000","last_fullsized":"2024-09-12T02:28:22.472283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466714+0000","last_change":"2024-09-12T02:28:22.460598+0000","last_active":"2024-09-12T02:28:22.466714+0000","last_peered":"2024-09-12T02:28:22.466714+0000","last_clean":"2024-09-12T02:28:22.466714+0000","last_became_active":"2024-09-12T02:28:22.460325+0000","last_became_peered":"2024-09-12T02:28:22.460325+0000","last_unstale":"2024-09-12T02:28:22.466714+0000","last_undegraded":"2024-09-12T02:28:22.466714+0000","last_fullsized":"2024-09-12T02:28:22.466714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445444+0000","last_change":"2024-09-12T02:28:21.445444+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445444+0000","last_undegraded":"2024-09-12T02:28:21.445444+0000","last_fullsized":"2024-09-12T02:28:21.445444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469964+0000","last_change":"2024-09-12T02:28:22.462049+0000","last_active":"2024-09-12T02:28:22.469964+0000","last_peered":"2024-09-12T02:28:22.469964+0000","last_clean":"2024-09-12T02:28:22.469964+0000","last_became_active":"2024-09-12T02:28:22.461571+0000","last_became_peered":"2024-09-12T02:28:22.461571+0000","last_unstale":"2024-09-12T02:28:22.469964+0000","last_undegraded":"2024-09-12T02:28:22.469964+0000","last_fullsized":"2024-09-12T02:28:22.469964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:09.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.465223+0000","last_change":"2024-09-12T02:28:22.463467+0000","last_active":"2024-09-12T02:28:22.465223+0000","last_peered":"2024-09-12T02:28:22.465223+0000","last_clean":"2024-09-12T02:28:22.465223+0000","last_became_active":"2024-09-12T02:28:22.463205+0000","last_became_peered":"2024-09-12T02:28:22.463205+0000","last_unstale":"2024-09-12T02:28:22.465223+0000","last_undegraded":"2024-09-12T02:28:22.465223+0000","last_fullsized":"2024-09-12T02:28:22.465223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476631+0000","last_change":"2024-09-12T02:28:22.475573+0000","last_active":"2024-09-12T02:28:22.476631+0000","last_peered":"2024-09-12T02:28:22.476631+0000","last_clean":"2024-09-12T02:28:22.476631+0000","last_became_active":"2024-09-12T02:28:22.475311+0000","last_became_peered":"2024-09-12T02:28:22.475311+0000","last_unstale":"2024-09-12T02:28:22.476631+0000","last_undegraded":"2024-09-12T02:28:22.476631+0000","last_fullsized":"2024-09-12T02:28:22.476631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471642+0000","last_change":"2024-09-12T02:28:22.468036+0000","last_active":"2024-09-12T02:28:22.471642+0000","last_peered":"2024-09-12T02:28:22.471642+0000","last_clean":"2024-09-12T02:28:22.471642+0000","last_became_active":"2024-09-12T02:28:22.467611+0000","last_became_peered":"2024-09-12T02:28:22.467611+0000","last_unstale":"2024-09-12T02:28:22.471642+0000","last_undegraded":"2024-09-12T02:28:22.471642+0000","last_fullsized":"2024-09-12T02:28:22.471642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441768+0000","last_change":"2024-09-12T02:28:21.441768+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441768+0000","last_undegraded":"2024-09-12T02:28:21.441768+0000","last_fullsized":"2024-09-12T02:28:21.441768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463904+0000","last_change":"2024-09-12T02:28:22.455655+0000","last_active":"2024-09-12T02:28:22.463904+0000","last_peered":"2024-09-12T02:28:22.463904+0000","last_clean":"2024-09-12T02:28:22.463904+0000","last_became_active":"2024-09-12T02:28:22.454802+0000","last_became_peered":"2024-09-12T02:28:22.454802+0000","last_unstale":"2024-09-12T02:28:22.463904+0000","last_undegraded":"2024-09-12T02:28:22.463904+0000","last_fullsized":"2024-09-12T02:28:22.463904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472584+0000","last_change":"2024-09-12T02:28:22.464688+0000","last_active":"2024-09-12T02:28:22.472584+0000","last_peered":"2024-09-12T02:28:22.472584+0000","last_clean":"2024-09-12T02:28:22.472584+0000","last_became_active":"2024-09-12T02:28:22.464285+0000","last_became_peered":"2024-09-12T02:28:22.464285+0000","last_unstale":"2024-09-12T02:28:22.472584+0000","last_undegraded":"2024-09-12T02:28:22.472584+0000","last_fullsized":"2024-09-12T02:28:22.472584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470636+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:22.470636+0000","last_peered":"2024-09-12T02:28:22.470636+0000","last_clean":"2024-09-12T02:28:22.470636+0000","last_became_active":"2024-09-12T02:28:22.464320+0000","last_became_peered":"2024-09-12T02:28:22.464320+0000","last_unstale":"2024-09-12T02:28:22.470636+0000","last_undegraded":"2024-09-12T02:28:22.470636+0000","last_fullsized":"2024-09-12T02:28:22.470636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471607+0000","last_change":"2024-09-12T02:28:22.467576+0000","last_active":"2024-09-12T02:28:22.471607+0000","last_peered":"2024-09-12T02:28:22.471607+0000","last_clean":"2024-09-12T02:28:22.471607+0000","last_became_active":"2024-09-12T02:28:22.467297+0000","last_became_peered":"2024-09-12T02:28:22.467297+0000","last_unstale":"2024-09-12T02:28:22.471607+0000","last_undegraded":"2024-09-12T02:28:22.471607+0000","last_fullsized":"2024-09-12T02:28:22.471607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445576+0000","last_change":"2024-09-12T02:28:21.445576+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445576+0000","last_undegraded":"2024-09-12T02:28:21.445576+0000","last_fullsized":"2024-09-12T02:28:21.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472463+0000","last_change":"2024-09-12T02:28:22.470133+0000","last_active":"2024-09-12T02:28:22.472463+0000","last_peered":"2024-09-12T02:28:22.472463+0000","last_clean":"2024-09-12T02:28:22.472463+0000","last_became_active":"2024-09-12T02:28:22.469748+0000","last_became_peered":"2024-09-12T02:28:22.469748+0000","last_unstale":"2024-09-12T02:28:22.472463+0000","last_undegraded":"2024-09-12T02:28:22.472463+0000","last_fullsized":"2024-09-12T02:28:22.472463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445736+0000","last_change":"2024-09-12T02:28:21.445736+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445736+0000","last_undegraded":"2024-09-12T02:28:21.445736+0000","last_fullsized":"2024-09-12T02:28:21.445736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469678+0000","last_change":"2024-09-12T02:28:22.465019+0000","last_active":"2024-09-12T02:28:22.469678+0000","last_peered":"2024-09-12T02:28:22.469678+0000","last_clean":"2024-09-12T02:28:22.469678+0000","last_became_active":"2024-09-12T02:28:22.464751+0000","last_became_peered":"2024-09-12T02:28:22.464751+0000","last_unstale":"2024-09-12T02:28:22.469678+0000","last_undegraded":"2024-09-12T02:28:22.469678+0000","last_fullsized":"2024-09-12T02:28:22.469678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460624+0000","last_change":"2024-09-12T02:28:22.459615+0000","last_active":"2024-09-12T02:28:22.460624+0000","last_peered":"2024-09-12T02:28:22.460624+0000","last_clean":"2024-09-12T02:28:22.460624+0000","last_became_active":"2024-09-12T02:28:22.459342+0000","last_became_peered":"2024-09-12T02:28:22.459342+0000","last_unstale":"2024-09-12T02:28:22.460624+0000","last_undegraded":"2024-09-12T02:28:22.460624+0000","last_fullsized":"2024-09-12T02:28:22.460624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445619+0000","last_change":"2024-09-12T02:28:21.445619+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445619+0000","last_undegraded":"2024-09-12T02:28:21.445619+0000","last_fullsized":"2024-09-12T02:28:21.445619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470611+0000","last_change":"2024-09-12T02:28:22.464467+0000","last_active":"2024-09-12T02:28:22.470611+0000","last_peered":"2024-09-12T02:28:22.470611+0000","last_clean":"2024-09-12T02:28:22.470611+0000","last_became_active":"2024-09-12T02:28:22.464145+0000","last_became_peered":"2024-09-12T02:28:22.464145+0000","last_unstale":"2024-09-12T02:28:22.470611+0000","last_undegraded":"2024-09-12T02:28:22.470611+0000","last_fullsized":"2024-09-12T02:28:22.470611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472621+0000","last_change":"2024-09-12T02:28:22.470537+0000","last_active":"2024-09-12T02:28:22.472621+0000","last_peered":"2024-09-12T02:28:22.472621+0000","last_clean":"2024-09-12T02:28:22.472621+0000","last_became_active":"2024-09-12T02:28:22.469350+0000","last_became_peered":"2024-09-12T02:28:22.469350+0000","last_unstale":"2024-09-12T02:28:22.472621+0000","last_undegraded":"2024-09-12T02:28:22.472621+0000","last_fullsized":"2024-09-12T02:28:22.472621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441574+0000","last_change":"2024-09-12T02:28:21.441574+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441574+0000","last_undegraded":"2024-09-12T02:28:21.441574+0000","last_fullsized":"2024-09-12T02:28:21.441574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469623+0000","last_change":"2024-09-12T02:28:22.463462+0000","last_active":"2024-09-12T02:28:22.469623+0000","last_peered":"2024-09-12T02:28:22.469623+0000","last_clean":"2024-09-12T02:28:22.469623+0000","last_became_active":"2024-09-12T02:28:22.463170+0000","last_became_peered":"2024-09-12T02:28:22.463170+0000","last_unstale":"2024-09-12T02:28:22.469623+0000","last_undegraded":"2024-09-12T02:28:22.469623+0000","last_fullsized":"2024-09-12T02:28:22.469623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467270+0000","last_change":"2024-09-12T02:28:22.461255+0000","last_active":"2024-09-12T02:28:22.467270+0000","last_peered":"2024-09-12T02:28:22.467270+0000","last_clean":"2024-09-12T02:28:22.467270+0000","last_became_active":"2024-09-12T02:28:22.460994+0000","last_became_peered":"2024-09-12T02:28:22.460994+0000","last_unstale":"2024-09-12T02:28:22.467270+0000","last_undegraded":"2024-09-12T02:28:22.467270+0000","last_fullsized":"2024-09-12T02:28:22.467270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458010+0000","last_change":"2024-09-12T02:28:21.453139+0000","last_active":"2024-09-12T02:28:21.458010+0000","last_peered":"2024-09-12T02:28:21.458010+0000","last_clean":"2024-09-12T02:28:21.458010+0000","last_became_active":"2024-09-12T02:28:21.452853+0000","last_became_peered":"2024-09-12T02:28:21.452853+0000","last_unstale":"2024-09-12T02:28:21.458010+0000","last_undegraded":"2024-09-12T02:28:21.458010+0000","last_fullsized":"2024-09-12T02:28:21.458010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464325+0000","last_change":"2024-09-12T02:28:22.456228+0000","last_active":"2024-09-12T02:28:22.464325+0000","last_peered":"2024-09-12T02:28:22.464325+0000","last_clean":"2024-09-12T02:28:22.464325+0000","last_became_active":"2024-09-12T02:28:22.455958+0000","last_became_peered":"2024-09-12T02:28:22.455958+0000","last_unstale":"2024-09-12T02:28:22.464325+0000","last_undegraded":"2024-09-12T02:28:22.464325+0000","last_fullsized":"2024-09-12T02:28:22.464325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472737+0000","last_change":"2024-09-12T02:28:21.446775+0000","last_active":"2024-09-12T02:28:22.472737+0000","last_peered":"2024-09-12T02:28:22.472737+0000","last_clean":"2024-09-12T02:28:22.472737+0000","last_became_active":"2024-09-12T02:28:21.446028+0000","last_became_peered":"2024-09-12T02:28:21.446028+0000","last_unstale":"2024-09-12T02:28:22.472737+0000","last_undegraded":"2024-09-12T02:28:22.472737+0000","last_fullsized":"2024-09-12T02:28:22.472737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:12.026922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458067+0000","last_change":"2024-09-12T02:28:21.452793+0000","last_active":"2024-09-12T02:28:21.458067+0000","last_peered":"2024-09-12T02:28:21.458067+0000","last_clean":"2024-09-12T02:28:21.458067+0000","last_became_active":"2024-09-12T02:28:21.452354+0000","last_became_peered":"2024-09-12T02:28:21.452354+0000","last_unstale":"2024-09-12T02:28:21.458067+0000","last_undegraded":"2024-09-12T02:28:21.458067+0000","last_fullsized":"2024-09-12T02:28:21.458067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445055+0000","last_change":"2024-09-12T02:28:21.445055+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445055+0000","last_undegraded":"2024-09-12T02:28:21.445055+0000","last_fullsized":"2024-09-12T02:28:21.445055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.458540+0000","last_change":"2024-09-12T02:28:21.454569+0000","last_active":"2024-09-12T02:28:22.458540+0000","last_peered":"2024-09-12T02:28:22.458540+0000","last_clean":"2024-09-12T02:28:22.458540+0000","last_became_active":"2024-09-12T02:28:21.453146+0000","last_became_peered":"2024-09-12T02:28:21.453146+0000","last_unstale":"2024-09-12T02:28:22.458540+0000","last_undegraded":"2024-09-12T02:28:22.458540+0000","last_fullsized":"2024-09-12T02:28:22.458540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460543+0000","last_change":"2024-09-12T02:28:22.458922+0000","last_active":"2024-09-12T02:28:22.460543+0000","last_peered":"2024-09-12T02:28:22.460543+0000","last_clean":"2024-09-12T02:28:22.460543+0000","last_became_active":"2024-09-12T02:28:22.458641+0000","last_became_peered":"2024-09-12T02:28:22.458641+0000","last_unstale":"2024-09-12T02:28:22.460543+0000","last_undegraded":"2024-09-12T02:28:22.460543+0000","last_fullsized":"2024-09-12T02:28:22.460543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455704+0000","last_change":"2024-09-12T02:28:21.455322+0000","last_active":"2024-09-12T02:28:22.455704+0000","last_peered":"2024-09-12T02:28:22.455704+0000","last_clean":"2024-09-12T02:28:22.455704+0000","last_became_active":"2024-09-12T02:28:21.455039+0000","last_became_peered":"2024-09-12T02:28:21.455039+0000","last_unstale":"2024-09-12T02:28:22.455704+0000","last_undegraded":"2024-09-12T02:28:22.455704+0000","last_fullsized":"2024-09-12T02:28:22.455704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471705+0000","last_change":"2024-09-12T02:28:22.467660+0000","last_active":"2024-09-12T02:28:22.471705+0000","last_peered":"2024-09-12T02:28:22.471705+0000","last_clean":"2024-09-12T02:28:22.471705+0000","last_became_active":"2024-09-12T02:28:22.467401+0000","last_became_peered":"2024-09-12T02:28:22.467401+0000","last_unstale":"2024-09-12T02:28:22.471705+0000","last_undegraded":"2024-09-12T02:28:22.471705+0000","last_fullsized":"2024-09-12T02:28:22.471705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459944+0000","last_change":"2024-09-12T02:28:21.456883+0000","last_active":"2024-09-12T02:28:22.459944+0000","last_peered":"2024-09-12T02:28:22.459944+0000","last_clean":"2024-09-12T02:28:22.459944+0000","last_became_active":"2024-09-12T02:28:21.456438+0000","last_became_peered":"2024-09-12T02:28:21.456438+0000","last_unstale":"2024-09-12T02:28:22.459944+0000","last_undegraded":"2024-09-12T02:28:22.459944+0000","last_fullsized":"2024-09-12T02:28:22.459944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471682+0000","last_change":"2024-09-12T02:28:22.467768+0000","last_active":"2024-09-12T02:28:22.471682+0000","last_peered":"2024-09-12T02:28:22.471682+0000","last_clean":"2024-09-12T02:28:22.471682+0000","last_became_active":"2024-09-12T02:28:22.467484+0000","last_became_peered":"2024-09-12T02:28:22.467484+0000","last_unstale":"2024-09-12T02:28:22.471682+0000","last_undegraded":"2024-09-12T02:28:22.471682+0000","last_fullsized":"2024-09-12T02:28:22.471682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476218+0000","last_change":"2024-09-12T02:28:21.453336+0000","last_active":"2024-09-12T02:28:22.476218+0000","last_peered":"2024-09-12T02:28:22.476218+0000","last_clean":"2024-09-12T02:28:22.476218+0000","last_became_active":"2024-09-12T02:28:21.453054+0000","last_became_peered":"2024-09-12T02:28:21.453054+0000","last_unstale":"2024-09-12T02:28:22.476218+0000","last_undegraded":"2024-09-12T02:28:22.476218+0000","last_fullsized":"2024-09-12T02:28:22.476218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467201+0000","last_change":"2024-09-12T02:28:22.462579+0000","last_active":"2024-09-12T02:28:22.467201+0000","last_peered":"2024-09-12T02:28:22.467201+0000","last_clean":"2024-09-12T02:28:22.467201+0000","last_became_active":"2024-09-12T02:28:22.462294+0000","last_became_peered":"2024-09-12T02:28:22.462294+0000","last_unstale":"2024-09-12T02:28:22.467201+0000","last_undegraded":"2024-09-12T02:28:22.467201+0000","last_fullsized":"2024-09-12T02:28:22.467201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.478807+0000","last_change":"2024-09-12T02:28:21.449013+0000","last_active":"2024-09-12T02:28:22.478807+0000","last_peered":"2024-09-12T02:28:22.478807+0000","last_clean":"2024-09-12T02:28:22.478807+0000","last_became_active":"2024-09-12T02:28:21.448493+0000","last_became_peered":"2024-09-12T02:28:21.448493+0000","last_unstale":"2024-09-12T02:28:22.478807+0000","last_undegraded":"2024-09-12T02:28:22.478807+0000","last_fullsized":"2024-09-12T02:28:22.478807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463940+0000","last_change":"2024-09-12T02:28:22.456742+0000","last_active":"2024-09-12T02:28:22.463940+0000","last_peered":"2024-09-12T02:28:22.463940+0000","last_clean":"2024-09-12T02:28:22.463940+0000","last_became_active":"2024-09-12T02:28:22.456477+0000","last_became_peered":"2024-09-12T02:28:22.456477+0000","last_unstale":"2024-09-12T02:28:22.463940+0000","last_undegraded":"2024-09-12T02:28:22.463940+0000","last_fullsized":"2024-09-12T02:28:22.463940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474786+0000","last_change":"2024-09-12T02:28:21.461100+0000","last_active":"2024-09-12T02:28:22.474786+0000","last_peered":"2024-09-12T02:28:22.474786+0000","last_clean":"2024-09-12T02:28:22.474786+0000","last_became_active":"2024-09-12T02:28:21.460785+0000","last_became_peered":"2024-09-12T02:28:21.460785+0000","last_unstale":"2024-09-12T02:28:22.474786+0000","last_undegraded":"2024-09-12T02:28:22.474786+0000","last_fullsized":"2024-09-12T02:28:22.474786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:11.030581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469937+0000","last_change":"2024-09-12T02:28:22.461832+0000","last_active":"2024-09-12T02:28:22.469937+0000","last_peered":"2024-09-12T02:28:22.469937+0000","last_clean":"2024-09-12T02:28:22.469937+0000","last_became_active":"2024-09-12T02:28:22.461223+0000","last_became_peered":"2024-09-12T02:28:22.461223+0000","last_unstale":"2024-09-12T02:28:22.469937+0000","last_undegraded":"2024-09-12T02:28:22.469937+0000","last_fullsized":"2024-09-12T02:28:22.469937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:48.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460521+0000","last_change":"2024-09-12T02:28:21.454178+0000","last_active":"2024-09-12T02:28:22.460521+0000","last_peered":"2024-09-12T02:28:22.460521+0000","last_clean":"2024-09-12T02:28:22.460521+0000","last_became_active":"2024-09-12T02:28:21.453871+0000","last_became_peered":"2024-09-12T02:28:21.453871+0000","last_unstale":"2024-09-12T02:28:22.460521+0000","last_undegraded":"2024-09-12T02:28:22.460521+0000","last_fullsized":"2024-09-12T02:28:22.460521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464025+0000","last_change":"2024-09-12T02:28:22.459853+0000","last_active":"2024-09-12T02:28:22.464025+0000","last_peered":"2024-09-12T02:28:22.464025+0000","last_clean":"2024-09-12T02:28:22.464025+0000","last_became_active":"2024-09-12T02:28:22.459611+0000","last_became_peered":"2024-09-12T02:28:22.459611+0000","last_unstale":"2024-09-12T02:28:22.464025+0000","last_undegraded":"2024-09-12T02:28:22.464025+0000","last_fullsized":"2024-09-12T02:28:22.464025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454995+0000","last_change":"2024-09-12T02:28:21.449223+0000","last_active":"2024-09-12T02:28:22.454995+0000","last_peered":"2024-09-12T02:28:22.454995+0000","last_clean":"2024-09-12T02:28:22.454995+0000","last_became_active":"2024-09-12T02:28:21.448650+0000","last_became_peered":"2024-09-12T02:28:21.448650+0000","last_unstale":"2024-09-12T02:28:22.454995+0000","last_undegraded":"2024-09-12T02:28:22.454995+0000","last_fullsized":"2024-09-12T02:28:22.454995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469646+0000","last_change":"2024-09-12T02:28:22.463479+0000","last_active":"2024-09-12T02:28:22.469646+0000","last_peered":"2024-09-12T02:28:22.469646+0000","last_clean":"2024-09-12T02:28:22.469646+0000","last_became_active":"2024-09-12T02:28:22.463208+0000","last_became_peered":"2024-09-12T02:28:22.463208+0000","last_unstale":"2024-09-12T02:28:22.469646+0000","last_undegraded":"2024-09-12T02:28:22.469646+0000","last_fullsized":"2024-09-12T02:28:22.469646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455931+0000","last_change":"2024-09-12T02:28:21.451427+0000","last_active":"2024-09-12T02:28:21.455931+0000","last_peered":"2024-09-12T02:28:21.455931+0000","last_clean":"2024-09-12T02:28:21.455931+0000","last_became_active":"2024-09-12T02:28:21.451124+0000","last_became_peered":"2024-09-12T02:28:21.451124+0000","last_unstale":"2024-09-12T02:28:21.455931+0000","last_undegraded":"2024-09-12T02:28:21.455931+0000","last_fullsized":"2024-09-12T02:28:21.455931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463744+0000","last_change":"2024-09-12T02:28:22.456047+0000","last_active":"2024-09-12T02:28:22.463744+0000","last_peered":"2024-09-12T02:28:22.463744+0000","last_clean":"2024-09-12T02:28:22.463744+0000","last_became_active":"2024-09-12T02:28:22.455803+0000","last_became_peered":"2024-09-12T02:28:22.455803+0000","last_unstale":"2024-09-12T02:28:22.463744+0000","last_undegraded":"2024-09-12T02:28:22.463744+0000","last_fullsized":"2024-09-12T02:28:22.463744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477262+0000","last_change":"2024-09-12T02:28:21.461510+0000","last_active":"2024-09-12T02:28:22.477262+0000","last_peered":"2024-09-12T02:28:22.477262+0000","last_clean":"2024-09-12T02:28:22.477262+0000","last_became_active":"2024-09-12T02:28:21.461183+0000","last_became_peered":"2024-09-12T02:28:21.461183+0000","last_unstale":"2024-09-12T02:28:22.477262+0000","last_undegraded":"2024-09-12T02:28:22.477262+0000","last_fullsized":"2024-09-12T02:28:22.477262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.909426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463806+0000","last_change":"2024-09-12T02:28:22.459244+0000","last_active":"2024-09-12T02:28:22.463806+0000","last_peered":"2024-09-12T02:28:22.463806+0000","last_clean":"2024-09-12T02:28:22.463806+0000","last_became_active":"2024-09-12T02:28:22.458948+0000","last_became_peered":"2024-09-12T02:28:22.458948+0000","last_unstale":"2024-09-12T02:28:22.463806+0000","last_undegraded":"2024-09-12T02:28:22.463806+0000","last_fullsized":"2024-09-12T02:28:22.463806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450138+0000","last_change":"2024-09-12T02:28:21.448604+0000","last_active":"2024-09-12T02:28:21.450138+0000","last_peered":"2024-09-12T02:28:21.450138+0000","last_clean":"2024-09-12T02:28:21.450138+0000","last_became_active":"2024-09-12T02:28:21.448165+0000","last_became_peered":"2024-09-12T02:28:21.448165+0000","last_unstale":"2024-09-12T02:28:21.450138+0000","last_undegraded":"2024-09-12T02:28:21.450138+0000","last_fullsized":"2024-09-12T02:28:21.450138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:33.333161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463722+0000","last_change":"2024-09-12T02:28:22.458525+0000","last_active":"2024-09-12T02:28:22.463722+0000","last_peered":"2024-09-12T02:28:22.463722+0000","last_clean":"2024-09-12T02:28:22.463722+0000","last_became_active":"2024-09-12T02:28:22.458270+0000","last_became_peered":"2024-09-12T02:28:22.458270+0000","last_unstale":"2024-09-12T02:28:22.463722+0000","last_undegraded":"2024-09-12T02:28:22.463722+0000","last_fullsized":"2024-09-12T02:28:22.463722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.475972+0000","last_change":"2024-09-12T02:28:21.456310+0000","last_active":"2024-09-12T02:28:22.475972+0000","last_peered":"2024-09-12T02:28:22.475972+0000","last_clean":"2024-09-12T02:28:22.475972+0000","last_became_active":"2024-09-12T02:28:21.455875+0000","last_became_peered":"2024-09-12T02:28:21.455875+0000","last_unstale":"2024-09-12T02:28:22.475972+0000","last_undegraded":"2024-09-12T02:28:22.475972+0000","last_fullsized":"2024-09-12T02:28:22.475972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472561+0000","last_change":"2024-09-12T02:28:22.470690+0000","last_active":"2024-09-12T02:28:22.472561+0000","last_peered":"2024-09-12T02:28:22.472561+0000","last_clean":"2024-09-12T02:28:22.472561+0000","last_became_active":"2024-09-12T02:28:22.469379+0000","last_became_peered":"2024-09-12T02:28:22.469379+0000","last_unstale":"2024-09-12T02:28:22.472561+0000","last_undegraded":"2024-09-12T02:28:22.472561+0000","last_fullsized":"2024-09-12T02:28:22.472561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455988+0000","last_change":"2024-09-12T02:28:21.451827+0000","last_active":"2024-09-12T02:28:21.455988+0000","last_peered":"2024-09-12T02:28:21.455988+0000","last_clean":"2024-09-12T02:28:21.455988+0000","last_became_active":"2024-09-12T02:28:21.451567+0000","last_became_peered":"2024-09-12T02:28:21.451567+0000","last_unstale":"2024-09-12T02:28:21.455988+0000","last_undegraded":"2024-09-12T02:28:21.455988+0000","last_fullsized":"2024-09-12T02:28:21.455988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470710+0000","last_change":"2024-09-12T02:28:22.468838+0000","last_active":"2024-09-12T02:28:22.470710+0000","last_peered":"2024-09-12T02:28:22.470710+0000","last_clean":"2024-09-12T02:28:22.470710+0000","last_became_active":"2024-09-12T02:28:22.468221+0000","last_became_peered":"2024-09-12T02:28:22.468221+0000","last_unstale":"2024-09-12T02:28:22.470710+0000","last_undegraded":"2024-09-12T02:28:22.470710+0000","last_fullsized":"2024-09-12T02:28:22.470710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.987815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.449072+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:28:22.449072+0000","last_peered":"2024-09-12T02:28:22.449072+0000","last_clean":"2024-09-12T02:28:22.449072+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:28:22.449072+0000","last_undegraded":"2024-09-12T02:28:22.449072+0000","last_fullsized":"2024-09-12T02:28:22.449072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457174+0000","last_change":"2024-09-12T02:28:21.456961+0000","last_active":"2024-09-12T02:28:22.457174+0000","last_peered":"2024-09-12T02:28:22.457174+0000","last_clean":"2024-09-12T02:28:22.457174+0000","last_became_active":"2024-09-12T02:28:21.456682+0000","last_became_peered":"2024-09-12T02:28:21.456682+0000","last_unstale":"2024-09-12T02:28:22.457174+0000","last_undegraded":"2024-09-12T02:28:22.457174+0000","last_fullsized":"2024-09-12T02:28:22.457174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444080+0000","last_change":"2024-09-12T02:28:21.444080+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444080+0000","last_undegraded":"2024-09-12T02:28:21.444080+0000","last_fullsized":"2024-09-12T02:28:21.444080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.448411+0000","last_change":"2024-09-12T02:28:21.462547+0000","last_active":"2024-09-12T02:28:22.448411+0000","last_peered":"2024-09-12T02:28:22.448411+0000","last_clean":"2024-09-12T02:28:22.448411+0000","last_became_active":"2024-09-12T02:28:21.462186+0000","last_became_peered":"2024-09-12T02:28:21.462186+0000","last_unstale":"2024-09-12T02:28:22.448411+0000","last_undegraded":"2024-09-12T02:28:22.448411+0000","last_fullsized":"2024-09-12T02:28:22.448411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468356+0000","last_change":"2024-09-12T02:28:22.457842+0000","last_active":"2024-09-12T02:28:22.468356+0000","last_peered":"2024-09-12T02:28:22.468356+0000","last_clean":"2024-09-12T02:28:22.468356+0000","last_became_active":"2024-09-12T02:28:22.457001+0000","last_became_peered":"2024-09-12T02:28:22.457001+0000","last_unstale":"2024-09-12T02:28:22.468356+0000","last_undegraded":"2024-09-12T02:28:22.468356+0000","last_fullsized":"2024-09-12T02:28:22.468356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450193+0000","last_change":"2024-09-12T02:28:21.449367+0000","last_active":"2024-09-12T02:28:21.450193+0000","last_peered":"2024-09-12T02:28:21.450193+0000","last_clean":"2024-09-12T02:28:21.450193+0000","last_became_active":"2024-09-12T02:28:21.448265+0000","last_became_peered":"2024-09-12T02:28:21.448265+0000","last_unstale":"2024-09-12T02:28:21.450193+0000","last_undegraded":"2024-09-12T02:28:21.450193+0000","last_fullsized":"2024-09-12T02:28:21.450193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459933+0000","last_change":"2024-09-12T02:28:22.458123+0000","last_active":"2024-09-12T02:28:22.459933+0000","last_peered":"2024-09-12T02:28:22.459933+0000","last_clean":"2024-09-12T02:28:22.459933+0000","last_became_active":"2024-09-12T02:28:22.457250+0000","last_became_peered":"2024-09-12T02:28:22.457250+0000","last_unstale":"2024-09-12T02:28:22.459933+0000","last_undegraded":"2024-09-12T02:28:22.459933+0000","last_fullsized":"2024-09-12T02:28:22.459933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460808+0000","last_change":"2024-09-12T02:28:21.457643+0000","last_active":"2024-09-12T02:28:22.460808+0000","last_peered":"2024-09-12T02:28:22.460808+0000","last_clean":"2024-09-12T02:28:22.460808+0000","last_became_active":"2024-09-12T02:28:21.457340+0000","last_became_peered":"2024-09-12T02:28:21.457340+0000","last_unstale":"2024-09-12T02:28:22.460808+0000","last_undegraded":"2024-09-12T02:28:22.460808+0000","last_fullsized":"2024-09-12T02:28:22.460808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469359+0000","last_change":"2024-09-12T02:28:22.466165+0000","last_active":"2024-09-12T02:28:22.469359+0000","last_peered":"2024-09-12T02:28:22.469359+0000","last_clean":"2024-09-12T02:28:22.469359+0000","last_became_active":"2024-09-12T02:28:22.465870+0000","last_became_peered":"2024-09-12T02:28:22.465870+0000","last_unstale":"2024-09-12T02:28:22.469359+0000","last_undegraded":"2024-09-12T02:28:22.469359+0000","last_fullsized":"2024-09-12T02:28:22.469359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455220+0000","last_change":"2024-09-12T02:28:21.461428+0000","last_active":"2024-09-12T02:28:22.455220+0000","last_peered":"2024-09-12T02:28:22.455220+0000","last_clean":"2024-09-12T02:28:22.455220+0000","last_became_active":"2024-09-12T02:28:21.461117+0000","last_became_peered":"2024-09-12T02:28:21.461117+0000","last_unstale":"2024-09-12T02:28:22.455220+0000","last_undegraded":"2024-09-12T02:28:22.455220+0000","last_fullsized":"2024-09-12T02:28:22.455220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472581+0000","last_change":"2024-09-12T02:28:22.470508+0000","last_active":"2024-09-12T02:28:22.472581+0000","last_peered":"2024-09-12T02:28:22.472581+0000","last_clean":"2024-09-12T02:28:22.472581+0000","last_became_active":"2024-09-12T02:28:22.470220+0000","last_became_peered":"2024-09-12T02:28:22.470220+0000","last_unstale":"2024-09-12T02:28:22.472581+0000","last_undegraded":"2024-09-12T02:28:22.472581+0000","last_fullsized":"2024-09-12T02:28:22.472581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.450227+0000","last_change":"2024-09-12T02:28:21.461899+0000","last_active":"2024-09-12T02:28:22.450227+0000","last_peered":"2024-09-12T02:28:22.450227+0000","last_clean":"2024-09-12T02:28:22.450227+0000","last_became_active":"2024-09-12T02:28:21.461616+0000","last_became_peered":"2024-09-12T02:28:21.461616+0000","last_unstale":"2024-09-12T02:28:22.450227+0000","last_undegraded":"2024-09-12T02:28:22.450227+0000","last_fullsized":"2024-09-12T02:28:22.450227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:55.870005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460282+0000","last_change":"2024-09-12T02:28:22.458683+0000","last_active":"2024-09-12T02:28:22.460282+0000","last_peered":"2024-09-12T02:28:22.460282+0000","last_clean":"2024-09-12T02:28:22.460282+0000","last_became_active":"2024-09-12T02:28:22.458413+0000","last_became_peered":"2024-09-12T02:28:22.458413+0000","last_unstale":"2024-09-12T02:28:22.460282+0000","last_undegraded":"2024-09-12T02:28:22.460282+0000","last_fullsized":"2024-09-12T02:28:22.460282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455432+0000","last_change":"2024-09-12T02:28:21.455450+0000","last_active":"2024-09-12T02:28:22.455432+0000","last_peered":"2024-09-12T02:28:22.455432+0000","last_clean":"2024-09-12T02:28:22.455432+0000","last_became_active":"2024-09-12T02:28:21.455128+0000","last_became_peered":"2024-09-12T02:28:21.455128+0000","last_unstale":"2024-09-12T02:28:22.455432+0000","last_undegraded":"2024-09-12T02:28:22.455432+0000","last_fullsized":"2024-09-12T02:28:22.455432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444057+0000","last_change":"2024-09-12T02:28:21.444057+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444057+0000","last_undegraded":"2024-09-12T02:28:21.444057+0000","last_fullsized":"2024-09-12T02:28:21.444057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474150+0000","last_change":"2024-09-12T02:28:21.457754+0000","last_active":"2024-09-12T02:28:22.474150+0000","last_peered":"2024-09-12T02:28:22.474150+0000","last_clean":"2024-09-12T02:28:22.474150+0000","last_became_active":"2024-09-12T02:28:21.457443+0000","last_became_peered":"2024-09-12T02:28:21.457443+0000","last_unstale":"2024-09-12T02:28:22.474150+0000","last_undegraded":"2024-09-12T02:28:22.474150+0000","last_fullsized":"2024-09-12T02:28:22.474150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470384+0000","last_change":"2024-09-12T02:28:22.463795+0000","last_active":"2024-09-12T02:28:22.470384+0000","last_peered":"2024-09-12T02:28:22.470384+0000","last_clean":"2024-09-12T02:28:22.470384+0000","last_became_active":"2024-09-12T02:28:22.463408+0000","last_became_peered":"2024-09-12T02:28:22.463408+0000","last_unstale":"2024-09-12T02:28:22.470384+0000","last_undegraded":"2024-09-12T02:28:22.470384+0000","last_fullsized":"2024-09-12T02:28:22.470384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.451656+0000","last_change":"2024-09-12T02:28:21.462250+0000","last_active":"2024-09-12T02:28:22.451656+0000","last_peered":"2024-09-12T02:28:22.451656+0000","last_clean":"2024-09-12T02:28:22.451656+0000","last_became_active":"2024-09-12T02:28:21.461734+0000","last_became_peered":"2024-09-12T02:28:21.461734+0000","last_unstale":"2024-09-12T02:28:22.451656+0000","last_undegraded":"2024-09-12T02:28:22.451656+0000","last_fullsized":"2024-09-12T02:28:22.451656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:27.705966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463201+0000","last_change":"2024-09-12T02:28:22.459098+0000","last_active":"2024-09-12T02:28:22.463201+0000","last_peered":"2024-09-12T02:28:22.463201+0000","last_clean":"2024-09-12T02:28:22.463201+0000","last_became_active":"2024-09-12T02:28:22.457658+0000","last_became_peered":"2024-09-12T02:28:22.457658+0000","last_unstale":"2024-09-12T02:28:22.463201+0000","last_undegraded":"2024-09-12T02:28:22.463201+0000","last_fullsized":"2024-09-12T02:28:22.463201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.035027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454312+0000","last_change":"2024-09-12T02:28:21.457547+0000","last_active":"2024-09-12T02:28:22.454312+0000","last_peered":"2024-09-12T02:28:22.454312+0000","last_clean":"2024-09-12T02:28:22.454312+0000","last_became_active":"2024-09-12T02:28:21.457263+0000","last_became_peered":"2024-09-12T02:28:21.457263+0000","last_unstale":"2024-09-12T02:28:22.454312+0000","last_undegraded":"2024-09-12T02:28:22.454312+0000","last_fullsized":"2024-09-12T02:28:22.454312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.443679+0000","last_change":"2024-09-12T02:28:21.443679+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.443679+0000","last_undegraded":"2024-09-12T02:28:21.443679+0000","last_fullsized":"2024-09-12T02:28:21.443679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457445+0000","last_change":"2024-09-12T02:28:21.454638+0000","last_active":"2024-09-12T02:28:22.457445+0000","last_peered":"2024-09-12T02:28:22.457445+0000","last_clean":"2024-09-12T02:28:22.457445+0000","last_became_active":"2024-09-12T02:28:21.454339+0000","last_became_peered":"2024-09-12T02:28:21.454339+0000","last_unstale":"2024-09-12T02:28:22.457445+0000","last_undegraded":"2024-09-12T02:28:22.457445+0000","last_fullsized":"2024-09-12T02:28:22.457445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444408+0000","last_change":"2024-09-12T02:28:21.444408+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444408+0000","last_undegraded":"2024-09-12T02:28:21.444408+0000","last_fullsized":"2024-09-12T02:28:21.444408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476692+0000","last_change":"2024-09-12T02:28:21.462703+0000","last_active":"2024-09-12T02:28:22.476692+0000","last_peered":"2024-09-12T02:28:22.476692+0000","last_clean":"2024-09-12T02:28:22.476692+0000","last_became_active":"2024-09-12T02:28:21.462354+0000","last_became_peered":"2024-09-12T02:28:21.462354+0000","last_unstale":"2024-09-12T02:28:22.476692+0000","last_undegraded":"2024-09-12T02:28:22.476692+0000","last_fullsized":"2024-09-12T02:28:22.476692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:45.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469663+0000","last_change":"2024-09-12T02:28:22.465703+0000","last_active":"2024-09-12T02:28:22.469663+0000","last_peered":"2024-09-12T02:28:22.469663+0000","last_clean":"2024-09-12T02:28:22.469663+0000","last_became_active":"2024-09-12T02:28:22.465439+0000","last_became_peered":"2024-09-12T02:28:22.465439+0000","last_unstale":"2024-09-12T02:28:22.469663+0000","last_undegraded":"2024-09-12T02:28:22.469663+0000","last_fullsized":"2024-09-12T02:28:22.469663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470400+0000","last_change":"2024-09-12T02:28:22.464376+0000","last_active":"2024-09-12T02:28:22.470400+0000","last_peered":"2024-09-12T02:28:22.470400+0000","last_clean":"2024-09-12T02:28:22.470400+0000","last_became_active":"2024-09-12T02:28:22.464058+0000","last_became_peered":"2024-09-12T02:28:22.464058+0000","last_unstale":"2024-09-12T02:28:22.470400+0000","last_undegraded":"2024-09-12T02:28:22.470400+0000","last_fullsized":"2024-09-12T02:28:22.470400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476750+0000","last_change":"2024-09-12T02:28:21.459499+0000","last_active":"2024-09-12T02:28:22.476750+0000","last_peered":"2024-09-12T02:28:22.476750+0000","last_clean":"2024-09-12T02:28:22.476750+0000","last_became_active":"2024-09-12T02:28:21.459190+0000","last_became_peered":"2024-09-12T02:28:21.459190+0000","last_unstale":"2024-09-12T02:28:22.476750+0000","last_undegraded":"2024-09-12T02:28:22.476750+0000","last_fullsized":"2024-09-12T02:28:22.476750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471707+0000","last_change":"2024-09-12T02:28:22.467912+0000","last_active":"2024-09-12T02:28:22.471707+0000","last_peered":"2024-09-12T02:28:22.471707+0000","last_clean":"2024-09-12T02:28:22.471707+0000","last_became_active":"2024-09-12T02:28:22.467615+0000","last_became_peered":"2024-09-12T02:28:22.467615+0000","last_unstale":"2024-09-12T02:28:22.471707+0000","last_undegraded":"2024-09-12T02:28:22.471707+0000","last_fullsized":"2024-09-12T02:28:22.471707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476846+0000","last_change":"2024-09-12T02:28:21.462426+0000","last_active":"2024-09-12T02:28:22.476846+0000","last_peered":"2024-09-12T02:28:22.476846+0000","last_clean":"2024-09-12T02:28:22.476846+0000","last_became_active":"2024-09-12T02:28:21.462107+0000","last_became_peered":"2024-09-12T02:28:21.462107+0000","last_unstale":"2024-09-12T02:28:22.476846+0000","last_undegraded":"2024-09-12T02:28:22.476846+0000","last_fullsized":"2024-09-12T02:28:22.476846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:08.206286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.473779+0000","last_change":"2024-09-12T02:28:22.468618+0000","last_active":"2024-09-12T02:28:22.473779+0000","last_peered":"2024-09-12T02:28:22.473779+0000","last_clean":"2024-09-12T02:28:22.473779+0000","last_became_active":"2024-09-12T02:28:22.468188+0000","last_became_peered":"2024-09-12T02:28:22.468188+0000","last_unstale":"2024-09-12T02:28:22.473779+0000","last_undegraded":"2024-09-12T02:28:22.473779+0000","last_fullsized":"2024-09-12T02:28:22.473779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.464145+0000","last_change":"2024-09-12T02:28:21.462214+0000","last_active":"2024-09-12T02:28:21.464145+0000","last_peered":"2024-09-12T02:28:21.464145+0000","last_clean":"2024-09-12T02:28:21.464145+0000","last_became_active":"2024-09-12T02:28:21.461911+0000","last_became_peered":"2024-09-12T02:28:21.461911+0000","last_unstale":"2024-09-12T02:28:21.464145+0000","last_undegraded":"2024-09-12T02:28:21.464145+0000","last_fullsized":"2024-09-12T02:28:21.464145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445229+0000","last_change":"2024-09-12T02:28:21.445229+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445229+0000","last_undegraded":"2024-09-12T02:28:21.445229+0000","last_fullsized":"2024-09-12T02:28:21.445229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477547+0000","last_change":"2024-09-12T02:28:21.461271+0000","last_active":"2024-09-12T02:28:22.477547+0000","last_peered":"2024-09-12T02:28:22.477547+0000","last_clean":"2024-09-12T02:28:22.477547+0000","last_became_active":"2024-09-12T02:28:21.460986+0000","last_became_peered":"2024-09-12T02:28:21.460986+0000","last_unstale":"2024-09-12T02:28:22.477547+0000","last_undegraded":"2024-09-12T02:28:22.477547+0000","last_fullsized":"2024-09-12T02:28:22.477547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:58.924252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:28:26.060 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-12T02:28:26.060 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.445684+0000', 'last_change': '2024-09-12T02:28:21.445684+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.445684+0000', 'last_undegraded': '2024-09-12T02:28:21.445684+0000', 'last_fullsized': '2024-09-12T02:28:21.445684+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.445444+0000', 'last_change': '2024-09-12T02:28:21.445444+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.445444+0000', 'last_undegraded': '2024-09-12T02:28:21.445444+0000', 'last_fullsized': '2024-09-12T02:28:21.445444+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.441768+0000', 'last_change': '2024-09-12T02:28:21.441768+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.441768+0000', 'last_undegraded': '2024-09-12T02:28:21.441768+0000', 'last_fullsized': '2024-09-12T02:28:21.441768+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.445576+0000', 'last_change': '2024-09-12T02:28:21.445576+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.445576+0000', 'last_undegraded': '2024-09-12T02:28:21.445576+0000', 'last_fullsized': '2024-09-12T02:28:21.445576+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.445736+0000', 'last_change': '2024-09-12T02:28:21.445736+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.445736+0000', 'last_undegraded': '2024-09-12T02:28:21.445736+0000', 'last_fullsized': '2024-09-12T02:28:21.445736+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-12T02:28:26.061 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.445619+0000', 'last_change': '2024-09-12T02:28:21.445619+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.445619+0000', 'last_undegraded': '2024-09-12T02:28:21.445619+0000', 'last_fullsized': '2024-09-12T02:28:21.445619+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.441574+0000', 'last_change': '2024-09-12T02:28:21.441574+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.441574+0000', 'last_undegraded': '2024-09-12T02:28:21.441574+0000', 'last_fullsized': '2024-09-12T02:28:21.441574+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.445055+0000', 'last_change': '2024-09-12T02:28:21.445055+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.445055+0000', 'last_undegraded': '2024-09-12T02:28:21.445055+0000', 'last_fullsized': '2024-09-12T02:28:21.445055+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.444080+0000', 'last_change': '2024-09-12T02:28:21.444080+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.444080+0000', 'last_undegraded': '2024-09-12T02:28:21.444080+0000', 'last_fullsized': '2024-09-12T02:28:21.444080+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.444057+0000', 'last_change': '2024-09-12T02:28:21.444057+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.444057+0000', 'last_undegraded': '2024-09-12T02:28:21.444057+0000', 'last_fullsized': '2024-09-12T02:28:21.444057+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.443679+0000', 'last_change': '2024-09-12T02:28:21.443679+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.443679+0000', 'last_undegraded': '2024-09-12T02:28:21.443679+0000', 'last_fullsized': '2024-09-12T02:28:21.443679+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-12T02:28:26.062 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.444408+0000', 'last_change': '2024-09-12T02:28:21.444408+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.444408+0000', 'last_undegraded': '2024-09-12T02:28:21.444408+0000', 'last_fullsized': '2024-09-12T02:28:21.444408+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.063 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-12T02:28:26.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:28:21.445229+0000', 'last_change': '2024-09-12T02:28:21.445229+0000', 'last_active': '2024-09-12T02:28:21.432019+0000', 'last_peered': '2024-09-12T02:28:21.432019+0000', 'last_clean': '2024-09-12T02:28:21.432019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:28:21.445229+0000', 'last_undegraded': '2024-09-12T02:28:21.445229+0000', 'last_fullsized': '2024-09-12T02:28:21.445229+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'last_clean_scrub_stamp': '2024-09-12T02:28:21.432019+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:28:26.063 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:28:26.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.193+0000 7f7967253640 1 Processor -- start 2024-09-12T02:28:26.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.193+0000 7f7967253640 1 -- start start 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7967253640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015e270 0x7f796015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7967253640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7960072600 0x7f7960072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7967253640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7960160190 con 0x7f796015f320 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7967253640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7960160470 con 0x7f7960072600 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7967253640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7960160750 con 0x7f796015e270 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f79657f0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7960072600 0x7f7960072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7957fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f796015f320 0x7f796015c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:56164/0 (socket says 172.21.15.181:56164) 2024-09-12T02:28:26.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7957fff640 1 -- 172.21.15.181:0/28179325 learned_addr learned my addr 172.21.15.181:0/28179325 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7964fef640 1 --2- 172.21.15.181:0/28179325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015e270 0x7f796015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f79657f0640 1 -- 172.21.15.181:0/28179325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015e270 msgr2=0x7f796015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f79657f0640 1 --2- 172.21.15.181:0/28179325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015e270 0x7f796015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f79657f0640 1 -- 172.21.15.181:0/28179325 >> v1:172.21.15.181:6789/0 conn(0x7f796015f320 legacy=0x7f796015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f79657f0640 1 -- 172.21.15.181:0/28179325 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7960160a30 con 0x7f7960072600 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f79577fe640 1 -- 172.21.15.181:0/28179325 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12757314 0 0) 0x7f7960160190 con 0x7f796015f320 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.194+0000 7f7964fef640 1 --2- 172.21.15.181:0/28179325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015e270 0x7f796015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.195+0000 7f79657f0640 1 --2- 172.21.15.181:0/28179325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7960072600 0x7f7960072a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7958009d90 tx=0x7f795802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8b44e40e85a72b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.195+0000 7f79577fe640 1 -- 172.21.15.181:0/28179325 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958007740 con 0x7f7960072600 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.195+0000 7f79577fe640 1 -- 172.21.15.181:0/28179325 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79580078e0 con 0x7f7960072600 2024-09-12T02:28:26.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.195+0000 7f79577fe640 1 -- 172.21.15.181:0/28179325 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958007cb0 con 0x7f7960072600 2024-09-12T02:28:26.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 -- 172.21.15.181:0/28179325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7960072600 msgr2=0x7f7960072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 --2- 172.21.15.181:0/28179325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7960072600 0x7f7960072a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7958009d90 tx=0x7f795802a6f0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 -- 172.21.15.181:0/28179325 shutdown_connections 2024-09-12T02:28:26.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 --2- 172.21.15.181:0/28179325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7960072600 0x7f7960072a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 --2- 172.21.15.181:0/28179325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015e270 0x7f796015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 -- 172.21.15.181:0/28179325 >> 172.21.15.181:0/28179325 conn(0x7f796006cd20 msgr2=0x7f796006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:26.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 -- 172.21.15.181:0/28179325 shutdown_connections 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.196+0000 7f7967253640 1 -- 172.21.15.181:0/28179325 wait complete. 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.197+0000 7f7967253640 1 Processor -- start 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.197+0000 7f7967253640 1 -- start start 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7967253640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7960072600 0x7f79601f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7967253640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f796015e270 0x7f79600affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7967253640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015f320 0x7f79600cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7967253640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f796015e7d0 con 0x7f796015e270 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7967253640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f796015e650 con 0x7f7960072600 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7967253640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f796015f740 con 0x7f796015f320 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f796015e270 0x7f79600affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f796015e270 0x7f79600affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40112/0 (socket says 172.21.15.181:40112) 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 -- 172.21.15.181:0/2936445621 learned_addr learned my addr 172.21.15.181:0/2936445621 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f79657f0640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015f320 0x7f79600cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7964fef640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7960072600 0x7f79601f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 -- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015f320 msgr2=0x7f79600cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015f320 0x7f79600cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 -- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7960072600 msgr2=0x7f79601f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7960072600 0x7f79601f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 -- 172.21.15.181:0/2936445621 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79600b1340 con 0x7f796015e270 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.198+0000 7f7957fff640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f796015e270 0x7f79600affa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f795000c4a0 tx=0x7f795000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.199+0000 7f79557fa640 1 -- 172.21.15.181:0/2936445621 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950018070 con 0x7f796015e270 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.199+0000 7f79557fa640 1 -- 172.21.15.181:0/2936445621 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79500074e0 con 0x7f796015e270 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.199+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79600b1620 con 0x7f796015e270 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.199+0000 7f79557fa640 1 -- 172.21.15.181:0/2936445621 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950004a20 con 0x7f796015e270 2024-09-12T02:28:26.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.199+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79600b1be0 con 0x7f796015e270 2024-09-12T02:28:26.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.200+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796015ca70 con 0x7f796015e270 2024-09-12T02:28:26.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.200+0000 7f79557fa640 1 -- 172.21.15.181:0/2936445621 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f795001b070 con 0x7f796015e270 2024-09-12T02:28:26.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.201+0000 7f79557fa640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f794c06be30 0x7f794c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.201+0000 7f7964fef640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f794c06be30 0x7f794c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.201+0000 7f79557fa640 1 -- 172.21.15.181:0/2936445621 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f795008a100 con 0x7f796015e270 2024-09-12T02:28:26.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.201+0000 7f7964fef640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f794c06be30 0x7f794c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79601f72c0 tx=0x7f795c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:26.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.205+0000 7f79557fa640 1 -- 172.21.15.181:0/2936445621 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7950058460 con 0x7f796015e270 2024-09-12T02:28:26.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.433+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f79600d0db0 con 0x7f796015e270 2024-09-12T02:28:26.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.434+0000 7f79557fa640 1 -- 172.21.15.181:0/2936445621 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1138 (secure 0 0 0) 0x7f795005c760 con 0x7f796015e270 2024-09-12T02:28:26.435 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:26.435 INFO:teuthology.orchestra.run.smithi181.stdout:{"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726108091,"num_in_osds":8,"osd_in_since":1726108081,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":84},{"state_name":"creating+peering","count":13}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592778,"bytes_used":224092160,"bytes_avail":772870021120,"bytes_total":773094113280,"inactive_pgs_ratio":0.1340206116437912,"write_bytes_sec":3583,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4284}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T02:27:59.517050+0000","services":{}},"progress_events":{}} 2024-09-12T02:28:26.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f794c06be30 msgr2=0x7f794c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f794c06be30 0x7f794c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79601f72c0 tx=0x7f795c008040 comp rx=0 tx=0).stop 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f796015e270 msgr2=0x7f79600affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f796015e270 0x7f79600affa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f795000c4a0 tx=0x7f795000c960 comp rx=0 tx=0).stop 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 shutdown_connections 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f794c06be30 0x7f794c06e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f796015f320 0x7f79600cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f796015e270 0x7f79600affa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 --2- 172.21.15.181:0/2936445621 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7960072600 0x7f79601f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 >> 172.21.15.181:0/2936445621 conn(0x7f796006cd20 msgr2=0x7f79600b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 shutdown_connections 2024-09-12T02:28:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.436+0000 7f7967253640 1 -- 172.21.15.181:0/2936445621 wait complete. 2024-09-12T02:28:26.448 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:28:26.448 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:28:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.546+0000 7fc1501fd640 1 Processor -- start 2024-09-12T02:28:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.546+0000 7fc1501fd640 1 -- start start 2024-09-12T02:28:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc1501fd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc148158c90 0x7fc14806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc1501fd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc14806c150 0x7fc1480b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc1501fd640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14806e3c0 con 0x7fc1480b0610 2024-09-12T02:28:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc1501fd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc14806e170 con 0x7fc148158c90 2024-09-12T02:28:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc1501fd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fc14815fac0 con 0x7fc14806c150 2024-09-12T02:28:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc14df99640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc148158c90 0x7fc14806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc14df99640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc148158c90 0x7fc14806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40122/0 (socket says 172.21.15.181:40122) 2024-09-12T02:28:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc14df99640 1 -- 172.21.15.181:0/757270721 learned_addr learned my addr 172.21.15.181:0/757270721 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc14df99640 1 -- 172.21.15.181:0/757270721 >> v2:172.21.15.204:3300/0 conn(0x7fc14806c150 msgr2=0x7fc1480b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc14df99640 1 --2- 172.21.15.181:0/757270721 >> v2:172.21.15.204:3300/0 conn(0x7fc14806c150 0x7fc1480b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc14df99640 1 -- 172.21.15.181:0/757270721 >> v1:172.21.15.204:6789/0 conn(0x7fc1480b0610 legacy=0x7fc1480d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.547+0000 7fc14df99640 1 -- 172.21.15.181:0/757270721 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14806e6a0 con 0x7fc148158c90 2024-09-12T02:28:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.548+0000 7fc14df99640 1 --2- 172.21.15.181:0/757270721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc14806bc10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1480cd510 tx=0x7fc14002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5acea235fd4f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.548+0000 7fc14cf97640 1 -- 172.21.15.181:0/757270721 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140036070 con 0x7fc148158c90 2024-09-12T02:28:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.548+0000 7fc14cf97640 1 -- 172.21.15.181:0/757270721 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc140031600 con 0x7fc148158c90 2024-09-12T02:28:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.548+0000 7fc14cf97640 1 -- 172.21.15.181:0/757270721 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1400319d0 con 0x7fc148158c90 2024-09-12T02:28:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 -- 172.21.15.181:0/757270721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 msgr2=0x7fc14806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 --2- 172.21.15.181:0/757270721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc14806bc10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1480cd510 tx=0x7fc14002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 -- 172.21.15.181:0/757270721 shutdown_connections 2024-09-12T02:28:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 --2- 172.21.15.181:0/757270721 >> v2:172.21.15.204:3300/0 conn(0x7fc14806c150 0x7fc1480b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 --2- 172.21.15.181:0/757270721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc14806bc10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 -- 172.21.15.181:0/757270721 >> 172.21.15.181:0/757270721 conn(0x7fc148067b30 msgr2=0x7fc14806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 -- 172.21.15.181:0/757270721 shutdown_connections 2024-09-12T02:28:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.549+0000 7fc1501fd640 1 -- 172.21.15.181:0/757270721 wait complete. 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.550+0000 7fc1501fd640 1 Processor -- start 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.550+0000 7fc1501fd640 1 -- start start 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc14806c150 0x7fc14814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1480b0610 0x7fc148151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc148072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1480b0aa0 con 0x7fc148158c90 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc14806ec60 con 0x7fc1480b0610 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc1480b4210 con 0x7fc14806c150 2024-09-12T02:28:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc148072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc148072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40134/0 (socket says 172.21.15.181:40134) 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 -- 172.21.15.181:0/2903491324 learned_addr learned my addr 172.21.15.181:0/2903491324 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14df99640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc14806c150 0x7fc14814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14d798640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1480b0610 0x7fc148151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 -- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc14806c150 msgr2=0x7fc14814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc14806c150 0x7fc14814e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 -- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1480b0610 msgr2=0x7fc148151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1480b0610 0x7fc148151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 -- 172.21.15.181:0/2903491324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1481f7a40 con 0x7fc148158c90 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc14e79a640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc148072090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c3c0 tx=0x7fc13800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1467fc640 1 -- 172.21.15.181:0/2903491324 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc138017070 con 0x7fc148158c90 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1467fc640 1 -- 172.21.15.181:0/2903491324 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1380035f0 con 0x7fc148158c90 2024-09-12T02:28:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1481f7d20 con 0x7fc148158c90 2024-09-12T02:28:26.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1467fc640 1 -- 172.21.15.181:0/2903491324 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1380039e0 con 0x7fc148158c90 2024-09-12T02:28:26.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.551+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1481f82e0 con 0x7fc148158c90 2024-09-12T02:28:26.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.552+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1480b00d0 con 0x7fc148158c90 2024-09-12T02:28:26.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.553+0000 7fc1467fc640 1 -- 172.21.15.181:0/2903491324 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc13801a070 con 0x7fc148158c90 2024-09-12T02:28:26.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.553+0000 7fc1467fc640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:26.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.553+0000 7fc1467fc640 1 -- 172.21.15.181:0/2903491324 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc13808a190 con 0x7fc148158c90 2024-09-12T02:28:26.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.553+0000 7fc14df99640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:26.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.554+0000 7fc14df99640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc13406be30 0x7fc13406e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc140033000 tx=0x7fc140009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:26.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.557+0000 7fc1467fc640 1 -- 172.21.15.181:0/2903491324 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc138058bd0 con 0x7fc148158c90 2024-09-12T02:28:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.719+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1480b14e0 con 0x7fc13406be30 2024-09-12T02:28:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.724+0000 7fc1467fc640 1 -- 172.21.15.181:0/2903491324 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250815 (secure 0 0 0) 0x7fc1480b14e0 con 0x7fc13406be30 2024-09-12T02:28:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:28:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc13406be30 msgr2=0x7fc13406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc13406be30 0x7fc13406e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc140033000 tx=0x7fc140009000 comp rx=0 tx=0).stop 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 msgr2=0x7fc148072090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc148072090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c3c0 tx=0x7fc13800c880 comp rx=0 tx=0).stop 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 shutdown_connections 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1480b0610 0x7fc148151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc148158c90 0x7fc148072090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 --2- 172.21.15.181:0/2903491324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc14806c150 0x7fc14814e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 >> 172.21.15.181:0/2903491324 conn(0x7fc148067b30 msgr2=0x7fc1480b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 shutdown_connections 2024-09-12T02:28:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:26.728+0000 7fc1501fd640 1 -- 172.21.15.181:0/2903491324 wait complete. 2024-09-12T02:28:26.739 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T02:28:25.612469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218840,"kb_used_data":2600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755880,"statfs":{"total":773094113280,"available":772870021120,"internally_reserved":0,"allocated":2662400,"data_stored":1651872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.180410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466895+0000","last_change":"2024-09-12T02:28:22.461189+0000","last_active":"2024-09-12T02:28:22.466895+0000","last_peered":"2024-09-12T02:28:22.466895+0000","last_clean":"2024-09-12T02:28:22.466895+0000","last_became_active":"2024-09-12T02:28:22.460880+0000","last_became_peered":"2024-09-12T02:28:22.460880+0000","last_unstale":"2024-09-12T02:28:22.466895+0000","last_undegraded":"2024-09-12T02:28:22.466895+0000","last_fullsized":"2024-09-12T02:28:22.466895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464423+0000","last_change":"2024-09-12T02:28:22.462152+0000","last_active":"2024-09-12T02:28:22.464423+0000","last_peered":"2024-09-12T02:28:22.464423+0000","last_clean":"2024-09-12T02:28:22.464423+0000","last_became_active":"2024-09-12T02:28:22.461892+0000","last_became_peered":"2024-09-12T02:28:22.461892+0000","last_unstale":"2024-09-12T02:28:22.464423+0000","last_undegraded":"2024-09-12T02:28:22.464423+0000","last_fullsized":"2024-09-12T02:28:22.464423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460940+0000","last_change":"2024-09-12T02:28:22.456793+0000","last_active":"2024-09-12T02:28:22.460940+0000","last_peered":"2024-09-12T02:28:22.460940+0000","last_clean":"2024-09-12T02:28:22.460940+0000","last_became_active":"2024-09-12T02:28:22.456542+0000","last_became_peered":"2024-09-12T02:28:22.456542+0000","last_unstale":"2024-09-12T02:28:22.460940+0000","last_undegraded":"2024-09-12T02:28:22.460940+0000","last_fullsized":"2024-09-12T02:28:22.460940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472493+0000","last_change":"2024-09-12T02:28:22.470469+0000","last_active":"2024-09-12T02:28:22.472493+0000","last_peered":"2024-09-12T02:28:22.472493+0000","last_clean":"2024-09-12T02:28:22.472493+0000","last_became_active":"2024-09-12T02:28:22.470021+0000","last_became_peered":"2024-09-12T02:28:22.470021+0000","last_unstale":"2024-09-12T02:28:22.472493+0000","last_undegraded":"2024-09-12T02:28:22.472493+0000","last_fullsized":"2024-09-12T02:28:22.472493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464005+0000","last_change":"2024-09-12T02:28:22.457601+0000","last_active":"2024-09-12T02:28:22.464005+0000","last_peered":"2024-09-12T02:28:22.464005+0000","last_clean":"2024-09-12T02:28:22.464005+0000","last_became_active":"2024-09-12T02:28:22.454545+0000","last_became_peered":"2024-09-12T02:28:22.454545+0000","last_unstale":"2024-09-12T02:28:22.464005+0000","last_undegraded":"2024-09-12T02:28:22.464005+0000","last_fullsized":"2024-09-12T02:28:22.464005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476329+0000","last_change":"2024-09-12T02:28:22.475342+0000","last_active":"2024-09-12T02:28:22.476329+0000","last_peered":"2024-09-12T02:28:22.476329+0000","last_clean":"2024-09-12T02:28:22.476329+0000","last_became_active":"2024-09-12T02:28:22.475064+0000","last_became_peered":"2024-09-12T02:28:22.475064+0000","last_unstale":"2024-09-12T02:28:22.476329+0000","last_undegraded":"2024-09-12T02:28:22.476329+0000","last_fullsized":"2024-09-12T02:28:22.476329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466857+0000","last_change":"2024-09-12T02:28:22.462932+0000","last_active":"2024-09-12T02:28:22.466857+0000","last_peered":"2024-09-12T02:28:22.466857+0000","last_clean":"2024-09-12T02:28:22.466857+0000","last_became_active":"2024-09-12T02:28:22.462608+0000","last_became_peered":"2024-09-12T02:28:22.462608+0000","last_unstale":"2024-09-12T02:28:22.466857+0000","last_undegraded":"2024-09-12T02:28:22.466857+0000","last_fullsized":"2024-09-12T02:28:22.466857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445684+0000","last_change":"2024-09-12T02:28:21.445684+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445684+0000","last_undegraded":"2024-09-12T02:28:21.445684+0000","last_fullsized":"2024-09-12T02:28:21.445684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468959+0000","last_change":"2024-09-12T02:28:22.464802+0000","last_active":"2024-09-12T02:28:22.468959+0000","last_peered":"2024-09-12T02:28:22.468959+0000","last_clean":"2024-09-12T02:28:22.468959+0000","last_became_active":"2024-09-12T02:28:22.464518+0000","last_became_peered":"2024-09-12T02:28:22.464518+0000","last_unstale":"2024-09-12T02:28:22.468959+0000","last_undegraded":"2024-09-12T02:28:22.468959+0000","last_fullsized":"2024-09-12T02:28:22.468959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472207+0000","last_change":"2024-09-12T02:28:22.467874+0000","last_active":"2024-09-12T02:28:22.472207+0000","last_peered":"2024-09-12T02:28:22.472207+0000","last_clean":"2024-09-12T02:28:22.472207+0000","last_became_active":"2024-09-12T02:28:22.467350+0000","last_became_peered":"2024-09-12T02:28:22.467350+0000","last_unstale":"2024-09-12T02:28:22.472207+0000","last_undegraded":"2024-09-12T02:28:22.472207+0000","last_fullsized":"2024-09-12T02:28:22.472207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472283+0000","last_change":"2024-09-12T02:28:22.468202+0000","last_active":"2024-09-12T02:28:22.472283+0000","last_peered":"2024-09-12T02:28:22.472283+0000","last_clean":"2024-09-12T02:28:22.472283+0000","last_became_active":"2024-09-12T02:28:22.467913+0000","last_became_peered":"2024-09-12T02:28:22.467913+0000","last_unstale":"2024-09-12T02:28:22.472283+0000","last_undegraded":"2024-09-12T02:28:22.472283+0000","last_fullsized":"2024-09-12T02:28:22.472283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.466714+0000","last_change":"2024-09-12T02:28:22.460598+0000","last_active":"2024-09-12T02:28:22.466714+0000","last_peered":"2024-09-12T02:28:22.466714+0000","last_clean":"2024-09-12T02:28:22.466714+0000","last_became_active":"2024-09-12T02:28:22.460325+0000","last_became_peered":"2024-09-12T02:28:22.460325+0000","last_unstale":"2024-09-12T02:28:22.466714+0000","last_undegraded":"2024-09-12T02:28:22.466714+0000","last_fullsized":"2024-09-12T02:28:22.466714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445444+0000","last_change":"2024-09-12T02:28:21.445444+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445444+0000","last_undegraded":"2024-09-12T02:28:21.445444+0000","last_fullsized":"2024-09-12T02:28:21.445444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469964+0000","last_change":"2024-09-12T02:28:22.462049+0000","last_active":"2024-09-12T02:28:22.469964+0000","last_peered":"2024-09-12T02:28:22.469964+0000","last_clean":"2024-09-12T02:28:22.469964+0000","last_became_active":"2024-09-12T02:28:22.461571+0000","last_became_peered":"2024-09-12T02:28:22.461571+0000","last_unstale":"2024-09-12T02:28:22.469964+0000","last_undegraded":"2024-09-12T02:28:22.469964+0000","last_fullsized":"2024-09-12T02:28:22.469964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:09.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.465223+0000","last_change":"2024-09-12T02:28:22.463467+0000","last_active":"2024-09-12T02:28:22.465223+0000","last_peered":"2024-09-12T02:28:22.465223+0000","last_clean":"2024-09-12T02:28:22.465223+0000","last_became_active":"2024-09-12T02:28:22.463205+0000","last_became_peered":"2024-09-12T02:28:22.463205+0000","last_unstale":"2024-09-12T02:28:22.465223+0000","last_undegraded":"2024-09-12T02:28:22.465223+0000","last_fullsized":"2024-09-12T02:28:22.465223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476631+0000","last_change":"2024-09-12T02:28:22.475573+0000","last_active":"2024-09-12T02:28:22.476631+0000","last_peered":"2024-09-12T02:28:22.476631+0000","last_clean":"2024-09-12T02:28:22.476631+0000","last_became_active":"2024-09-12T02:28:22.475311+0000","last_became_peered":"2024-09-12T02:28:22.475311+0000","last_unstale":"2024-09-12T02:28:22.476631+0000","last_undegraded":"2024-09-12T02:28:22.476631+0000","last_fullsized":"2024-09-12T02:28:22.476631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471642+0000","last_change":"2024-09-12T02:28:22.468036+0000","last_active":"2024-09-12T02:28:22.471642+0000","last_peered":"2024-09-12T02:28:22.471642+0000","last_clean":"2024-09-12T02:28:22.471642+0000","last_became_active":"2024-09-12T02:28:22.467611+0000","last_became_peered":"2024-09-12T02:28:22.467611+0000","last_unstale":"2024-09-12T02:28:22.471642+0000","last_undegraded":"2024-09-12T02:28:22.471642+0000","last_fullsized":"2024-09-12T02:28:22.471642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441768+0000","last_change":"2024-09-12T02:28:21.441768+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441768+0000","last_undegraded":"2024-09-12T02:28:21.441768+0000","last_fullsized":"2024-09-12T02:28:21.441768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463904+0000","last_change":"2024-09-12T02:28:22.455655+0000","last_active":"2024-09-12T02:28:22.463904+0000","last_peered":"2024-09-12T02:28:22.463904+0000","last_clean":"2024-09-12T02:28:22.463904+0000","last_became_active":"2024-09-12T02:28:22.454802+0000","last_became_peered":"2024-09-12T02:28:22.454802+0000","last_unstale":"2024-09-12T02:28:22.463904+0000","last_undegraded":"2024-09-12T02:28:22.463904+0000","last_fullsized":"2024-09-12T02:28:22.463904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472584+0000","last_change":"2024-09-12T02:28:22.464688+0000","last_active":"2024-09-12T02:28:22.472584+0000","last_peered":"2024-09-12T02:28:22.472584+0000","last_clean":"2024-09-12T02:28:22.472584+0000","last_became_active":"2024-09-12T02:28:22.464285+0000","last_became_peered":"2024-09-12T02:28:22.464285+0000","last_unstale":"2024-09-12T02:28:22.472584+0000","last_undegraded":"2024-09-12T02:28:22.472584+0000","last_fullsized":"2024-09-12T02:28:22.472584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470636+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:22.470636+0000","last_peered":"2024-09-12T02:28:22.470636+0000","last_clean":"2024-09-12T02:28:22.470636+0000","last_became_active":"2024-09-12T02:28:22.464320+0000","last_became_peered":"2024-09-12T02:28:22.464320+0000","last_unstale":"2024-09-12T02:28:22.470636+0000","last_undegraded":"2024-09-12T02:28:22.470636+0000","last_fullsized":"2024-09-12T02:28:22.470636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471607+0000","last_change":"2024-09-12T02:28:22.467576+0000","last_active":"2024-09-12T02:28:22.471607+0000","last_peered":"2024-09-12T02:28:22.471607+0000","last_clean":"2024-09-12T02:28:22.471607+0000","last_became_active":"2024-09-12T02:28:22.467297+0000","last_became_peered":"2024-09-12T02:28:22.467297+0000","last_unstale":"2024-09-12T02:28:22.471607+0000","last_undegraded":"2024-09-12T02:28:22.471607+0000","last_fullsized":"2024-09-12T02:28:22.471607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445576+0000","last_change":"2024-09-12T02:28:21.445576+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445576+0000","last_undegraded":"2024-09-12T02:28:21.445576+0000","last_fullsized":"2024-09-12T02:28:21.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472463+0000","last_change":"2024-09-12T02:28:22.470133+0000","last_active":"2024-09-12T02:28:22.472463+0000","last_peered":"2024-09-12T02:28:22.472463+0000","last_clean":"2024-09-12T02:28:22.472463+0000","last_became_active":"2024-09-12T02:28:22.469748+0000","last_became_peered":"2024-09-12T02:28:22.469748+0000","last_unstale":"2024-09-12T02:28:22.472463+0000","last_undegraded":"2024-09-12T02:28:22.472463+0000","last_fullsized":"2024-09-12T02:28:22.472463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445736+0000","last_change":"2024-09-12T02:28:21.445736+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445736+0000","last_undegraded":"2024-09-12T02:28:21.445736+0000","last_fullsized":"2024-09-12T02:28:21.445736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469678+0000","last_change":"2024-09-12T02:28:22.465019+0000","last_active":"2024-09-12T02:28:22.469678+0000","last_peered":"2024-09-12T02:28:22.469678+0000","last_clean":"2024-09-12T02:28:22.469678+0000","last_became_active":"2024-09-12T02:28:22.464751+0000","last_became_peered":"2024-09-12T02:28:22.464751+0000","last_unstale":"2024-09-12T02:28:22.469678+0000","last_undegraded":"2024-09-12T02:28:22.469678+0000","last_fullsized":"2024-09-12T02:28:22.469678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460624+0000","last_change":"2024-09-12T02:28:22.459615+0000","last_active":"2024-09-12T02:28:22.460624+0000","last_peered":"2024-09-12T02:28:22.460624+0000","last_clean":"2024-09-12T02:28:22.460624+0000","last_became_active":"2024-09-12T02:28:22.459342+0000","last_became_peered":"2024-09-12T02:28:22.459342+0000","last_unstale":"2024-09-12T02:28:22.460624+0000","last_undegraded":"2024-09-12T02:28:22.460624+0000","last_fullsized":"2024-09-12T02:28:22.460624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:28.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445619+0000","last_change":"2024-09-12T02:28:21.445619+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445619+0000","last_undegraded":"2024-09-12T02:28:21.445619+0000","last_fullsized":"2024-09-12T02:28:21.445619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470611+0000","last_change":"2024-09-12T02:28:22.464467+0000","last_active":"2024-09-12T02:28:22.470611+0000","last_peered":"2024-09-12T02:28:22.470611+0000","last_clean":"2024-09-12T02:28:22.470611+0000","last_became_active":"2024-09-12T02:28:22.464145+0000","last_became_peered":"2024-09-12T02:28:22.464145+0000","last_unstale":"2024-09-12T02:28:22.470611+0000","last_undegraded":"2024-09-12T02:28:22.470611+0000","last_fullsized":"2024-09-12T02:28:22.470611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472621+0000","last_change":"2024-09-12T02:28:22.470537+0000","last_active":"2024-09-12T02:28:22.472621+0000","last_peered":"2024-09-12T02:28:22.472621+0000","last_clean":"2024-09-12T02:28:22.472621+0000","last_became_active":"2024-09-12T02:28:22.469350+0000","last_became_peered":"2024-09-12T02:28:22.469350+0000","last_unstale":"2024-09-12T02:28:22.472621+0000","last_undegraded":"2024-09-12T02:28:22.472621+0000","last_fullsized":"2024-09-12T02:28:22.472621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.441574+0000","last_change":"2024-09-12T02:28:21.441574+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.441574+0000","last_undegraded":"2024-09-12T02:28:21.441574+0000","last_fullsized":"2024-09-12T02:28:21.441574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469623+0000","last_change":"2024-09-12T02:28:22.463462+0000","last_active":"2024-09-12T02:28:22.469623+0000","last_peered":"2024-09-12T02:28:22.469623+0000","last_clean":"2024-09-12T02:28:22.469623+0000","last_became_active":"2024-09-12T02:28:22.463170+0000","last_became_peered":"2024-09-12T02:28:22.463170+0000","last_unstale":"2024-09-12T02:28:22.469623+0000","last_undegraded":"2024-09-12T02:28:22.469623+0000","last_fullsized":"2024-09-12T02:28:22.469623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467270+0000","last_change":"2024-09-12T02:28:22.461255+0000","last_active":"2024-09-12T02:28:22.467270+0000","last_peered":"2024-09-12T02:28:22.467270+0000","last_clean":"2024-09-12T02:28:22.467270+0000","last_became_active":"2024-09-12T02:28:22.460994+0000","last_became_peered":"2024-09-12T02:28:22.460994+0000","last_unstale":"2024-09-12T02:28:22.467270+0000","last_undegraded":"2024-09-12T02:28:22.467270+0000","last_fullsized":"2024-09-12T02:28:22.467270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458010+0000","last_change":"2024-09-12T02:28:21.453139+0000","last_active":"2024-09-12T02:28:21.458010+0000","last_peered":"2024-09-12T02:28:21.458010+0000","last_clean":"2024-09-12T02:28:21.458010+0000","last_became_active":"2024-09-12T02:28:21.452853+0000","last_became_peered":"2024-09-12T02:28:21.452853+0000","last_unstale":"2024-09-12T02:28:21.458010+0000","last_undegraded":"2024-09-12T02:28:21.458010+0000","last_fullsized":"2024-09-12T02:28:21.458010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464325+0000","last_change":"2024-09-12T02:28:22.456228+0000","last_active":"2024-09-12T02:28:22.464325+0000","last_peered":"2024-09-12T02:28:22.464325+0000","last_clean":"2024-09-12T02:28:22.464325+0000","last_became_active":"2024-09-12T02:28:22.455958+0000","last_became_peered":"2024-09-12T02:28:22.455958+0000","last_unstale":"2024-09-12T02:28:22.464325+0000","last_undegraded":"2024-09-12T02:28:22.464325+0000","last_fullsized":"2024-09-12T02:28:22.464325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:13.031368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472737+0000","last_change":"2024-09-12T02:28:21.446775+0000","last_active":"2024-09-12T02:28:22.472737+0000","last_peered":"2024-09-12T02:28:22.472737+0000","last_clean":"2024-09-12T02:28:22.472737+0000","last_became_active":"2024-09-12T02:28:21.446028+0000","last_became_peered":"2024-09-12T02:28:21.446028+0000","last_unstale":"2024-09-12T02:28:22.472737+0000","last_undegraded":"2024-09-12T02:28:22.472737+0000","last_fullsized":"2024-09-12T02:28:22.472737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:12.026922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.458067+0000","last_change":"2024-09-12T02:28:21.452793+0000","last_active":"2024-09-12T02:28:21.458067+0000","last_peered":"2024-09-12T02:28:21.458067+0000","last_clean":"2024-09-12T02:28:21.458067+0000","last_became_active":"2024-09-12T02:28:21.452354+0000","last_became_peered":"2024-09-12T02:28:21.452354+0000","last_unstale":"2024-09-12T02:28:21.458067+0000","last_undegraded":"2024-09-12T02:28:21.458067+0000","last_fullsized":"2024-09-12T02:28:21.458067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445055+0000","last_change":"2024-09-12T02:28:21.445055+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445055+0000","last_undegraded":"2024-09-12T02:28:21.445055+0000","last_fullsized":"2024-09-12T02:28:21.445055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.458540+0000","last_change":"2024-09-12T02:28:21.454569+0000","last_active":"2024-09-12T02:28:22.458540+0000","last_peered":"2024-09-12T02:28:22.458540+0000","last_clean":"2024-09-12T02:28:22.458540+0000","last_became_active":"2024-09-12T02:28:21.453146+0000","last_became_peered":"2024-09-12T02:28:21.453146+0000","last_unstale":"2024-09-12T02:28:22.458540+0000","last_undegraded":"2024-09-12T02:28:22.458540+0000","last_fullsized":"2024-09-12T02:28:22.458540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460543+0000","last_change":"2024-09-12T02:28:22.458922+0000","last_active":"2024-09-12T02:28:22.460543+0000","last_peered":"2024-09-12T02:28:22.460543+0000","last_clean":"2024-09-12T02:28:22.460543+0000","last_became_active":"2024-09-12T02:28:22.458641+0000","last_became_peered":"2024-09-12T02:28:22.458641+0000","last_unstale":"2024-09-12T02:28:22.460543+0000","last_undegraded":"2024-09-12T02:28:22.460543+0000","last_fullsized":"2024-09-12T02:28:22.460543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455704+0000","last_change":"2024-09-12T02:28:21.455322+0000","last_active":"2024-09-12T02:28:22.455704+0000","last_peered":"2024-09-12T02:28:22.455704+0000","last_clean":"2024-09-12T02:28:22.455704+0000","last_became_active":"2024-09-12T02:28:21.455039+0000","last_became_peered":"2024-09-12T02:28:21.455039+0000","last_unstale":"2024-09-12T02:28:22.455704+0000","last_undegraded":"2024-09-12T02:28:22.455704+0000","last_fullsized":"2024-09-12T02:28:22.455704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471705+0000","last_change":"2024-09-12T02:28:22.467660+0000","last_active":"2024-09-12T02:28:22.471705+0000","last_peered":"2024-09-12T02:28:22.471705+0000","last_clean":"2024-09-12T02:28:22.471705+0000","last_became_active":"2024-09-12T02:28:22.467401+0000","last_became_peered":"2024-09-12T02:28:22.467401+0000","last_unstale":"2024-09-12T02:28:22.471705+0000","last_undegraded":"2024-09-12T02:28:22.471705+0000","last_fullsized":"2024-09-12T02:28:22.471705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459944+0000","last_change":"2024-09-12T02:28:21.456883+0000","last_active":"2024-09-12T02:28:22.459944+0000","last_peered":"2024-09-12T02:28:22.459944+0000","last_clean":"2024-09-12T02:28:22.459944+0000","last_became_active":"2024-09-12T02:28:21.456438+0000","last_became_peered":"2024-09-12T02:28:21.456438+0000","last_unstale":"2024-09-12T02:28:22.459944+0000","last_undegraded":"2024-09-12T02:28:22.459944+0000","last_fullsized":"2024-09-12T02:28:22.459944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471682+0000","last_change":"2024-09-12T02:28:22.467768+0000","last_active":"2024-09-12T02:28:22.471682+0000","last_peered":"2024-09-12T02:28:22.471682+0000","last_clean":"2024-09-12T02:28:22.471682+0000","last_became_active":"2024-09-12T02:28:22.467484+0000","last_became_peered":"2024-09-12T02:28:22.467484+0000","last_unstale":"2024-09-12T02:28:22.471682+0000","last_undegraded":"2024-09-12T02:28:22.471682+0000","last_fullsized":"2024-09-12T02:28:22.471682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476218+0000","last_change":"2024-09-12T02:28:21.453336+0000","last_active":"2024-09-12T02:28:22.476218+0000","last_peered":"2024-09-12T02:28:22.476218+0000","last_clean":"2024-09-12T02:28:22.476218+0000","last_became_active":"2024-09-12T02:28:21.453054+0000","last_became_peered":"2024-09-12T02:28:21.453054+0000","last_unstale":"2024-09-12T02:28:22.476218+0000","last_undegraded":"2024-09-12T02:28:22.476218+0000","last_fullsized":"2024-09-12T02:28:22.476218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.467201+0000","last_change":"2024-09-12T02:28:22.462579+0000","last_active":"2024-09-12T02:28:22.467201+0000","last_peered":"2024-09-12T02:28:22.467201+0000","last_clean":"2024-09-12T02:28:22.467201+0000","last_became_active":"2024-09-12T02:28:22.462294+0000","last_became_peered":"2024-09-12T02:28:22.462294+0000","last_unstale":"2024-09-12T02:28:22.467201+0000","last_undegraded":"2024-09-12T02:28:22.467201+0000","last_fullsized":"2024-09-12T02:28:22.467201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:05.212548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.478807+0000","last_change":"2024-09-12T02:28:21.449013+0000","last_active":"2024-09-12T02:28:22.478807+0000","last_peered":"2024-09-12T02:28:22.478807+0000","last_clean":"2024-09-12T02:28:22.478807+0000","last_became_active":"2024-09-12T02:28:21.448493+0000","last_became_peered":"2024-09-12T02:28:21.448493+0000","last_unstale":"2024-09-12T02:28:22.478807+0000","last_undegraded":"2024-09-12T02:28:22.478807+0000","last_fullsized":"2024-09-12T02:28:22.478807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463940+0000","last_change":"2024-09-12T02:28:22.456742+0000","last_active":"2024-09-12T02:28:22.463940+0000","last_peered":"2024-09-12T02:28:22.463940+0000","last_clean":"2024-09-12T02:28:22.463940+0000","last_became_active":"2024-09-12T02:28:22.456477+0000","last_became_peered":"2024-09-12T02:28:22.456477+0000","last_unstale":"2024-09-12T02:28:22.463940+0000","last_undegraded":"2024-09-12T02:28:22.463940+0000","last_fullsized":"2024-09-12T02:28:22.463940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474786+0000","last_change":"2024-09-12T02:28:21.461100+0000","last_active":"2024-09-12T02:28:22.474786+0000","last_peered":"2024-09-12T02:28:22.474786+0000","last_clean":"2024-09-12T02:28:22.474786+0000","last_became_active":"2024-09-12T02:28:21.460785+0000","last_became_peered":"2024-09-12T02:28:21.460785+0000","last_unstale":"2024-09-12T02:28:22.474786+0000","last_undegraded":"2024-09-12T02:28:22.474786+0000","last_fullsized":"2024-09-12T02:28:22.474786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:11.030581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469937+0000","last_change":"2024-09-12T02:28:22.461832+0000","last_active":"2024-09-12T02:28:22.469937+0000","last_peered":"2024-09-12T02:28:22.469937+0000","last_clean":"2024-09-12T02:28:22.469937+0000","last_became_active":"2024-09-12T02:28:22.461223+0000","last_became_peered":"2024-09-12T02:28:22.461223+0000","last_unstale":"2024-09-12T02:28:22.469937+0000","last_undegraded":"2024-09-12T02:28:22.469937+0000","last_fullsized":"2024-09-12T02:28:22.469937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:48.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460521+0000","last_change":"2024-09-12T02:28:21.454178+0000","last_active":"2024-09-12T02:28:22.460521+0000","last_peered":"2024-09-12T02:28:22.460521+0000","last_clean":"2024-09-12T02:28:22.460521+0000","last_became_active":"2024-09-12T02:28:21.453871+0000","last_became_peered":"2024-09-12T02:28:21.453871+0000","last_unstale":"2024-09-12T02:28:22.460521+0000","last_undegraded":"2024-09-12T02:28:22.460521+0000","last_fullsized":"2024-09-12T02:28:22.460521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.464025+0000","last_change":"2024-09-12T02:28:22.459853+0000","last_active":"2024-09-12T02:28:22.464025+0000","last_peered":"2024-09-12T02:28:22.464025+0000","last_clean":"2024-09-12T02:28:22.464025+0000","last_became_active":"2024-09-12T02:28:22.459611+0000","last_became_peered":"2024-09-12T02:28:22.459611+0000","last_unstale":"2024-09-12T02:28:22.464025+0000","last_undegraded":"2024-09-12T02:28:22.464025+0000","last_fullsized":"2024-09-12T02:28:22.464025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454995+0000","last_change":"2024-09-12T02:28:21.449223+0000","last_active":"2024-09-12T02:28:22.454995+0000","last_peered":"2024-09-12T02:28:22.454995+0000","last_clean":"2024-09-12T02:28:22.454995+0000","last_became_active":"2024-09-12T02:28:21.448650+0000","last_became_peered":"2024-09-12T02:28:21.448650+0000","last_unstale":"2024-09-12T02:28:22.454995+0000","last_undegraded":"2024-09-12T02:28:22.454995+0000","last_fullsized":"2024-09-12T02:28:22.454995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469646+0000","last_change":"2024-09-12T02:28:22.463479+0000","last_active":"2024-09-12T02:28:22.469646+0000","last_peered":"2024-09-12T02:28:22.469646+0000","last_clean":"2024-09-12T02:28:22.469646+0000","last_became_active":"2024-09-12T02:28:22.463208+0000","last_became_peered":"2024-09-12T02:28:22.463208+0000","last_unstale":"2024-09-12T02:28:22.469646+0000","last_undegraded":"2024-09-12T02:28:22.469646+0000","last_fullsized":"2024-09-12T02:28:22.469646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455931+0000","last_change":"2024-09-12T02:28:21.451427+0000","last_active":"2024-09-12T02:28:21.455931+0000","last_peered":"2024-09-12T02:28:21.455931+0000","last_clean":"2024-09-12T02:28:21.455931+0000","last_became_active":"2024-09-12T02:28:21.451124+0000","last_became_peered":"2024-09-12T02:28:21.451124+0000","last_unstale":"2024-09-12T02:28:21.455931+0000","last_undegraded":"2024-09-12T02:28:21.455931+0000","last_fullsized":"2024-09-12T02:28:21.455931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:32.994151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463744+0000","last_change":"2024-09-12T02:28:22.456047+0000","last_active":"2024-09-12T02:28:22.463744+0000","last_peered":"2024-09-12T02:28:22.463744+0000","last_clean":"2024-09-12T02:28:22.463744+0000","last_became_active":"2024-09-12T02:28:22.455803+0000","last_became_peered":"2024-09-12T02:28:22.455803+0000","last_unstale":"2024-09-12T02:28:22.463744+0000","last_undegraded":"2024-09-12T02:28:22.463744+0000","last_fullsized":"2024-09-12T02:28:22.463744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477262+0000","last_change":"2024-09-12T02:28:21.461510+0000","last_active":"2024-09-12T02:28:22.477262+0000","last_peered":"2024-09-12T02:28:22.477262+0000","last_clean":"2024-09-12T02:28:22.477262+0000","last_became_active":"2024-09-12T02:28:21.461183+0000","last_became_peered":"2024-09-12T02:28:21.461183+0000","last_unstale":"2024-09-12T02:28:22.477262+0000","last_undegraded":"2024-09-12T02:28:22.477262+0000","last_fullsized":"2024-09-12T02:28:22.477262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.909426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463806+0000","last_change":"2024-09-12T02:28:22.459244+0000","last_active":"2024-09-12T02:28:22.463806+0000","last_peered":"2024-09-12T02:28:22.463806+0000","last_clean":"2024-09-12T02:28:22.463806+0000","last_became_active":"2024-09-12T02:28:22.458948+0000","last_became_peered":"2024-09-12T02:28:22.458948+0000","last_unstale":"2024-09-12T02:28:22.463806+0000","last_undegraded":"2024-09-12T02:28:22.463806+0000","last_fullsized":"2024-09-12T02:28:22.463806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450138+0000","last_change":"2024-09-12T02:28:21.448604+0000","last_active":"2024-09-12T02:28:21.450138+0000","last_peered":"2024-09-12T02:28:21.450138+0000","last_clean":"2024-09-12T02:28:21.450138+0000","last_became_active":"2024-09-12T02:28:21.448165+0000","last_became_peered":"2024-09-12T02:28:21.448165+0000","last_unstale":"2024-09-12T02:28:21.450138+0000","last_undegraded":"2024-09-12T02:28:21.450138+0000","last_fullsized":"2024-09-12T02:28:21.450138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:33.333161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463722+0000","last_change":"2024-09-12T02:28:22.458525+0000","last_active":"2024-09-12T02:28:22.463722+0000","last_peered":"2024-09-12T02:28:22.463722+0000","last_clean":"2024-09-12T02:28:22.463722+0000","last_became_active":"2024-09-12T02:28:22.458270+0000","last_became_peered":"2024-09-12T02:28:22.458270+0000","last_unstale":"2024-09-12T02:28:22.463722+0000","last_undegraded":"2024-09-12T02:28:22.463722+0000","last_fullsized":"2024-09-12T02:28:22.463722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.475972+0000","last_change":"2024-09-12T02:28:21.456310+0000","last_active":"2024-09-12T02:28:22.475972+0000","last_peered":"2024-09-12T02:28:22.475972+0000","last_clean":"2024-09-12T02:28:22.475972+0000","last_became_active":"2024-09-12T02:28:21.455875+0000","last_became_peered":"2024-09-12T02:28:21.455875+0000","last_unstale":"2024-09-12T02:28:22.475972+0000","last_undegraded":"2024-09-12T02:28:22.475972+0000","last_fullsized":"2024-09-12T02:28:22.475972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472561+0000","last_change":"2024-09-12T02:28:22.470690+0000","last_active":"2024-09-12T02:28:22.472561+0000","last_peered":"2024-09-12T02:28:22.472561+0000","last_clean":"2024-09-12T02:28:22.472561+0000","last_became_active":"2024-09-12T02:28:22.469379+0000","last_became_peered":"2024-09-12T02:28:22.469379+0000","last_unstale":"2024-09-12T02:28:22.472561+0000","last_undegraded":"2024-09-12T02:28:22.472561+0000","last_fullsized":"2024-09-12T02:28:22.472561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.455988+0000","last_change":"2024-09-12T02:28:21.451827+0000","last_active":"2024-09-12T02:28:21.455988+0000","last_peered":"2024-09-12T02:28:21.455988+0000","last_clean":"2024-09-12T02:28:21.455988+0000","last_became_active":"2024-09-12T02:28:21.451567+0000","last_became_peered":"2024-09-12T02:28:21.451567+0000","last_unstale":"2024-09-12T02:28:21.455988+0000","last_undegraded":"2024-09-12T02:28:21.455988+0000","last_fullsized":"2024-09-12T02:28:21.455988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470710+0000","last_change":"2024-09-12T02:28:22.468838+0000","last_active":"2024-09-12T02:28:22.470710+0000","last_peered":"2024-09-12T02:28:22.470710+0000","last_clean":"2024-09-12T02:28:22.470710+0000","last_became_active":"2024-09-12T02:28:22.468221+0000","last_became_peered":"2024-09-12T02:28:22.468221+0000","last_unstale":"2024-09-12T02:28:22.470710+0000","last_undegraded":"2024-09-12T02:28:22.470710+0000","last_fullsized":"2024-09-12T02:28:22.470710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.987815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.449072+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:28:22.449072+0000","last_peered":"2024-09-12T02:28:22.449072+0000","last_clean":"2024-09-12T02:28:22.449072+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:28:22.449072+0000","last_undegraded":"2024-09-12T02:28:22.449072+0000","last_fullsized":"2024-09-12T02:28:22.449072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457174+0000","last_change":"2024-09-12T02:28:21.456961+0000","last_active":"2024-09-12T02:28:22.457174+0000","last_peered":"2024-09-12T02:28:22.457174+0000","last_clean":"2024-09-12T02:28:22.457174+0000","last_became_active":"2024-09-12T02:28:21.456682+0000","last_became_peered":"2024-09-12T02:28:21.456682+0000","last_unstale":"2024-09-12T02:28:22.457174+0000","last_undegraded":"2024-09-12T02:28:22.457174+0000","last_fullsized":"2024-09-12T02:28:22.457174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444080+0000","last_change":"2024-09-12T02:28:21.444080+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444080+0000","last_undegraded":"2024-09-12T02:28:21.444080+0000","last_fullsized":"2024-09-12T02:28:21.444080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.448411+0000","last_change":"2024-09-12T02:28:21.462547+0000","last_active":"2024-09-12T02:28:22.448411+0000","last_peered":"2024-09-12T02:28:22.448411+0000","last_clean":"2024-09-12T02:28:22.448411+0000","last_became_active":"2024-09-12T02:28:21.462186+0000","last_became_peered":"2024-09-12T02:28:21.462186+0000","last_unstale":"2024-09-12T02:28:22.448411+0000","last_undegraded":"2024-09-12T02:28:22.448411+0000","last_fullsized":"2024-09-12T02:28:22.448411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.468356+0000","last_change":"2024-09-12T02:28:22.457842+0000","last_active":"2024-09-12T02:28:22.468356+0000","last_peered":"2024-09-12T02:28:22.468356+0000","last_clean":"2024-09-12T02:28:22.468356+0000","last_became_active":"2024-09-12T02:28:22.457001+0000","last_became_peered":"2024-09-12T02:28:22.457001+0000","last_unstale":"2024-09-12T02:28:22.468356+0000","last_undegraded":"2024-09-12T02:28:22.468356+0000","last_fullsized":"2024-09-12T02:28:22.468356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.450193+0000","last_change":"2024-09-12T02:28:21.449367+0000","last_active":"2024-09-12T02:28:21.450193+0000","last_peered":"2024-09-12T02:28:21.450193+0000","last_clean":"2024-09-12T02:28:21.450193+0000","last_became_active":"2024-09-12T02:28:21.448265+0000","last_became_peered":"2024-09-12T02:28:21.448265+0000","last_unstale":"2024-09-12T02:28:21.450193+0000","last_undegraded":"2024-09-12T02:28:21.450193+0000","last_fullsized":"2024-09-12T02:28:21.450193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:33.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.459933+0000","last_change":"2024-09-12T02:28:22.458123+0000","last_active":"2024-09-12T02:28:22.459933+0000","last_peered":"2024-09-12T02:28:22.459933+0000","last_clean":"2024-09-12T02:28:22.459933+0000","last_became_active":"2024-09-12T02:28:22.457250+0000","last_became_peered":"2024-09-12T02:28:22.457250+0000","last_unstale":"2024-09-12T02:28:22.459933+0000","last_undegraded":"2024-09-12T02:28:22.459933+0000","last_fullsized":"2024-09-12T02:28:22.459933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460808+0000","last_change":"2024-09-12T02:28:21.457643+0000","last_active":"2024-09-12T02:28:22.460808+0000","last_peered":"2024-09-12T02:28:22.460808+0000","last_clean":"2024-09-12T02:28:22.460808+0000","last_became_active":"2024-09-12T02:28:21.457340+0000","last_became_peered":"2024-09-12T02:28:21.457340+0000","last_unstale":"2024-09-12T02:28:22.460808+0000","last_undegraded":"2024-09-12T02:28:22.460808+0000","last_fullsized":"2024-09-12T02:28:22.460808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469359+0000","last_change":"2024-09-12T02:28:22.466165+0000","last_active":"2024-09-12T02:28:22.469359+0000","last_peered":"2024-09-12T02:28:22.469359+0000","last_clean":"2024-09-12T02:28:22.469359+0000","last_became_active":"2024-09-12T02:28:22.465870+0000","last_became_peered":"2024-09-12T02:28:22.465870+0000","last_unstale":"2024-09-12T02:28:22.469359+0000","last_undegraded":"2024-09-12T02:28:22.469359+0000","last_fullsized":"2024-09-12T02:28:22.469359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.359807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455220+0000","last_change":"2024-09-12T02:28:21.461428+0000","last_active":"2024-09-12T02:28:22.455220+0000","last_peered":"2024-09-12T02:28:22.455220+0000","last_clean":"2024-09-12T02:28:22.455220+0000","last_became_active":"2024-09-12T02:28:21.461117+0000","last_became_peered":"2024-09-12T02:28:21.461117+0000","last_unstale":"2024-09-12T02:28:22.455220+0000","last_undegraded":"2024-09-12T02:28:22.455220+0000","last_fullsized":"2024-09-12T02:28:22.455220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.472581+0000","last_change":"2024-09-12T02:28:22.470508+0000","last_active":"2024-09-12T02:28:22.472581+0000","last_peered":"2024-09-12T02:28:22.472581+0000","last_clean":"2024-09-12T02:28:22.472581+0000","last_became_active":"2024-09-12T02:28:22.470220+0000","last_became_peered":"2024-09-12T02:28:22.470220+0000","last_unstale":"2024-09-12T02:28:22.472581+0000","last_undegraded":"2024-09-12T02:28:22.472581+0000","last_fullsized":"2024-09-12T02:28:22.472581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.450227+0000","last_change":"2024-09-12T02:28:21.461899+0000","last_active":"2024-09-12T02:28:22.450227+0000","last_peered":"2024-09-12T02:28:22.450227+0000","last_clean":"2024-09-12T02:28:22.450227+0000","last_became_active":"2024-09-12T02:28:21.461616+0000","last_became_peered":"2024-09-12T02:28:21.461616+0000","last_unstale":"2024-09-12T02:28:22.450227+0000","last_undegraded":"2024-09-12T02:28:22.450227+0000","last_fullsized":"2024-09-12T02:28:22.450227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:55.870005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.460282+0000","last_change":"2024-09-12T02:28:22.458683+0000","last_active":"2024-09-12T02:28:22.460282+0000","last_peered":"2024-09-12T02:28:22.460282+0000","last_clean":"2024-09-12T02:28:22.460282+0000","last_became_active":"2024-09-12T02:28:22.458413+0000","last_became_peered":"2024-09-12T02:28:22.458413+0000","last_unstale":"2024-09-12T02:28:22.460282+0000","last_undegraded":"2024-09-12T02:28:22.460282+0000","last_fullsized":"2024-09-12T02:28:22.460282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.455432+0000","last_change":"2024-09-12T02:28:21.455450+0000","last_active":"2024-09-12T02:28:22.455432+0000","last_peered":"2024-09-12T02:28:22.455432+0000","last_clean":"2024-09-12T02:28:22.455432+0000","last_became_active":"2024-09-12T02:28:21.455128+0000","last_became_peered":"2024-09-12T02:28:21.455128+0000","last_unstale":"2024-09-12T02:28:22.455432+0000","last_undegraded":"2024-09-12T02:28:22.455432+0000","last_fullsized":"2024-09-12T02:28:22.455432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444057+0000","last_change":"2024-09-12T02:28:21.444057+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444057+0000","last_undegraded":"2024-09-12T02:28:21.444057+0000","last_fullsized":"2024-09-12T02:28:21.444057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.474150+0000","last_change":"2024-09-12T02:28:21.457754+0000","last_active":"2024-09-12T02:28:22.474150+0000","last_peered":"2024-09-12T02:28:22.474150+0000","last_clean":"2024-09-12T02:28:22.474150+0000","last_became_active":"2024-09-12T02:28:21.457443+0000","last_became_peered":"2024-09-12T02:28:21.457443+0000","last_unstale":"2024-09-12T02:28:22.474150+0000","last_undegraded":"2024-09-12T02:28:22.474150+0000","last_fullsized":"2024-09-12T02:28:22.474150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470384+0000","last_change":"2024-09-12T02:28:22.463795+0000","last_active":"2024-09-12T02:28:22.470384+0000","last_peered":"2024-09-12T02:28:22.470384+0000","last_clean":"2024-09-12T02:28:22.470384+0000","last_became_active":"2024-09-12T02:28:22.463408+0000","last_became_peered":"2024-09-12T02:28:22.463408+0000","last_unstale":"2024-09-12T02:28:22.470384+0000","last_undegraded":"2024-09-12T02:28:22.470384+0000","last_fullsized":"2024-09-12T02:28:22.470384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.451656+0000","last_change":"2024-09-12T02:28:21.462250+0000","last_active":"2024-09-12T02:28:22.451656+0000","last_peered":"2024-09-12T02:28:22.451656+0000","last_clean":"2024-09-12T02:28:22.451656+0000","last_became_active":"2024-09-12T02:28:21.461734+0000","last_became_peered":"2024-09-12T02:28:21.461734+0000","last_unstale":"2024-09-12T02:28:22.451656+0000","last_undegraded":"2024-09-12T02:28:22.451656+0000","last_fullsized":"2024-09-12T02:28:22.451656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:27.705966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.463201+0000","last_change":"2024-09-12T02:28:22.459098+0000","last_active":"2024-09-12T02:28:22.463201+0000","last_peered":"2024-09-12T02:28:22.463201+0000","last_clean":"2024-09-12T02:28:22.463201+0000","last_became_active":"2024-09-12T02:28:22.457658+0000","last_became_peered":"2024-09-12T02:28:22.457658+0000","last_unstale":"2024-09-12T02:28:22.463201+0000","last_undegraded":"2024-09-12T02:28:22.463201+0000","last_fullsized":"2024-09-12T02:28:22.463201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.035027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.454312+0000","last_change":"2024-09-12T02:28:21.457547+0000","last_active":"2024-09-12T02:28:22.454312+0000","last_peered":"2024-09-12T02:28:22.454312+0000","last_clean":"2024-09-12T02:28:22.454312+0000","last_became_active":"2024-09-12T02:28:21.457263+0000","last_became_peered":"2024-09-12T02:28:21.457263+0000","last_unstale":"2024-09-12T02:28:22.454312+0000","last_undegraded":"2024-09-12T02:28:22.454312+0000","last_fullsized":"2024-09-12T02:28:22.454312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.443679+0000","last_change":"2024-09-12T02:28:21.443679+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.443679+0000","last_undegraded":"2024-09-12T02:28:21.443679+0000","last_fullsized":"2024-09-12T02:28:21.443679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.457445+0000","last_change":"2024-09-12T02:28:21.454638+0000","last_active":"2024-09-12T02:28:22.457445+0000","last_peered":"2024-09-12T02:28:22.457445+0000","last_clean":"2024-09-12T02:28:22.457445+0000","last_became_active":"2024-09-12T02:28:21.454339+0000","last_became_peered":"2024-09-12T02:28:21.454339+0000","last_unstale":"2024-09-12T02:28:22.457445+0000","last_undegraded":"2024-09-12T02:28:22.457445+0000","last_fullsized":"2024-09-12T02:28:22.457445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.444408+0000","last_change":"2024-09-12T02:28:21.444408+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.444408+0000","last_undegraded":"2024-09-12T02:28:21.444408+0000","last_fullsized":"2024-09-12T02:28:21.444408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476692+0000","last_change":"2024-09-12T02:28:21.462703+0000","last_active":"2024-09-12T02:28:22.476692+0000","last_peered":"2024-09-12T02:28:22.476692+0000","last_clean":"2024-09-12T02:28:22.476692+0000","last_became_active":"2024-09-12T02:28:21.462354+0000","last_became_peered":"2024-09-12T02:28:21.462354+0000","last_unstale":"2024-09-12T02:28:22.476692+0000","last_undegraded":"2024-09-12T02:28:22.476692+0000","last_fullsized":"2024-09-12T02:28:22.476692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:45.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.469663+0000","last_change":"2024-09-12T02:28:22.465703+0000","last_active":"2024-09-12T02:28:22.469663+0000","last_peered":"2024-09-12T02:28:22.469663+0000","last_clean":"2024-09-12T02:28:22.469663+0000","last_became_active":"2024-09-12T02:28:22.465439+0000","last_became_peered":"2024-09-12T02:28:22.465439+0000","last_unstale":"2024-09-12T02:28:22.469663+0000","last_undegraded":"2024-09-12T02:28:22.469663+0000","last_fullsized":"2024-09-12T02:28:22.469663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.470400+0000","last_change":"2024-09-12T02:28:22.464376+0000","last_active":"2024-09-12T02:28:22.470400+0000","last_peered":"2024-09-12T02:28:22.470400+0000","last_clean":"2024-09-12T02:28:22.470400+0000","last_became_active":"2024-09-12T02:28:22.464058+0000","last_became_peered":"2024-09-12T02:28:22.464058+0000","last_unstale":"2024-09-12T02:28:22.470400+0000","last_undegraded":"2024-09-12T02:28:22.470400+0000","last_fullsized":"2024-09-12T02:28:22.470400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476750+0000","last_change":"2024-09-12T02:28:21.459499+0000","last_active":"2024-09-12T02:28:22.476750+0000","last_peered":"2024-09-12T02:28:22.476750+0000","last_clean":"2024-09-12T02:28:22.476750+0000","last_became_active":"2024-09-12T02:28:21.459190+0000","last_became_peered":"2024-09-12T02:28:21.459190+0000","last_unstale":"2024-09-12T02:28:22.476750+0000","last_undegraded":"2024-09-12T02:28:22.476750+0000","last_fullsized":"2024-09-12T02:28:22.476750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.471707+0000","last_change":"2024-09-12T02:28:22.467912+0000","last_active":"2024-09-12T02:28:22.471707+0000","last_peered":"2024-09-12T02:28:22.471707+0000","last_clean":"2024-09-12T02:28:22.471707+0000","last_became_active":"2024-09-12T02:28:22.467615+0000","last_became_peered":"2024-09-12T02:28:22.467615+0000","last_unstale":"2024-09-12T02:28:22.471707+0000","last_undegraded":"2024-09-12T02:28:22.471707+0000","last_fullsized":"2024-09-12T02:28:22.471707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.476846+0000","last_change":"2024-09-12T02:28:21.462426+0000","last_active":"2024-09-12T02:28:22.476846+0000","last_peered":"2024-09-12T02:28:22.476846+0000","last_clean":"2024-09-12T02:28:22.476846+0000","last_became_active":"2024-09-12T02:28:21.462107+0000","last_became_peered":"2024-09-12T02:28:21.462107+0000","last_unstale":"2024-09-12T02:28:22.476846+0000","last_undegraded":"2024-09-12T02:28:22.476846+0000","last_fullsized":"2024-09-12T02:28:22.476846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:08.206286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.473779+0000","last_change":"2024-09-12T02:28:22.468618+0000","last_active":"2024-09-12T02:28:22.473779+0000","last_peered":"2024-09-12T02:28:22.473779+0000","last_clean":"2024-09-12T02:28:22.473779+0000","last_became_active":"2024-09-12T02:28:22.468188+0000","last_became_peered":"2024-09-12T02:28:22.468188+0000","last_unstale":"2024-09-12T02:28:22.473779+0000","last_undegraded":"2024-09-12T02:28:22.473779+0000","last_fullsized":"2024-09-12T02:28:22.473779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:56.874450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T02:28:21.464145+0000","last_change":"2024-09-12T02:28:21.462214+0000","last_active":"2024-09-12T02:28:21.464145+0000","last_peered":"2024-09-12T02:28:21.464145+0000","last_clean":"2024-09-12T02:28:21.464145+0000","last_became_active":"2024-09-12T02:28:21.461911+0000","last_became_peered":"2024-09-12T02:28:21.461911+0000","last_unstale":"2024-09-12T02:28:21.464145+0000","last_undegraded":"2024-09-12T02:28:21.464145+0000","last_fullsized":"2024-09-12T02:28:21.464145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:52.500471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:28:21.445229+0000","last_change":"2024-09-12T02:28:21.445229+0000","last_active":"2024-09-12T02:28:21.432019+0000","last_peered":"2024-09-12T02:28:21.432019+0000","last_clean":"2024-09-12T02:28:21.432019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:28:21.445229+0000","last_undegraded":"2024-09-12T02:28:21.445229+0000","last_fullsized":"2024-09-12T02:28:21.445229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:28:22.477547+0000","last_change":"2024-09-12T02:28:21.461271+0000","last_active":"2024-09-12T02:28:22.477547+0000","last_peered":"2024-09-12T02:28:22.477547+0000","last_clean":"2024-09-12T02:28:22.477547+0000","last_became_active":"2024-09-12T02:28:21.460986+0000","last_became_peered":"2024-09-12T02:28:21.460986+0000","last_unstale":"2024-09-12T02:28:22.477547+0000","last_undegraded":"2024-09-12T02:28:22.477547+0000","last_fullsized":"2024-09-12T02:28:22.477547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:58.924252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":649260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":58892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:28:28.241 INFO:tasks.ceph.mds.c.smithi181.stderr:2024-09-12T02:28:28.240+0000 7f80f6f88640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:28:29.743 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:28:29.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.854+0000 7f12d8b0a640 1 Processor -- start 2024-09-12T02:28:29.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.854+0000 7f12d8b0a640 1 -- start start 2024-09-12T02:28:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d8b0a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f12d415e590 0x7f12d40b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d8b0a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f12d4071330 0x7f12d40d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d8b0a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d40d0770 con 0x7f12d40cec80 2024-09-12T02:28:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d8b0a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f12d40b5900 con 0x7f12d4071330 2024-09-12T02:28:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d8b0a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f12d40b5be0 con 0x7f12d415e590 2024-09-12T02:28:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12cbfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f12d4071330 0x7f12d40d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d2d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f12d40cec80 0x7f12d40b69a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54270/0 (socket says 172.21.15.181:54270) 2024-09-12T02:28:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d2d9d640 1 -- 172.21.15.181:0/2968888623 learned_addr learned my addr 172.21.15.181:0/2968888623 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12d259c640 1 --2- 172.21.15.181:0/2968888623 >> v2:172.21.15.204:3300/0 conn(0x7f12d415e590 0x7f12d40b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12cbfff640 1 -- 172.21.15.181:0/2968888623 >> v2:172.21.15.204:3300/0 conn(0x7f12d415e590 msgr2=0x7f12d40b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12cbfff640 1 --2- 172.21.15.181:0/2968888623 >> v2:172.21.15.204:3300/0 conn(0x7f12d415e590 0x7f12d40b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12cbfff640 1 -- 172.21.15.181:0/2968888623 >> v1:172.21.15.181:6789/0 conn(0x7f12d40cec80 legacy=0x7f12d40b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.855+0000 7f12cbfff640 1 -- 172.21.15.181:0/2968888623 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d40b5ec0 con 0x7f12d4071330 2024-09-12T02:28:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.856+0000 7f12cbfff640 1 --2- 172.21.15.181:0/2968888623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d4071330 0x7f12d40d0230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12d406f320 tx=0x7f12bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622c15b3efdacd54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.856+0000 7f12d1d9b640 1 -- 172.21.15.181:0/2968888623 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc037070 con 0x7f12d4071330 2024-09-12T02:28:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.856+0000 7f12d1d9b640 1 -- 172.21.15.181:0/2968888623 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc032440 con 0x7f12d4071330 2024-09-12T02:28:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.856+0000 7f12d1d9b640 1 -- 172.21.15.181:0/2968888623 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc032810 con 0x7f12d4071330 2024-09-12T02:28:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2968888623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d4071330 msgr2=0x7f12d40d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2968888623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d4071330 0x7f12d40d0230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12d406f320 tx=0x7f12bc02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2968888623 shutdown_connections 2024-09-12T02:28:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2968888623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d4071330 0x7f12d40d0230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2968888623 >> v2:172.21.15.204:3300/0 conn(0x7f12d415e590 0x7f12d40b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2968888623 >> 172.21.15.181:0/2968888623 conn(0x7f12d406f400 msgr2=0x7f12d406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2968888623 shutdown_connections 2024-09-12T02:28:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.857+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2968888623 wait complete. 2024-09-12T02:28:29.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.858+0000 7f12d8b0a640 1 Processor -- start 2024-09-12T02:28:29.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.858+0000 7f12d8b0a640 1 -- start start 2024-09-12T02:28:29.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d8b0a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12d4071330 0x7f12d4155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:29.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d8b0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d40cec80 0x7f12d415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:29.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d8b0a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12d415e590 0x7f12d4158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:29.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d8b0a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f12d40741b0 con 0x7f12d40cec80 2024-09-12T02:28:29.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d8b0a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f12d40b6480 con 0x7f12d4071330 2024-09-12T02:28:29.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d8b0a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f12d415e970 con 0x7f12d415e590 2024-09-12T02:28:29.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d40cec80 0x7f12d415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:29.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d40cec80 0x7f12d415ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51576/0 (socket says 172.21.15.181:51576) 2024-09-12T02:28:29.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 -- 172.21.15.181:0/2596315694 learned_addr learned my addr 172.21.15.181:0/2596315694 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:29.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d2d9d640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12d415e590 0x7f12d4158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:29.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12d259c640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12d4071330 0x7f12d4155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:29.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 -- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12d415e590 msgr2=0x7f12d4158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:29.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12d415e590 0x7f12d4158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 -- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12d4071330 msgr2=0x7f12d4155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:29.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12d4071330 0x7f12d4155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 -- 172.21.15.181:0/2596315694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d4156870 con 0x7f12d40cec80 2024-09-12T02:28:29.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.859+0000 7f12cbfff640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d40cec80 0x7f12d415ed00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009890 tx=0x7f12bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:29.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.860+0000 7f12caffd640 1 -- 172.21.15.181:0/2596315694 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc037040 con 0x7f12d40cec80 2024-09-12T02:28:29.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.860+0000 7f12caffd640 1 -- 172.21.15.181:0/2596315694 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc042070 con 0x7f12d40cec80 2024-09-12T02:28:29.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.860+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d40b15f0 con 0x7f12d40cec80 2024-09-12T02:28:29.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.860+0000 7f12caffd640 1 -- 172.21.15.181:0/2596315694 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc030bd0 con 0x7f12d40cec80 2024-09-12T02:28:29.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.860+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d40b1bb0 con 0x7f12d40cec80 2024-09-12T02:28:29.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.861+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d40d0230 con 0x7f12d40cec80 2024-09-12T02:28:29.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.861+0000 7f12caffd640 1 -- 172.21.15.181:0/2596315694 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12bc047460 con 0x7f12d40cec80 2024-09-12T02:28:29.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.862+0000 7f12caffd640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f12b406be60 0x7f12b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:29.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.862+0000 7f12caffd640 1 -- 172.21.15.181:0/2596315694 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f12bc0ab970 con 0x7f12d40cec80 2024-09-12T02:28:29.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.862+0000 7f12d259c640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f12b406be60 0x7f12b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:29.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.862+0000 7f12d259c640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f12b406be60 0x7f12b406e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f12c4006fd0 tx=0x7f12c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:29.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:29.866+0000 7f12caffd640 1 -- 172.21.15.181:0/2596315694 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12bc032e20 con 0x7f12d40cec80 2024-09-12T02:28:30.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.029+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12d40b3d90 con 0x7f12b406be60 2024-09-12T02:28:30.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.035+0000 7f12caffd640 1 -- 172.21.15.181:0/2596315694 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251908 (secure 0 0 0) 0x7f12d40b3d90 con 0x7f12b406be60 2024-09-12T02:28:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:28:30.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f12b406be60 msgr2=0x7f12b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f12b406be60 0x7f12b406e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f12c4006fd0 tx=0x7f12c4008040 comp rx=0 tx=0).stop 2024-09-12T02:28:30.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d40cec80 msgr2=0x7f12d415ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d40cec80 0x7f12d415ed00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009890 tx=0x7f12bc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 shutdown_connections 2024-09-12T02:28:30.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f12b406be60 0x7f12b406e320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f12d415e590 0x7f12d4158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12d40cec80 0x7f12d415ed00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 --2- 172.21.15.181:0/2596315694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f12d4071330 0x7f12d4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 >> 172.21.15.181:0/2596315694 conn(0x7f12d406f400 msgr2=0x7f12d415b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:30.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 shutdown_connections 2024-09-12T02:28:30.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.038+0000 7f12d8b0a640 1 -- 172.21.15.181:0/2596315694 wait complete. 2024-09-12T02:28:30.050 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T02:28:29.613345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2924544,"data_stored":1761292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001472"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298690+0000","last_change":"2024-09-12T02:28:22.461189+0000","last_active":"2024-09-12T02:28:24.298690+0000","last_peered":"2024-09-12T02:28:24.298690+0000","last_clean":"2024-09-12T02:28:24.298690+0000","last_became_active":"2024-09-12T02:28:22.460880+0000","last_became_peered":"2024-09-12T02:28:22.460880+0000","last_unstale":"2024-09-12T02:28:24.298690+0000","last_undegraded":"2024-09-12T02:28:24.298690+0000","last_fullsized":"2024-09-12T02:28:24.298690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.893907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459714+0000","last_change":"2024-09-12T02:28:22.462152+0000","last_active":"2024-09-12T02:28:23.459714+0000","last_peered":"2024-09-12T02:28:23.459714+0000","last_clean":"2024-09-12T02:28:23.459714+0000","last_became_active":"2024-09-12T02:28:22.461892+0000","last_became_peered":"2024-09-12T02:28:22.461892+0000","last_unstale":"2024-09-12T02:28:23.459714+0000","last_undegraded":"2024-09-12T02:28:23.459714+0000","last_fullsized":"2024-09-12T02:28:23.459714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995437+0000","last_change":"2024-09-12T02:28:22.456793+0000","last_active":"2024-09-12T02:28:23.995437+0000","last_peered":"2024-09-12T02:28:23.995437+0000","last_clean":"2024-09-12T02:28:23.995437+0000","last_became_active":"2024-09-12T02:28:22.456542+0000","last_became_peered":"2024-09-12T02:28:22.456542+0000","last_unstale":"2024-09-12T02:28:23.995437+0000","last_undegraded":"2024-09-12T02:28:23.995437+0000","last_fullsized":"2024-09-12T02:28:23.995437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298035+0000","last_change":"2024-09-12T02:28:22.470469+0000","last_active":"2024-09-12T02:28:24.298035+0000","last_peered":"2024-09-12T02:28:24.298035+0000","last_clean":"2024-09-12T02:28:24.298035+0000","last_became_active":"2024-09-12T02:28:22.470021+0000","last_became_peered":"2024-09-12T02:28:22.470021+0000","last_unstale":"2024-09-12T02:28:24.298035+0000","last_undegraded":"2024-09-12T02:28:24.298035+0000","last_fullsized":"2024-09-12T02:28:24.298035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:24.316527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298202+0000","last_change":"2024-09-12T02:28:22.457601+0000","last_active":"2024-09-12T02:28:24.298202+0000","last_peered":"2024-09-12T02:28:24.298202+0000","last_clean":"2024-09-12T02:28:24.298202+0000","last_became_active":"2024-09-12T02:28:22.454545+0000","last_became_peered":"2024-09-12T02:28:22.454545+0000","last_unstale":"2024-09-12T02:28:24.298202+0000","last_undegraded":"2024-09-12T02:28:24.298202+0000","last_fullsized":"2024-09-12T02:28:24.298202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:24.316527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297761+0000","last_change":"2024-09-12T02:28:22.475342+0000","last_active":"2024-09-12T02:28:24.297761+0000","last_peered":"2024-09-12T02:28:24.297761+0000","last_clean":"2024-09-12T02:28:24.297761+0000","last_became_active":"2024-09-12T02:28:22.475064+0000","last_became_peered":"2024-09-12T02:28:22.475064+0000","last_unstale":"2024-09-12T02:28:24.297761+0000","last_undegraded":"2024-09-12T02:28:24.297761+0000","last_fullsized":"2024-09-12T02:28:24.297761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.987815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297419+0000","last_change":"2024-09-12T02:28:22.462932+0000","last_active":"2024-09-12T02:28:24.297419+0000","last_peered":"2024-09-12T02:28:24.297419+0000","last_clean":"2024-09-12T02:28:24.297419+0000","last_became_active":"2024-09-12T02:28:22.462608+0000","last_became_peered":"2024-09-12T02:28:22.462608+0000","last_unstale":"2024-09-12T02:28:24.297419+0000","last_undegraded":"2024-09-12T02:28:24.297419+0000","last_fullsized":"2024-09-12T02:28:24.297419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:28.724885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297146+0000","last_change":"2024-09-12T02:28:22.467818+0000","last_active":"2024-09-12T02:28:24.297146+0000","last_peered":"2024-09-12T02:28:24.297146+0000","last_clean":"2024-09-12T02:28:24.297146+0000","last_became_active":"2024-09-12T02:28:22.467560+0000","last_became_peered":"2024-09-12T02:28:22.467560+0000","last_unstale":"2024-09-12T02:28:24.297146+0000","last_undegraded":"2024-09-12T02:28:24.297146+0000","last_fullsized":"2024-09-12T02:28:24.297146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.908086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298706+0000","last_change":"2024-09-12T02:28:22.464802+0000","last_active":"2024-09-12T02:28:24.298706+0000","last_peered":"2024-09-12T02:28:24.298706+0000","last_clean":"2024-09-12T02:28:24.298706+0000","last_became_active":"2024-09-12T02:28:22.464518+0000","last_became_peered":"2024-09-12T02:28:22.464518+0000","last_unstale":"2024-09-12T02:28:24.298706+0000","last_undegraded":"2024-09-12T02:28:24.298706+0000","last_fullsized":"2024-09-12T02:28:24.298706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:30.326182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463284+0000","last_change":"2024-09-12T02:28:22.467874+0000","last_active":"2024-09-12T02:28:23.463284+0000","last_peered":"2024-09-12T02:28:23.463284+0000","last_clean":"2024-09-12T02:28:23.463284+0000","last_became_active":"2024-09-12T02:28:22.467350+0000","last_became_peered":"2024-09-12T02:28:22.467350+0000","last_unstale":"2024-09-12T02:28:23.463284+0000","last_undegraded":"2024-09-12T02:28:23.463284+0000","last_fullsized":"2024-09-12T02:28:23.463284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462468+0000","last_change":"2024-09-12T02:28:22.468202+0000","last_active":"2024-09-12T02:28:23.462468+0000","last_peered":"2024-09-12T02:28:23.462468+0000","last_clean":"2024-09-12T02:28:23.462468+0000","last_became_active":"2024-09-12T02:28:22.467913+0000","last_became_peered":"2024-09-12T02:28:22.467913+0000","last_unstale":"2024-09-12T02:28:23.462468+0000","last_undegraded":"2024-09-12T02:28:23.462468+0000","last_fullsized":"2024-09-12T02:28:23.462468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463228+0000","last_change":"2024-09-12T02:28:22.460598+0000","last_active":"2024-09-12T02:28:23.463228+0000","last_peered":"2024-09-12T02:28:23.463228+0000","last_clean":"2024-09-12T02:28:23.463228+0000","last_became_active":"2024-09-12T02:28:22.460325+0000","last_became_peered":"2024-09-12T02:28:22.460325+0000","last_unstale":"2024-09-12T02:28:23.463228+0000","last_undegraded":"2024-09-12T02:28:23.463228+0000","last_fullsized":"2024-09-12T02:28:23.463228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297437+0000","last_change":"2024-09-12T02:28:22.462576+0000","last_active":"2024-09-12T02:28:24.297437+0000","last_peered":"2024-09-12T02:28:24.297437+0000","last_clean":"2024-09-12T02:28:24.297437+0000","last_became_active":"2024-09-12T02:28:22.461457+0000","last_became_peered":"2024-09-12T02:28:22.461457+0000","last_unstale":"2024-09-12T02:28:24.297437+0000","last_undegraded":"2024-09-12T02:28:24.297437+0000","last_fullsized":"2024-09-12T02:28:24.297437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:26.973561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995232+0000","last_change":"2024-09-12T02:28:22.462049+0000","last_active":"2024-09-12T02:28:23.995232+0000","last_peered":"2024-09-12T02:28:23.995232+0000","last_clean":"2024-09-12T02:28:23.995232+0000","last_became_active":"2024-09-12T02:28:22.461571+0000","last_became_peered":"2024-09-12T02:28:22.461571+0000","last_unstale":"2024-09-12T02:28:23.995232+0000","last_undegraded":"2024-09-12T02:28:23.995232+0000","last_fullsized":"2024-09-12T02:28:23.995232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459520+0000","last_change":"2024-09-12T02:28:22.463467+0000","last_active":"2024-09-12T02:28:23.459520+0000","last_peered":"2024-09-12T02:28:23.459520+0000","last_clean":"2024-09-12T02:28:23.459520+0000","last_became_active":"2024-09-12T02:28:22.463205+0000","last_became_peered":"2024-09-12T02:28:22.463205+0000","last_unstale":"2024-09-12T02:28:23.459520+0000","last_undegraded":"2024-09-12T02:28:23.459520+0000","last_fullsized":"2024-09-12T02:28:23.459520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297481+0000","last_change":"2024-09-12T02:28:22.475573+0000","last_active":"2024-09-12T02:28:24.297481+0000","last_peered":"2024-09-12T02:28:24.297481+0000","last_clean":"2024-09-12T02:28:24.297481+0000","last_became_active":"2024-09-12T02:28:22.475311+0000","last_became_peered":"2024-09-12T02:28:22.475311+0000","last_unstale":"2024-09-12T02:28:24.297481+0000","last_undegraded":"2024-09-12T02:28:24.297481+0000","last_fullsized":"2024-09-12T02:28:24.297481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298512+0000","last_change":"2024-09-12T02:28:22.468036+0000","last_active":"2024-09-12T02:28:24.298512+0000","last_peered":"2024-09-12T02:28:24.298512+0000","last_clean":"2024-09-12T02:28:24.298512+0000","last_became_active":"2024-09-12T02:28:22.467611+0000","last_became_peered":"2024-09-12T02:28:22.467611+0000","last_unstale":"2024-09-12T02:28:24.298512+0000","last_undegraded":"2024-09-12T02:28:24.298512+0000","last_fullsized":"2024-09-12T02:28:24.298512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:30.326182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251391+0000","last_change":"2024-09-12T02:28:22.459062+0000","last_active":"2024-09-12T02:28:24.251391+0000","last_peered":"2024-09-12T02:28:24.251391+0000","last_clean":"2024-09-12T02:28:24.251391+0000","last_became_active":"2024-09-12T02:28:22.458792+0000","last_became_peered":"2024-09-12T02:28:22.458792+0000","last_unstale":"2024-09-12T02:28:24.251391+0000","last_undegraded":"2024-09-12T02:28:24.251391+0000","last_fullsized":"2024-09-12T02:28:24.251391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:25.142485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298786+0000","last_change":"2024-09-12T02:28:22.455655+0000","last_active":"2024-09-12T02:28:24.298786+0000","last_peered":"2024-09-12T02:28:24.298786+0000","last_clean":"2024-09-12T02:28:24.298786+0000","last_became_active":"2024-09-12T02:28:22.454802+0000","last_became_peered":"2024-09-12T02:28:22.454802+0000","last_unstale":"2024-09-12T02:28:24.298786+0000","last_undegraded":"2024-09-12T02:28:24.298786+0000","last_fullsized":"2024-09-12T02:28:24.298786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:44.397727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463379+0000","last_change":"2024-09-12T02:28:22.464688+0000","last_active":"2024-09-12T02:28:23.463379+0000","last_peered":"2024-09-12T02:28:23.463379+0000","last_clean":"2024-09-12T02:28:23.463379+0000","last_became_active":"2024-09-12T02:28:22.464285+0000","last_became_peered":"2024-09-12T02:28:22.464285+0000","last_unstale":"2024-09-12T02:28:23.463379+0000","last_undegraded":"2024-09-12T02:28:23.463379+0000","last_fullsized":"2024-09-12T02:28:23.463379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995368+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:23.995368+0000","last_peered":"2024-09-12T02:28:23.995368+0000","last_clean":"2024-09-12T02:28:23.995368+0000","last_became_active":"2024-09-12T02:28:22.464320+0000","last_became_peered":"2024-09-12T02:28:22.464320+0000","last_unstale":"2024-09-12T02:28:23.995368+0000","last_undegraded":"2024-09-12T02:28:23.995368+0000","last_fullsized":"2024-09-12T02:28:23.995368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297938+0000","last_change":"2024-09-12T02:28:22.467576+0000","last_active":"2024-09-12T02:28:24.297938+0000","last_peered":"2024-09-12T02:28:24.297938+0000","last_clean":"2024-09-12T02:28:24.297938+0000","last_became_active":"2024-09-12T02:28:22.467297+0000","last_became_peered":"2024-09-12T02:28:22.467297+0000","last_unstale":"2024-09-12T02:28:24.297938+0000","last_undegraded":"2024-09-12T02:28:24.297938+0000","last_fullsized":"2024-09-12T02:28:24.297938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.507175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297246+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:24.297246+0000","last_peered":"2024-09-12T02:28:24.297246+0000","last_clean":"2024-09-12T02:28:24.297246+0000","last_became_active":"2024-09-12T02:28:22.464373+0000","last_became_peered":"2024-09-12T02:28:22.464373+0000","last_unstale":"2024-09-12T02:28:24.297246+0000","last_undegraded":"2024-09-12T02:28:24.297246+0000","last_fullsized":"2024-09-12T02:28:24.297246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:51.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297547+0000","last_change":"2024-09-12T02:28:22.470133+0000","last_active":"2024-09-12T02:28:24.297547+0000","last_peered":"2024-09-12T02:28:24.297547+0000","last_clean":"2024-09-12T02:28:24.297547+0000","last_became_active":"2024-09-12T02:28:22.469748+0000","last_became_peered":"2024-09-12T02:28:22.469748+0000","last_unstale":"2024-09-12T02:28:24.297547+0000","last_undegraded":"2024-09-12T02:28:24.297547+0000","last_fullsized":"2024-09-12T02:28:24.297547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297457+0000","last_change":"2024-09-12T02:28:22.466114+0000","last_active":"2024-09-12T02:28:24.297457+0000","last_peered":"2024-09-12T02:28:24.297457+0000","last_clean":"2024-09-12T02:28:24.297457+0000","last_became_active":"2024-09-12T02:28:22.465773+0000","last_became_peered":"2024-09-12T02:28:22.465773+0000","last_unstale":"2024-09-12T02:28:24.297457+0000","last_undegraded":"2024-09-12T02:28:24.297457+0000","last_fullsized":"2024-09-12T02:28:24.297457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.522598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463327+0000","last_change":"2024-09-12T02:28:22.465019+0000","last_active":"2024-09-12T02:28:23.463327+0000","last_peered":"2024-09-12T02:28:23.463327+0000","last_clean":"2024-09-12T02:28:23.463327+0000","last_became_active":"2024-09-12T02:28:22.464751+0000","last_became_peered":"2024-09-12T02:28:22.464751+0000","last_unstale":"2024-09-12T02:28:23.463327+0000","last_undegraded":"2024-09-12T02:28:23.463327+0000","last_fullsized":"2024-09-12T02:28:23.463327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459551+0000","last_change":"2024-09-12T02:28:22.459615+0000","last_active":"2024-09-12T02:28:23.459551+0000","last_peered":"2024-09-12T02:28:23.459551+0000","last_clean":"2024-09-12T02:28:23.459551+0000","last_became_active":"2024-09-12T02:28:22.459342+0000","last_became_peered":"2024-09-12T02:28:22.459342+0000","last_unstale":"2024-09-12T02:28:23.459551+0000","last_undegraded":"2024-09-12T02:28:23.459551+0000","last_fullsized":"2024-09-12T02:28:23.459551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297704+0000","last_change":"2024-09-12T02:28:22.465319+0000","last_active":"2024-09-12T02:28:24.297704+0000","last_peered":"2024-09-12T02:28:24.297704+0000","last_clean":"2024-09-12T02:28:24.297704+0000","last_became_active":"2024-09-12T02:28:22.465059+0000","last_became_peered":"2024-09-12T02:28:22.465059+0000","last_unstale":"2024-09-12T02:28:24.297704+0000","last_undegraded":"2024-09-12T02:28:24.297704+0000","last_fullsized":"2024-09-12T02:28:24.297704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:12.495527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995398+0000","last_change":"2024-09-12T02:28:22.464467+0000","last_active":"2024-09-12T02:28:23.995398+0000","last_peered":"2024-09-12T02:28:23.995398+0000","last_clean":"2024-09-12T02:28:23.995398+0000","last_became_active":"2024-09-12T02:28:22.464145+0000","last_became_peered":"2024-09-12T02:28:22.464145+0000","last_unstale":"2024-09-12T02:28:23.995398+0000","last_undegraded":"2024-09-12T02:28:23.995398+0000","last_fullsized":"2024-09-12T02:28:23.995398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298119+0000","last_change":"2024-09-12T02:28:22.470537+0000","last_active":"2024-09-12T02:28:24.298119+0000","last_peered":"2024-09-12T02:28:24.298119+0000","last_clean":"2024-09-12T02:28:24.298119+0000","last_became_active":"2024-09-12T02:28:22.469350+0000","last_became_peered":"2024-09-12T02:28:22.469350+0000","last_unstale":"2024-09-12T02:28:24.298119+0000","last_undegraded":"2024-09-12T02:28:24.298119+0000","last_fullsized":"2024-09-12T02:28:24.298119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.829525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251249+0000","last_change":"2024-09-12T02:28:22.464994+0000","last_active":"2024-09-12T02:28:24.251249+0000","last_peered":"2024-09-12T02:28:24.251249+0000","last_clean":"2024-09-12T02:28:24.251249+0000","last_became_active":"2024-09-12T02:28:22.464704+0000","last_became_peered":"2024-09-12T02:28:22.464704+0000","last_unstale":"2024-09-12T02:28:24.251249+0000","last_undegraded":"2024-09-12T02:28:24.251249+0000","last_fullsized":"2024-09-12T02:28:24.251249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:32.306382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462749+0000","last_change":"2024-09-12T02:28:22.463462+0000","last_active":"2024-09-12T02:28:23.462749+0000","last_peered":"2024-09-12T02:28:23.462749+0000","last_clean":"2024-09-12T02:28:23.462749+0000","last_became_active":"2024-09-12T02:28:22.463170+0000","last_became_peered":"2024-09-12T02:28:22.463170+0000","last_unstale":"2024-09-12T02:28:23.462749+0000","last_undegraded":"2024-09-12T02:28:23.462749+0000","last_fullsized":"2024-09-12T02:28:23.462749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462660+0000","last_change":"2024-09-12T02:28:22.461255+0000","last_active":"2024-09-12T02:28:23.462660+0000","last_peered":"2024-09-12T02:28:23.462660+0000","last_clean":"2024-09-12T02:28:23.462660+0000","last_became_active":"2024-09-12T02:28:22.460994+0000","last_became_peered":"2024-09-12T02:28:22.460994+0000","last_unstale":"2024-09-12T02:28:23.462660+0000","last_undegraded":"2024-09-12T02:28:23.462660+0000","last_fullsized":"2024-09-12T02:28:23.462660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297624+0000","last_change":"2024-09-12T02:28:21.453139+0000","last_active":"2024-09-12T02:28:24.297624+0000","last_peered":"2024-09-12T02:28:24.297624+0000","last_clean":"2024-09-12T02:28:24.297624+0000","last_became_active":"2024-09-12T02:28:21.452853+0000","last_became_peered":"2024-09-12T02:28:21.452853+0000","last_unstale":"2024-09-12T02:28:24.297624+0000","last_undegraded":"2024-09-12T02:28:24.297624+0000","last_fullsized":"2024-09-12T02:28:24.297624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:26.817704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995580+0000","last_change":"2024-09-12T02:28:22.456228+0000","last_active":"2024-09-12T02:28:23.995580+0000","last_peered":"2024-09-12T02:28:23.995580+0000","last_clean":"2024-09-12T02:28:23.995580+0000","last_became_active":"2024-09-12T02:28:22.455958+0000","last_became_peered":"2024-09-12T02:28:22.455958+0000","last_unstale":"2024-09-12T02:28:23.995580+0000","last_undegraded":"2024-09-12T02:28:23.995580+0000","last_fullsized":"2024-09-12T02:28:23.995580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462800+0000","last_change":"2024-09-12T02:28:21.446775+0000","last_active":"2024-09-12T02:28:23.462800+0000","last_peered":"2024-09-12T02:28:23.462800+0000","last_clean":"2024-09-12T02:28:23.462800+0000","last_became_active":"2024-09-12T02:28:21.446028+0000","last_became_peered":"2024-09-12T02:28:21.446028+0000","last_unstale":"2024-09-12T02:28:23.462800+0000","last_undegraded":"2024-09-12T02:28:23.462800+0000","last_fullsized":"2024-09-12T02:28:23.462800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:12.026922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297505+0000","last_change":"2024-09-12T02:28:21.452793+0000","last_active":"2024-09-12T02:28:24.297505+0000","last_peered":"2024-09-12T02:28:24.297505+0000","last_clean":"2024-09-12T02:28:24.297505+0000","last_became_active":"2024-09-12T02:28:21.452354+0000","last_became_peered":"2024-09-12T02:28:21.452354+0000","last_unstale":"2024-09-12T02:28:24.297505+0000","last_undegraded":"2024-09-12T02:28:24.297505+0000","last_fullsized":"2024-09-12T02:28:24.297505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297229+0000","last_change":"2024-09-12T02:28:22.474976+0000","last_active":"2024-09-12T02:28:24.297229+0000","last_peered":"2024-09-12T02:28:24.297229+0000","last_clean":"2024-09-12T02:28:24.297229+0000","last_became_active":"2024-09-12T02:28:22.474804+0000","last_became_peered":"2024-09-12T02:28:22.474804+0000","last_unstale":"2024-09-12T02:28:24.297229+0000","last_undegraded":"2024-09-12T02:28:24.297229+0000","last_fullsized":"2024-09-12T02:28:24.297229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:27.574862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297594+0000","last_change":"2024-09-12T02:28:21.454569+0000","last_active":"2024-09-12T02:28:24.297594+0000","last_peered":"2024-09-12T02:28:24.297594+0000","last_clean":"2024-09-12T02:28:24.297594+0000","last_became_active":"2024-09-12T02:28:21.453146+0000","last_became_peered":"2024-09-12T02:28:21.453146+0000","last_unstale":"2024-09-12T02:28:24.297594+0000","last_undegraded":"2024-09-12T02:28:24.297594+0000","last_fullsized":"2024-09-12T02:28:24.297594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459516+0000","last_change":"2024-09-12T02:28:22.458922+0000","last_active":"2024-09-12T02:28:23.459516+0000","last_peered":"2024-09-12T02:28:23.459516+0000","last_clean":"2024-09-12T02:28:23.459516+0000","last_became_active":"2024-09-12T02:28:22.458641+0000","last_became_peered":"2024-09-12T02:28:22.458641+0000","last_unstale":"2024-09-12T02:28:23.459516+0000","last_undegraded":"2024-09-12T02:28:23.459516+0000","last_fullsized":"2024-09-12T02:28:23.459516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462939+0000","last_change":"2024-09-12T02:28:21.455322+0000","last_active":"2024-09-12T02:28:23.462939+0000","last_peered":"2024-09-12T02:28:23.462939+0000","last_clean":"2024-09-12T02:28:23.462939+0000","last_became_active":"2024-09-12T02:28:21.455039+0000","last_became_peered":"2024-09-12T02:28:21.455039+0000","last_unstale":"2024-09-12T02:28:23.462939+0000","last_undegraded":"2024-09-12T02:28:23.462939+0000","last_fullsized":"2024-09-12T02:28:23.462939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297881+0000","last_change":"2024-09-12T02:28:22.467660+0000","last_active":"2024-09-12T02:28:24.297881+0000","last_peered":"2024-09-12T02:28:24.297881+0000","last_clean":"2024-09-12T02:28:24.297881+0000","last_became_active":"2024-09-12T02:28:22.467401+0000","last_became_peered":"2024-09-12T02:28:22.467401+0000","last_unstale":"2024-09-12T02:28:24.297881+0000","last_undegraded":"2024-09-12T02:28:24.297881+0000","last_fullsized":"2024-09-12T02:28:24.297881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:28.724885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298375+0000","last_change":"2024-09-12T02:28:21.456883+0000","last_active":"2024-09-12T02:28:24.298375+0000","last_peered":"2024-09-12T02:28:24.298375+0000","last_clean":"2024-09-12T02:28:24.298375+0000","last_became_active":"2024-09-12T02:28:21.456438+0000","last_became_peered":"2024-09-12T02:28:21.456438+0000","last_unstale":"2024-09-12T02:28:24.298375+0000","last_undegraded":"2024-09-12T02:28:24.298375+0000","last_fullsized":"2024-09-12T02:28:24.298375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995535+0000","last_change":"2024-09-12T02:28:22.467768+0000","last_active":"2024-09-12T02:28:23.995535+0000","last_peered":"2024-09-12T02:28:23.995535+0000","last_clean":"2024-09-12T02:28:23.995535+0000","last_became_active":"2024-09-12T02:28:22.467484+0000","last_became_peered":"2024-09-12T02:28:22.467484+0000","last_unstale":"2024-09-12T02:28:23.995535+0000","last_undegraded":"2024-09-12T02:28:23.995535+0000","last_fullsized":"2024-09-12T02:28:23.995535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459611+0000","last_change":"2024-09-12T02:28:21.453336+0000","last_active":"2024-09-12T02:28:23.459611+0000","last_peered":"2024-09-12T02:28:23.459611+0000","last_clean":"2024-09-12T02:28:23.459611+0000","last_became_active":"2024-09-12T02:28:21.453054+0000","last_became_peered":"2024-09-12T02:28:21.453054+0000","last_unstale":"2024-09-12T02:28:23.459611+0000","last_undegraded":"2024-09-12T02:28:23.459611+0000","last_fullsized":"2024-09-12T02:28:23.459611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463389+0000","last_change":"2024-09-12T02:28:22.462579+0000","last_active":"2024-09-12T02:28:23.463389+0000","last_peered":"2024-09-12T02:28:23.463389+0000","last_clean":"2024-09-12T02:28:23.463389+0000","last_became_active":"2024-09-12T02:28:22.462294+0000","last_became_peered":"2024-09-12T02:28:22.462294+0000","last_unstale":"2024-09-12T02:28:23.463389+0000","last_undegraded":"2024-09-12T02:28:23.463389+0000","last_fullsized":"2024-09-12T02:28:23.463389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463174+0000","last_change":"2024-09-12T02:28:21.449013+0000","last_active":"2024-09-12T02:28:23.463174+0000","last_peered":"2024-09-12T02:28:23.463174+0000","last_clean":"2024-09-12T02:28:23.463174+0000","last_became_active":"2024-09-12T02:28:21.448493+0000","last_became_peered":"2024-09-12T02:28:21.448493+0000","last_unstale":"2024-09-12T02:28:23.463174+0000","last_undegraded":"2024-09-12T02:28:23.463174+0000","last_fullsized":"2024-09-12T02:28:23.463174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298568+0000","last_change":"2024-09-12T02:28:22.456742+0000","last_active":"2024-09-12T02:28:24.298568+0000","last_peered":"2024-09-12T02:28:24.298568+0000","last_clean":"2024-09-12T02:28:24.298568+0000","last_became_active":"2024-09-12T02:28:22.456477+0000","last_became_peered":"2024-09-12T02:28:22.456477+0000","last_unstale":"2024-09-12T02:28:24.298568+0000","last_undegraded":"2024-09-12T02:28:24.298568+0000","last_fullsized":"2024-09-12T02:28:24.298568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:52.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995564+0000","last_change":"2024-09-12T02:28:21.461100+0000","last_active":"2024-09-12T02:28:23.995564+0000","last_peered":"2024-09-12T02:28:23.995564+0000","last_clean":"2024-09-12T02:28:23.995564+0000","last_became_active":"2024-09-12T02:28:21.460785+0000","last_became_peered":"2024-09-12T02:28:21.460785+0000","last_unstale":"2024-09-12T02:28:23.995564+0000","last_undegraded":"2024-09-12T02:28:23.995564+0000","last_fullsized":"2024-09-12T02:28:23.995564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:11.030581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995310+0000","last_change":"2024-09-12T02:28:22.461832+0000","last_active":"2024-09-12T02:28:23.995310+0000","last_peered":"2024-09-12T02:28:23.995310+0000","last_clean":"2024-09-12T02:28:23.995310+0000","last_became_active":"2024-09-12T02:28:22.461223+0000","last_became_peered":"2024-09-12T02:28:22.461223+0000","last_unstale":"2024-09-12T02:28:23.995310+0000","last_undegraded":"2024-09-12T02:28:23.995310+0000","last_fullsized":"2024-09-12T02:28:23.995310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298235+0000","last_change":"2024-09-12T02:28:21.454178+0000","last_active":"2024-09-12T02:28:24.298235+0000","last_peered":"2024-09-12T02:28:24.298235+0000","last_clean":"2024-09-12T02:28:24.298235+0000","last_became_active":"2024-09-12T02:28:21.453871+0000","last_became_peered":"2024-09-12T02:28:21.453871+0000","last_unstale":"2024-09-12T02:28:24.298235+0000","last_undegraded":"2024-09-12T02:28:24.298235+0000","last_fullsized":"2024-09-12T02:28:24.298235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298309+0000","last_change":"2024-09-12T02:28:22.459853+0000","last_active":"2024-09-12T02:28:24.298309+0000","last_peered":"2024-09-12T02:28:24.298309+0000","last_clean":"2024-09-12T02:28:24.298309+0000","last_became_active":"2024-09-12T02:28:22.459611+0000","last_became_peered":"2024-09-12T02:28:22.459611+0000","last_unstale":"2024-09-12T02:28:24.298309+0000","last_undegraded":"2024-09-12T02:28:24.298309+0000","last_fullsized":"2024-09-12T02:28:24.298309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.290900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462368+0000","last_change":"2024-09-12T02:28:21.449223+0000","last_active":"2024-09-12T02:28:23.462368+0000","last_peered":"2024-09-12T02:28:23.462368+0000","last_clean":"2024-09-12T02:28:23.462368+0000","last_became_active":"2024-09-12T02:28:21.448650+0000","last_became_peered":"2024-09-12T02:28:21.448650+0000","last_unstale":"2024-09-12T02:28:23.462368+0000","last_undegraded":"2024-09-12T02:28:23.462368+0000","last_fullsized":"2024-09-12T02:28:23.462368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462866+0000","last_change":"2024-09-12T02:28:22.463479+0000","last_active":"2024-09-12T02:28:23.462866+0000","last_peered":"2024-09-12T02:28:23.462866+0000","last_clean":"2024-09-12T02:28:23.462866+0000","last_became_active":"2024-09-12T02:28:22.463208+0000","last_became_peered":"2024-09-12T02:28:22.463208+0000","last_unstale":"2024-09-12T02:28:23.462866+0000","last_undegraded":"2024-09-12T02:28:23.462866+0000","last_fullsized":"2024-09-12T02:28:23.462866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251159+0000","last_change":"2024-09-12T02:28:21.451427+0000","last_active":"2024-09-12T02:28:24.251159+0000","last_peered":"2024-09-12T02:28:24.251159+0000","last_clean":"2024-09-12T02:28:24.251159+0000","last_became_active":"2024-09-12T02:28:21.451124+0000","last_became_peered":"2024-09-12T02:28:21.451124+0000","last_unstale":"2024-09-12T02:28:24.251159+0000","last_undegraded":"2024-09-12T02:28:24.251159+0000","last_fullsized":"2024-09-12T02:28:24.251159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.656183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298014+0000","last_change":"2024-09-12T02:28:22.456047+0000","last_active":"2024-09-12T02:28:24.298014+0000","last_peered":"2024-09-12T02:28:24.298014+0000","last_clean":"2024-09-12T02:28:24.298014+0000","last_became_active":"2024-09-12T02:28:22.455803+0000","last_became_peered":"2024-09-12T02:28:22.455803+0000","last_unstale":"2024-09-12T02:28:24.298014+0000","last_undegraded":"2024-09-12T02:28:24.298014+0000","last_fullsized":"2024-09-12T02:28:24.298014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:50.825935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463657+0000","last_change":"2024-09-12T02:28:21.461510+0000","last_active":"2024-09-12T02:28:23.463657+0000","last_peered":"2024-09-12T02:28:23.463657+0000","last_clean":"2024-09-12T02:28:23.463657+0000","last_became_active":"2024-09-12T02:28:21.461183+0000","last_became_peered":"2024-09-12T02:28:21.461183+0000","last_unstale":"2024-09-12T02:28:23.463657+0000","last_undegraded":"2024-09-12T02:28:23.463657+0000","last_fullsized":"2024-09-12T02:28:23.463657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.909426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298086+0000","last_change":"2024-09-12T02:28:22.459244+0000","last_active":"2024-09-12T02:28:24.298086+0000","last_peered":"2024-09-12T02:28:24.298086+0000","last_clean":"2024-09-12T02:28:24.298086+0000","last_became_active":"2024-09-12T02:28:22.458948+0000","last_became_peered":"2024-09-12T02:28:22.458948+0000","last_unstale":"2024-09-12T02:28:24.298086+0000","last_undegraded":"2024-09-12T02:28:24.298086+0000","last_fullsized":"2024-09-12T02:28:24.298086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.507175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251362+0000","last_change":"2024-09-12T02:28:21.448604+0000","last_active":"2024-09-12T02:28:24.251362+0000","last_peered":"2024-09-12T02:28:24.251362+0000","last_clean":"2024-09-12T02:28:24.251362+0000","last_became_active":"2024-09-12T02:28:21.448165+0000","last_became_peered":"2024-09-12T02:28:21.448165+0000","last_unstale":"2024-09-12T02:28:24.251362+0000","last_undegraded":"2024-09-12T02:28:24.251362+0000","last_fullsized":"2024-09-12T02:28:24.251362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:25.512376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298838+0000","last_change":"2024-09-12T02:28:22.458525+0000","last_active":"2024-09-12T02:28:24.298838+0000","last_peered":"2024-09-12T02:28:24.298838+0000","last_clean":"2024-09-12T02:28:24.298838+0000","last_became_active":"2024-09-12T02:28:22.458270+0000","last_became_peered":"2024-09-12T02:28:22.458270+0000","last_unstale":"2024-09-12T02:28:24.298838+0000","last_undegraded":"2024-09-12T02:28:24.298838+0000","last_fullsized":"2024-09-12T02:28:24.298838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:39.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459647+0000","last_change":"2024-09-12T02:28:21.456310+0000","last_active":"2024-09-12T02:28:23.459647+0000","last_peered":"2024-09-12T02:28:23.459647+0000","last_clean":"2024-09-12T02:28:23.459647+0000","last_became_active":"2024-09-12T02:28:21.455875+0000","last_became_peered":"2024-09-12T02:28:21.455875+0000","last_unstale":"2024-09-12T02:28:23.459647+0000","last_undegraded":"2024-09-12T02:28:23.459647+0000","last_fullsized":"2024-09-12T02:28:23.459647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298346+0000","last_change":"2024-09-12T02:28:22.470690+0000","last_active":"2024-09-12T02:28:24.298346+0000","last_peered":"2024-09-12T02:28:24.298346+0000","last_clean":"2024-09-12T02:28:24.298346+0000","last_became_active":"2024-09-12T02:28:22.469379+0000","last_became_peered":"2024-09-12T02:28:22.469379+0000","last_unstale":"2024-09-12T02:28:24.298346+0000","last_undegraded":"2024-09-12T02:28:24.298346+0000","last_fullsized":"2024-09-12T02:28:24.298346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.893907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251280+0000","last_change":"2024-09-12T02:28:21.451827+0000","last_active":"2024-09-12T02:28:24.251280+0000","last_peered":"2024-09-12T02:28:24.251280+0000","last_clean":"2024-09-12T02:28:24.251280+0000","last_became_active":"2024-09-12T02:28:21.451567+0000","last_became_peered":"2024-09-12T02:28:21.451567+0000","last_unstale":"2024-09-12T02:28:24.251280+0000","last_undegraded":"2024-09-12T02:28:24.251280+0000","last_fullsized":"2024-09-12T02:28:24.251280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298587+0000","last_change":"2024-09-12T02:28:22.468838+0000","last_active":"2024-09-12T02:28:24.298587+0000","last_peered":"2024-09-12T02:28:24.298587+0000","last_clean":"2024-09-12T02:28:24.298587+0000","last_became_active":"2024-09-12T02:28:22.468221+0000","last_became_peered":"2024-09-12T02:28:22.468221+0000","last_unstale":"2024-09-12T02:28:24.298587+0000","last_undegraded":"2024-09-12T02:28:24.298587+0000","last_fullsized":"2024-09-12T02:28:24.298587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.829525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297450+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:28:24.297450+0000","last_peered":"2024-09-12T02:28:24.297450+0000","last_clean":"2024-09-12T02:28:24.297450+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:28:24.297450+0000","last_undegraded":"2024-09-12T02:28:24.297450+0000","last_fullsized":"2024-09-12T02:28:24.297450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298377+0000","last_change":"2024-09-12T02:28:21.456961+0000","last_active":"2024-09-12T02:28:24.298377+0000","last_peered":"2024-09-12T02:28:24.298377+0000","last_clean":"2024-09-12T02:28:24.298377+0000","last_became_active":"2024-09-12T02:28:21.456682+0000","last_became_peered":"2024-09-12T02:28:21.456682+0000","last_unstale":"2024-09-12T02:28:24.298377+0000","last_undegraded":"2024-09-12T02:28:24.298377+0000","last_fullsized":"2024-09-12T02:28:24.298377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297376+0000","last_change":"2024-09-12T02:28:22.468056+0000","last_active":"2024-09-12T02:28:24.297376+0000","last_peered":"2024-09-12T02:28:24.297376+0000","last_clean":"2024-09-12T02:28:24.297376+0000","last_became_active":"2024-09-12T02:28:22.467654+0000","last_became_peered":"2024-09-12T02:28:22.467654+0000","last_unstale":"2024-09-12T02:28:24.297376+0000","last_undegraded":"2024-09-12T02:28:24.297376+0000","last_fullsized":"2024-09-12T02:28:24.297376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:01.840287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297294+0000","last_change":"2024-09-12T02:28:21.462547+0000","last_active":"2024-09-12T02:28:24.297294+0000","last_peered":"2024-09-12T02:28:24.297294+0000","last_clean":"2024-09-12T02:28:24.297294+0000","last_became_active":"2024-09-12T02:28:21.462186+0000","last_became_peered":"2024-09-12T02:28:21.462186+0000","last_unstale":"2024-09-12T02:28:24.297294+0000","last_undegraded":"2024-09-12T02:28:24.297294+0000","last_fullsized":"2024-09-12T02:28:24.297294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995210+0000","last_change":"2024-09-12T02:28:22.457842+0000","last_active":"2024-09-12T02:28:23.995210+0000","last_peered":"2024-09-12T02:28:23.995210+0000","last_clean":"2024-09-12T02:28:23.995210+0000","last_became_active":"2024-09-12T02:28:22.457001+0000","last_became_peered":"2024-09-12T02:28:22.457001+0000","last_unstale":"2024-09-12T02:28:23.995210+0000","last_undegraded":"2024-09-12T02:28:23.995210+0000","last_fullsized":"2024-09-12T02:28:23.995210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251305+0000","last_change":"2024-09-12T02:28:21.449367+0000","last_active":"2024-09-12T02:28:24.251305+0000","last_peered":"2024-09-12T02:28:24.251305+0000","last_clean":"2024-09-12T02:28:24.251305+0000","last_became_active":"2024-09-12T02:28:21.448265+0000","last_became_peered":"2024-09-12T02:28:21.448265+0000","last_unstale":"2024-09-12T02:28:24.251305+0000","last_undegraded":"2024-09-12T02:28:24.251305+0000","last_fullsized":"2024-09-12T02:28:24.251305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:16.640297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459760+0000","last_change":"2024-09-12T02:28:22.458123+0000","last_active":"2024-09-12T02:28:23.459760+0000","last_peered":"2024-09-12T02:28:23.459760+0000","last_clean":"2024-09-12T02:28:23.459760+0000","last_became_active":"2024-09-12T02:28:22.457250+0000","last_became_peered":"2024-09-12T02:28:22.457250+0000","last_unstale":"2024-09-12T02:28:23.459760+0000","last_undegraded":"2024-09-12T02:28:23.459760+0000","last_fullsized":"2024-09-12T02:28:23.459760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298438+0000","last_change":"2024-09-12T02:28:21.457643+0000","last_active":"2024-09-12T02:28:24.298438+0000","last_peered":"2024-09-12T02:28:24.298438+0000","last_clean":"2024-09-12T02:28:24.298438+0000","last_became_active":"2024-09-12T02:28:21.457340+0000","last_became_peered":"2024-09-12T02:28:21.457340+0000","last_unstale":"2024-09-12T02:28:24.298438+0000","last_undegraded":"2024-09-12T02:28:24.298438+0000","last_fullsized":"2024-09-12T02:28:24.298438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462588+0000","last_change":"2024-09-12T02:28:22.466165+0000","last_active":"2024-09-12T02:28:23.462588+0000","last_peered":"2024-09-12T02:28:23.462588+0000","last_clean":"2024-09-12T02:28:23.462588+0000","last_became_active":"2024-09-12T02:28:22.465870+0000","last_became_peered":"2024-09-12T02:28:22.465870+0000","last_unstale":"2024-09-12T02:28:23.462588+0000","last_undegraded":"2024-09-12T02:28:23.462588+0000","last_fullsized":"2024-09-12T02:28:23.462588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:09.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459593+0000","last_change":"2024-09-12T02:28:21.461428+0000","last_active":"2024-09-12T02:28:23.459593+0000","last_peered":"2024-09-12T02:28:23.459593+0000","last_clean":"2024-09-12T02:28:23.459593+0000","last_became_active":"2024-09-12T02:28:21.461117+0000","last_became_peered":"2024-09-12T02:28:21.461117+0000","last_unstale":"2024-09-12T02:28:23.459593+0000","last_undegraded":"2024-09-12T02:28:23.459593+0000","last_fullsized":"2024-09-12T02:28:23.459593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298072+0000","last_change":"2024-09-12T02:28:22.470508+0000","last_active":"2024-09-12T02:28:24.298072+0000","last_peered":"2024-09-12T02:28:24.298072+0000","last_clean":"2024-09-12T02:28:24.298072+0000","last_became_active":"2024-09-12T02:28:22.470220+0000","last_became_peered":"2024-09-12T02:28:22.470220+0000","last_unstale":"2024-09-12T02:28:24.298072+0000","last_undegraded":"2024-09-12T02:28:24.298072+0000","last_fullsized":"2024-09-12T02:28:24.298072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.290900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298806+0000","last_change":"2024-09-12T02:28:21.461899+0000","last_active":"2024-09-12T02:28:24.298806+0000","last_peered":"2024-09-12T02:28:24.298806+0000","last_clean":"2024-09-12T02:28:24.298806+0000","last_became_active":"2024-09-12T02:28:21.461616+0000","last_became_peered":"2024-09-12T02:28:21.461616+0000","last_unstale":"2024-09-12T02:28:24.298806+0000","last_undegraded":"2024-09-12T02:28:24.298806+0000","last_fullsized":"2024-09-12T02:28:24.298806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:55.870005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459550+0000","last_change":"2024-09-12T02:28:22.458683+0000","last_active":"2024-09-12T02:28:23.459550+0000","last_peered":"2024-09-12T02:28:23.459550+0000","last_clean":"2024-09-12T02:28:23.459550+0000","last_became_active":"2024-09-12T02:28:22.458413+0000","last_became_peered":"2024-09-12T02:28:22.458413+0000","last_unstale":"2024-09-12T02:28:23.459550+0000","last_undegraded":"2024-09-12T02:28:23.459550+0000","last_fullsized":"2024-09-12T02:28:23.459550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459717+0000","last_change":"2024-09-12T02:28:21.455450+0000","last_active":"2024-09-12T02:28:23.459717+0000","last_peered":"2024-09-12T02:28:23.459717+0000","last_clean":"2024-09-12T02:28:23.459717+0000","last_became_active":"2024-09-12T02:28:21.455128+0000","last_became_peered":"2024-09-12T02:28:21.455128+0000","last_unstale":"2024-09-12T02:28:23.459717+0000","last_undegraded":"2024-09-12T02:28:23.459717+0000","last_fullsized":"2024-09-12T02:28:23.459717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297588+0000","last_change":"2024-09-12T02:28:22.464804+0000","last_active":"2024-09-12T02:28:24.297588+0000","last_peered":"2024-09-12T02:28:24.297588+0000","last_clean":"2024-09-12T02:28:24.297588+0000","last_became_active":"2024-09-12T02:28:22.464515+0000","last_became_peered":"2024-09-12T02:28:22.464515+0000","last_unstale":"2024-09-12T02:28:24.297588+0000","last_undegraded":"2024-09-12T02:28:24.297588+0000","last_fullsized":"2024-09-12T02:28:24.297588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.429495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463010+0000","last_change":"2024-09-12T02:28:21.457754+0000","last_active":"2024-09-12T02:28:23.463010+0000","last_peered":"2024-09-12T02:28:23.463010+0000","last_clean":"2024-09-12T02:28:23.463010+0000","last_became_active":"2024-09-12T02:28:21.457443+0000","last_became_peered":"2024-09-12T02:28:21.457443+0000","last_unstale":"2024-09-12T02:28:23.463010+0000","last_undegraded":"2024-09-12T02:28:23.463010+0000","last_fullsized":"2024-09-12T02:28:23.463010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995496+0000","last_change":"2024-09-12T02:28:22.463795+0000","last_active":"2024-09-12T02:28:23.995496+0000","last_peered":"2024-09-12T02:28:23.995496+0000","last_clean":"2024-09-12T02:28:23.995496+0000","last_became_active":"2024-09-12T02:28:22.463408+0000","last_became_peered":"2024-09-12T02:28:22.463408+0000","last_unstale":"2024-09-12T02:28:23.995496+0000","last_undegraded":"2024-09-12T02:28:23.995496+0000","last_fullsized":"2024-09-12T02:28:23.995496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297286+0000","last_change":"2024-09-12T02:28:21.462250+0000","last_active":"2024-09-12T02:28:24.297286+0000","last_peered":"2024-09-12T02:28:24.297286+0000","last_clean":"2024-09-12T02:28:24.297286+0000","last_became_active":"2024-09-12T02:28:21.461734+0000","last_became_peered":"2024-09-12T02:28:21.461734+0000","last_unstale":"2024-09-12T02:28:24.297286+0000","last_undegraded":"2024-09-12T02:28:24.297286+0000","last_fullsized":"2024-09-12T02:28:24.297286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:27.705966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462792+0000","last_change":"2024-09-12T02:28:22.459098+0000","last_active":"2024-09-12T02:28:23.462792+0000","last_peered":"2024-09-12T02:28:23.462792+0000","last_clean":"2024-09-12T02:28:23.462792+0000","last_became_active":"2024-09-12T02:28:22.457658+0000","last_became_peered":"2024-09-12T02:28:22.457658+0000","last_unstale":"2024-09-12T02:28:23.462792+0000","last_undegraded":"2024-09-12T02:28:23.462792+0000","last_fullsized":"2024-09-12T02:28:23.462792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459625+0000","last_change":"2024-09-12T02:28:21.457547+0000","last_active":"2024-09-12T02:28:23.459625+0000","last_peered":"2024-09-12T02:28:23.459625+0000","last_clean":"2024-09-12T02:28:23.459625+0000","last_became_active":"2024-09-12T02:28:21.457263+0000","last_became_peered":"2024-09-12T02:28:21.457263+0000","last_unstale":"2024-09-12T02:28:23.459625+0000","last_undegraded":"2024-09-12T02:28:23.459625+0000","last_fullsized":"2024-09-12T02:28:23.459625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297338+0000","last_change":"2024-09-12T02:28:22.459832+0000","last_active":"2024-09-12T02:28:24.297338+0000","last_peered":"2024-09-12T02:28:24.297338+0000","last_clean":"2024-09-12T02:28:24.297338+0000","last_became_active":"2024-09-12T02:28:22.459559+0000","last_became_peered":"2024-09-12T02:28:22.459559+0000","last_unstale":"2024-09-12T02:28:24.297338+0000","last_undegraded":"2024-09-12T02:28:24.297338+0000","last_fullsized":"2024-09-12T02:28:24.297338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.382251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459771+0000","last_change":"2024-09-12T02:28:21.454638+0000","last_active":"2024-09-12T02:28:23.459771+0000","last_peered":"2024-09-12T02:28:23.459771+0000","last_clean":"2024-09-12T02:28:23.459771+0000","last_became_active":"2024-09-12T02:28:21.454339+0000","last_became_peered":"2024-09-12T02:28:21.454339+0000","last_unstale":"2024-09-12T02:28:23.459771+0000","last_undegraded":"2024-09-12T02:28:23.459771+0000","last_fullsized":"2024-09-12T02:28:23.459771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297506+0000","last_change":"2024-09-12T02:28:22.475121+0000","last_active":"2024-09-12T02:28:24.297506+0000","last_peered":"2024-09-12T02:28:24.297506+0000","last_clean":"2024-09-12T02:28:24.297506+0000","last_became_active":"2024-09-12T02:28:22.474844+0000","last_became_peered":"2024-09-12T02:28:22.474844+0000","last_unstale":"2024-09-12T02:28:24.297506+0000","last_undegraded":"2024-09-12T02:28:24.297506+0000","last_fullsized":"2024-09-12T02:28:24.297506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:19.714606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298384+0000","last_change":"2024-09-12T02:28:21.462703+0000","last_active":"2024-09-12T02:28:24.298384+0000","last_peered":"2024-09-12T02:28:24.298384+0000","last_clean":"2024-09-12T02:28:24.298384+0000","last_became_active":"2024-09-12T02:28:21.462354+0000","last_became_peered":"2024-09-12T02:28:21.462354+0000","last_unstale":"2024-09-12T02:28:24.298384+0000","last_undegraded":"2024-09-12T02:28:24.298384+0000","last_fullsized":"2024-09-12T02:28:24.298384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:45.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462696+0000","last_change":"2024-09-12T02:28:22.465703+0000","last_active":"2024-09-12T02:28:23.462696+0000","last_peered":"2024-09-12T02:28:23.462696+0000","last_clean":"2024-09-12T02:28:23.462696+0000","last_became_active":"2024-09-12T02:28:22.465439+0000","last_became_peered":"2024-09-12T02:28:22.465439+0000","last_unstale":"2024-09-12T02:28:23.462696+0000","last_undegraded":"2024-09-12T02:28:23.462696+0000","last_fullsized":"2024-09-12T02:28:23.462696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297890+0000","last_change":"2024-09-12T02:28:22.464376+0000","last_active":"2024-09-12T02:28:24.297890+0000","last_peered":"2024-09-12T02:28:24.297890+0000","last_clean":"2024-09-12T02:28:24.297890+0000","last_became_active":"2024-09-12T02:28:22.464058+0000","last_became_peered":"2024-09-12T02:28:22.464058+0000","last_unstale":"2024-09-12T02:28:24.297890+0000","last_undegraded":"2024-09-12T02:28:24.297890+0000","last_fullsized":"2024-09-12T02:28:24.297890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:50.825935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297772+0000","last_change":"2024-09-12T02:28:21.459499+0000","last_active":"2024-09-12T02:28:24.297772+0000","last_peered":"2024-09-12T02:28:24.297772+0000","last_clean":"2024-09-12T02:28:24.297772+0000","last_became_active":"2024-09-12T02:28:21.459190+0000","last_became_peered":"2024-09-12T02:28:21.459190+0000","last_unstale":"2024-09-12T02:28:24.297772+0000","last_undegraded":"2024-09-12T02:28:24.297772+0000","last_fullsized":"2024-09-12T02:28:24.297772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298200+0000","last_change":"2024-09-12T02:28:22.467912+0000","last_active":"2024-09-12T02:28:24.298200+0000","last_peered":"2024-09-12T02:28:24.298200+0000","last_clean":"2024-09-12T02:28:24.298200+0000","last_became_active":"2024-09-12T02:28:22.467615+0000","last_became_peered":"2024-09-12T02:28:22.467615+0000","last_unstale":"2024-09-12T02:28:24.298200+0000","last_undegraded":"2024-09-12T02:28:24.298200+0000","last_fullsized":"2024-09-12T02:28:24.298200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:52.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298701+0000","last_change":"2024-09-12T02:28:21.462426+0000","last_active":"2024-09-12T02:28:24.298701+0000","last_peered":"2024-09-12T02:28:24.298701+0000","last_clean":"2024-09-12T02:28:24.298701+0000","last_became_active":"2024-09-12T02:28:21.462107+0000","last_became_peered":"2024-09-12T02:28:21.462107+0000","last_unstale":"2024-09-12T02:28:24.298701+0000","last_undegraded":"2024-09-12T02:28:24.298701+0000","last_fullsized":"2024-09-12T02:28:24.298701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:08.206286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995479+0000","last_change":"2024-09-12T02:28:22.468618+0000","last_active":"2024-09-12T02:28:23.995479+0000","last_peered":"2024-09-12T02:28:23.995479+0000","last_clean":"2024-09-12T02:28:23.995479+0000","last_became_active":"2024-09-12T02:28:22.468188+0000","last_became_peered":"2024-09-12T02:28:22.468188+0000","last_unstale":"2024-09-12T02:28:23.995479+0000","last_undegraded":"2024-09-12T02:28:23.995479+0000","last_fullsized":"2024-09-12T02:28:23.995479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297499+0000","last_change":"2024-09-12T02:28:21.462214+0000","last_active":"2024-09-12T02:28:24.297499+0000","last_peered":"2024-09-12T02:28:24.297499+0000","last_clean":"2024-09-12T02:28:24.297499+0000","last_became_active":"2024-09-12T02:28:21.461911+0000","last_became_peered":"2024-09-12T02:28:21.461911+0000","last_unstale":"2024-09-12T02:28:24.297499+0000","last_undegraded":"2024-09-12T02:28:24.297499+0000","last_fullsized":"2024-09-12T02:28:24.297499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.656183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297467+0000","last_change":"2024-09-12T02:28:22.463363+0000","last_active":"2024-09-12T02:28:24.297467+0000","last_peered":"2024-09-12T02:28:24.297467+0000","last_clean":"2024-09-12T02:28:24.297467+0000","last_became_active":"2024-09-12T02:28:22.463101+0000","last_became_peered":"2024-09-12T02:28:22.463101+0000","last_unstale":"2024-09-12T02:28:24.297467+0000","last_undegraded":"2024-09-12T02:28:24.297467+0000","last_fullsized":"2024-09-12T02:28:24.297467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.463443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995570+0000","last_change":"2024-09-12T02:28:21.461271+0000","last_active":"2024-09-12T02:28:23.995570+0000","last_peered":"2024-09-12T02:28:23.995570+0000","last_clean":"2024-09-12T02:28:23.995570+0000","last_became_active":"2024-09-12T02:28:21.460986+0000","last_became_peered":"2024-09-12T02:28:21.460986+0000","last_unstale":"2024-09-12T02:28:23.995570+0000","last_undegraded":"2024-09-12T02:28:23.995570+0000","last_fullsized":"2024-09-12T02:28:23.995570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:58.924252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":662973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:28:30.057 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:28:30.057 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:28:30.058 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:28:30.058 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T02:28:30.058 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T02:28:30.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.188+0000 7f95543be640 1 Processor -- start 2024-09-12T02:28:30.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.188+0000 7f95543be640 1 -- start start 2024-09-12T02:28:30.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.189+0000 7f95543be640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f954c06cd90 0x7f954c0d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.189+0000 7f95543be640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c0d0e20 0x7f954c0d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.189+0000 7f95543be640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954c0d3040 con 0x7f954c161c60 2024-09-12T02:28:30.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.189+0000 7f95543be640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f954c0d2df0 con 0x7f954c06cd90 2024-09-12T02:28:30.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.189+0000 7f95543be640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f954c073050 con 0x7f954c0d0e20 2024-09-12T02:28:30.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.189+0000 7f9551959640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f954c06cd90 0x7f954c0d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f9551959640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f954c06cd90 0x7f954c0d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51586/0 (socket says 172.21.15.181:51586) 2024-09-12T02:28:30.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f955215a640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f954c161c60 0x7f954c06d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54286/0 (socket says 172.21.15.181:54286) 2024-09-12T02:28:30.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f9551959640 1 -- 172.21.15.181:0/605245105 learned_addr learned my addr 172.21.15.181:0/605245105 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:30.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f955295b640 1 --2- 172.21.15.181:0/605245105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c0d0e20 0x7f954c0d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f9551959640 1 -- 172.21.15.181:0/605245105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c0d0e20 msgr2=0x7f954c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:30.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f9551959640 1 --2- 172.21.15.181:0/605245105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c0d0e20 0x7f954c0d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f9551959640 1 -- 172.21.15.181:0/605245105 >> v1:172.21.15.181:6789/0 conn(0x7f954c161c60 legacy=0x7f954c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.190+0000 7f9551959640 1 -- 172.21.15.181:0/605245105 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c073330 con 0x7f954c06cd90 2024-09-12T02:28:30.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f9551959640 1 --2- 172.21.15.181:0/605245105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c06cd90 0x7f954c0d1e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9540009870 tx=0x7f954002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f053ad2249cc7c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f9551158640 1 -- 172.21.15.181:0/605245105 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540037070 con 0x7f954c06cd90 2024-09-12T02:28:30.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f9551158640 1 -- 172.21.15.181:0/605245105 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9540032440 con 0x7f954c06cd90 2024-09-12T02:28:30.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f9551158640 1 -- 172.21.15.181:0/605245105 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540032810 con 0x7f954c06cd90 2024-09-12T02:28:30.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 -- 172.21.15.181:0/605245105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c06cd90 msgr2=0x7f954c0d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 --2- 172.21.15.181:0/605245105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c06cd90 0x7f954c0d1e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9540009870 tx=0x7f954002a130 comp rx=0 tx=0).stop 2024-09-12T02:28:30.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 -- 172.21.15.181:0/605245105 shutdown_connections 2024-09-12T02:28:30.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 --2- 172.21.15.181:0/605245105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c0d0e20 0x7f954c0d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 --2- 172.21.15.181:0/605245105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c06cd90 0x7f954c0d1e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 -- 172.21.15.181:0/605245105 >> 172.21.15.181:0/605245105 conn(0x7f954c067950 msgr2=0x7f954c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:30.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 -- 172.21.15.181:0/605245105 shutdown_connections 2024-09-12T02:28:30.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.191+0000 7f95543be640 1 -- 172.21.15.181:0/605245105 wait complete. 2024-09-12T02:28:30.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.192+0000 7f95543be640 1 Processor -- start 2024-09-12T02:28:30.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f95543be640 1 -- start start 2024-09-12T02:28:30.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f95543be640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f954c06cd90 0x7f954c1e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f95543be640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c0d0e20 0x7f954c14e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f95543be640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c161c60 0x7f954c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f95543be640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0b4090 con 0x7f954c0d0e20 2024-09-12T02:28:30.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f95543be640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f954c074100 con 0x7f954c06cd90 2024-09-12T02:28:30.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f95543be640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f954c0b4210 con 0x7f954c161c60 2024-09-12T02:28:30.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c0d0e20 0x7f954c14e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c0d0e20 0x7f954c14e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51590/0 (socket says 172.21.15.181:51590) 2024-09-12T02:28:30.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 -- 172.21.15.181:0/507690659 learned_addr learned my addr 172.21.15.181:0/507690659 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:30.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 -- 172.21.15.181:0/507690659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c161c60 msgr2=0x7f954c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c161c60 0x7f954c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 -- 172.21.15.181:0/507690659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f954c06cd90 msgr2=0x7f954c1e88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f954c06cd90 0x7f954c1e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.193+0000 7f9551959640 1 -- 172.21.15.181:0/507690659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c159900 con 0x7f954c0d0e20 2024-09-12T02:28:30.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.194+0000 7f9551959640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c0d0e20 0x7f954c14e7e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9540000c00 tx=0x7f95400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.194+0000 7f954affd640 1 -- 172.21.15.181:0/507690659 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540037040 con 0x7f954c0d0e20 2024-09-12T02:28:30.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.194+0000 7f954affd640 1 -- 172.21.15.181:0/507690659 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9540042070 con 0x7f954c0d0e20 2024-09-12T02:28:30.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.194+0000 7f954affd640 1 -- 172.21.15.181:0/507690659 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540030bd0 con 0x7f954c0d0e20 2024-09-12T02:28:30.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.194+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c159be0 con 0x7f954c0d0e20 2024-09-12T02:28:30.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.194+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c15a1a0 con 0x7f954c0d0e20 2024-09-12T02:28:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.195+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c0d1290 con 0x7f954c0d0e20 2024-09-12T02:28:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.195+0000 7f954affd640 1 -- 172.21.15.181:0/507690659 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9540047460 con 0x7f954c0d0e20 2024-09-12T02:28:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.196+0000 7f954affd640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f953806be30 0x7f953806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.196+0000 7f954affd640 1 -- 172.21.15.181:0/507690659 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95400abaa0 con 0x7f954c0d0e20 2024-09-12T02:28:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.196+0000 7f955215a640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f953806be30 0x7f953806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.196+0000 7f955215a640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f953806be30 0x7f953806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9544000f60 tx=0x7f9544007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.200+0000 7f954affd640 1 -- 172.21.15.181:0/507690659 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9540045360 con 0x7f954c0d0e20 2024-09-12T02:28:30.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.409+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f954c070b20 con 0x7f954c0d0e20 2024-09-12T02:28:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.412+0000 7f954affd640 1 -- 172.21.15.181:0/507690659 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172945 (secure 0 0 0) 0x7f954007a450 con 0x7f954c0d0e20 2024-09-12T02:28:30.417 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f953806be30 msgr2=0x7f953806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f953806be30 0x7f953806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9544000f60 tx=0x7f9544007a00 comp rx=0 tx=0).stop 2024-09-12T02:28:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c0d0e20 msgr2=0x7f954c14e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c0d0e20 0x7f954c14e7e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9540000c00 tx=0x7f95400046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 shutdown_connections 2024-09-12T02:28:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f953806be30 0x7f953806e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f954c161c60 0x7f954c14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f954c0d0e20 0x7f954c14e7e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.414+0000 7f95543be640 1 --2- 172.21.15.181:0/507690659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f954c06cd90 0x7f954c1e88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.415+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 >> 172.21.15.181:0/507690659 conn(0x7f954c067950 msgr2=0x7f954c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.415+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 shutdown_connections 2024-09-12T02:28:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.415+0000 7f95543be640 1 -- 172.21.15.181:0/507690659 wait complete. 2024-09-12T02:28:30.426 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3184205121},{"type":"v1","addr":"172.21.15.181:6825","nonce":3184205121}]},"active_addr":"172.21.15.181:6825/3184205121","active_change":"2024-09-12T02:28:03.602741+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3670135635}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":1861308031}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":2154070615}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":189452211}]}]} 2024-09-12T02:28:30.436 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T02:28:30.436 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T02:28:30.437 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:30.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.538+0000 7f8846aa6640 1 Processor -- start 2024-09-12T02:28:30.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.538+0000 7f8846aa6640 1 -- start start 2024-09-12T02:28:30.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.538+0000 7f8846aa6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f88400d2da0 0x7f88400cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.538+0000 7f8846aa6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88400d0a30 con 0x7f884015c4a0 2024-09-12T02:28:30.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.538+0000 7f8846aa6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88400b76f0 con 0x7f88400b47a0 2024-09-12T02:28:30.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.538+0000 7f8846aa6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f88400d0d30 con 0x7f88400d2da0 2024-09-12T02:28:30.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8844842640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f884015c4a0 0x7f88400b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54288/0 (socket says 172.21.15.181:54288) 2024-09-12T02:28:30.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8844842640 1 -- 172.21.15.181:0/545431495 learned_addr learned my addr 172.21.15.181:0/545431495 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:30.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8845043640 1 --2- 172.21.15.181:0/545431495 >> v2:172.21.15.204:3300/0 conn(0x7f88400d2da0 0x7f88400cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802780439 0 0) 0x7f88400d0a30 con 0x7f884015c4a0 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f882c003520 con 0x7f884015c4a0 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3149741519 0 0) 0x7f882c003520 con 0x7f884015c4a0 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 >> v2:172.21.15.204:3300/0 conn(0x7f88400d2da0 msgr2=0x7f88400cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 --2- 172.21.15.181:0/545431495 >> v2:172.21.15.204:3300/0 conn(0x7f88400d2da0 0x7f88400cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 >> v1:172.21.15.204:6789/0 conn(0x7f88400b47a0 legacy=0x7f8840164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8840073710 con 0x7f884015c4a0 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f8838001670 con 0x7f884015c4a0 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 >> v1:172.21.15.181:6789/0 conn(0x7f884015c4a0 legacy=0x7f88400b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f882c0039b0 0x7f882c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f882c004800 0x7f882c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f882c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f88400d0d30 con 0x7f882c0051c0 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f882c00c160 con 0x7f882c004800 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f882c00c360 con 0x7f882c0039b0 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8845043640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f882c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8844842640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f882c0039b0 0x7f882c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f883ffff640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f882c004800 0x7f882c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8845043640 1 -- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f882c0039b0 msgr2=0x7f882c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8845043640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f882c0039b0 0x7f882c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8845043640 1 -- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f882c004800 msgr2=0x7f882c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8845043640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f882c004800 0x7f882c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.539+0000 7f8845043640 1 -- 172.21.15.181:0/545431495 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c003520 con 0x7f882c0051c0 2024-09-12T02:28:30.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.540+0000 7f8845043640 1 -- 172.21.15.181:0/545431495 reap_dead start 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.540+0000 7f8845043640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f882c00b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8828009a90 tx=0x7f882c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b823df75991a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.540+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828036070 con 0x7f882c0051c0 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.540+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8828031400 con 0x7f882c0051c0 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.540+0000 7f883f7fe640 1 -- 172.21.15.181:0/545431495 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828009690 con 0x7f882c0051c0 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.541+0000 7f8846aa6640 1 -- 172.21.15.181:0/545431495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 msgr2=0x7f882c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.541+0000 7f8846aa6640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f882c00b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8828009a90 tx=0x7f882c005830 comp rx=0 tx=0).stop 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.541+0000 7f8846aa6640 1 -- 172.21.15.181:0/545431495 shutdown_connections 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.541+0000 7f8846aa6640 1 --2- 172.21.15.181:0/545431495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f882c00b9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.541+0000 7f8846aa6640 1 -- 172.21.15.181:0/545431495 >> 172.21.15.181:0/545431495 conn(0x7f8840067950 msgr2=0x7f8840067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.541+0000 7f8846aa6640 1 -- 172.21.15.181:0/545431495 shutdown_connections 2024-09-12T02:28:30.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.541+0000 7f8846aa6640 1 -- 172.21.15.181:0/545431495 wait complete. 2024-09-12T02:28:30.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.542+0000 7f8846aa6640 1 Processor -- start 2024-09-12T02:28:30.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.542+0000 7f8846aa6640 1 -- start start 2024-09-12T02:28:30.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8846aa6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f88401f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8846aa6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8840154fe0 0x7f884014d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8846aa6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8840155e60 0x7f8840157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8846aa6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f88400cff80 con 0x7f882c0051c0 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8846aa6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f88400d28e0 con 0x7f8840155e60 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8846aa6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f88400d0100 con 0x7f8840154fe0 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f88401f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f88401f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51608/0 (socket says 172.21.15.181:51608) 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 -- 172.21.15.181:0/3633380127 learned_addr learned my addr 172.21.15.181:0/3633380127 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f883ffff640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8840154fe0 0x7f884014d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8845043640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8840155e60 0x7f8840157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 -- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8840154fe0 msgr2=0x7f884014d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8840154fe0 0x7f884014d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 -- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8840155e60 msgr2=0x7f8840157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8840155e60 0x7f8840157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 -- 172.21.15.181:0/3633380127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8840156790 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.543+0000 7f8844842640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f88401f2050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88380072c0 tx=0x7f8838007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.544+0000 7f883d7fa640 1 -- 172.21.15.181:0/3633380127 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883800f960 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.544+0000 7f883d7fa640 1 -- 172.21.15.181:0/3633380127 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8838018070 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.544+0000 7f883d7fa640 1 -- 172.21.15.181:0/3633380127 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883800fd60 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.544+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884014f0a0 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.544+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884014d5c0 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.545+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884015c880 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.545+0000 7f883d7fa640 1 -- 172.21.15.181:0/3633380127 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f883801d460 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.545+0000 7f883d7fa640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f882006be60 0x7f882006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.546+0000 7f883d7fa640 1 -- 172.21.15.181:0/3633380127 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f883808afe0 con 0x7f882c0051c0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.546+0000 7f883ffff640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f882006be60 0x7f882006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.546+0000 7f883ffff640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f882006be60 0x7f882006e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8840150d50 tx=0x7f8830009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.550+0000 7f883d7fa640 1 -- 172.21.15.181:0/3633380127 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8838059990 con 0x7f882c0051c0 2024-09-12T02:28:30.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.717+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88400b43b0 con 0x7f882c0051c0 2024-09-12T02:28:30.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.718+0000 7f883d7fa640 1 -- 172.21.15.181:0/3633380127 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16737 (secure 0 0 0) 0x7f8838059290 con 0x7f882c0051c0 2024-09-12T02:28:30.720 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:30.720 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:23.452762+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:30.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.720+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f882006be60 msgr2=0x7f882006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.720+0000 7f8846aa6640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f882006be60 0x7f882006e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8840150d50 tx=0x7f8830009040 comp rx=0 tx=0).stop 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.720+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 msgr2=0x7f88401f2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.720+0000 7f8846aa6640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f88401f2050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88380072c0 tx=0x7f8838007780 comp rx=0 tx=0).stop 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 shutdown_connections 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f882006be60 0x7f882006e320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8840155e60 0x7f8840157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8840154fe0 0x7f884014d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 --2- 172.21.15.181:0/3633380127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f882c0051c0 0x7f88401f2050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 >> 172.21.15.181:0/3633380127 conn(0x7f8840067950 msgr2=0x7f884015af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 shutdown_connections 2024-09-12T02:28:30.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.721+0000 7f8846aa6640 1 -- 172.21.15.181:0/3633380127 wait complete. 2024-09-12T02:28:30.732 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T02:28:30.732 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.829+0000 7f9861db9640 1 Processor -- start 2024-09-12T02:28:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.829+0000 7f9861db9640 1 -- start start 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f9861db9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f9861db9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f985c0b2490 0x7f985c071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f9861db9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f985c0ce4f0 con 0x7f985c0cdfc0 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f9861db9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f985c15b6c0 con 0x7f985c0b2490 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f9861db9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f985c0ce7d0 con 0x7f985c15b2e0 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f985bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f985c0b2490 0x7f985c071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f985affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f985c0cdfc0 0x7f985c0b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54292/0 (socket says 172.21.15.181:54292) 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f985affd640 1 -- 172.21.15.181:0/3068227460 learned_addr learned my addr 172.21.15.181:0/3068227460 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:30.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.830+0000 7f985b7fe640 1 --2- 172.21.15.181:0/3068227460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985bfff640 1 -- 172.21.15.181:0/3068227460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 msgr2=0x7f985c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985bfff640 1 --2- 172.21.15.181:0/3068227460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985bfff640 1 -- 172.21.15.181:0/3068227460 >> v1:172.21.15.181:6789/0 conn(0x7f985c0cdfc0 legacy=0x7f985c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985bfff640 1 -- 172.21.15.181:0/3068227460 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c0ceab0 con 0x7f985c0b2490 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985a7fc640 1 -- 172.21.15.181:0/3068227460 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476144625 0 0) 0x7f985c0ce4f0 con 0x7f985c0cdfc0 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985bfff640 1 --2- 172.21.15.181:0/3068227460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c071750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9854009d90 tx=0x7f985402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5821366678a8b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985a7fc640 1 -- 172.21.15.181:0/3068227460 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854007740 con 0x7f985c0b2490 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985a7fc640 1 -- 172.21.15.181:0/3068227460 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98540078e0 con 0x7f985c0b2490 2024-09-12T02:28:30.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.831+0000 7f985a7fc640 1 -- 172.21.15.181:0/3068227460 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854007cb0 con 0x7f985c0b2490 2024-09-12T02:28:30.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 -- 172.21.15.181:0/3068227460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 msgr2=0x7f985c071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 --2- 172.21.15.181:0/3068227460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c071750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9854009d90 tx=0x7f985402a660 comp rx=0 tx=0).stop 2024-09-12T02:28:30.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 -- 172.21.15.181:0/3068227460 shutdown_connections 2024-09-12T02:28:30.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 --2- 172.21.15.181:0/3068227460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c071750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 --2- 172.21.15.181:0/3068227460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 -- 172.21.15.181:0/3068227460 >> 172.21.15.181:0/3068227460 conn(0x7f985c06bc10 msgr2=0x7f985c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 -- 172.21.15.181:0/3068227460 shutdown_connections 2024-09-12T02:28:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.832+0000 7f9861db9640 1 -- 172.21.15.181:0/3068227460 wait complete. 2024-09-12T02:28:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.833+0000 7f9861db9640 1 Processor -- start 2024-09-12T02:28:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.833+0000 7f9861db9640 1 -- start start 2024-09-12T02:28:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f9861db9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f9861db9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f985c0cdfc0 0x7f985c150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f9861db9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f9861db9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f985c0712b0 con 0x7f985c0b2490 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f9861db9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f985c071130 con 0x7f985c0cdfc0 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f9861db9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f985c0b4260 con 0x7f985c15b2e0 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51628/0 (socket says 172.21.15.181:51628) 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 -- 172.21.15.181:0/2418644516 learned_addr learned my addr 172.21.15.181:0/2418644516 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985bfff640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985affd640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f985c0cdfc0 0x7f985c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 -- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 msgr2=0x7f985c0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 -- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f985c0cdfc0 msgr2=0x7f985c150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f985c0cdfc0 0x7f985c150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.834+0000 7f985b7fe640 1 -- 172.21.15.181:0/2418644516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c150b40 con 0x7f985c0b2490 2024-09-12T02:28:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.835+0000 7f985b7fe640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c152ae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f984c00d5f0 tx=0x7f984c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.835+0000 7f9843fff640 1 -- 172.21.15.181:0/2418644516 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c0125f0 con 0x7f985c0b2490 2024-09-12T02:28:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.835+0000 7f9843fff640 1 -- 172.21.15.181:0/2418644516 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c019070 con 0x7f985c0b2490 2024-09-12T02:28:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.835+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c153170 con 0x7f985c0b2490 2024-09-12T02:28:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.835+0000 7f9843fff640 1 -- 172.21.15.181:0/2418644516 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c0129d0 con 0x7f985c0b2490 2024-09-12T02:28:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.835+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c153730 con 0x7f985c0b2490 2024-09-12T02:28:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.836+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c0cf630 con 0x7f985c0b2490 2024-09-12T02:28:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.836+0000 7f9843fff640 1 -- 172.21.15.181:0/2418644516 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f984c012b70 con 0x7f985c0b2490 2024-09-12T02:28:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.837+0000 7f9843fff640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f984806be30 0x7f984806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.837+0000 7f9843fff640 1 -- 172.21.15.181:0/2418644516 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f984c08b060 con 0x7f985c0b2490 2024-09-12T02:28:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.837+0000 7f985affd640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f984806be30 0x7f984806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.837+0000 7f985affd640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f984806be30 0x7f984806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9850007f70 tx=0x7f9850007f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:30.841+0000 7f9843fff640 1 -- 172.21.15.181:0/2418644516 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f984c059450 con 0x7f985c0b2490 2024-09-12T02:28:31.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.006+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f985c15bda0 con 0x7f985c0b2490 2024-09-12T02:28:31.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.007+0000 7f9843fff640 1 -- 172.21.15.181:0/2418644516 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16737 (secure 0 0 0) 0x7f984c05d750 con 0x7f985c0b2490 2024-09-12T02:28:31.008 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:31.009 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:23.452762+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:31.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.009+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f984806be30 msgr2=0x7f984806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.009+0000 7f9861db9640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f984806be30 0x7f984806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9850007f70 tx=0x7f9850007f00 comp rx=0 tx=0).stop 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.009+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 msgr2=0x7f985c152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.009+0000 7f9861db9640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c152ae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f984c00d5f0 tx=0x7f984c00dab0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 shutdown_connections 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f984806be30 0x7f984806e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f985c0cdfc0 0x7f985c150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f985c15b2e0 0x7f985c0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 --2- 172.21.15.181:0/2418644516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f985c0b2490 0x7f985c152ae0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 >> 172.21.15.181:0/2418644516 conn(0x7f985c06bc10 msgr2=0x7f985c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 shutdown_connections 2024-09-12T02:28:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.010+0000 7f9861db9640 1 -- 172.21.15.181:0/2418644516 wait complete. 2024-09-12T02:28:31.022 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T02:28:31.023 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T02:28:31.023 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T02:28:31.023 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T02:28:31.024 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T02:28:31.024 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T02:28:31.025 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T02:28:31.025 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T02:28:31.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.187+0000 7eff8ce0e640 1 Processor -- start 2024-09-12T02:28:31.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7f55596f1640 1 Processor -- start 2024-09-12T02:28:31.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.191+0000 7f55596f1640 1 -- start start 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.188+0000 7eff8ce0e640 1 -- start start 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.189+0000 7eff8ce0e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7eff880cf6c0 0x7eff880b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.189+0000 7eff8659c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7eff8808c720 0x7eff8816b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54308/0 (socket says 172.21.15.181:54308) 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.189+0000 7eff8ce0e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff880b4e40 0x7eff880ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.189+0000 7eff86d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff880b4e40 0x7eff880ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff86d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff880b4e40 0x7eff880ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51634/0 (socket says 172.21.15.181:51634) 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff8ce0e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff880b52d0 con 0x7eff8808c720 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff8ce0e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7eff880cdaa0 con 0x7eff880b4e40 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff8ce0e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7eff880cd220 con 0x7eff880cf6c0 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff8659c640 1 -- 172.21.15.181:0/3290969073 learned_addr learned my addr 172.21.15.181:0/3290969073 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff86d9d640 1 -- 172.21.15.181:0/3290969073 >> v2:172.21.15.204:3300/0 conn(0x7eff880cf6c0 msgr2=0x7eff880b4900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:28:31.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff86d9d640 1 --2- 172.21.15.181:0/3290969073 >> v2:172.21.15.204:3300/0 conn(0x7eff880cf6c0 0x7eff880b4900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff86d9d640 1 -- 172.21.15.181:0/3290969073 >> v1:172.21.15.181:6789/0 conn(0x7eff8808c720 legacy=0x7eff8816b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff86d9d640 1 -- 172.21.15.181:0/3290969073 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff880cfdc0 con 0x7eff880b4e40 2024-09-12T02:28:31.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7eff8659c640 1 --1- 172.21.15.181:0/3290969073 >> v1:172.21.15.181:6789/0 conn(0x7eff8808c720 0x7eff8816b2f0 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-12T02:28:31.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.191+0000 7eff86d9d640 1 --2- 172.21.15.181:0/3290969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880b4e40 0x7eff880ce330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff8000c340 tx=0x7eff8003bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29f885d04e86a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7f32ab32a640 1 Processor -- start 2024-09-12T02:28:31.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f8ad8842640 1 Processor -- start 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f55596f1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f55540b28e0 0x7f55540b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f55596f1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f555415a790 0x7f555415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f55596f1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f555415f070 con 0x7f55540cdfc0 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f55596f1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f55540cfe20 con 0x7f55540b28e0 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f55596f1640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f555406f7b0 con 0x7f555415a790 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f5552ffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f55540b28e0 0x7f55540b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f5552ffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f55540b28e0 0x7f55540b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51640/0 (socket says 172.21.15.181:51640) 2024-09-12T02:28:31.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f8ad8842640 1 -- start start 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f5552ffd640 1 -- 172.21.15.181:0/2188410042 learned_addr learned my addr 172.21.15.181:0/2188410042 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.190+0000 7f32ab32a640 1 -- start start 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f32ab32a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a415a820 0x7f32a40b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f32a90c6640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f32a40cdfc0 0x7f32a40ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54322/0 (socket says 172.21.15.181:54322) 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f32ab32a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a40b3290 con 0x7f32a40cdfc0 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f32a90c6640 1 -- 172.21.15.181:0/3207753123 learned_addr learned my addr 172.21.15.181:0/3207753123 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f32ab32a640 1 -- 172.21.15.181:0/3207753123 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a40cf860 con 0x7f32a415eb60 2024-09-12T02:28:31.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f32ab32a640 1 -- 172.21.15.181:0/3207753123 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32a40cfe20 con 0x7f32a415a820 2024-09-12T02:28:31.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.192+0000 7f55527fc640 1 --2- 172.21.15.181:0/2188410042 >> v2:172.21.15.204:3300/0 conn(0x7f555415a790 0x7f555415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f55527fc640 1 -- 172.21.15.181:0/2188410042 >> v2:172.21.15.181:3300/0 conn(0x7f55540b28e0 msgr2=0x7f55540b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7fbb881b7640 1 Processor -- start 2024-09-12T02:28:31.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f5551ffb640 1 -- 172.21.15.181:0/2188410042 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997992115 0 0) 0x7f555415f070 con 0x7f55540cdfc0 2024-09-12T02:28:31.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f55527fc640 1 --2- 172.21.15.181:0/2188410042 >> v2:172.21.15.181:3300/0 conn(0x7f55540b28e0 0x7f55540b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f55527fc640 1 -- 172.21.15.181:0/2188410042 >> v1:172.21.15.181:6789/0 conn(0x7f55540cdfc0 legacy=0x7f555406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f55527fc640 1 -- 172.21.15.181:0/2188410042 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55540b3290 con 0x7f555415a790 2024-09-12T02:28:31.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ad8842640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8ad415e630 0x7f8ad406f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ad8842640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8ad40cd6c0 0x7f8ad40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ad8842640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 0x7f8ad40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ad8842640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad406e350 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ad8842640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad415ea10 con 0x7f8ad415e630 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ad8842640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad4162f40 con 0x7f8ad40ce9b0 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ac9d9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8ad40cd6c0 0x7f8ad40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ac9d9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8ad40cd6c0 0x7f8ad40ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51644/0 (socket says 172.21.15.181:51644) 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f8ac9d9b640 1 -- 172.21.15.181:0/3915921725 learned_addr learned my addr 172.21.15.181:0/3915921725 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f5552ffd640 1 --2- 172.21.15.181:0/2188410042 >> v2:172.21.15.181:3300/0 conn(0x7f55540b28e0 0x7f55540b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f55527fc640 1 --2- 172.21.15.181:0/2188410042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f555415a790 0x7f555415eb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f55540afd10 tx=0x7f554802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c39ee122db67de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f5551ffb640 1 -- 172.21.15.181:0/2188410042 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548037070 con 0x7f555415a790 2024-09-12T02:28:31.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f5551ffb640 1 -- 172.21.15.181:0/2188410042 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5548032440 con 0x7f555415a790 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f5551ffb640 1 -- 172.21.15.181:0/2188410042 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548032810 con 0x7f555415a790 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7eff8559a640 1 -- 172.21.15.181:0/3290969073 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8003c880 con 0x7eff880b4e40 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7eff8559a640 1 -- 172.21.15.181:0/3290969073 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8003ca20 con 0x7eff880b4e40 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7eff8559a640 1 -- 172.21.15.181:0/3290969073 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8003cdd0 con 0x7eff880b4e40 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7eff8ce0e640 1 -- 172.21.15.181:0/3290969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880b4e40 msgr2=0x7eff880ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7eff8ce0e640 1 --2- 172.21.15.181:0/3290969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880b4e40 0x7eff880ce330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff8000c340 tx=0x7eff8003bd80 comp rx=0 tx=0).stop 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7eff8ce0e640 1 -- 172.21.15.181:0/3290969073 shutdown_connections 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7eff8ce0e640 1 --2- 172.21.15.181:0/3290969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880b4e40 0x7eff880ce330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7eff8ce0e640 1 --2- 172.21.15.181:0/3290969073 >> v2:172.21.15.204:3300/0 conn(0x7eff880cf6c0 0x7eff880b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7eff8ce0e640 1 -- 172.21.15.181:0/3290969073 >> 172.21.15.181:0/3290969073 conn(0x7eff880b1df0 msgr2=0x7eff880b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175583143 0 0) 0x7f32a40b3290 con 0x7f32a40cdfc0 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3290003520 con 0x7f32a40cdfc0 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278721415 0 0) 0x7f32a40cf860 con 0x7f32a415eb60 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a40b3290 con 0x7f32a415eb60 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3587348876 0 0) 0x7f3290003520 con 0x7f32a40cdfc0 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a415a820 msgr2=0x7f32a40b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a415a820 0x7f32a40b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 >> v1:172.21.15.204:6789/0 conn(0x7f32a415eb60 legacy=0x7f32a40cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a40cfb40 con 0x7f32a40cdfc0 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f32a0001690 con 0x7f32a40cdfc0 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 >> v1:172.21.15.181:6789/0 conn(0x7f32a40cdfc0 legacy=0x7f32a40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f329bfff640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32900037d0 0x7f3290003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f329bfff640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3290004180 0x7f3290008d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f329bfff640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32900092d0 0x7f3290009750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40cfe20 con 0x7f32900037d0 2024-09-12T02:28:31.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3290009f50 con 0x7f32900092d0 2024-09-12T02:28:31.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f329000a150 con 0x7f3290004180 2024-09-12T02:28:31.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.193+0000 7fbb881b7640 1 -- start start 2024-09-12T02:28:31.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f3455552640 1 Processor -- start 2024-09-12T02:28:31.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f3455552640 1 -- start start 2024-09-12T02:28:31.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f8ac9d9b640 1 -- 172.21.15.181:0/3915921725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 msgr2=0x7f8ad40ccff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:28:31.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f8ac9d9b640 1 --2- 172.21.15.181:0/3915921725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 0x7f8ad40ccff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f8ac9d9b640 1 -- 172.21.15.181:0/3915921725 >> v2:172.21.15.204:3300/0 conn(0x7f8ad415e630 msgr2=0x7f8ad406f0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:28:31.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f8ac9d9b640 1 --2- 172.21.15.181:0/3915921725 >> v2:172.21.15.204:3300/0 conn(0x7f8ad415e630 0x7f8ad406f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f8ac9d9b640 1 -- 172.21.15.181:0/3915921725 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad406e610 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f32a98c7640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32900092d0 0x7f3290009750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f32a90c6640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32900037d0 0x7f3290003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f32a98c7640 1 -- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3290004180 msgr2=0x7f3290008d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f32a98c7640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3290004180 0x7f3290008d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f32a98c7640 1 -- 172.21.15.181:0/3207753123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32900037d0 msgr2=0x7f3290003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f32a98c7640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32900037d0 0x7f3290003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.194+0000 7f32a98c7640 1 -- 172.21.15.181:0/3207753123 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3290003520 con 0x7f32900092d0 2024-09-12T02:28:31.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb881b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb80162790 0x7fbb800cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb881b7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb800cf340 0x7fbb800cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb881b7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb800d3e60 con 0x7fbb800cedf0 2024-09-12T02:28:31.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb881b7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbb800d4140 con 0x7fbb800cf340 2024-09-12T02:28:31.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb881b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbb800d4420 con 0x7fbb80162790 2024-09-12T02:28:31.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f7ddb482640 1 Processor -- start 2024-09-12T02:28:31.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f7ddb482640 1 -- start start 2024-09-12T02:28:31.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7f32a98c7640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32900092d0 0x7f3290009750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3294001910 tx=0x7f3290004820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84933b2129d34e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb85752640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb800cf340 0x7fbb800cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb85f53640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb80162790 0x7fbb800cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb85752640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb800cf340 0x7fbb800cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51656/0 (socket says 172.21.15.181:51656) 2024-09-12T02:28:31.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7eff8ce0e640 1 -- 172.21.15.181:0/3290969073 shutdown_connections 2024-09-12T02:28:31.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.195+0000 7fbb85752640 1 -- 172.21.15.181:0/4034809749 learned_addr learned my addr 172.21.15.181:0/4034809749 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f344effd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f34500b4e60 0x7f34500b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54342/0 (socket says 172.21.15.181:54342) 2024-09-12T02:28:31.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7eff8ce0e640 1 -- 172.21.15.181:0/3290969073 wait complete. 2024-09-12T02:28:31.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294037070 con 0x7f32900092d0 2024-09-12T02:28:31.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f344effd640 1 -- 172.21.15.181:0/1590357705 learned_addr learned my addr 172.21.15.181:0/1590357705 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:31.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f8ac9d9b640 1 --2- 172.21.15.181:0/3915921725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad40cd6c0 0x7f8ad40ccab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4050630 tx=0x7f8abc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749428d203b90287 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329402ac80 con 0x7f32900092d0 2024-09-12T02:28:31.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f329bfff640 1 -- 172.21.15.181:0/3207753123 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940014e0 con 0x7f32900092d0 2024-09-12T02:28:31.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7fbb85f53640 1 -- 172.21.15.181:0/4034809749 >> v2:172.21.15.181:3300/0 conn(0x7fbb800cf340 msgr2=0x7fbb800cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7fbb85f53640 1 --2- 172.21.15.181:0/4034809749 >> v2:172.21.15.181:3300/0 conn(0x7fbb800cf340 0x7fbb800cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7fbb85f53640 1 -- 172.21.15.181:0/4034809749 >> v1:172.21.15.204:6789/0 conn(0x7fbb800cedf0 legacy=0x7fbb800d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7fbb85f53640 1 -- 172.21.15.181:0/4034809749 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb800d4700 con 0x7fbb80162790 2024-09-12T02:28:31.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7fbb85752640 1 --2- 172.21.15.181:0/4034809749 >> v2:172.21.15.181:3300/0 conn(0x7fbb800cf340 0x7fbb800cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:31.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f8ad1d9b640 1 -- 172.21.15.181:0/3915921725 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc037070 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f8ad1d9b640 1 -- 172.21.15.181:0/3915921725 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc032440 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f8ad1d9b640 1 -- 172.21.15.181:0/3915921725 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc032810 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f7ddb482640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7dd40cf310 0x7f7dd40d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7ddb482640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd406fbf0 con 0x7f7dd415e510 2024-09-12T02:28:31.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7ddb482640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd4162140 con 0x7f7dd4162c20 2024-09-12T02:28:31.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7ddb482640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd415e8f0 con 0x7f7dd40cf310 2024-09-12T02:28:31.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7dd9c7f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7dd40cf310 0x7f7dd40d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7dd9c7f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7dd40cf310 0x7f7dd40d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:52934/0 (socket says 172.21.15.181:52934) 2024-09-12T02:28:31.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7dd9c7f640 1 -- 172.21.15.181:0/594429024 learned_addr learned my addr 172.21.15.181:0/594429024 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f3455552640 1 --2- 172.21.15.181:0/1590357705 >> v2:172.21.15.204:3300/0 conn(0x7f345015a6e0 0x7f34500cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.196+0000 7f3455552640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 0x7f34500b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34500cfad0 con 0x7f34500b4e60 2024-09-12T02:28:31.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7dd9c7f640 1 -- 172.21.15.181:0/594429024 >> v1:172.21.15.204:6789/0 conn(0x7f7dd4162c20 legacy=0x7f7dd40d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f345006ea30 con 0x7f345015a6e0 2024-09-12T02:28:31.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7dd9c7f640 1 -- 172.21.15.181:0/594429024 >> v1:172.21.15.181:6789/0 conn(0x7f7dd415e510 legacy=0x7f7dd40cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f7dd9c7f640 1 -- 172.21.15.181:0/594429024 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd4162420 con 0x7f7dd40cf310 2024-09-12T02:28:31.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f34500cfd90 con 0x7f3450069ac0 2024-09-12T02:28:31.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171794495 0 0) 0x7f34500cfad0 con 0x7f34500b4e60 2024-09-12T02:28:31.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f343c003520 con 0x7f34500b4e60 2024-09-12T02:28:31.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f8ad8842640 1 -- 172.21.15.181:0/3915921725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad40cd6c0 msgr2=0x7f8ad40ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f8ad8842640 1 --2- 172.21.15.181:0/3915921725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad40cd6c0 0x7f8ad40ccab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4050630 tx=0x7f8abc02a210 comp rx=0 tx=0).stop 2024-09-12T02:28:31.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f32ab32a640 1 -- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32900092d0 msgr2=0x7f3290009750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f32ab32a640 1 --2- 172.21.15.181:0/3207753123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32900092d0 0x7f3290009750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3294001910 tx=0x7f3290004820 comp rx=0 tx=0).stop 2024-09-12T02:28:31.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7fbb85f53640 1 --2- 172.21.15.181:0/4034809749 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb80162790 0x7fbb800cf880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0097a0 tx=0x7fbb7c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42344ea0675be4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f344f7fe640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 0x7f34500b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f55596f1640 1 -- 172.21.15.181:0/2188410042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f555415a790 msgr2=0x7f555415eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f55596f1640 1 --2- 172.21.15.181:0/2188410042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f555415a790 0x7f555415eb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f55540afd10 tx=0x7f554802a230 comp rx=0 tx=0).stop 2024-09-12T02:28:31.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7eff8ce0e640 1 Processor -- start 2024-09-12T02:28:31.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7fbb84f51640 1 -- 172.21.15.181:0/4034809749 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c037070 con 0x7fbb80162790 2024-09-12T02:28:31.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7fbb84f51640 1 -- 172.21.15.181:0/4034809749 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c032440 con 0x7fbb80162790 2024-09-12T02:28:31.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7fbb84f51640 1 -- 172.21.15.181:0/4034809749 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c032810 con 0x7fbb80162790 2024-09-12T02:28:31.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2713023912 0 0) 0x7f343c003520 con 0x7f34500b4e60 2024-09-12T02:28:31.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 msgr2=0x7f34500b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 0x7f34500b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 >> v2:172.21.15.204:3300/0 conn(0x7f345015a6e0 msgr2=0x7f34500cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f3447fff640 1 --2- 172.21.15.181:0/1590357705 >> v2:172.21.15.204:3300/0 conn(0x7f345015a6e0 0x7f34500cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f11b196d640 1 Processor -- start 2024-09-12T02:28:31.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 --2- 172.21.15.181:0/1590357705 >> v2:172.21.15.204:3300/0 conn(0x7f345015a6e0 0x7f34500cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345006e6c0 con 0x7f34500b4e60 2024-09-12T02:28:31.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.197+0000 7f32a98c7640 1 -- 172.21.15.181:0/3207753123 reap_dead start 2024-09-12T02:28:31.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f3447fff640 1 --2- 172.21.15.181:0/1590357705 >> v2:172.21.15.204:3300/0 conn(0x7f345015a6e0 0x7f34500cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:31.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f3440001690 con 0x7f34500b4e60 2024-09-12T02:28:31.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 >> v1:172.21.15.181:6789/0 conn(0x7f34500b4e60 legacy=0x7f34500b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f32ab32a640 1 -- 172.21.15.181:0/3207753123 shutdown_connections 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f32ab32a640 1 -- 172.21.15.181:0/3207753123 >> 172.21.15.181:0/3207753123 conn(0x7f32a40b1df0 msgr2=0x7f32a40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f8ad8842640 1 -- 172.21.15.181:0/3915921725 shutdown_connections 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f8ad8842640 1 --2- 172.21.15.181:0/3915921725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 0x7f8ad40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f8ad8842640 1 --2- 172.21.15.181:0/3915921725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad40cd6c0 0x7f8ad40ccab0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f8ad8842640 1 --2- 172.21.15.181:0/3915921725 >> v2:172.21.15.204:3300/0 conn(0x7f8ad415e630 0x7f8ad406f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f55596f1640 1 -- 172.21.15.181:0/2188410042 shutdown_connections 2024-09-12T02:28:31.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f55596f1640 1 --2- 172.21.15.181:0/2188410042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f555415a790 0x7f555415eb30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f55596f1640 1 --2- 172.21.15.181:0/2188410042 >> v2:172.21.15.181:3300/0 conn(0x7f55540b28e0 0x7f55540b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f55596f1640 1 -- 172.21.15.181:0/2188410042 >> 172.21.15.181:0/2188410042 conn(0x7f55540b1df0 msgr2=0x7f55540b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f8ad8842640 1 -- 172.21.15.181:0/3915921725 >> 172.21.15.181:0/3915921725 conn(0x7f8ad40b1df0 msgr2=0x7f8ad40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7eff8ce0e640 1 -- start start 2024-09-12T02:28:31.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f55596f1640 1 -- 172.21.15.181:0/2188410042 shutdown_connections 2024-09-12T02:28:31.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f343c0039b0 0x7f343c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 0x7f343c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f343c004d40 0x7f343c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f32ab32a640 1 -- 172.21.15.181:0/3207753123 shutdown_connections 2024-09-12T02:28:31.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344effd640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f343c0039b0 0x7f343c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f345006ea30 con 0x7f343c004d40 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f34500cfd90 con 0x7f343c0039b0 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f343c00bbd0 con 0x7f3450069ac0 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f3447fff640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 0x7f343c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f344f7fe640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f343c004d40 0x7f343c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7fbb881b7640 1 -- 172.21.15.181:0/4034809749 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb80162790 msgr2=0x7fbb800cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7fbb881b7640 1 --2- 172.21.15.181:0/4034809749 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb80162790 0x7fbb800cf880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0097a0 tx=0x7fbb7c02a180 comp rx=0 tx=0).stop 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f344effd640 1 -- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 msgr2=0x7f343c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f344effd640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3450069ac0 0x7f343c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f344effd640 1 -- 172.21.15.181:0/1590357705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f343c004d40 msgr2=0x7f343c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f344effd640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f343c004d40 0x7f343c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff8ce0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff8808c720 0x7eff88168e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f344effd640 1 -- 172.21.15.181:0/1590357705 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c003520 con 0x7f343c0039b0 2024-09-12T02:28:31.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff8ce0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff880b4e40 0x7eff881544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f32ab32a640 1 -- 172.21.15.181:0/3207753123 wait complete. 2024-09-12T02:28:31.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f8ad8842640 1 -- 172.21.15.181:0/3915921725 shutdown_connections 2024-09-12T02:28:31.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f8ad8842640 1 -- 172.21.15.181:0/3915921725 wait complete. 2024-09-12T02:28:31.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff8659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff8808c720 0x7eff88168e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7fbb881b7640 1 -- 172.21.15.181:0/4034809749 shutdown_connections 2024-09-12T02:28:31.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7fbb881b7640 1 --2- 172.21.15.181:0/4034809749 >> v2:172.21.15.181:3300/0 conn(0x7fbb800cf340 0x7fbb800cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7fbb881b7640 1 --2- 172.21.15.181:0/4034809749 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb80162790 0x7fbb800cf880 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7fbb881b7640 1 -- 172.21.15.181:0/4034809749 >> 172.21.15.181:0/4034809749 conn(0x7fbb80067950 msgr2=0x7fbb80067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff8659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff8808c720 0x7eff88168e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35418/0 (socket says 172.21.15.181:35418) 2024-09-12T02:28:31.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7fbb881b7640 1 -- 172.21.15.181:0/4034809749 shutdown_connections 2024-09-12T02:28:31.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff8659c640 1 -- 172.21.15.181:0/487144178 learned_addr learned my addr 172.21.15.181:0/487144178 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f11b196d640 1 -- start start 2024-09-12T02:28:31.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11b196d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a40e06d0 0x7f11a4053090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f7dd9c7f640 1 --2- 172.21.15.181:0/594429024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 0x7f7dd40d1ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009870 tx=0x7f7dc402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=923f06688681b543 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.198+0000 7f55596f1640 1 -- 172.21.15.181:0/2188410042 wait complete. 2024-09-12T02:28:31.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff8ce0e640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880cf6c0 0x7eff881f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11b196d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f11a4055500 0x7f11a400ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11b196d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a4053b10 con 0x7f11a40535d0 2024-09-12T02:28:31.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11b196d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f11a40333a0 con 0x7f11a4055500 2024-09-12T02:28:31.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11b196d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11a400bfb0 con 0x7f11a40e06d0 2024-09-12T02:28:31.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff86d9d640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880cf6c0 0x7eff881f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11aa7fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f11a40535d0 0x7f11a4054df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54356/0 (socket says 172.21.15.181:54356) 2024-09-12T02:28:31.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11aa7fc640 1 -- 172.21.15.181:0/2569082542 learned_addr learned my addr 172.21.15.181:0/2569082542 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:31.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f7dd947e640 1 -- 172.21.15.181:0/594429024 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4037070 con 0x7f7dd40cf310 2024-09-12T02:28:31.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7f11aaffd640 1 --2- 172.21.15.181:0/2569082542 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a40e06d0 0x7f11a4053090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f7dd947e640 1 -- 172.21.15.181:0/594429024 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4032440 con 0x7f7dd40cf310 2024-09-12T02:28:31.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f7dd947e640 1 -- 172.21.15.181:0/594429024 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4032810 con 0x7f7dd40cf310 2024-09-12T02:28:31.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff880cfae0 con 0x7eff880cf6c0 2024-09-12T02:28:31.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7eff880cd7c0 con 0x7eff880b4e40 2024-09-12T02:28:31.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7eff880b3390 con 0x7eff8808c720 2024-09-12T02:28:31.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f11a9ffb640 1 -- 172.21.15.181:0/2569082542 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319138996 0 0) 0x7f11a4053b10 con 0x7f11a40535d0 2024-09-12T02:28:31.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f11aaffd640 1 -- 172.21.15.181:0/2569082542 >> v2:172.21.15.204:3300/0 conn(0x7f11a4055500 msgr2=0x7f11a400ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:28:31.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f11aaffd640 1 --2- 172.21.15.181:0/2569082542 >> v2:172.21.15.204:3300/0 conn(0x7f11a4055500 0x7f11a400ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f11aaffd640 1 -- 172.21.15.181:0/2569082542 >> v1:172.21.15.181:6789/0 conn(0x7f11a40535d0 legacy=0x7f11a4054df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f32ab32a640 1 Processor -- start 2024-09-12T02:28:31.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f55596f1640 1 Processor -- start 2024-09-12T02:28:31.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f11aaffd640 1 -- 172.21.15.181:0/2569082542 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a400c290 con 0x7f11a40e06d0 2024-09-12T02:28:31.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7f55596f1640 1 -- start start 2024-09-12T02:28:31.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.199+0000 7fbb881b7640 1 -- 172.21.15.181:0/4034809749 wait complete. 2024-09-12T02:28:31.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.200+0000 7eff85d9b640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff880b4e40 0x7eff881544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f7ddb482640 1 -- 172.21.15.181:0/594429024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 msgr2=0x7f7dd40d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f7ddb482640 1 --2- 172.21.15.181:0/594429024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 0x7f7dd40d1ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009870 tx=0x7f7dc402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff86d9d640 1 -- 172.21.15.181:0/487144178 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff8808c720 msgr2=0x7eff88168e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f344effd640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f343c0039b0 0x7f343c003d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3440005060 tx=0x7f343c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df15929b8645aa6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7fbb881b7640 1 Processor -- start 2024-09-12T02:28:31.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff86d9d640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff8808c720 0x7eff88168e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff86d9d640 1 -- 172.21.15.181:0/487144178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff880b4e40 msgr2=0x7eff881544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff86d9d640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff880b4e40 0x7eff881544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff86d9d640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff88154f70 con 0x7eff880cf6c0 2024-09-12T02:28:31.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff85d9b640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff880b4e40 0x7eff881544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:31.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440004c60 con 0x7f343c0039b0 2024-09-12T02:28:31.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f7ddb482640 1 -- 172.21.15.181:0/594429024 shutdown_connections 2024-09-12T02:28:31.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f7ddb482640 1 --2- 172.21.15.181:0/594429024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 0x7f7dd40d1ab0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f7ddb482640 1 -- 172.21.15.181:0/594429024 >> 172.21.15.181:0/594429024 conn(0x7f7dd406bdf0 msgr2=0x7f7dd4067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7fbb881b7640 1 -- start start 2024-09-12T02:28:31.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f8ad8842640 1 Processor -- start 2024-09-12T02:28:31.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f7ddb482640 1 -- 172.21.15.181:0/594429024 shutdown_connections 2024-09-12T02:28:31.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f8ad8842640 1 -- start start 2024-09-12T02:28:31.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff86d9d640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880cf6c0 0x7eff881f6a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff80042000 tx=0x7eff80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff8659c640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff8808c720 0x7eff88168e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:31.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f7ddb482640 1 -- 172.21.15.181:0/594429024 wait complete. 2024-09-12T02:28:31.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344002f030 con 0x7f343c0039b0 2024-09-12T02:28:31.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80049040 con 0x7eff880cf6c0 2024-09-12T02:28:31.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff80053070 con 0x7eff880cf6c0 2024-09-12T02:28:31.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f344e7fc640 1 -- 172.21.15.181:0/1590357705 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440005dd0 con 0x7f343c0039b0 2024-09-12T02:28:31.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f55596f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55540b28e0 0x7f555414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f55596f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55540cdfc0 0x7f555415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f55596f1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f555415a790 0x7f5554148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f55596f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f55540cfb40 con 0x7f55540b28e0 2024-09-12T02:28:31.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f55596f1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f55540b5350 con 0x7f555415a790 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55540b28e0 0x7f555414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f55596f1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f55540b3770 con 0x7f55540cdfc0 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55540b28e0 0x7f555414ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51698/0 (socket says 172.21.15.181:51698) 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 -- 172.21.15.181:0/2795554897 learned_addr learned my addr 172.21.15.181:0/2795554897 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f8ad8842640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ad40cd6c0 0x7f8ad415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad8842640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 0x7f8ad41614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad8842640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad415e630 0x7f8ad40b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad415e630 0x7f8ad40b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad415e630 0x7f8ad40b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51716/0 (socket says 172.21.15.181:51716) 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad2d9d640 1 -- 172.21.15.181:0/1330302023 learned_addr learned my addr 172.21.15.181:0/1330302023 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad4162b60 con 0x7f8ad415e630 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad406ebd0 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad4162ce0 con 0x7f8ad40ce9b0 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 -- 172.21.15.181:0/2795554897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55540cdfc0 msgr2=0x7f555415dec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55540cdfc0 0x7f555415dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 -- 172.21.15.181:0/2795554897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f555415a790 msgr2=0x7f5554148c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f555415a790 0x7f5554148c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f5552ffd640 1 -- 172.21.15.181:0/2795554897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5554150550 con 0x7f55540b28e0 2024-09-12T02:28:31.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f5552ffd640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55540b28e0 0x7f555414ff00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c370 tx=0x7f554c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80003bb0 con 0x7eff880cf6c0 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff88155250 con 0x7eff880cf6c0 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff88152930 con 0x7eff880cf6c0 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f32ab32a640 1 -- start start 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32ab32a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a4151010 0x7f32a415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32ab32a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32a41552a0 0x7f32a40731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32ab32a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32a40736e0 0x7f32a415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32ab32a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32a415ef90 con 0x7f32a41552a0 2024-09-12T02:28:31.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32ab32a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40b3770 con 0x7f32a40736e0 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32ab32a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32a40b38f0 con 0x7f32a4151010 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb881b7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb800cedf0 0x7fbb801faec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb881b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb800cf340 0x7fbb800cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb881b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb80162790 0x7fbb800b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb881b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800b8f10 con 0x7fbb80162790 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb881b7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800d3ae0 con 0x7fbb800cedf0 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb881b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbb800b9090 con 0x7fbb800cf340 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb86754640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb80162790 0x7fbb800b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7fbb86754640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb80162790 0x7fbb800b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51702/0 (socket says 172.21.15.181:51702) 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7fbb86754640 1 -- 172.21.15.181:0/2934289148 learned_addr learned my addr 172.21.15.181:0/2934289148 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7fbb85752640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb800cf340 0x7fbb800cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.201+0000 7f11aaffd640 1 --2- 172.21.15.181:0/2569082542 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a40e06d0 0x7f11a4053090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f119c009790 tx=0x7f119c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41faba826014c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f11a9ffb640 1 -- 172.21.15.181:0/2569082542 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c037070 con 0x7f11a40e06d0 2024-09-12T02:28:31.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.202+0000 7f11a9ffb640 1 -- 172.21.15.181:0/2569082542 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c032440 con 0x7f11a40e06d0 2024-09-12T02:28:31.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f343c0039b0 msgr2=0x7f343c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f3455552640 1 --2- 172.21.15.181:0/1590357705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f343c0039b0 0x7f343c003d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3440005060 tx=0x7f343c005830 comp rx=0 tx=0).stop 2024-09-12T02:28:31.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f344f7fe640 1 -- 172.21.15.181:0/1590357705 reap_dead start 2024-09-12T02:28:31.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ad259c640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ad40cd6c0 0x7f8ad415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 shutdown_connections 2024-09-12T02:28:31.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 >> 172.21.15.181:0/1590357705 conn(0x7f34500d0340 msgr2=0x7f34500d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f8ac9d9b640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 0x7f8ad41614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 shutdown_connections 2024-09-12T02:28:31.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7fbb86754640 1 -- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb800cf340 msgr2=0x7fbb800cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7fbb86754640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb800cf340 0x7fbb800cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7fbb86754640 1 -- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb800cedf0 msgr2=0x7fbb801faec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:28:31.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7fbb86754640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb800cedf0 0x7fbb801faec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7fbb86754640 1 -- 172.21.15.181:0/2934289148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb80157ad0 con 0x7fbb80162790 2024-09-12T02:28:31.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f3455552640 1 -- 172.21.15.181:0/1590357705 wait complete. 2024-09-12T02:28:31.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f11b196d640 1 -- 172.21.15.181:0/2569082542 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a40e06d0 msgr2=0x7f11a4053090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f11b196d640 1 --2- 172.21.15.181:0/2569082542 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a40e06d0 0x7f11a4053090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f119c009790 tx=0x7f119c02a210 comp rx=0 tx=0).stop 2024-09-12T02:28:31.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f7ddb482640 1 Processor -- start 2024-09-12T02:28:31.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f7ddb482640 1 -- start start 2024-09-12T02:28:31.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f11b196d640 1 -- 172.21.15.181:0/2569082542 shutdown_connections 2024-09-12T02:28:31.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f11b196d640 1 --2- 172.21.15.181:0/2569082542 >> v2:172.21.15.204:3300/0 conn(0x7f11a4055500 0x7f11a400ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f11b196d640 1 --2- 172.21.15.181:0/2569082542 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a40e06d0 0x7f11a4053090 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f119c009790 tx=0x7f119c02a210 comp rx=0 tx=0).stop 2024-09-12T02:28:31.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f11b196d640 1 -- 172.21.15.181:0/2569082542 >> 172.21.15.181:0/2569082542 conn(0x7f11a401fb40 msgr2=0x7f11a4056810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32a90c6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a4151010 0x7f32a415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32a98c7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32a40736e0 0x7f32a415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.203+0000 7f32a88c5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32a41552a0 0x7f32a40731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a88c5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32a41552a0 0x7f32a40731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51712/0 (socket says 172.21.15.181:51712) 2024-09-12T02:28:31.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a88c5640 1 -- 172.21.15.181:0/3778976559 learned_addr learned my addr 172.21.15.181:0/3778976559 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f8ad259c640 1 -- 172.21.15.181:0/1330302023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 msgr2=0x7f8ad41614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f8ad259c640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ad40ce9b0 0x7f8ad41614f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f8ad259c640 1 -- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad415e630 msgr2=0x7f8ad40b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f8ad259c640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ad415e630 0x7f8ad40b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f8ad259c640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad415fab0 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a90c6640 1 -- 172.21.15.181:0/3778976559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32a40736e0 msgr2=0x7f32a415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a90c6640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32a40736e0 0x7f32a415a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a90c6640 1 -- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32a41552a0 msgr2=0x7f32a40731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a90c6640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32a41552a0 0x7f32a40731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a90c6640 1 -- 172.21.15.181:0/3778976559 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a41513f0 con 0x7f32a4151010 2024-09-12T02:28:31.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f11b196d640 1 -- 172.21.15.181:0/2569082542 shutdown_connections 2024-09-12T02:28:31.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f11b196d640 1 -- 172.21.15.181:0/2569082542 wait complete. 2024-09-12T02:28:31.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff88152440 con 0x7eff880cf6c0 2024-09-12T02:28:31.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c009e10 con 0x7f55540b28e0 2024-09-12T02:28:31.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f32a90c6640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a4151010 0x7f32a415c9d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32a0008060 tx=0x7f32a0008520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f8ad259c640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ad40cd6c0 0x7f8ad415d6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009fd0 tx=0x7f8ac400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f554c019070 con 0x7f55540b28e0 2024-09-12T02:28:31.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f7ddb482640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 0x7f7dd415fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f7ddb482640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dd415e510 0x7f7dd414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f7ddb482640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dd4162c20 0x7f7dd414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4015020 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f7ddb482640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd406f810 con 0x7f7dd4162c20 2024-09-12T02:28:31.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f7ddb482640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd406f690 con 0x7f7dd40cf310 2024-09-12T02:28:31.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f7ddb482640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd406f990 con 0x7f7dd415e510 2024-09-12T02:28:31.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac4011830 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0019070 con 0x7f32a4151010 2024-09-12T02:28:31.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a000eae0 con 0x7f32a4151010 2024-09-12T02:28:31.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a000ee90 con 0x7f32a4151010 2024-09-12T02:28:31.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7fbb86754640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb80162790 0x7fbb800b4250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c730 tx=0x7fbb7800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f3455552640 1 Processor -- start 2024-09-12T02:28:31.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f3455552640 1 -- start start 2024-09-12T02:28:31.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4011c20 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f11b196d640 1 Processor -- start 2024-09-12T02:28:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad415de40 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad415efd0 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78016020 con 0x7fbb80162790 2024-09-12T02:28:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dd4162c20 0x7f7dd414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dd4162c20 0x7f7dd414be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51730/0 (socket says 172.21.15.181:51730) 2024-09-12T02:28:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 -- 172.21.15.181:0/60382845 learned_addr learned my addr 172.21.15.181:0/60382845 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7dda480640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 0x7f7dd415fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff80005d10 con 0x7eff880cf6c0 2024-09-12T02:28:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7dd9c7f640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dd415e510 0x7f7dd414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb78006d50 con 0x7fbb80162790 2024-09-12T02:28:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78003bb0 con 0x7fbb80162790 2024-09-12T02:28:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3455552640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f343c0039b0 0x7f3450155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3455552640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3450152730 0x7f34500733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 -- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dd415e510 msgr2=0x7f7dd414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dd415e510 0x7f7dd414b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 -- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 msgr2=0x7f7dd415fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dd40cf310 0x7f7dd415fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f7ddac81640 1 -- 172.21.15.181:0/60382845 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd4160580 con 0x7f7dd4162c20 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f7ddac81640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dd4162c20 0x7f7dd414be50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c730 tx=0x7f7dcc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f11b196d640 1 -- start start 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3455552640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34501519e0 0x7f3450151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f344effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f343c0039b0 0x7f3450155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3447fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3450152730 0x7f34500733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3447fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3450152730 0x7f34500733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53026/0 (socket says 172.21.15.181:53026) 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3447fff640 1 -- 172.21.15.181:0/3871142833 learned_addr learned my addr 172.21.15.181:0/3871142833 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3455552640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f34500b34a0 con 0x7f34501519e0 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3455552640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f34500b3320 con 0x7f3450152730 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3455552640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f34500b3620 con 0x7f343c0039b0 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f344f7fe640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34501519e0 0x7f3450151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7eff76ffd640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff6806bf00 0x7eff6806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7eff800bd650 con 0x7eff880cf6c0 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7eff8659c640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff6806bf00 0x7eff6806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7eff76ffd640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7eff68074120 0x7eff68076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ad406f0f0 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff80053070 con 0x7eff68074120 2024-09-12T02:28:31.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7eff800bda40 con 0x7eff880cf6c0 2024-09-12T02:28:31.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc016020 con 0x7f7dd4162c20 2024-09-12T02:28:31.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc006d50 con 0x7f7dd4162c20 2024-09-12T02:28:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f7ddb482640 1 -- 172.21.15.181:0/60382845 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd4160860 con 0x7f7dd4162c20 2024-09-12T02:28:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7eff85d9b640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7eff68074120 0x7eff68076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f7ddb482640 1 -- 172.21.15.181:0/60382845 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd4160e20 con 0x7f7dd4162c20 2024-09-12T02:28:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3447fff640 1 -- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f343c0039b0 msgr2=0x7f3450155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3447fff640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f343c0039b0 0x7f3450155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f3447fff640 1 -- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34501519e0 msgr2=0x7f3450151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f3447fff640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34501519e0 0x7f3450151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f3447fff640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3450152380 con 0x7f3450152730 2024-09-12T02:28:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f344f7fe640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34501519e0 0x7f3450151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7eff8659c640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff6806bf00 0x7eff6806e3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007fd0 tx=0x7eff7c007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f3447fff640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3450152730 0x7f34500733d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3438008fd0 tx=0x7f3438015420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c014680 con 0x7f55540b28e0 2024-09-12T02:28:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.204+0000 7f55596f1640 1 -- 172.21.15.181:0/2795554897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5554150830 con 0x7f55540b28e0 2024-09-12T02:28:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.205+0000 7f55596f1640 1 -- 172.21.15.181:0/2795554897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555414ca80 con 0x7f55540b28e0 2024-09-12T02:28:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.206+0000 7f55596f1640 1 -- 172.21.15.181:0/2795554897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f555415b000 con 0x7f55540b28e0 2024-09-12T02:28:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc003b90 con 0x7f7dd4162c20 2024-09-12T02:28:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f11b196d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a40535d0 0x7f11a40d8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ac4018020 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3438015d40 con 0x7f3450152730 2024-09-12T02:28:31.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3438011930 con 0x7f3450152730 2024-09-12T02:28:31.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3438011d00 con 0x7f3450152730 2024-09-12T02:28:31.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f3455552640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3450155910 con 0x7f3450152730 2024-09-12T02:28:31.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.207+0000 7f11b196d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11a4055500 0x7f11a404e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f11aaffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a40535d0 0x7f11a40d8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f11aaffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a40535d0 0x7f11a40d8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51744/0 (socket says 172.21.15.181:51744) 2024-09-12T02:28:31.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a4155a80 con 0x7f32a4151010 2024-09-12T02:28:31.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a4156040 con 0x7f32a4151010 2024-09-12T02:28:31.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.208+0000 7eff85d9b640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7eff68074120 0x7eff68076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11b196d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a403bbb0 0x7f11a4056780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11b196d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11a40e0ab0 con 0x7f11a40535d0 2024-09-12T02:28:31.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f8acb7fe640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8ab406bf00 0x7f8ab406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11b196d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f11a4054600 con 0x7f11a4055500 2024-09-12T02:28:31.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11a4055500 0x7f11a404e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11a4055500 0x7f11a404e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53038/0 (socket says 172.21.15.181:53038) 2024-09-12T02:28:31.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ac408aca0 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 -- 172.21.15.181:0/1201442270 learned_addr learned my addr 172.21.15.181:0/1201442270 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11a40e0c30 con 0x7f11a403bbb0 2024-09-12T02:28:31.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f8acb7fe640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f8ab4074120 0x7f8ab4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ac40044f0 con 0x7f8ab4074120 2024-09-12T02:28:31.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8ac408d300 con 0x7f8ad40cd6c0 2024-09-12T02:28:31.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb800cc670 con 0x7fbb80162790 2024-09-12T02:28:31.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff80053070 con 0x7eff68074120 2024-09-12T02:28:31.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 -- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a403bbb0 msgr2=0x7f11a4056780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:28:31.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11a403bbb0 0x7f11a4056780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 -- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a40535d0 msgr2=0x7f11a40d8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a40535d0 0x7f11a40d8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f11aa7fc640 1 -- 172.21.15.181:0/1201442270 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a403ab10 con 0x7f11a4055500 2024-09-12T02:28:31.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f3455552640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3450157e30 con 0x7f3450152730 2024-09-12T02:28:31.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb800c9530 con 0x7fbb80162790 2024-09-12T02:28:31.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f11aaffd640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a40535d0 0x7f11a40d8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-12T02:28:31.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f11aa7fc640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11a4055500 0x7f11a404e360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11a000c3f0 tx=0x7f11a000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb800c9910 con 0x7fbb80162790 2024-09-12T02:28:31.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.209+0000 7f7ddb482640 1 -- 172.21.15.181:0/60382845 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7dd40756f0 con 0x7f7dd4162c20 2024-09-12T02:28:31.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7dcc0050d0 con 0x7f7dd4162c20 2024-09-12T02:28:31.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00074e0 con 0x7f11a4055500 2024-09-12T02:28:31.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f554c005d10 con 0x7f55540b28e0 2024-09-12T02:28:31.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f8ad2d9d640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f8ab4074120 0x7f8ab4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a00047e0 con 0x7f11a4055500 2024-09-12T02:28:31.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.210+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0004bd0 con 0x7f11a4055500 2024-09-12T02:28:31.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a403adf0 con 0x7f11a4055500 2024-09-12T02:28:31.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f8ad2d9d640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f8ab4074120 0x7f8ab4076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f7dcaffd640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7db806bf00 0x7f7db806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7dcc08c6f0 con 0x7f7dd4162c20 2024-09-12T02:28:31.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f7dcaffd640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f7db8074120 0x7f7db8076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7dcc017e70 con 0x7f7db8074120 2024-09-12T02:28:31.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7dcc08cae0 con 0x7f7dd4162c20 2024-09-12T02:28:31.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f7dd9c7f640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f7db8074120 0x7f7db8076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32a4156700 con 0x7f32a4151010 2024-09-12T02:28:31.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f553b7fe640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f554006bf00 0x7f554006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32a001c070 con 0x7f32a4151010 2024-09-12T02:28:31.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a403b3b0 con 0x7f11a4055500 2024-09-12T02:28:31.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f554c08bfb0 con 0x7f55540b28e0 2024-09-12T02:28:31.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f7dda480640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7db806bf00 0x7f7db806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f553b7fe640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f5540074180 0x7f55400765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f7dd9c7f640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f7db8074120 0x7f7db8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ac40044f0 con 0x7f8ab4074120 2024-09-12T02:28:31.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f8ac9d9b640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8ab406bf00 0x7f8ab406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f3299ffb640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f328806c0a0 0x7f328806e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f32a008a770 con 0x7f32a4151010 2024-09-12T02:28:31.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f3299ffb640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f32880742a0 0x7f32880766c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11a0011070 con 0x7f11a4055500 2024-09-12T02:28:31.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11a4053090 con 0x7f11a4055500 2024-09-12T02:28:31.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f7dda480640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7db806bf00 0x7f7db806e3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0007fd0 tx=0x7f7dd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7dcc017e70 con 0x7f7db8074120 2024-09-12T02:28:31.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f554c00be50 con 0x7f5540074180 2024-09-12T02:28:31.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.211+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f554c08c3a0 con 0x7f55540b28e0 2024-09-12T02:28:31.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f55537fe640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f5540074180 0x7f55400765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f55537fe640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f5540074180 0x7f55400765a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f55527fc640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f554006bf00 0x7f554006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.212+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34380130d0 con 0x7f3450152730 2024-09-12T02:28:31.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f3455552640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3450069170 con 0x7f3450152730 2024-09-12T02:28:31.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f34477fe640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f343006be80 0x7f343006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3438093440 con 0x7f3450152730 2024-09-12T02:28:31.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.213+0000 7f1193fff640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11980702c0 0x7f1198072780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f554c00be50 con 0x7f5540074180 2024-09-12T02:28:31.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f11a008aad0 con 0x7f11a4055500 2024-09-12T02:28:31.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f1193fff640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f11980784c0 0x7f119807a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f119807af90 con 0x7f11980784c0 2024-09-12T02:28:31.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32a0022e50 con 0x7f32880742a0 2024-09-12T02:28:31.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f32a0091050 con 0x7f32a4151010 2024-09-12T02:28:31.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f32a88c5640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f328806c0a0 0x7f328806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f34477fe640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f3430074080 0x7f34300764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3430076b50 con 0x7f3430074080 2024-09-12T02:28:31.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f344effd640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f343006be80 0x7f343006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f343809a050 con 0x7f3450152730 2024-09-12T02:28:31.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f8ac9d9b640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8ab406bf00 0x7f8ab406e3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8abc034000 tx=0x7f8abc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f11a0055000 con 0x7f11a4055500 2024-09-12T02:28:31.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb780050d0 con 0x7fbb80162790 2024-09-12T02:28:31.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.214+0000 7f11ab7fe640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f11980784c0 0x7f119807a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7f32a98c7640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f32880742a0 0x7f32880766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7f11aaffd640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11980702c0 0x7f1198072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7f32a88c5640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f328806c0a0 0x7f328806e560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32a4157d30 tx=0x7f329c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7fbb767fc640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbb6406bf00 0x7fbb6406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7f344effd640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f343006be80 0x7f343006e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f344002f000 tx=0x7f3440007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7f32a98c7640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f32880742a0 0x7f32880766c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.216+0000 7f11ab7fe640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f11980784c0 0x7f119807a8e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.216+0000 7f11aaffd640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11980702c0 0x7f1198072780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f119c034000 tx=0x7f119c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbb7808b850 con 0x7fbb80162790 2024-09-12T02:28:31.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7fbb767fc640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fbb64074180 0x7fbb640765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb64076c50 con 0x7fbb64074180 2024-09-12T02:28:31.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.215+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbb7808bc40 con 0x7fbb80162790 2024-09-12T02:28:31.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.216+0000 7f55527fc640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f554006bf00 0x7f554006e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5548034000 tx=0x7f554802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.216+0000 7f344f7fe640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f3430074080 0x7f34300764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.216+0000 7fbb85752640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fbb64074180 0x7fbb640765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.217+0000 7fbb85f53640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbb6406bf00 0x7fbb6406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.217+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f119807af90 con 0x7f11980784c0 2024-09-12T02:28:31.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.217+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32a0022e50 con 0x7f32880742a0 2024-09-12T02:28:31.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.217+0000 7fbb85f53640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbb6406bf00 0x7fbb6406e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c034000 tx=0x7fbb7c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.218+0000 7fbb85752640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fbb64074180 0x7fbb640765a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.218+0000 7f344f7fe640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f3430074080 0x7f34300764a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.219+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3430076b50 con 0x7f3430074080 2024-09-12T02:28:31.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.219+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb64076c50 con 0x7fbb64074180 2024-09-12T02:28:31.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.241+0000 7f7ddb482640 1 -- 172.21.15.181:0/60382845 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7dd40756f0 con 0x7f7db8074120 2024-09-12T02:28:31.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.241+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff880cc3e0 con 0x7eff68074120 2024-09-12T02:28:31.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.241+0000 7f7dcaffd640 1 -- 172.21.15.181:0/60382845 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7dd40756f0 con 0x7f7db8074120 2024-09-12T02:28:31.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7eff76ffd640 1 -- 172.21.15.181:0/487144178 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff880cc3e0 con 0x7eff68074120 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f7db8074120 msgr2=0x7f7db8076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7f7dc8ff9640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f7db8074120 0x7f7db8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7db806bf00 msgr2=0x7f7db806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7f7dc8ff9640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7db806bf00 0x7f7db806e3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0007fd0 tx=0x7f7dd0009040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dd4162c20 msgr2=0x7f7dd414be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7f7dc8ff9640 1 --2- 172.21.15.181:0/60382845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dd4162c20 0x7f7dd414be50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c730 tx=0x7f7dcc00cbf0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7f7ddac81640 1 -- 172.21.15.181:0/60382845 reap_dead start 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/60382845 shutdown_connections 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7eff68074120 msgr2=0x7eff68076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.242+0000 7eff8ce0e640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7eff68074120 0x7eff68076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/60382845 >> 172.21.15.181:0/60382845 conn(0x7f7dd406bdf0 msgr2=0x7f7dd40af010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff6806bf00 msgr2=0x7eff6806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff6806bf00 0x7eff6806e3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007fd0 tx=0x7eff7c007e20 comp rx=0 tx=0).stop 2024-09-12T02:28:31.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880cf6c0 msgr2=0x7eff881f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 --2- 172.21.15.181:0/487144178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff880cf6c0 0x7eff881f6a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff80042000 tx=0x7eff80004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:31.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff86d9d640 1 -- 172.21.15.181:0/487144178 reap_dead start 2024-09-12T02:28:31.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 shutdown_connections 2024-09-12T02:28:31.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 >> 172.21.15.181:0/487144178 conn(0x7eff880b1df0 msgr2=0x7eff8816d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 shutdown_connections 2024-09-12T02:28:31.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7f55596f1640 1 -- 172.21.15.181:0/2795554897 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55540cd730 con 0x7f5540074180 2024-09-12T02:28:31.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/60382845 shutdown_connections 2024-09-12T02:28:31.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/60382845 wait complete. 2024-09-12T02:28:31.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7eff8ce0e640 1 -- 172.21.15.181:0/487144178 wait complete. 2024-09-12T02:28:31.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.243+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ad4074220 con 0x7f8ab4074120 2024-09-12T02:28:31.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.244+0000 7f553b7fe640 1 -- 172.21.15.181:0/2795554897 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f55440050b0 con 0x7f5540074180 2024-09-12T02:28:31.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.244+0000 7f8acb7fe640 1 -- 172.21.15.181:0/1330302023 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ad4074220 con 0x7f8ab4074120 2024-09-12T02:28:31.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.244+0000 7f55397fa640 1 -- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f5540074180 msgr2=0x7f55400765a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.244+0000 7f55397fa640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f5540074180 0x7f55400765a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f8ab4074120 msgr2=0x7f8ab4076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f8ab4074120 0x7f8ab4076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8ab406bf00 msgr2=0x7f8ab406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8ab406bf00 0x7f8ab406e3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8abc034000 tx=0x7f8abc02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ad40cd6c0 msgr2=0x7f8ad415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 --2- 172.21.15.181:0/1330302023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ad40cd6c0 0x7f8ad415d6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009fd0 tx=0x7f8ac400b870 comp rx=0 tx=0).stop 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad2d9d640 1 -- 172.21.15.181:0/1330302023 reap_dead start 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 shutdown_connections 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 >> 172.21.15.181:0/1330302023 conn(0x7f8ad40b1df0 msgr2=0x7f8ad40aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 shutdown_connections 2024-09-12T02:28:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f55397fa640 1 -- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f554006bf00 msgr2=0x7f554006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f55397fa640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f554006bf00 0x7f554006e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5548034000 tx=0x7f554802e000 comp rx=0 tx=0).stop 2024-09-12T02:28:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f8ad8842640 1 -- 172.21.15.181:0/1330302023 wait complete. 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f55397fa640 1 -- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55540b28e0 msgr2=0x7f555414ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f55397fa640 1 --2- 172.21.15.181:0/2795554897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55540b28e0 0x7f555414ff00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c370 tx=0x7f554c00c830 comp rx=0 tx=0).stop 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.245+0000 7f55537fe640 1 -- 172.21.15.181:0/2795554897 reap_dead start 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.246+0000 7f55397fa640 1 -- 172.21.15.181:0/2795554897 shutdown_connections 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.246+0000 7f55397fa640 1 -- 172.21.15.181:0/2795554897 >> 172.21.15.181:0/2795554897 conn(0x7f55540b1df0 msgr2=0x7f5554158630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.246+0000 7f55397fa640 1 -- 172.21.15.181:0/2795554897 shutdown_connections 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.247+0000 7f55397fa640 1 -- 172.21.15.181:0/2795554897 wait complete. 2024-09-12T02:28:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.247+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbb80076100 con 0x7fbb64074180 2024-09-12T02:28:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.248+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11a4034980 con 0x7f11980784c0 2024-09-12T02:28:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.248+0000 7fbb767fc640 1 -- 172.21.15.181:0/2934289148 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbb80076100 con 0x7fbb64074180 2024-09-12T02:28:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.248+0000 7f1193fff640 1 -- 172.21.15.181:0/1201442270 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f11a4034980 con 0x7f11980784c0 2024-09-12T02:28:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.248+0000 7f3455552640 1 -- 172.21.15.181:0/3871142833 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34500cca40 con 0x7f3430074080 2024-09-12T02:28:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32a4156700 con 0x7f32880742a0 2024-09-12T02:28:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fbb64074180 msgr2=0x7fbb640765a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7fbb881b7640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fbb64074180 0x7fbb640765a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f11980784c0 msgr2=0x7f119807a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f11980784c0 0x7f119807a8e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbb6406bf00 msgr2=0x7fbb6406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7fbb881b7640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbb6406bf00 0x7fbb6406e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c034000 tx=0x7fbb7c02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb80162790 msgr2=0x7fbb800b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11980702c0 msgr2=0x7f1198072780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f34477fe640 1 -- 172.21.15.181:0/3871142833 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f34500cca40 con 0x7f3430074080 2024-09-12T02:28:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11980702c0 0x7f1198072780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f119c034000 tx=0x7f119c02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:31.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11a4055500 msgr2=0x7f11a404e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 --2- 172.21.15.181:0/1201442270 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11a4055500 0x7f11a404e360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11a000c3f0 tx=0x7f11a000c8b0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f3299ffb640 1 -- 172.21.15.181:0/3778976559 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f32a4156700 con 0x7f32880742a0 2024-09-12T02:28:31.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11ab7fe640 1 -- 172.21.15.181:0/1201442270 reap_dead start 2024-09-12T02:28:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7fbb881b7640 1 --2- 172.21.15.181:0/2934289148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb80162790 0x7fbb800b4250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c730 tx=0x7fbb7800cbf0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 shutdown_connections 2024-09-12T02:28:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 >> 172.21.15.181:0/1201442270 conn(0x7f11a401fb40 msgr2=0x7f11a40e1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.249+0000 7fbb86754640 1 -- 172.21.15.181:0/2934289148 reap_dead start 2024-09-12T02:28:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 shutdown_connections 2024-09-12T02:28:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f32880742a0 msgr2=0x7f32880766c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f32ab32a640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f32880742a0 0x7f32880766c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 >> 172.21.15.181:0/2934289148 conn(0x7fbb80067950 msgr2=0x7fbb80067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 shutdown_connections 2024-09-12T02:28:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f11b196d640 1 -- 172.21.15.181:0/1201442270 wait complete. 2024-09-12T02:28:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f34457fa640 1 -- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f3430074080 msgr2=0x7f34300764a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f34457fa640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f3430074080 0x7f34300764a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f328806c0a0 msgr2=0x7f328806e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 shutdown_connections 2024-09-12T02:28:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7fbb881b7640 1 -- 172.21.15.181:0/2934289148 wait complete. 2024-09-12T02:28:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f34457fa640 1 -- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f343006be80 msgr2=0x7f343006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f34457fa640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f343006be80 0x7f343006e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f344002f000 tx=0x7f3440007000 comp rx=0 tx=0).stop 2024-09-12T02:28:31.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f34457fa640 1 -- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3450152730 msgr2=0x7f34500733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f34457fa640 1 --2- 172.21.15.181:0/3871142833 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3450152730 0x7f34500733d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3438008fd0 tx=0x7f3438015420 comp rx=0 tx=0).stop 2024-09-12T02:28:31.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f344f7fe640 1 -- 172.21.15.181:0/3871142833 reap_dead start 2024-09-12T02:28:31.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f34457fa640 1 -- 172.21.15.181:0/3871142833 shutdown_connections 2024-09-12T02:28:31.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f34457fa640 1 -- 172.21.15.181:0/3871142833 >> 172.21.15.181:0/3871142833 conn(0x7f34500d0340 msgr2=0x7f34500b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f32ab32a640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f328806c0a0 0x7f328806e560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32a4157d30 tx=0x7f329c00b040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a4151010 msgr2=0x7f32a415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.250+0000 7f32ab32a640 1 --2- 172.21.15.181:0/3778976559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32a4151010 0x7f32a415c9d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32a0008060 tx=0x7f32a0008520 comp rx=0 tx=0).stop 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f32a98c7640 1 -- 172.21.15.181:0/3778976559 reap_dead start 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 shutdown_connections 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 >> 172.21.15.181:0/3778976559 conn(0x7f32a40b1df0 msgr2=0x7f32a40b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 shutdown_connections 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f32ab32a640 1 -- 172.21.15.181:0/3778976559 wait complete. 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f34457fa640 1 -- 172.21.15.181:0/3871142833 shutdown_connections 2024-09-12T02:28:31.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.251+0000 7f34457fa640 1 -- 172.21.15.181:0/3871142833 wait complete. 2024-09-12T02:28:31.311 INFO:teuthology.orchestra.run.smithi181.stdout:60129542150 2024-09-12T02:28:31.311 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:28:31.312 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:31.313 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:28:31.313 INFO:teuthology.orchestra.run.smithi181.stdout:64424509447 2024-09-12T02:28:31.314 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:28:31.314 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:31.314 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:28:31.315 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:31.315 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:28:31.316 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:31.316 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:28:31.317 INFO:teuthology.orchestra.run.smithi181.stdout:60129542151 2024-09-12T02:28:31.317 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:28:31.318 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:31.318 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:28:31.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.518+0000 7f401662b640 1 Processor -- start 2024-09-12T02:28:31.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.518+0000 7f401662b640 1 -- start start 2024-09-12T02:28:31.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.520+0000 7f401662b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 0x7f400804efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.520+0000 7f401662b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4008006830 con 0x7f400800a350 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.520+0000 7f401662b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4008006d90 con 0x7f4008036470 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.520+0000 7f401662b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40080078d0 con 0x7f4008036f60 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.520+0000 7f4015e2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 0x7f400804efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.520+0000 7f4015e2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 0x7f400804efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35494/0 (socket says 172.21.15.181:35494) 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.520+0000 7f4015e2a640 1 -- 172.21.15.181:0/1923310886 learned_addr learned my addr 172.21.15.181:0/1923310886 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167380258 0 0) 0x7f400c001110 con 0x7f400800a350 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ffc003520 con 0x7f400800a350 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2923223168 0 0) 0x7f3ffc003520 con 0x7f400800a350 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 msgr2=0x7f400804efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 0x7f400804efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 >> v1:172.21.15.204:6789/0 conn(0x7f4008036470 legacy=0x7f4008055100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4008055810 con 0x7f400800a350 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f400c001840 con 0x7f400800a350 2024-09-12T02:28:31.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 >> v1:172.21.15.181:6789/0 conn(0x7f400800a350 legacy=0x7f4008036850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 0x7f3ffc0037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f2b53dc4640 1 Processor -- start 2024-09-12T02:28:31.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ffc003ce0 0x7f3ffc004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc00b1a0 0x7f3ffc00d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f40080078d0 con 0x7f3ffc00b1a0 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc00ded0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc004e60 con 0x7f4008036f60 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f4014e28640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ffc003ce0 0x7f3ffc004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f4015e2a640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc00b1a0 0x7f3ffc00d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f4014e28640 1 -- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 msgr2=0x7f3ffc0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f4014e28640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4008036f60 0x7f3ffc0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f4014e28640 1 -- 172.21.15.181:0/1923310886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc00b1a0 msgr2=0x7f3ffc00d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f4014e28640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc00b1a0 0x7f3ffc00d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f19c1f11640 1 Processor -- start 2024-09-12T02:28:31.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f19c1f11640 1 -- start start 2024-09-12T02:28:31.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7fc8b945e640 1 Processor -- start 2024-09-12T02:28:31.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.521+0000 7f410f48d640 1 Processor -- start 2024-09-12T02:28:31.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f410f48d640 1 -- start start 2024-09-12T02:28:31.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7f4014e28640 1 -- 172.21.15.181:0/1923310886 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc003520 con 0x7f3ffc003ce0 2024-09-12T02:28:31.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.522+0000 7fc8b945e640 1 -- start start 2024-09-12T02:28:31.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7f410f48d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 0x7f4100006ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7f410f48d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4100007ce0 con 0x7f41000df2d0 2024-09-12T02:28:31.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7f410f48d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4100039ca0 con 0x7f4100007850 2024-09-12T02:28:31.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7f2b53dc4640 1 -- start start 2024-09-12T02:28:31.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f410f48d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4100007fc0 con 0x7f4100006620 2024-09-12T02:28:31.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f3797131640 1 Processor -- start 2024-09-12T02:28:31.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7fc8b945e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc8b40b5f80 0x7fc8b406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7fc8b945e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b406f150 0x7fc8b40b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7fc8b945e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b40bb740 con 0x7fc8b415e310 2024-09-12T02:28:31.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7fc8b945e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b40bb520 con 0x7fc8b40b5f80 2024-09-12T02:28:31.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.523+0000 7fc8b945e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b40d4a00 con 0x7fc8b406f150 2024-09-12T02:28:31.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f3797131640 1 -- start start 2024-09-12T02:28:31.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f410ca28640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f4100007850 0x7f410003a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:38342/0 (socket says 172.21.15.181:38342) 2024-09-12T02:28:31.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f410ca28640 1 -- 172.21.15.181:0/4166588348 learned_addr learned my addr 172.21.15.181:0/4166588348 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:31.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19c1f11640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f19bc0b63c0 0x7f19bc06e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7fc8b27fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc8b40b5f80 0x7fc8b406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7fc8b3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b406f150 0x7fc8b40b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7fc8b27fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc8b40b5f80 0x7fc8b406ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53048/0 (socket says 172.21.15.181:53048) 2024-09-12T02:28:31.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3236526610 learned_addr learned my addr 172.21.15.181:0/3236526610 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f410da2a640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 0x7f4100006ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024218820 0 0) 0x7f4100039ca0 con 0x7f4100007850 2024-09-12T02:28:31.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b53dc4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2b4c0b28e0 0x7f2b4c0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b53dc4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b4c15a790 0x7f2b4c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b53dc4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b53dc4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2b4c0cfe20 con 0x7f2b4c15a790 2024-09-12T02:28:31.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b53dc4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2b4c06f7b0 con 0x7f2b4c0b28e0 2024-09-12T02:28:31.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b53dc4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4c15f070 con 0x7f2b4c0cdfc0 2024-09-12T02:28:31.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f4014e28640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ffc003ce0 0x7f3ffc004160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f400c012e60 tx=0x7f3ffc004820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eda4eb161615e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40f4003520 con 0x7f4100007850 2024-09-12T02:28:31.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b5135f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b4c15a790 0x7f2b4c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b5135f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b4c15a790 0x7f2b4c15eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51764/0 (socket says 172.21.15.181:51764) 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b5135f640 1 -- 172.21.15.181:0/1956563309 learned_addr learned my addr 172.21.15.181:0/1956563309 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f2b52361640 1 --2- 172.21.15.181:0/1956563309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19c1f11640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f19bc06ed20 0x7f19bc0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19c1f11640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19bc06d740 con 0x7f19bc162840 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19c1f11640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f19bc06fe00 con 0x7f19bc0b63c0 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19c1f11640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f19bc06e350 con 0x7f19bc06ed20 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19bbfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f19bc06ed20 0x7f19bc0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19bbfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f19bc06ed20 0x7f19bc0b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53050/0 (socket says 172.21.15.181:53050) 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19bbfff640 1 -- 172.21.15.181:0/2929059896 learned_addr learned my addr 172.21.15.181:0/2929059896 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1998757164 0 0) 0x7f40f4003520 con 0x7f4100007850 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 msgr2=0x7f4100006ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f40fffff640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 0x7f4100006ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 >> v1:172.21.15.181:6789/0 conn(0x7f41000df2d0 legacy=0x7f41000347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4100039f80 con 0x7f4100007850 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f40f8001670 con 0x7f4100007850 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 >> v1:172.21.15.204:6789/0 conn(0x7f4100007850 legacy=0x7f410003a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f40f4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 0x7f40f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f4004d40 0x7f40f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4100007fc0 con 0x7f40f4004d40 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f40f400bb00 con 0x7f40f40039b0 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40f400bd00 con 0x7f4100006620 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f410da2a640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f4004d40 0x7f40f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.524+0000 7f19bbfff640 1 -- 172.21.15.181:0/2929059896 >> v2:172.21.15.181:3300/0 conn(0x7f19bc0b63c0 msgr2=0x7f19bc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f19bbfff640 1 --2- 172.21.15.181:0/2929059896 >> v2:172.21.15.181:3300/0 conn(0x7f19bc0b63c0 0x7f19bc06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f19bbfff640 1 -- 172.21.15.181:0/2929059896 >> v1:172.21.15.181:6789/0 conn(0x7f19bc162840 legacy=0x7f19bc06f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f19bbfff640 1 -- 172.21.15.181:0/2929059896 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc06da20 con 0x7f19bc06ed20 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c047070 con 0x7f3ffc003ce0 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400c0122f0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f4007fff640 1 -- 172.21.15.181:0/1923310886 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c0077e0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f3794ecd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3790151210 0x7f37900cdb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54414/0 (socket says 172.21.15.181:54414) 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f3797131640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37900b5cb0 0x7f379006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f3794ecd640 1 -- 172.21.15.181:0/3850325134 learned_addr learned my addr 172.21.15.181:0/3850325134 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379006bcb0 con 0x7f3790151210 2024-09-12T02:28:31.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379006bf90 con 0x7f379006cd50 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f379006c8c0 con 0x7f37900b5cb0 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3236526610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b406f150 msgr2=0x7fc8b40b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7fc8b27fc640 1 --2- 172.21.15.181:0/3236526610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b406f150 0x7fc8b40b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3236526610 >> v1:172.21.15.181:6789/0 conn(0x7fc8b415e310 legacy=0x7fc8b40bae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3236526610 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b40bba20 con 0x7fc8b40b5f80 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f2b52361640 1 -- 172.21.15.181:0/1956563309 >> v2:172.21.15.204:3300/0 conn(0x7f2b4c0b28e0 msgr2=0x7f2b4c0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f2b52361640 1 --2- 172.21.15.181:0/1956563309 >> v2:172.21.15.204:3300/0 conn(0x7f2b4c0b28e0 0x7f2b4c0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f2b52361640 1 -- 172.21.15.181:0/1956563309 >> v2:172.21.15.181:3300/0 conn(0x7f2b4c15a790 msgr2=0x7f2b4c15eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f2b52361640 1 --2- 172.21.15.181:0/1956563309 >> v2:172.21.15.181:3300/0 conn(0x7f2b4c15a790 0x7f2b4c15eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.525+0000 7f2b52361640 1 -- 172.21.15.181:0/1956563309 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4c0ce900 con 0x7f2b4c0cdfc0 2024-09-12T02:28:31.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f37956ce640 1 --2- 172.21.15.181:0/3850325134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37900b5cb0 0x7f379006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f19bbfff640 1 --2- 172.21.15.181:0/2929059896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc06ed20 0x7f19bc0b5120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19bc071370 tx=0x7f19b002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c894c62e1da47d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f2b52361640 1 --2- 172.21.15.181:0/1956563309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0ce3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c076170 tx=0x7f2b3c02a120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a120666f27cb1b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f378f7fe640 1 -- 172.21.15.181:0/3850325134 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333333672 0 0) 0x7f379006bf90 con 0x7f379006cd50 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f378f7fe640 1 -- 172.21.15.181:0/3850325134 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3778003520 con 0x7f379006cd50 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f37956ce640 1 -- 172.21.15.181:0/3850325134 >> v1:172.21.15.204:6789/0 conn(0x7f379006cd50 legacy=0x7f37900b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f37956ce640 1 -- 172.21.15.181:0/3850325134 >> v1:172.21.15.181:6789/0 conn(0x7f3790151210 legacy=0x7f37900cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f37956ce640 1 -- 172.21.15.181:0/3850325134 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379006c270 con 0x7f37900b5cb0 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f19ba7fc640 1 -- 172.21.15.181:0/2929059896 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0037070 con 0x7f19bc06ed20 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f19ba7fc640 1 -- 172.21.15.181:0/2929059896 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b0032440 con 0x7f19bc06ed20 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f19ba7fc640 1 -- 172.21.15.181:0/2929059896 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0032850 con 0x7f19bc06ed20 2024-09-12T02:28:31.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f2b50b5e640 1 -- 172.21.15.181:0/1956563309 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c037070 con 0x7f2b4c0cdfc0 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f2b50b5e640 1 -- 172.21.15.181:0/1956563309 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c032440 con 0x7f2b4c0cdfc0 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f2b50b5e640 1 -- 172.21.15.181:0/1956563309 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c032810 con 0x7f2b4c0cdfc0 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f401662b640 1 -- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ffc003ce0 msgr2=0x7f3ffc004160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f401662b640 1 --2- 172.21.15.181:0/1923310886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ffc003ce0 0x7f3ffc004160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f400c012e60 tx=0x7f3ffc004820 comp rx=0 tx=0).stop 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f4015e2a640 1 -- 172.21.15.181:0/1923310886 reap_dead start 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f401662b640 1 -- 172.21.15.181:0/1923310886 shutdown_connections 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f401662b640 1 -- 172.21.15.181:0/1923310886 >> 172.21.15.181:0/1923310886 conn(0x7f400801dd80 msgr2=0x7f40080549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 -- 172.21.15.181:0/2929059896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc06ed20 msgr2=0x7f19bc0b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 --2- 172.21.15.181:0/2929059896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc06ed20 0x7f19bc0b5120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19bc071370 tx=0x7f19b002a210 comp rx=0 tx=0).stop 2024-09-12T02:28:31.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7fc8b27fc640 1 --2- 172.21.15.181:0/3236526610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b40b5f80 0x7fc8b406ec10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e50 tx=0x7fc8ac02a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc7b6a05a2f9c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7fc8b1ffb640 1 -- 172.21.15.181:0/3236526610 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac036070 con 0x7fc8b40b5f80 2024-09-12T02:28:31.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7fc8b1ffb640 1 -- 172.21.15.181:0/3236526610 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac031600 con 0x7fc8b40b5f80 2024-09-12T02:28:31.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7fb66376d640 1 Processor -- start 2024-09-12T02:28:31.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7fb66376d640 1 -- start start 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f410d229640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f40f4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f410ca28640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 0x7f40f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f410d229640 1 -- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 msgr2=0x7f40f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f410d229640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100006620 0x7f40f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f410d229640 1 -- 172.21.15.181:0/4166588348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f4004d40 msgr2=0x7f40f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f410d229640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f4004d40 0x7f40f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.526+0000 7f410d229640 1 -- 172.21.15.181:0/4166588348 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4100039f80 con 0x7f40f40039b0 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f401662b640 1 -- 172.21.15.181:0/1923310886 shutdown_connections 2024-09-12T02:28:31.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f401662b640 1 -- 172.21.15.181:0/1923310886 wait complete. 2024-09-12T02:28:31.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 -- 172.21.15.181:0/2929059896 shutdown_connections 2024-09-12T02:28:31.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 --2- 172.21.15.181:0/2929059896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc06ed20 0x7f19bc0b5120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 --2- 172.21.15.181:0/2929059896 >> v2:172.21.15.181:3300/0 conn(0x7f19bc0b63c0 0x7f19bc06e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 -- 172.21.15.181:0/2929059896 >> 172.21.15.181:0/2929059896 conn(0x7f19bc0713e0 msgr2=0x7f19bc0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f37956ce640 1 --2- 172.21.15.181:0/3850325134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37900b5cb0 0x7f379006d1c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37800097d0 tx=0x7f378002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc59e7a073a982e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f410da2a640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f4004d40 0x7f40f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:31.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 -- 172.21.15.181:0/2929059896 shutdown_connections 2024-09-12T02:28:31.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b1ffb640 1 -- 172.21.15.181:0/3236526610 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031a10 con 0x7fc8b40b5f80 2024-09-12T02:28:31.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 -- 172.21.15.181:0/3236526610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b40b5f80 msgr2=0x7fc8b406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 --2- 172.21.15.181:0/3236526610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b40b5f80 0x7fc8b406ec10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e50 tx=0x7fc8ac02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f410d229640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f40f4003db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4104001650 tx=0x7f40f4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e0180dbd183458 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 -- 172.21.15.181:0/3236526610 shutdown_connections 2024-09-12T02:28:31.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 --2- 172.21.15.181:0/3236526610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b406f150 0x7fc8b40b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 --2- 172.21.15.181:0/3236526610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b40b5f80 0x7fc8b406ec10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 -- 172.21.15.181:0/3236526610 >> 172.21.15.181:0/3236526610 conn(0x7fc8b406e800 msgr2=0x7fc8b406dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 -- 172.21.15.181:0/3236526610 shutdown_connections 2024-09-12T02:28:31.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fc8b945e640 1 -- 172.21.15.181:0/3236526610 wait complete. 2024-09-12T02:28:31.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 -- 172.21.15.181:0/1956563309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 msgr2=0x7f2b4c0ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/1956563309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0ce3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c076170 tx=0x7f2b3c02a120 comp rx=0 tx=0).stop 2024-09-12T02:28:31.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 -- 172.21.15.181:0/1956563309 shutdown_connections 2024-09-12T02:28:31.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/1956563309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0ce3c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/1956563309 >> v2:172.21.15.181:3300/0 conn(0x7f2b4c15a790 0x7f2b4c15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/1956563309 >> v2:172.21.15.204:3300/0 conn(0x7f2b4c0b28e0 0x7f2b4c0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 -- 172.21.15.181:0/1956563309 >> 172.21.15.181:0/1956563309 conn(0x7f2b4c0b1df0 msgr2=0x7f2b4c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104001220 con 0x7f40f40039b0 2024-09-12T02:28:31.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 -- 172.21.15.181:0/1956563309 shutdown_connections 2024-09-12T02:28:31.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410402e070 con 0x7f40f40039b0 2024-09-12T02:28:31.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fb66376d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb65c162720 0x7fb65c0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fb66376d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb65c0b4e40 0x7fb65c162f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fb66376d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65c163520 con 0x7fb65c162b00 2024-09-12T02:28:31.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fb66376d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb65c0cce00 con 0x7fb65c0b4e40 2024-09-12T02:28:31.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fb66376d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb65c163dc0 con 0x7fb65c162720 2024-09-12T02:28:31.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f2b53dc4640 1 -- 172.21.15.181:0/1956563309 wait complete. 2024-09-12T02:28:31.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7f378f7fe640 1 -- 172.21.15.181:0/3850325134 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780037070 con 0x7f37900b5cb0 2024-09-12T02:28:31.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f378f7fe640 1 -- 172.21.15.181:0/3850325134 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3780032440 con 0x7f37900b5cb0 2024-09-12T02:28:31.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f378f7fe640 1 -- 172.21.15.181:0/3850325134 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780032850 con 0x7f37900b5cb0 2024-09-12T02:28:31.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.528+0000 7fb660d08640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fb65c162b00 0x7fb65c0b4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:38372/0 (socket says 172.21.15.181:38372) 2024-09-12T02:28:31.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7fb660d08640 1 -- 172.21.15.181:0/3200933424 learned_addr learned my addr 172.21.15.181:0/3200933424 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:31.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7fb661d0a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb65c0b4e40 0x7fb65c162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.527+0000 7f19c1f11640 1 -- 172.21.15.181:0/2929059896 wait complete. 2024-09-12T02:28:31.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f401662b640 1 Processor -- start 2024-09-12T02:28:31.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f19c1f11640 1 Processor -- start 2024-09-12T02:28:31.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f410f48d640 1 -- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 msgr2=0x7f40f4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7fb661509640 1 --2- 172.21.15.181:0/3200933424 >> v2:172.21.15.204:3300/0 conn(0x7fb65c162720 0x7fb65c0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f40fffff640 1 -- 172.21.15.181:0/4166588348 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104001220 con 0x7f40f40039b0 2024-09-12T02:28:31.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7fb661d0a640 1 -- 172.21.15.181:0/3200933424 >> v2:172.21.15.204:3300/0 conn(0x7fb65c162720 msgr2=0x7fb65c0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7fb661d0a640 1 --2- 172.21.15.181:0/3200933424 >> v2:172.21.15.204:3300/0 conn(0x7fb65c162720 0x7fb65c0b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7fb661d0a640 1 -- 172.21.15.181:0/3200933424 >> v1:172.21.15.204:6789/0 conn(0x7fb65c162b00 legacy=0x7fb65c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7fb661d0a640 1 -- 172.21.15.181:0/3200933424 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c163800 con 0x7fb65c0b4e40 2024-09-12T02:28:31.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f410f48d640 1 --2- 172.21.15.181:0/4166588348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f40f4003db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4104001650 tx=0x7f40f4005830 comp rx=0 tx=0).stop 2024-09-12T02:28:31.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f410da2a640 1 -- 172.21.15.181:0/4166588348 reap_dead start 2024-09-12T02:28:31.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f2b53dc4640 1 Processor -- start 2024-09-12T02:28:31.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f401662b640 1 -- start start 2024-09-12T02:28:31.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f401662b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc003ce0 0x7f400804a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.529+0000 7f19c1f11640 1 -- start start 2024-09-12T02:28:31.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7fc8b945e640 1 Processor -- start 2024-09-12T02:28:31.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7fc8b945e640 1 -- start start 2024-09-12T02:28:31.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37900b5cb0 msgr2=0x7f379006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f3797131640 1 --2- 172.21.15.181:0/3850325134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37900b5cb0 0x7f379006d1c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37800097d0 tx=0x7f378002a230 comp rx=0 tx=0).stop 2024-09-12T02:28:31.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f3c89574640 1 Processor -- start 2024-09-12T02:28:31.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f3c89574640 1 -- start start 2024-09-12T02:28:31.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 shutdown_connections 2024-09-12T02:28:31.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f3797131640 1 --2- 172.21.15.181:0/3850325134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37900b5cb0 0x7f379006d1c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 >> 172.21.15.181:0/3850325134 conn(0x7f37900cca40 msgr2=0x7f37900cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19c1f11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc06ed20 0x7f19bc1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19c1f11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19bc0b63c0 0x7f19bc159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f4015629640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc003ce0 0x7f400804a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f4015629640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc003ce0 0x7f400804a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51798/0 (socket says 172.21.15.181:51798) 2024-09-12T02:28:31.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fb661d0a640 1 --2- 172.21.15.181:0/3200933424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c162f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0d1160 tx=0x7fb64c02a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c61f77f563429e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19c1f11640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc162840 0x7f19bc155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f401662b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40080d41a0 0x7f400804aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19baffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19bc0b63c0 0x7f19bc159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f401662b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40080d4b80 0x7f4008177e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f401662b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f40080deec0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f401662b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f400800a790 con 0x7f40080d4b80 2024-09-12T02:28:31.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f401662b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40080072c0 con 0x7f40080d41a0 2024-09-12T02:28:31.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19baffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19bc0b63c0 0x7f19bc159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35546/0 (socket says 172.21.15.181:35546) 2024-09-12T02:28:31.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fb653fff640 1 -- 172.21.15.181:0/3200933424 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c037070 con 0x7fb65c0b4e40 2024-09-12T02:28:31.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19baffd640 1 -- 172.21.15.181:0/239553269 learned_addr learned my addr 172.21.15.181:0/239553269 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.530+0000 7f2b53dc4640 1 -- start start 2024-09-12T02:28:31.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f4015629640 1 -- 172.21.15.181:0/351545156 learned_addr learned my addr 172.21.15.181:0/351545156 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f4014e28640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40080d41a0 0x7f400804aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f4015e2a640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40080d4b80 0x7f4008177e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 shutdown_connections 2024-09-12T02:28:31.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b53dc4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4c0b28e0 0x7f2b4c153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b53dc4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b53dc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b4c15a790 0x7f2b4c155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fb653fff640 1 -- 172.21.15.181:0/3200933424 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb64c032440 con 0x7fb65c0b4e40 2024-09-12T02:28:31.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f410f48d640 1 -- 172.21.15.181:0/4166588348 shutdown_connections 2024-09-12T02:28:31.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f410f48d640 1 -- 172.21.15.181:0/4166588348 >> 172.21.15.181:0/4166588348 conn(0x7f410001e190 msgr2=0x7f4100054ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b945e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b406f150 0x7fc8b414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b945e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b40b5f80 0x7fc8b4090c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b945e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8b415e310 0x7fc8b415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b945e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b415e6f0 con 0x7fc8b415e310 2024-09-12T02:28:31.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b945e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b406f5a0 con 0x7fc8b406f150 2024-09-12T02:28:31.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b945e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b40bbd00 con 0x7fc8b40b5f80 2024-09-12T02:28:31.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b27fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b40b5f80 0x7fc8b4090c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f3797131640 1 -- 172.21.15.181:0/3850325134 wait complete. 2024-09-12T02:28:31.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b27fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b40b5f80 0x7fc8b4090c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35558/0 (socket says 172.21.15.181:35558) 2024-09-12T02:28:31.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3024122381 learned_addr learned my addr 172.21.15.181:0/3024122381 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b5135f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f3c89574640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c050 0x7f3c840ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f3c89574640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c8415c430 0x7f3c840ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f3c89574640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c840cd580 con 0x7f3c840cf1e0 2024-09-12T02:28:31.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f3c89574640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f3c840ce100 con 0x7f3c8415c430 2024-09-12T02:28:31.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f3c89574640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3c840cd860 con 0x7f3c8415c050 2024-09-12T02:28:31.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19bbfff640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc162840 0x7f19bc155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b53dc4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4c0cfb40 con 0x7f2b4c15a790 2024-09-12T02:28:31.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b53dc4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4c0b3290 con 0x7f2b4c0b28e0 2024-09-12T02:28:31.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b53dc4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4c0b5350 con 0x7f2b4c0cdfc0 2024-09-12T02:28:31.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b5135f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35562/0 (socket says 172.21.15.181:35562) 2024-09-12T02:28:31.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b5135f640 1 -- 172.21.15.181:0/2009770103 learned_addr learned my addr 172.21.15.181:0/2009770103 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7fc8b2ffd640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b406f150 0x7fc8b414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f19bb7fe640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc06ed20 0x7f19bc1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc0b5660 con 0x7f19bc06ed20 2024-09-12T02:28:31.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc8b3fff640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8b415e310 0x7fc8b415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f410f48d640 1 -- 172.21.15.181:0/4166588348 shutdown_connections 2024-09-12T02:28:31.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc06dfe0 con 0x7f19bc162840 2024-09-12T02:28:31.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f410f48d640 1 -- 172.21.15.181:0/4166588348 wait complete. 2024-09-12T02:28:31.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f19bc0b57e0 con 0x7f19bc0b63c0 2024-09-12T02:28:31.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f3c837fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c8415c430 0x7f3c840ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f3c837fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c8415c430 0x7f3c840ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53116/0 (socket says 172.21.15.181:53116) 2024-09-12T02:28:31.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f3c837fe640 1 -- 172.21.15.181:0/2253874303 learned_addr learned my addr 172.21.15.181:0/2253874303 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f3c83fff640 1 --2- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c050 0x7f3c840ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b406f150 msgr2=0x7fc8b414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc8b27fc640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b406f150 0x7fc8b414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f4015629640 1 -- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40080d41a0 msgr2=0x7f400804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f4015629640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40080d41a0 0x7f400804aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f4015629640 1 -- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40080d4b80 msgr2=0x7f4008177e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f4015629640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40080d4b80 0x7f4008177e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8b415e310 msgr2=0x7fc8b415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc8b27fc640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8b415e310 0x7fc8b415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc8b27fc640 1 -- 172.21.15.181:0/3024122381 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b415f010 con 0x7fc8b40b5f80 2024-09-12T02:28:31.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f4015629640 1 -- 172.21.15.181:0/351545156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080e1df0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.531+0000 7f2b52361640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b4c15a790 0x7f2b4c155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f2b51b60640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4c0b28e0 0x7f2b4c153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f2b52361640 1 -- 172.21.15.181:0/2009770103 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 msgr2=0x7f2b4c0acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f2b52361640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f2b52361640 1 -- 172.21.15.181:0/2009770103 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4c0b28e0 msgr2=0x7f2b4c153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f2b52361640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4c0b28e0 0x7f2b4c153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f2b52361640 1 -- 172.21.15.181:0/2009770103 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4c15c330 con 0x7f2b4c15a790 2024-09-12T02:28:31.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc8b27fc640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b40b5f80 0x7fc8b4090c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009f70 tx=0x7fc8ac004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f4015629640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc003ce0 0x7f400804a560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f400000c7e0 tx=0x7f400000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f2b52361640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b4c15a790 0x7f2b4c155b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0afd10 tx=0x7f2b3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f4005ffb640 1 -- 172.21.15.181:0/351545156 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000016020 con 0x7f3ffc003ce0 2024-09-12T02:28:31.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19baffd640 1 -- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc162840 msgr2=0x7f19bc155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19baffd640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc162840 0x7f19bc155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19baffd640 1 -- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc06ed20 msgr2=0x7f19bc1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19baffd640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc06ed20 0x7f19bc1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f19baffd640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc1ec010 con 0x7f19bc0b63c0 2024-09-12T02:28:31.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f19bbfff640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc162840 0x7f19bc155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:31.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7fc89b7fe640 1 -- 172.21.15.181:0/3024122381 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac041020 con 0x7fc8b40b5f80 2024-09-12T02:28:31.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f3c82ffd640 1 -- 172.21.15.181:0/2253874303 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484349143 0 0) 0x7f3c840cd580 con 0x7f3c840cf1e0 2024-09-12T02:28:31.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.532+0000 7f3c82ffd640 1 -- 172.21.15.181:0/2253874303 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c6c003520 con 0x7f3c840cf1e0 2024-09-12T02:28:31.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f19bb7fe640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc06ed20 0x7f19bc1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:31.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f19baffd640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19bc0b63c0 0x7f19bc159000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19b400ba50 tx=0x7f19b400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f2b427fc640 1 -- 172.21.15.181:0/2009770103 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c042020 con 0x7f2b4c15a790 2024-09-12T02:28:31.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f2b427fc640 1 -- 172.21.15.181:0/2009770103 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c038040 con 0x7f2b4c15a790 2024-09-12T02:28:31.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f2b427fc640 1 -- 172.21.15.181:0/2009770103 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c037050 con 0x7f2b4c15a790 2024-09-12T02:28:31.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40080e2090 con 0x7f3ffc003ce0 2024-09-12T02:28:31.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40080496f0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f4005ffb640 1 -- 172.21.15.181:0/351545156 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400000a5e0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7fc89b7fe640 1 -- 172.21.15.181:0/3024122381 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac008730 con 0x7fc8b40b5f80 2024-09-12T02:28:31.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7fc8b945e640 1 -- 172.21.15.181:0/3024122381 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b415f2f0 con 0x7fc8b40b5f80 2024-09-12T02:28:31.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7fc8b945e640 1 -- 172.21.15.181:0/3024122381 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b415f8b0 con 0x7fc8b40b5f80 2024-09-12T02:28:31.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7fc89b7fe640 1 -- 172.21.15.181:0/3024122381 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac036040 con 0x7fc8b40b5f80 2024-09-12T02:28:31.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7fb653fff640 1 -- 172.21.15.181:0/3200933424 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c037070 con 0x7fb65c0b4e40 2024-09-12T02:28:31.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f3797131640 1 Processor -- start 2024-09-12T02:28:31.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f3797131640 1 -- start start 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f410f48d640 1 Processor -- start 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f410f48d640 1 -- start start 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f3c837fe640 1 -- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c050 msgr2=0x7f3c840ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f3c837fe640 1 --2- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c050 0x7f3c840ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f3c837fe640 1 -- 172.21.15.181:0/2253874303 >> v1:172.21.15.204:6789/0 conn(0x7f3c840cf1e0 legacy=0x7f3c8415fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.533+0000 7f3c837fe640 1 -- 172.21.15.181:0/2253874303 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c840cdb40 con 0x7f3c8415c430 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7fb66376d640 1 -- 172.21.15.181:0/3200933424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 msgr2=0x7fb65c162f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7fb66376d640 1 --2- 172.21.15.181:0/3200933424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c162f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0d1160 tx=0x7fb64c02a370 comp rx=0 tx=0).stop 2024-09-12T02:28:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f19a3fff640 1 -- 172.21.15.181:0/239553269 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4019070 con 0x7f19bc0b63c0 2024-09-12T02:28:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f19a3fff640 1 -- 172.21.15.181:0/239553269 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b400cc00 con 0x7f19bc0b63c0 2024-09-12T02:28:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f19a3fff640 1 -- 172.21.15.181:0/239553269 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4014440 con 0x7f19bc0b63c0 2024-09-12T02:28:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f3c837fe640 1 --2- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c8415c430 0x7f3c840ceca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009870 tx=0x7f3c7402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5af0ea449186292e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f3c82ffd640 1 -- 172.21.15.181:0/2253874303 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74037070 con 0x7f3c8415c430 2024-09-12T02:28:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f3c82ffd640 1 -- 172.21.15.181:0/2253874303 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7402ab60 con 0x7f3c8415c430 2024-09-12T02:28:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f3c82ffd640 1 -- 172.21.15.181:0/2253874303 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78001690 con 0x7f3c8415c430 2024-09-12T02:28:31.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4c15c5d0 con 0x7f2b4c15a790 2024-09-12T02:28:31.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.534+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4c15cb90 con 0x7f2b4c15a790 2024-09-12T02:28:31.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410f48d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f41001643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410f48d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100175be0 0x7f4100168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410f48d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f410004ac00 0x7f410004b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3797131640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379006cd50 0x7f3790154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3797131640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37900b5cb0 0x7f3790147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3797131640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3790151210 0x7f3790145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3797131640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f37901515f0 con 0x7f3790151210 2024-09-12T02:28:31.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3797131640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f37900ce2a0 con 0x7f37900b5cb0 2024-09-12T02:28:31.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3797131640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3790151770 con 0x7f379006cd50 2024-09-12T02:28:31.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410d229640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f41001643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410d229640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f41001643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53132/0 (socket says 172.21.15.181:53132) 2024-09-12T02:28:31.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410da2a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f410004ac00 0x7f410004b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410da2a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f410004ac00 0x7f410004b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51836/0 (socket says 172.21.15.181:51836) 2024-09-12T02:28:31.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410d229640 1 -- 172.21.15.181:0/4032534631 learned_addr learned my addr 172.21.15.181:0/4032534631 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc1ec2f0 con 0x7f19bc0b63c0 2024-09-12T02:28:31.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4100006ab0 con 0x7f410004ac00 2024-09-12T02:28:31.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4100036490 con 0x7f40f40039b0 2024-09-12T02:28:31.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f37956ce640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3790151210 0x7f3790145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4100006c30 con 0x7f4100175be0 2024-09-12T02:28:31.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f37956ce640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3790151210 0x7f3790145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51852/0 (socket says 172.21.15.181:51852) 2024-09-12T02:28:31.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f37956ce640 1 -- 172.21.15.181:0/2357131001 learned_addr learned my addr 172.21.15.181:0/2357131001 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc1ec8b0 con 0x7f19bc0b63c0 2024-09-12T02:28:31.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fc89b7fe640 1 -- 172.21.15.181:0/3024122381 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8ac044020 con 0x7fc8b40b5f80 2024-09-12T02:28:31.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f4005ffb640 1 -- 172.21.15.181:0/351545156 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400000a9f0 con 0x7f3ffc003ce0 2024-09-12T02:28:31.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3c89574640 1 -- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c8415c430 msgr2=0x7f3c840ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.535+0000 7f3c89574640 1 --2- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c8415c430 0x7f3c840ceca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009870 tx=0x7f3c7402a0d0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f3c89574640 1 -- 172.21.15.181:0/2253874303 shutdown_connections 2024-09-12T02:28:31.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f3c89574640 1 --2- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c8415c430 0x7f3c840ceca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f3c89574640 1 --2- 172.21.15.181:0/2253874303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c050 0x7f3c840ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f3c89574640 1 -- 172.21.15.181:0/2253874303 >> 172.21.15.181:0/2253874303 conn(0x7f3c8406e2f0 msgr2=0x7f3c840b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f410d229640 1 -- 172.21.15.181:0/4032534631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100175be0 msgr2=0x7f4100168370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:31.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fb66376d640 1 -- 172.21.15.181:0/3200933424 shutdown_connections 2024-09-12T02:28:31.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f410d229640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100175be0 0x7f4100168370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fb66376d640 1 --2- 172.21.15.181:0/3200933424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c162f40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fb66376d640 1 --2- 172.21.15.181:0/3200933424 >> v2:172.21.15.204:3300/0 conn(0x7fb65c162720 0x7fb65c0b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fb66376d640 1 -- 172.21.15.181:0/3200933424 >> 172.21.15.181:0/3200933424 conn(0x7fb65c06bc10 msgr2=0x7fb65c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f410d229640 1 -- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f410004ac00 msgr2=0x7f410004b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f410d229640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f410004ac00 0x7f410004b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fc89b7fe640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc8a006be30 0x7fc8a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fc89b7fe640 1 -- 172.21.15.181:0/3024122381 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc8ac0aba20 con 0x7fc8b40b5f80 2024-09-12T02:28:31.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f410d229640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4100164a50 con 0x7f40f40039b0 2024-09-12T02:28:31.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fc8b2ffd640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc8a006be30 0x7fc8a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f3c89574640 1 -- 172.21.15.181:0/2253874303 shutdown_connections 2024-09-12T02:28:31.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f3c89574640 1 -- 172.21.15.181:0/2253874303 wait complete. 2024-09-12T02:28:31.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7fc8b945e640 1 -- 172.21.15.181:0/3024122381 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc894005290 con 0x7fc8b40b5f80 2024-09-12T02:28:31.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7fb66376d640 1 -- 172.21.15.181:0/3200933424 shutdown_connections 2024-09-12T02:28:31.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc0b5120 con 0x7f19bc0b63c0 2024-09-12T02:28:31.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f4005ffb640 1 -- 172.21.15.181:0/351545156 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4000019020 con 0x7f3ffc003ce0 2024-09-12T02:28:31.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7fc8b2ffd640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc8a006be30 0x7fc8a006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000f60 tx=0x7fc8a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f3794ecd640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379006cd50 0x7f3790154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.536+0000 7f378ffff640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37900b5cb0 0x7f3790147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f37956ce640 1 -- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379006cd50 msgr2=0x7f3790154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f37956ce640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379006cd50 0x7f3790154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f37956ce640 1 -- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37900b5cb0 msgr2=0x7f3790147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f37956ce640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37900b5cb0 0x7f3790147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f37956ce640 1 -- 172.21.15.181:0/2357131001 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3790145340 con 0x7f3790151210 2024-09-12T02:28:31.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f410d229640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f41001643c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f410402a3e0 tx=0x7f4104000fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7f4005ffb640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ff406bf60 0x7f3ff406e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f40fdffb640 1 -- 172.21.15.181:0/4032534631 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104043070 con 0x7f40f40039b0 2024-09-12T02:28:31.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f40fdffb640 1 -- 172.21.15.181:0/4032534631 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4104003a20 con 0x7f40f40039b0 2024-09-12T02:28:31.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f4005ffb640 1 -- 172.21.15.181:0/351545156 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f400008ac50 con 0x7f3ffc003ce0 2024-09-12T02:28:31.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff0005290 con 0x7f3ffc003ce0 2024-09-12T02:28:31.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f37956ce640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3790151210 0x7f3790145890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f37800097d0 tx=0x7f37800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f40fdffb640 1 -- 172.21.15.181:0/4032534631 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104007a50 con 0x7f40f40039b0 2024-09-12T02:28:31.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41000cec40 con 0x7f40f40039b0 2024-09-12T02:28:31.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41000cf200 con 0x7f40f40039b0 2024-09-12T02:28:31.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4c0b3800 con 0x7f2b4c15a790 2024-09-12T02:28:31.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.537+0000 7fb66376d640 1 -- 172.21.15.181:0/3200933424 wait complete. 2024-09-12T02:28:31.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7fb66376d640 1 Processor -- start 2024-09-12T02:28:31.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7f19a3fff640 1 -- 172.21.15.181:0/239553269 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19b401c070 con 0x7f19bc0b63c0 2024-09-12T02:28:31.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7f4014e28640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ff406bf60 0x7f3ff406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7f2b427fc640 1 -- 172.21.15.181:0/2009770103 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b3c03ca90 con 0x7f2b4c15a790 2024-09-12T02:28:31.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7f2b427fc640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3006bf00 0x7f2b3006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7f19a3fff640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19a806bf00 0x7f19a806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f19a3fff640 1 -- 172.21.15.181:0/239553269 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f19b408ab10 con 0x7f19bc0b63c0 2024-09-12T02:28:31.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7fb66376d640 1 -- start start 2024-09-12T02:28:31.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb66376d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f3c89574640 1 Processor -- start 2024-09-12T02:28:31.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4100176000 con 0x7f40f40039b0 2024-09-12T02:28:31.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.538+0000 7f3c89574640 1 -- start start 2024-09-12T02:28:31.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f2b427fc640 1 -- 172.21.15.181:0/2009770103 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b3c0ab450 con 0x7f2b4c15a790 2024-09-12T02:28:31.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f2b51b60640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3006bf00 0x7f2b3006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb66376d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb65c162720 0x7fb65c165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb661509640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.539+0000 7f3c89574640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cf1e0 0x7f3c84149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c89574640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8415c050 0x7f3c8414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f40fdffb640 1 -- 172.21.15.181:0/4032534631 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4104033470 con 0x7f40f40039b0 2024-09-12T02:28:31.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c89574640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c430 0x7f3c84148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c89574640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8415c850 con 0x7f3c8415c050 2024-09-12T02:28:31.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c89574640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840cf990 con 0x7f3c840cf1e0 2024-09-12T02:28:31.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c89574640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3c8406cf90 con 0x7f3c8415c430 2024-09-12T02:28:31.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb661509640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c164bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51866/0 (socket says 172.21.15.181:51866) 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb661509640 1 -- 172.21.15.181:0/1883630180 learned_addr learned my addr 172.21.15.181:0/1883630180 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c837fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8415c050 0x7f3c8414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c88d73640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c430 0x7f3c84148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c837fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8415c050 0x7f3c8414e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51864/0 (socket says 172.21.15.181:51864) 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c88d73640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c430 0x7f3c84148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35590/0 (socket says 172.21.15.181:35590) 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c837fe640 1 -- 172.21.15.181:0/798410834 learned_addr learned my addr 172.21.15.181:0/798410834 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c83fff640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cf1e0 0x7f3c84149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb660d08640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb65c162720 0x7fb65c165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb66376d640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb65c162b00 0x7fb65c1f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f2b51b60640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3006bf00 0x7f2b3006e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009990 tx=0x7f2b48009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f19bb7fe640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19a806bf00 0x7f19a806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f4014e28640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ff406bf60 0x7f3ff406e420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f400c044000 tx=0x7f400c040000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c0cf930 con 0x7fb65c0b4e40 2024-09-12T02:28:31.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c0cf410 con 0x7fb65c162720 2024-09-12T02:28:31.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb65c0cfab0 con 0x7fb65c162b00 2024-09-12T02:28:31.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c88d73640 1 -- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cf1e0 msgr2=0x7f3c84149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c88d73640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cf1e0 0x7f3c84149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c88d73640 1 -- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8415c050 msgr2=0x7f3c8414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c88d73640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8415c050 0x7f3c8414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.540+0000 7f3c88d73640 1 -- 172.21.15.181:0/798410834 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8414eb90 con 0x7f3c8415c430 2024-09-12T02:28:31.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7f40fdffb640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40ec070230 0x7f40ec0726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7f19bb7fe640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19a806bf00 0x7f19a806e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19bc156510 tx=0x7f19ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7f3c88d73640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c430 0x7f3c84148c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800c750 tx=0x7f3c7800cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7fb661d0a640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb65c162b00 0x7fb65c1f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7f40fdffb640 1 -- 172.21.15.181:0/4032534631 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f41040aa750 con 0x7f40f40039b0 2024-09-12T02:28:31.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7f410ca28640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40ec070230 0x7f40ec0726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7fb661509640 1 -- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb65c162b00 msgr2=0x7fb65c1f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7fb661509640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb65c162b00 0x7fb65c1f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7fb661509640 1 -- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb65c162720 msgr2=0x7fb65c165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7fb661509640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb65c162720 0x7fb65c165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7fb661509640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c165c30 con 0x7fb65c0b4e40 2024-09-12T02:28:31.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7fb661509640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c164bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65800c7f0 tx=0x7fb65800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.541+0000 7f410ca28640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40ec070230 0x7f40ec0726f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001ba0 tx=0x7f40f8001b10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.542+0000 7fc89b7fe640 1 -- 172.21.15.181:0/3024122381 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8ac04b030 con 0x7fc8b40b5f80 2024-09-12T02:28:31.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.544+0000 7f378d7fa640 1 -- 172.21.15.181:0/2357131001 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780037050 con 0x7f3790151210 2024-09-12T02:28:31.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.544+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3790148250 con 0x7f3790151210 2024-09-12T02:28:31.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.544+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3790148810 con 0x7f3790151210 2024-09-12T02:28:31.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.544+0000 7f4005ffb640 1 -- 172.21.15.181:0/351545156 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4000020020 con 0x7f3ffc003ce0 2024-09-12T02:28:31.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.544+0000 7fb651ffb640 1 -- 172.21.15.181:0/1883630180 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658015070 con 0x7fb65c0b4e40 2024-09-12T02:28:31.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.545+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c165950 con 0x7fb65c0b4e40 2024-09-12T02:28:31.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.545+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c1f9a30 con 0x7fb65c0b4e40 2024-09-12T02:28:31.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.545+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37900cd560 con 0x7f3790151210 2024-09-12T02:28:31.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.546+0000 7f40fdffb640 1 -- 172.21.15.181:0/4032534631 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4104079170 con 0x7f40f40039b0 2024-09-12T02:28:31.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.546+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65c162f40 con 0x7fb65c0b4e40 2024-09-12T02:28:31.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.547+0000 7f3c80ff9640 1 -- 172.21.15.181:0/798410834 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78017070 con 0x7f3c8415c430 2024-09-12T02:28:31.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.547+0000 7f3c80ff9640 1 -- 172.21.15.181:0/798410834 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c78005270 con 0x7f3c8415c430 2024-09-12T02:28:31.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.547+0000 7f3c80ff9640 1 -- 172.21.15.181:0/798410834 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800a640 con 0x7f3c8415c430 2024-09-12T02:28:31.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.547+0000 7f19a3fff640 1 -- 172.21.15.181:0/239553269 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19b4058ee0 con 0x7f19bc0b63c0 2024-09-12T02:28:31.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.547+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8415f560 con 0x7f3c8415c430 2024-09-12T02:28:31.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.547+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8415d790 con 0x7f3c8415c430 2024-09-12T02:28:31.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.548+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c840ce870 con 0x7f3c8415c430 2024-09-12T02:28:31.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.549+0000 7fb651ffb640 1 -- 172.21.15.181:0/1883630180 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb658004430 con 0x7fb65c0b4e40 2024-09-12T02:28:31.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.549+0000 7fb651ffb640 1 -- 172.21.15.181:0/1883630180 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65801e060 con 0x7fb65c0b4e40 2024-09-12T02:28:31.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.550+0000 7f3c80ff9640 1 -- 172.21.15.181:0/798410834 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c7801a070 con 0x7f3c8415c430 2024-09-12T02:28:31.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.551+0000 7f3c80ff9640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c7006bf00 0x7f3c7006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.551+0000 7f3c80ff9640 1 -- 172.21.15.181:0/798410834 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c7808a720 con 0x7f3c8415c430 2024-09-12T02:28:31.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.552+0000 7f2b427fc640 1 -- 172.21.15.181:0/2009770103 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b3c04c020 con 0x7f2b4c15a790 2024-09-12T02:28:31.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.551+0000 7f378d7fa640 1 -- 172.21.15.181:0/2357131001 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3780043070 con 0x7f3790151210 2024-09-12T02:28:31.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.551+0000 7f3c83fff640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c7006bf00 0x7f3c7006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.552+0000 7f3c83fff640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c7006bf00 0x7f3c7006e3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0113e0 tx=0x7f3c7c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.552+0000 7f378d7fa640 1 -- 172.21.15.181:0/2357131001 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378003cad0 con 0x7f3790151210 2024-09-12T02:28:31.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.552+0000 7f378d7fa640 1 -- 172.21.15.181:0/2357131001 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3780048460 con 0x7f3790151210 2024-09-12T02:28:31.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.552+0000 7f378d7fa640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f377c06bde0 0x7f377c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.553+0000 7f3794ecd640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f377c06bde0 0x7f377c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.553+0000 7fb651ffb640 1 -- 172.21.15.181:0/1883630180 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb658007820 con 0x7fb65c0b4e40 2024-09-12T02:28:31.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.553+0000 7f3794ecd640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f377c06bde0 0x7f377c06e2a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37880012e0 tx=0x7f3788009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.554+0000 7f378d7fa640 1 -- 172.21.15.181:0/2357131001 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3780078ad0 con 0x7f3790151210 2024-09-12T02:28:31.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.554+0000 7fb651ffb640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb64006be30 0x7fb64006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.554+0000 7fb651ffb640 1 -- 172.21.15.181:0/1883630180 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb65808b230 con 0x7fb65c0b4e40 2024-09-12T02:28:31.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.554+0000 7f3c80ff9640 1 -- 172.21.15.181:0/798410834 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c78021020 con 0x7f3c8415c430 2024-09-12T02:28:31.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.554+0000 7fb660d08640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb64006be30 0x7fb64006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.555+0000 7fb660d08640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb64006be30 0x7fb64006e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb65c165f00 tx=0x7fb654009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.558+0000 7f378d7fa640 1 -- 172.21.15.181:0/2357131001 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37800473c0 con 0x7f3790151210 2024-09-12T02:28:31.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.567+0000 7fb651ffb640 1 -- 172.21.15.181:0/1883630180 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb658059600 con 0x7fb65c0b4e40 2024-09-12T02:28:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.931+0000 7fc8b945e640 1 -- 172.21.15.181:0/3024122381 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc894005850 con 0x7fc8b40b5f80 2024-09-12T02:28:31.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.932+0000 7fc89b7fe640 1 -- 172.21.15.181:0/3024122381 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8ac07a460 con 0x7fc8b40b5f80 2024-09-12T02:28:31.933 INFO:teuthology.orchestra.run.smithi181.stdout:64424509445 2024-09-12T02:28:31.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.936+0000 7fc8997fa640 1 -- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc8a006be30 msgr2=0x7fc8a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.936+0000 7fc8997fa640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc8a006be30 0x7fc8a006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000f60 tx=0x7fc8a4009040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 -- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b40b5f80 msgr2=0x7fc8b4090c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b40b5f80 0x7fc8b4090c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009f70 tx=0x7fc8ac004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:31.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 -- 172.21.15.181:0/3024122381 shutdown_connections 2024-09-12T02:28:31.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc8a006be30 0x7fc8a006e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8b415e310 0x7fc8b415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8b40b5f80 0x7fc8b4090c10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 --2- 172.21.15.181:0/3024122381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8b406f150 0x7fc8b414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 -- 172.21.15.181:0/3024122381 >> 172.21.15.181:0/3024122381 conn(0x7fc8b406e800 msgr2=0x7fc8b4154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.937+0000 7fc8997fa640 1 -- 172.21.15.181:0/3024122381 shutdown_connections 2024-09-12T02:28:31.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.938+0000 7fc8997fa640 1 -- 172.21.15.181:0/3024122381 wait complete. 2024-09-12T02:28:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.946+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3ff0005580 con 0x7f3ffc003ce0 2024-09-12T02:28:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.946+0000 7f4005ffb640 1 -- 172.21.15.181:0/351545156 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4000059020 con 0x7f3ffc003ce0 2024-09-12T02:28:31.947 INFO:teuthology.orchestra.run.smithi181.stdout:64424509445 2024-09-12T02:28:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.949+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f19bc0730d0 con 0x7f19bc0b63c0 2024-09-12T02:28:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ff406bf60 msgr2=0x7f3ff406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.950 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2b4c0cd920 con 0x7f2b4c15a790 2024-09-12T02:28:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f2b427fc640 1 -- 172.21.15.181:0/2009770103 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b3c079e70 con 0x7f2b4c15a790 2024-09-12T02:28:31.951 INFO:teuthology.orchestra.run.smithi181.stdout:60129542149 2024-09-12T02:28:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f19a3fff640 1 -- 172.21.15.181:0/239553269 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19b405d1e0 con 0x7f19bc0b63c0 2024-09-12T02:28:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ff406bf60 0x7f3ff406e420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f400c044000 tx=0x7f400c040000 comp rx=0 tx=0).stop 2024-09-12T02:28:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc003ce0 msgr2=0x7f400804a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc003ce0 0x7f400804a560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f400000c7e0 tx=0x7f400000cca0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 shutdown_connections 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ff406bf60 0x7f3ff406e420 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f400c044000 tx=0x7f400c040000 comp rx=0 tx=0).stop 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40080d4b80 0x7f4008177e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40080d41a0 0x7f400804aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 --2- 172.21.15.181:0/351545156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ffc003ce0 0x7f400804a560 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f400000c7e0 tx=0x7f400000cca0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.950+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 >> 172.21.15.181:0/351545156 conn(0x7f400801dd80 msgr2=0x7f40080527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.951+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 shutdown_connections 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.951+0000 7f401662b640 1 -- 172.21.15.181:0/351545156 wait complete. 2024-09-12T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.952+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f37900cde50 con 0x7f3790151210 2024-09-12T02:28:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.953+0000 7f378d7fa640 1 -- 172.21.15.181:0/2357131001 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f378007b130 con 0x7f3790151210 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19a806bf00 msgr2=0x7f19a806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19a806bf00 0x7f19a806e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19bc156510 tx=0x7f19ac009040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19bc0b63c0 msgr2=0x7f19bc159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19bc0b63c0 0x7f19bc159000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19b400ba50 tx=0x7f19b400bf10 comp rx=0 tx=0).stop 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 shutdown_connections 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19a806bf00 0x7f19a806e3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19bc162840 0x7f19bc155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19bc0b63c0 0x7f19bc159000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 --2- 172.21.15.181:0/239553269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc06ed20 0x7f19bc1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 >> 172.21.15.181:0/239553269 conn(0x7f19bc0713e0 msgr2=0x7f19bc163ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.956 INFO:teuthology.orchestra.run.smithi181.stdout:64424509445 2024-09-12T02:28:31.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T02:28:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 shutdown_connections 2024-09-12T02:28:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f19c1f11640 1 -- 172.21.15.181:0/239553269 wait complete. 2024-09-12T02:28:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.954+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f410003a780 con 0x7f40f40039b0 2024-09-12T02:28:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3006bf00 msgr2=0x7f2b3006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3006bf00 0x7f2b3006e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009990 tx=0x7f2b48009110 comp rx=0 tx=0).stop 2024-09-12T02:28:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b4c15a790 msgr2=0x7f2b4c155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b4c15a790 0x7f2b4c155b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0afd10 tx=0x7f2b3c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f40fdffb640 1 -- 172.21.15.181:0/4032534631 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4104078a70 con 0x7f40f40039b0 2024-09-12T02:28:31.958 INFO:teuthology.orchestra.run.smithi181.stdout:60129542150 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 shutdown_connections 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3006bf00 0x7f2b3006e3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b4c15a790 0x7f2b4c155b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b4c0cdfc0 0x7f2b4c0acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 --2- 172.21.15.181:0/2009770103 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b4c0b28e0 0x7f2b4c153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 >> 172.21.15.181:0/2009770103 conn(0x7f2b4c0b1df0 msgr2=0x7f2b4c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 shutdown_connections 2024-09-12T02:28:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.955+0000 7f2b53dc4640 1 -- 172.21.15.181:0/2009770103 wait complete. 2024-09-12T02:28:31.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f377c06bde0 msgr2=0x7f377c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3c840b29e0 con 0x7f3c8415c430 2024-09-12T02:28:31.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f377c06bde0 0x7f377c06e2a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37880012e0 tx=0x7f3788009040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3790151210 msgr2=0x7f3790145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3790151210 0x7f3790145890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f37800097d0 tx=0x7f37800046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 shutdown_connections 2024-09-12T02:28:31.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3c80ff9640 1 -- 172.21.15.181:0/798410834 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3c78058af0 con 0x7f3c8415c430 2024-09-12T02:28:31.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f377c06bde0 0x7f377c06e2a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.961 INFO:teuthology.orchestra.run.smithi181.stdout:64424509445 2024-09-12T02:28:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37900b5cb0 0x7f3790147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3790151210 0x7f3790145890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 --2- 172.21.15.181:0/2357131001 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f379006cd50 0x7f3790154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.957+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 >> 172.21.15.181:0/2357131001 conn(0x7f37900cca40 msgr2=0x7f37900b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.958+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 shutdown_connections 2024-09-12T02:28:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.958+0000 7f3797131640 1 -- 172.21.15.181:0/2357131001 wait complete. 2024-09-12T02:28:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40ec070230 msgr2=0x7f40ec0726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40ec070230 0x7f40ec0726f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001ba0 tx=0x7f40f8001b10 comp rx=0 tx=0).stop 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 msgr2=0x7f41001643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f41001643c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f410402a3e0 tx=0x7f4104000fb0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 shutdown_connections 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40ec070230 0x7f40ec0726f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f410004ac00 0x7f410004b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4100175be0 0x7f4100168370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 --2- 172.21.15.181:0/4032534631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f40039b0 0x7f41001643c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.959+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 >> 172.21.15.181:0/4032534631 conn(0x7f410001e190 msgr2=0x7f410000b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.960+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 shutdown_connections 2024-09-12T02:28:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.960+0000 7f410f48d640 1 -- 172.21.15.181:0/4032534631 wait complete. 2024-09-12T02:28:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c7006bf00 msgr2=0x7f3c7006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c7006bf00 0x7f3c7006e3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0113e0 tx=0x7f3c7c00b040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c430 msgr2=0x7f3c84148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c430 0x7f3c84148c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800c750 tx=0x7f3c7800cc10 comp rx=0 tx=0).stop 2024-09-12T02:28:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 shutdown_connections 2024-09-12T02:28:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c7006bf00 0x7f3c7006e3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c8415c430 0x7f3c84148c30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8415c050 0x7f3c8414e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 --2- 172.21.15.181:0/798410834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c840cf1e0 0x7f3c84149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 >> 172.21.15.181:0/798410834 conn(0x7f3c8406e2f0 msgr2=0x7f3c8414f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 shutdown_connections 2024-09-12T02:28:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.961+0000 7f3c89574640 1 -- 172.21.15.181:0/798410834 wait complete. 2024-09-12T02:28:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.962+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb65c165670 con 0x7fb65c0b4e40 2024-09-12T02:28:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.963+0000 7fb651ffb640 1 -- 172.21.15.181:0/1883630180 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb65805d900 con 0x7fb65c0b4e40 2024-09-12T02:28:31.967 INFO:teuthology.orchestra.run.smithi181.stdout:64424509445 2024-09-12T02:28:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb64006be30 msgr2=0x7fb64006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb64006be30 0x7fb64006e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb65c165f00 tx=0x7fb654009040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 msgr2=0x7fb65c164bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c164bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65800c7f0 tx=0x7fb65800ccb0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 shutdown_connections 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb64006be30 0x7fb64006e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb65c162720 0x7fb65c165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb65c162b00 0x7fb65c1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 --2- 172.21.15.181:0/1883630180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb65c0b4e40 0x7fb65c164bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 >> 172.21.15.181:0/1883630180 conn(0x7fb65c06bc10 msgr2=0x7fb65c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.966+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 shutdown_connections 2024-09-12T02:28:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:31.967+0000 7fb66376d640 1 -- 172.21.15.181:0/1883630180 wait complete. 2024-09-12T02:28:31.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-12T02:28:31.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-12T02:28:31.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-12T02:28:31.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-09-12T02:28:31.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-12T02:28:31.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-09-12T02:28:31.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-09-12T02:28:32.958 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:28:32.976 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:28:32.981 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:28:32.981 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:28:32.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:28:32.986 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:28:32.986 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:28:32.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:28:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.117+0000 7f0c18a5e640 1 Processor -- start 2024-09-12T02:28:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.117+0000 7f0c18a5e640 1 -- start start 2024-09-12T02:28:33.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.120+0000 7f0c18a5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c1415b640 0x7f0c14154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.120+0000 7f0c18a5e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1415bd90 con 0x7f0c140b1d80 2024-09-12T02:28:33.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.120+0000 7f0c18a5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1415c030 con 0x7f0c1406ef40 2024-09-12T02:28:33.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.120+0000 7f0c18a5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0c141610c0 con 0x7f0c1415b640 2024-09-12T02:28:33.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.120+0000 7f0c1259c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f0c1406ef40 0x7f0c140b4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:38392/0 (socket says 172.21.15.181:38392) 2024-09-12T02:28:33.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.120+0000 7f0c1259c640 1 -- 172.21.15.181:0/4225572839 learned_addr learned my addr 172.21.15.181:0/4225572839 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.121+0000 7f0c11d9b640 1 --2- 172.21.15.181:0/4225572839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c1415b640 0x7f0c14154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.121+0000 7f0c1159a640 1 -- 172.21.15.181:0/4225572839 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199521152 0 0) 0x7f0c1415c030 con 0x7f0c1406ef40 2024-09-12T02:28:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.121+0000 7f0c1159a640 1 -- 172.21.15.181:0/4225572839 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bfc003520 con 0x7f0c1406ef40 2024-09-12T02:28:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.121+0000 7f0c11d9b640 1 -- 172.21.15.181:0/4225572839 >> v1:172.21.15.204:6789/0 conn(0x7f0c1406ef40 legacy=0x7f0c140b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.121+0000 7f0c1159a640 1 -- 172.21.15.181:0/4225572839 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 364396394 0 0) 0x7f0bfc003520 con 0x7f0c1406ef40 2024-09-12T02:28:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.121+0000 7f0c11d9b640 1 -- 172.21.15.181:0/4225572839 >> v1:172.21.15.181:6789/0 conn(0x7f0c140b1d80 legacy=0x7f0c1415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.121+0000 7f0c11d9b640 1 -- 172.21.15.181:0/4225572839 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1415c310 con 0x7f0c1415b640 2024-09-12T02:28:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.123+0000 7f0c11d9b640 1 --2- 172.21.15.181:0/4225572839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c1415b640 0x7f0c14154ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0c14069660 tx=0x7f0c0802a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba52357b6d247482 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.123+0000 7f0c1159a640 1 -- 172.21.15.181:0/4225572839 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08037070 con 0x7f0c1415b640 2024-09-12T02:28:33.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.123+0000 7f0c1159a640 1 -- 172.21.15.181:0/4225572839 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0802abc0 con 0x7f0c1415b640 2024-09-12T02:28:33.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.124+0000 7f0c18a5e640 1 -- 172.21.15.181:0/4225572839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c1415b640 msgr2=0x7f0c14154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.124+0000 7f0c1159a640 1 -- 172.21.15.181:0/4225572839 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08037070 con 0x7f0c1415b640 2024-09-12T02:28:33.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.124+0000 7f0c18a5e640 1 --2- 172.21.15.181:0/4225572839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c1415b640 0x7f0c14154ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0c14069660 tx=0x7f0c0802a0b0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.125+0000 7f0c18a5e640 1 -- 172.21.15.181:0/4225572839 shutdown_connections 2024-09-12T02:28:33.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.125+0000 7f0c18a5e640 1 --2- 172.21.15.181:0/4225572839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c1415b640 0x7f0c14154ac0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0c14069660 tx=0x7f0c0802a0b0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.125+0000 7f0c18a5e640 1 -- 172.21.15.181:0/4225572839 >> 172.21.15.181:0/4225572839 conn(0x7f0c1406bc10 msgr2=0x7f0c1406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.125+0000 7f0c18a5e640 1 -- 172.21.15.181:0/4225572839 shutdown_connections 2024-09-12T02:28:33.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.125+0000 7f0c18a5e640 1 -- 172.21.15.181:0/4225572839 wait complete. 2024-09-12T02:28:33.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.127+0000 7f0c18a5e640 1 Processor -- start 2024-09-12T02:28:33.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.128+0000 7f0c18a5e640 1 -- start start 2024-09-12T02:28:33.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.129+0000 7f0c18a5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c1406ef40 0x7f0c1406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.129+0000 7f0c18a5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c140b1d80 0x7f0c14160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.129+0000 7f0c1259c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c1406ef40 0x7f0c1406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.129+0000 7f0c1259c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c1406ef40 0x7f0c1406d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53176/0 (socket says 172.21.15.181:53176) 2024-09-12T02:28:33.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.129+0000 7f0c18a5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c141605d0 0x7f0c14143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c12d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c141605d0 0x7f0c14143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c12d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c141605d0 0x7f0c14143230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51868/0 (socket says 172.21.15.181:51868) 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c1259c640 1 -- 172.21.15.181:0/390711055 learned_addr learned my addr 172.21.15.181:0/390711055 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c18a5e640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0c140b2330 con 0x7f0c141605d0 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c18a5e640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0c140b21b0 con 0x7f0c1406ef40 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c18a5e640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0c140b24b0 con 0x7f0c140b1d80 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c12d9d640 1 -- 172.21.15.181:0/390711055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c140b1d80 msgr2=0x7f0c14160090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c12d9d640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c140b1d80 0x7f0c14160090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c12d9d640 1 -- 172.21.15.181:0/390711055 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c1406ef40 msgr2=0x7f0c1406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c12d9d640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c1406ef40 0x7f0c1406d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.130+0000 7f0c12d9d640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c140cfe20 con 0x7f0c141605d0 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.131+0000 7f0c12d9d640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c141605d0 0x7f0c14143230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c8e0 tx=0x7f0c0c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.131+0000 7f0c02ffd640 1 -- 172.21.15.181:0/390711055 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c016020 con 0x7f0c141605d0 2024-09-12T02:28:33.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.131+0000 7f0c18a5e640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c140d0100 con 0x7f0c141605d0 2024-09-12T02:28:33.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.132+0000 7f0c18a5e640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c1406d8a0 con 0x7f0c141605d0 2024-09-12T02:28:33.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.132+0000 7f0c02ffd640 1 -- 172.21.15.181:0/390711055 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0c00a860 con 0x7f0c141605d0 2024-09-12T02:28:33.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.132+0000 7f0c02ffd640 1 -- 172.21.15.181:0/390711055 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00ac50 con 0x7f0c141605d0 2024-09-12T02:28:33.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.136+0000 7f0c02ffd640 1 -- 172.21.15.181:0/390711055 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c0c019020 con 0x7f0c141605d0 2024-09-12T02:28:33.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.136+0000 7f0c02ffd640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0bf406bf00 0x7f0bf406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.136+0000 7f0c02ffd640 1 -- 172.21.15.181:0/390711055 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0c08b0f0 con 0x7f0c141605d0 2024-09-12T02:28:33.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.137+0000 7f0c1259c640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0bf406bf00 0x7f0bf406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.138+0000 7f0c1259c640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0bf406bf00 0x7f0bf406e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c04000f60 tx=0x7f0c04001b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.138+0000 7f0c18a5e640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf8005290 con 0x7f0c141605d0 2024-09-12T02:28:33.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.147+0000 7f0c02ffd640 1 -- 172.21.15.181:0/390711055 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c0c020020 con 0x7f0c141605d0 2024-09-12T02:28:33.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.173+0000 7f3ab6c44640 1 Processor -- start 2024-09-12T02:28:33.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.174+0000 7f3ab6c44640 1 -- start start 2024-09-12T02:28:33.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.175+0000 7f3ab6c44640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3aa80e2fe0 0x7f3aa803a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.175+0000 7f0337531640 1 Processor -- start 2024-09-12T02:28:33.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f1eab59f640 1 Processor -- start 2024-09-12T02:28:33.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f0337531640 1 -- start start 2024-09-12T02:28:33.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab5c42640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3aa80e2fe0 0x7f3aa803a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab5c42640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3aa80e2fe0 0x7f3aa803a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51872/0 (socket says 172.21.15.181:51872) 2024-09-12T02:28:33.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab5c42640 1 -- 172.21.15.181:0/3509294286 learned_addr learned my addr 172.21.15.181:0/3509294286 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.175+0000 7eff09374640 1 Processor -- start 2024-09-12T02:28:33.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80345e0 0x7f3aa803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7eff09374640 1 -- start start 2024-09-12T02:28:33.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/3509294286 >> v2:172.21.15.204:3300/0 conn(0x7f3aa8036a00 0x7f3aa803ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa8036f00 con 0x7f3aa80e2fe0 2024-09-12T02:28:33.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa8008ab0 con 0x7f3aa8036a00 2024-09-12T02:28:33.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80350b0 con 0x7f3aa80345e0 2024-09-12T02:28:33.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab5441640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80345e0 0x7f3aa803a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f3ab6443640 1 --2- 172.21.15.181:0/3509294286 >> v2:172.21.15.204:3300/0 conn(0x7f3aa8036a00 0x7f3aa803ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f3ab6443640 1 -- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80345e0 msgr2=0x7f3aa803a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f3ab6443640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80345e0 0x7f3aa803a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f3ab6443640 1 -- 172.21.15.181:0/3509294286 >> v2:172.21.15.181:3300/0 conn(0x7f3aa80e2fe0 msgr2=0x7f3aa803a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f3ab6443640 1 --2- 172.21.15.181:0/3509294286 >> v2:172.21.15.181:3300/0 conn(0x7f3aa80e2fe0 0x7f3aa803a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f3ab6443640 1 -- 172.21.15.181:0/3509294286 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa8035390 con 0x7f3aa8036a00 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f3ab5441640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80345e0 0x7f3aa803a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f3ab5c42640 1 --2- 172.21.15.181:0/3509294286 >> v2:172.21.15.181:3300/0 conn(0x7f3aa80e2fe0 0x7f3aa803a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:33.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.176+0000 7f1eab59f640 1 -- start start 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f8955dc6640 1 Processor -- start 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f8955dc6640 1 -- start start 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff09374640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efefc0e06e0 0x7efefc0530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff09374640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efefc0535e0 0x7efefc054e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff09374640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e0ac0 0x7efefc055340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff09374640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7efefc0333b0 con 0x7efefc0e06e0 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff09374640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7efefc053b20 con 0x7efefc0535e0 2024-09-12T02:28:33.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff09374640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efefc00bfc0 con 0x7efefc0e0ac0 2024-09-12T02:28:33.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f0337531640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03301650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f0337531640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03300b5400 con 0x7f033015b640 2024-09-12T02:28:33.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff03fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efefc0e06e0 0x7efefc0530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7f0337531640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033015bd90 con 0x7f0330154d30 2024-09-12T02:28:33.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff03fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efefc0e06e0 0x7efefc0530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51878/0 (socket says 172.21.15.181:51878) 2024-09-12T02:28:33.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.177+0000 7eff03fff640 1 -- 172.21.15.181:0/1277575255 learned_addr learned my addr 172.21.15.181:0/1277575255 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7eff037fe640 1 --2- 172.21.15.181:0/1277575255 >> v2:172.21.15.204:3300/0 conn(0x7efefc0535e0 0x7efefc054e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f0335ace640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03301650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f03352cd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f0330154d30 0x7f03300b4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:38400/0 (socket says 172.21.15.181:38400) 2024-09-12T02:28:33.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f03352cd640 1 -- 172.21.15.181:0/213286344 learned_addr learned my addr 172.21.15.181:0/213286344 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:33.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f3ab6443640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa803ae10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ab006b560 tx=0x7f3ab006a700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fd77776f66f6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1eab59f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 0x7f1ea40b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1eab59f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ea40b4c70 0x7f1ea40cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1eab59f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea4163520 con 0x7f1ea4162720 2024-09-12T02:28:33.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1eab59f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea40cce00 con 0x7f1ea40b4c70 2024-09-12T02:28:33.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1eab59f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea4163dc0 con 0x7f1ea40b2790 2024-09-12T02:28:33.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f0337531640 1 -- 172.21.15.181:0/213286344 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f033015c030 con 0x7f03300b2490 2024-09-12T02:28:33.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7eff03fff640 1 -- 172.21.15.181:0/1277575255 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e0ac0 msgr2=0x7efefc055340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:28:33.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7eff03fff640 1 --2- 172.21.15.181:0/1277575255 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e0ac0 0x7efefc055340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7eff03fff640 1 -- 172.21.15.181:0/1277575255 >> v2:172.21.15.204:3300/0 conn(0x7efefc0535e0 msgr2=0x7efefc054e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7eff03fff640 1 --2- 172.21.15.181:0/1277575255 >> v2:172.21.15.204:3300/0 conn(0x7efefc0535e0 0x7efefc054e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7eff03fff640 1 -- 172.21.15.181:0/1277575255 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc00c2a0 con 0x7efefc0e06e0 2024-09-12T02:28:33.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1ea933b640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f1ea4162720 0x7f1ea4162b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:38410/0 (socket says 172.21.15.181:38410) 2024-09-12T02:28:33.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1ea933b640 1 -- 172.21.15.181:0/2468411232 learned_addr learned my addr 172.21.15.181:0/2468411232 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:33.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f3ab4c40640 1 -- 172.21.15.181:0/3509294286 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00b4070 con 0x7f3aa8036a00 2024-09-12T02:28:33.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f3ab4c40640 1 -- 172.21.15.181:0/3509294286 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab00ad7d0 con 0x7f3aa8036a00 2024-09-12T02:28:33.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f3ab4c40640 1 -- 172.21.15.181:0/3509294286 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00adc00 con 0x7f3aa8036a00 2024-09-12T02:28:33.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f8955dc6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 0x7f895015b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165994956 0 0) 0x7f1ea4163520 con 0x7f1ea4162720 2024-09-12T02:28:33.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f8955dc6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f89500b2490 0x7f895015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e90003520 con 0x7f1ea4162720 2024-09-12T02:28:33.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f87129bd640 1 Processor -- start 2024-09-12T02:28:33.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f8955dc6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89500b5400 con 0x7f89500b4b80 2024-09-12T02:28:33.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f8955dc6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f895015bd90 con 0x7f89500b2490 2024-09-12T02:28:33.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f8955dc6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f895015c030 con 0x7f8950154d30 2024-09-12T02:28:33.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.178+0000 7f0327fff640 1 -- 172.21.15.181:0/213286344 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584001632 0 0) 0x7f03300b5400 con 0x7f033015b640 2024-09-12T02:28:33.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f87129bd640 1 -- start start 2024-09-12T02:28:33.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1ea8b3a640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 0x7f1ea40b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1011763679 0 0) 0x7f1e90003520 con 0x7f1ea4162720 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 msgr2=0x7f1ea40b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 0x7f1ea40b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 >> v2:172.21.15.181:3300/0 conn(0x7f1ea40b4c70 msgr2=0x7f1ea40cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1ea9b3c640 1 --2- 172.21.15.181:0/2468411232 >> v2:172.21.15.181:3300/0 conn(0x7f1ea40b4c70 0x7f1ea40cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 --2- 172.21.15.181:0/2468411232 >> v2:172.21.15.181:3300/0 conn(0x7f1ea40b4c70 0x7f1ea40cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea4163800 con 0x7f1ea4162720 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f1e9c0019f0 con 0x7f1ea4162720 2024-09-12T02:28:33.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894effd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f89500b4b80 0x7f89500b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54432/0 (socket says 172.21.15.181:54432) 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894effd640 1 -- 172.21.15.181:0/2067176453 learned_addr learned my addr 172.21.15.181:0/2067176453 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894ffff640 1 --2- 172.21.15.181:0/2067176453 >> v2:172.21.15.181:3300/0 conn(0x7f89500b2490 0x7f895015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894f7fe640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 0x7f895015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507355765 0 0) 0x7f89500b5400 con 0x7f89500b4b80 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8934003520 con 0x7f89500b4b80 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f0335ace640 1 -- 172.21.15.181:0/213286344 >> v1:172.21.15.204:6789/0 conn(0x7f0330154d30 legacy=0x7f03300b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f0335ace640 1 -- 172.21.15.181:0/213286344 >> v1:172.21.15.181:6789/0 conn(0x7f033015b640 legacy=0x7f03300b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f0335ace640 1 -- 172.21.15.181:0/213286344 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033015c310 con 0x7f03300b2490 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 msgr2=0x7f3aa803ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa803ae10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ab006b560 tx=0x7f3ab006a700 comp rx=0 tx=0).stop 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2095508632 0 0) 0x7f8934003520 con 0x7f89500b4b80 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 msgr2=0x7f895015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 0x7f895015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 >> v2:172.21.15.181:3300/0 conn(0x7f89500b2490 msgr2=0x7f895015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 --2- 172.21.15.181:0/2067176453 >> v2:172.21.15.181:3300/0 conn(0x7f89500b2490 0x7f895015cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895015c310 con 0x7f89500b4b80 2024-09-12T02:28:33.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f893c000ed0 con 0x7f89500b4b80 2024-09-12T02:28:33.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 >> v1:172.21.15.204:6789/0 conn(0x7f1ea4162720 legacy=0x7f1ea4162b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 0x7f1e900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e90003fe0 0x7f1e90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e90004d40 0x7f1e900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4163dc0 con 0x7f1e90004d40 2024-09-12T02:28:33.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9000bbd0 con 0x7f1e90003fe0 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9000bdd0 con 0x7f1ea40b2790 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1ea9b3c640 1 --2- 172.21.15.181:0/2468411232 >> v2:172.21.15.181:3300/0 conn(0x7f1ea40b4c70 0x7f1ea40cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f1ea933b640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 0x7f1e900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f1ea9b3c640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e90004d40 0x7f1e900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 >> v1:172.21.15.181:6789/0 conn(0x7f89500b4b80 legacy=0x7f89500b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89340039d0 0x7f8934003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 0x7f8934004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8934004d40 0x7f89340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f87129bd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a920 0x7f870c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f895015bd90 con 0x7f89340039d0 2024-09-12T02:28:33.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f895015c030 con 0x7f8934004d40 2024-09-12T02:28:33.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.179+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f893400ba90 con 0x7f8950154d30 2024-09-12T02:28:33.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894effd640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 0x7f8934004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894ffff640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8934004d40 0x7f89340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f87129bd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f870c06d7a0 0x7f870c072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f87129bd640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c0714b0 con 0x7f870c15a540 2024-09-12T02:28:33.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894f7fe640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89340039d0 0x7f8934003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894ffff640 1 -- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 msgr2=0x7f8934004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894ffff640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8950154d30 0x7f8934004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894ffff640 1 -- 172.21.15.181:0/2067176453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89340039d0 msgr2=0x7f8934003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894ffff640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89340039d0 0x7f8934003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894ffff640 1 -- 172.21.15.181:0/2067176453 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893400bd50 con 0x7f8934004d40 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f894f7fe640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89340039d0 0x7f8934003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f87129bd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f870c071260 con 0x7f870c06d7a0 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f87129bd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f870c15ad60 con 0x7f870c15a920 2024-09-12T02:28:33.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f0335ace640 1 --2- 172.21.15.181:0/213286344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03301650d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0328009dc0 tx=0x7f032802c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c7d87c2d8e0da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f8710f5a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f870c06d7a0 0x7f870c072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f8710f5a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f870c06d7a0 0x7f870c072550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53208/0 (socket says 172.21.15.181:53208) 2024-09-12T02:28:33.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f8710f5a640 1 -- 172.21.15.181:0/3158750032 learned_addr learned my addr 172.21.15.181:0/3158750032 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7eff03fff640 1 --2- 172.21.15.181:0/1277575255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0e06e0 0x7efefc0530a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efefc0101c0 tx=0x7efef802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba830259f4158885 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f870b7fe640 1 --2- 172.21.15.181:0/3158750032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a920 0x7f870c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f1ea8b3a640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e90003fe0 0x7f1e90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f1ea933b640 1 -- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e90003fe0 msgr2=0x7f1e90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f1ea933b640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e90003fe0 0x7f1e90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f1ea933b640 1 -- 172.21.15.181:0/2468411232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e90004d40 msgr2=0x7f1e900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f1ea933b640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e90004d40 0x7f1e900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.180+0000 7f1ea933b640 1 -- 172.21.15.181:0/2468411232 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea4163800 con 0x7f1ea40b2790 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 shutdown_connections 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa803ae10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/3509294286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80345e0 0x7f3aa803a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/3509294286 >> v2:172.21.15.181:3300/0 conn(0x7f3aa80e2fe0 0x7f3aa803a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 >> 172.21.15.181:0/3509294286 conn(0x7f3aa801ea40 msgr2=0x7f3aa80556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7eff02ffd640 1 -- 172.21.15.181:0/1277575255 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8004030 con 0x7efefc0e06e0 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7eff02ffd640 1 -- 172.21.15.181:0/1277575255 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef80041d0 con 0x7efefc0e06e0 2024-09-12T02:28:33.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7eff02ffd640 1 -- 172.21.15.181:0/1277575255 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8003610 con 0x7efefc0e06e0 2024-09-12T02:28:33.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f0327fff640 1 -- 172.21.15.181:0/213286344 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328007740 con 0x7f03300b2490 2024-09-12T02:28:33.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f0327fff640 1 -- 172.21.15.181:0/213286344 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03280078e0 con 0x7f03300b2490 2024-09-12T02:28:33.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f870b7fe640 1 -- 172.21.15.181:0/3158750032 >> v2:172.21.15.204:3300/0 conn(0x7f870c06d7a0 msgr2=0x7f870c072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f0327fff640 1 -- 172.21.15.181:0/213286344 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328007cb0 con 0x7f03300b2490 2024-09-12T02:28:33.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f870b7fe640 1 --2- 172.21.15.181:0/3158750032 >> v2:172.21.15.204:3300/0 conn(0x7f870c06d7a0 0x7f870c072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f870b7fe640 1 -- 172.21.15.181:0/3158750032 >> v1:172.21.15.204:6789/0 conn(0x7f870c15a540 legacy=0x7f870c0b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f870b7fe640 1 -- 172.21.15.181:0/3158750032 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c071790 con 0x7f870c15a920 2024-09-12T02:28:33.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f8710f5a640 1 --2- 172.21.15.181:0/3158750032 >> v2:172.21.15.204:3300/0 conn(0x7f870c06d7a0 0x7f870c072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:33.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f1ea933b640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 0x7f1e900039b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00a8e0 tx=0x7f1e90005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513b8081edf70580 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 shutdown_connections 2024-09-12T02:28:33.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00a4e0 con 0x7f1ea40b2790 2024-09-12T02:28:33.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c02f070 con 0x7f1ea40b2790 2024-09-12T02:28:33.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.181+0000 7f1e9bfff640 1 -- 172.21.15.181:0/2468411232 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c02bd60 con 0x7f1ea40b2790 2024-09-12T02:28:33.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f3ab6c44640 1 -- 172.21.15.181:0/3509294286 wait complete. 2024-09-12T02:28:33.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f0337531640 1 -- 172.21.15.181:0/213286344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 msgr2=0x7f03301650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f0337531640 1 --2- 172.21.15.181:0/213286344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03301650d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0328009dc0 tx=0x7f032802c780 comp rx=0 tx=0).stop 2024-09-12T02:28:33.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f0337531640 1 -- 172.21.15.181:0/213286344 shutdown_connections 2024-09-12T02:28:33.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f0337531640 1 --2- 172.21.15.181:0/213286344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03301650d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f894ffff640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8934004d40 0x7f89340051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f895006cb20 tx=0x7f8934005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56aa5337b5d315af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 -- 172.21.15.181:0/1277575255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0e06e0 msgr2=0x7efefc0530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 --2- 172.21.15.181:0/1277575255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0e06e0 0x7efefc0530a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efefc0101c0 tx=0x7efef802a250 comp rx=0 tx=0).stop 2024-09-12T02:28:33.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f870b7fe640 1 --2- 172.21.15.181:0/3158750032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a920 0x7f870c06d260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0097a0 tx=0x7f86fc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c19dbf45b09173f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f0337531640 1 -- 172.21.15.181:0/213286344 >> 172.21.15.181:0/213286344 conn(0x7f033006bc10 msgr2=0x7f033006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 -- 172.21.15.181:0/1277575255 shutdown_connections 2024-09-12T02:28:33.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 --2- 172.21.15.181:0/1277575255 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e0ac0 0x7efefc055340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 --2- 172.21.15.181:0/1277575255 >> v2:172.21.15.204:3300/0 conn(0x7efefc0535e0 0x7efefc054e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 --2- 172.21.15.181:0/1277575255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0e06e0 0x7efefc0530a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 -- 172.21.15.181:0/1277575255 >> 172.21.15.181:0/1277575255 conn(0x7efefc01fb50 msgr2=0x7efefc056820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f0337531640 1 -- 172.21.15.181:0/213286344 shutdown_connections 2024-09-12T02:28:33.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f0337531640 1 -- 172.21.15.181:0/213286344 wait complete. 2024-09-12T02:28:33.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f1eab59f640 1 -- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 msgr2=0x7f1e900039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f1eab59f640 1 --2- 172.21.15.181:0/2468411232 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea40b2790 0x7f1e900039b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00a8e0 tx=0x7f1e90005830 comp rx=0 tx=0).stop 2024-09-12T02:28:33.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7f1ea9b3c640 1 -- 172.21.15.181:0/2468411232 reap_dead start 2024-09-12T02:28:33.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f1eab59f640 1 -- 172.21.15.181:0/2468411232 shutdown_connections 2024-09-12T02:28:33.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f1eab59f640 1 -- 172.21.15.181:0/2468411232 >> 172.21.15.181:0/2468411232 conn(0x7f1ea406bc10 msgr2=0x7f1ea406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f870affd640 1 -- 172.21.15.181:0/3158750032 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc037070 con 0x7f870c15a920 2024-09-12T02:28:33.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f870affd640 1 -- 172.21.15.181:0/3158750032 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc02ae40 con 0x7f870c15a920 2024-09-12T02:28:33.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f870affd640 1 -- 172.21.15.181:0/3158750032 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc032660 con 0x7f870c15a920 2024-09-12T02:28:33.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f39d8047640 1 Processor -- start 2024-09-12T02:28:33.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f1eab59f640 1 -- 172.21.15.181:0/2468411232 shutdown_connections 2024-09-12T02:28:33.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f1eab59f640 1 -- 172.21.15.181:0/2468411232 wait complete. 2024-09-12T02:28:33.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.183+0000 7f39d8047640 1 -- start start 2024-09-12T02:28:33.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f3ab6c44640 1 Processor -- start 2024-09-12T02:28:33.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f87129bd640 1 -- 172.21.15.181:0/3158750032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a920 msgr2=0x7f870c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f87129bd640 1 --2- 172.21.15.181:0/3158750032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a920 0x7f870c06d260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0097a0 tx=0x7f86fc02a130 comp rx=0 tx=0).stop 2024-09-12T02:28:33.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 -- 172.21.15.181:0/1277575255 shutdown_connections 2024-09-12T02:28:33.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.182+0000 7eff09374640 1 -- 172.21.15.181:0/1277575255 wait complete. 2024-09-12T02:28:33.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f3ab6c44640 1 -- start start 2024-09-12T02:28:33.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894803c070 con 0x7f8934004d40 2024-09-12T02:28:33.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894802f820 con 0x7f8934004d40 2024-09-12T02:28:33.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f894e7fc640 1 -- 172.21.15.181:0/2067176453 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894803c070 con 0x7f8934004d40 2024-09-12T02:28:33.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7eff09374640 1 Processor -- start 2024-09-12T02:28:33.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f87129bd640 1 -- 172.21.15.181:0/3158750032 shutdown_connections 2024-09-12T02:28:33.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f87129bd640 1 --2- 172.21.15.181:0/3158750032 >> v2:172.21.15.204:3300/0 conn(0x7f870c06d7a0 0x7f870c072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f87129bd640 1 --2- 172.21.15.181:0/3158750032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a920 0x7f870c06d260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f87129bd640 1 -- 172.21.15.181:0/3158750032 >> 172.21.15.181:0/3158750032 conn(0x7f870c067d70 msgr2=0x7f870c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7eff09374640 1 -- start start 2024-09-12T02:28:33.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f39d8047640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162720 0x7f39d00b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f0337531640 1 Processor -- start 2024-09-12T02:28:33.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f39d8047640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f39d0162b00 0x7f39d0162f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f39d8047640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f39d00b4730 0x7f39d00b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f39d8047640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f39d00cce00 con 0x7f39d00b4730 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f39d8047640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f39d0163dc0 con 0x7f39d0162b00 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f39d8047640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f39d0163520 con 0x7f39d0162720 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f39d00b4730 0x7f39d00b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f39d00b4730 0x7f39d00b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51922/0 (socket says 172.21.15.181:51922) 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 -- 172.21.15.181:0/1652528172 learned_addr learned my addr 172.21.15.181:0/1652528172 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d5de3640 1 --2- 172.21.15.181:0/1652528172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162720 0x7f39d00b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f0337531640 1 -- start start 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f1eab59f640 1 Processor -- start 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.184+0000 7f1eab59f640 1 -- start start 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d55e2640 1 --2- 172.21.15.181:0/1652528172 >> v2:172.21.15.204:3300/0 conn(0x7f39d0162b00 0x7f39d0162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 -- 172.21.15.181:0/1652528172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162720 msgr2=0x7f39d00b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 --2- 172.21.15.181:0/1652528172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162720 0x7f39d00b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 -- 172.21.15.181:0/1652528172 >> v2:172.21.15.204:3300/0 conn(0x7f39d0162b00 msgr2=0x7f39d0162f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 --2- 172.21.15.181:0/1652528172 >> v2:172.21.15.204:3300/0 conn(0x7f39d0162b00 0x7f39d0162f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f39d65e4640 1 -- 172.21.15.181:0/1652528172 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d0163800 con 0x7f39d00b4730 2024-09-12T02:28:33.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f87129bd640 1 -- 172.21.15.181:0/3158750032 shutdown_connections 2024-09-12T02:28:33.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f3ab6c44640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3aa80345e0 0x7f3aa8054560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f87129bd640 1 -- 172.21.15.181:0/3158750032 wait complete. 2024-09-12T02:28:33.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7f1eab59f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea40b2790 0x7f1ea4150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1eab59f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea414eb70 0x7f1ea414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1eab59f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ea414e3f0 0x7f1ea41ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab5c42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3aa80345e0 0x7f3aa8054560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea40b2790 0x7f1ea4150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1eab59f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4163210 con 0x7f1ea40b2790 2024-09-12T02:28:33.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1eab59f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea40cf410 con 0x7f1ea414e3f0 2024-09-12T02:28:33.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1eab59f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea40b50e0 con 0x7f1ea414eb70 2024-09-12T02:28:33.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea40b2790 0x7f1ea4150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51944/0 (socket says 172.21.15.181:51944) 2024-09-12T02:28:33.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 -- 172.21.15.181:0/1619177479 learned_addr learned my addr 172.21.15.181:0/1619177479 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab5c42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3aa80345e0 0x7f3aa8054560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51960/0 (socket says 172.21.15.181:51960) 2024-09-12T02:28:33.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.185+0000 7eff09374640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0535e0 0x7efefc03c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f8955dc6640 1 -- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8934004d40 msgr2=0x7f89340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab5c42640 1 -- 172.21.15.181:0/1203737443 learned_addr learned my addr 172.21.15.181:0/1203737443 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f8955dc6640 1 --2- 172.21.15.181:0/2067176453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8934004d40 0x7f89340051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f895006cb20 tx=0x7f8934005830 comp rx=0 tx=0).stop 2024-09-12T02:28:33.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f894ffff640 1 -- 172.21.15.181:0/2067176453 reap_dead start 2024-09-12T02:28:33.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f8955dc6640 1 -- 172.21.15.181:0/2067176453 shutdown_connections 2024-09-12T02:28:33.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa80dbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f8955dc6640 1 -- 172.21.15.181:0/2067176453 >> 172.21.15.181:0/2067176453 conn(0x7f895006bc10 msgr2=0x7f895006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f39d65e4640 1 --2- 172.21.15.181:0/1652528172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 0x7f39d00b4bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39d00d11c0 tx=0x7f39c802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60483d1acc5fcb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f8955dc6640 1 -- 172.21.15.181:0/2067176453 shutdown_connections 2024-09-12T02:28:33.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f0337531640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03300aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80e2fe0 0x7f3aa8051580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f8955dc6640 1 -- 172.21.15.181:0/2067176453 wait complete. 2024-09-12T02:28:33.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f0337531640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0330154d30 0x7f03300ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa8053430 con 0x7f3aa80345e0 2024-09-12T02:28:33.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80532b0 con 0x7f3aa8036a00 2024-09-12T02:28:33.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 -- 172.21.15.181:0/1619177479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea414eb70 msgr2=0x7f1ea414deb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:28:33.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea414eb70 0x7f1ea414deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 -- 172.21.15.181:0/1619177479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ea414e3f0 msgr2=0x7f1ea41ebae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:28:33.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ea414e3f0 0x7f1ea41ebae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f1ea933b640 1 -- 172.21.15.181:0/1619177479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea414e870 con 0x7f1ea40b2790 2024-09-12T02:28:33.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f03352cd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03300aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f03352cd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03300aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35684/0 (socket says 172.21.15.181:35684) 2024-09-12T02:28:33.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f1ea933b640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea40b2790 0x7f1ea4150e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000f80 tx=0x7f1e9c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f0334acc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0330154d30 0x7f03300ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f0334acc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0330154d30 0x7f03300ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51962/0 (socket says 172.21.15.181:51962) 2024-09-12T02:28:33.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f03352cd640 1 -- 172.21.15.181:0/2887608536 learned_addr learned my addr 172.21.15.181:0/2887608536 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f39d4de1640 1 -- 172.21.15.181:0/1652528172 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8036070 con 0x7f39d00b4730 2024-09-12T02:28:33.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f39d4de1640 1 -- 172.21.15.181:0/1652528172 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c802ae50 con 0x7f39d00b4730 2024-09-12T02:28:33.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f39d4de1640 1 -- 172.21.15.181:0/1652528172 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8031800 con 0x7f39d00b4730 2024-09-12T02:28:33.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f0337531640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f033015b640 0x7f03300aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff03fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0535e0 0x7efefc03c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff03fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0535e0 0x7efefc03c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51934/0 (socket says 172.21.15.181:51934) 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff03fff640 1 -- 172.21.15.181:0/2138666540 learned_addr learned my addr 172.21.15.181:0/2138666540 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e06e0 0x7efefc04b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efefc0e0ac0 0x7efefc04e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efefc051550 con 0x7efefc0535e0 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7efefc054610 con 0x7efefc0e0ac0 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efefc0516d0 con 0x7efefc0e06e0 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff08b73640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efefc0e0ac0 0x7efefc04e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f1e99ffb640 1 -- 172.21.15.181:0/1619177479 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c02bcd0 con 0x7f1ea40b2790 2024-09-12T02:28:33.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f1e99ffb640 1 -- 172.21.15.181:0/1619177479 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c001a00 con 0x7f1ea40b2790 2024-09-12T02:28:33.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f87129bd640 1 Processor -- start 2024-09-12T02:28:33.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f87129bd640 1 -- start start 2024-09-12T02:28:33.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f033006f0c0 con 0x7f0330154d30 2024-09-12T02:28:33.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f033006ef40 con 0x7f033015b640 2024-09-12T02:28:33.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f033015db20 con 0x7f03300b2490 2024-09-12T02:28:33.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f0335ace640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f033015b640 0x7f03300aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab6443640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80e2fe0 0x7f3aa8051580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.186+0000 7f3ab5441640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa80dbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.187+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80535b0 con 0x7f3aa80e2fe0 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f0334acc640 1 -- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 msgr2=0x7f03300aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f0334acc640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03300aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f0334acc640 1 -- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f033015b640 msgr2=0x7f03300aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f0334acc640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f033015b640 0x7f03300aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f0334acc640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03301f0f10 con 0x7f0330154d30 2024-09-12T02:28:33.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f8955dc6640 1 Processor -- start 2024-09-12T02:28:33.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff08b73640 1 -- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e06e0 msgr2=0x7efefc04b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f39d8047640 1 -- 172.21.15.181:0/1652528172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 msgr2=0x7f39d00b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f39d8047640 1 --2- 172.21.15.181:0/1652528172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 0x7f39d00b4bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39d00d11c0 tx=0x7f39c802a630 comp rx=0 tx=0).stop 2024-09-12T02:28:33.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea41ec880 con 0x7f1ea40b2790 2024-09-12T02:28:33.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f0335ace640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f033015b640 0x7f03300aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:33.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff08b73640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e06e0 0x7efefc04b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f3ab5c42640 1 -- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80e2fe0 msgr2=0x7f3aa8051580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f3ab5c42640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80e2fe0 0x7f3aa8051580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f3ab5c42640 1 -- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 msgr2=0x7f3aa80dbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f3ab5c42640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa80dbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f3ab5c42640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa8051ef0 con 0x7f3aa80345e0 2024-09-12T02:28:33.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f8955dc6640 1 -- start start 2024-09-12T02:28:33.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f3ab5441640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa80dbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:33.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f3ab6443640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80e2fe0 0x7f3aa8051580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:33.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea40ae0a0 con 0x7f1ea40b2790 2024-09-12T02:28:33.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f1e99ffb640 1 -- 172.21.15.181:0/1619177479 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c03f690 con 0x7f1ea40b2790 2024-09-12T02:28:33.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f87129bd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f870c06d7a0 0x7f870c1f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f0334acc640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0330154d30 0x7f03300ae750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0320001840 tx=0x7f0320001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f39d8047640 1 -- 172.21.15.181:0/1652528172 shutdown_connections 2024-09-12T02:28:33.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f39d8047640 1 --2- 172.21.15.181:0/1652528172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 0x7f39d00b4bc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f39d8047640 1 --2- 172.21.15.181:0/1652528172 >> v2:172.21.15.204:3300/0 conn(0x7f39d0162b00 0x7f39d0162f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f39d8047640 1 --2- 172.21.15.181:0/1652528172 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162720 0x7f39d00b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7f39d8047640 1 -- 172.21.15.181:0/1652528172 >> 172.21.15.181:0/1652528172 conn(0x7f39d006bc10 msgr2=0x7f39d006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff08b73640 1 -- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0535e0 msgr2=0x7efefc03c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f39d8047640 1 -- 172.21.15.181:0/1652528172 shutdown_connections 2024-09-12T02:28:33.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff08b73640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0535e0 0x7efefc03c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff08b73640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc0d6d90 con 0x7efefc0e0ac0 2024-09-12T02:28:33.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff03fff640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0535e0 0x7efefc03c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:33.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff08b73640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efefc0e0ac0 0x7efefc04e940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff04050d60 tx=0x7eff04069e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.188+0000 7eff00ff9640 1 -- 172.21.15.181:0/2138666540 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040696f0 con 0x7efefc0e0ac0 2024-09-12T02:28:33.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7eff00ff9640 1 -- 172.21.15.181:0/2138666540 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff040921d0 con 0x7efefc0e0ac0 2024-09-12T02:28:33.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efefc04a350 con 0x7efefc0e0ac0 2024-09-12T02:28:33.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f8955dc6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8934004d40 0x7f895014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f8955dc6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89501f8920 0x7f895014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f8955dc6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89501f8da0 0x7f895014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efefc04b7b0 con 0x7efefc0e0ac0 2024-09-12T02:28:33.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f8955dc6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f89500b5160 con 0x7f8934004d40 2024-09-12T02:28:33.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f8955dc6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f89500b4fe0 con 0x7f89501f8da0 2024-09-12T02:28:33.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f8955dc6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f895006ef40 con 0x7f89501f8920 2024-09-12T02:28:33.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7eff00ff9640 1 -- 172.21.15.181:0/2138666540 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff04092600 con 0x7efefc0e0ac0 2024-09-12T02:28:33.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.189+0000 7f39d8047640 1 -- 172.21.15.181:0/1652528172 wait complete. 2024-09-12T02:28:33.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f894ffff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89501f8da0 0x7f895014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f894ffff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89501f8da0 0x7f895014f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53242/0 (socket says 172.21.15.181:53242) 2024-09-12T02:28:33.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f894ffff640 1 -- 172.21.15.181:0/3242689911 learned_addr learned my addr 172.21.15.181:0/3242689911 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f870bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f870c06d7a0 0x7f870c1f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f87129bd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a540 0x7f870c15d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f87129bd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f870c15a920 0x7f870c14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f87129bd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f870c072030 con 0x7f870c06d7a0 2024-09-12T02:28:33.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f87129bd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f870c071d50 con 0x7f870c15a920 2024-09-12T02:28:33.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f87129bd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f870c0b3cd0 con 0x7f870c15a540 2024-09-12T02:28:33.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea40b4730 con 0x7f1ea40b2790 2024-09-12T02:28:33.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f0325ffb640 1 -- 172.21.15.181:0/2887608536 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032001f070 con 0x7f0330154d30 2024-09-12T02:28:33.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0330157170 con 0x7f0330154d30 2024-09-12T02:28:33.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0330157730 con 0x7f0330154d30 2024-09-12T02:28:33.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f3ab5c42640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3aa80345e0 0x7f3aa8054560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00e9b0 tx=0x7f3aac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f894ffff640 1 -- 172.21.15.181:0/3242689911 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89501f8920 msgr2=0x7f895014eb60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:28:33.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f894ffff640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89501f8920 0x7f895014eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f894ffff640 1 -- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8934004d40 msgr2=0x7f895014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f894ffff640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8934004d40 0x7f895014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f894ffff640 1 -- 172.21.15.181:0/3242689911 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89501f98c0 con 0x7f89501f8da0 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a540 0x7f870c15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a540 0x7f870c15d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35724/0 (socket says 172.21.15.181:35724) 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.190+0000 7f870b7fe640 1 -- 172.21.15.181:0/2949985973 learned_addr learned my addr 172.21.15.181:0/2949985973 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f870b7fe640 1 -- 172.21.15.181:0/2949985973 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f870c15a920 msgr2=0x7f870c14fa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f870b7fe640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f870c15a920 0x7f870c14fa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f870b7fe640 1 -- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f870c06d7a0 msgr2=0x7f870c1f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f870b7fe640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f870c06d7a0 0x7f870c1f44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f870b7fe640 1 -- 172.21.15.181:0/2949985973 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c15be90 con 0x7f870c15a540 2024-09-12T02:28:33.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f870b7fe640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a540 0x7f870c15d840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098c0 tx=0x7f86fc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f894ffff640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89501f8da0 0x7f895014f0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8948010540 tx=0x7f894800a2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f0325ffb640 1 -- 172.21.15.181:0/2887608536 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0320005070 con 0x7f0330154d30 2024-09-12T02:28:33.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f0325ffb640 1 -- 172.21.15.181:0/2887608536 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320005480 con 0x7f0330154d30 2024-09-12T02:28:33.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f39d8047640 1 Processor -- start 2024-09-12T02:28:33.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7eff00ff9640 1 -- 172.21.15.181:0/2138666540 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff04095030 con 0x7efefc0e0ac0 2024-09-12T02:28:33.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f8708ff9640 1 -- 172.21.15.181:0/2949985973 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc04a070 con 0x7f870c15a540 2024-09-12T02:28:33.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f8708ff9640 1 -- 172.21.15.181:0/2949985973 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc038040 con 0x7f870c15a540 2024-09-12T02:28:33.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f39d8047640 1 -- start start 2024-09-12T02:28:33.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f8947fff640 1 -- 172.21.15.181:0/3242689911 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948045070 con 0x7f89501f8da0 2024-09-12T02:28:33.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f8947fff640 1 -- 172.21.15.181:0/3242689911 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8948040450 con 0x7f89501f8da0 2024-09-12T02:28:33.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f8947fff640 1 -- 172.21.15.181:0/3242689911 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894803c070 con 0x7f89501f8da0 2024-09-12T02:28:33.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89500cee60 con 0x7f89501f8da0 2024-09-12T02:28:33.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89501f95e0 con 0x7f89501f8da0 2024-09-12T02:28:33.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.191+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efefc04a960 con 0x7efefc0e0ac0 2024-09-12T02:28:33.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.192+0000 7eff00ff9640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efee806bf00 0x7efee806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.192+0000 7f8708ff9640 1 -- 172.21.15.181:0/2949985973 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc037050 con 0x7f870c15a540 2024-09-12T02:28:33.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.192+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870c15c170 con 0x7f870c15a540 2024-09-12T02:28:33.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.192+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f870c15c730 con 0x7f870c15a540 2024-09-12T02:28:33.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.192+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0310005290 con 0x7f0330154d30 2024-09-12T02:28:33.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f3aa67fc640 1 -- 172.21.15.181:0/1203737443 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac017070 con 0x7f3aa80345e0 2024-09-12T02:28:33.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f3aa67fc640 1 -- 172.21.15.181:0/1203737443 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac00c9a0 con 0x7f3aa80345e0 2024-09-12T02:28:33.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f3aa67fc640 1 -- 172.21.15.181:0/1203737443 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00cd50 con 0x7f3aa80345e0 2024-09-12T02:28:33.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa8053a80 con 0x7f3aa80345e0 2024-09-12T02:28:33.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa8054040 con 0x7f3aa80345e0 2024-09-12T02:28:33.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d8047640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 0x7f39d01f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d8047640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39d0162720 0x7f39d0157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d8047640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162b00 0x7f39d015b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d8047640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f39d00b5100 con 0x7f39d00b4730 2024-09-12T02:28:33.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892c005290 con 0x7f89501f8da0 2024-09-12T02:28:33.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d55e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39d0162720 0x7f39d0157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d55e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39d0162720 0x7f39d0157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:53254/0 (socket says 172.21.15.181:53254) 2024-09-12T02:28:33.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d55e2640 1 -- 172.21.15.181:0/658842309 learned_addr learned my addr 172.21.15.181:0/658842309 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f39d00cf410 con 0x7f39d0162720 2024-09-12T02:28:33.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d65e4640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162b00 0x7f39d015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f39d00cdfc0 con 0x7f39d0162b00 2024-09-12T02:28:33.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f1e99ffb640 1 -- 172.21.15.181:0/1619177479 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e9c046060 con 0x7f1ea40b2790 2024-09-12T02:28:33.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870c06dfc0 con 0x7f870c15a540 2024-09-12T02:28:33.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7f1e99ffb640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1e8806be60 0x7f1e8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f39d55e2640 1 -- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162b00 msgr2=0x7f39d015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f39d55e2640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162b00 0x7f39d015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f39d55e2640 1 -- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 msgr2=0x7f39d01f9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f39d55e2640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 0x7f39d01f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f39d55e2640 1 -- 172.21.15.181:0/658842309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d0073450 con 0x7f39d0162720 2024-09-12T02:28:33.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.193+0000 7eff03fff640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efee806bf00 0x7efee806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7eff03fff640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efee806bf00 0x7efee806e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efefc050630 tx=0x7efef802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f1e99ffb640 1 -- 172.21.15.181:0/1619177479 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e9c0aaf50 con 0x7f1ea40b2790 2024-09-12T02:28:33.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f1ea8b3a640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1e8806be60 0x7f1e8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7eff00ff9640 1 -- 172.21.15.181:0/2138666540 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7eff04105df0 con 0x7efefc0e0ac0 2024-09-12T02:28:33.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f1ea8b3a640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1e8806be60 0x7f1e8806e320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4155280 tx=0x7f1e94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f8708ff9640 1 -- 172.21.15.181:0/2949985973 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86fc04d070 con 0x7f870c15a540 2024-09-12T02:28:33.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.194+0000 7f39d55e2640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39d0162720 0x7f39d0157020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c7f0 tx=0x7f39cc00ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f8947fff640 1 -- 172.21.15.181:0/3242689911 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8948040840 con 0x7f89501f8da0 2024-09-12T02:28:33.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa8054240 con 0x7f3aa80345e0 2024-09-12T02:28:33.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f8708ff9640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f86f806bf00 0x7f86f806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f8708ff9640 1 -- 172.21.15.181:0/2949985973 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f86fc0b2f40 con 0x7f870c15a540 2024-09-12T02:28:33.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f8947fff640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f893806beb0 0x7f893806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f870bfff640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f86f806bf00 0x7f86f806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f0325ffb640 1 -- 172.21.15.181:0/2887608536 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0320022070 con 0x7f0330154d30 2024-09-12T02:28:33.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f894f7fe640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f893806beb0 0x7f893806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.195+0000 7f8947fff640 1 -- 172.21.15.181:0/3242689911 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f89480aac90 con 0x7f89501f8da0 2024-09-12T02:28:33.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.196+0000 7f894f7fe640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f893806beb0 0x7f893806e370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8950157f10 tx=0x7f8940009350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.196+0000 7f870bfff640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f86f806bf00 0x7f86f806e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87000015d0 tx=0x7f8700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.196+0000 7f0325ffb640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f031406bfd0 0x7f031406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.196+0000 7f03352cd640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f031406bfd0 0x7f031406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.196+0000 7f03352cd640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f031406bfd0 0x7f031406e490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f032c000f60 tx=0x7f032c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.198+0000 7eff00ff9640 1 -- 172.21.15.181:0/2138666540 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff0409c020 con 0x7efefc0e0ac0 2024-09-12T02:28:33.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.199+0000 7f8708ff9640 1 -- 172.21.15.181:0/2949985973 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86fc054030 con 0x7f870c15a540 2024-09-12T02:28:33.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.200+0000 7f0325ffb640 1 -- 172.21.15.181:0/2887608536 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f032005ed10 con 0x7f0330154d30 2024-09-12T02:28:33.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.201+0000 7f1e99ffb640 1 -- 172.21.15.181:0/1619177479 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e9c0798f0 con 0x7f1ea40b2790 2024-09-12T02:28:33.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.201+0000 7f3aa67fc640 1 -- 172.21.15.181:0/1203737443 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3aac01a070 con 0x7f3aa80345e0 2024-09-12T02:28:33.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.201+0000 7f3aa67fc640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3a9406be80 0x7f3a9406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f3aa67fc640 1 -- 172.21.15.181:0/1203737443 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3aac08b3a0 con 0x7f3aa80345e0 2024-09-12T02:28:33.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f3ab5441640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3a9406be80 0x7f3a9406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f39c27fc640 1 -- 172.21.15.181:0/658842309 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc004230 con 0x7f39d0162720 2024-09-12T02:28:33.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f8947fff640 1 -- 172.21.15.181:0/3242689911 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8948079060 con 0x7f89501f8da0 2024-09-12T02:28:33.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d0070f80 con 0x7f39d0162720 2024-09-12T02:28:33.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d0073170 con 0x7f39d0162720 2024-09-12T02:28:33.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f39c27fc640 1 -- 172.21.15.181:0/658842309 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc0043d0 con 0x7f39d0162720 2024-09-12T02:28:33.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f3ab5441640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3a9406be80 0x7f3a9406e340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006fd0 tx=0x7f3aa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.202+0000 7f39c27fc640 1 -- 172.21.15.181:0/658842309 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc007820 con 0x7f39d0162720 2024-09-12T02:28:33.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.204+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b8005290 con 0x7f39d0162720 2024-09-12T02:28:33.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.204+0000 7f39c27fc640 1 -- 172.21.15.181:0/658842309 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39cc007c10 con 0x7f39d0162720 2024-09-12T02:28:33.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.205+0000 7f39c27fc640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f39b406bf00 0x7f39b406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.205+0000 7f39c27fc640 1 -- 172.21.15.181:0/658842309 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f39cc08ae40 con 0x7f39d0162720 2024-09-12T02:28:33.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.205+0000 7f39d5de3640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f39b406bf00 0x7f39b406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.206+0000 7f39d5de3640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f39b406bf00 0x7f39b406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39c4006a90 tx=0x7f39c4006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.209+0000 7f0325ffb640 1 -- 172.21.15.181:0/2887608536 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0320029020 con 0x7f0330154d30 2024-09-12T02:28:33.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.209+0000 7f39c27fc640 1 -- 172.21.15.181:0/658842309 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39cc015020 con 0x7f39d0162720 2024-09-12T02:28:33.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.218+0000 7f3aa67fc640 1 -- 172.21.15.181:0/1203737443 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3aa8054240 con 0x7f3aa80345e0 2024-09-12T02:28:33.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.533+0000 7f0c18a5e640 1 -- 172.21.15.181:0/390711055 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0bf8005580 con 0x7f0c141605d0 2024-09-12T02:28:33.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.533+0000 7f0c02ffd640 1 -- 172.21.15.181:0/390711055 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c0c059a80 con 0x7f0c141605d0 2024-09-12T02:28:33.534 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:33.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.537+0000 7f0c00ff9640 1 -- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0bf406bf00 msgr2=0x7f0bf406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.537+0000 7f0c00ff9640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0bf406bf00 0x7f0bf406e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c04000f60 tx=0x7f0c04001b20 comp rx=0 tx=0).stop 2024-09-12T02:28:33.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.537+0000 7f0c00ff9640 1 -- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c141605d0 msgr2=0x7f0c14143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.537+0000 7f0c00ff9640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c141605d0 0x7f0c14143230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c8e0 tx=0x7f0c0c00cda0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 -- 172.21.15.181:0/390711055 shutdown_connections 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0bf406bf00 0x7f0bf406e3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c141605d0 0x7f0c14143230 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c140b1d80 0x7f0c14160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 --2- 172.21.15.181:0/390711055 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c1406ef40 0x7f0c1406d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 -- 172.21.15.181:0/390711055 >> 172.21.15.181:0/390711055 conn(0x7f0c1406bc10 msgr2=0x7f0c14159140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 -- 172.21.15.181:0/390711055 shutdown_connections 2024-09-12T02:28:33.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.538+0000 7f0c00ff9640 1 -- 172.21.15.181:0/390711055 wait complete. 2024-09-12T02:28:33.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T02:28:33.555 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.571+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f870c06ea10 con 0x7f870c15a540 2024-09-12T02:28:33.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.572+0000 7f8708ff9640 1 -- 172.21.15.181:0/2949985973 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86fc0818d0 con 0x7f870c15a540 2024-09-12T02:28:33.573 INFO:teuthology.orchestra.run.smithi181.stdout:60129542151 2024-09-12T02:28:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f86f806bf00 msgr2=0x7f86f806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f86f806bf00 0x7f86f806e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87000015d0 tx=0x7f8700009040 comp rx=0 tx=0).stop 2024-09-12T02:28:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a540 msgr2=0x7f870c15d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a540 0x7f870c15d840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098c0 tx=0x7f86fc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 shutdown_connections 2024-09-12T02:28:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f86f806bf00 0x7f86f806e3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f870c15a920 0x7f870c14fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f870c15a540 0x7f870c15d840 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 --2- 172.21.15.181:0/2949985973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f870c06d7a0 0x7f870c1f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 >> 172.21.15.181:0/2949985973 conn(0x7f870c067d70 msgr2=0x7f870c152140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 shutdown_connections 2024-09-12T02:28:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.575+0000 7f87129bd640 1 -- 172.21.15.181:0/2949985973 wait complete. 2024-09-12T02:28:33.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-09-12T02:28:33.587 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.597+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ea41ecb60 con 0x7f1ea40b2790 2024-09-12T02:28:33.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.597+0000 7f1e99ffb640 1 -- 172.21.15.181:0/1619177479 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e9c0791f0 con 0x7f1ea40b2790 2024-09-12T02:28:33.598 INFO:teuthology.orchestra.run.smithi181.stdout:60129542150 2024-09-12T02:28:33.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.599+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efefc0530a0 con 0x7efefc0e0ac0 2024-09-12T02:28:33.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.600+0000 7eff00ff9640 1 -- 172.21.15.181:0/2138666540 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff040d4790 con 0x7efefc0e0ac0 2024-09-12T02:28:33.600 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:33.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.600+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1e8806be60 msgr2=0x7f1e8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.600+0000 7f1eab59f640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1e8806be60 0x7f1e8806e320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4155280 tx=0x7f1e94008040 comp rx=0 tx=0).stop 2024-09-12T02:28:33.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.600+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea40b2790 msgr2=0x7f1ea4150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.600+0000 7f1eab59f640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea40b2790 0x7f1ea4150e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000f80 tx=0x7f1e9c001360 comp rx=0 tx=0).stop 2024-09-12T02:28:33.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 shutdown_connections 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1e8806be60 0x7f1e8806e320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ea414e3f0 0x7f1ea41ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ea414eb70 0x7f1ea414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 --2- 172.21.15.181:0/1619177479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea40b2790 0x7f1ea4150e70 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000f80 tx=0x7f1e9c001360 comp rx=0 tx=0).stop 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 >> 172.21.15.181:0/1619177479 conn(0x7f1ea406bc10 msgr2=0x7f1ea40cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 shutdown_connections 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f1eab59f640 1 -- 172.21.15.181:0/1619177479 wait complete. 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f892c005850 con 0x7f89501f8da0 2024-09-12T02:28:33.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.601+0000 7f8947fff640 1 -- 172.21.15.181:0/3242689911 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f894807d360 con 0x7f89501f8da0 2024-09-12T02:28:33.604 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:33.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efee806bf00 msgr2=0x7efee806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efee806bf00 0x7efee806e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efefc050630 tx=0x7efef802e000 comp rx=0 tx=0).stop 2024-09-12T02:28:33.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efefc0e0ac0 msgr2=0x7efefc04e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efefc0e0ac0 0x7efefc04e940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff04050d60 tx=0x7eff04069e90 comp rx=0 tx=0).stop 2024-09-12T02:28:33.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 shutdown_connections 2024-09-12T02:28:33.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efee806bf00 0x7efee806e3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efefc0e0ac0 0x7efefc04e940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efefc0e06e0 0x7efefc04b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 --2- 172.21.15.181:0/2138666540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efefc0535e0 0x7efefc03c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 >> 172.21.15.181:0/2138666540 conn(0x7efefc01fb50 msgr2=0x7efefc052610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 shutdown_connections 2024-09-12T02:28:33.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.602+0000 7eff09374640 1 -- 172.21.15.181:0/2138666540 wait complete. 2024-09-12T02:28:33.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f893806beb0 msgr2=0x7f893806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f893806beb0 0x7f893806e370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8950157f10 tx=0x7f8940009350 comp rx=0 tx=0).stop 2024-09-12T02:28:33.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89501f8da0 msgr2=0x7f895014f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89501f8da0 0x7f895014f0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8948010540 tx=0x7f894800a2f0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 shutdown_connections 2024-09-12T02:28:33.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f893806beb0 0x7f893806e370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f89501f8da0 0x7f895014f0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f89501f8920 0x7f895014eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 --2- 172.21.15.181:0/3242689911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8934004d40 0x7f895014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0310005850 con 0x7f0330154d30 2024-09-12T02:28:33.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 >> 172.21.15.181:0/3242689911 conn(0x7f895006bc10 msgr2=0x7f8950073230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 shutdown_connections 2024-09-12T02:28:33.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.605+0000 7f8955dc6640 1 -- 172.21.15.181:0/3242689911 wait complete. 2024-09-12T02:28:33.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.606+0000 7f0325ffb640 1 -- 172.21.15.181:0/2887608536 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0320060c70 con 0x7f0330154d30 2024-09-12T02:28:33.609 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:33.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.607+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f39b8005580 con 0x7f39d0162720 2024-09-12T02:28:33.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.608+0000 7f39c27fc640 1 -- 172.21.15.181:0/658842309 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39cc059210 con 0x7f39d0162720 2024-09-12T02:28:33.610 INFO:teuthology.orchestra.run.smithi181.stdout:64424509446 2024-09-12T02:28:33.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f031406bfd0 msgr2=0x7f031406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f031406bfd0 0x7f031406e490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f032c000f60 tx=0x7f032c009040 comp rx=0 tx=0).stop 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0330154d30 msgr2=0x7f03300ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0330154d30 0x7f03300ae750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0320001840 tx=0x7f0320001d00 comp rx=0 tx=0).stop 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 shutdown_connections 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f031406bfd0 0x7f031406e490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f033015b640 0x7f03300aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0330154d30 0x7f03300ae750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 --2- 172.21.15.181:0/2887608536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03300b2490 0x7f03300aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.610+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 >> 172.21.15.181:0/2887608536 conn(0x7f033006bc10 msgr2=0x7f03300b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 shutdown_connections 2024-09-12T02:28:33.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f39b406bf00 msgr2=0x7f39b406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f39b406bf00 0x7f39b406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39c4006a90 tx=0x7f39c4006a20 comp rx=0 tx=0).stop 2024-09-12T02:28:33.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39d0162720 msgr2=0x7f39d0157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39d0162720 0x7f39d0157020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c7f0 tx=0x7f39cc00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f0337531640 1 -- 172.21.15.181:0/2887608536 wait complete. 2024-09-12T02:28:33.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 shutdown_connections 2024-09-12T02:28:33.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f39b406bf00 0x7f39b406e3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39d0162720 0x7f39d0157020 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39d0162b00 0x7f39d015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 --2- 172.21.15.181:0/658842309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39d00b4730 0x7f39d01f9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 >> 172.21.15.181:0/658842309 conn(0x7f39d006bc10 msgr2=0x7f39d006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 shutdown_connections 2024-09-12T02:28:33.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.611+0000 7f39d8047640 1 -- 172.21.15.181:0/658842309 wait complete. 2024-09-12T02:28:33.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.615+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3aa80de5a0 con 0x7f3aa80345e0 2024-09-12T02:28:33.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.616+0000 7f3aa67fc640 1 -- 172.21.15.181:0/1203737443 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3aac059ec0 con 0x7f3aa80345e0 2024-09-12T02:28:33.616 INFO:teuthology.orchestra.run.smithi181.stdout:64424509447 2024-09-12T02:28:33.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-12T02:28:33.620 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3a9406be80 msgr2=0x7f3a9406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3a9406be80 0x7f3a9406e340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006fd0 tx=0x7f3aa0008040 comp rx=0 tx=0).stop 2024-09-12T02:28:33.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3aa80345e0 msgr2=0x7f3aa8054560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3aa80345e0 0x7f3aa8054560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00e9b0 tx=0x7f3aac00ee70 comp rx=0 tx=0).stop 2024-09-12T02:28:33.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-12T02:28:33.622 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 shutdown_connections 2024-09-12T02:28:33.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3a9406be80 0x7f3a9406e340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3aa8036a00 0x7f3aa80dbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3aa80e2fe0 0x7f3aa8051580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 --2- 172.21.15.181:0/1203737443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3aa80345e0 0x7f3aa8054560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 >> 172.21.15.181:0/1203737443 conn(0x7f3aa801ea40 msgr2=0x7f3aa8008310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 shutdown_connections 2024-09-12T02:28:33.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.620+0000 7f3ab6c44640 1 -- 172.21.15.181:0/1203737443 wait complete. 2024-09-12T02:28:33.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T02:28:33.626 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-12T02:28:33.629 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-12T02:28:33.630 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-12T02:28:33.634 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:33.634 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:28:33.634 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:28:33.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.772+0000 7f5b17017640 1 Processor -- start 2024-09-12T02:28:33.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.772+0000 7f5b17017640 1 -- start start 2024-09-12T02:28:33.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b17017640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b100b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b17017640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5b1015d2e0 0x7f5b1015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b17017640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b10070660 0x7f5b10070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b17017640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5b10071010 con 0x7f5b10070660 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b17017640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1015d720 con 0x7f5b1015d2e0 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b17017640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5b100b59b0 con 0x7f5b100d27b0 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b10070660 0x7f5b10070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b10070660 0x7f5b10070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51998/0 (socket says 172.21.15.181:51998) 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 -- 172.21.15.181:0/1156439233 learned_addr learned my addr 172.21.15.181:0/1156439233 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 -- 172.21.15.181:0/1156439233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 msgr2=0x7f5b100b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b14db3640 1 --2- 172.21.15.181:0/1156439233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b100b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b0ffff640 1 --2- 172.21.15.181:0/1156439233 >> v2:172.21.15.204:3300/0 conn(0x7f5b1015d2e0 0x7f5b1015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 --2- 172.21.15.181:0/1156439233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b100b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 -- 172.21.15.181:0/1156439233 >> v2:172.21.15.204:3300/0 conn(0x7f5b1015d2e0 msgr2=0x7f5b1015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 --2- 172.21.15.181:0/1156439233 >> v2:172.21.15.204:3300/0 conn(0x7f5b1015d2e0 0x7f5b1015d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.773+0000 7f5b155b4640 1 -- 172.21.15.181:0/1156439233 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100b5c90 con 0x7f5b10070660 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.774+0000 7f5b155b4640 1 --2- 172.21.15.181:0/1156439233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b10070660 0x7f5b10070ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b10071940 tx=0x7f5b0802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc11b139aad15afe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.774+0000 7f5b0f7fe640 1 -- 172.21.15.181:0/1156439233 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08036070 con 0x7f5b10070660 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.774+0000 7f5b0f7fe640 1 -- 172.21.15.181:0/1156439233 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b08031600 con 0x7f5b10070660 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.774+0000 7f5b0f7fe640 1 -- 172.21.15.181:0/1156439233 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b080319d0 con 0x7f5b10070660 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 -- 172.21.15.181:0/1156439233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b10070660 msgr2=0x7f5b10070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 --2- 172.21.15.181:0/1156439233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b10070660 0x7f5b10070ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b10071940 tx=0x7f5b0802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 -- 172.21.15.181:0/1156439233 shutdown_connections 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 --2- 172.21.15.181:0/1156439233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b10070660 0x7f5b10070ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 --2- 172.21.15.181:0/1156439233 >> v2:172.21.15.204:3300/0 conn(0x7f5b1015d2e0 0x7f5b1015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 --2- 172.21.15.181:0/1156439233 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b100b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 -- 172.21.15.181:0/1156439233 >> 172.21.15.181:0/1156439233 conn(0x7f5b1006f400 msgr2=0x7f5b1006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 -- 172.21.15.181:0/1156439233 shutdown_connections 2024-09-12T02:28:33.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.775+0000 7f5b17017640 1 -- 172.21.15.181:0/1156439233 wait complete. 2024-09-12T02:28:33.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.776+0000 7f5b17017640 1 Processor -- start 2024-09-12T02:28:33.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.776+0000 7f5b17017640 1 -- start start 2024-09-12T02:28:33.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b17017640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b10070660 0x7f5b10158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b17017640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b10157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b17017640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b1015d2e0 0x7f5b10151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b17017640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100b6530 con 0x7f5b1015d2e0 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b17017640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100b6250 con 0x7f5b10070660 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b17017640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5b100d2b90 con 0x7f5b100d27b0 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b1015d2e0 0x7f5b10151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b1015d2e0 0x7f5b10151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52000/0 (socket says 172.21.15.181:52000) 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 -- 172.21.15.181:0/3589449330 learned_addr learned my addr 172.21.15.181:0/3589449330 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b14db3640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b10070660 0x7f5b10158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b0ffff640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b10157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 -- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 msgr2=0x7f5b10157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b10157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 -- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b10070660 msgr2=0x7f5b10158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b10070660 0x7f5b10158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.777+0000 7f5b155b4640 1 -- 172.21.15.181:0/3589449330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100ce570 con 0x7f5b1015d2e0 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.778+0000 7f5b155b4640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b1015d2e0 0x7f5b10151e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f40 tx=0x7f5b08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.778+0000 7f5b0d7fa640 1 -- 172.21.15.181:0/3589449330 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08036050 con 0x7f5b1015d2e0 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.778+0000 7f5b0d7fa640 1 -- 172.21.15.181:0/3589449330 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b08042070 con 0x7f5b1015d2e0 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.778+0000 7f5b0d7fa640 1 -- 172.21.15.181:0/3589449330 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08009510 con 0x7f5b1015d2e0 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.778+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b10152360 con 0x7f5b1015d2e0 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.778+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b101548e0 con 0x7f5b1015d2e0 2024-09-12T02:28:33.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.779+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b10070ad0 con 0x7f5b1015d2e0 2024-09-12T02:28:33.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.779+0000 7f5b0d7fa640 1 -- 172.21.15.181:0/3589449330 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b08007bd0 con 0x7f5b1015d2e0 2024-09-12T02:28:33.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.780+0000 7f5b0d7fa640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5afc06be60 0x7f5afc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:33.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.780+0000 7f5b14db3640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5afc06be60 0x7f5afc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.780+0000 7f5b0d7fa640 1 -- 172.21.15.181:0/3589449330 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b080abb90 con 0x7f5b1015d2e0 2024-09-12T02:28:33.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.780+0000 7f5b14db3640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5afc06be60 0x7f5afc06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000aaf0 tx=0x7f5b00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:33.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.784+0000 7f5b0d7fa640 1 -- 172.21.15.181:0/3589449330 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b08079f80 con 0x7f5b1015d2e0 2024-09-12T02:28:33.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.946+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b100d1e40 con 0x7f5afc06be60 2024-09-12T02:28:33.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.951+0000 7f5b0d7fa640 1 -- 172.21.15.181:0/3589449330 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251830 (secure 0 0 0) 0x7f5b100d1e40 con 0x7f5afc06be60 2024-09-12T02:28:33.955 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:33.956 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5afc06be60 msgr2=0x7f5afc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5afc06be60 0x7f5afc06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000aaf0 tx=0x7f5b00008040 comp rx=0 tx=0).stop 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b1015d2e0 msgr2=0x7f5b10151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b1015d2e0 0x7f5b10151e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f40 tx=0x7f5b08004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 shutdown_connections 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5afc06be60 0x7f5afc06e320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b1015d2e0 0x7f5b10151e20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.954+0000 7f5b17017640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b100d27b0 0x7f5b10157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.955+0000 7f5b17017640 1 --2- 172.21.15.181:0/3589449330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b10070660 0x7f5b10158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.955+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 >> 172.21.15.181:0/3589449330 conn(0x7f5b1006f400 msgr2=0x7f5b100d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:33.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.955+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 shutdown_connections 2024-09-12T02:28:33.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:33.955+0000 7f5b17017640 1 -- 172.21.15.181:0/3589449330 wait complete. 2024-09-12T02:28:33.966 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T02:28:33.614390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2924544,"data_stored":1761292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.156401"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298690+0000","last_change":"2024-09-12T02:28:22.461189+0000","last_active":"2024-09-12T02:28:24.298690+0000","last_peered":"2024-09-12T02:28:24.298690+0000","last_clean":"2024-09-12T02:28:24.298690+0000","last_became_active":"2024-09-12T02:28:22.460880+0000","last_became_peered":"2024-09-12T02:28:22.460880+0000","last_unstale":"2024-09-12T02:28:24.298690+0000","last_undegraded":"2024-09-12T02:28:24.298690+0000","last_fullsized":"2024-09-12T02:28:24.298690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.893907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459714+0000","last_change":"2024-09-12T02:28:22.462152+0000","last_active":"2024-09-12T02:28:23.459714+0000","last_peered":"2024-09-12T02:28:23.459714+0000","last_clean":"2024-09-12T02:28:23.459714+0000","last_became_active":"2024-09-12T02:28:22.461892+0000","last_became_peered":"2024-09-12T02:28:22.461892+0000","last_unstale":"2024-09-12T02:28:23.459714+0000","last_undegraded":"2024-09-12T02:28:23.459714+0000","last_fullsized":"2024-09-12T02:28:23.459714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995437+0000","last_change":"2024-09-12T02:28:22.456793+0000","last_active":"2024-09-12T02:28:23.995437+0000","last_peered":"2024-09-12T02:28:23.995437+0000","last_clean":"2024-09-12T02:28:23.995437+0000","last_became_active":"2024-09-12T02:28:22.456542+0000","last_became_peered":"2024-09-12T02:28:22.456542+0000","last_unstale":"2024-09-12T02:28:23.995437+0000","last_undegraded":"2024-09-12T02:28:23.995437+0000","last_fullsized":"2024-09-12T02:28:23.995437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298035+0000","last_change":"2024-09-12T02:28:22.470469+0000","last_active":"2024-09-12T02:28:24.298035+0000","last_peered":"2024-09-12T02:28:24.298035+0000","last_clean":"2024-09-12T02:28:24.298035+0000","last_became_active":"2024-09-12T02:28:22.470021+0000","last_became_peered":"2024-09-12T02:28:22.470021+0000","last_unstale":"2024-09-12T02:28:24.298035+0000","last_undegraded":"2024-09-12T02:28:24.298035+0000","last_fullsized":"2024-09-12T02:28:24.298035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:24.316527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298202+0000","last_change":"2024-09-12T02:28:22.457601+0000","last_active":"2024-09-12T02:28:24.298202+0000","last_peered":"2024-09-12T02:28:24.298202+0000","last_clean":"2024-09-12T02:28:24.298202+0000","last_became_active":"2024-09-12T02:28:22.454545+0000","last_became_peered":"2024-09-12T02:28:22.454545+0000","last_unstale":"2024-09-12T02:28:24.298202+0000","last_undegraded":"2024-09-12T02:28:24.298202+0000","last_fullsized":"2024-09-12T02:28:24.298202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:24.316527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297761+0000","last_change":"2024-09-12T02:28:22.475342+0000","last_active":"2024-09-12T02:28:24.297761+0000","last_peered":"2024-09-12T02:28:24.297761+0000","last_clean":"2024-09-12T02:28:24.297761+0000","last_became_active":"2024-09-12T02:28:22.475064+0000","last_became_peered":"2024-09-12T02:28:22.475064+0000","last_unstale":"2024-09-12T02:28:24.297761+0000","last_undegraded":"2024-09-12T02:28:24.297761+0000","last_fullsized":"2024-09-12T02:28:24.297761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.987815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297419+0000","last_change":"2024-09-12T02:28:22.462932+0000","last_active":"2024-09-12T02:28:24.297419+0000","last_peered":"2024-09-12T02:28:24.297419+0000","last_clean":"2024-09-12T02:28:24.297419+0000","last_became_active":"2024-09-12T02:28:22.462608+0000","last_became_peered":"2024-09-12T02:28:22.462608+0000","last_unstale":"2024-09-12T02:28:24.297419+0000","last_undegraded":"2024-09-12T02:28:24.297419+0000","last_fullsized":"2024-09-12T02:28:24.297419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:28.724885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297146+0000","last_change":"2024-09-12T02:28:22.467818+0000","last_active":"2024-09-12T02:28:24.297146+0000","last_peered":"2024-09-12T02:28:24.297146+0000","last_clean":"2024-09-12T02:28:24.297146+0000","last_became_active":"2024-09-12T02:28:22.467560+0000","last_became_peered":"2024-09-12T02:28:22.467560+0000","last_unstale":"2024-09-12T02:28:24.297146+0000","last_undegraded":"2024-09-12T02:28:24.297146+0000","last_fullsized":"2024-09-12T02:28:24.297146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.908086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298706+0000","last_change":"2024-09-12T02:28:22.464802+0000","last_active":"2024-09-12T02:28:24.298706+0000","last_peered":"2024-09-12T02:28:24.298706+0000","last_clean":"2024-09-12T02:28:24.298706+0000","last_became_active":"2024-09-12T02:28:22.464518+0000","last_became_peered":"2024-09-12T02:28:22.464518+0000","last_unstale":"2024-09-12T02:28:24.298706+0000","last_undegraded":"2024-09-12T02:28:24.298706+0000","last_fullsized":"2024-09-12T02:28:24.298706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:30.326182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463284+0000","last_change":"2024-09-12T02:28:22.467874+0000","last_active":"2024-09-12T02:28:23.463284+0000","last_peered":"2024-09-12T02:28:23.463284+0000","last_clean":"2024-09-12T02:28:23.463284+0000","last_became_active":"2024-09-12T02:28:22.467350+0000","last_became_peered":"2024-09-12T02:28:22.467350+0000","last_unstale":"2024-09-12T02:28:23.463284+0000","last_undegraded":"2024-09-12T02:28:23.463284+0000","last_fullsized":"2024-09-12T02:28:23.463284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462468+0000","last_change":"2024-09-12T02:28:22.468202+0000","last_active":"2024-09-12T02:28:23.462468+0000","last_peered":"2024-09-12T02:28:23.462468+0000","last_clean":"2024-09-12T02:28:23.462468+0000","last_became_active":"2024-09-12T02:28:22.467913+0000","last_became_peered":"2024-09-12T02:28:22.467913+0000","last_unstale":"2024-09-12T02:28:23.462468+0000","last_undegraded":"2024-09-12T02:28:23.462468+0000","last_fullsized":"2024-09-12T02:28:23.462468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463228+0000","last_change":"2024-09-12T02:28:22.460598+0000","last_active":"2024-09-12T02:28:23.463228+0000","last_peered":"2024-09-12T02:28:23.463228+0000","last_clean":"2024-09-12T02:28:23.463228+0000","last_became_active":"2024-09-12T02:28:22.460325+0000","last_became_peered":"2024-09-12T02:28:22.460325+0000","last_unstale":"2024-09-12T02:28:23.463228+0000","last_undegraded":"2024-09-12T02:28:23.463228+0000","last_fullsized":"2024-09-12T02:28:23.463228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297437+0000","last_change":"2024-09-12T02:28:22.462576+0000","last_active":"2024-09-12T02:28:24.297437+0000","last_peered":"2024-09-12T02:28:24.297437+0000","last_clean":"2024-09-12T02:28:24.297437+0000","last_became_active":"2024-09-12T02:28:22.461457+0000","last_became_peered":"2024-09-12T02:28:22.461457+0000","last_unstale":"2024-09-12T02:28:24.297437+0000","last_undegraded":"2024-09-12T02:28:24.297437+0000","last_fullsized":"2024-09-12T02:28:24.297437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:26.973561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995232+0000","last_change":"2024-09-12T02:28:22.462049+0000","last_active":"2024-09-12T02:28:23.995232+0000","last_peered":"2024-09-12T02:28:23.995232+0000","last_clean":"2024-09-12T02:28:23.995232+0000","last_became_active":"2024-09-12T02:28:22.461571+0000","last_became_peered":"2024-09-12T02:28:22.461571+0000","last_unstale":"2024-09-12T02:28:23.995232+0000","last_undegraded":"2024-09-12T02:28:23.995232+0000","last_fullsized":"2024-09-12T02:28:23.995232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459520+0000","last_change":"2024-09-12T02:28:22.463467+0000","last_active":"2024-09-12T02:28:23.459520+0000","last_peered":"2024-09-12T02:28:23.459520+0000","last_clean":"2024-09-12T02:28:23.459520+0000","last_became_active":"2024-09-12T02:28:22.463205+0000","last_became_peered":"2024-09-12T02:28:22.463205+0000","last_unstale":"2024-09-12T02:28:23.459520+0000","last_undegraded":"2024-09-12T02:28:23.459520+0000","last_fullsized":"2024-09-12T02:28:23.459520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297481+0000","last_change":"2024-09-12T02:28:22.475573+0000","last_active":"2024-09-12T02:28:24.297481+0000","last_peered":"2024-09-12T02:28:24.297481+0000","last_clean":"2024-09-12T02:28:24.297481+0000","last_became_active":"2024-09-12T02:28:22.475311+0000","last_became_peered":"2024-09-12T02:28:22.475311+0000","last_unstale":"2024-09-12T02:28:24.297481+0000","last_undegraded":"2024-09-12T02:28:24.297481+0000","last_fullsized":"2024-09-12T02:28:24.297481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298512+0000","last_change":"2024-09-12T02:28:22.468036+0000","last_active":"2024-09-12T02:28:24.298512+0000","last_peered":"2024-09-12T02:28:24.298512+0000","last_clean":"2024-09-12T02:28:24.298512+0000","last_became_active":"2024-09-12T02:28:22.467611+0000","last_became_peered":"2024-09-12T02:28:22.467611+0000","last_unstale":"2024-09-12T02:28:24.298512+0000","last_undegraded":"2024-09-12T02:28:24.298512+0000","last_fullsized":"2024-09-12T02:28:24.298512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:30.326182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251391+0000","last_change":"2024-09-12T02:28:22.459062+0000","last_active":"2024-09-12T02:28:24.251391+0000","last_peered":"2024-09-12T02:28:24.251391+0000","last_clean":"2024-09-12T02:28:24.251391+0000","last_became_active":"2024-09-12T02:28:22.458792+0000","last_became_peered":"2024-09-12T02:28:22.458792+0000","last_unstale":"2024-09-12T02:28:24.251391+0000","last_undegraded":"2024-09-12T02:28:24.251391+0000","last_fullsized":"2024-09-12T02:28:24.251391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:25.142485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298786+0000","last_change":"2024-09-12T02:28:22.455655+0000","last_active":"2024-09-12T02:28:24.298786+0000","last_peered":"2024-09-12T02:28:24.298786+0000","last_clean":"2024-09-12T02:28:24.298786+0000","last_became_active":"2024-09-12T02:28:22.454802+0000","last_became_peered":"2024-09-12T02:28:22.454802+0000","last_unstale":"2024-09-12T02:28:24.298786+0000","last_undegraded":"2024-09-12T02:28:24.298786+0000","last_fullsized":"2024-09-12T02:28:24.298786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:44.397727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463379+0000","last_change":"2024-09-12T02:28:22.464688+0000","last_active":"2024-09-12T02:28:23.463379+0000","last_peered":"2024-09-12T02:28:23.463379+0000","last_clean":"2024-09-12T02:28:23.463379+0000","last_became_active":"2024-09-12T02:28:22.464285+0000","last_became_peered":"2024-09-12T02:28:22.464285+0000","last_unstale":"2024-09-12T02:28:23.463379+0000","last_undegraded":"2024-09-12T02:28:23.463379+0000","last_fullsized":"2024-09-12T02:28:23.463379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995368+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:23.995368+0000","last_peered":"2024-09-12T02:28:23.995368+0000","last_clean":"2024-09-12T02:28:23.995368+0000","last_became_active":"2024-09-12T02:28:22.464320+0000","last_became_peered":"2024-09-12T02:28:22.464320+0000","last_unstale":"2024-09-12T02:28:23.995368+0000","last_undegraded":"2024-09-12T02:28:23.995368+0000","last_fullsized":"2024-09-12T02:28:23.995368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297938+0000","last_change":"2024-09-12T02:28:22.467576+0000","last_active":"2024-09-12T02:28:24.297938+0000","last_peered":"2024-09-12T02:28:24.297938+0000","last_clean":"2024-09-12T02:28:24.297938+0000","last_became_active":"2024-09-12T02:28:22.467297+0000","last_became_peered":"2024-09-12T02:28:22.467297+0000","last_unstale":"2024-09-12T02:28:24.297938+0000","last_undegraded":"2024-09-12T02:28:24.297938+0000","last_fullsized":"2024-09-12T02:28:24.297938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.507175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297246+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:24.297246+0000","last_peered":"2024-09-12T02:28:24.297246+0000","last_clean":"2024-09-12T02:28:24.297246+0000","last_became_active":"2024-09-12T02:28:22.464373+0000","last_became_peered":"2024-09-12T02:28:22.464373+0000","last_unstale":"2024-09-12T02:28:24.297246+0000","last_undegraded":"2024-09-12T02:28:24.297246+0000","last_fullsized":"2024-09-12T02:28:24.297246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:51.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297547+0000","last_change":"2024-09-12T02:28:22.470133+0000","last_active":"2024-09-12T02:28:24.297547+0000","last_peered":"2024-09-12T02:28:24.297547+0000","last_clean":"2024-09-12T02:28:24.297547+0000","last_became_active":"2024-09-12T02:28:22.469748+0000","last_became_peered":"2024-09-12T02:28:22.469748+0000","last_unstale":"2024-09-12T02:28:24.297547+0000","last_undegraded":"2024-09-12T02:28:24.297547+0000","last_fullsized":"2024-09-12T02:28:24.297547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297457+0000","last_change":"2024-09-12T02:28:22.466114+0000","last_active":"2024-09-12T02:28:24.297457+0000","last_peered":"2024-09-12T02:28:24.297457+0000","last_clean":"2024-09-12T02:28:24.297457+0000","last_became_active":"2024-09-12T02:28:22.465773+0000","last_became_peered":"2024-09-12T02:28:22.465773+0000","last_unstale":"2024-09-12T02:28:24.297457+0000","last_undegraded":"2024-09-12T02:28:24.297457+0000","last_fullsized":"2024-09-12T02:28:24.297457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.522598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463327+0000","last_change":"2024-09-12T02:28:22.465019+0000","last_active":"2024-09-12T02:28:23.463327+0000","last_peered":"2024-09-12T02:28:23.463327+0000","last_clean":"2024-09-12T02:28:23.463327+0000","last_became_active":"2024-09-12T02:28:22.464751+0000","last_became_peered":"2024-09-12T02:28:22.464751+0000","last_unstale":"2024-09-12T02:28:23.463327+0000","last_undegraded":"2024-09-12T02:28:23.463327+0000","last_fullsized":"2024-09-12T02:28:23.463327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459551+0000","last_change":"2024-09-12T02:28:22.459615+0000","last_active":"2024-09-12T02:28:23.459551+0000","last_peered":"2024-09-12T02:28:23.459551+0000","last_clean":"2024-09-12T02:28:23.459551+0000","last_became_active":"2024-09-12T02:28:22.459342+0000","last_became_peered":"2024-09-12T02:28:22.459342+0000","last_unstale":"2024-09-12T02:28:23.459551+0000","last_undegraded":"2024-09-12T02:28:23.459551+0000","last_fullsized":"2024-09-12T02:28:23.459551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297704+0000","last_change":"2024-09-12T02:28:22.465319+0000","last_active":"2024-09-12T02:28:24.297704+0000","last_peered":"2024-09-12T02:28:24.297704+0000","last_clean":"2024-09-12T02:28:24.297704+0000","last_became_active":"2024-09-12T02:28:22.465059+0000","last_became_peered":"2024-09-12T02:28:22.465059+0000","last_unstale":"2024-09-12T02:28:24.297704+0000","last_undegraded":"2024-09-12T02:28:24.297704+0000","last_fullsized":"2024-09-12T02:28:24.297704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:12.495527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995398+0000","last_change":"2024-09-12T02:28:22.464467+0000","last_active":"2024-09-12T02:28:23.995398+0000","last_peered":"2024-09-12T02:28:23.995398+0000","last_clean":"2024-09-12T02:28:23.995398+0000","last_became_active":"2024-09-12T02:28:22.464145+0000","last_became_peered":"2024-09-12T02:28:22.464145+0000","last_unstale":"2024-09-12T02:28:23.995398+0000","last_undegraded":"2024-09-12T02:28:23.995398+0000","last_fullsized":"2024-09-12T02:28:23.995398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298119+0000","last_change":"2024-09-12T02:28:22.470537+0000","last_active":"2024-09-12T02:28:24.298119+0000","last_peered":"2024-09-12T02:28:24.298119+0000","last_clean":"2024-09-12T02:28:24.298119+0000","last_became_active":"2024-09-12T02:28:22.469350+0000","last_became_peered":"2024-09-12T02:28:22.469350+0000","last_unstale":"2024-09-12T02:28:24.298119+0000","last_undegraded":"2024-09-12T02:28:24.298119+0000","last_fullsized":"2024-09-12T02:28:24.298119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.829525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251249+0000","last_change":"2024-09-12T02:28:22.464994+0000","last_active":"2024-09-12T02:28:24.251249+0000","last_peered":"2024-09-12T02:28:24.251249+0000","last_clean":"2024-09-12T02:28:24.251249+0000","last_became_active":"2024-09-12T02:28:22.464704+0000","last_became_peered":"2024-09-12T02:28:22.464704+0000","last_unstale":"2024-09-12T02:28:24.251249+0000","last_undegraded":"2024-09-12T02:28:24.251249+0000","last_fullsized":"2024-09-12T02:28:24.251249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:32.306382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462749+0000","last_change":"2024-09-12T02:28:22.463462+0000","last_active":"2024-09-12T02:28:23.462749+0000","last_peered":"2024-09-12T02:28:23.462749+0000","last_clean":"2024-09-12T02:28:23.462749+0000","last_became_active":"2024-09-12T02:28:22.463170+0000","last_became_peered":"2024-09-12T02:28:22.463170+0000","last_unstale":"2024-09-12T02:28:23.462749+0000","last_undegraded":"2024-09-12T02:28:23.462749+0000","last_fullsized":"2024-09-12T02:28:23.462749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462660+0000","last_change":"2024-09-12T02:28:22.461255+0000","last_active":"2024-09-12T02:28:23.462660+0000","last_peered":"2024-09-12T02:28:23.462660+0000","last_clean":"2024-09-12T02:28:23.462660+0000","last_became_active":"2024-09-12T02:28:22.460994+0000","last_became_peered":"2024-09-12T02:28:22.460994+0000","last_unstale":"2024-09-12T02:28:23.462660+0000","last_undegraded":"2024-09-12T02:28:23.462660+0000","last_fullsized":"2024-09-12T02:28:23.462660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297624+0000","last_change":"2024-09-12T02:28:21.453139+0000","last_active":"2024-09-12T02:28:24.297624+0000","last_peered":"2024-09-12T02:28:24.297624+0000","last_clean":"2024-09-12T02:28:24.297624+0000","last_became_active":"2024-09-12T02:28:21.452853+0000","last_became_peered":"2024-09-12T02:28:21.452853+0000","last_unstale":"2024-09-12T02:28:24.297624+0000","last_undegraded":"2024-09-12T02:28:24.297624+0000","last_fullsized":"2024-09-12T02:28:24.297624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:26.817704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995580+0000","last_change":"2024-09-12T02:28:22.456228+0000","last_active":"2024-09-12T02:28:23.995580+0000","last_peered":"2024-09-12T02:28:23.995580+0000","last_clean":"2024-09-12T02:28:23.995580+0000","last_became_active":"2024-09-12T02:28:22.455958+0000","last_became_peered":"2024-09-12T02:28:22.455958+0000","last_unstale":"2024-09-12T02:28:23.995580+0000","last_undegraded":"2024-09-12T02:28:23.995580+0000","last_fullsized":"2024-09-12T02:28:23.995580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462800+0000","last_change":"2024-09-12T02:28:21.446775+0000","last_active":"2024-09-12T02:28:23.462800+0000","last_peered":"2024-09-12T02:28:23.462800+0000","last_clean":"2024-09-12T02:28:23.462800+0000","last_became_active":"2024-09-12T02:28:21.446028+0000","last_became_peered":"2024-09-12T02:28:21.446028+0000","last_unstale":"2024-09-12T02:28:23.462800+0000","last_undegraded":"2024-09-12T02:28:23.462800+0000","last_fullsized":"2024-09-12T02:28:23.462800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:12.026922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297505+0000","last_change":"2024-09-12T02:28:21.452793+0000","last_active":"2024-09-12T02:28:24.297505+0000","last_peered":"2024-09-12T02:28:24.297505+0000","last_clean":"2024-09-12T02:28:24.297505+0000","last_became_active":"2024-09-12T02:28:21.452354+0000","last_became_peered":"2024-09-12T02:28:21.452354+0000","last_unstale":"2024-09-12T02:28:24.297505+0000","last_undegraded":"2024-09-12T02:28:24.297505+0000","last_fullsized":"2024-09-12T02:28:24.297505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297229+0000","last_change":"2024-09-12T02:28:22.474976+0000","last_active":"2024-09-12T02:28:24.297229+0000","last_peered":"2024-09-12T02:28:24.297229+0000","last_clean":"2024-09-12T02:28:24.297229+0000","last_became_active":"2024-09-12T02:28:22.474804+0000","last_became_peered":"2024-09-12T02:28:22.474804+0000","last_unstale":"2024-09-12T02:28:24.297229+0000","last_undegraded":"2024-09-12T02:28:24.297229+0000","last_fullsized":"2024-09-12T02:28:24.297229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:27.574862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297594+0000","last_change":"2024-09-12T02:28:21.454569+0000","last_active":"2024-09-12T02:28:24.297594+0000","last_peered":"2024-09-12T02:28:24.297594+0000","last_clean":"2024-09-12T02:28:24.297594+0000","last_became_active":"2024-09-12T02:28:21.453146+0000","last_became_peered":"2024-09-12T02:28:21.453146+0000","last_unstale":"2024-09-12T02:28:24.297594+0000","last_undegraded":"2024-09-12T02:28:24.297594+0000","last_fullsized":"2024-09-12T02:28:24.297594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459516+0000","last_change":"2024-09-12T02:28:22.458922+0000","last_active":"2024-09-12T02:28:23.459516+0000","last_peered":"2024-09-12T02:28:23.459516+0000","last_clean":"2024-09-12T02:28:23.459516+0000","last_became_active":"2024-09-12T02:28:22.458641+0000","last_became_peered":"2024-09-12T02:28:22.458641+0000","last_unstale":"2024-09-12T02:28:23.459516+0000","last_undegraded":"2024-09-12T02:28:23.459516+0000","last_fullsized":"2024-09-12T02:28:23.459516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462939+0000","last_change":"2024-09-12T02:28:21.455322+0000","last_active":"2024-09-12T02:28:23.462939+0000","last_peered":"2024-09-12T02:28:23.462939+0000","last_clean":"2024-09-12T02:28:23.462939+0000","last_became_active":"2024-09-12T02:28:21.455039+0000","last_became_peered":"2024-09-12T02:28:21.455039+0000","last_unstale":"2024-09-12T02:28:23.462939+0000","last_undegraded":"2024-09-12T02:28:23.462939+0000","last_fullsized":"2024-09-12T02:28:23.462939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297881+0000","last_change":"2024-09-12T02:28:22.467660+0000","last_active":"2024-09-12T02:28:24.297881+0000","last_peered":"2024-09-12T02:28:24.297881+0000","last_clean":"2024-09-12T02:28:24.297881+0000","last_became_active":"2024-09-12T02:28:22.467401+0000","last_became_peered":"2024-09-12T02:28:22.467401+0000","last_unstale":"2024-09-12T02:28:24.297881+0000","last_undegraded":"2024-09-12T02:28:24.297881+0000","last_fullsized":"2024-09-12T02:28:24.297881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:28.724885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298375+0000","last_change":"2024-09-12T02:28:21.456883+0000","last_active":"2024-09-12T02:28:24.298375+0000","last_peered":"2024-09-12T02:28:24.298375+0000","last_clean":"2024-09-12T02:28:24.298375+0000","last_became_active":"2024-09-12T02:28:21.456438+0000","last_became_peered":"2024-09-12T02:28:21.456438+0000","last_unstale":"2024-09-12T02:28:24.298375+0000","last_undegraded":"2024-09-12T02:28:24.298375+0000","last_fullsized":"2024-09-12T02:28:24.298375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995535+0000","last_change":"2024-09-12T02:28:22.467768+0000","last_active":"2024-09-12T02:28:23.995535+0000","last_peered":"2024-09-12T02:28:23.995535+0000","last_clean":"2024-09-12T02:28:23.995535+0000","last_became_active":"2024-09-12T02:28:22.467484+0000","last_became_peered":"2024-09-12T02:28:22.467484+0000","last_unstale":"2024-09-12T02:28:23.995535+0000","last_undegraded":"2024-09-12T02:28:23.995535+0000","last_fullsized":"2024-09-12T02:28:23.995535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459611+0000","last_change":"2024-09-12T02:28:21.453336+0000","last_active":"2024-09-12T02:28:23.459611+0000","last_peered":"2024-09-12T02:28:23.459611+0000","last_clean":"2024-09-12T02:28:23.459611+0000","last_became_active":"2024-09-12T02:28:21.453054+0000","last_became_peered":"2024-09-12T02:28:21.453054+0000","last_unstale":"2024-09-12T02:28:23.459611+0000","last_undegraded":"2024-09-12T02:28:23.459611+0000","last_fullsized":"2024-09-12T02:28:23.459611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463389+0000","last_change":"2024-09-12T02:28:22.462579+0000","last_active":"2024-09-12T02:28:23.463389+0000","last_peered":"2024-09-12T02:28:23.463389+0000","last_clean":"2024-09-12T02:28:23.463389+0000","last_became_active":"2024-09-12T02:28:22.462294+0000","last_became_peered":"2024-09-12T02:28:22.462294+0000","last_unstale":"2024-09-12T02:28:23.463389+0000","last_undegraded":"2024-09-12T02:28:23.463389+0000","last_fullsized":"2024-09-12T02:28:23.463389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463174+0000","last_change":"2024-09-12T02:28:21.449013+0000","last_active":"2024-09-12T02:28:23.463174+0000","last_peered":"2024-09-12T02:28:23.463174+0000","last_clean":"2024-09-12T02:28:23.463174+0000","last_became_active":"2024-09-12T02:28:21.448493+0000","last_became_peered":"2024-09-12T02:28:21.448493+0000","last_unstale":"2024-09-12T02:28:23.463174+0000","last_undegraded":"2024-09-12T02:28:23.463174+0000","last_fullsized":"2024-09-12T02:28:23.463174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298568+0000","last_change":"2024-09-12T02:28:22.456742+0000","last_active":"2024-09-12T02:28:24.298568+0000","last_peered":"2024-09-12T02:28:24.298568+0000","last_clean":"2024-09-12T02:28:24.298568+0000","last_became_active":"2024-09-12T02:28:22.456477+0000","last_became_peered":"2024-09-12T02:28:22.456477+0000","last_unstale":"2024-09-12T02:28:24.298568+0000","last_undegraded":"2024-09-12T02:28:24.298568+0000","last_fullsized":"2024-09-12T02:28:24.298568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:52.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995564+0000","last_change":"2024-09-12T02:28:21.461100+0000","last_active":"2024-09-12T02:28:23.995564+0000","last_peered":"2024-09-12T02:28:23.995564+0000","last_clean":"2024-09-12T02:28:23.995564+0000","last_became_active":"2024-09-12T02:28:21.460785+0000","last_became_peered":"2024-09-12T02:28:21.460785+0000","last_unstale":"2024-09-12T02:28:23.995564+0000","last_undegraded":"2024-09-12T02:28:23.995564+0000","last_fullsized":"2024-09-12T02:28:23.995564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:11.030581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995310+0000","last_change":"2024-09-12T02:28:22.461832+0000","last_active":"2024-09-12T02:28:23.995310+0000","last_peered":"2024-09-12T02:28:23.995310+0000","last_clean":"2024-09-12T02:28:23.995310+0000","last_became_active":"2024-09-12T02:28:22.461223+0000","last_became_peered":"2024-09-12T02:28:22.461223+0000","last_unstale":"2024-09-12T02:28:23.995310+0000","last_undegraded":"2024-09-12T02:28:23.995310+0000","last_fullsized":"2024-09-12T02:28:23.995310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298235+0000","last_change":"2024-09-12T02:28:21.454178+0000","last_active":"2024-09-12T02:28:24.298235+0000","last_peered":"2024-09-12T02:28:24.298235+0000","last_clean":"2024-09-12T02:28:24.298235+0000","last_became_active":"2024-09-12T02:28:21.453871+0000","last_became_peered":"2024-09-12T02:28:21.453871+0000","last_unstale":"2024-09-12T02:28:24.298235+0000","last_undegraded":"2024-09-12T02:28:24.298235+0000","last_fullsized":"2024-09-12T02:28:24.298235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298309+0000","last_change":"2024-09-12T02:28:22.459853+0000","last_active":"2024-09-12T02:28:24.298309+0000","last_peered":"2024-09-12T02:28:24.298309+0000","last_clean":"2024-09-12T02:28:24.298309+0000","last_became_active":"2024-09-12T02:28:22.459611+0000","last_became_peered":"2024-09-12T02:28:22.459611+0000","last_unstale":"2024-09-12T02:28:24.298309+0000","last_undegraded":"2024-09-12T02:28:24.298309+0000","last_fullsized":"2024-09-12T02:28:24.298309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.290900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462368+0000","last_change":"2024-09-12T02:28:21.449223+0000","last_active":"2024-09-12T02:28:23.462368+0000","last_peered":"2024-09-12T02:28:23.462368+0000","last_clean":"2024-09-12T02:28:23.462368+0000","last_became_active":"2024-09-12T02:28:21.448650+0000","last_became_peered":"2024-09-12T02:28:21.448650+0000","last_unstale":"2024-09-12T02:28:23.462368+0000","last_undegraded":"2024-09-12T02:28:23.462368+0000","last_fullsized":"2024-09-12T02:28:23.462368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462866+0000","last_change":"2024-09-12T02:28:22.463479+0000","last_active":"2024-09-12T02:28:23.462866+0000","last_peered":"2024-09-12T02:28:23.462866+0000","last_clean":"2024-09-12T02:28:23.462866+0000","last_became_active":"2024-09-12T02:28:22.463208+0000","last_became_peered":"2024-09-12T02:28:22.463208+0000","last_unstale":"2024-09-12T02:28:23.462866+0000","last_undegraded":"2024-09-12T02:28:23.462866+0000","last_fullsized":"2024-09-12T02:28:23.462866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251159+0000","last_change":"2024-09-12T02:28:21.451427+0000","last_active":"2024-09-12T02:28:24.251159+0000","last_peered":"2024-09-12T02:28:24.251159+0000","last_clean":"2024-09-12T02:28:24.251159+0000","last_became_active":"2024-09-12T02:28:21.451124+0000","last_became_peered":"2024-09-12T02:28:21.451124+0000","last_unstale":"2024-09-12T02:28:24.251159+0000","last_undegraded":"2024-09-12T02:28:24.251159+0000","last_fullsized":"2024-09-12T02:28:24.251159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.656183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298014+0000","last_change":"2024-09-12T02:28:22.456047+0000","last_active":"2024-09-12T02:28:24.298014+0000","last_peered":"2024-09-12T02:28:24.298014+0000","last_clean":"2024-09-12T02:28:24.298014+0000","last_became_active":"2024-09-12T02:28:22.455803+0000","last_became_peered":"2024-09-12T02:28:22.455803+0000","last_unstale":"2024-09-12T02:28:24.298014+0000","last_undegraded":"2024-09-12T02:28:24.298014+0000","last_fullsized":"2024-09-12T02:28:24.298014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:50.825935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463657+0000","last_change":"2024-09-12T02:28:21.461510+0000","last_active":"2024-09-12T02:28:23.463657+0000","last_peered":"2024-09-12T02:28:23.463657+0000","last_clean":"2024-09-12T02:28:23.463657+0000","last_became_active":"2024-09-12T02:28:21.461183+0000","last_became_peered":"2024-09-12T02:28:21.461183+0000","last_unstale":"2024-09-12T02:28:23.463657+0000","last_undegraded":"2024-09-12T02:28:23.463657+0000","last_fullsized":"2024-09-12T02:28:23.463657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.909426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298086+0000","last_change":"2024-09-12T02:28:22.459244+0000","last_active":"2024-09-12T02:28:24.298086+0000","last_peered":"2024-09-12T02:28:24.298086+0000","last_clean":"2024-09-12T02:28:24.298086+0000","last_became_active":"2024-09-12T02:28:22.458948+0000","last_became_peered":"2024-09-12T02:28:22.458948+0000","last_unstale":"2024-09-12T02:28:24.298086+0000","last_undegraded":"2024-09-12T02:28:24.298086+0000","last_fullsized":"2024-09-12T02:28:24.298086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.507175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251362+0000","last_change":"2024-09-12T02:28:21.448604+0000","last_active":"2024-09-12T02:28:24.251362+0000","last_peered":"2024-09-12T02:28:24.251362+0000","last_clean":"2024-09-12T02:28:24.251362+0000","last_became_active":"2024-09-12T02:28:21.448165+0000","last_became_peered":"2024-09-12T02:28:21.448165+0000","last_unstale":"2024-09-12T02:28:24.251362+0000","last_undegraded":"2024-09-12T02:28:24.251362+0000","last_fullsized":"2024-09-12T02:28:24.251362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:25.512376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298838+0000","last_change":"2024-09-12T02:28:22.458525+0000","last_active":"2024-09-12T02:28:24.298838+0000","last_peered":"2024-09-12T02:28:24.298838+0000","last_clean":"2024-09-12T02:28:24.298838+0000","last_became_active":"2024-09-12T02:28:22.458270+0000","last_became_peered":"2024-09-12T02:28:22.458270+0000","last_unstale":"2024-09-12T02:28:24.298838+0000","last_undegraded":"2024-09-12T02:28:24.298838+0000","last_fullsized":"2024-09-12T02:28:24.298838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:39.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459647+0000","last_change":"2024-09-12T02:28:21.456310+0000","last_active":"2024-09-12T02:28:23.459647+0000","last_peered":"2024-09-12T02:28:23.459647+0000","last_clean":"2024-09-12T02:28:23.459647+0000","last_became_active":"2024-09-12T02:28:21.455875+0000","last_became_peered":"2024-09-12T02:28:21.455875+0000","last_unstale":"2024-09-12T02:28:23.459647+0000","last_undegraded":"2024-09-12T02:28:23.459647+0000","last_fullsized":"2024-09-12T02:28:23.459647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298346+0000","last_change":"2024-09-12T02:28:22.470690+0000","last_active":"2024-09-12T02:28:24.298346+0000","last_peered":"2024-09-12T02:28:24.298346+0000","last_clean":"2024-09-12T02:28:24.298346+0000","last_became_active":"2024-09-12T02:28:22.469379+0000","last_became_peered":"2024-09-12T02:28:22.469379+0000","last_unstale":"2024-09-12T02:28:24.298346+0000","last_undegraded":"2024-09-12T02:28:24.298346+0000","last_fullsized":"2024-09-12T02:28:24.298346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.893907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251280+0000","last_change":"2024-09-12T02:28:21.451827+0000","last_active":"2024-09-12T02:28:24.251280+0000","last_peered":"2024-09-12T02:28:24.251280+0000","last_clean":"2024-09-12T02:28:24.251280+0000","last_became_active":"2024-09-12T02:28:21.451567+0000","last_became_peered":"2024-09-12T02:28:21.451567+0000","last_unstale":"2024-09-12T02:28:24.251280+0000","last_undegraded":"2024-09-12T02:28:24.251280+0000","last_fullsized":"2024-09-12T02:28:24.251280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298587+0000","last_change":"2024-09-12T02:28:22.468838+0000","last_active":"2024-09-12T02:28:24.298587+0000","last_peered":"2024-09-12T02:28:24.298587+0000","last_clean":"2024-09-12T02:28:24.298587+0000","last_became_active":"2024-09-12T02:28:22.468221+0000","last_became_peered":"2024-09-12T02:28:22.468221+0000","last_unstale":"2024-09-12T02:28:24.298587+0000","last_undegraded":"2024-09-12T02:28:24.298587+0000","last_fullsized":"2024-09-12T02:28:24.298587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.829525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297450+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:28:24.297450+0000","last_peered":"2024-09-12T02:28:24.297450+0000","last_clean":"2024-09-12T02:28:24.297450+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:28:24.297450+0000","last_undegraded":"2024-09-12T02:28:24.297450+0000","last_fullsized":"2024-09-12T02:28:24.297450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298377+0000","last_change":"2024-09-12T02:28:21.456961+0000","last_active":"2024-09-12T02:28:24.298377+0000","last_peered":"2024-09-12T02:28:24.298377+0000","last_clean":"2024-09-12T02:28:24.298377+0000","last_became_active":"2024-09-12T02:28:21.456682+0000","last_became_peered":"2024-09-12T02:28:21.456682+0000","last_unstale":"2024-09-12T02:28:24.298377+0000","last_undegraded":"2024-09-12T02:28:24.298377+0000","last_fullsized":"2024-09-12T02:28:24.298377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297376+0000","last_change":"2024-09-12T02:28:22.468056+0000","last_active":"2024-09-12T02:28:24.297376+0000","last_peered":"2024-09-12T02:28:24.297376+0000","last_clean":"2024-09-12T02:28:24.297376+0000","last_became_active":"2024-09-12T02:28:22.467654+0000","last_became_peered":"2024-09-12T02:28:22.467654+0000","last_unstale":"2024-09-12T02:28:24.297376+0000","last_undegraded":"2024-09-12T02:28:24.297376+0000","last_fullsized":"2024-09-12T02:28:24.297376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:01.840287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297294+0000","last_change":"2024-09-12T02:28:21.462547+0000","last_active":"2024-09-12T02:28:24.297294+0000","last_peered":"2024-09-12T02:28:24.297294+0000","last_clean":"2024-09-12T02:28:24.297294+0000","last_became_active":"2024-09-12T02:28:21.462186+0000","last_became_peered":"2024-09-12T02:28:21.462186+0000","last_unstale":"2024-09-12T02:28:24.297294+0000","last_undegraded":"2024-09-12T02:28:24.297294+0000","last_fullsized":"2024-09-12T02:28:24.297294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995210+0000","last_change":"2024-09-12T02:28:22.457842+0000","last_active":"2024-09-12T02:28:23.995210+0000","last_peered":"2024-09-12T02:28:23.995210+0000","last_clean":"2024-09-12T02:28:23.995210+0000","last_became_active":"2024-09-12T02:28:22.457001+0000","last_became_peered":"2024-09-12T02:28:22.457001+0000","last_unstale":"2024-09-12T02:28:23.995210+0000","last_undegraded":"2024-09-12T02:28:23.995210+0000","last_fullsized":"2024-09-12T02:28:23.995210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251305+0000","last_change":"2024-09-12T02:28:21.449367+0000","last_active":"2024-09-12T02:28:24.251305+0000","last_peered":"2024-09-12T02:28:24.251305+0000","last_clean":"2024-09-12T02:28:24.251305+0000","last_became_active":"2024-09-12T02:28:21.448265+0000","last_became_peered":"2024-09-12T02:28:21.448265+0000","last_unstale":"2024-09-12T02:28:24.251305+0000","last_undegraded":"2024-09-12T02:28:24.251305+0000","last_fullsized":"2024-09-12T02:28:24.251305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:16.640297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459760+0000","last_change":"2024-09-12T02:28:22.458123+0000","last_active":"2024-09-12T02:28:23.459760+0000","last_peered":"2024-09-12T02:28:23.459760+0000","last_clean":"2024-09-12T02:28:23.459760+0000","last_became_active":"2024-09-12T02:28:22.457250+0000","last_became_peered":"2024-09-12T02:28:22.457250+0000","last_unstale":"2024-09-12T02:28:23.459760+0000","last_undegraded":"2024-09-12T02:28:23.459760+0000","last_fullsized":"2024-09-12T02:28:23.459760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298438+0000","last_change":"2024-09-12T02:28:21.457643+0000","last_active":"2024-09-12T02:28:24.298438+0000","last_peered":"2024-09-12T02:28:24.298438+0000","last_clean":"2024-09-12T02:28:24.298438+0000","last_became_active":"2024-09-12T02:28:21.457340+0000","last_became_peered":"2024-09-12T02:28:21.457340+0000","last_unstale":"2024-09-12T02:28:24.298438+0000","last_undegraded":"2024-09-12T02:28:24.298438+0000","last_fullsized":"2024-09-12T02:28:24.298438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462588+0000","last_change":"2024-09-12T02:28:22.466165+0000","last_active":"2024-09-12T02:28:23.462588+0000","last_peered":"2024-09-12T02:28:23.462588+0000","last_clean":"2024-09-12T02:28:23.462588+0000","last_became_active":"2024-09-12T02:28:22.465870+0000","last_became_peered":"2024-09-12T02:28:22.465870+0000","last_unstale":"2024-09-12T02:28:23.462588+0000","last_undegraded":"2024-09-12T02:28:23.462588+0000","last_fullsized":"2024-09-12T02:28:23.462588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:09.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459593+0000","last_change":"2024-09-12T02:28:21.461428+0000","last_active":"2024-09-12T02:28:23.459593+0000","last_peered":"2024-09-12T02:28:23.459593+0000","last_clean":"2024-09-12T02:28:23.459593+0000","last_became_active":"2024-09-12T02:28:21.461117+0000","last_became_peered":"2024-09-12T02:28:21.461117+0000","last_unstale":"2024-09-12T02:28:23.459593+0000","last_undegraded":"2024-09-12T02:28:23.459593+0000","last_fullsized":"2024-09-12T02:28:23.459593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298072+0000","last_change":"2024-09-12T02:28:22.470508+0000","last_active":"2024-09-12T02:28:24.298072+0000","last_peered":"2024-09-12T02:28:24.298072+0000","last_clean":"2024-09-12T02:28:24.298072+0000","last_became_active":"2024-09-12T02:28:22.470220+0000","last_became_peered":"2024-09-12T02:28:22.470220+0000","last_unstale":"2024-09-12T02:28:24.298072+0000","last_undegraded":"2024-09-12T02:28:24.298072+0000","last_fullsized":"2024-09-12T02:28:24.298072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.290900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298806+0000","last_change":"2024-09-12T02:28:21.461899+0000","last_active":"2024-09-12T02:28:24.298806+0000","last_peered":"2024-09-12T02:28:24.298806+0000","last_clean":"2024-09-12T02:28:24.298806+0000","last_became_active":"2024-09-12T02:28:21.461616+0000","last_became_peered":"2024-09-12T02:28:21.461616+0000","last_unstale":"2024-09-12T02:28:24.298806+0000","last_undegraded":"2024-09-12T02:28:24.298806+0000","last_fullsized":"2024-09-12T02:28:24.298806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:55.870005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459550+0000","last_change":"2024-09-12T02:28:22.458683+0000","last_active":"2024-09-12T02:28:23.459550+0000","last_peered":"2024-09-12T02:28:23.459550+0000","last_clean":"2024-09-12T02:28:23.459550+0000","last_became_active":"2024-09-12T02:28:22.458413+0000","last_became_peered":"2024-09-12T02:28:22.458413+0000","last_unstale":"2024-09-12T02:28:23.459550+0000","last_undegraded":"2024-09-12T02:28:23.459550+0000","last_fullsized":"2024-09-12T02:28:23.459550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459717+0000","last_change":"2024-09-12T02:28:21.455450+0000","last_active":"2024-09-12T02:28:23.459717+0000","last_peered":"2024-09-12T02:28:23.459717+0000","last_clean":"2024-09-12T02:28:23.459717+0000","last_became_active":"2024-09-12T02:28:21.455128+0000","last_became_peered":"2024-09-12T02:28:21.455128+0000","last_unstale":"2024-09-12T02:28:23.459717+0000","last_undegraded":"2024-09-12T02:28:23.459717+0000","last_fullsized":"2024-09-12T02:28:23.459717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297588+0000","last_change":"2024-09-12T02:28:22.464804+0000","last_active":"2024-09-12T02:28:24.297588+0000","last_peered":"2024-09-12T02:28:24.297588+0000","last_clean":"2024-09-12T02:28:24.297588+0000","last_became_active":"2024-09-12T02:28:22.464515+0000","last_became_peered":"2024-09-12T02:28:22.464515+0000","last_unstale":"2024-09-12T02:28:24.297588+0000","last_undegraded":"2024-09-12T02:28:24.297588+0000","last_fullsized":"2024-09-12T02:28:24.297588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.429495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463010+0000","last_change":"2024-09-12T02:28:21.457754+0000","last_active":"2024-09-12T02:28:23.463010+0000","last_peered":"2024-09-12T02:28:23.463010+0000","last_clean":"2024-09-12T02:28:23.463010+0000","last_became_active":"2024-09-12T02:28:21.457443+0000","last_became_peered":"2024-09-12T02:28:21.457443+0000","last_unstale":"2024-09-12T02:28:23.463010+0000","last_undegraded":"2024-09-12T02:28:23.463010+0000","last_fullsized":"2024-09-12T02:28:23.463010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995496+0000","last_change":"2024-09-12T02:28:22.463795+0000","last_active":"2024-09-12T02:28:23.995496+0000","last_peered":"2024-09-12T02:28:23.995496+0000","last_clean":"2024-09-12T02:28:23.995496+0000","last_became_active":"2024-09-12T02:28:22.463408+0000","last_became_peered":"2024-09-12T02:28:22.463408+0000","last_unstale":"2024-09-12T02:28:23.995496+0000","last_undegraded":"2024-09-12T02:28:23.995496+0000","last_fullsized":"2024-09-12T02:28:23.995496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297286+0000","last_change":"2024-09-12T02:28:21.462250+0000","last_active":"2024-09-12T02:28:24.297286+0000","last_peered":"2024-09-12T02:28:24.297286+0000","last_clean":"2024-09-12T02:28:24.297286+0000","last_became_active":"2024-09-12T02:28:21.461734+0000","last_became_peered":"2024-09-12T02:28:21.461734+0000","last_unstale":"2024-09-12T02:28:24.297286+0000","last_undegraded":"2024-09-12T02:28:24.297286+0000","last_fullsized":"2024-09-12T02:28:24.297286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:27.705966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462792+0000","last_change":"2024-09-12T02:28:22.459098+0000","last_active":"2024-09-12T02:28:23.462792+0000","last_peered":"2024-09-12T02:28:23.462792+0000","last_clean":"2024-09-12T02:28:23.462792+0000","last_became_active":"2024-09-12T02:28:22.457658+0000","last_became_peered":"2024-09-12T02:28:22.457658+0000","last_unstale":"2024-09-12T02:28:23.462792+0000","last_undegraded":"2024-09-12T02:28:23.462792+0000","last_fullsized":"2024-09-12T02:28:23.462792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459625+0000","last_change":"2024-09-12T02:28:21.457547+0000","last_active":"2024-09-12T02:28:23.459625+0000","last_peered":"2024-09-12T02:28:23.459625+0000","last_clean":"2024-09-12T02:28:23.459625+0000","last_became_active":"2024-09-12T02:28:21.457263+0000","last_became_peered":"2024-09-12T02:28:21.457263+0000","last_unstale":"2024-09-12T02:28:23.459625+0000","last_undegraded":"2024-09-12T02:28:23.459625+0000","last_fullsized":"2024-09-12T02:28:23.459625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297338+0000","last_change":"2024-09-12T02:28:22.459832+0000","last_active":"2024-09-12T02:28:24.297338+0000","last_peered":"2024-09-12T02:28:24.297338+0000","last_clean":"2024-09-12T02:28:24.297338+0000","last_became_active":"2024-09-12T02:28:22.459559+0000","last_became_peered":"2024-09-12T02:28:22.459559+0000","last_unstale":"2024-09-12T02:28:24.297338+0000","last_undegraded":"2024-09-12T02:28:24.297338+0000","last_fullsized":"2024-09-12T02:28:24.297338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.382251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459771+0000","last_change":"2024-09-12T02:28:21.454638+0000","last_active":"2024-09-12T02:28:23.459771+0000","last_peered":"2024-09-12T02:28:23.459771+0000","last_clean":"2024-09-12T02:28:23.459771+0000","last_became_active":"2024-09-12T02:28:21.454339+0000","last_became_peered":"2024-09-12T02:28:21.454339+0000","last_unstale":"2024-09-12T02:28:23.459771+0000","last_undegraded":"2024-09-12T02:28:23.459771+0000","last_fullsized":"2024-09-12T02:28:23.459771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297506+0000","last_change":"2024-09-12T02:28:22.475121+0000","last_active":"2024-09-12T02:28:24.297506+0000","last_peered":"2024-09-12T02:28:24.297506+0000","last_clean":"2024-09-12T02:28:24.297506+0000","last_became_active":"2024-09-12T02:28:22.474844+0000","last_became_peered":"2024-09-12T02:28:22.474844+0000","last_unstale":"2024-09-12T02:28:24.297506+0000","last_undegraded":"2024-09-12T02:28:24.297506+0000","last_fullsized":"2024-09-12T02:28:24.297506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:19.714606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298384+0000","last_change":"2024-09-12T02:28:21.462703+0000","last_active":"2024-09-12T02:28:24.298384+0000","last_peered":"2024-09-12T02:28:24.298384+0000","last_clean":"2024-09-12T02:28:24.298384+0000","last_became_active":"2024-09-12T02:28:21.462354+0000","last_became_peered":"2024-09-12T02:28:21.462354+0000","last_unstale":"2024-09-12T02:28:24.298384+0000","last_undegraded":"2024-09-12T02:28:24.298384+0000","last_fullsized":"2024-09-12T02:28:24.298384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:45.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462696+0000","last_change":"2024-09-12T02:28:22.465703+0000","last_active":"2024-09-12T02:28:23.462696+0000","last_peered":"2024-09-12T02:28:23.462696+0000","last_clean":"2024-09-12T02:28:23.462696+0000","last_became_active":"2024-09-12T02:28:22.465439+0000","last_became_peered":"2024-09-12T02:28:22.465439+0000","last_unstale":"2024-09-12T02:28:23.462696+0000","last_undegraded":"2024-09-12T02:28:23.462696+0000","last_fullsized":"2024-09-12T02:28:23.462696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297890+0000","last_change":"2024-09-12T02:28:22.464376+0000","last_active":"2024-09-12T02:28:24.297890+0000","last_peered":"2024-09-12T02:28:24.297890+0000","last_clean":"2024-09-12T02:28:24.297890+0000","last_became_active":"2024-09-12T02:28:22.464058+0000","last_became_peered":"2024-09-12T02:28:22.464058+0000","last_unstale":"2024-09-12T02:28:24.297890+0000","last_undegraded":"2024-09-12T02:28:24.297890+0000","last_fullsized":"2024-09-12T02:28:24.297890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:50.825935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297772+0000","last_change":"2024-09-12T02:28:21.459499+0000","last_active":"2024-09-12T02:28:24.297772+0000","last_peered":"2024-09-12T02:28:24.297772+0000","last_clean":"2024-09-12T02:28:24.297772+0000","last_became_active":"2024-09-12T02:28:21.459190+0000","last_became_peered":"2024-09-12T02:28:21.459190+0000","last_unstale":"2024-09-12T02:28:24.297772+0000","last_undegraded":"2024-09-12T02:28:24.297772+0000","last_fullsized":"2024-09-12T02:28:24.297772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298200+0000","last_change":"2024-09-12T02:28:22.467912+0000","last_active":"2024-09-12T02:28:24.298200+0000","last_peered":"2024-09-12T02:28:24.298200+0000","last_clean":"2024-09-12T02:28:24.298200+0000","last_became_active":"2024-09-12T02:28:22.467615+0000","last_became_peered":"2024-09-12T02:28:22.467615+0000","last_unstale":"2024-09-12T02:28:24.298200+0000","last_undegraded":"2024-09-12T02:28:24.298200+0000","last_fullsized":"2024-09-12T02:28:24.298200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:52.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298701+0000","last_change":"2024-09-12T02:28:21.462426+0000","last_active":"2024-09-12T02:28:24.298701+0000","last_peered":"2024-09-12T02:28:24.298701+0000","last_clean":"2024-09-12T02:28:24.298701+0000","last_became_active":"2024-09-12T02:28:21.462107+0000","last_became_peered":"2024-09-12T02:28:21.462107+0000","last_unstale":"2024-09-12T02:28:24.298701+0000","last_undegraded":"2024-09-12T02:28:24.298701+0000","last_fullsized":"2024-09-12T02:28:24.298701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:08.206286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995479+0000","last_change":"2024-09-12T02:28:22.468618+0000","last_active":"2024-09-12T02:28:23.995479+0000","last_peered":"2024-09-12T02:28:23.995479+0000","last_clean":"2024-09-12T02:28:23.995479+0000","last_became_active":"2024-09-12T02:28:22.468188+0000","last_became_peered":"2024-09-12T02:28:22.468188+0000","last_unstale":"2024-09-12T02:28:23.995479+0000","last_undegraded":"2024-09-12T02:28:23.995479+0000","last_fullsized":"2024-09-12T02:28:23.995479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297499+0000","last_change":"2024-09-12T02:28:21.462214+0000","last_active":"2024-09-12T02:28:24.297499+0000","last_peered":"2024-09-12T02:28:24.297499+0000","last_clean":"2024-09-12T02:28:24.297499+0000","last_became_active":"2024-09-12T02:28:21.461911+0000","last_became_peered":"2024-09-12T02:28:21.461911+0000","last_unstale":"2024-09-12T02:28:24.297499+0000","last_undegraded":"2024-09-12T02:28:24.297499+0000","last_fullsized":"2024-09-12T02:28:24.297499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.656183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297467+0000","last_change":"2024-09-12T02:28:22.463363+0000","last_active":"2024-09-12T02:28:24.297467+0000","last_peered":"2024-09-12T02:28:24.297467+0000","last_clean":"2024-09-12T02:28:24.297467+0000","last_became_active":"2024-09-12T02:28:22.463101+0000","last_became_peered":"2024-09-12T02:28:22.463101+0000","last_unstale":"2024-09-12T02:28:24.297467+0000","last_undegraded":"2024-09-12T02:28:24.297467+0000","last_fullsized":"2024-09-12T02:28:24.297467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.463443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995570+0000","last_change":"2024-09-12T02:28:21.461271+0000","last_active":"2024-09-12T02:28:23.995570+0000","last_peered":"2024-09-12T02:28:23.995570+0000","last_clean":"2024-09-12T02:28:23.995570+0000","last_became_active":"2024-09-12T02:28:21.460986+0000","last_became_peered":"2024-09-12T02:28:21.460986+0000","last_unstale":"2024-09-12T02:28:23.995570+0000","last_undegraded":"2024-09-12T02:28:23.995570+0000","last_fullsized":"2024-09-12T02:28:23.995570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:58.924252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":662973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:28:33.969 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:28:34.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.104+0000 7fd36f827640 1 Processor -- start 2024-09-12T02:28:34.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.104+0000 7fd36f827640 1 -- start start 2024-09-12T02:28:34.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd36f827640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd36815eab0 0x7fd36806d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd36f827640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3680d17e0 con 0x7fd3680d3480 2024-09-12T02:28:34.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd36f827640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3680cfc10 con 0x7fd36806dae0 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd36f827640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd3680d09d0 con 0x7fd36815eab0 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd36ddc4640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd3680d3480 0x7fd3680b8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54444/0 (socket says 172.21.15.181:54444) 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd36ddc4640 1 -- 172.21.15.181:0/2853897752 learned_addr learned my addr 172.21.15.181:0/2853897752 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd36d5c3640 1 --2- 172.21.15.181:0/2853897752 >> v2:172.21.15.204:3300/0 conn(0x7fd36815eab0 0x7fd36806d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238495781 0 0) 0x7fd3680d17e0 con 0x7fd3680d3480 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.105+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd354003520 con 0x7fd3680d3480 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1831220631 0 0) 0x7fd354003520 con 0x7fd3680d3480 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 >> v2:172.21.15.204:3300/0 conn(0x7fd36815eab0 msgr2=0x7fd36806d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 --2- 172.21.15.181:0/2853897752 >> v2:172.21.15.204:3300/0 conn(0x7fd36815eab0 0x7fd36806d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 >> v1:172.21.15.204:6789/0 conn(0x7fd36806dae0 legacy=0x7fd3680b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3680cfef0 con 0x7fd3680d3480 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fd3600019f0 con 0x7fd3680d3480 2024-09-12T02:28:34.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 >> v1:172.21.15.181:6789/0 conn(0x7fd3680d3480 legacy=0x7fd3680b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3540039b0 0x7fd354003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd354004800 0x7fd354004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3540051c0 0x7fd35400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680d09d0 con 0x7fd354004800 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd35400c070 con 0x7fd3540051c0 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd35400c270 con 0x7fd3540039b0 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36cdc2640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd354004800 0x7fd354004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36ddc4640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3540051c0 0x7fd35400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36d5c3640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3540039b0 0x7fd354003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36cdc2640 1 -- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3540039b0 msgr2=0x7fd354003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36cdc2640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3540039b0 0x7fd354003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36cdc2640 1 -- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3540051c0 msgr2=0x7fd35400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36cdc2640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3540051c0 0x7fd35400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36ddc4640 1 -- 172.21.15.181:0/2853897752 reap_dead start 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.106+0000 7fd36cdc2640 1 -- 172.21.15.181:0/2853897752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd354003520 con 0x7fd354004800 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd36cdc2640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd354004800 0x7fd354004c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd358001750 tx=0x7fd354005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c1bce95bad1f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358001370 con 0x7fd354004800 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3580052d0 con 0x7fd354004800 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd35ffff640 1 -- 172.21.15.181:0/2853897752 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35802abc0 con 0x7fd354004800 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd36f827640 1 -- 172.21.15.181:0/2853897752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd354004800 msgr2=0x7fd354004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd36f827640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd354004800 0x7fd354004c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd358001750 tx=0x7fd354005830 comp rx=0 tx=0).stop 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd36f827640 1 -- 172.21.15.181:0/2853897752 shutdown_connections 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd36f827640 1 --2- 172.21.15.181:0/2853897752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd354004800 0x7fd354004c80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.107+0000 7fd36f827640 1 -- 172.21.15.181:0/2853897752 >> 172.21.15.181:0/2853897752 conn(0x7fd3680d4b30 msgr2=0x7fd3680d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.108+0000 7fd36f827640 1 -- 172.21.15.181:0/2853897752 shutdown_connections 2024-09-12T02:28:34.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.108+0000 7fd36f827640 1 -- 172.21.15.181:0/2853897752 wait complete. 2024-09-12T02:28:34.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 Processor -- start 2024-09-12T02:28:34.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 -- start start 2024-09-12T02:28:34.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd354004800 0x7fd368157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd368159910 0x7fd3681615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd368159d90 0x7fd368161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd36806df20 con 0x7fd368159d90 2024-09-12T02:28:34.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd36815ee90 con 0x7fd368159910 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36f827640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd3680d04b0 con 0x7fd354004800 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36ddc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd368159d90 0x7fd368161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36ddc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd368159d90 0x7fd368161af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52024/0 (socket says 172.21.15.181:52024) 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.109+0000 7fd36ddc4640 1 -- 172.21.15.181:0/311009467 learned_addr learned my addr 172.21.15.181:0/311009467 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36ddc4640 1 -- 172.21.15.181:0/311009467 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd354004800 msgr2=0x7fd368157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36ddc4640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd354004800 0x7fd368157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36ddc4640 1 -- 172.21.15.181:0/311009467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd368159910 msgr2=0x7fd3681615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36ddc4640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd368159910 0x7fd3681615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36ddc4640 1 -- 172.21.15.181:0/311009467 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36815aee0 con 0x7fd368159d90 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36ddc4640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd368159d90 0x7fd368161af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b3ef0 tx=0x7fd360007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd35dffb640 1 -- 172.21.15.181:0/311009467 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36000ab60 con 0x7fd368159d90 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd35dffb640 1 -- 172.21.15.181:0/311009467 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd360019070 con 0x7fd368159d90 2024-09-12T02:28:34.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd35dffb640 1 -- 172.21.15.181:0/311009467 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3600133f0 con 0x7fd368159d90 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36815a360 con 0x7fd368159d90 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.110+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36815a920 con 0x7fd368159d90 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.111+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3680b7760 con 0x7fd368159d90 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.112+0000 7fd35dffb640 1 -- 172.21.15.181:0/311009467 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd360013590 con 0x7fd368159d90 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.112+0000 7fd35dffb640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd34c06be30 0x7fd34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.112+0000 7fd36d5c3640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd34c06be30 0x7fd34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.112+0000 7fd35dffb640 1 -- 172.21.15.181:0/311009467 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd36008b410 con 0x7fd368159d90 2024-09-12T02:28:34.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.113+0000 7fd36d5c3640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd34c06be30 0x7fd34c06e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd364006b10 tx=0x7fd364006aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.117+0000 7fd35dffb640 1 -- 172.21.15.181:0/311009467 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3680b7760 con 0x7fd368159d90 2024-09-12T02:28:34.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.278+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3680d17e0 con 0x7fd34c06be30 2024-09-12T02:28:34.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.284+0000 7fd35dffb640 1 -- 172.21.15.181:0/311009467 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251830 (secure 0 0 0) 0x7fd3680d17e0 con 0x7fd34c06be30 2024-09-12T02:28:34.287 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:34.288 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd34c06be30 msgr2=0x7fd34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd34c06be30 0x7fd34c06e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd364006b10 tx=0x7fd364006aa0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd368159d90 msgr2=0x7fd368161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd368159d90 0x7fd368161af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b3ef0 tx=0x7fd360007b00 comp rx=0 tx=0).stop 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 shutdown_connections 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd34c06be30 0x7fd34c06e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd368159910 0x7fd3681615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd368159d90 0x7fd368161af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 --2- 172.21.15.181:0/311009467 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd354004800 0x7fd368157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 >> 172.21.15.181:0/311009467 conn(0x7fd3680d4b30 msgr2=0x7fd3680ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 shutdown_connections 2024-09-12T02:28:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.287+0000 7fd36f827640 1 -- 172.21.15.181:0/311009467 wait complete. 2024-09-12T02:28:34.298 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T02:28:33.614390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2924544,"data_stored":1761292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.156401"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298690+0000","last_change":"2024-09-12T02:28:22.461189+0000","last_active":"2024-09-12T02:28:24.298690+0000","last_peered":"2024-09-12T02:28:24.298690+0000","last_clean":"2024-09-12T02:28:24.298690+0000","last_became_active":"2024-09-12T02:28:22.460880+0000","last_became_peered":"2024-09-12T02:28:22.460880+0000","last_unstale":"2024-09-12T02:28:24.298690+0000","last_undegraded":"2024-09-12T02:28:24.298690+0000","last_fullsized":"2024-09-12T02:28:24.298690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.893907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459714+0000","last_change":"2024-09-12T02:28:22.462152+0000","last_active":"2024-09-12T02:28:23.459714+0000","last_peered":"2024-09-12T02:28:23.459714+0000","last_clean":"2024-09-12T02:28:23.459714+0000","last_became_active":"2024-09-12T02:28:22.461892+0000","last_became_peered":"2024-09-12T02:28:22.461892+0000","last_unstale":"2024-09-12T02:28:23.459714+0000","last_undegraded":"2024-09-12T02:28:23.459714+0000","last_fullsized":"2024-09-12T02:28:23.459714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995437+0000","last_change":"2024-09-12T02:28:22.456793+0000","last_active":"2024-09-12T02:28:23.995437+0000","last_peered":"2024-09-12T02:28:23.995437+0000","last_clean":"2024-09-12T02:28:23.995437+0000","last_became_active":"2024-09-12T02:28:22.456542+0000","last_became_peered":"2024-09-12T02:28:22.456542+0000","last_unstale":"2024-09-12T02:28:23.995437+0000","last_undegraded":"2024-09-12T02:28:23.995437+0000","last_fullsized":"2024-09-12T02:28:23.995437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298035+0000","last_change":"2024-09-12T02:28:22.470469+0000","last_active":"2024-09-12T02:28:24.298035+0000","last_peered":"2024-09-12T02:28:24.298035+0000","last_clean":"2024-09-12T02:28:24.298035+0000","last_became_active":"2024-09-12T02:28:22.470021+0000","last_became_peered":"2024-09-12T02:28:22.470021+0000","last_unstale":"2024-09-12T02:28:24.298035+0000","last_undegraded":"2024-09-12T02:28:24.298035+0000","last_fullsized":"2024-09-12T02:28:24.298035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:24.316527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298202+0000","last_change":"2024-09-12T02:28:22.457601+0000","last_active":"2024-09-12T02:28:24.298202+0000","last_peered":"2024-09-12T02:28:24.298202+0000","last_clean":"2024-09-12T02:28:24.298202+0000","last_became_active":"2024-09-12T02:28:22.454545+0000","last_became_peered":"2024-09-12T02:28:22.454545+0000","last_unstale":"2024-09-12T02:28:24.298202+0000","last_undegraded":"2024-09-12T02:28:24.298202+0000","last_fullsized":"2024-09-12T02:28:24.298202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:24.316527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297761+0000","last_change":"2024-09-12T02:28:22.475342+0000","last_active":"2024-09-12T02:28:24.297761+0000","last_peered":"2024-09-12T02:28:24.297761+0000","last_clean":"2024-09-12T02:28:24.297761+0000","last_became_active":"2024-09-12T02:28:22.475064+0000","last_became_peered":"2024-09-12T02:28:22.475064+0000","last_unstale":"2024-09-12T02:28:24.297761+0000","last_undegraded":"2024-09-12T02:28:24.297761+0000","last_fullsized":"2024-09-12T02:28:24.297761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.987815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297419+0000","last_change":"2024-09-12T02:28:22.462932+0000","last_active":"2024-09-12T02:28:24.297419+0000","last_peered":"2024-09-12T02:28:24.297419+0000","last_clean":"2024-09-12T02:28:24.297419+0000","last_became_active":"2024-09-12T02:28:22.462608+0000","last_became_peered":"2024-09-12T02:28:22.462608+0000","last_unstale":"2024-09-12T02:28:24.297419+0000","last_undegraded":"2024-09-12T02:28:24.297419+0000","last_fullsized":"2024-09-12T02:28:24.297419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:28.724885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297146+0000","last_change":"2024-09-12T02:28:22.467818+0000","last_active":"2024-09-12T02:28:24.297146+0000","last_peered":"2024-09-12T02:28:24.297146+0000","last_clean":"2024-09-12T02:28:24.297146+0000","last_became_active":"2024-09-12T02:28:22.467560+0000","last_became_peered":"2024-09-12T02:28:22.467560+0000","last_unstale":"2024-09-12T02:28:24.297146+0000","last_undegraded":"2024-09-12T02:28:24.297146+0000","last_fullsized":"2024-09-12T02:28:24.297146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.908086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298706+0000","last_change":"2024-09-12T02:28:22.464802+0000","last_active":"2024-09-12T02:28:24.298706+0000","last_peered":"2024-09-12T02:28:24.298706+0000","last_clean":"2024-09-12T02:28:24.298706+0000","last_became_active":"2024-09-12T02:28:22.464518+0000","last_became_peered":"2024-09-12T02:28:22.464518+0000","last_unstale":"2024-09-12T02:28:24.298706+0000","last_undegraded":"2024-09-12T02:28:24.298706+0000","last_fullsized":"2024-09-12T02:28:24.298706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:30.326182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463284+0000","last_change":"2024-09-12T02:28:22.467874+0000","last_active":"2024-09-12T02:28:23.463284+0000","last_peered":"2024-09-12T02:28:23.463284+0000","last_clean":"2024-09-12T02:28:23.463284+0000","last_became_active":"2024-09-12T02:28:22.467350+0000","last_became_peered":"2024-09-12T02:28:22.467350+0000","last_unstale":"2024-09-12T02:28:23.463284+0000","last_undegraded":"2024-09-12T02:28:23.463284+0000","last_fullsized":"2024-09-12T02:28:23.463284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462468+0000","last_change":"2024-09-12T02:28:22.468202+0000","last_active":"2024-09-12T02:28:23.462468+0000","last_peered":"2024-09-12T02:28:23.462468+0000","last_clean":"2024-09-12T02:28:23.462468+0000","last_became_active":"2024-09-12T02:28:22.467913+0000","last_became_peered":"2024-09-12T02:28:22.467913+0000","last_unstale":"2024-09-12T02:28:23.462468+0000","last_undegraded":"2024-09-12T02:28:23.462468+0000","last_fullsized":"2024-09-12T02:28:23.462468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463228+0000","last_change":"2024-09-12T02:28:22.460598+0000","last_active":"2024-09-12T02:28:23.463228+0000","last_peered":"2024-09-12T02:28:23.463228+0000","last_clean":"2024-09-12T02:28:23.463228+0000","last_became_active":"2024-09-12T02:28:22.460325+0000","last_became_peered":"2024-09-12T02:28:22.460325+0000","last_unstale":"2024-09-12T02:28:23.463228+0000","last_undegraded":"2024-09-12T02:28:23.463228+0000","last_fullsized":"2024-09-12T02:28:23.463228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.210731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297437+0000","last_change":"2024-09-12T02:28:22.462576+0000","last_active":"2024-09-12T02:28:24.297437+0000","last_peered":"2024-09-12T02:28:24.297437+0000","last_clean":"2024-09-12T02:28:24.297437+0000","last_became_active":"2024-09-12T02:28:22.461457+0000","last_became_peered":"2024-09-12T02:28:22.461457+0000","last_unstale":"2024-09-12T02:28:24.297437+0000","last_undegraded":"2024-09-12T02:28:24.297437+0000","last_fullsized":"2024-09-12T02:28:24.297437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:26.973561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995232+0000","last_change":"2024-09-12T02:28:22.462049+0000","last_active":"2024-09-12T02:28:23.995232+0000","last_peered":"2024-09-12T02:28:23.995232+0000","last_clean":"2024-09-12T02:28:23.995232+0000","last_became_active":"2024-09-12T02:28:22.461571+0000","last_became_peered":"2024-09-12T02:28:22.461571+0000","last_unstale":"2024-09-12T02:28:23.995232+0000","last_undegraded":"2024-09-12T02:28:23.995232+0000","last_fullsized":"2024-09-12T02:28:23.995232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:21.655140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459520+0000","last_change":"2024-09-12T02:28:22.463467+0000","last_active":"2024-09-12T02:28:23.459520+0000","last_peered":"2024-09-12T02:28:23.459520+0000","last_clean":"2024-09-12T02:28:23.459520+0000","last_became_active":"2024-09-12T02:28:22.463205+0000","last_became_peered":"2024-09-12T02:28:22.463205+0000","last_unstale":"2024-09-12T02:28:23.459520+0000","last_undegraded":"2024-09-12T02:28:23.459520+0000","last_fullsized":"2024-09-12T02:28:23.459520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297481+0000","last_change":"2024-09-12T02:28:22.475573+0000","last_active":"2024-09-12T02:28:24.297481+0000","last_peered":"2024-09-12T02:28:24.297481+0000","last_clean":"2024-09-12T02:28:24.297481+0000","last_became_active":"2024-09-12T02:28:22.475311+0000","last_became_peered":"2024-09-12T02:28:22.475311+0000","last_unstale":"2024-09-12T02:28:24.297481+0000","last_undegraded":"2024-09-12T02:28:24.297481+0000","last_fullsized":"2024-09-12T02:28:24.297481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298512+0000","last_change":"2024-09-12T02:28:22.468036+0000","last_active":"2024-09-12T02:28:24.298512+0000","last_peered":"2024-09-12T02:28:24.298512+0000","last_clean":"2024-09-12T02:28:24.298512+0000","last_became_active":"2024-09-12T02:28:22.467611+0000","last_became_peered":"2024-09-12T02:28:22.467611+0000","last_unstale":"2024-09-12T02:28:24.298512+0000","last_undegraded":"2024-09-12T02:28:24.298512+0000","last_fullsized":"2024-09-12T02:28:24.298512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:30.326182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251391+0000","last_change":"2024-09-12T02:28:22.459062+0000","last_active":"2024-09-12T02:28:24.251391+0000","last_peered":"2024-09-12T02:28:24.251391+0000","last_clean":"2024-09-12T02:28:24.251391+0000","last_became_active":"2024-09-12T02:28:22.458792+0000","last_became_peered":"2024-09-12T02:28:22.458792+0000","last_unstale":"2024-09-12T02:28:24.251391+0000","last_undegraded":"2024-09-12T02:28:24.251391+0000","last_fullsized":"2024-09-12T02:28:24.251391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:25.142485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298786+0000","last_change":"2024-09-12T02:28:22.455655+0000","last_active":"2024-09-12T02:28:24.298786+0000","last_peered":"2024-09-12T02:28:24.298786+0000","last_clean":"2024-09-12T02:28:24.298786+0000","last_became_active":"2024-09-12T02:28:22.454802+0000","last_became_peered":"2024-09-12T02:28:22.454802+0000","last_unstale":"2024-09-12T02:28:24.298786+0000","last_undegraded":"2024-09-12T02:28:24.298786+0000","last_fullsized":"2024-09-12T02:28:24.298786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:44.397727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463379+0000","last_change":"2024-09-12T02:28:22.464688+0000","last_active":"2024-09-12T02:28:23.463379+0000","last_peered":"2024-09-12T02:28:23.463379+0000","last_clean":"2024-09-12T02:28:23.463379+0000","last_became_active":"2024-09-12T02:28:22.464285+0000","last_became_peered":"2024-09-12T02:28:22.464285+0000","last_unstale":"2024-09-12T02:28:23.463379+0000","last_undegraded":"2024-09-12T02:28:23.463379+0000","last_fullsized":"2024-09-12T02:28:23.463379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995368+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:23.995368+0000","last_peered":"2024-09-12T02:28:23.995368+0000","last_clean":"2024-09-12T02:28:23.995368+0000","last_became_active":"2024-09-12T02:28:22.464320+0000","last_became_peered":"2024-09-12T02:28:22.464320+0000","last_unstale":"2024-09-12T02:28:23.995368+0000","last_undegraded":"2024-09-12T02:28:23.995368+0000","last_fullsized":"2024-09-12T02:28:23.995368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297938+0000","last_change":"2024-09-12T02:28:22.467576+0000","last_active":"2024-09-12T02:28:24.297938+0000","last_peered":"2024-09-12T02:28:24.297938+0000","last_clean":"2024-09-12T02:28:24.297938+0000","last_became_active":"2024-09-12T02:28:22.467297+0000","last_became_peered":"2024-09-12T02:28:22.467297+0000","last_unstale":"2024-09-12T02:28:24.297938+0000","last_undegraded":"2024-09-12T02:28:24.297938+0000","last_fullsized":"2024-09-12T02:28:24.297938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.507175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297246+0000","last_change":"2024-09-12T02:28:22.464664+0000","last_active":"2024-09-12T02:28:24.297246+0000","last_peered":"2024-09-12T02:28:24.297246+0000","last_clean":"2024-09-12T02:28:24.297246+0000","last_became_active":"2024-09-12T02:28:22.464373+0000","last_became_peered":"2024-09-12T02:28:22.464373+0000","last_unstale":"2024-09-12T02:28:24.297246+0000","last_undegraded":"2024-09-12T02:28:24.297246+0000","last_fullsized":"2024-09-12T02:28:24.297246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:51.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297547+0000","last_change":"2024-09-12T02:28:22.470133+0000","last_active":"2024-09-12T02:28:24.297547+0000","last_peered":"2024-09-12T02:28:24.297547+0000","last_clean":"2024-09-12T02:28:24.297547+0000","last_became_active":"2024-09-12T02:28:22.469748+0000","last_became_peered":"2024-09-12T02:28:22.469748+0000","last_unstale":"2024-09-12T02:28:24.297547+0000","last_undegraded":"2024-09-12T02:28:24.297547+0000","last_fullsized":"2024-09-12T02:28:24.297547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297457+0000","last_change":"2024-09-12T02:28:22.466114+0000","last_active":"2024-09-12T02:28:24.297457+0000","last_peered":"2024-09-12T02:28:24.297457+0000","last_clean":"2024-09-12T02:28:24.297457+0000","last_became_active":"2024-09-12T02:28:22.465773+0000","last_became_peered":"2024-09-12T02:28:22.465773+0000","last_unstale":"2024-09-12T02:28:24.297457+0000","last_undegraded":"2024-09-12T02:28:24.297457+0000","last_fullsized":"2024-09-12T02:28:24.297457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.522598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463327+0000","last_change":"2024-09-12T02:28:22.465019+0000","last_active":"2024-09-12T02:28:23.463327+0000","last_peered":"2024-09-12T02:28:23.463327+0000","last_clean":"2024-09-12T02:28:23.463327+0000","last_became_active":"2024-09-12T02:28:22.464751+0000","last_became_peered":"2024-09-12T02:28:22.464751+0000","last_unstale":"2024-09-12T02:28:23.463327+0000","last_undegraded":"2024-09-12T02:28:23.463327+0000","last_fullsized":"2024-09-12T02:28:23.463327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459551+0000","last_change":"2024-09-12T02:28:22.459615+0000","last_active":"2024-09-12T02:28:23.459551+0000","last_peered":"2024-09-12T02:28:23.459551+0000","last_clean":"2024-09-12T02:28:23.459551+0000","last_became_active":"2024-09-12T02:28:22.459342+0000","last_became_peered":"2024-09-12T02:28:22.459342+0000","last_unstale":"2024-09-12T02:28:23.459551+0000","last_undegraded":"2024-09-12T02:28:23.459551+0000","last_fullsized":"2024-09-12T02:28:23.459551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:37.018510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297704+0000","last_change":"2024-09-12T02:28:22.465319+0000","last_active":"2024-09-12T02:28:24.297704+0000","last_peered":"2024-09-12T02:28:24.297704+0000","last_clean":"2024-09-12T02:28:24.297704+0000","last_became_active":"2024-09-12T02:28:22.465059+0000","last_became_peered":"2024-09-12T02:28:22.465059+0000","last_unstale":"2024-09-12T02:28:24.297704+0000","last_undegraded":"2024-09-12T02:28:24.297704+0000","last_fullsized":"2024-09-12T02:28:24.297704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:12.495527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995398+0000","last_change":"2024-09-12T02:28:22.464467+0000","last_active":"2024-09-12T02:28:23.995398+0000","last_peered":"2024-09-12T02:28:23.995398+0000","last_clean":"2024-09-12T02:28:23.995398+0000","last_became_active":"2024-09-12T02:28:22.464145+0000","last_became_peered":"2024-09-12T02:28:22.464145+0000","last_unstale":"2024-09-12T02:28:23.995398+0000","last_undegraded":"2024-09-12T02:28:23.995398+0000","last_fullsized":"2024-09-12T02:28:23.995398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298119+0000","last_change":"2024-09-12T02:28:22.470537+0000","last_active":"2024-09-12T02:28:24.298119+0000","last_peered":"2024-09-12T02:28:24.298119+0000","last_clean":"2024-09-12T02:28:24.298119+0000","last_became_active":"2024-09-12T02:28:22.469350+0000","last_became_peered":"2024-09-12T02:28:22.469350+0000","last_unstale":"2024-09-12T02:28:24.298119+0000","last_undegraded":"2024-09-12T02:28:24.298119+0000","last_fullsized":"2024-09-12T02:28:24.298119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.829525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251249+0000","last_change":"2024-09-12T02:28:22.464994+0000","last_active":"2024-09-12T02:28:24.251249+0000","last_peered":"2024-09-12T02:28:24.251249+0000","last_clean":"2024-09-12T02:28:24.251249+0000","last_became_active":"2024-09-12T02:28:22.464704+0000","last_became_peered":"2024-09-12T02:28:22.464704+0000","last_unstale":"2024-09-12T02:28:24.251249+0000","last_undegraded":"2024-09-12T02:28:24.251249+0000","last_fullsized":"2024-09-12T02:28:24.251249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:32.306382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462749+0000","last_change":"2024-09-12T02:28:22.463462+0000","last_active":"2024-09-12T02:28:23.462749+0000","last_peered":"2024-09-12T02:28:23.462749+0000","last_clean":"2024-09-12T02:28:23.462749+0000","last_became_active":"2024-09-12T02:28:22.463170+0000","last_became_peered":"2024-09-12T02:28:22.463170+0000","last_unstale":"2024-09-12T02:28:23.462749+0000","last_undegraded":"2024-09-12T02:28:23.462749+0000","last_fullsized":"2024-09-12T02:28:23.462749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462660+0000","last_change":"2024-09-12T02:28:22.461255+0000","last_active":"2024-09-12T02:28:23.462660+0000","last_peered":"2024-09-12T02:28:23.462660+0000","last_clean":"2024-09-12T02:28:23.462660+0000","last_became_active":"2024-09-12T02:28:22.460994+0000","last_became_peered":"2024-09-12T02:28:22.460994+0000","last_unstale":"2024-09-12T02:28:23.462660+0000","last_undegraded":"2024-09-12T02:28:23.462660+0000","last_fullsized":"2024-09-12T02:28:23.462660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:52.577495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297624+0000","last_change":"2024-09-12T02:28:21.453139+0000","last_active":"2024-09-12T02:28:24.297624+0000","last_peered":"2024-09-12T02:28:24.297624+0000","last_clean":"2024-09-12T02:28:24.297624+0000","last_became_active":"2024-09-12T02:28:21.452853+0000","last_became_peered":"2024-09-12T02:28:21.452853+0000","last_unstale":"2024-09-12T02:28:24.297624+0000","last_undegraded":"2024-09-12T02:28:24.297624+0000","last_fullsized":"2024-09-12T02:28:24.297624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:26.817704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995580+0000","last_change":"2024-09-12T02:28:22.456228+0000","last_active":"2024-09-12T02:28:23.995580+0000","last_peered":"2024-09-12T02:28:23.995580+0000","last_clean":"2024-09-12T02:28:23.995580+0000","last_became_active":"2024-09-12T02:28:22.455958+0000","last_became_peered":"2024-09-12T02:28:22.455958+0000","last_unstale":"2024-09-12T02:28:23.995580+0000","last_undegraded":"2024-09-12T02:28:23.995580+0000","last_fullsized":"2024-09-12T02:28:23.995580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.985711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462800+0000","last_change":"2024-09-12T02:28:21.446775+0000","last_active":"2024-09-12T02:28:23.462800+0000","last_peered":"2024-09-12T02:28:23.462800+0000","last_clean":"2024-09-12T02:28:23.462800+0000","last_became_active":"2024-09-12T02:28:21.446028+0000","last_became_peered":"2024-09-12T02:28:21.446028+0000","last_unstale":"2024-09-12T02:28:23.462800+0000","last_undegraded":"2024-09-12T02:28:23.462800+0000","last_fullsized":"2024-09-12T02:28:23.462800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:12.026922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297505+0000","last_change":"2024-09-12T02:28:21.452793+0000","last_active":"2024-09-12T02:28:24.297505+0000","last_peered":"2024-09-12T02:28:24.297505+0000","last_clean":"2024-09-12T02:28:24.297505+0000","last_became_active":"2024-09-12T02:28:21.452354+0000","last_became_peered":"2024-09-12T02:28:21.452354+0000","last_unstale":"2024-09-12T02:28:24.297505+0000","last_undegraded":"2024-09-12T02:28:24.297505+0000","last_fullsized":"2024-09-12T02:28:24.297505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297229+0000","last_change":"2024-09-12T02:28:22.474976+0000","last_active":"2024-09-12T02:28:24.297229+0000","last_peered":"2024-09-12T02:28:24.297229+0000","last_clean":"2024-09-12T02:28:24.297229+0000","last_became_active":"2024-09-12T02:28:22.474804+0000","last_became_peered":"2024-09-12T02:28:22.474804+0000","last_unstale":"2024-09-12T02:28:24.297229+0000","last_undegraded":"2024-09-12T02:28:24.297229+0000","last_fullsized":"2024-09-12T02:28:24.297229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:27.574862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297594+0000","last_change":"2024-09-12T02:28:21.454569+0000","last_active":"2024-09-12T02:28:24.297594+0000","last_peered":"2024-09-12T02:28:24.297594+0000","last_clean":"2024-09-12T02:28:24.297594+0000","last_became_active":"2024-09-12T02:28:21.453146+0000","last_became_peered":"2024-09-12T02:28:21.453146+0000","last_unstale":"2024-09-12T02:28:24.297594+0000","last_undegraded":"2024-09-12T02:28:24.297594+0000","last_fullsized":"2024-09-12T02:28:24.297594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459516+0000","last_change":"2024-09-12T02:28:22.458922+0000","last_active":"2024-09-12T02:28:23.459516+0000","last_peered":"2024-09-12T02:28:23.459516+0000","last_clean":"2024-09-12T02:28:23.459516+0000","last_became_active":"2024-09-12T02:28:22.458641+0000","last_became_peered":"2024-09-12T02:28:22.458641+0000","last_unstale":"2024-09-12T02:28:23.459516+0000","last_undegraded":"2024-09-12T02:28:23.459516+0000","last_fullsized":"2024-09-12T02:28:23.459516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:09.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462939+0000","last_change":"2024-09-12T02:28:21.455322+0000","last_active":"2024-09-12T02:28:23.462939+0000","last_peered":"2024-09-12T02:28:23.462939+0000","last_clean":"2024-09-12T02:28:23.462939+0000","last_became_active":"2024-09-12T02:28:21.455039+0000","last_became_peered":"2024-09-12T02:28:21.455039+0000","last_unstale":"2024-09-12T02:28:23.462939+0000","last_undegraded":"2024-09-12T02:28:23.462939+0000","last_fullsized":"2024-09-12T02:28:23.462939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297881+0000","last_change":"2024-09-12T02:28:22.467660+0000","last_active":"2024-09-12T02:28:24.297881+0000","last_peered":"2024-09-12T02:28:24.297881+0000","last_clean":"2024-09-12T02:28:24.297881+0000","last_became_active":"2024-09-12T02:28:22.467401+0000","last_became_peered":"2024-09-12T02:28:22.467401+0000","last_unstale":"2024-09-12T02:28:24.297881+0000","last_undegraded":"2024-09-12T02:28:24.297881+0000","last_fullsized":"2024-09-12T02:28:24.297881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:28.724885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298375+0000","last_change":"2024-09-12T02:28:21.456883+0000","last_active":"2024-09-12T02:28:24.298375+0000","last_peered":"2024-09-12T02:28:24.298375+0000","last_clean":"2024-09-12T02:28:24.298375+0000","last_became_active":"2024-09-12T02:28:21.456438+0000","last_became_peered":"2024-09-12T02:28:21.456438+0000","last_unstale":"2024-09-12T02:28:24.298375+0000","last_undegraded":"2024-09-12T02:28:24.298375+0000","last_fullsized":"2024-09-12T02:28:24.298375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995535+0000","last_change":"2024-09-12T02:28:22.467768+0000","last_active":"2024-09-12T02:28:23.995535+0000","last_peered":"2024-09-12T02:28:23.995535+0000","last_clean":"2024-09-12T02:28:23.995535+0000","last_became_active":"2024-09-12T02:28:22.467484+0000","last_became_peered":"2024-09-12T02:28:22.467484+0000","last_unstale":"2024-09-12T02:28:23.995535+0000","last_undegraded":"2024-09-12T02:28:23.995535+0000","last_fullsized":"2024-09-12T02:28:23.995535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459611+0000","last_change":"2024-09-12T02:28:21.453336+0000","last_active":"2024-09-12T02:28:23.459611+0000","last_peered":"2024-09-12T02:28:23.459611+0000","last_clean":"2024-09-12T02:28:23.459611+0000","last_became_active":"2024-09-12T02:28:21.453054+0000","last_became_peered":"2024-09-12T02:28:21.453054+0000","last_unstale":"2024-09-12T02:28:23.459611+0000","last_undegraded":"2024-09-12T02:28:23.459611+0000","last_fullsized":"2024-09-12T02:28:23.459611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463389+0000","last_change":"2024-09-12T02:28:22.462579+0000","last_active":"2024-09-12T02:28:23.463389+0000","last_peered":"2024-09-12T02:28:23.463389+0000","last_clean":"2024-09-12T02:28:23.463389+0000","last_became_active":"2024-09-12T02:28:22.462294+0000","last_became_peered":"2024-09-12T02:28:22.462294+0000","last_unstale":"2024-09-12T02:28:23.463389+0000","last_undegraded":"2024-09-12T02:28:23.463389+0000","last_fullsized":"2024-09-12T02:28:23.463389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.751757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463174+0000","last_change":"2024-09-12T02:28:21.449013+0000","last_active":"2024-09-12T02:28:23.463174+0000","last_peered":"2024-09-12T02:28:23.463174+0000","last_clean":"2024-09-12T02:28:23.463174+0000","last_became_active":"2024-09-12T02:28:21.448493+0000","last_became_peered":"2024-09-12T02:28:21.448493+0000","last_unstale":"2024-09-12T02:28:23.463174+0000","last_undegraded":"2024-09-12T02:28:23.463174+0000","last_fullsized":"2024-09-12T02:28:23.463174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298568+0000","last_change":"2024-09-12T02:28:22.456742+0000","last_active":"2024-09-12T02:28:24.298568+0000","last_peered":"2024-09-12T02:28:24.298568+0000","last_clean":"2024-09-12T02:28:24.298568+0000","last_became_active":"2024-09-12T02:28:22.456477+0000","last_became_peered":"2024-09-12T02:28:22.456477+0000","last_unstale":"2024-09-12T02:28:24.298568+0000","last_undegraded":"2024-09-12T02:28:24.298568+0000","last_fullsized":"2024-09-12T02:28:24.298568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:52.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995564+0000","last_change":"2024-09-12T02:28:21.461100+0000","last_active":"2024-09-12T02:28:23.995564+0000","last_peered":"2024-09-12T02:28:23.995564+0000","last_clean":"2024-09-12T02:28:23.995564+0000","last_became_active":"2024-09-12T02:28:21.460785+0000","last_became_peered":"2024-09-12T02:28:21.460785+0000","last_unstale":"2024-09-12T02:28:23.995564+0000","last_undegraded":"2024-09-12T02:28:23.995564+0000","last_fullsized":"2024-09-12T02:28:23.995564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:11.030581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995310+0000","last_change":"2024-09-12T02:28:22.461832+0000","last_active":"2024-09-12T02:28:23.995310+0000","last_peered":"2024-09-12T02:28:23.995310+0000","last_clean":"2024-09-12T02:28:23.995310+0000","last_became_active":"2024-09-12T02:28:22.461223+0000","last_became_peered":"2024-09-12T02:28:22.461223+0000","last_unstale":"2024-09-12T02:28:23.995310+0000","last_undegraded":"2024-09-12T02:28:23.995310+0000","last_fullsized":"2024-09-12T02:28:23.995310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298235+0000","last_change":"2024-09-12T02:28:21.454178+0000","last_active":"2024-09-12T02:28:24.298235+0000","last_peered":"2024-09-12T02:28:24.298235+0000","last_clean":"2024-09-12T02:28:24.298235+0000","last_became_active":"2024-09-12T02:28:21.453871+0000","last_became_peered":"2024-09-12T02:28:21.453871+0000","last_unstale":"2024-09-12T02:28:24.298235+0000","last_undegraded":"2024-09-12T02:28:24.298235+0000","last_fullsized":"2024-09-12T02:28:24.298235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298309+0000","last_change":"2024-09-12T02:28:22.459853+0000","last_active":"2024-09-12T02:28:24.298309+0000","last_peered":"2024-09-12T02:28:24.298309+0000","last_clean":"2024-09-12T02:28:24.298309+0000","last_became_active":"2024-09-12T02:28:22.459611+0000","last_became_peered":"2024-09-12T02:28:22.459611+0000","last_unstale":"2024-09-12T02:28:24.298309+0000","last_undegraded":"2024-09-12T02:28:24.298309+0000","last_fullsized":"2024-09-12T02:28:24.298309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.290900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462368+0000","last_change":"2024-09-12T02:28:21.449223+0000","last_active":"2024-09-12T02:28:23.462368+0000","last_peered":"2024-09-12T02:28:23.462368+0000","last_clean":"2024-09-12T02:28:23.462368+0000","last_became_active":"2024-09-12T02:28:21.448650+0000","last_became_peered":"2024-09-12T02:28:21.448650+0000","last_unstale":"2024-09-12T02:28:23.462368+0000","last_undegraded":"2024-09-12T02:28:23.462368+0000","last_fullsized":"2024-09-12T02:28:23.462368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462866+0000","last_change":"2024-09-12T02:28:22.463479+0000","last_active":"2024-09-12T02:28:23.462866+0000","last_peered":"2024-09-12T02:28:23.462866+0000","last_clean":"2024-09-12T02:28:23.462866+0000","last_became_active":"2024-09-12T02:28:22.463208+0000","last_became_peered":"2024-09-12T02:28:22.463208+0000","last_unstale":"2024-09-12T02:28:23.462866+0000","last_undegraded":"2024-09-12T02:28:23.462866+0000","last_fullsized":"2024-09-12T02:28:23.462866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:38.121499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251159+0000","last_change":"2024-09-12T02:28:21.451427+0000","last_active":"2024-09-12T02:28:24.251159+0000","last_peered":"2024-09-12T02:28:24.251159+0000","last_clean":"2024-09-12T02:28:24.251159+0000","last_became_active":"2024-09-12T02:28:21.451124+0000","last_became_peered":"2024-09-12T02:28:21.451124+0000","last_unstale":"2024-09-12T02:28:24.251159+0000","last_undegraded":"2024-09-12T02:28:24.251159+0000","last_fullsized":"2024-09-12T02:28:24.251159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.656183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298014+0000","last_change":"2024-09-12T02:28:22.456047+0000","last_active":"2024-09-12T02:28:24.298014+0000","last_peered":"2024-09-12T02:28:24.298014+0000","last_clean":"2024-09-12T02:28:24.298014+0000","last_became_active":"2024-09-12T02:28:22.455803+0000","last_became_peered":"2024-09-12T02:28:22.455803+0000","last_unstale":"2024-09-12T02:28:24.298014+0000","last_undegraded":"2024-09-12T02:28:24.298014+0000","last_fullsized":"2024-09-12T02:28:24.298014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:50.825935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463657+0000","last_change":"2024-09-12T02:28:21.461510+0000","last_active":"2024-09-12T02:28:23.463657+0000","last_peered":"2024-09-12T02:28:23.463657+0000","last_clean":"2024-09-12T02:28:23.463657+0000","last_became_active":"2024-09-12T02:28:21.461183+0000","last_became_peered":"2024-09-12T02:28:21.461183+0000","last_unstale":"2024-09-12T02:28:23.463657+0000","last_undegraded":"2024-09-12T02:28:23.463657+0000","last_fullsized":"2024-09-12T02:28:23.463657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.909426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298086+0000","last_change":"2024-09-12T02:28:22.459244+0000","last_active":"2024-09-12T02:28:24.298086+0000","last_peered":"2024-09-12T02:28:24.298086+0000","last_clean":"2024-09-12T02:28:24.298086+0000","last_became_active":"2024-09-12T02:28:22.458948+0000","last_became_peered":"2024-09-12T02:28:22.458948+0000","last_unstale":"2024-09-12T02:28:24.298086+0000","last_undegraded":"2024-09-12T02:28:24.298086+0000","last_fullsized":"2024-09-12T02:28:24.298086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.507175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251362+0000","last_change":"2024-09-12T02:28:21.448604+0000","last_active":"2024-09-12T02:28:24.251362+0000","last_peered":"2024-09-12T02:28:24.251362+0000","last_clean":"2024-09-12T02:28:24.251362+0000","last_became_active":"2024-09-12T02:28:21.448165+0000","last_became_peered":"2024-09-12T02:28:21.448165+0000","last_unstale":"2024-09-12T02:28:24.251362+0000","last_undegraded":"2024-09-12T02:28:24.251362+0000","last_fullsized":"2024-09-12T02:28:24.251362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:25.512376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298838+0000","last_change":"2024-09-12T02:28:22.458525+0000","last_active":"2024-09-12T02:28:24.298838+0000","last_peered":"2024-09-12T02:28:24.298838+0000","last_clean":"2024-09-12T02:28:24.298838+0000","last_became_active":"2024-09-12T02:28:22.458270+0000","last_became_peered":"2024-09-12T02:28:22.458270+0000","last_unstale":"2024-09-12T02:28:24.298838+0000","last_undegraded":"2024-09-12T02:28:24.298838+0000","last_fullsized":"2024-09-12T02:28:24.298838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:39.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459647+0000","last_change":"2024-09-12T02:28:21.456310+0000","last_active":"2024-09-12T02:28:23.459647+0000","last_peered":"2024-09-12T02:28:23.459647+0000","last_clean":"2024-09-12T02:28:23.459647+0000","last_became_active":"2024-09-12T02:28:21.455875+0000","last_became_peered":"2024-09-12T02:28:21.455875+0000","last_unstale":"2024-09-12T02:28:23.459647+0000","last_undegraded":"2024-09-12T02:28:23.459647+0000","last_fullsized":"2024-09-12T02:28:23.459647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298346+0000","last_change":"2024-09-12T02:28:22.470690+0000","last_active":"2024-09-12T02:28:24.298346+0000","last_peered":"2024-09-12T02:28:24.298346+0000","last_clean":"2024-09-12T02:28:24.298346+0000","last_became_active":"2024-09-12T02:28:22.469379+0000","last_became_peered":"2024-09-12T02:28:22.469379+0000","last_unstale":"2024-09-12T02:28:24.298346+0000","last_undegraded":"2024-09-12T02:28:24.298346+0000","last_fullsized":"2024-09-12T02:28:24.298346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.893907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251280+0000","last_change":"2024-09-12T02:28:21.451827+0000","last_active":"2024-09-12T02:28:24.251280+0000","last_peered":"2024-09-12T02:28:24.251280+0000","last_clean":"2024-09-12T02:28:24.251280+0000","last_became_active":"2024-09-12T02:28:21.451567+0000","last_became_peered":"2024-09-12T02:28:21.451567+0000","last_unstale":"2024-09-12T02:28:24.251280+0000","last_undegraded":"2024-09-12T02:28:24.251280+0000","last_fullsized":"2024-09-12T02:28:24.251280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298587+0000","last_change":"2024-09-12T02:28:22.468838+0000","last_active":"2024-09-12T02:28:24.298587+0000","last_peered":"2024-09-12T02:28:24.298587+0000","last_clean":"2024-09-12T02:28:24.298587+0000","last_became_active":"2024-09-12T02:28:22.468221+0000","last_became_peered":"2024-09-12T02:28:22.468221+0000","last_unstale":"2024-09-12T02:28:24.298587+0000","last_undegraded":"2024-09-12T02:28:24.298587+0000","last_fullsized":"2024-09-12T02:28:24.298587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.829525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297450+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:28:24.297450+0000","last_peered":"2024-09-12T02:28:24.297450+0000","last_clean":"2024-09-12T02:28:24.297450+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:28:24.297450+0000","last_undegraded":"2024-09-12T02:28:24.297450+0000","last_fullsized":"2024-09-12T02:28:24.297450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298377+0000","last_change":"2024-09-12T02:28:21.456961+0000","last_active":"2024-09-12T02:28:24.298377+0000","last_peered":"2024-09-12T02:28:24.298377+0000","last_clean":"2024-09-12T02:28:24.298377+0000","last_became_active":"2024-09-12T02:28:21.456682+0000","last_became_peered":"2024-09-12T02:28:21.456682+0000","last_unstale":"2024-09-12T02:28:24.298377+0000","last_undegraded":"2024-09-12T02:28:24.298377+0000","last_fullsized":"2024-09-12T02:28:24.298377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297376+0000","last_change":"2024-09-12T02:28:22.468056+0000","last_active":"2024-09-12T02:28:24.297376+0000","last_peered":"2024-09-12T02:28:24.297376+0000","last_clean":"2024-09-12T02:28:24.297376+0000","last_became_active":"2024-09-12T02:28:22.467654+0000","last_became_peered":"2024-09-12T02:28:22.467654+0000","last_unstale":"2024-09-12T02:28:24.297376+0000","last_undegraded":"2024-09-12T02:28:24.297376+0000","last_fullsized":"2024-09-12T02:28:24.297376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:01.840287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297294+0000","last_change":"2024-09-12T02:28:21.462547+0000","last_active":"2024-09-12T02:28:24.297294+0000","last_peered":"2024-09-12T02:28:24.297294+0000","last_clean":"2024-09-12T02:28:24.297294+0000","last_became_active":"2024-09-12T02:28:21.462186+0000","last_became_peered":"2024-09-12T02:28:21.462186+0000","last_unstale":"2024-09-12T02:28:24.297294+0000","last_undegraded":"2024-09-12T02:28:24.297294+0000","last_fullsized":"2024-09-12T02:28:24.297294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:26.123209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995210+0000","last_change":"2024-09-12T02:28:22.457842+0000","last_active":"2024-09-12T02:28:23.995210+0000","last_peered":"2024-09-12T02:28:23.995210+0000","last_clean":"2024-09-12T02:28:23.995210+0000","last_became_active":"2024-09-12T02:28:22.457001+0000","last_became_peered":"2024-09-12T02:28:22.457001+0000","last_unstale":"2024-09-12T02:28:23.995210+0000","last_undegraded":"2024-09-12T02:28:23.995210+0000","last_fullsized":"2024-09-12T02:28:23.995210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.492513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.251305+0000","last_change":"2024-09-12T02:28:21.449367+0000","last_active":"2024-09-12T02:28:24.251305+0000","last_peered":"2024-09-12T02:28:24.251305+0000","last_clean":"2024-09-12T02:28:24.251305+0000","last_became_active":"2024-09-12T02:28:21.448265+0000","last_became_peered":"2024-09-12T02:28:21.448265+0000","last_unstale":"2024-09-12T02:28:24.251305+0000","last_undegraded":"2024-09-12T02:28:24.251305+0000","last_fullsized":"2024-09-12T02:28:24.251305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:16.640297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459760+0000","last_change":"2024-09-12T02:28:22.458123+0000","last_active":"2024-09-12T02:28:23.459760+0000","last_peered":"2024-09-12T02:28:23.459760+0000","last_clean":"2024-09-12T02:28:23.459760+0000","last_became_active":"2024-09-12T02:28:22.457250+0000","last_became_peered":"2024-09-12T02:28:22.457250+0000","last_unstale":"2024-09-12T02:28:23.459760+0000","last_undegraded":"2024-09-12T02:28:23.459760+0000","last_fullsized":"2024-09-12T02:28:23.459760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.519011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298438+0000","last_change":"2024-09-12T02:28:21.457643+0000","last_active":"2024-09-12T02:28:24.298438+0000","last_peered":"2024-09-12T02:28:24.298438+0000","last_clean":"2024-09-12T02:28:24.298438+0000","last_became_active":"2024-09-12T02:28:21.457340+0000","last_became_peered":"2024-09-12T02:28:21.457340+0000","last_unstale":"2024-09-12T02:28:24.298438+0000","last_undegraded":"2024-09-12T02:28:24.298438+0000","last_fullsized":"2024-09-12T02:28:24.298438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462588+0000","last_change":"2024-09-12T02:28:22.466165+0000","last_active":"2024-09-12T02:28:23.462588+0000","last_peered":"2024-09-12T02:28:23.462588+0000","last_clean":"2024-09-12T02:28:23.462588+0000","last_became_active":"2024-09-12T02:28:22.465870+0000","last_became_peered":"2024-09-12T02:28:22.465870+0000","last_unstale":"2024-09-12T02:28:23.462588+0000","last_undegraded":"2024-09-12T02:28:23.462588+0000","last_fullsized":"2024-09-12T02:28:23.462588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:09.530027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459593+0000","last_change":"2024-09-12T02:28:21.461428+0000","last_active":"2024-09-12T02:28:23.459593+0000","last_peered":"2024-09-12T02:28:23.459593+0000","last_clean":"2024-09-12T02:28:23.459593+0000","last_became_active":"2024-09-12T02:28:21.461117+0000","last_became_peered":"2024-09-12T02:28:21.461117+0000","last_unstale":"2024-09-12T02:28:23.459593+0000","last_undegraded":"2024-09-12T02:28:23.459593+0000","last_fullsized":"2024-09-12T02:28:23.459593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:36.355362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298072+0000","last_change":"2024-09-12T02:28:22.470508+0000","last_active":"2024-09-12T02:28:24.298072+0000","last_peered":"2024-09-12T02:28:24.298072+0000","last_clean":"2024-09-12T02:28:24.298072+0000","last_became_active":"2024-09-12T02:28:22.470220+0000","last_became_peered":"2024-09-12T02:28:22.470220+0000","last_unstale":"2024-09-12T02:28:24.298072+0000","last_undegraded":"2024-09-12T02:28:24.298072+0000","last_fullsized":"2024-09-12T02:28:24.298072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.290900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298806+0000","last_change":"2024-09-12T02:28:21.461899+0000","last_active":"2024-09-12T02:28:24.298806+0000","last_peered":"2024-09-12T02:28:24.298806+0000","last_clean":"2024-09-12T02:28:24.298806+0000","last_became_active":"2024-09-12T02:28:21.461616+0000","last_became_peered":"2024-09-12T02:28:21.461616+0000","last_unstale":"2024-09-12T02:28:24.298806+0000","last_undegraded":"2024-09-12T02:28:24.298806+0000","last_fullsized":"2024-09-12T02:28:24.298806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:55.870005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459550+0000","last_change":"2024-09-12T02:28:22.458683+0000","last_active":"2024-09-12T02:28:23.459550+0000","last_peered":"2024-09-12T02:28:23.459550+0000","last_clean":"2024-09-12T02:28:23.459550+0000","last_became_active":"2024-09-12T02:28:22.458413+0000","last_became_peered":"2024-09-12T02:28:22.458413+0000","last_unstale":"2024-09-12T02:28:23.459550+0000","last_undegraded":"2024-09-12T02:28:23.459550+0000","last_fullsized":"2024-09-12T02:28:23.459550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459717+0000","last_change":"2024-09-12T02:28:21.455450+0000","last_active":"2024-09-12T02:28:23.459717+0000","last_peered":"2024-09-12T02:28:23.459717+0000","last_clean":"2024-09-12T02:28:23.459717+0000","last_became_active":"2024-09-12T02:28:21.455128+0000","last_became_peered":"2024-09-12T02:28:21.455128+0000","last_unstale":"2024-09-12T02:28:23.459717+0000","last_undegraded":"2024-09-12T02:28:23.459717+0000","last_fullsized":"2024-09-12T02:28:23.459717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.716970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297588+0000","last_change":"2024-09-12T02:28:22.464804+0000","last_active":"2024-09-12T02:28:24.297588+0000","last_peered":"2024-09-12T02:28:24.297588+0000","last_clean":"2024-09-12T02:28:24.297588+0000","last_became_active":"2024-09-12T02:28:22.464515+0000","last_became_peered":"2024-09-12T02:28:22.464515+0000","last_unstale":"2024-09-12T02:28:24.297588+0000","last_undegraded":"2024-09-12T02:28:24.297588+0000","last_fullsized":"2024-09-12T02:28:24.297588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.429495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.463010+0000","last_change":"2024-09-12T02:28:21.457754+0000","last_active":"2024-09-12T02:28:23.463010+0000","last_peered":"2024-09-12T02:28:23.463010+0000","last_clean":"2024-09-12T02:28:23.463010+0000","last_became_active":"2024-09-12T02:28:21.457443+0000","last_became_peered":"2024-09-12T02:28:21.457443+0000","last_unstale":"2024-09-12T02:28:23.463010+0000","last_undegraded":"2024-09-12T02:28:23.463010+0000","last_fullsized":"2024-09-12T02:28:23.463010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:08.525581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995496+0000","last_change":"2024-09-12T02:28:22.463795+0000","last_active":"2024-09-12T02:28:23.995496+0000","last_peered":"2024-09-12T02:28:23.995496+0000","last_clean":"2024-09-12T02:28:23.995496+0000","last_became_active":"2024-09-12T02:28:22.463408+0000","last_became_peered":"2024-09-12T02:28:22.463408+0000","last_unstale":"2024-09-12T02:28:23.995496+0000","last_undegraded":"2024-09-12T02:28:23.995496+0000","last_fullsized":"2024-09-12T02:28:23.995496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:22.265415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297286+0000","last_change":"2024-09-12T02:28:21.462250+0000","last_active":"2024-09-12T02:28:24.297286+0000","last_peered":"2024-09-12T02:28:24.297286+0000","last_clean":"2024-09-12T02:28:24.297286+0000","last_became_active":"2024-09-12T02:28:21.461734+0000","last_became_peered":"2024-09-12T02:28:21.461734+0000","last_unstale":"2024-09-12T02:28:24.297286+0000","last_undegraded":"2024-09-12T02:28:24.297286+0000","last_fullsized":"2024-09-12T02:28:24.297286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:27.705966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462792+0000","last_change":"2024-09-12T02:28:22.459098+0000","last_active":"2024-09-12T02:28:23.462792+0000","last_peered":"2024-09-12T02:28:23.462792+0000","last_clean":"2024-09-12T02:28:23.462792+0000","last_became_active":"2024-09-12T02:28:22.457658+0000","last_became_peered":"2024-09-12T02:28:22.457658+0000","last_unstale":"2024-09-12T02:28:23.462792+0000","last_undegraded":"2024-09-12T02:28:23.462792+0000","last_fullsized":"2024-09-12T02:28:23.462792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:27.127654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459625+0000","last_change":"2024-09-12T02:28:21.457547+0000","last_active":"2024-09-12T02:28:23.459625+0000","last_peered":"2024-09-12T02:28:23.459625+0000","last_clean":"2024-09-12T02:28:23.459625+0000","last_became_active":"2024-09-12T02:28:21.457263+0000","last_became_peered":"2024-09-12T02:28:21.457263+0000","last_unstale":"2024-09-12T02:28:23.459625+0000","last_undegraded":"2024-09-12T02:28:23.459625+0000","last_fullsized":"2024-09-12T02:28:23.459625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:04.208103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297338+0000","last_change":"2024-09-12T02:28:22.459832+0000","last_active":"2024-09-12T02:28:24.297338+0000","last_peered":"2024-09-12T02:28:24.297338+0000","last_clean":"2024-09-12T02:28:24.297338+0000","last_became_active":"2024-09-12T02:28:22.459559+0000","last_became_peered":"2024-09-12T02:28:22.459559+0000","last_unstale":"2024-09-12T02:28:24.297338+0000","last_undegraded":"2024-09-12T02:28:24.297338+0000","last_fullsized":"2024-09-12T02:28:24.297338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.382251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.459771+0000","last_change":"2024-09-12T02:28:21.454638+0000","last_active":"2024-09-12T02:28:23.459771+0000","last_peered":"2024-09-12T02:28:23.459771+0000","last_clean":"2024-09-12T02:28:23.459771+0000","last_became_active":"2024-09-12T02:28:21.454339+0000","last_became_peered":"2024-09-12T02:28:21.454339+0000","last_unstale":"2024-09-12T02:28:23.459771+0000","last_undegraded":"2024-09-12T02:28:23.459771+0000","last_fullsized":"2024-09-12T02:28:23.459771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297506+0000","last_change":"2024-09-12T02:28:22.475121+0000","last_active":"2024-09-12T02:28:24.297506+0000","last_peered":"2024-09-12T02:28:24.297506+0000","last_clean":"2024-09-12T02:28:24.297506+0000","last_became_active":"2024-09-12T02:28:22.474844+0000","last_became_peered":"2024-09-12T02:28:22.474844+0000","last_unstale":"2024-09-12T02:28:24.297506+0000","last_undegraded":"2024-09-12T02:28:24.297506+0000","last_fullsized":"2024-09-12T02:28:24.297506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:19.714606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298384+0000","last_change":"2024-09-12T02:28:21.462703+0000","last_active":"2024-09-12T02:28:24.298384+0000","last_peered":"2024-09-12T02:28:24.298384+0000","last_clean":"2024-09-12T02:28:24.298384+0000","last_became_active":"2024-09-12T02:28:21.462354+0000","last_became_peered":"2024-09-12T02:28:21.462354+0000","last_unstale":"2024-09-12T02:28:24.298384+0000","last_undegraded":"2024-09-12T02:28:24.298384+0000","last_fullsized":"2024-09-12T02:28:24.298384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:45.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.462696+0000","last_change":"2024-09-12T02:28:22.465703+0000","last_active":"2024-09-12T02:28:23.462696+0000","last_peered":"2024-09-12T02:28:23.462696+0000","last_clean":"2024-09-12T02:28:23.462696+0000","last_became_active":"2024-09-12T02:28:22.465439+0000","last_became_peered":"2024-09-12T02:28:22.465439+0000","last_unstale":"2024-09-12T02:28:23.462696+0000","last_undegraded":"2024-09-12T02:28:23.462696+0000","last_fullsized":"2024-09-12T02:28:23.462696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:19.123633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297890+0000","last_change":"2024-09-12T02:28:22.464376+0000","last_active":"2024-09-12T02:28:24.297890+0000","last_peered":"2024-09-12T02:28:24.297890+0000","last_clean":"2024-09-12T02:28:24.297890+0000","last_became_active":"2024-09-12T02:28:22.464058+0000","last_became_peered":"2024-09-12T02:28:22.464058+0000","last_unstale":"2024-09-12T02:28:24.297890+0000","last_undegraded":"2024-09-12T02:28:24.297890+0000","last_fullsized":"2024-09-12T02:28:24.297890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:50.825935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297772+0000","last_change":"2024-09-12T02:28:21.459499+0000","last_active":"2024-09-12T02:28:24.297772+0000","last_peered":"2024-09-12T02:28:24.297772+0000","last_clean":"2024-09-12T02:28:24.297772+0000","last_became_active":"2024-09-12T02:28:21.459190+0000","last_became_peered":"2024-09-12T02:28:21.459190+0000","last_unstale":"2024-09-12T02:28:24.297772+0000","last_undegraded":"2024-09-12T02:28:24.297772+0000","last_fullsized":"2024-09-12T02:28:24.297772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:51.573049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298200+0000","last_change":"2024-09-12T02:28:22.467912+0000","last_active":"2024-09-12T02:28:24.298200+0000","last_peered":"2024-09-12T02:28:24.298200+0000","last_clean":"2024-09-12T02:28:24.298200+0000","last_became_active":"2024-09-12T02:28:22.467615+0000","last_became_peered":"2024-09-12T02:28:22.467615+0000","last_unstale":"2024-09-12T02:28:24.298200+0000","last_undegraded":"2024-09-12T02:28:24.298200+0000","last_fullsized":"2024-09-12T02:28:24.298200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:52.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.298701+0000","last_change":"2024-09-12T02:28:21.462426+0000","last_active":"2024-09-12T02:28:24.298701+0000","last_peered":"2024-09-12T02:28:24.298701+0000","last_clean":"2024-09-12T02:28:24.298701+0000","last_became_active":"2024-09-12T02:28:21.462107+0000","last_became_peered":"2024-09-12T02:28:21.462107+0000","last_unstale":"2024-09-12T02:28:24.298701+0000","last_undegraded":"2024-09-12T02:28:24.298701+0000","last_fullsized":"2024-09-12T02:28:24.298701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:08.206286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995479+0000","last_change":"2024-09-12T02:28:22.468618+0000","last_active":"2024-09-12T02:28:23.995479+0000","last_peered":"2024-09-12T02:28:23.995479+0000","last_clean":"2024-09-12T02:28:23.995479+0000","last_became_active":"2024-09-12T02:28:22.468188+0000","last_became_peered":"2024-09-12T02:28:22.468188+0000","last_unstale":"2024-09-12T02:28:23.995479+0000","last_undegraded":"2024-09-12T02:28:23.995479+0000","last_fullsized":"2024-09-12T02:28:23.995479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:04.937819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297499+0000","last_change":"2024-09-12T02:28:21.462214+0000","last_active":"2024-09-12T02:28:24.297499+0000","last_peered":"2024-09-12T02:28:24.297499+0000","last_clean":"2024-09-12T02:28:24.297499+0000","last_became_active":"2024-09-12T02:28:21.461911+0000","last_became_peered":"2024-09-12T02:28:21.461911+0000","last_unstale":"2024-09-12T02:28:24.297499+0000","last_undegraded":"2024-09-12T02:28:24.297499+0000","last_fullsized":"2024-09-12T02:28:24.297499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.656183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:24.297467+0000","last_change":"2024-09-12T02:28:22.463363+0000","last_active":"2024-09-12T02:28:24.297467+0000","last_peered":"2024-09-12T02:28:24.297467+0000","last_clean":"2024-09-12T02:28:24.297467+0000","last_became_active":"2024-09-12T02:28:22.463101+0000","last_became_peered":"2024-09-12T02:28:22.463101+0000","last_unstale":"2024-09-12T02:28:24.297467+0000","last_undegraded":"2024-09-12T02:28:24.297467+0000","last_fullsized":"2024-09-12T02:28:24.297467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:21.432019+0000","last_clean_scrub_stamp":"2024-09-12T02:28:21.432019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:28.463443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T02:28:23.995570+0000","last_change":"2024-09-12T02:28:21.461271+0000","last_active":"2024-09-12T02:28:23.995570+0000","last_peered":"2024-09-12T02:28:23.995570+0000","last_clean":"2024-09-12T02:28:23.995570+0000","last_became_active":"2024-09-12T02:28:21.460986+0000","last_became_peered":"2024-09-12T02:28:21.460986+0000","last_unstale":"2024-09-12T02:28:23.995570+0000","last_undegraded":"2024-09-12T02:28:23.995570+0000","last_fullsized":"2024-09-12T02:28:23.995570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:20.427574+0000","last_clean_scrub_stamp":"2024-09-12T02:28:20.427574+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:58.924252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":662973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:28:34.302 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:28:34.302 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:28:34.302 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:28:34.302 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T02:28:34.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.434+0000 7fd7bb8b7640 1 Processor -- start 2024-09-12T02:28:34.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.435+0000 7fd7bb8b7640 1 -- start start 2024-09-12T02:28:34.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.435+0000 7fd7bb8b7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd7b415e590 0x7fd7b40d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.435+0000 7fd7bb8b7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7b40b7530 0x7fd7b40b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.435+0000 7fd7bb8b7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b415e970 con 0x7fd7b40cf840 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.435+0000 7fd7bb8b7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40d41f0 con 0x7fd7b40b7530 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.435+0000 7fd7bb8b7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40d2800 con 0x7fd7b415e590 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.435+0000 7fd7b8e52640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7b40b7530 0x7fd7b40b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b8e52640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7b40b7530 0x7fd7b40b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52026/0 (socket says 172.21.15.181:52026) 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b8e52640 1 -- 172.21.15.181:0/2447320581 learned_addr learned my addr 172.21.15.181:0/2447320581 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b9653640 1 --2- 172.21.15.181:0/2447320581 >> v2:172.21.15.204:3300/0 conn(0x7fd7b415e590 0x7fd7b40d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b8e52640 1 -- 172.21.15.181:0/2447320581 >> v2:172.21.15.204:3300/0 conn(0x7fd7b415e590 msgr2=0x7fd7b40d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b8e52640 1 --2- 172.21.15.181:0/2447320581 >> v2:172.21.15.204:3300/0 conn(0x7fd7b415e590 0x7fd7b40d3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b8e52640 1 -- 172.21.15.181:0/2447320581 >> v1:172.21.15.204:6789/0 conn(0x7fd7b40cf840 legacy=0x7fd7b406bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b8e52640 1 -- 172.21.15.181:0/2447320581 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40d2ae0 con 0x7fd7b40b7530 2024-09-12T02:28:34.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.436+0000 7fd7b8e52640 1 --2- 172.21.15.181:0/2447320581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40b7530 0x7fd7b40b5f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40d5540 tx=0x7fd7a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47aca2840f493a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7abfff640 1 -- 172.21.15.181:0/2447320581 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4037070 con 0x7fd7b40b7530 2024-09-12T02:28:34.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7abfff640 1 -- 172.21.15.181:0/2447320581 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a4032440 con 0x7fd7b40b7530 2024-09-12T02:28:34.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7abfff640 1 -- 172.21.15.181:0/2447320581 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4032810 con 0x7fd7b40b7530 2024-09-12T02:28:34.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/2447320581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40b7530 msgr2=0x7fd7b40b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/2447320581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40b7530 0x7fd7b40b5f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40d5540 tx=0x7fd7a402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/2447320581 shutdown_connections 2024-09-12T02:28:34.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/2447320581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b40b7530 0x7fd7b40b5f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/2447320581 >> v2:172.21.15.204:3300/0 conn(0x7fd7b415e590 0x7fd7b40d3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/2447320581 >> 172.21.15.181:0/2447320581 conn(0x7fd7b4067d70 msgr2=0x7fd7b4068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:34.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/2447320581 shutdown_connections 2024-09-12T02:28:34.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.437+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/2447320581 wait complete. 2024-09-12T02:28:34.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.438+0000 7fd7bb8b7640 1 Processor -- start 2024-09-12T02:28:34.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7bb8b7640 1 -- start start 2024-09-12T02:28:34.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7bb8b7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7b40b7530 0x7fd7b41615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7bb8b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7b40cf840 0x7fd7b414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7bb8b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b415e590 0x7fd7b40cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7bb8b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b40d3e70 con 0x7fd7b415e590 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7bb8b7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b40d30a0 con 0x7fd7b40b7530 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7bb8b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b40b6460 con 0x7fd7b40cf840 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7b9e54640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b415e590 0x7fd7b40cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7b9e54640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b415e590 0x7fd7b40cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52042/0 (socket says 172.21.15.181:52042) 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7b9e54640 1 -- 172.21.15.181:0/3457084183 learned_addr learned my addr 172.21.15.181:0/3457084183 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7b9653640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7b40b7530 0x7fd7b41615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.439+0000 7fd7b8e52640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7b40cf840 0x7fd7b414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7b9e54640 1 -- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7b40cf840 msgr2=0x7fd7b414c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7b9e54640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7b40cf840 0x7fd7b414c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7b9e54640 1 -- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7b40b7530 msgr2=0x7fd7b41615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7b9e54640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7b40b7530 0x7fd7b41615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7b9e54640 1 -- 172.21.15.181:0/3457084183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40ccaf0 con 0x7fd7b415e590 2024-09-12T02:28:34.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7b8e52640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7b40cf840 0x7fd7b414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7b9e54640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b415e590 0x7fd7b40cd530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c7a0 tx=0x7fd7ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7a9ffb640 1 -- 172.21.15.181:0/3457084183 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac003b70 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7a9ffb640 1 -- 172.21.15.181:0/3457084183 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac003d30 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7a9ffb640 1 -- 172.21.15.181:0/3457084183 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00aa90 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b415f6f0 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.440+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b4161b00 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.441+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b40b67f0 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.441+0000 7fd7a9ffb640 1 -- 172.21.15.181:0/3457084183 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7ac00ac30 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.442+0000 7fd7a9ffb640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd79806be30 0x7fd79806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.442+0000 7fd7a9ffb640 1 -- 172.21.15.181:0/3457084183 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7ac08ad20 con 0x7fd7b415e590 2024-09-12T02:28:34.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.442+0000 7fd7b9653640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd79806be30 0x7fd79806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.442+0000 7fd7b9653640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd79806be30 0x7fd79806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00079a0 tx=0x7fd7b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.446+0000 7fd7a9ffb640 1 -- 172.21.15.181:0/3457084183 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7ac0596d0 con 0x7fd7b415e590 2024-09-12T02:28:34.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.647+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd7b415d690 con 0x7fd7b415e590 2024-09-12T02:28:34.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.647+0000 7fd7a9ffb640 1 -- 172.21.15.181:0/3457084183 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd7ac058fd0 con 0x7fd7b415e590 2024-09-12T02:28:34.648 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:34.648 INFO:teuthology.orchestra.run.smithi181.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:28:34.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd79806be30 msgr2=0x7fd79806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd79806be30 0x7fd79806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00079a0 tx=0x7fd7b0008040 comp rx=0 tx=0).stop 2024-09-12T02:28:34.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b415e590 msgr2=0x7fd7b40cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b415e590 0x7fd7b40cd530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c7a0 tx=0x7fd7ac00cc60 comp rx=0 tx=0).stop 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 shutdown_connections 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd79806be30 0x7fd79806e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7b415e590 0x7fd7b40cd530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7b40cf840 0x7fd7b414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 --2- 172.21.15.181:0/3457084183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7b40b7530 0x7fd7b41615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 >> 172.21.15.181:0/3457084183 conn(0x7fd7b4067d70 msgr2=0x7fd7b406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 shutdown_connections 2024-09-12T02:28:34.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.649+0000 7fd7bb8b7640 1 -- 172.21.15.181:0/3457084183 wait complete. 2024-09-12T02:28:34.660 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:28:34.661 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.758+0000 7f8123645640 1 Processor -- start 2024-09-12T02:28:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.758+0000 7f8123645640 1 -- start start 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f8123645640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f811c15e7c0 0x7f811c162b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f8123645640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f811c0cf480 0x7f811c0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f8123645640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f811c0b39a0 con 0x7f811c15f900 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f8123645640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f811c1630d0 con 0x7f811c15e7c0 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f8123645640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f811c15eba0 con 0x7f811c0cf480 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f81213e1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f811c15e7c0 0x7f811c162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f81213e1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f811c15e7c0 0x7f811c162b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52048/0 (socket says 172.21.15.181:52048) 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f81213e1640 1 -- 172.21.15.181:0/1287546537 learned_addr learned my addr 172.21.15.181:0/1287546537 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f8120be0640 1 --2- 172.21.15.181:0/1287546537 >> v2:172.21.15.204:3300/0 conn(0x7f811c0cf480 0x7f811c0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f81213e1640 1 -- 172.21.15.181:0/1287546537 >> v2:172.21.15.204:3300/0 conn(0x7f811c0cf480 msgr2=0x7f811c0b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f81213e1640 1 --2- 172.21.15.181:0/1287546537 >> v2:172.21.15.204:3300/0 conn(0x7f811c0cf480 0x7f811c0b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f81213e1640 1 -- 172.21.15.181:0/1287546537 >> v1:172.21.15.204:6789/0 conn(0x7f811c15f900 legacy=0x7f811c0b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.759+0000 7f81213e1640 1 -- 172.21.15.181:0/1287546537 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c0cfc60 con 0x7f811c15e7c0 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.760+0000 7f81213e1640 1 --2- 172.21.15.181:0/1287546537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c162b90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f811c08da60 tx=0x7f811802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bc471342cead3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.760+0000 7f8113fff640 1 -- 172.21.15.181:0/1287546537 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8118036070 con 0x7f811c15e7c0 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.760+0000 7f8113fff640 1 -- 172.21.15.181:0/1287546537 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8118031600 con 0x7f811c15e7c0 2024-09-12T02:28:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.760+0000 7f8113fff640 1 -- 172.21.15.181:0/1287546537 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81180319d0 con 0x7f811c15e7c0 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 -- 172.21.15.181:0/1287546537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 msgr2=0x7f811c162b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 --2- 172.21.15.181:0/1287546537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c162b90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f811c08da60 tx=0x7f811802a780 comp rx=0 tx=0).stop 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 -- 172.21.15.181:0/1287546537 shutdown_connections 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 --2- 172.21.15.181:0/1287546537 >> v2:172.21.15.204:3300/0 conn(0x7f811c0cf480 0x7f811c0b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 --2- 172.21.15.181:0/1287546537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c162b90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 -- 172.21.15.181:0/1287546537 >> 172.21.15.181:0/1287546537 conn(0x7f811c0d1320 msgr2=0x7f811c0d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 -- 172.21.15.181:0/1287546537 shutdown_connections 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.761+0000 7f8123645640 1 -- 172.21.15.181:0/1287546537 wait complete. 2024-09-12T02:28:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.762+0000 7f8123645640 1 Processor -- start 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.762+0000 7f8123645640 1 -- start start 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8123645640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f811c0cf480 0x7f811c156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8123645640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8123645640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f811c15f900 0x7f811c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8123645640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f811c15f100 con 0x7f811c15e7c0 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8123645640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f811c15ee20 con 0x7f811c15f900 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8123645640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f811c15f3e0 con 0x7f811c0cf480 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c0cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52058/0 (socket says 172.21.15.181:52058) 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 -- 172.21.15.181:0/280324723 learned_addr learned my addr 172.21.15.181:0/280324723 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f81213e1640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f811c0cf480 0x7f811c156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 -- 172.21.15.181:0/280324723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f811c0cf480 msgr2=0x7f811c156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f811c0cf480 0x7f811c156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 -- 172.21.15.181:0/280324723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f811c15f900 msgr2=0x7f811c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f811c15f900 0x7f811c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 -- 172.21.15.181:0/280324723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c0cc040 con 0x7f811c15e7c0 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.763+0000 7f8120be0640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c0cb580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f810c00d7d0 tx=0x7f810c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.764+0000 7f8111ffb640 1 -- 172.21.15.181:0/280324723 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00b6c0 con 0x7f811c15e7c0 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.764+0000 7f8111ffb640 1 -- 172.21.15.181:0/280324723 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c019070 con 0x7f811c15e7c0 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.764+0000 7f8111ffb640 1 -- 172.21.15.181:0/280324723 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00bac0 con 0x7f811c15e7c0 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.764+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c0cc320 con 0x7f811c15e7c0 2024-09-12T02:28:34.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.764+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c0b8300 con 0x7f811c15e7c0 2024-09-12T02:28:34.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.765+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c162b90 con 0x7f811c15e7c0 2024-09-12T02:28:34.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.765+0000 7f8111ffb640 1 -- 172.21.15.181:0/280324723 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f810c00bc60 con 0x7f811c15e7c0 2024-09-12T02:28:34.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.766+0000 7f8111ffb640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f810006be30 0x7f810006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:34.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.766+0000 7f81213e1640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f810006be30 0x7f810006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:34.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.766+0000 7f8111ffb640 1 -- 172.21.15.181:0/280324723 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f810c08b330 con 0x7f811c15e7c0 2024-09-12T02:28:34.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.766+0000 7f81213e1640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f810006be30 0x7f810006e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8118033000 tx=0x7f8118009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:34.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.770+0000 7f8111ffb640 1 -- 172.21.15.181:0/280324723 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f810c059ce0 con 0x7f811c15e7c0 2024-09-12T02:28:34.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.970+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f811c0d2150 con 0x7f811c15e7c0 2024-09-12T02:28:34.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.971+0000 7f8111ffb640 1 -- 172.21.15.181:0/280324723 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7f810c0595e0 con 0x7f811c15e7c0 2024-09-12T02:28:34.972 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:34.972 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:34.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f810006be30 msgr2=0x7f810006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f810006be30 0x7f810006e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8118033000 tx=0x7f8118009000 comp rx=0 tx=0).stop 2024-09-12T02:28:34.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 msgr2=0x7f811c0cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:34.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c0cb580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f810c00d7d0 tx=0x7f810c00dc90 comp rx=0 tx=0).stop 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 shutdown_connections 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f810006be30 0x7f810006e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f811c15f900 0x7f811c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c15e7c0 0x7f811c0cb580 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 --2- 172.21.15.181:0/280324723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f811c0cf480 0x7f811c156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 >> 172.21.15.181:0/280324723 conn(0x7f811c0d1320 msgr2=0x7f811c0d4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 shutdown_connections 2024-09-12T02:28:34.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:34.973+0000 7f8123645640 1 -- 172.21.15.181:0/280324723 wait complete. 2024-09-12T02:28:34.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:35.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.082+0000 7f1ba9723640 1 Processor -- start 2024-09-12T02:28:35.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.082+0000 7f1ba9723640 1 -- start start 2024-09-12T02:28:35.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba9723640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba415eab0 0x7f1ba406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba9723640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1ba40d3480 0x7f1ba40b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba9723640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ba40d17e0 con 0x7f1ba406dae0 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba9723640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1ba40d09d0 con 0x7f1ba40d3480 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba9723640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba415ee90 con 0x7f1ba415eab0 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba415eab0 0x7f1ba406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba37fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1ba40d3480 0x7f1ba40b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba415eab0 0x7f1ba406d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35812/0 (socket says 172.21.15.181:35812) 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.083+0000 7f1ba2ffd640 1 -- 172.21.15.181:0/4145696017 learned_addr learned my addr 172.21.15.181:0/4145696017 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.084+0000 7f1ba37fe640 1 -- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba415eab0 msgr2=0x7f1ba406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:35.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.084+0000 7f1ba37fe640 1 --2- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba415eab0 0x7f1ba406d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.084+0000 7f1ba37fe640 1 -- 172.21.15.181:0/4145696017 >> v1:172.21.15.204:6789/0 conn(0x7f1ba406dae0 legacy=0x7f1ba40b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.084+0000 7f1ba37fe640 1 -- 172.21.15.181:0/4145696017 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba40cfc10 con 0x7f1ba40d3480 2024-09-12T02:28:35.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.084+0000 7f1ba2ffd640 1 --2- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba415eab0 0x7f1ba406d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:35.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba37fe640 1 --2- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba40d3480 0x7f1ba40b8290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009dc0 tx=0x7f1b9c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53880bbac38211 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba1ffb640 1 -- 172.21.15.181:0/4145696017 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c007740 con 0x7f1ba40d3480 2024-09-12T02:28:35.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba1ffb640 1 -- 172.21.15.181:0/4145696017 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9c0078e0 con 0x7f1ba40d3480 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba1ffb640 1 -- 172.21.15.181:0/4145696017 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c007cb0 con 0x7f1ba40d3480 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 -- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba40d3480 msgr2=0x7f1ba40b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 --2- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba40d3480 0x7f1ba40b8290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009dc0 tx=0x7f1b9c02a710 comp rx=0 tx=0).stop 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 -- 172.21.15.181:0/4145696017 shutdown_connections 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 --2- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba40d3480 0x7f1ba40b8290 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 --2- 172.21.15.181:0/4145696017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba415eab0 0x7f1ba406d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 -- 172.21.15.181:0/4145696017 >> 172.21.15.181:0/4145696017 conn(0x7f1ba40d4b30 msgr2=0x7f1ba40d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 -- 172.21.15.181:0/4145696017 shutdown_connections 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.085+0000 7f1ba9723640 1 -- 172.21.15.181:0/4145696017 wait complete. 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 Processor -- start 2024-09-12T02:28:35.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 -- start start 2024-09-12T02:28:35.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba406dae0 0x7f1ba40b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba40d3480 0x7f1ba4157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba415eab0 0x7f1ba41f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba40d01d0 con 0x7f1ba415eab0 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba406df20 con 0x7f1ba406dae0 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.087+0000 7f1ba9723640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba40d04b0 con 0x7f1ba40d3480 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba415eab0 0x7f1ba41f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba415eab0 0x7f1ba41f7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52074/0 (socket says 172.21.15.181:52074) 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 -- 172.21.15.181:0/1295893708 learned_addr learned my addr 172.21.15.181:0/1295893708 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba27fc640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba40d3480 0x7f1ba4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba2ffd640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba406dae0 0x7f1ba40b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 -- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba40d3480 msgr2=0x7f1ba4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba40d3480 0x7f1ba4157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 -- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba406dae0 msgr2=0x7f1ba40b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba406dae0 0x7f1ba40b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 -- 172.21.15.181:0/1295893708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba4158390 con 0x7f1ba415eab0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba37fe640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba415eab0 0x7f1ba41f7180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c02ad00 tx=0x7f1b9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1b8b7fe640 1 -- 172.21.15.181:0/1295893708 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c040070 con 0x7f1ba415eab0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1b8b7fe640 1 -- 172.21.15.181:0/1295893708 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9c031c40 con 0x7f1ba415eab0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba4158670 con 0x7f1ba415eab0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1b8b7fe640 1 -- 172.21.15.181:0/1295893708 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c009450 con 0x7f1ba415eab0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.088+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba4158f10 con 0x7f1ba415eab0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.089+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba4158840 con 0x7f1ba415eab0 2024-09-12T02:28:35.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.090+0000 7f1b8b7fe640 1 -- 172.21.15.181:0/1295893708 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b9c039040 con 0x7f1ba415eab0 2024-09-12T02:28:35.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.090+0000 7f1b8b7fe640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1b9006be30 0x7f1b9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.090+0000 7f1ba2ffd640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1b9006be30 0x7f1b9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.090+0000 7f1b8b7fe640 1 -- 172.21.15.181:0/1295893708 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b9c0ac500 con 0x7f1ba415eab0 2024-09-12T02:28:35.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.091+0000 7f1ba2ffd640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1b9006be30 0x7f1b9006e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b94006ca0 tx=0x7f1b94009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.095+0000 7f1b8b7fe640 1 -- 172.21.15.181:0/1295893708 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b9c07a8f0 con 0x7f1ba415eab0 2024-09-12T02:28:35.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.294+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ba40ceb50 con 0x7f1ba415eab0 2024-09-12T02:28:35.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.294+0000 7f1b8b7fe640 1 -- 172.21.15.181:0/1295893708 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7f1b9c07ebf0 con 0x7f1ba415eab0 2024-09-12T02:28:35.295 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:35.295 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:35.295 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:35.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1b9006be30 msgr2=0x7f1b9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1b9006be30 0x7f1b9006e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b94006ca0 tx=0x7f1b94009240 comp rx=0 tx=0).stop 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba415eab0 msgr2=0x7f1ba41f7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba415eab0 0x7f1ba41f7180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c02ad00 tx=0x7f1b9c004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 shutdown_connections 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1b9006be30 0x7f1b9006e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba415eab0 0x7f1ba41f7180 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ba40d3480 0x7f1ba4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 --2- 172.21.15.181:0/1295893708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ba406dae0 0x7f1ba40b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.296+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 >> 172.21.15.181:0/1295893708 conn(0x7f1ba40d4b30 msgr2=0x7f1ba415d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.297+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 shutdown_connections 2024-09-12T02:28:35.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.297+0000 7f1ba9723640 1 -- 172.21.15.181:0/1295893708 wait complete. 2024-09-12T02:28:35.309 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 Processor -- start 2024-09-12T02:28:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 -- start start 2024-09-12T02:28:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4cc815e640 0x7f4cc80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc80cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4cc80b2cf0 0x7f4cc80b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc80b2860 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc815ea20 con 0x7f4cc815e640 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.406+0000 7f4ccd4d0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc80b1c50 con 0x7f4cc80cf0e0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4cc80b2cf0 0x7f4cc80b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4cc80b2cf0 0x7f4cc80b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52076/0 (socket says 172.21.15.181:52076) 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 -- 172.21.15.181:0/2192941134 learned_addr learned my addr 172.21.15.181:0/2192941134 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc6ffd640 1 --2- 172.21.15.181:0/2192941134 >> v2:172.21.15.204:3300/0 conn(0x7f4cc815e640 0x7f4cc80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc67fc640 1 --2- 172.21.15.181:0/2192941134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc80cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 -- 172.21.15.181:0/2192941134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 msgr2=0x7f4cc80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 --2- 172.21.15.181:0/2192941134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc80cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 -- 172.21.15.181:0/2192941134 >> v2:172.21.15.204:3300/0 conn(0x7f4cc815e640 msgr2=0x7f4cc80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 --2- 172.21.15.181:0/2192941134 >> v2:172.21.15.204:3300/0 conn(0x7f4cc815e640 0x7f4cc80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.407+0000 7f4cc77fe640 1 -- 172.21.15.181:0/2192941134 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc80b1f30 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4cc77fe640 1 --2- 172.21.15.181:0/2192941134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc80b31a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cc808d4c0 tx=0x7f4cc002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ed2655b32c2076 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4cc5ffb640 1 -- 172.21.15.181:0/2192941134 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0036070 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4cc5ffb640 1 -- 172.21.15.181:0/2192941134 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc0031600 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4cc5ffb640 1 -- 172.21.15.181:0/2192941134 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00319d0 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/2192941134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 msgr2=0x7f4cc80b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/2192941134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc80b31a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cc808d4c0 tx=0x7f4cc002a610 comp rx=0 tx=0).stop 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/2192941134 shutdown_connections 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/2192941134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc80b31a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/2192941134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc80cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/2192941134 >> v2:172.21.15.204:3300/0 conn(0x7f4cc815e640 0x7f4cc80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/2192941134 >> 172.21.15.181:0/2192941134 conn(0x7f4cc809d820 msgr2=0x7f4cc80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/2192941134 shutdown_connections 2024-09-12T02:28:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.408+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/2192941134 wait complete. 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 Processor -- start 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 -- start start 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc81f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc8155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cc815e640 0x7f4cc80c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80cfe40 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80b24f0 con 0x7f4cc815e640 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4ccd4d0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc80b73a0 con 0x7f4cc80cf0e0 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4cc6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc81f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4cc6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc81f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52090/0 (socket says 172.21.15.181:52090) 2024-09-12T02:28:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.410+0000 7f4cc6ffd640 1 -- 172.21.15.181:0/1100583687 learned_addr learned my addr 172.21.15.181:0/1100583687 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc67fc640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc8155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc77fe640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cc815e640 0x7f4cc80c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc6ffd640 1 -- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 msgr2=0x7f4cc8155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc6ffd640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc8155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc6ffd640 1 -- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cc815e640 msgr2=0x7f4cc80c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc6ffd640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cc815e640 0x7f4cc80c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc6ffd640 1 -- 172.21.15.181:0/1100583687 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc81f4f10 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4cc6ffd640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc81f49d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4caf7fe640 1 -- 172.21.15.181:0/1100583687 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8017070 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4caf7fe640 1 -- 172.21.15.181:0/1100583687 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb800c9a0 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc80ca050 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4caf7fe640 1 -- 172.21.15.181:0/1100583687 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800cd90 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.411+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc80c82d0 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.412+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc80c80e0 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.413+0000 7f4caf7fe640 1 -- 172.21.15.181:0/1100583687 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cb801a070 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.413+0000 7f4caf7fe640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cb406be30 0x7f4cb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.413+0000 7f4caf7fe640 1 -- 172.21.15.181:0/1100583687 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4cb808ada0 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.413+0000 7f4cc67fc640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cb406be30 0x7f4cb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.413+0000 7f4cc67fc640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cb406be30 0x7f4cb406e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80cb230 tx=0x7f4cbc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.417+0000 7f4caf7fe640 1 -- 172.21.15.181:0/1100583687 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cc81f4f10 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.586+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc80d3980 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.587+0000 7f4caf7fe640 1 -- 172.21.15.181:0/1100583687 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16737 (secure 0 0 0) 0x7f4cb8059100 con 0x7f4cc80b2cf0 2024-09-12T02:28:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:35.588 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:23.452762+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:35.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cb406be30 msgr2=0x7f4cb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cb406be30 0x7f4cb406e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80cb230 tx=0x7f4cbc009190 comp rx=0 tx=0).stop 2024-09-12T02:28:35.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 msgr2=0x7f4cc81f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc81f49d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ee70 comp rx=0 tx=0).stop 2024-09-12T02:28:35.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 shutdown_connections 2024-09-12T02:28:35.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cb406be30 0x7f4cb406e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cc815e640 0x7f4cc80c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cc80cf0e0 0x7f4cc8155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 --2- 172.21.15.181:0/1100583687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc80b2cf0 0x7f4cc81f49d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 >> 172.21.15.181:0/1100583687 conn(0x7f4cc809d820 msgr2=0x7f4cc80d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:35.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 shutdown_connections 2024-09-12T02:28:35.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.589+0000 7f4ccd4d0640 1 -- 172.21.15.181:0/1100583687 wait complete. 2024-09-12T02:28:35.601 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:35.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.698+0000 7ffbea4f1640 1 Processor -- start 2024-09-12T02:28:35.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.698+0000 7ffbea4f1640 1 -- start start 2024-09-12T02:28:35.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbea4f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415eab0 0x7ffbe406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbea4f1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbe406dae0 0x7ffbe40b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbea4f1640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe40d17e0 con 0x7ffbe40b80c0 2024-09-12T02:28:35.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbea4f1640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ffbe40d09d0 con 0x7ffbe406dae0 2024-09-12T02:28:35.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbea4f1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe415ee90 con 0x7ffbe415eab0 2024-09-12T02:28:35.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbe3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415eab0 0x7ffbe406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbdbfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbe406dae0 0x7ffbe40b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbe3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415eab0 0x7ffbe406d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35862/0 (socket says 172.21.15.181:35862) 2024-09-12T02:28:35.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbe3fff640 1 -- 172.21.15.181:0/2372121434 learned_addr learned my addr 172.21.15.181:0/2372121434 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:35.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.699+0000 7ffbe8a8e640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7ffbe40b80c0 0x7ffbe40b8570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:38460/0 (socket says 172.21.15.181:38460) 2024-09-12T02:28:35.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.700+0000 7ffbdbfff640 1 -- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415eab0 msgr2=0x7ffbe406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:35.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.700+0000 7ffbdbfff640 1 --2- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415eab0 0x7ffbe406d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.700+0000 7ffbdbfff640 1 -- 172.21.15.181:0/2372121434 >> v1:172.21.15.204:6789/0 conn(0x7ffbe40b80c0 legacy=0x7ffbe40b8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.700+0000 7ffbdbfff640 1 -- 172.21.15.181:0/2372121434 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe40cfc10 con 0x7ffbe406dae0 2024-09-12T02:28:35.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.700+0000 7ffbe3fff640 1 --2- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415eab0 0x7ffbe406d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:35.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbdbfff640 1 --2- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 0x7ffbe40b7b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0097d0 tx=0x7ffbcc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50d21db561f1d077 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbe37fe640 1 -- 172.21.15.181:0/2372121434 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc037070 con 0x7ffbe406dae0 2024-09-12T02:28:35.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbe37fe640 1 -- 172.21.15.181:0/2372121434 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc032440 con 0x7ffbe406dae0 2024-09-12T02:28:35.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbe37fe640 1 -- 172.21.15.181:0/2372121434 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc032810 con 0x7ffbe406dae0 2024-09-12T02:28:35.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 -- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 msgr2=0x7ffbe40b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 0x7ffbe40b7b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0097d0 tx=0x7ffbcc02a250 comp rx=0 tx=0).stop 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 -- 172.21.15.181:0/2372121434 shutdown_connections 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 0x7ffbe40b7b80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/2372121434 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe415eab0 0x7ffbe406d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 -- 172.21.15.181:0/2372121434 >> 172.21.15.181:0/2372121434 conn(0x7ffbe40d4b30 msgr2=0x7ffbe40d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 -- 172.21.15.181:0/2372121434 shutdown_connections 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.701+0000 7ffbea4f1640 1 -- 172.21.15.181:0/2372121434 wait complete. 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.702+0000 7ffbea4f1640 1 Processor -- start 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbea4f1640 1 -- start start 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbea4f1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 0x7ffbe41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbea4f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe40b80c0 0x7ffbe41eb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbea4f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbe415eab0 0x7ffbe40cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbea4f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe40d01d0 con 0x7ffbe415eab0 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbea4f1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe406df20 con 0x7ffbe406dae0 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbea4f1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe40d04b0 con 0x7ffbe40b80c0 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbe8a8e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbe415eab0 0x7ffbe40cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbe8a8e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbe415eab0 0x7ffbe40cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52106/0 (socket says 172.21.15.181:52106) 2024-09-12T02:28:35.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.703+0000 7ffbe8a8e640 1 -- 172.21.15.181:0/285269216 learned_addr learned my addr 172.21.15.181:0/285269216 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:35.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbdbfff640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe40b80c0 0x7ffbe41eb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe3fff640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 0x7ffbe41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe8a8e640 1 -- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe40b80c0 msgr2=0x7ffbe41eb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe8a8e640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe40b80c0 0x7ffbe41eb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe8a8e640 1 -- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 msgr2=0x7ffbe41588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe8a8e640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 0x7ffbe41588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe8a8e640 1 -- 172.21.15.181:0/285269216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe41602b0 con 0x7ffbe415eab0 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe8a8e640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbe415eab0 0x7ffbe40cd5e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00c780 tx=0x7ffbdc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe17fa640 1 -- 172.21.15.181:0/285269216 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc017070 con 0x7ffbe415eab0 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe17fa640 1 -- 172.21.15.181:0/285269216 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00a5e0 con 0x7ffbe415eab0 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe4160590 con 0x7ffbe415eab0 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbe17fa640 1 -- 172.21.15.181:0/285269216 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00a9d0 con 0x7ffbe415eab0 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.704+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe4160b50 con 0x7ffbe415eab0 2024-09-12T02:28:35.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.705+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe4160d50 con 0x7ffbe415eab0 2024-09-12T02:28:35.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.706+0000 7ffbe17fa640 1 -- 172.21.15.181:0/285269216 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbdc01a070 con 0x7ffbe415eab0 2024-09-12T02:28:35.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.706+0000 7ffbe17fa640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffbc406be30 0x7ffbc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.706+0000 7ffbe17fa640 1 -- 172.21.15.181:0/285269216 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffbdc08a350 con 0x7ffbe415eab0 2024-09-12T02:28:35.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.706+0000 7ffbe3fff640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffbc406be30 0x7ffbc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.706+0000 7ffbe3fff640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffbc406be30 0x7ffbc406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b9610 tx=0x7ffbd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:35.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.710+0000 7ffbe17fa640 1 -- 172.21.15.181:0/285269216 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbe4160d50 con 0x7ffbe415eab0 2024-09-12T02:28:35.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.906+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbe40b31c0 con 0x7ffbe415eab0 2024-09-12T02:28:35.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.906+0000 7ffbe17fa640 1 -- 172.21.15.181:0/285269216 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7ffbdc0586b0 con 0x7ffbe415eab0 2024-09-12T02:28:35.907 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:35.907 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:35.907 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffbc406be30 msgr2=0x7ffbc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffbc406be30 0x7ffbc406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b9610 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbe415eab0 msgr2=0x7ffbe40cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbe415eab0 0x7ffbe40cd5e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00c780 tx=0x7ffbdc00cc40 comp rx=0 tx=0).stop 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 shutdown_connections 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffbc406be30 0x7ffbc406e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbe415eab0 0x7ffbe40cd5e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbe40b80c0 0x7ffbe41eb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 --2- 172.21.15.181:0/285269216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbe406dae0 0x7ffbe41588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.908+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 >> 172.21.15.181:0/285269216 conn(0x7ffbe40d4b30 msgr2=0x7ffbe40b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.909+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 shutdown_connections 2024-09-12T02:28:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:35.909+0000 7ffbea4f1640 1 -- 172.21.15.181:0/285269216 wait complete. 2024-09-12T02:28:36.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:28:21.776422+0000', 'modified': '2024-09-12T02:28:23.784945+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.181:6837/3219847583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3219847583}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3219847583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-09-12T02:28:36.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:28:36.323 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:28:36.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.423+0000 7f7dd1c7b640 1 Processor -- start 2024-09-12T02:28:36.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.424+0000 7f7dd1c7b640 1 -- start start 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.424+0000 7f7dd1c7b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7dcc15c4a0 0x7f7dcc0cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.424+0000 7f7dd1c7b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0d0a30 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.424+0000 7f7dd1c7b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0b76f0 con 0x7f7dcc0b47a0 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.424+0000 7f7dd1c7b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc0d0d30 con 0x7f7dcc15c4a0 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.424+0000 7f7dcb7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7dcc15c4a0 0x7f7dcc0cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.425+0000 7f7dc2ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7dcc0d2da0 0x7f7dcc0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54448/0 (socket says 172.21.15.181:54448) 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.425+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/1512566082 learned_addr learned my addr 172.21.15.181:0/1512566082 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.425+0000 7f7dcb7fe640 1 -- 172.21.15.181:0/1512566082 >> v1:172.21.15.204:6789/0 conn(0x7f7dcc0b47a0 legacy=0x7f7dcc166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.425+0000 7f7dcb7fe640 1 -- 172.21.15.181:0/1512566082 >> v1:172.21.15.181:6789/0 conn(0x7f7dcc0d2da0 legacy=0x7f7dcc0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.425+0000 7f7dcb7fe640 1 -- 172.21.15.181:0/1512566082 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc073710 con 0x7f7dcc15c4a0 2024-09-12T02:28:36.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.425+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/1512566082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc15c4a0 0x7f7dcc0cff80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097a0 tx=0x7f7dbc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b724b386b87cc313 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dcaffd640 1 -- 172.21.15.181:0/1512566082 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc037070 con 0x7f7dcc15c4a0 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dcaffd640 1 -- 172.21.15.181:0/1512566082 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dbc02ae50 con 0x7f7dcc15c4a0 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dcaffd640 1 -- 172.21.15.181:0/1512566082 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc032660 con 0x7f7dcc15c4a0 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/1512566082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc15c4a0 msgr2=0x7f7dcc0cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/1512566082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc15c4a0 0x7f7dcc0cff80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097a0 tx=0x7f7dbc02a140 comp rx=0 tx=0).stop 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/1512566082 shutdown_connections 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/1512566082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc15c4a0 0x7f7dcc0cff80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/1512566082 >> 172.21.15.181:0/1512566082 conn(0x7f7dcc067950 msgr2=0x7f7dcc067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/1512566082 shutdown_connections 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.426+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/1512566082 wait complete. 2024-09-12T02:28:36.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.427+0000 7f7dd1c7b640 1 Processor -- start 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dd1c7b640 1 -- start start 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dd1c7b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dcc0b47a0 0x7f7dcc141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dd1c7b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc0d2da0 0x7f7dcc152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dd1c7b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dcc15c4a0 0x7f7dcc152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dd1c7b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc15c880 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dd1c7b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0d28e0 con 0x7f7dcc0b47a0 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dd1c7b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc15ca00 con 0x7f7dcc15c4a0 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dc2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc0d2da0 0x7f7dcc152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dc2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc0d2da0 0x7f7dcc152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52132/0 (socket says 172.21.15.181:52132) 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.428+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/2522940728 learned_addr learned my addr 172.21.15.181:0/2522940728 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dcc15c4a0 0x7f7dcc152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dcc0b47a0 0x7f7dcc141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dcc15c4a0 msgr2=0x7f7dcc152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dcc15c4a0 0x7f7dcc152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dcc0b47a0 msgr2=0x7f7dcc141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dcc0b47a0 0x7f7dcc141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/2522940728 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0aa650 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dcc15c4a0 0x7f7dcc152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dcc0b47a0 0x7f7dcc141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc0d2da0 0x7f7dcc152630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c440 tx=0x7f7db4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/2522940728 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4017070 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/2522940728 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db4005ce0 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc0aa930 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/2522940728 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db40072f0 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.429+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc0aaef0 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.431+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/2522940728 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7db401a070 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.431+0000 7f7dc8ff9640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dac06be30 0x7f7dac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.431+0000 7f7dc8ff9640 1 -- 172.21.15.181:0/2522940728 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7db408a160 con 0x7f7dcc0d2da0 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.431+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dac06be30 0x7f7dac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.432+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dac06be30 0x7f7dac06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc034000 tx=0x7f7dbc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.432+0000 7f7dd4a1b740 1 Processor -- start 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.432+0000 7f7dd4a1b740 1 -- start start 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a39087a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a3903fa80 0x562a390426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3903c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a38fa4520 con 0x562a3903fa80 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562a38f4c3e0 con 0x562a39043a50 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562a38fa04e0 con 0x562a390422c0 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a3903fa80 0x562a390426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a3903fa80 0x562a390426a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52138/0 (socket says 172.21.15.181:52138) 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/1795437585 learned_addr learned my addr 172.21.15.181:0/1795437585 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a39087a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3903c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 msgr2=0x562a39087a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a39087a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 msgr2=0x562a3903c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3903c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/1795437585 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a38f672f0 con 0x562a3903fa80 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3903c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.433+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a3903fa80 0x562a390426a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7db40886c0 tx=0x7f7db40583a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c483fe4e5956854 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dc17fa640 1 -- 172.21.15.181:0/1795437585 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4061080 con 0x562a3903fa80 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dc17fa640 1 -- 172.21.15.181:0/1795437585 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40567a0 con 0x562a3903fa80 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dc17fa640 1 -- 172.21.15.181:0/1795437585 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4007490 con 0x562a3903fa80 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/1795437585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a3903fa80 msgr2=0x562a390426a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a3903fa80 0x562a390426a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7db40886c0 tx=0x7f7db40583a0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/1795437585 shutdown_connections 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3903c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a3903fa80 0x562a390426a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/1795437585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a39087a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/1795437585 >> 172.21.15.181:0/1795437585 conn(0x562a3903ea80 msgr2=0x562a39086f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/1795437585 shutdown_connections 2024-09-12T02:28:36.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.434+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/1795437585 wait complete. 2024-09-12T02:28:36.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.435+0000 7f7dd4a1b740 1 -- start start 2024-09-12T02:28:36.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.435+0000 7f7dd4a1b740 1 Processor -- start 2024-09-12T02:28:36.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a390422c0 0x562a3905de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3906bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39097730 0x562a39063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a3903df20 con 0x562a390422c0 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562a38f2d450 con 0x562a39043a50 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562a39088290 con 0x562a39097730 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 10 client.0 _ll_register_callbacks cb 0x562a38cb6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a390422c0 0x562a3905de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a390422c0 0x562a3905de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52142/0 (socket says 172.21.15.181:52142) 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 -- 172.21.15.181:0/2971659338 learned_addr learned my addr 172.21.15.181:0/2971659338 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3906bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39097730 0x562a39063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 -- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39097730 msgr2=0x562a39063ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39097730 0x562a39063ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 -- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 msgr2=0x562a3906bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3906bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 -- 172.21.15.181:0/2971659338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a38cb72d0 con 0x562a390422c0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3906bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a390422c0 0x562a3905de60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0098c0 tx=0x7f7dbc02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb1e4f50797895 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7daa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7daa7fc640 1 -- 172.21.15.181:0/2971659338 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc050060 con 0x562a390422c0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7daa7fc640 1 -- 172.21.15.181:0/2971659338 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7dbc04b480 con 0x562a390422c0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.436+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7db40567a0 con 0x562a390422c0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7daa7fc640 1 -- 172.21.15.181:0/2971659338 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f7dbc056050 con 0x562a390422c0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 10 client.4623 fetch_fsmap learned FSMap version 6 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x562a38d816b0 con 0x562a390422c0 2024-09-12T02:28:36.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7daa7fc640 1 -- 172.21.15.181:0/2971659338 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40567a0 con 0x562a390422c0 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7daa7fc640 1 -- 172.21.15.181:0/2971659338 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f7dbc059020 con 0x562a390422c0 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 10 client.4623 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 10 client.4623 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 20 client.4623 populate_metadata read hostname 'smithi181' 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a39061d40 0x562a39062120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 4 client.4623 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 --> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a38fb1c50 con 0x562a39061d40 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a39061d40 0x562a39062120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7daa7fc640 10 client.4623 ms_handle_connect on v2:172.21.15.181:6836/3219847583 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.437+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a39061d40 0x562a39062120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff23628ddbacfee4 server_cookie=401c31e0f5bcb7 in_seq=0 out_seq=0 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7daa7fc640 1 -- 172.21.15.181:0/2971659338 <== mds.0 v2:172.21.15.181:6836/3219847583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a38fb1c50 con 0x562a39061d40 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7daa7fc640 10 client.4623 handle_command_reply: tid=0 2024-09-12T02:28:36.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 client.4623 shutdown 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a390422c0 msgr2=0x562a3905de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a390422c0 0x562a3905de60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0098c0 tx=0x7f7dbc02c070 comp rx=0 tx=0).stop 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 shutdown_connections 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a39061d40 0x562a39062120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39043a50 0x562a3906bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39097730 0x562a39063ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7daa7fc640 0 client.4623 ms_handle_reset on v2:172.21.15.181:6836/3219847583 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/2971659338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a390422c0 0x562a3905de60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 >> 172.21.15.181:0/2971659338 conn(0x562a3903fa80 msgr2=0x562a39085f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 shutdown_connections 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/2971659338 wait complete. 2024-09-12T02:28:36.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.438+0000 7f7dd4a1b740 20 client.4623 trim_cache size 0 max 16384 2024-09-12T02:28:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.456+0000 7f7dd4a1b740 1 Processor -- start 2024-09-12T02:28:36.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.456+0000 7f7dd4a1b740 1 -- start start 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.456+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a390422c0 0x562a390670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39043a50 0x562a39088a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39097730 0x562a3909a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1fe950 con 0x562a39097730 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0ac510 con 0x562a390422c0 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc0b6240 con 0x562a39043a50 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39097730 0x562a3909a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39097730 0x562a3909a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52150/0 (socket says 172.21.15.181:52150) 2024-09-12T02:28:36.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 -- 172.21.15.181:0/593893446 learned_addr learned my addr 172.21.15.181:0/593893446 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a390422c0 0x562a390670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39043a50 0x562a39088a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 -- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39043a50 msgr2=0x562a39088a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39043a50 0x562a39088a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 -- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a390422c0 msgr2=0x562a390670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a390422c0 0x562a390670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 -- 172.21.15.181:0/593893446 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a39068080 con 0x562a39097730 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a390422c0 0x562a390670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39097730 0x562a3909a1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b4c70 tx=0x7f7dc40056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7a9e16fa5aea4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dc0ff9640 1 -- 172.21.15.181:0/593893446 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4006d20 con 0x562a39097730 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dc0ff9640 1 -- 172.21.15.181:0/593893446 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4001b40 con 0x562a39097730 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.457+0000 7f7dc0ff9640 1 -- 172.21.15.181:0/593893446 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4001cf0 con 0x562a39097730 2024-09-12T02:28:36.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/593893446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39097730 msgr2=0x562a3909a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39097730 0x562a3909a1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b4c70 tx=0x7f7dc40056a0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/593893446 shutdown_connections 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39097730 0x562a3909a1c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a39043a50 0x562a39088a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/593893446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a390422c0 0x562a390670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/593893446 >> 172.21.15.181:0/593893446 conn(0x562a3903fa80 msgr2=0x562a390432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/593893446 shutdown_connections 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/593893446 wait complete. 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.458+0000 7f7dd4a1b740 1 -- start start 2024-09-12T02:28:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 1 Processor -- start 2024-09-12T02:28:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a390eeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39043a50 0x562a39105850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39097730 0x562a39068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a390638d0 con 0x562a39043a50 2024-09-12T02:28:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0abec0 con 0x562a39097730 2024-09-12T02:28:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562a3903c6f0 con 0x562a390422c0 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dd4a1b740 10 client.0 _ll_register_callbacks cb 0x7f7dbc009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dc2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39043a50 0x562a39105850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dc2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39043a50 0x562a39105850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52164/0 (socket says 172.21.15.181:52164) 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/77038959 learned_addr learned my addr 172.21.15.181:0/77038959 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a390eeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.459+0000 7f7dcbfff640 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39097730 0x562a39068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 msgr2=0x562a390eeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a390eeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39097730 msgr2=0x562a39068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39097730 0x562a39068ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dc2ffd640 1 -- 172.21.15.181:0/77038959 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a390670e0 con 0x562a39043a50 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dc2ffd640 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39043a50 0x562a39105850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7db4058660 tx=0x7f7db4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb8cd4bf47a903d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7daa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:28:36.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7daa7fc640 1 -- 172.21.15.181:0/77038959 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4054740 con 0x562a39043a50 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7daa7fc640 1 -- 172.21.15.181:0/77038959 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7db4054b10 con 0x562a39043a50 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dc4001b40 con 0x562a39043a50 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7daa7fc640 1 -- 172.21.15.181:0/77038959 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f7db40565c0 con 0x562a39043a50 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 10 client.4629 fetch_fsmap learned FSMap version 6 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x562a39067400 con 0x562a39043a50 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7daa7fc640 1 -- 172.21.15.181:0/77038959 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4001b40 con 0x562a39043a50 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7daa7fc640 1 -- 172.21.15.181:0/77038959 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f7db40772d0 con 0x562a39043a50 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 10 client.4629 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 10 client.4629 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 20 client.4629 populate_metadata read hostname 'smithi181' 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a390836d0 0x562a39083ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 4 client.4629 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:28:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 --> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] -- command(tid 0: {"prefix": "status"}) -- 0x562a38fabfa0 con 0x562a390836d0 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.460+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a390836d0 0x562a39083ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7daa7fc640 10 client.4629 ms_handle_connect on v2:172.21.15.181:6836/3219847583 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dcb7fe640 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a390836d0 0x562a39083ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e02e95c8a44278 server_cookie=626a37424cfc6c45 in_seq=0 out_seq=0 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7daa7fc640 1 -- 172.21.15.181:0/77038959 <== mds.0 v2:172.21.15.181:6836/3219847583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x562a38fabfa0 con 0x562a390836d0 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7daa7fc640 10 client.4629 handle_command_reply: tid=0 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 client.4629 shutdown 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39043a50 msgr2=0x562a39105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39043a50 0x562a39105850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7db4058660 tx=0x7f7db4014040 comp rx=0 tx=0).stop 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 shutdown_connections 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:6836/3219847583,v1:172.21.15.181:6837/3219847583] conn(0x562a390836d0 0x562a39083ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a39097730 0x562a39068ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a39043a50 0x562a39105850 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 --2- 172.21.15.181:0/77038959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a390422c0 0x562a390eeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 >> 172.21.15.181:0/77038959 conn(0x562a3903fa80 msgr2=0x562a3906b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7daa7fc640 0 client.4629 ms_handle_reset on v2:172.21.15.181:6836/3219847583 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 shutdown_connections 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 1 -- 172.21.15.181:0/77038959 wait complete. 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd4a1b740 20 client.4629 trim_cache size 0 max 16384 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:28:36.469 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 4284, 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 14.008492748, 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 6, 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 21, 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 21, 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 19.231196936 2024-09-12T02:28:36.470 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.461+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dac06be30 msgr2=0x7f7dac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dac06be30 0x7f7dac06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc034000 tx=0x7f7dbc02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc0d2da0 msgr2=0x7f7dcc152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc0d2da0 0x7f7dcc152630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c440 tx=0x7f7db4001e70 comp rx=0 tx=0).stop 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 shutdown_connections 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dac06be30 0x7f7dac06e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dcc15c4a0 0x7f7dcc152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dcc0d2da0 0x7f7dcc152630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 --2- 172.21.15.181:0/2522940728 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dcc0b47a0 0x7f7dcc141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 >> 172.21.15.181:0/2522940728 conn(0x7f7dcc067950 msgr2=0x7f7dcc0cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 shutdown_connections 2024-09-12T02:28:36.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.462+0000 7f7dd1c7b640 1 -- 172.21.15.181:0/2522940728 wait complete. 2024-09-12T02:28:36.473 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:28:36.486 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:28:36.486 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:28:36.487 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:28:36.487 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T02:28:36.515 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T02:28:36.515 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-12T02:28:36.515 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:36.516 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:36.516 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:36.516 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:28:36.516 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:36.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:36.517 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:28:36.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:36.533 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-09-12T02:28:36.599 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-09-12T02:28:36.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:28:36.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:36.601 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-09-12T02:28:36.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:36.620 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-09-12T02:28:36.693 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2024-09-12T02:28:36.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:28:36.695 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T02:28:36.695 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T02:28:36.695 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:28:36.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.793+0000 7f6836191640 1 Processor -- start 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.793+0000 7f6836191640 1 -- start start 2024-09-12T02:28:36.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f6836191640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 0x7f68300d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f6836191640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683006cec0 con 0x7f683015e8c0 2024-09-12T02:28:36.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f6836191640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683006d160 con 0x7f683015e4e0 2024-09-12T02:28:36.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f6836191640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f68300d2d40 con 0x7f68300b6ee0 2024-09-12T02:28:36.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682effd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f683015e8c0 0x7f68300d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54464/0 (socket says 172.21.15.181:54464) 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682effd640 1 -- 172.21.15.181:0/1171224776 learned_addr learned my addr 172.21.15.181:0/1171224776 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434258975 0 0) 0x7f683006cec0 con 0x7f683015e8c0 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682ffff640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 0x7f68300d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f681c003520 con 0x7f683015e8c0 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3118520712 0 0) 0x7f681c003520 con 0x7f683015e8c0 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 msgr2=0x7f68300d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 0x7f68300d26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 >> v1:172.21.15.204:6789/0 conn(0x7f683015e4e0 legacy=0x7f68300b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683006d440 con 0x7f683015e8c0 2024-09-12T02:28:36.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f6818001670 con 0x7f683015e8c0 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 >> v1:172.21.15.181:6789/0 conn(0x7f683015e8c0 legacy=0x7f68300d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c0039e0 0x7f681c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 0x7f681c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f681c004d40 0x7f681c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f68300d2d40 con 0x7f681c004d40 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f681c00baf0 con 0x7f681c0039e0 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f681c00bcf0 con 0x7f68300b6ee0 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682ffff640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f681c004d40 0x7f681c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.794+0000 7f682f7fe640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c0039e0 0x7f681c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682effd640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 0x7f681c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682ffff640 1 -- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 msgr2=0x7f681c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682ffff640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68300b6ee0 0x7f681c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682ffff640 1 -- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c0039e0 msgr2=0x7f681c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682ffff640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c0039e0 0x7f681c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682ffff640 1 -- 172.21.15.181:0/1171224776 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681c003520 con 0x7f681c004d40 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682ffff640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f681c004d40 0x7f681c0051c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6828009fc0 tx=0x7f681c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104ed5490dee547b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.795+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828009c10 con 0x7f681c004d40 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6828036070 con 0x7f681c004d40 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f682e7fc640 1 -- 172.21.15.181:0/1171224776 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828031880 con 0x7f681c004d40 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f6836191640 1 -- 172.21.15.181:0/1171224776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f681c004d40 msgr2=0x7f681c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f6836191640 1 --2- 172.21.15.181:0/1171224776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f681c004d40 0x7f681c0051c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6828009fc0 tx=0x7f681c005830 comp rx=0 tx=0).stop 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f682ffff640 1 -- 172.21.15.181:0/1171224776 reap_dead start 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f6836191640 1 -- 172.21.15.181:0/1171224776 shutdown_connections 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f6836191640 1 -- 172.21.15.181:0/1171224776 >> 172.21.15.181:0/1171224776 conn(0x7f683006f400 msgr2=0x7f683006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f6836191640 1 -- 172.21.15.181:0/1171224776 shutdown_connections 2024-09-12T02:28:36.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.796+0000 7f6836191640 1 -- 172.21.15.181:0/1171224776 wait complete. 2024-09-12T02:28:36.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.797+0000 7f6836191640 1 Processor -- start 2024-09-12T02:28:36.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.797+0000 7f6836191640 1 -- start start 2024-09-12T02:28:36.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f6836191640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c004d40 0x7f6830148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f6836191640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f683014be10 0x7f683014c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f6836191640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68300b0e50 0x7f68300b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f6836191640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f68300d26d0 con 0x7f68300b0e50 2024-09-12T02:28:36.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f6836191640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f683006ec50 con 0x7f681c004d40 2024-09-12T02:28:36.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f6836191640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f68300d2850 con 0x7f683014be10 2024-09-12T02:28:36.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f682ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68300b0e50 0x7f68300b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f682ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68300b0e50 0x7f68300b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52188/0 (socket says 172.21.15.181:52188) 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f682ffff640 1 -- 172.21.15.181:0/4172664596 learned_addr learned my addr 172.21.15.181:0/4172664596 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f682f7fe640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c004d40 0x7f6830148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.798+0000 7f682effd640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f683014be10 0x7f683014c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f682ffff640 1 -- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f683014be10 msgr2=0x7f683014c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f682ffff640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f683014be10 0x7f683014c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f682ffff640 1 -- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c004d40 msgr2=0x7f6830148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f682ffff640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c004d40 0x7f6830148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f682ffff640 1 -- 172.21.15.181:0/4172664596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6830149280 con 0x7f68300b0e50 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f682ffff640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68300b0e50 0x7f68300b1290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f682802aee0 tx=0x7f6828009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f6827fff640 1 -- 172.21.15.181:0/4172664596 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828009c10 con 0x7f68300b0e50 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f6827fff640 1 -- 172.21.15.181:0/4172664596 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6828040030 con 0x7f68300b0e50 2024-09-12T02:28:36.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6830156480 con 0x7f68300b0e50 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f6827fff640 1 -- 172.21.15.181:0/4172664596 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828003bb0 con 0x7f68300b0e50 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.799+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6830156a40 con 0x7f68300b0e50 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.800+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683015b920 con 0x7f68300b0e50 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.800+0000 7f6827fff640 1 -- 172.21.15.181:0/4172664596 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6828005d10 con 0x7f68300b0e50 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.801+0000 7f6827fff640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f681006be30 0x7f681006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.801+0000 7f6827fff640 1 -- 172.21.15.181:0/4172664596 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f68280ac050 con 0x7f68300b0e50 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.801+0000 7f682f7fe640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f681006be30 0x7f681006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.801+0000 7f682f7fe640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f681006be30 0x7f681006e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f68200017e0 tx=0x7f6820009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:36.805+0000 7f6827fff640 1 -- 172.21.15.181:0/4172664596 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f682804a020 con 0x7f68300b0e50 2024-09-12T02:28:37.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.001+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f683015b640 con 0x7f68300b0e50 2024-09-12T02:28:37.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.001+0000 7f6827fff640 1 -- 172.21.15.181:0/4172664596 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f6830149280 con 0x7f68300b0e50 2024-09-12T02:28:37.002 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:28:37.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f681006be30 msgr2=0x7f681006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:37.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f681006be30 0x7f681006e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f68200017e0 tx=0x7f6820009040 comp rx=0 tx=0).stop 2024-09-12T02:28:37.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68300b0e50 msgr2=0x7f68300b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:37.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68300b0e50 0x7f68300b1290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f682802aee0 tx=0x7f6828009750 comp rx=0 tx=0).stop 2024-09-12T02:28:37.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 shutdown_connections 2024-09-12T02:28:37.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f681006be30 0x7f681006e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68300b0e50 0x7f68300b1290 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f683014be10 0x7f683014c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 --2- 172.21.15.181:0/4172664596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f681c004d40 0x7f6830148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 >> 172.21.15.181:0/4172664596 conn(0x7f683006f400 msgr2=0x7f683015d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:37.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 shutdown_connections 2024-09-12T02:28:37.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37.003+0000 7f6836191640 1 -- 172.21.15.181:0/4172664596 wait complete. 2024-09-12T02:28:37.015 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:28:37.015 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:28:37.015 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:28:37.015 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:28:37.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:37.015 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:28:37.015 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:28:37.016 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:28:37.016 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:28:37.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:37.016 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:28:37.031 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:37.031 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:37.032 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:28:37.033 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:37.033 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:28:37.033 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42726sec preferred_lft 42726sec 2024-09-12T02:28:37.033 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:28:37.033 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:37.033 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:28:37.033 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:37.033 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:37.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:28:37.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr flush dev ceph-brx 2024-09-12T02:28:37.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set ceph-brx up 2024-09-12T02:28:37.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:28:37.034 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:37.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:37.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:37.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:37.245 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:28:37.270 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:28:37.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:37.272 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:28:37.344 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:28:37.344 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:28:37.344 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:28:37.345 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:28:37.345 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:28:37.345 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:37.345 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:37.345 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:28:37.345 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:28:37.345 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:28:37.346 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:37.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:37.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:37.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:37.635 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:28:37.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:37.651 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-09-12T02:28:37.706 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:37.706 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:37.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:37.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:28:37.706 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:37.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:37.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:37.823 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:28:37.824 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:37.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:37.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:37.948 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:37.948 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:37.948 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:28:37.948 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:28:37.948 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:37.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:38.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:38.024 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:28:38.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:38.025 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:38.040 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:28:38.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:38.040 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:38.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:28:38.160 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:38.216 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:28:38.216 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:28:38.216 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:28:38.217 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:28:38.218 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:28:38.219 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:28:38.219 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:38.219 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:38.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:38.220 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:28:38.274 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:28:38.275 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:28:38.317 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:28:38.341 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:38.399 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:28:38.400 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:38.401 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:38.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:38.403 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:28:38.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:28:38.404+0000 7f2d4d21b480 -1 init, newargv = 0x561b1be73c40 newargc=15 2024-09-12T02:28:38.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[44811]: starting ceph client 2024-09-12T02:28:38.410 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[44811]: starting fuse 2024-09-12T02:28:38.420 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:28:38.420 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:28:38.420 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:28:38.420 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:28:38.420 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:28:38.420 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:28:38.420 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:28:38.420 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:28:38.421 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:28:38.422 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:28:38.422 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:28:38.422 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:28:38.422 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:38.422 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:28:38.422 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:28:38.538 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.44811.asok 2024-09-12T02:28:38.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:38.548 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44811.asok 2024-09-12T02:28:38.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:38.548 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44811.asok status 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "44811", 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:28:38.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 4641, 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4641 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 4183733863 2024-09-12T02:28:38.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 4183733863 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.4641 192.168.0.1:0/4183733863", 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/4183733863", 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 6, 2024-09-12T02:28:38.684 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 21, 2024-09-12T02:28:38.685 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:28:38.685 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:28:38.685 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:28:38.685 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:28:38.690 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T02:28:38.690 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:28:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.788+0000 7f7e447fd640 1 Processor -- start 2024-09-12T02:28:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.788+0000 7f7e447fd640 1 -- start start 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e447fd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e3c15b1e0 0x7f7e3c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e447fd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7e3c0b41d0 0x7f7e3c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e447fd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3c0ce480 con 0x7f7e3c0cdfc0 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e447fd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7e3c0ce760 con 0x7f7e3c0b41d0 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e447fd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7e3c0cea40 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e42d9a640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7e3c0cdfc0 0x7f7e3c0ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54478/0 (socket says 172.21.15.181:54478) 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e42d9a640 1 -- 172.21.15.181:0/2283972248 learned_addr learned my addr 172.21.15.181:0/2283972248 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e41d98640 1 --2- 172.21.15.181:0/2283972248 >> v2:172.21.15.181:3300/0 conn(0x7f7e3c0b41d0 0x7f7e3c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e42599640 1 --2- 172.21.15.181:0/2283972248 >> v2:172.21.15.204:3300/0 conn(0x7f7e3c15b1e0 0x7f7e3c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e41d98640 1 -- 172.21.15.181:0/2283972248 >> v2:172.21.15.204:3300/0 conn(0x7f7e3c15b1e0 msgr2=0x7f7e3c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e41d98640 1 --2- 172.21.15.181:0/2283972248 >> v2:172.21.15.204:3300/0 conn(0x7f7e3c15b1e0 0x7f7e3c0b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e41d98640 1 -- 172.21.15.181:0/2283972248 >> v1:172.21.15.181:6789/0 conn(0x7f7e3c0cdfc0 legacy=0x7f7e3c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e41597640 1 -- 172.21.15.181:0/2283972248 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682155729 0 0) 0x7f7e3c0ce480 con 0x7f7e3c0cdfc0 2024-09-12T02:28:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.789+0000 7f7e41d98640 1 -- 172.21.15.181:0/2283972248 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c0ced20 con 0x7f7e3c0b41d0 2024-09-12T02:28:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.790+0000 7f7e41d98640 1 --2- 172.21.15.181:0/2283972248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c0b41d0 0x7f7e3c0b1d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c069550 tx=0x7f7e2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2653b079e7801be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.790+0000 7f7e41597640 1 -- 172.21.15.181:0/2283972248 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c037070 con 0x7f7e3c0b41d0 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.790+0000 7f7e41597640 1 -- 172.21.15.181:0/2283972248 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c032440 con 0x7f7e3c0b41d0 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.790+0000 7f7e41597640 1 -- 172.21.15.181:0/2283972248 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c032810 con 0x7f7e3c0b41d0 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 -- 172.21.15.181:0/2283972248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c0b41d0 msgr2=0x7f7e3c0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 --2- 172.21.15.181:0/2283972248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c0b41d0 0x7f7e3c0b1d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c069550 tx=0x7f7e2c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 -- 172.21.15.181:0/2283972248 shutdown_connections 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 --2- 172.21.15.181:0/2283972248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c0b41d0 0x7f7e3c0b1d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 --2- 172.21.15.181:0/2283972248 >> v2:172.21.15.204:3300/0 conn(0x7f7e3c15b1e0 0x7f7e3c0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 -- 172.21.15.181:0/2283972248 >> 172.21.15.181:0/2283972248 conn(0x7f7e3c06bc10 msgr2=0x7f7e3c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 -- 172.21.15.181:0/2283972248 shutdown_connections 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.791+0000 7f7e447fd640 1 -- 172.21.15.181:0/2283972248 wait complete. 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.792+0000 7f7e447fd640 1 Processor -- start 2024-09-12T02:28:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.792+0000 7f7e447fd640 1 -- start start 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e3c0b41d0 0x7f7e3c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e3c0cdfc0 0x7f7e3c1f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c15b1e0 0x7f7e3c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c0726d0 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c071130 con 0x7f7e3c0cdfc0 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e3c072850 con 0x7f7e3c0b41d0 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c15b1e0 0x7f7e3c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c15b1e0 0x7f7e3c152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52208/0 (socket says 172.21.15.181:52208) 2024-09-12T02:28:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 -- 172.21.15.181:0/145467043 learned_addr learned my addr 172.21.15.181:0/145467043 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42599640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e3c0b41d0 0x7f7e3c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e41d98640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e3c0cdfc0 0x7f7e3c1f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 -- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e3c0b41d0 msgr2=0x7f7e3c154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e3c0b41d0 0x7f7e3c154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 -- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e3c0cdfc0 msgr2=0x7f7e3c1f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e3c0cdfc0 0x7f7e3c1f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 -- 172.21.15.181:0/145467043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c1f56e0 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e41d98640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e3c0cdfc0 0x7f7e3c1f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42599640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e3c0b41d0 0x7f7e3c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e42d9a640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c15b1e0 0x7f7e3c152800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400ea20 tx=0x7f7e3400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e32ffd640 1 -- 172.21.15.181:0/145467043 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34004d70 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e32ffd640 1 -- 172.21.15.181:0/145467043 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e34016020 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c1f1050 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e32ffd640 1 -- 172.21.15.181:0/145467043 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400cc10 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.793+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3c1551c0 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.794+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c159160 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.795+0000 7f7e32ffd640 1 -- 172.21.15.181:0/145467043 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e340070d0 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.795+0000 7f7e32ffd640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e2006be30 0x7f7e2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.795+0000 7f7e32ffd640 1 -- 172.21.15.181:0/145467043 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7e3408d400 con 0x7f7e3c15b1e0 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.795+0000 7f7e42599640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e2006be30 0x7f7e2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.796+0000 7f7e42599640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e2006be30 0x7f7e2006e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006fd0 tx=0x7f7e38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:38.800+0000 7f7e32ffd640 1 -- 172.21.15.181:0/145467043 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e34020030 con 0x7f7e3c15b1e0 2024-09-12T02:28:39.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.001+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7e3c158e80 con 0x7f7e3c15b1e0 2024-09-12T02:28:39.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.002+0000 7f7e32ffd640 1 -- 172.21.15.181:0/145467043 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f7e3c1f56e0 con 0x7f7e3c15b1e0 2024-09-12T02:28:39.003 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e2006be30 msgr2=0x7f7e2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e2006be30 0x7f7e2006e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006fd0 tx=0x7f7e38008040 comp rx=0 tx=0).stop 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c15b1e0 msgr2=0x7f7e3c152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c15b1e0 0x7f7e3c152800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400ea20 tx=0x7f7e3400eee0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 shutdown_connections 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7e2006be30 0x7f7e2006e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e3c0cdfc0 0x7f7e3c1f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e3c15b1e0 0x7f7e3c152800 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 --2- 172.21.15.181:0/145467043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e3c0b41d0 0x7f7e3c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 >> 172.21.15.181:0/145467043 conn(0x7f7e3c06bc10 msgr2=0x7f7e3c1582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 shutdown_connections 2024-09-12T02:28:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39.004+0000 7f7e447fd640 1 -- 172.21.15.181:0/145467043 wait complete. 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:28:39.015 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:28:39.016 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-12T02:28:39.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.016 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:28:39.032 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:39.032 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:39.032 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:39.032 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.032 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:39.032 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:28:39.033 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42724sec preferred_lft 42724sec 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link tentative 2024-09-12T02:28:39.034 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.035 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:28:39.095 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:28:39.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.097 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:28:39.153 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:28:39.153 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:28:39.154 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:28:39.154 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:28:39.154 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:28:39.154 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:39.154 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:39.154 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:28:39.154 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:28:39.154 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:28:39.154 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:39.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:39.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:39.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.279 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:28:39.294 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:28:39.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.295 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-09-12T02:28:39.349 INFO:teuthology.orchestra.run.smithi181.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-12T02:28:39.350 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:39.350 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:39.350 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:28:39.350 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-12T02:28:39.350 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:39.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:39.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.466 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 46:f7:f3:c5:78:3d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::44f7:f3ff:fec5:783d/64 scope link 2024-09-12T02:28:39.491 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 46:f7:f3:c5:78:3d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:28:39.557 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:28:39.558 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.558 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::44f7:f3ff:fec5:783d/64 scope link 2024-09-12T02:28:39.558 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:39.559 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-12T02:28:39.559 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:39.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:39.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:39.710 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:39.710 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:28:39.710 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.1 up 2024-09-12T02:28:39.710 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T02:28:39.711 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:28:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:39.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:39.787 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-12T02:28:39.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:39.787 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:39.801 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-12T02:28:39.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:39.802 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:39.856 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:28:39.921 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:39.978 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:28:39.978 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:28:39.978 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:28:39.978 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:28:39.978 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:28:39.978 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:39.980 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:39.981 INFO:teuthology.orchestra.run.smithi181.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:39.981 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:28:39.981 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:28:39.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:39.981 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:28:40.034 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:28:40.034 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-09-12T02:28:40.034 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-12T02:28:40.077 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:28:40.101 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:40.157 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:28:40.157 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:28:40.157 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:28:40.158 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:28:40.159 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:28:40.160 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:40.160 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:28:40.160 INFO:teuthology.orchestra.run.smithi181.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:40.160 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:28:40.160 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:28:40.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:40.161 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:28:40.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi181.stderr:2024-09-12T02:28:40.157+0000 7f58657e2480 -1 init, newargv = 0x55b618650700 newargc=15 2024-09-12T02:28:40.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi181.stderr:ceph-fuse[45309]: starting ceph client 2024-09-12T02:28:40.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi181.stderr:ceph-fuse[45309]: starting fuse 2024-09-12T02:28:40.176 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:28:40.177 INFO:teuthology.orchestra.run.smithi181.stdout:44 2024-09-12T02:28:40.177 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:28:40.177 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:28:40.178 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:28:40.179 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:28:40.179 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:28:40.179 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.2")) 2024-09-12T02:28:40.179 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:28:40.293 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.2.45309.asok 2024-09-12T02:28:40.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:40.303 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45309.asok 2024-09-12T02:28:40.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:40.304 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45309.asok status 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "2", 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-12T02:28:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "45309", 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 4659, 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4659 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.2:0", 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 2825971619 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.2:0", 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 2825971619 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.4659 192.168.0.2:0/2825971619", 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.2:0/2825971619", 2024-09-12T02:28:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:28:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 6, 2024-09-12T02:28:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 21, 2024-09-12T02:28:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:28:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:28:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:28:40.439 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:28:40.444 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T02:28:40.444 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:28:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.544+0000 7f135621e640 1 Processor -- start 2024-09-12T02:28:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.544+0000 7f135621e640 1 -- start start 2024-09-12T02:28:40.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f135621e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135015eab0 0x7f135006d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f135621e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f13500d3480 0x7f13500b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f135621e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13500d17e0 con 0x7f135006dae0 2024-09-12T02:28:40.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f135621e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f13500d09d0 con 0x7f13500d3480 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f135621e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f135015ee90 con 0x7f135015eab0 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135015eab0 0x7f135006d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f13500d3480 0x7f13500b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f13500d3480 0x7f13500b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:34776/0 (socket says 172.21.15.181:34776) 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135015eab0 0x7f135006d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:45998/0 (socket says 172.21.15.181:45998) 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134ffff640 1 -- 172.21.15.181:0/111478544 learned_addr learned my addr 172.21.15.181:0/111478544 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134ffff640 1 -- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135015eab0 msgr2=0x7f135006d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134ffff640 1 --2- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135015eab0 0x7f135006d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134ffff640 1 -- 172.21.15.181:0/111478544 >> v1:172.21.15.204:6789/0 conn(0x7f135006dae0 legacy=0x7f13500b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134ffff640 1 -- 172.21.15.181:0/111478544 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13500cfc10 con 0x7f13500d3480 2024-09-12T02:28:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.545+0000 7f134f7fe640 1 --2- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135015eab0 0x7f135006d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:40.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.546+0000 7f134ffff640 1 --2- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f13500b8290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1348009e80 tx=0x7f134802a7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27e3f5d6aeb27fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:40.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.546+0000 7f134e7fc640 1 -- 172.21.15.181:0/111478544 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348036070 con 0x7f13500d3480 2024-09-12T02:28:40.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.546+0000 7f134e7fc640 1 -- 172.21.15.181:0/111478544 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1348031600 con 0x7f13500d3480 2024-09-12T02:28:40.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.546+0000 7f134e7fc640 1 -- 172.21.15.181:0/111478544 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480319d0 con 0x7f13500d3480 2024-09-12T02:28:40.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 -- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 msgr2=0x7f13500b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 --2- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f13500b8290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1348009e80 tx=0x7f134802a7e0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 -- 172.21.15.181:0/111478544 shutdown_connections 2024-09-12T02:28:40.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 --2- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f13500b8290 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 --2- 172.21.15.181:0/111478544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135015eab0 0x7f135006d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 -- 172.21.15.181:0/111478544 >> 172.21.15.181:0/111478544 conn(0x7f13500d4b30 msgr2=0x7f13500d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:40.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 -- 172.21.15.181:0/111478544 shutdown_connections 2024-09-12T02:28:40.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.547+0000 7f135621e640 1 -- 172.21.15.181:0/111478544 wait complete. 2024-09-12T02:28:40.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.548+0000 7f135621e640 1 Processor -- start 2024-09-12T02:28:40.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.548+0000 7f135621e640 1 -- start start 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f135621e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135006dae0 0x7f13500adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f135621e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f135015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f135621e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f135015eab0 0x7f13501f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f135621e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f13500d01d0 con 0x7f135015eab0 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f135621e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f135006df20 con 0x7f13500d3480 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f135621e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f13500d04b0 con 0x7f135006dae0 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f135015eab0 0x7f13501f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f135015eab0 0x7f13501f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44780/0 (socket says 172.21.15.181:44780) 2024-09-12T02:28:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 -- 172.21.15.181:0/3534205207 learned_addr learned my addr 172.21.15.181:0/3534205207 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134f7fe640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135006dae0 0x7f13500adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134effd640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f135015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 -- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135006dae0 msgr2=0x7f13500adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135006dae0 0x7f13500adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 -- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 msgr2=0x7f135015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f135015c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134ffff640 1 -- 172.21.15.181:0/3534205207 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13500ae640 con 0x7f135015eab0 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.549+0000 7f134effd640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f135015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.550+0000 7f134ffff640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f135015eab0 0x7f13501f4970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1348009fa0 tx=0x7f1348004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.550+0000 7f1337fff640 1 -- 172.21.15.181:0/3534205207 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348036050 con 0x7f135015eab0 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.550+0000 7f1337fff640 1 -- 172.21.15.181:0/3534205207 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1348042070 con 0x7f135015eab0 2024-09-12T02:28:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.550+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13500ae920 con 0x7f135015eab0 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.550+0000 7f1337fff640 1 -- 172.21.15.181:0/3534205207 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348009510 con 0x7f135015eab0 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.550+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13500aec00 con 0x7f135015eab0 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.551+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1350069ac0 con 0x7f135015eab0 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.551+0000 7f1337fff640 1 -- 172.21.15.181:0/3534205207 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1348007bf0 con 0x7f135015eab0 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.552+0000 7f1337fff640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f133c06be30 0x7f133c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.552+0000 7f1337fff640 1 -- 172.21.15.181:0/3534205207 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13480abb00 con 0x7f135015eab0 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.552+0000 7f134f7fe640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f133c06be30 0x7f133c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.552+0000 7f134f7fe640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f133c06be30 0x7f133c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1340009560 tx=0x7f1340009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.556+0000 7f1337fff640 1 -- 172.21.15.181:0/3534205207 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1350069ac0 con 0x7f135015eab0 2024-09-12T02:28:40.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.753+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f135006e5d0 con 0x7f135015eab0 2024-09-12T02:28:40.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.753+0000 7f1337fff640 1 -- 172.21.15.181:0/3534205207 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f135006e5d0 con 0x7f135015eab0 2024-09-12T02:28:40.754 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:28:40.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f133c06be30 msgr2=0x7f133c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f133c06be30 0x7f133c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1340009560 tx=0x7f1340009190 comp rx=0 tx=0).stop 2024-09-12T02:28:40.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f135015eab0 msgr2=0x7f13501f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f135015eab0 0x7f13501f4970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1348009fa0 tx=0x7f1348004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 shutdown_connections 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f133c06be30 0x7f133c06e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f13500d3480 0x7f135015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f135015eab0 0x7f13501f4970 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 --2- 172.21.15.181:0/3534205207 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f135006dae0 0x7f13500adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 >> 172.21.15.181:0/3534205207 conn(0x7f13500d4b30 msgr2=0x7f13500b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 shutdown_connections 2024-09-12T02:28:40.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:40.755+0000 7f135621e640 1 -- 172.21.15.181:0/3534205207 wait complete. 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:28:40.767 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:28:40.768 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:28:40.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:40.768 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-09-12T02:28:40.788 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:40.788 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:40.788 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:40.789 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:28:40.790 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:40.790 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:28:40.790 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-09-12T02:28:40.790 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link noprefixroute 2024-09-12T02:28:40.790 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:40.790 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:28:40.790 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:40.790 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:40.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:28:40.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr flush dev ceph-brx 2024-09-12T02:28:40.791 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set ceph-brx up 2024-09-12T02:28:40.791 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:28:40.791 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:40.883 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:41.002 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:41.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:41.008 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:28:41.033 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-09-12T02:28:41.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:41.035 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-09-12T02:28:41.106 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-09-12T02:28:41.107 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:28:41.107 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:28:41.107 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:28:41.107 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:28:41.107 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:41.107 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:41.107 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:28:41.107 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:28:41.107 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:28:41.108 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:41.195 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:41.395 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:41.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:41.401 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-09-12T02:28:41.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:41.416 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2024-09-12T02:28:41.472 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:41.472 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:41.473 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:41.473 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T02:28:41.473 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:41.561 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:41.585 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:41.591 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T02:28:41.592 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:41.641 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:41.712 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:41.726 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:41.726 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:41.726 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2024-09-12T02:28:41.726 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:28:41.726 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:41.781 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:41.805 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:41.811 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T02:28:41.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:41.812 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:41.827 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:28:41.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:41.828 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:41.884 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-09-12T02:28:41.952 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:42.008 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-09-12T02:28:42.008 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-09-12T02:28:42.008 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-09-12T02:28:42.009 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T02:28:42.010 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-09-12T02:28:42.011 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:42.011 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:42.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:42.011 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-09-12T02:28:42.063 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:28:42.063 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T02:28:42.105 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-09-12T02:28:42.130 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:42.186 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-09-12T02:28:42.186 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-09-12T02:28:42.186 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-09-12T02:28:42.186 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-09-12T02:28:42.186 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-09-12T02:28:42.186 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-09-12T02:28:42.187 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:42.188 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:42.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:42.189 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-09-12T02:28:42.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:2024-09-12T02:28:42.195+0000 7fe2f8f1c480 -1 init, newargv = 0x55d317827dc0 newargc=15 2024-09-12T02:28:42.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:ceph-fuse[43010]: starting ceph client 2024-09-12T02:28:42.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:ceph-fuse[43010]: starting fuse 2024-09-12T02:28:42.212 INFO:teuthology.orchestra.run.smithi204.stdout:43 2024-09-12T02:28:42.212 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-12T02:28:42.212 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:28:42.212 DEBUG:teuthology.orchestra.run.smithi204:> import glob 2024-09-12T02:28:42.212 DEBUG:teuthology.orchestra.run.smithi204:> import re 2024-09-12T02:28:42.212 DEBUG:teuthology.orchestra.run.smithi204:> import os 2024-09-12T02:28:42.212 DEBUG:teuthology.orchestra.run.smithi204:> import subprocess 2024-09-12T02:28:42.212 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> def _find_admin_socket(client_name): 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> files = glob.glob(asok_path) 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> # Given a non-glob path, it better be there 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> if "*" not in asok_path: 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> assert(len(files) == 1) 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> return files[0] 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> for f in files: 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:28:42.213 DEBUG:teuthology.orchestra.run.smithi204:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:28:42.214 DEBUG:teuthology.orchestra.run.smithi204:> contents = proc_f.read() 2024-09-12T02:28:42.214 DEBUG:teuthology.orchestra.run.smithi204:> if mountpoint in contents: 2024-09-12T02:28:42.214 DEBUG:teuthology.orchestra.run.smithi204:> return f 2024-09-12T02:28:42.214 DEBUG:teuthology.orchestra.run.smithi204:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:28:42.214 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:42.214 DEBUG:teuthology.orchestra.run.smithi204:> print(_find_admin_socket("client.1")) 2024-09-12T02:28:42.214 DEBUG:teuthology.orchestra.run.smithi204:> ' 2024-09-12T02:28:42.330 INFO:teuthology.orchestra.run.smithi204.stdout:/var/run/ceph/ceph-client.1.43010.asok 2024-09-12T02:28:42.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:42.340 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43010.asok 2024-09-12T02:28:42.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:42.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43010.asok status 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout: "metadata": { 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout: "entity_id": "1", 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout: "hostname": "smithi204", 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T02:28:42.476 INFO:teuthology.orchestra.run.smithi204.stdout: "pid": "43010", 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "root": "/" 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_count": 0, 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_pinned_count": 0, 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "id": 4487, 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "inst": { 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "name": { 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "client", 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "num": 4487 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-09-12T02:28:42.477 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 3264212519 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 3264212519 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "inst_str": "client.4487 192.168.0.1:0/3264212519", 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "addr_str": "192.168.0.1:0/3264212519", 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "inode_count": 1, 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "mds_epoch": 6, 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch": 21, 2024-09-12T02:28:42.478 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:28:42.479 INFO:teuthology.orchestra.run.smithi204.stdout: "blocklisted": false, 2024-09-12T02:28:42.479 INFO:teuthology.orchestra.run.smithi204.stdout: "fs_name": "cephfs" 2024-09-12T02:28:42.479 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-12T02:28:42.484 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T02:28:42.484 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:28:42.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.595+0000 7f5c3e01e640 1 Processor -- start 2024-09-12T02:28:42.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.595+0000 7f5c3e01e640 1 -- start start 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c3e01e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e4e0 0x7f5c380b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c3e01e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c380d26d0 0x7f5c380b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c3e01e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3806cec0 con 0x7f5c3815e8c0 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c3e01e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5c380d2d40 con 0x7f5c380d26d0 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c3e01e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c380b7250 con 0x7f5c3815e4e0 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c37fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c380d26d0 0x7f5c380b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c377fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e4e0 0x7f5c380b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c37fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c380d26d0 0x7f5c380b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:34790/0 (socket says 172.21.15.181:34790) 2024-09-12T02:28:42.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c37fff640 1 -- 172.21.15.181:0/3398492623 learned_addr learned my addr 172.21.15.181:0/3398492623 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c36ffd640 1 --1- 172.21.15.181:0/3398492623 >> v1:172.21.15.204:6789/0 conn(0x7f5c3815e8c0 0x7f5c380d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:50420/0 (socket says 172.21.15.181:50420) 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c37fff640 1 -- 172.21.15.181:0/3398492623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e4e0 msgr2=0x7f5c380b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c37fff640 1 --2- 172.21.15.181:0/3398492623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e4e0 0x7f5c380b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c37fff640 1 -- 172.21.15.181:0/3398492623 >> v1:172.21.15.204:6789/0 conn(0x7f5c3815e8c0 legacy=0x7f5c380d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c37fff640 1 -- 172.21.15.181:0/3398492623 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3806d160 con 0x7f5c380d26d0 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.596+0000 7f5c367fc640 1 -- 172.21.15.181:0/3398492623 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198519370 0 0) 0x7f5c3806cec0 con 0x7f5c3815e8c0 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.597+0000 7f5c37fff640 1 --2- 172.21.15.181:0/3398492623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c380d26d0 0x7f5c380b6d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009e50 tx=0x7f5c3002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0274dc9c82e4065 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.597+0000 7f5c367fc640 1 -- 172.21.15.181:0/3398492623 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30036070 con 0x7f5c380d26d0 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.597+0000 7f5c367fc640 1 -- 172.21.15.181:0/3398492623 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c30031600 con 0x7f5c380d26d0 2024-09-12T02:28:42.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.597+0000 7f5c367fc640 1 -- 172.21.15.181:0/3398492623 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300319d0 con 0x7f5c380d26d0 2024-09-12T02:28:42.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 -- 172.21.15.181:0/3398492623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c380d26d0 msgr2=0x7f5c380b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:42.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/3398492623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c380d26d0 0x7f5c380b6d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009e50 tx=0x7f5c3002a710 comp rx=0 tx=0).stop 2024-09-12T02:28:42.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 -- 172.21.15.181:0/3398492623 shutdown_connections 2024-09-12T02:28:42.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/3398492623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c380d26d0 0x7f5c380b6d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/3398492623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e4e0 0x7f5c380b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 -- 172.21.15.181:0/3398492623 >> 172.21.15.181:0/3398492623 conn(0x7f5c3806f400 msgr2=0x7f5c3806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 -- 172.21.15.181:0/3398492623 shutdown_connections 2024-09-12T02:28:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.598+0000 7f5c3e01e640 1 -- 172.21.15.181:0/3398492623 wait complete. 2024-09-12T02:28:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.599+0000 7f5c3e01e640 1 Processor -- start 2024-09-12T02:28:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.599+0000 7f5c3e01e640 1 -- start start 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c3e01e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c380d26d0 0x7f5c38146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c3e01e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c3815e4e0 0x7f5c380b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c3e01e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e8c0 0x7f5c381e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c3e01e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3806dc40 con 0x7f5c380d26d0 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c3e01e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3806d720 con 0x7f5c3815e4e0 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c3e01e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3806ddc0 con 0x7f5c3815e8c0 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c380d26d0 0x7f5c38146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c380d26d0 0x7f5c38146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44784/0 (socket says 172.21.15.181:44784) 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 -- 172.21.15.181:0/2292868395 learned_addr learned my addr 172.21.15.181:0/2292868395 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c36ffd640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c3815e4e0 0x7f5c380b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c37fff640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e8c0 0x7f5c381e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 -- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e8c0 msgr2=0x7f5c381e64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e8c0 0x7f5c381e64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 -- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c3815e4e0 msgr2=0x7f5c380b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c3815e4e0 0x7f5c380b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.600+0000 7f5c377fe640 1 -- 172.21.15.181:0/2292868395 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c38146920 con 0x7f5c380d26d0 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.601+0000 7f5c377fe640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c380d26d0 0x7f5c38146340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000e930 tx=0x7f5c2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.601+0000 7f5c2ffff640 1 -- 172.21.15.181:0/2292868395 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20017070 con 0x7f5c380d26d0 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.601+0000 7f5c2ffff640 1 -- 172.21.15.181:0/2292868395 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2000ca00 con 0x7f5c380d26d0 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.601+0000 7f5c2ffff640 1 -- 172.21.15.181:0/2292868395 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000cdf0 con 0x7f5c380d26d0 2024-09-12T02:28:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.601+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c38146c00 con 0x7f5c380d26d0 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.601+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c381471c0 con 0x7f5c380d26d0 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.602+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c380d1fc0 con 0x7f5c380d26d0 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.602+0000 7f5c2ffff640 1 -- 172.21.15.181:0/2292868395 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c2001a070 con 0x7f5c380d26d0 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.603+0000 7f5c2ffff640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c1806be30 0x7f5c1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:42.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.603+0000 7f5c36ffd640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c1806be30 0x7f5c1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:42.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.603+0000 7f5c2ffff640 1 -- 172.21.15.181:0/2292868395 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c2008b1e0 con 0x7f5c380d26d0 2024-09-12T02:28:42.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.603+0000 7f5c36ffd640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c1806be30 0x7f5c1806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c381e6210 tx=0x7f5c28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.607+0000 7f5c2ffff640 1 -- 172.21.15.181:0/2292868395 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c20059ce0 con 0x7f5c380d26d0 2024-09-12T02:28:42.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.807+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c380740f0 con 0x7f5c380d26d0 2024-09-12T02:28:42.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.808+0000 7f5c2ffff640 1 -- 172.21.15.181:0/2292868395 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f5c200595e0 con 0x7f5c380d26d0 2024-09-12T02:28:42.808 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.809+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c1806be30 msgr2=0x7f5c1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.809+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c1806be30 0x7f5c1806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c381e6210 tx=0x7f5c28009040 comp rx=0 tx=0).stop 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c380d26d0 msgr2=0x7f5c38146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c380d26d0 0x7f5c38146340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000e930 tx=0x7f5c2000edf0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 shutdown_connections 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c1806be30 0x7f5c1806e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c3815e4e0 0x7f5c380b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c3815e8c0 0x7f5c381e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 --2- 172.21.15.181:0/2292868395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c380d26d0 0x7f5c38146340 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 >> 172.21.15.181:0/2292868395 conn(0x7f5c3806f400 msgr2=0x7f5c380708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:42.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 shutdown_connections 2024-09-12T02:28:42.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:42.810+0000 7f5c3e01e640 1 -- 172.21.15.181:0/2292868395 wait complete. 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:28:42.821 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-12T02:28:42.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:42.822 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-09-12T02:28:42.837 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:42.837 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:28:42.838 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42728sec preferred_lft 42728sec 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link noprefixroute 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 3e:96:19:99:b9:77 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::c6:19ff:fe02:171b/64 scope link tentative 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:42.839 INFO:teuthology.orchestra.run.smithi204.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:28:42.840 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 3e:96:19:99:b9:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:42.840 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::3c96:19ff:fe99:b977/64 scope link tentative 2024-09-12T02:28:42.840 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:42.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:42.840 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:28:42.900 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-09-12T02:28:42.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:42.902 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-09-12T02:28:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-09-12T02:28:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:28:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:28:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:28:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:28:42.959 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:42.959 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:42.959 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:28:42.959 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:28:42.960 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:28:42.960 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:43.046 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:43.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:43.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:43.085 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-09-12T02:28:43.100 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:28:43.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:43.101 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2024-09-12T02:28:43.155 INFO:teuthology.orchestra.run.smithi204.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-12T02:28:43.156 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:43.156 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:43.156 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:28:43.156 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-12T02:28:43.156 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:43.243 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:43.266 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:43.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:43.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether d2:7e:52:dd:39:e2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:28:43.297 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:28:43.298 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.298 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::d07e:52ff:fedd:39e2/64 scope link tentative 2024-09-12T02:28:43.298 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:43.299 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T02:28:43.364 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:28:43.364 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:28:43.364 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:28:43.364 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.364 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-09-12T02:28:43.364 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.364 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:28:43.365 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether d2:7e:52:dd:39:e2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:28:43.365 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:28:43.365 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.365 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::d07e:52ff:fedd:39e2/64 scope link tentative 2024-09-12T02:28:43.365 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:28:43.366 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-12T02:28:43.366 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:43.366 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:43.366 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-12T02:28:43.366 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T02:28:43.366 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-12T02:28:43.366 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-12T02:28:43.367 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-12T02:28:43.367 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:43.454 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:43.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:43.519 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:28:43.519 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-09-12T02:28:43.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.1 up 2024-09-12T02:28:43.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T02:28:43.519 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-09-12T02:28:43.567 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:28:43.590 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:43.596 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-12T02:28:43.596 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:43.596 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:43.623 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-12T02:28:43.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:28:43.624 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:43.678 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-09-12T02:28:43.744 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:43.801 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-09-12T02:28:43.801 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-09-12T02:28:43.801 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-09-12T02:28:43.801 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-09-12T02:28:43.801 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:43.802 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:43.803 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:43.804 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:28:43.804 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:28:43.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:43.804 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-09-12T02:28:43.856 INFO:teuthology.orchestra.run.smithi204.stdout:43 2024-09-12T02:28:43.856 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-12T02:28:43.857 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-12T02:28:43.899 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-09-12T02:28:43.924 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-09-12T02:28:43.981 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:28:43.982 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:28:43.983 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:28:43.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:43.984 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-09-12T02:28:43.984 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:2024-09-12T02:28:43.981+0000 7f2cfbd62480 -1 init, newargv = 0x5599571db9a0 newargc=15 2024-09-12T02:28:43.984 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:ceph-fuse[43464]: starting ceph client 2024-09-12T02:28:43.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:ceph-fuse[43464]: starting fuse 2024-09-12T02:28:44.001 INFO:teuthology.orchestra.run.smithi204.stdout:43 2024-09-12T02:28:44.001 INFO:teuthology.orchestra.run.smithi204.stdout:44 2024-09-12T02:28:44.001 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-12T02:28:44.001 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:28:44.001 DEBUG:teuthology.orchestra.run.smithi204:> import glob 2024-09-12T02:28:44.001 DEBUG:teuthology.orchestra.run.smithi204:> import re 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> import os 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> import subprocess 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> def _find_admin_socket(client_name): 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> files = glob.glob(asok_path) 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> # Given a non-glob path, it better be there 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> if "*" not in asok_path: 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> assert(len(files) == 1) 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> return files[0] 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:44.002 DEBUG:teuthology.orchestra.run.smithi204:> for f in files: 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> contents = proc_f.read() 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> if mountpoint in contents: 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> return f 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> print(_find_admin_socket("client.3")) 2024-09-12T02:28:44.003 DEBUG:teuthology.orchestra.run.smithi204:> ' 2024-09-12T02:28:44.120 INFO:teuthology.orchestra.run.smithi204.stdout:/var/run/ceph/ceph-client.3.43464.asok 2024-09-12T02:28:44.123 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-12T02:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:28:44.131 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43464.asok 2024-09-12T02:28:44.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.131 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43464.asok status 2024-09-12T02:28:44.264 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-12T02:28:44.264 INFO:teuthology.orchestra.run.smithi204.stdout: "metadata": { 2024-09-12T02:28:44.264 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:28:44.264 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:28:44.264 INFO:teuthology.orchestra.run.smithi204.stdout: "entity_id": "3", 2024-09-12T02:28:44.264 INFO:teuthology.orchestra.run.smithi204.stdout: "hostname": "smithi204", 2024-09-12T02:28:44.265 INFO:teuthology.orchestra.run.smithi204.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-12T02:28:44.265 INFO:teuthology.orchestra.run.smithi204.stdout: "pid": "43464", 2024-09-12T02:28:44.265 INFO:teuthology.orchestra.run.smithi204.stdout: "root": "/" 2024-09-12T02:28:44.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:44.265 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_count": 0, 2024-09-12T02:28:44.265 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_pinned_count": 0, 2024-09-12T02:28:44.265 INFO:teuthology.orchestra.run.smithi204.stdout: "id": 4603, 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "inst": { 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "name": { 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "client", 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "num": 4603 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.2:0", 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 978468556 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:44.266 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.2:0", 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 978468556 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "inst_str": "client.4603 192.168.0.2:0/978468556", 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "addr_str": "192.168.0.2:0/978468556", 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "inode_count": 1, 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "mds_epoch": 6, 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch": 21, 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "blocklisted": false, 2024-09-12T02:28:44.267 INFO:teuthology.orchestra.run.smithi204.stdout: "fs_name": "cephfs" 2024-09-12T02:28:44.268 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-12T02:28:44.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.273 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:28:44.273 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:44.293 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:28:44.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:44.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:44.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.366 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:28:44.366 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:44.425 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:28:44.425 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:44.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.425 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:44.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.496 DEBUG:teuthology.orchestra.run.smithi204:> stat --file-system '--printf=%T 2024-09-12T02:28:44.496 DEBUG:teuthology.orchestra.run.smithi204:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:44.515 INFO:teuthology.orchestra.run.smithi204.stdout:fuseblk 2024-09-12T02:28:44.516 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:44.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.516 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:44.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.582 DEBUG:teuthology.orchestra.run.smithi204:> stat --file-system '--printf=%T 2024-09-12T02:28:44.582 DEBUG:teuthology.orchestra.run.smithi204:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:44.638 INFO:teuthology.orchestra.run.smithi204.stdout:fuseblk 2024-09-12T02:28:44.638 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:44.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:44.639 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:44.703 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-12T02:28:44.750 INFO:tasks.cephfs_test_runner:Starting test: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) That when some dentries in the journal but nothing is in 2024-09-12T02:28:44.750 INFO:tasks.cephfs_test_runner:test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-12T02:28:44.751 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:44.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.859+0000 7fefee4f1640 1 Processor -- start 2024-09-12T02:28:44.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.859+0000 7fefee4f1640 1 -- start start 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.859+0000 7fefee4f1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefe80b0050 0x7fefe80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.859+0000 7fefee4f1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe80cf870 con 0x7fefe8162280 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.859+0000 7fefee4f1640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe80cfb50 con 0x7fefe8162660 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.859+0000 7fefee4f1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fefe80cfe30 con 0x7fefe80b0050 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.860+0000 7fefeca8e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefe80b0050 0x7fefe80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.860+0000 7fefe7fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fefe8162280 0x7fefe80ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44986/0 (socket says 172.21.15.181:44986) 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.860+0000 7fefeca8e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefe80b0050 0x7fefe80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44792/0 (socket says 172.21.15.181:44792) 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.860+0000 7fefe7fff640 1 -- 172.21.15.181:0/3799531054 learned_addr learned my addr 172.21.15.181:0/3799531054 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.860+0000 7fefeca8e640 1 -- 172.21.15.181:0/3799531054 >> v1:172.21.15.204:6789/0 conn(0x7fefe8162660 legacy=0x7fefe80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.860+0000 7fefeca8e640 1 -- 172.21.15.181:0/3799531054 >> v1:172.21.15.181:6789/0 conn(0x7fefe8162280 legacy=0x7fefe80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.860+0000 7fefeca8e640 1 -- 172.21.15.181:0/3799531054 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe80d0110 con 0x7fefe80b0050 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefeca8e640 1 --2- 172.21.15.181:0/3799531054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe80b0050 0x7fefe80cf290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009d90 tx=0x7fefe002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ac1eee8d9659e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefe6ffd640 1 -- 172.21.15.181:0/3799531054 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0007740 con 0x7fefe80b0050 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefe6ffd640 1 -- 172.21.15.181:0/3799531054 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe00078e0 con 0x7fefe80b0050 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefe6ffd640 1 -- 172.21.15.181:0/3799531054 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0007cb0 con 0x7fefe80b0050 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefee4f1640 1 -- 172.21.15.181:0/3799531054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe80b0050 msgr2=0x7fefe80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefee4f1640 1 --2- 172.21.15.181:0/3799531054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe80b0050 0x7fefe80cf290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009d90 tx=0x7fefe002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefee4f1640 1 -- 172.21.15.181:0/3799531054 shutdown_connections 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefee4f1640 1 --2- 172.21.15.181:0/3799531054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe80b0050 0x7fefe80cf290 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefee4f1640 1 -- 172.21.15.181:0/3799531054 >> 172.21.15.181:0/3799531054 conn(0x7fefe80b1770 msgr2=0x7fefe80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:44.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefee4f1640 1 -- 172.21.15.181:0/3799531054 shutdown_connections 2024-09-12T02:28:44.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.861+0000 7fefee4f1640 1 -- 172.21.15.181:0/3799531054 wait complete. 2024-09-12T02:28:44.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.862+0000 7fefee4f1640 1 Processor -- start 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.863+0000 7fefee4f1640 1 -- start start 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.863+0000 7fefee4f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe80b0050 0x7fefe81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.863+0000 7fefee4f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8162280 0x7fefe815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.863+0000 7fefee4f1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe8162660 0x7fefe815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.863+0000 7fefee4f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fefe80b6010 con 0x7fefe8162280 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.863+0000 7fefee4f1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fefe80b5e90 con 0x7fefe8162660 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.863+0000 7fefee4f1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fefe80b6190 con 0x7fefe80b0050 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8162280 0x7fefe815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8162280 0x7fefe815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44802/0 (socket says 172.21.15.181:44802) 2024-09-12T02:28:44.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 -- 172.21.15.181:0/387492661 learned_addr learned my addr 172.21.15.181:0/387492661 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefeca8e640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe8162660 0x7fefe815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe7fff640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe80b0050 0x7fefe81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 -- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe80b0050 msgr2=0x7fefe81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe80b0050 0x7fefe81591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 -- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe8162660 msgr2=0x7fefe815b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe8162660 0x7fefe815b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 -- 172.21.15.181:0/387492661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe815bb20 con 0x7fefe8162280 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe77fe640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8162280 0x7fefe815b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00c3c0 tx=0x7fefdc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe4ff9640 1 -- 172.21.15.181:0/387492661 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0052d0 con 0x7fefe8162280 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe4ff9640 1 -- 172.21.15.181:0/387492661 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefdc005490 con 0x7fefe8162280 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe815bdd0 con 0x7fefe8162280 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefe4ff9640 1 -- 172.21.15.181:0/387492661 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc007260 con 0x7fefe8162280 2024-09-12T02:28:44.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.864+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe8156500 con 0x7fefe8162280 2024-09-12T02:28:44.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.865+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe815c2f0 con 0x7fefe8162280 2024-09-12T02:28:44.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.866+0000 7fefe4ff9640 1 -- 172.21.15.181:0/387492661 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefdc007400 con 0x7fefe8162280 2024-09-12T02:28:44.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.866+0000 7fefe4ff9640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fefd406be30 0x7fefd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.866+0000 7fefe4ff9640 1 -- 172.21.15.181:0/387492661 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fefdc08a260 con 0x7fefe8162280 2024-09-12T02:28:44.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.866+0000 7fefe7fff640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fefd406be30 0x7fefd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.867+0000 7fefe7fff640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fefd406be30 0x7fefd406e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005880 tx=0x7fefd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:44.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:44.871+0000 7fefe4ff9640 1 -- 172.21.15.181:0/387492661 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefdc0585c0 con 0x7fefe8162280 2024-09-12T02:28:45.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.036+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefe80cf290 con 0x7fefe8162280 2024-09-12T02:28:45.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.037+0000 7fefe4ff9640 1 -- 172.21.15.181:0/387492661 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16737 (secure 0 0 0) 0x7fefdc05c8c0 con 0x7fefe8162280 2024-09-12T02:28:45.038 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:45.038 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:23.452762+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fefd406be30 msgr2=0x7fefd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fefd406be30 0x7fefd406e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005880 tx=0x7fefd8009040 comp rx=0 tx=0).stop 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8162280 msgr2=0x7fefe815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8162280 0x7fefe815b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00c3c0 tx=0x7fefdc00c880 comp rx=0 tx=0).stop 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 shutdown_connections 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fefd406be30 0x7fefd406e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe8162660 0x7fefe815b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8162280 0x7fefe815b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 --2- 172.21.15.181:0/387492661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe80b0050 0x7fefe81591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 >> 172.21.15.181:0/387492661 conn(0x7fefe80b1770 msgr2=0x7fefe80b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:45.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 shutdown_connections 2024-09-12T02:28:45.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.039+0000 7fefee4f1640 1 -- 172.21.15.181:0/387492661 wait complete. 2024-09-12T02:28:45.051 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:28:11.641634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:28:20.418315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:28:20.746540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:28:45.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:28:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.152+0000 7fc69caac640 1 Processor -- start 2024-09-12T02:28:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.152+0000 7fc69caac640 1 -- start start 2024-09-12T02:28:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc69caac640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc6980cda00 0x7fc6980ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc69caac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc69806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc69caac640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6980ce360 con 0x7fc698141a90 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc69caac640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fc69813f770 con 0x7fc6980cda00 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc69caac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc69806c5b0 con 0x7fc69806bc10 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc68dd9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc698141a90 0x7fc69815c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44990/0 (socket says 172.21.15.181:44990) 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc68dd9b640 1 -- 172.21.15.181:0/4261527938 learned_addr learned my addr 172.21.15.181:0/4261527938 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc69659c640 1 --2- 172.21.15.181:0/4261527938 >> v2:172.21.15.204:3300/0 conn(0x7fc6980cda00 0x7fc6980ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc696d9d640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc69806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562197212 0 0) 0x7fc6980ce360 con 0x7fc698141a90 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc684003520 con 0x7fc698141a90 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2904357477 0 0) 0x7fc684003520 con 0x7fc698141a90 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 msgr2=0x7fc69806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc69806c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 >> v2:172.21.15.204:3300/0 conn(0x7fc6980cda00 msgr2=0x7fc6980ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:45.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 --2- 172.21.15.181:0/4261527938 >> v2:172.21.15.204:3300/0 conn(0x7fc6980cda00 0x7fc6980ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69815d020 con 0x7fc698141a90 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fc680001670 con 0x7fc698141a90 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc696d9d640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc69806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 >> v1:172.21.15.181:6789/0 conn(0x7fc698141a90 legacy=0x7fc69815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6840039b0 0x7fc684003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc684004800 0x7fc684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc6840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc68400b9c0 con 0x7fc6840039b0 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc68400bb40 con 0x7fc684004800 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc68400bcc0 con 0x7fc69806bc10 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.153+0000 7fc69659c640 1 --2- 172.21.15.181:0/4261527938 >> v2:172.21.15.204:3300/0 conn(0x7fc6980cda00 0x7fc6980ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc696d9d640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc6840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc68dd9b640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc684004800 0x7fc684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc69659c640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6840039b0 0x7fc684003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc696d9d640 1 -- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc684004800 msgr2=0x7fc684004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc696d9d640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc684004800 0x7fc684004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc696d9d640 1 -- 172.21.15.181:0/4261527938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6840039b0 msgr2=0x7fc684003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc696d9d640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6840039b0 0x7fc684003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.154+0000 7fc696d9d640 1 -- 172.21.15.181:0/4261527938 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc684003520 con 0x7fc69806bc10 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc696d9d640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc6840051c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc69000e350 tx=0x7fc684005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7f3e612fb66824 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690009de0 con 0x7fc69806bc10 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69002e660 con 0x7fc69806bc10 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc695d9b640 1 -- 172.21.15.181:0/4261527938 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69002ea10 con 0x7fc69806bc10 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc69caac640 1 -- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 msgr2=0x7fc6840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc69caac640 1 --2- 172.21.15.181:0/4261527938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc6840051c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc69000e350 tx=0x7fc684005830 comp rx=0 tx=0).stop 2024-09-12T02:28:45.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc696d9d640 1 -- 172.21.15.181:0/4261527938 reap_dead start 2024-09-12T02:28:45.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc69caac640 1 -- 172.21.15.181:0/4261527938 shutdown_connections 2024-09-12T02:28:45.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc69caac640 1 -- 172.21.15.181:0/4261527938 >> 172.21.15.181:0/4261527938 conn(0x7fc6980b30f0 msgr2=0x7fc6980b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:45.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc69caac640 1 -- 172.21.15.181:0/4261527938 shutdown_connections 2024-09-12T02:28:45.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.155+0000 7fc69caac640 1 -- 172.21.15.181:0/4261527938 wait complete. 2024-09-12T02:28:45.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.157+0000 7fc69caac640 1 Processor -- start 2024-09-12T02:28:45.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.157+0000 7fc69caac640 1 -- start start 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc698071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc698073ab0 0x7fc69813cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc69815b3b0 0x7fc69815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc698142200 con 0x7fc698073ab0 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc69815ff00 con 0x7fc69815b3b0 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc6981424e0 con 0x7fc69806bc10 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc698073ab0 0x7fc69813cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc698073ab0 0x7fc69813cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44822/0 (socket says 172.21.15.181:44822) 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 -- 172.21.15.181:0/3332828062 learned_addr learned my addr 172.21.15.181:0/3332828062 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc696d9d640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc69815b3b0 0x7fc69815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69659c640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc698071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 -- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 msgr2=0x7fc698071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc698071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 -- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc69815b3b0 msgr2=0x7fc69815b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc69815b3b0 0x7fc69815b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 -- 172.21.15.181:0/3332828062 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69813d0b0 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68dd9b640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc698073ab0 0x7fc69813cb70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc680007340 tx=0x7fc680007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68f7fe640 1 -- 172.21.15.181:0/3332828062 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68000f8e0 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68f7fe640 1 -- 172.21.15.181:0/3332828062 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680018070 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6980724d0 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc68f7fe640 1 -- 172.21.15.181:0/3332828062 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68000fd00 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.158+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc698072a90 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.160+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69815bd70 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.160+0000 7fc68f7fe640 1 -- 172.21.15.181:0/3332828062 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc68001c410 con 0x7fc698073ab0 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.160+0000 7fc68f7fe640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc67806be60 0x7fc67806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.160+0000 7fc68f7fe640 1 -- 172.21.15.181:0/3332828062 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc68008a8e0 con 0x7fc698073ab0 2024-09-12T02:28:45.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.160+0000 7fc69659c640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc67806be60 0x7fc67806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.161+0000 7fc69659c640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc67806be60 0x7fc67806e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc688009dc0 tx=0x7fc688009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.165+0000 7fc68f7fe640 1 -- 172.21.15.181:0/3332828062 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc680058cd0 con 0x7fc698073ab0 2024-09-12T02:28:45.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.328+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc69806c070 con 0x7fc698073ab0 2024-09-12T02:28:45.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.329+0000 7fc68f7fe640 1 -- 172.21.15.181:0/3332828062 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fc68005cfd0 con 0x7fc698073ab0 2024-09-12T02:28:45.330 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 1 2024-09-12T02:28:45.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc67806be60 msgr2=0x7fc67806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc67806be60 0x7fc67806e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc688009dc0 tx=0x7fc688009190 comp rx=0 tx=0).stop 2024-09-12T02:28:45.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc698073ab0 msgr2=0x7fc69813cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc698073ab0 0x7fc69813cb70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc680007340 tx=0x7fc680007800 comp rx=0 tx=0).stop 2024-09-12T02:28:45.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 shutdown_connections 2024-09-12T02:28:45.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc67806be60 0x7fc67806e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc69815b3b0 0x7fc69815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc698073ab0 0x7fc69813cb70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 --2- 172.21.15.181:0/3332828062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc69806bc10 0x7fc698071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 >> 172.21.15.181:0/3332828062 conn(0x7fc6980b30f0 msgr2=0x7fc69815dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:45.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 shutdown_connections 2024-09-12T02:28:45.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.331+0000 7fc69caac640 1 -- 172.21.15.181:0/3332828062 wait complete. 2024-09-12T02:28:45.343 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:28:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.444+0000 7ff35a56d640 1 Processor -- start 2024-09-12T02:28:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.444+0000 7ff35a56d640 1 -- start start 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff35a56d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d0ad0 0x7ff35406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff35a56d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff3540d0f10 0x7ff35406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff35a56d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff354155b20 con 0x7ff3540d2350 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff35a56d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff35406f470 con 0x7ff3540d0f10 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff35a56d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff35406f750 con 0x7ff3540d0ad0 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff358b0a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff3540d0f10 0x7ff35406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff353fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff3540d2350 0x7ff3540d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45002/0 (socket says 172.21.15.181:45002) 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff353fff640 1 -- 172.21.15.181:0/348214007 learned_addr learned my addr 172.21.15.181:0/348214007 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff3537fe640 1 --2- 172.21.15.181:0/348214007 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d0ad0 0x7ff35406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff358b0a640 1 -- 172.21.15.181:0/348214007 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d0ad0 msgr2=0x7ff35406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff358b0a640 1 --2- 172.21.15.181:0/348214007 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d0ad0 0x7ff35406d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff358b0a640 1 -- 172.21.15.181:0/348214007 >> v1:172.21.15.181:6789/0 conn(0x7ff3540d2350 legacy=0x7ff3540d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff358b0a640 1 -- 172.21.15.181:0/348214007 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35406fa30 con 0x7ff3540d0f10 2024-09-12T02:28:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.445+0000 7ff352ffd640 1 -- 172.21.15.181:0/348214007 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028191430 0 0) 0x7ff354155b20 con 0x7ff3540d2350 2024-09-12T02:28:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.446+0000 7ff358b0a640 1 --2- 172.21.15.181:0/348214007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff35406d580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009d90 tx=0x7ff34c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c9448360403135 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.446+0000 7ff352ffd640 1 -- 172.21.15.181:0/348214007 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c007740 con 0x7ff3540d0f10 2024-09-12T02:28:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.446+0000 7ff352ffd640 1 -- 172.21.15.181:0/348214007 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c0078e0 con 0x7ff3540d0f10 2024-09-12T02:28:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.446+0000 7ff352ffd640 1 -- 172.21.15.181:0/348214007 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c007cb0 con 0x7ff3540d0f10 2024-09-12T02:28:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 -- 172.21.15.181:0/348214007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 msgr2=0x7ff35406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 --2- 172.21.15.181:0/348214007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff35406d580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009d90 tx=0x7ff34c02a660 comp rx=0 tx=0).stop 2024-09-12T02:28:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 -- 172.21.15.181:0/348214007 shutdown_connections 2024-09-12T02:28:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 --2- 172.21.15.181:0/348214007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff35406d580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 --2- 172.21.15.181:0/348214007 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d0ad0 0x7ff35406d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 -- 172.21.15.181:0/348214007 >> 172.21.15.181:0/348214007 conn(0x7ff3540b7db0 msgr2=0x7ff354067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:45.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 -- 172.21.15.181:0/348214007 shutdown_connections 2024-09-12T02:28:45.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.447+0000 7ff35a56d640 1 -- 172.21.15.181:0/348214007 wait complete. 2024-09-12T02:28:45.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.448+0000 7ff35a56d640 1 Processor -- start 2024-09-12T02:28:45.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.448+0000 7ff35a56d640 1 -- start start 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff35a56d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3540d0ad0 0x7ff3540b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff35a56d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff354156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff35a56d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d2350 0x7ff3541448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff35a56d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff3540d0560 con 0x7ff3540d0f10 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff35a56d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff3540d03e0 con 0x7ff3540d0ad0 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff35a56d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff35406dac0 con 0x7ff3540d2350 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff354156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff354156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44844/0 (socket says 172.21.15.181:44844) 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 -- 172.21.15.181:0/373730765 learned_addr learned my addr 172.21.15.181:0/373730765 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:45.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff358b0a640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d2350 0x7ff3541448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff353fff640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3540d0ad0 0x7ff3540b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 -- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d2350 msgr2=0x7ff3541448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d2350 0x7ff3541448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 -- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3540d0ad0 msgr2=0x7ff3540b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3540d0ad0 0x7ff3540b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.449+0000 7ff3537fe640 1 -- 172.21.15.181:0/373730765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff354157aa0 con 0x7ff3540d0f10 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.450+0000 7ff3537fe640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff354156fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e980 tx=0x7ff34800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.450+0000 7ff350ff9640 1 -- 172.21.15.181:0/373730765 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348017070 con 0x7ff3540d0f10 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.450+0000 7ff350ff9640 1 -- 172.21.15.181:0/373730765 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34800ca00 con 0x7ff3540d0f10 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.450+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff354157d80 con 0x7ff3540d0f10 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.450+0000 7ff350ff9640 1 -- 172.21.15.181:0/373730765 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800cdd0 con 0x7ff3540d0f10 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.450+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff354158620 con 0x7ff3540d0f10 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.451+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3540d2730 con 0x7ff3540d0f10 2024-09-12T02:28:45.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.451+0000 7ff350ff9640 1 -- 172.21.15.181:0/373730765 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff34801a070 con 0x7ff3540d0f10 2024-09-12T02:28:45.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.452+0000 7ff350ff9640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34006be30 0x7ff34006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.452+0000 7ff350ff9640 1 -- 172.21.15.181:0/373730765 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff34808b1f0 con 0x7ff3540d0f10 2024-09-12T02:28:45.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.452+0000 7ff353fff640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34006be30 0x7ff34006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.452+0000 7ff353fff640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34006be30 0x7ff34006e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff344007fd0 tx=0x7ff344007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.456+0000 7ff350ff9640 1 -- 172.21.15.181:0/373730765 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3480594c0 con 0x7ff3540d0f10 2024-09-12T02:28:45.566 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:28:45.568 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:28:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.628+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff35406ed10 con 0x7ff3540d0f10 2024-09-12T02:28:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.629+0000 7ff350ff9640 1 -- 172.21.15.181:0/373730765 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff34805d7c0 con 0x7ff3540d0f10 2024-09-12T02:28:45.629 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 32 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.630+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34006be30 msgr2=0x7ff34006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.630+0000 7ff35a56d640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34006be30 0x7ff34006e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff344007fd0 tx=0x7ff344007de0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.630+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 msgr2=0x7ff354156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff354156fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e980 tx=0x7ff34800ee40 comp rx=0 tx=0).stop 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 shutdown_connections 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34006be30 0x7ff34006e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3540d2350 0x7ff3541448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3540d0f10 0x7ff354156fe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 --2- 172.21.15.181:0/373730765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff3540d0ad0 0x7ff3540b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 >> 172.21.15.181:0/373730765 conn(0x7ff3540b7db0 msgr2=0x7ff3540b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:45.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 shutdown_connections 2024-09-12T02:28:45.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.631+0000 7ff35a56d640 1 -- 172.21.15.181:0/373730765 wait complete. 2024-09-12T02:28:45.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:28:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.783+0000 7f2ef4e77640 1 Processor -- start 2024-09-12T02:28:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.783+0000 7f2ef4e77640 1 -- start start 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2ef4e77640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2ef00b3fb0 0x7f2ef00b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2ef4e77640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef00cfb60 con 0x7f2ef00d1fa0 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2ef4e77640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef006d9a0 con 0x7f2ef015e500 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2ef4e77640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef00b4960 con 0x7f2ef00b3fb0 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2eeed9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2ef00b3fb0 0x7f2ef00b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2ee5d9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2ef00d1fa0 0x7f2ef00cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45018/0 (socket says 172.21.15.181:45018) 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2eeed9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2ef00b3fb0 0x7f2ef00b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44846/0 (socket says 172.21.15.181:44846) 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2ee5d9b640 1 -- 172.21.15.181:0/971346052 learned_addr learned my addr 172.21.15.181:0/971346052 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2eeed9d640 1 -- 172.21.15.181:0/971346052 >> v1:172.21.15.204:6789/0 conn(0x7f2ef015e500 legacy=0x7f2ef006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2eeed9d640 1 -- 172.21.15.181:0/971346052 >> v1:172.21.15.181:6789/0 conn(0x7f2ef00d1fa0 legacy=0x7f2ef00cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2eeed9d640 1 -- 172.21.15.181:0/971346052 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef00ce970 con 0x7f2ef00b3fb0 2024-09-12T02:28:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.784+0000 7f2eedd9b640 1 -- 172.21.15.181:0/971346052 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088966246 0 0) 0x7f2ef00cfb60 con 0x7f2ef00d1fa0 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.785+0000 7f2eeed9d640 1 --2- 172.21.15.181:0/971346052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef00b3fb0 0x7f2ef00b4420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009d90 tx=0x7f2ee802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddb8d557acb0216 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.785+0000 7f2eedd9b640 1 -- 172.21.15.181:0/971346052 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8007740 con 0x7f2ef00b3fb0 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.785+0000 7f2eedd9b640 1 -- 172.21.15.181:0/971346052 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee80078e0 con 0x7f2ef00b3fb0 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.785+0000 7f2eedd9b640 1 -- 172.21.15.181:0/971346052 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8007cb0 con 0x7f2ef00b3fb0 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.786+0000 7f2ef4e77640 1 -- 172.21.15.181:0/971346052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef00b3fb0 msgr2=0x7f2ef00b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.786+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/971346052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef00b3fb0 0x7f2ef00b4420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009d90 tx=0x7f2ee802a730 comp rx=0 tx=0).stop 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.786+0000 7f2ef4e77640 1 -- 172.21.15.181:0/971346052 shutdown_connections 2024-09-12T02:28:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.786+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/971346052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef00b3fb0 0x7f2ef00b4420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.786+0000 7f2ef4e77640 1 -- 172.21.15.181:0/971346052 >> 172.21.15.181:0/971346052 conn(0x7f2ef0067950 msgr2=0x7f2ef0067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.786+0000 7f2ef4e77640 1 -- 172.21.15.181:0/971346052 shutdown_connections 2024-09-12T02:28:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.786+0000 7f2ef4e77640 1 -- 172.21.15.181:0/971346052 wait complete. 2024-09-12T02:28:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.787+0000 7f2ef4e77640 1 Processor -- start 2024-09-12T02:28:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.787+0000 7f2ef4e77640 1 -- start start 2024-09-12T02:28:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2ef4e77640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ef00b3fb0 0x7f2ef0148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2ef4e77640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ef00d1fa0 0x7f2ef01e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2ef4e77640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef015e500 0x7f2ef01e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2ef4e77640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef006dc80 con 0x7f2ef015e500 2024-09-12T02:28:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2ef4e77640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef006d750 con 0x7f2ef00d1fa0 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2ef4e77640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef00cef30 con 0x7f2ef00b3fb0 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef015e500 0x7f2ef01e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef015e500 0x7f2ef01e6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44862/0 (socket says 172.21.15.181:44862) 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 -- 172.21.15.181:0/2829347368 learned_addr learned my addr 172.21.15.181:0/2829347368 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eee59c640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ef00b3fb0 0x7f2ef0148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2ee5d9b640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ef00d1fa0 0x7f2ef01e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 -- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ef00b3fb0 msgr2=0x7f2ef0148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ef00b3fb0 0x7f2ef0148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 -- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ef00d1fa0 msgr2=0x7f2ef01e6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ef00d1fa0 0x7f2ef01e6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.788+0000 7f2eeed9d640 1 -- 172.21.15.181:0/2829347368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef00b1910 con 0x7f2ef015e500 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.789+0000 7f2eeed9d640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef015e500 0x7f2ef01e6f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009d90 tx=0x7f2ee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.789+0000 7f2ee77fe640 1 -- 172.21.15.181:0/2829347368 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8040070 con 0x7f2ef015e500 2024-09-12T02:28:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.789+0000 7f2ee77fe640 1 -- 172.21.15.181:0/2829347368 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee8031c40 con 0x7f2ef015e500 2024-09-12T02:28:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.789+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef00b1630 con 0x7f2ef015e500 2024-09-12T02:28:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.789+0000 7f2ee77fe640 1 -- 172.21.15.181:0/2829347368 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8003990 con 0x7f2ef015e500 2024-09-12T02:28:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.789+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef0149c30 con 0x7f2ef015e500 2024-09-12T02:28:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.790+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef00d3200 con 0x7f2ef015e500 2024-09-12T02:28:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.790+0000 7f2ee77fe640 1 -- 172.21.15.181:0/2829347368 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ee8039040 con 0x7f2ef015e500 2024-09-12T02:28:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.790+0000 7f2ee77fe640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2ed006be30 0x7f2ed006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.791+0000 7f2ee77fe640 1 -- 172.21.15.181:0/2829347368 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ee80abda0 con 0x7f2ef015e500 2024-09-12T02:28:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.791+0000 7f2eee59c640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2ed006be30 0x7f2ed006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.791+0000 7f2eee59c640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2ed006be30 0x7f2ed006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0004f60 tx=0x7f2ee0007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:45.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.795+0000 7f2ee77fe640 1 -- 172.21.15.181:0/2829347368 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ee807a100 con 0x7f2ef015e500 2024-09-12T02:28:45.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.959+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2ef00b3200 con 0x7f2ef015e500 2024-09-12T02:28:45.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.959+0000 7f2ee77fe640 1 -- 172.21.15.181:0/2829347368 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f2ee807e400 con 0x7f2ef015e500 2024-09-12T02:28:45.960 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 64 2024-09-12T02:28:45.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2ed006be30 msgr2=0x7f2ed006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2ed006be30 0x7f2ed006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0004f60 tx=0x7f2ee0007e30 comp rx=0 tx=0).stop 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef015e500 msgr2=0x7f2ef01e6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef015e500 0x7f2ef01e6f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009d90 tx=0x7f2ee8004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 shutdown_connections 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2ed006be30 0x7f2ed006e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2ef00d1fa0 0x7f2ef01e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef015e500 0x7f2ef01e6f40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 --2- 172.21.15.181:0/2829347368 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2ef00b3fb0 0x7f2ef0148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.961+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 >> 172.21.15.181:0/2829347368 conn(0x7f2ef0067950 msgr2=0x7f2ef00b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.962+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 shutdown_connections 2024-09-12T02:28:45.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:45.962+0000 7f2ef4e77640 1 -- 172.21.15.181:0/2829347368 wait complete. 2024-09-12T02:28:45.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2024-09-12T02:28:46.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.070+0000 7fa5f7f5b640 1 Processor -- start 2024-09-12T02:28:46.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.070+0000 7fa5f7f5b640 1 -- start start 2024-09-12T02:28:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.071+0000 7fa5f7f5b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 0x7fa5f00cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.071+0000 7fa5f7f5b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa5f00b0320 0x7fa5f00cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.071+0000 7fa5f7f5b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f00b61b0 con 0x7fa5f0156770 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.071+0000 7fa5f7f5b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f00b6490 con 0x7fa5f00b0320 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.071+0000 7fa5f7f5b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f00b6770 con 0x7fa5f00afec0 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.071+0000 7fa5f5cf7640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa5f0156770 0x7fa5f0160810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45028/0 (socket says 172.21.15.181:45028) 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.071+0000 7fa5f5cf7640 1 -- 172.21.15.181:0/3088153670 learned_addr learned my addr 172.21.15.181:0/3088153670 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660071690 0 0) 0x7fa5f00b61b0 con 0x7fa5f0156770 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5dc003520 con 0x7fa5f0156770 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f64f8640 1 --2- 172.21.15.181:0/3088153670 >> v2:172.21.15.204:3300/0 conn(0x7fa5f00b0320 0x7fa5f00cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 0x7fa5f00cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 244268062 0 0) 0x7fa5dc003520 con 0x7fa5f0156770 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 msgr2=0x7fa5f00cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 0x7fa5f00cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 >> v2:172.21.15.204:3300/0 conn(0x7fa5f00b0320 msgr2=0x7fa5f00cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 --2- 172.21.15.181:0/3088153670 >> v2:172.21.15.204:3300/0 conn(0x7fa5f00b0320 0x7fa5f00cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f0160010 con 0x7fa5f0156770 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fa5ec001670 con 0x7fa5f0156770 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 >> v1:172.21.15.181:6789/0 conn(0x7fa5f0156770 legacy=0x7fa5f0160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 0x7fa5dc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5dc003fe0 0x7fa5dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc004d40 0x7fa5dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00b6490 con 0x7fa5dc003fe0 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00b6770 con 0x7fa5dc004d40 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa5dc00bb80 con 0x7fa5f00afec0 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5dc003fe0 0x7fa5dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f5cf7640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 0x7fa5dc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f64f8640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc004d40 0x7fa5dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f54f6640 1 -- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 msgr2=0x7fa5dc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00afec0 0x7fa5dc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f54f6640 1 -- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc004d40 msgr2=0x7fa5dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc004d40 0x7fa5dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.072+0000 7fa5f54f6640 1 -- 172.21.15.181:0/3088153670 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc003520 con 0x7fa5dc003fe0 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.073+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5dc003fe0 0x7fa5dc004800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ba30 tx=0x7fa5dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d431be30cdf448 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.073+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0030070 con 0x7fa5dc003fe0 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.073+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e002ade0 con 0x7fa5dc003fe0 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.073+0000 7fa5f4cf5640 1 -- 172.21.15.181:0/3088153670 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000b600 con 0x7fa5dc003fe0 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.074+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/3088153670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5dc003fe0 msgr2=0x7fa5dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.074+0000 7fa5f7f5b640 1 --2- 172.21.15.181:0/3088153670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5dc003fe0 0x7fa5dc004800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ba30 tx=0x7fa5dc005830 comp rx=0 tx=0).stop 2024-09-12T02:28:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.074+0000 7fa5f64f8640 1 -- 172.21.15.181:0/3088153670 reap_dead start 2024-09-12T02:28:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.074+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/3088153670 shutdown_connections 2024-09-12T02:28:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.074+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/3088153670 >> 172.21.15.181:0/3088153670 conn(0x7fa5f00b1770 msgr2=0x7fa5f00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.074+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/3088153670 shutdown_connections 2024-09-12T02:28:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.074+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/3088153670 wait complete. 2024-09-12T02:28:46.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.075+0000 7fa5f7f5b640 1 Processor -- start 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.075+0000 7fa5f7f5b640 1 -- start start 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc003fe0 0x7fa5f01f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f01557f0 0x7fa5f015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00ae240 0x7fa5f00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00cf9a0 con 0x7fa5f01557f0 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00cf820 con 0x7fa5dc003fe0 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f00cfb20 con 0x7fa5f00ae240 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f01557f0 0x7fa5f015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f01557f0 0x7fa5f015a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44886/0 (socket says 172.21.15.181:44886) 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 -- 172.21.15.181:0/2688802202 learned_addr learned my addr 172.21.15.181:0/2688802202 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f5cf7640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc003fe0 0x7fa5f01f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f64f8640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00ae240 0x7fa5f00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 -- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00ae240 msgr2=0x7fa5f00ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00ae240 0x7fa5f00ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 -- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc003fe0 msgr2=0x7fa5f01f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc003fe0 0x7fa5f01f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 -- 172.21.15.181:0/2688802202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f015ab40 con 0x7fa5f01557f0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f54f6640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f01557f0 0x7fa5f015a460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0035d90 tx=0x7fa5e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5e67fc640 1 -- 172.21.15.181:0/2688802202 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0043030 con 0x7fa5f01557f0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5e67fc640 1 -- 172.21.15.181:0/2688802202 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e002abe0 con 0x7fa5f01557f0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f015ae20 con 0x7fa5f01557f0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5e67fc640 1 -- 172.21.15.181:0/2688802202 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000b600 con 0x7fa5f01557f0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.076+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f015b3e0 con 0x7fa5f01557f0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.077+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f00cfd60 con 0x7fa5f01557f0 2024-09-12T02:28:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.078+0000 7fa5e67fc640 1 -- 172.21.15.181:0/2688802202 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5e0046070 con 0x7fa5f01557f0 2024-09-12T02:28:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.078+0000 7fa5e67fc640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa5d406be30 0x7fa5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.078+0000 7fa5e67fc640 1 -- 172.21.15.181:0/2688802202 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa5e00ab680 con 0x7fa5f01557f0 2024-09-12T02:28:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.078+0000 7fa5f5cf7640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa5d406be30 0x7fa5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.079+0000 7fa5f5cf7640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa5d406be30 0x7fa5d406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007fd0 tx=0x7fa5ec0078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.083+0000 7fa5e67fc640 1 -- 172.21.15.181:0/2688802202 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5e002adb0 con 0x7fa5f01557f0 2024-09-12T02:28:46.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.311+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) -- 0x7fa5f0067e30 con 0x7fa5f01557f0 2024-09-12T02:28:46.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.517+0000 7fa5e67fc640 1 -- 172.21.15.181:0/2688802202 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v43) ==== 153+0+0 (secure 0 0 0) 0x7fa5e007a030 con 0x7fa5f01557f0 2024-09-12T02:28:46.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.519+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa5d406be30 msgr2=0x7fa5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.519+0000 7fa5f7f5b640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa5d406be30 0x7fa5d406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007fd0 tx=0x7fa5ec0078f0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.519+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f01557f0 msgr2=0x7fa5f015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.519+0000 7fa5f7f5b640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f01557f0 0x7fa5f015a460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0035d90 tx=0x7fa5e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 shutdown_connections 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa5d406be30 0x7fa5d406e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5f00ae240 0x7fa5f00ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f01557f0 0x7fa5f015a460 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 --2- 172.21.15.181:0/2688802202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc003fe0 0x7fa5f01f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 >> 172.21.15.181:0/2688802202 conn(0x7fa5f00b1770 msgr2=0x7fa5f006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 shutdown_connections 2024-09-12T02:28:46.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.520+0000 7fa5f7f5b640 1 -- 172.21.15.181:0/2688802202 wait complete. 2024-09-12T02:28:46.531 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:28:46.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.632+0000 7fd748dc6640 1 Processor -- start 2024-09-12T02:28:46.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.632+0000 7fd748dc6640 1 -- start start 2024-09-12T02:28:46.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd748dc6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d2350 0x7fd7440d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd748dc6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7440d0f10 0x7fd74406e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd748dc6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd744155b20 con 0x7fd7440d0ad0 2024-09-12T02:28:46.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd748dc6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd7440d2c70 con 0x7fd7440d0f10 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd748dc6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd74406f470 con 0x7fd7440d2350 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd742d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7440d0f10 0x7fd74406e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd742d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd7440d0f10 0x7fd74406e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44902/0 (socket says 172.21.15.181:44902) 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd742d9d640 1 -- 172.21.15.181:0/3931069366 learned_addr learned my addr 172.21.15.181:0/3931069366 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd742d9d640 1 -- 172.21.15.181:0/3931069366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d2350 msgr2=0x7fd7440d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd742d9d640 1 --2- 172.21.15.181:0/3931069366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d2350 0x7fd7440d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd742d9d640 1 -- 172.21.15.181:0/3931069366 >> v1:172.21.15.204:6789/0 conn(0x7fd7440d0ad0 legacy=0x7fd744073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.633+0000 7fd742d9d640 1 -- 172.21.15.181:0/3931069366 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74406f750 con 0x7fd7440d0f10 2024-09-12T02:28:46.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.634+0000 7fd742d9d640 1 --2- 172.21.15.181:0/3931069366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d0f10 0x7fd74406e050 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e50 tx=0x7fd73c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e407b761dd36f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.634+0000 7fd741d9b640 1 -- 172.21.15.181:0/3931069366 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c036070 con 0x7fd7440d0f10 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.634+0000 7fd741d9b640 1 -- 172.21.15.181:0/3931069366 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c031600 con 0x7fd7440d0f10 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.634+0000 7fd741d9b640 1 -- 172.21.15.181:0/3931069366 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0319d0 con 0x7fd7440d0f10 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 -- 172.21.15.181:0/3931069366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d0f10 msgr2=0x7fd74406e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 --2- 172.21.15.181:0/3931069366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d0f10 0x7fd74406e050 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e50 tx=0x7fd73c02a6c0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 -- 172.21.15.181:0/3931069366 shutdown_connections 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 --2- 172.21.15.181:0/3931069366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d0f10 0x7fd74406e050 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 --2- 172.21.15.181:0/3931069366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d2350 0x7fd7440d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 -- 172.21.15.181:0/3931069366 >> 172.21.15.181:0/3931069366 conn(0x7fd7440b7db0 msgr2=0x7fd744067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 -- 172.21.15.181:0/3931069366 shutdown_connections 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.635+0000 7fd748dc6640 1 -- 172.21.15.181:0/3931069366 wait complete. 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.636+0000 7fd748dc6640 1 Processor -- start 2024-09-12T02:28:46.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.636+0000 7fd748dc6640 1 -- start start 2024-09-12T02:28:46.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd748dc6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7440d0ad0 0x7fd744140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd748dc6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d0f10 0x7fd744157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd748dc6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d2350 0x7fd744155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd748dc6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd7440d03e0 con 0x7fd7440d2350 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd748dc6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd74406fd10 con 0x7fd7440d0ad0 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd748dc6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd7440d0560 con 0x7fd7440d0f10 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d2350 0x7fd744155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d2350 0x7fd744155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44912/0 (socket says 172.21.15.181:44912) 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 -- 172.21.15.181:0/765028935 learned_addr learned my addr 172.21.15.181:0/765028935 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd74259c640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7440d0ad0 0x7fd744140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd739d9b640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d0f10 0x7fd744157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 -- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d0f10 msgr2=0x7fd744157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d0f10 0x7fd744157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 -- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7440d0ad0 msgr2=0x7fd744140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7440d0ad0 0x7fd744140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 -- 172.21.15.181:0/765028935 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd744152f80 con 0x7fd7440d2350 2024-09-12T02:28:46.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.637+0000 7fd742d9d640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d2350 0x7fd744155cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009f70 tx=0x7fd73c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.638+0000 7fd73b7fe640 1 -- 172.21.15.181:0/765028935 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c041020 con 0x7fd7440d2350 2024-09-12T02:28:46.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.638+0000 7fd73b7fe640 1 -- 172.21.15.181:0/765028935 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c007800 con 0x7fd7440d2350 2024-09-12T02:28:46.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.638+0000 7fd73b7fe640 1 -- 172.21.15.181:0/765028935 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c036040 con 0x7fd7440d2350 2024-09-12T02:28:46.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.638+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd744140ea0 con 0x7fd7440d2350 2024-09-12T02:28:46.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.638+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd744158a10 con 0x7fd7440d2350 2024-09-12T02:28:46.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.639+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7440d2730 con 0x7fd7440d2350 2024-09-12T02:28:46.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.639+0000 7fd73b7fe640 1 -- 172.21.15.181:0/765028935 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd73c044020 con 0x7fd7440d2350 2024-09-12T02:28:46.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.640+0000 7fd73b7fe640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd72406be30 0x7fd72406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.640+0000 7fd73b7fe640 1 -- 172.21.15.181:0/765028935 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd73c0abaa0 con 0x7fd7440d2350 2024-09-12T02:28:46.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.640+0000 7fd74259c640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd72406be30 0x7fd72406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.640+0000 7fd74259c640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd72406be30 0x7fd72406e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd744155530 tx=0x7fd734009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.644+0000 7fd73b7fe640 1 -- 172.21.15.181:0/765028935 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd73c04b030 con 0x7fd7440d2350 2024-09-12T02:28:46.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.810+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd74406ed10 con 0x7fd7440d2350 2024-09-12T02:28:46.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.813+0000 7fd73b7fe640 1 -- 172.21.15.181:0/765028935 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd73c07a460 con 0x7fd7440d2350 2024-09-12T02:28:46.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd72406be30 msgr2=0x7fd72406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd72406be30 0x7fd72406e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd744155530 tx=0x7fd734009110 comp rx=0 tx=0).stop 2024-09-12T02:28:46.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d2350 msgr2=0x7fd744155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d2350 0x7fd744155cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009f70 tx=0x7fd73c004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:46.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 shutdown_connections 2024-09-12T02:28:46.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd72406be30 0x7fd72406e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7440d2350 0x7fd744155cf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd7440d0f10 0x7fd744157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 --2- 172.21.15.181:0/765028935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd7440d0ad0 0x7fd744140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 >> 172.21.15.181:0/765028935 conn(0x7fd7440b7db0 msgr2=0x7fd7440b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:46.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 shutdown_connections 2024-09-12T02:28:46.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:46.816+0000 7fd748dc6640 1 -- 172.21.15.181:0/765028935 wait complete. 2024-09-12T02:28:46.828 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:28:46.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:28:46.872 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:28:46.914 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:28:46.914 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:28:46.914 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:46.930 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:28:46.930 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:46.986 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:47.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.124+0000 7fad7fd0a640 1 Processor -- start 2024-09-12T02:28:47.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.125+0000 7fad7fd0a640 1 -- start start 2024-09-12T02:28:47.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.125+0000 7fad7fd0a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad7815b2e0 0x7fad780b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.125+0000 7fad7fd0a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fad780b2490 0x7fad78071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.125+0000 7fad7fd0a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad780ce4f0 con 0x7fad780cdfc0 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.125+0000 7fad7fd0a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fad7815b6c0 con 0x7fad7815b2e0 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.125+0000 7fad7fd0a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fad780ce7d0 con 0x7fad780b2490 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7daa6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad7815b2e0 0x7fad780b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7daa6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad7815b2e0 0x7fad780b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44922/0 (socket says 172.21.15.181:44922) 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7daa6640 1 -- 172.21.15.181:0/4218255236 learned_addr learned my addr 172.21.15.181:0/4218255236 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7e2a7640 1 --2- 172.21.15.181:0/4218255236 >> v2:172.21.15.204:3300/0 conn(0x7fad780b2490 0x7fad78071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7daa6640 1 -- 172.21.15.181:0/4218255236 >> v2:172.21.15.204:3300/0 conn(0x7fad780b2490 msgr2=0x7fad78071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7daa6640 1 --2- 172.21.15.181:0/4218255236 >> v2:172.21.15.204:3300/0 conn(0x7fad780b2490 0x7fad78071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7daa6640 1 -- 172.21.15.181:0/4218255236 >> v1:172.21.15.204:6789/0 conn(0x7fad780cdfc0 legacy=0x7fad780b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.126+0000 7fad7daa6640 1 -- 172.21.15.181:0/4218255236 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad780ceab0 con 0x7fad7815b2e0 2024-09-12T02:28:47.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7daa6640 1 --2- 172.21.15.181:0/4218255236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad7815b2e0 0x7fad780b3d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad780b4830 tx=0x7fad7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e6db40acf00812 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7caa4640 1 -- 172.21.15.181:0/4218255236 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74037070 con 0x7fad7815b2e0 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7caa4640 1 -- 172.21.15.181:0/4218255236 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad74032440 con 0x7fad7815b2e0 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7caa4640 1 -- 172.21.15.181:0/4218255236 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74032810 con 0x7fad7815b2e0 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 -- 172.21.15.181:0/4218255236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad7815b2e0 msgr2=0x7fad780b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/4218255236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad7815b2e0 0x7fad780b3d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad780b4830 tx=0x7fad7402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 -- 172.21.15.181:0/4218255236 shutdown_connections 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/4218255236 >> v2:172.21.15.204:3300/0 conn(0x7fad780b2490 0x7fad78071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/4218255236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad7815b2e0 0x7fad780b3d20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 -- 172.21.15.181:0/4218255236 >> 172.21.15.181:0/4218255236 conn(0x7fad7806bc10 msgr2=0x7fad7806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 -- 172.21.15.181:0/4218255236 shutdown_connections 2024-09-12T02:28:47.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.127+0000 7fad7fd0a640 1 -- 172.21.15.181:0/4218255236 wait complete. 2024-09-12T02:28:47.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 Processor -- start 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 -- start start 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad780b2490 0x7fad7815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad780cdfc0 0x7fad78153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7815b2e0 0x7fad7814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fad780712b0 con 0x7fad780cdfc0 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fad78071130 con 0x7fad780b2490 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7fd0a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fad780b4260 con 0x7fad7815b2e0 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7d2a5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad780cdfc0 0x7fad78153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7d2a5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad780cdfc0 0x7fad78153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44938/0 (socket says 172.21.15.181:44938) 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.129+0000 7fad7d2a5640 1 -- 172.21.15.181:0/1452224302 learned_addr learned my addr 172.21.15.181:0/1452224302 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7daa6640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad780b2490 0x7fad7815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7e2a7640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7815b2e0 0x7fad7814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7d2a5640 1 -- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7815b2e0 msgr2=0x7fad7814eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7d2a5640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7815b2e0 0x7fad7814eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7d2a5640 1 -- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad780b2490 msgr2=0x7fad7815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7d2a5640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad780b2490 0x7fad7815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7d2a5640 1 -- 172.21.15.181:0/1452224302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7815cd30 con 0x7fad780cdfc0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7d2a5640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad780cdfc0 0x7fad78153330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad6800e710 tx=0x7fad6800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad6e7fc640 1 -- 172.21.15.181:0/1452224302 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad680052d0 con 0x7fad780cdfc0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad6e7fc640 1 -- 172.21.15.181:0/1452224302 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad68005470 con 0x7fad780cdfc0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad6e7fc640 1 -- 172.21.15.181:0/1452224302 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68001b50 con 0x7fad780cdfc0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7815d010 con 0x7fad780cdfc0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.130+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7815d5d0 con 0x7fad780cdfc0 2024-09-12T02:28:47.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.131+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad78158160 con 0x7fad780cdfc0 2024-09-12T02:28:47.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.132+0000 7fad6e7fc640 1 -- 172.21.15.181:0/1452224302 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad680035f0 con 0x7fad780cdfc0 2024-09-12T02:28:47.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.132+0000 7fad6e7fc640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fad5c06be30 0x7fad5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.132+0000 7fad7daa6640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fad5c06be30 0x7fad5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.132+0000 7fad6e7fc640 1 -- 172.21.15.181:0/1452224302 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad6808d0a0 con 0x7fad780cdfc0 2024-09-12T02:28:47.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.133+0000 7fad7daa6640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fad5c06be30 0x7fad5c06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fad74034000 tx=0x7fad7402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.136+0000 7fad6e7fc640 1 -- 172.21.15.181:0/1452224302 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad68016020 con 0x7fad780cdfc0 2024-09-12T02:28:47.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.315+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fad780b10f0 con 0x7fad780cdfc0 2024-09-12T02:28:47.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.315+0000 7fad6e7fc640 1 -- 172.21.15.181:0/1452224302 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fad6800ee20 con 0x7fad780cdfc0 2024-09-12T02:28:47.316 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:47.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fad5c06be30 msgr2=0x7fad5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fad5c06be30 0x7fad5c06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fad74034000 tx=0x7fad7402e000 comp rx=0 tx=0).stop 2024-09-12T02:28:47.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad780cdfc0 msgr2=0x7fad78153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad780cdfc0 0x7fad78153330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad6800e710 tx=0x7fad6800ebd0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 shutdown_connections 2024-09-12T02:28:47.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fad5c06be30 0x7fad5c06e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad7815b2e0 0x7fad7814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad780cdfc0 0x7fad78153330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 --2- 172.21.15.181:0/1452224302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad780b2490 0x7fad7815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 >> 172.21.15.181:0/1452224302 conn(0x7fad7806bc10 msgr2=0x7fad780cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:47.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 shutdown_connections 2024-09-12T02:28:47.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.317+0000 7fad7fd0a640 1 -- 172.21.15.181:0/1452224302 wait complete. 2024-09-12T02:28:47.329 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:28:47.329 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:47.345 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.485+0000 7f116ef91640 1 Processor -- start 2024-09-12T02:28:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.485+0000 7f116ef91640 1 -- start start 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.485+0000 7f116ef91640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f11680cf2b0 0x7f11680d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.485+0000 7f116ef91640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11680cf720 0x7f11680d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.485+0000 7f116ef91640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116815ea20 con 0x7f116815e640 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.485+0000 7f116ef91640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f11680b3d00 con 0x7f11680cf2b0 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.485+0000 7f116ef91640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11680b2860 con 0x7f11680cf720 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f1167fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f11680cf2b0 0x7f11680d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116d52e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11680cf720 0x7f11680d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116cd2d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f116815e640 0x7f11680ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:50462/0 (socket says 172.21.15.181:50462) 2024-09-12T02:28:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116d52e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11680cf720 0x7f11680d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:46146/0 (socket says 172.21.15.181:46146) 2024-09-12T02:28:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116cd2d640 1 -- 172.21.15.181:0/3560760087 learned_addr learned my addr 172.21.15.181:0/3560760087 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116d52e640 1 -- 172.21.15.181:0/3560760087 >> v2:172.21.15.204:3300/0 conn(0x7f11680cf2b0 msgr2=0x7f11680d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116d52e640 1 --2- 172.21.15.181:0/3560760087 >> v2:172.21.15.204:3300/0 conn(0x7f11680cf2b0 0x7f11680d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116d52e640 1 -- 172.21.15.181:0/3560760087 >> v1:172.21.15.204:6789/0 conn(0x7f116815e640 legacy=0x7f11680ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f116d52e640 1 -- 172.21.15.181:0/3560760087 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11680b1c50 con 0x7f11680cf720 2024-09-12T02:28:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.486+0000 7f1167fff640 1 --2- 172.21.15.181:0/3560760087 >> v2:172.21.15.204:3300/0 conn(0x7f11680cf2b0 0x7f11680d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:47.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.487+0000 7f116d52e640 1 --2- 172.21.15.181:0/3560760087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11680cf720 0x7f11680d2b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1160009d90 tx=0x7f116002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a83b946f208a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.487+0000 7f11677fe640 1 -- 172.21.15.181:0/3560760087 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160031600 con 0x7f11680cf720 2024-09-12T02:28:47.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.487+0000 7f11677fe640 1 -- 172.21.15.181:0/3560760087 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11600317a0 con 0x7f11680cf720 2024-09-12T02:28:47.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.487+0000 7f11677fe640 1 -- 172.21.15.181:0/3560760087 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160031b70 con 0x7f11680cf720 2024-09-12T02:28:47.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 -- 172.21.15.181:0/3560760087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11680cf720 msgr2=0x7f11680d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 --2- 172.21.15.181:0/3560760087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11680cf720 0x7f11680d2b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1160009d90 tx=0x7f116002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 -- 172.21.15.181:0/3560760087 shutdown_connections 2024-09-12T02:28:47.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 --2- 172.21.15.181:0/3560760087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11680cf720 0x7f11680d2b90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 --2- 172.21.15.181:0/3560760087 >> v2:172.21.15.204:3300/0 conn(0x7f11680cf2b0 0x7f11680d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 -- 172.21.15.181:0/3560760087 >> 172.21.15.181:0/3560760087 conn(0x7f116809d820 msgr2=0x7f11680d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:47.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 -- 172.21.15.181:0/3560760087 shutdown_connections 2024-09-12T02:28:47.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.488+0000 7f116ef91640 1 -- 172.21.15.181:0/3560760087 wait complete. 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.489+0000 7f116ef91640 1 Processor -- start 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.489+0000 7f116ef91640 1 -- start start 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116ef91640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11680cf2b0 0x7f11680c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116ef91640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11680cf720 0x7f1168160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116ef91640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f116815e640 0x7f11681f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116ef91640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11680b24f0 con 0x7f11680cf2b0 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116ef91640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f11680b2210 con 0x7f11680cf720 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116ef91640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11680cfe40 con 0x7f116815e640 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11680cf2b0 0x7f11680c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11680cf2b0 0x7f11680c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44948/0 (socket says 172.21.15.181:44948) 2024-09-12T02:28:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 -- 172.21.15.181:0/3237194985 learned_addr learned my addr 172.21.15.181:0/3237194985 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116d52e640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f116815e640 0x7f11681f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f1167fff640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11680cf720 0x7f1168160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 -- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f116815e640 msgr2=0x7f11681f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f116815e640 0x7f11681f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 -- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11680cf720 msgr2=0x7f1168160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11680cf720 0x7f1168160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 -- 172.21.15.181:0/3237194985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11681f4860 con 0x7f11680cf2b0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116d52e640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f116815e640 0x7f11681f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.490+0000 7f116cd2d640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11680cf2b0 0x7f11680c93c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c400 tx=0x7f115c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.491+0000 7f11657fa640 1 -- 172.21.15.181:0/3237194985 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c017070 con 0x7f11680cf2b0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.491+0000 7f11657fa640 1 -- 172.21.15.181:0/3237194985 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115c005ce0 con 0x7f11680cf2b0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.491+0000 7f11657fa640 1 -- 172.21.15.181:0/3237194985 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c0072f0 con 0x7f11680cf2b0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.491+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11681f4b00 con 0x7f11680cf2b0 2024-09-12T02:28:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.491+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11681f50c0 con 0x7f11680cf2b0 2024-09-12T02:28:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.492+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1168068eb0 con 0x7f11680cf2b0 2024-09-12T02:28:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.492+0000 7f11657fa640 1 -- 172.21.15.181:0/3237194985 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f115c01a070 con 0x7f11680cf2b0 2024-09-12T02:28:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.492+0000 7f11657fa640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f114c06be30 0x7f114c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.493+0000 7f11657fa640 1 -- 172.21.15.181:0/3237194985 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f115c08a1d0 con 0x7f11680cf2b0 2024-09-12T02:28:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.493+0000 7f1167fff640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f114c06be30 0x7f114c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.493+0000 7f1167fff640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f114c06be30 0x7f114c06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f116815e1f0 tx=0x7f1154008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.497+0000 7f11657fa640 1 -- 172.21.15.181:0/3237194985 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f115c058c10 con 0x7f11680cf2b0 2024-09-12T02:28:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.676+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f11680b8930 con 0x7f11680cf2b0 2024-09-12T02:28:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.676+0000 7f11657fa640 1 -- 172.21.15.181:0/3237194985 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f115c058510 con 0x7f11680cf2b0 2024-09-12T02:28:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f114c06be30 msgr2=0x7f114c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f114c06be30 0x7f114c06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f116815e1f0 tx=0x7f1154008040 comp rx=0 tx=0).stop 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11680cf2b0 msgr2=0x7f11680c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11680cf2b0 0x7f11680c93c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c400 tx=0x7f115c00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 shutdown_connections 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f114c06be30 0x7f114c06e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11680cf720 0x7f1168160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f116815e640 0x7f11681f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 --2- 172.21.15.181:0/3237194985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11680cf2b0 0x7f11680c93c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 >> 172.21.15.181:0/3237194985 conn(0x7f116809d820 msgr2=0x7f11680b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 shutdown_connections 2024-09-12T02:28:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.679+0000 7f116ef91640 1 -- 172.21.15.181:0/3237194985 wait complete. 2024-09-12T02:28:47.691 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:28:47.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:47.691 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:28:47.715 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:47.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:28:47.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:47.716 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:28:47.797 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:28:47.797 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:47.817 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:28:47.818 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:47.877 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:47.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.974+0000 7ff5fafcf640 1 Processor -- start 2024-09-12T02:28:47.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.974+0000 7ff5fafcf640 1 -- start start 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.975+0000 7ff5fafcf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff5f415c4a0 0x7ff5f40cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.975+0000 7ff5fafcf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f40d0a30 con 0x7ff5f40b47a0 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.975+0000 7ff5fafcf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f40b76f0 con 0x7ff5f40d2da0 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.975+0000 7ff5fafcf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f40d0d30 con 0x7ff5f415c4a0 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.975+0000 7ff5f956c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff5f40b47a0 0x7ff5f4166030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45030/0 (socket says 172.21.15.181:45030) 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.975+0000 7ff5f956c640 1 -- 172.21.15.181:0/527391706 learned_addr learned my addr 172.21.15.181:0/527391706 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419324082 0 0) 0x7ff5f40d0a30 con 0x7ff5f40b47a0 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e0003520 con 0x7ff5f40b47a0 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/527391706 >> v2:172.21.15.204:3300/0 conn(0x7ff5f415c4a0 0x7ff5f40cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 346810125 0 0) 0x7ff5e0003520 con 0x7ff5f40b47a0 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 >> v2:172.21.15.204:3300/0 conn(0x7ff5f415c4a0 msgr2=0x7ff5f40cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 --2- 172.21.15.181:0/527391706 >> v2:172.21.15.204:3300/0 conn(0x7ff5f415c4a0 0x7ff5f40cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 >> v1:172.21.15.204:6789/0 conn(0x7ff5f40d2da0 legacy=0x7ff5f40b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f4073710 con 0x7ff5f40b47a0 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7ff5ec001670 con 0x7ff5f40b47a0 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 >> v1:172.21.15.181:6789/0 conn(0x7ff5f40b47a0 legacy=0x7ff5f4166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5e00039b0 0x7ff5e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5e0004800 0x7ff5e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00052e0 0x7ff5e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f40d0d30 con 0x7ff5e00039b0 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e000c1b0 con 0x7ff5e0004800 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e000c3b0 con 0x7ff5e00052e0 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/527391706 >> v2:172.21.15.204:3300/0 conn(0x7ff5f415c4a0 0x7ff5f40cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f3fff640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5e0004800 0x7ff5e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5e00039b0 0x7ff5e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f956c640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00052e0 0x7ff5e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f8d6b640 1 -- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00052e0 msgr2=0x7ff5e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00052e0 0x7ff5e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f8d6b640 1 -- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5e0004800 msgr2=0x7ff5e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.976+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5e0004800 0x7ff5e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.977+0000 7ff5f8d6b640 1 -- 172.21.15.181:0/527391706 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e0003520 con 0x7ff5e00039b0 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.977+0000 7ff5f956c640 1 -- 172.21.15.181:0/527391706 reap_dead start 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.977+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5e00039b0 0x7ff5e0003dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40073b0 tx=0x7ff5e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3160743121575f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.977+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4033070 con 0x7ff5e00039b0 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.977+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e402f650 con 0x7ff5e00039b0 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.977+0000 7ff5f37fe640 1 -- 172.21.15.181:0/527391706 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4009c70 con 0x7ff5e00039b0 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.978+0000 7ff5fafcf640 1 -- 172.21.15.181:0/527391706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5e00039b0 msgr2=0x7ff5e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.978+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5e00039b0 0x7ff5e0003dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40073b0 tx=0x7ff5e0005830 comp rx=0 tx=0).stop 2024-09-12T02:28:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.978+0000 7ff5fafcf640 1 -- 172.21.15.181:0/527391706 shutdown_connections 2024-09-12T02:28:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.978+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/527391706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5e00039b0 0x7ff5e0003dd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.978+0000 7ff5fafcf640 1 -- 172.21.15.181:0/527391706 >> 172.21.15.181:0/527391706 conn(0x7ff5f4067950 msgr2=0x7ff5f4067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.978+0000 7ff5fafcf640 1 -- 172.21.15.181:0/527391706 shutdown_connections 2024-09-12T02:28:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.978+0000 7ff5fafcf640 1 -- 172.21.15.181:0/527391706 wait complete. 2024-09-12T02:28:47.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.979+0000 7ff5fafcf640 1 Processor -- start 2024-09-12T02:28:47.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.979+0000 7ff5fafcf640 1 -- start start 2024-09-12T02:28:47.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5fafcf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00039b0 0x7ff5f40ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5fafcf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5f40add00 0x7ff5f40ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5fafcf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5f40ad610 0x7ff5f4156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5fafcf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f40cff80 con 0x7ff5f40ad610 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5fafcf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f40d28e0 con 0x7ff5f40add00 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5fafcf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f40d0100 con 0x7ff5e00039b0 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5f40ad610 0x7ff5f4156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5f40ad610 0x7ff5f4156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44972/0 (socket says 172.21.15.181:44972) 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 -- 172.21.15.181:0/289202356 learned_addr learned my addr 172.21.15.181:0/289202356 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00039b0 0x7ff5f40ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f3fff640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5f40add00 0x7ff5f40ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 -- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00039b0 msgr2=0x7ff5f40ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00039b0 0x7ff5f40ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 -- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5f40add00 msgr2=0x7ff5f40ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:47.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5f40add00 0x7ff5f40ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.980+0000 7ff5f956c640 1 -- 172.21.15.181:0/289202356 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f40ab2c0 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.981+0000 7ff5f956c640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5f40ad610 0x7ff5f4156af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4068900 tx=0x7ff5ec007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.981+0000 7ff5f17fa640 1 -- 172.21.15.181:0/289202356 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00f680 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.981+0000 7ff5f17fa640 1 -- 172.21.15.181:0/289202356 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec018070 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.981+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f40ab5a0 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.981+0000 7ff5f17fa640 1 -- 172.21.15.181:0/289202356 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00faa0 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.981+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f40abb60 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.982+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f415c880 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.982+0000 7ff5f17fa640 1 -- 172.21.15.181:0/289202356 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5ec00fc40 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.983+0000 7ff5f17fa640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff5d406be30 0x7ff5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.983+0000 7ff5f17fa640 1 -- 172.21.15.181:0/289202356 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5ec08aae0 con 0x7ff5f40ad610 2024-09-12T02:28:47.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.983+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff5d406be30 0x7ff5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:47.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.983+0000 7ff5f8d6b640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff5d406be30 0x7ff5d406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4035000 tx=0x7ff5e400b030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:47.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:47.987+0000 7ff5f17fa640 1 -- 172.21.15.181:0/289202356 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5ec058e40 con 0x7ff5f40ad610 2024-09-12T02:28:48.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.163+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff5f40b5e00 con 0x7ff5f40ad610 2024-09-12T02:28:48.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.164+0000 7ff5f17fa640 1 -- 172.21.15.181:0/289202356 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7ff5ec05d140 con 0x7ff5f40ad610 2024-09-12T02:28:48.165 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff5d406be30 msgr2=0x7ff5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff5d406be30 0x7ff5d406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4035000 tx=0x7ff5e400b030 comp rx=0 tx=0).stop 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5f40ad610 msgr2=0x7ff5f4156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5f40ad610 0x7ff5f4156af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4068900 tx=0x7ff5ec007430 comp rx=0 tx=0).stop 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 shutdown_connections 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff5d406be30 0x7ff5d406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff5f40add00 0x7ff5f40ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5f40ad610 0x7ff5f4156af0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 --2- 172.21.15.181:0/289202356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff5e00039b0 0x7ff5f40ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 >> 172.21.15.181:0/289202356 conn(0x7ff5f4067950 msgr2=0x7ff5f40b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 shutdown_connections 2024-09-12T02:28:48.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.166+0000 7ff5fafcf640 1 -- 172.21.15.181:0/289202356 wait complete. 2024-09-12T02:28:48.177 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:28:48.177 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:48.197 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.296+0000 7f39066ba640 1 Processor -- start 2024-09-12T02:28:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.296+0000 7f39066ba640 1 -- start start 2024-09-12T02:28:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.297+0000 7f39066ba640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f390006f2f0 0x7f39000ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.297+0000 7f39066ba640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390006e900 con 0x7f390006dbb0 2024-09-12T02:28:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.297+0000 7f39066ba640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39000b36d0 con 0x7f390015c4f0 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.297+0000 7f39066ba640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f390006e6d0 con 0x7f390006f2f0 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.297+0000 7f38ff7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f390006f2f0 0x7f39000ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.297+0000 7f3904c57640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f390006dbb0 0x7f390006dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45040/0 (socket says 172.21.15.181:45040) 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.297+0000 7f3904c57640 1 -- 172.21.15.181:0/773850530 learned_addr learned my addr 172.21.15.181:0/773850530 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.298+0000 7f38ff7fe640 1 -- 172.21.15.181:0/773850530 >> v1:172.21.15.204:6789/0 conn(0x7f390015c4f0 legacy=0x7f390006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.298+0000 7f38ff7fe640 1 -- 172.21.15.181:0/773850530 >> v1:172.21.15.181:6789/0 conn(0x7f390006dbb0 legacy=0x7f390006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.298+0000 7f38ff7fe640 1 -- 172.21.15.181:0/773850530 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39000b39b0 con 0x7f390006f2f0 2024-09-12T02:28:48.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.298+0000 7f38feffd640 1 -- 172.21.15.181:0/773850530 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610669060 0 0) 0x7f390006e900 con 0x7f390006dbb0 2024-09-12T02:28:48.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.298+0000 7f38ff7fe640 1 --2- 172.21.15.181:0/773850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f39000ce460 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097a0 tx=0x7f38f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5688d53488a8de09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f38feffd640 1 -- 172.21.15.181:0/773850530 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4037070 con 0x7f390006f2f0 2024-09-12T02:28:48.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f38feffd640 1 -- 172.21.15.181:0/773850530 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f4032440 con 0x7f390006f2f0 2024-09-12T02:28:48.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f38feffd640 1 -- 172.21.15.181:0/773850530 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4032810 con 0x7f390006f2f0 2024-09-12T02:28:48.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f39066ba640 1 -- 172.21.15.181:0/773850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 msgr2=0x7f39000ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f39066ba640 1 --2- 172.21.15.181:0/773850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f39000ce460 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097a0 tx=0x7f38f402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f39066ba640 1 -- 172.21.15.181:0/773850530 shutdown_connections 2024-09-12T02:28:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f39066ba640 1 --2- 172.21.15.181:0/773850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f39000ce460 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f39066ba640 1 -- 172.21.15.181:0/773850530 >> 172.21.15.181:0/773850530 conn(0x7f39000b21c0 msgr2=0x7f39000b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f39066ba640 1 -- 172.21.15.181:0/773850530 shutdown_connections 2024-09-12T02:28:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.299+0000 7f39066ba640 1 -- 172.21.15.181:0/773850530 wait complete. 2024-09-12T02:28:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.300+0000 7f39066ba640 1 Processor -- start 2024-09-12T02:28:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f39066ba640 1 -- start start 2024-09-12T02:28:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f39066ba640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f390006dbb0 0x7f390015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f39066ba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f3900151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f39066ba640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f390015c4f0 0x7f390015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f39066ba640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f39000b41b0 con 0x7f390006f2f0 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f39066ba640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f390015c8d0 con 0x7f390006dbb0 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f39066ba640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f39000b4330 con 0x7f390015c4f0 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f38ff7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f3900151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f38ff7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f3900151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44996/0 (socket says 172.21.15.181:44996) 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.301+0000 7f38ff7fe640 1 -- 172.21.15.181:0/1636833462 learned_addr learned my addr 172.21.15.181:0/1636833462 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f3904c57640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f390015c4f0 0x7f390015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38fffff640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f390006dbb0 0x7f390015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38ff7fe640 1 -- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f390015c4f0 msgr2=0x7f390015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38ff7fe640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f390015c4f0 0x7f390015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38ff7fe640 1 -- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f390006dbb0 msgr2=0x7f390015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38ff7fe640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f390006dbb0 0x7f390015e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38ff7fe640 1 -- 172.21.15.181:0/1636833462 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390015d510 con 0x7f390006f2f0 2024-09-12T02:28:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f3904c57640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f390015c4f0 0x7f390015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38fffff640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f390006dbb0 0x7f390015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38ff7fe640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f3900151360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097a0 tx=0x7f38f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38fcff9640 1 -- 172.21.15.181:0/1636833462 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4037040 con 0x7f390006f2f0 2024-09-12T02:28:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38fcff9640 1 -- 172.21.15.181:0/1636833462 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f4004250 con 0x7f390006f2f0 2024-09-12T02:28:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390015d7f0 con 0x7f390006f2f0 2024-09-12T02:28:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f38fcff9640 1 -- 172.21.15.181:0/1636833462 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4032e20 con 0x7f390006f2f0 2024-09-12T02:28:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.302+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390015e090 con 0x7f390006f2f0 2024-09-12T02:28:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.303+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39000ce460 con 0x7f390006f2f0 2024-09-12T02:28:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.303+0000 7f38fcff9640 1 -- 172.21.15.181:0/1636833462 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38f4030770 con 0x7f390006f2f0 2024-09-12T02:28:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.304+0000 7f38fcff9640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f38ec06be30 0x7f38ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.304+0000 7f38fcff9640 1 -- 172.21.15.181:0/1636833462 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f38f40ac180 con 0x7f390006f2f0 2024-09-12T02:28:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.304+0000 7f38fffff640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f38ec06be30 0x7f38ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.304+0000 7f38fffff640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f38ec06be30 0x7f38ec06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38f000a830 tx=0x7f38f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.308+0000 7f38fcff9640 1 -- 172.21.15.181:0/1636833462 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38f407ac50 con 0x7f390006f2f0 2024-09-12T02:28:48.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.486+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f39000ccf20 con 0x7f390006f2f0 2024-09-12T02:28:48.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.487+0000 7f38fcff9640 1 -- 172.21.15.181:0/1636833462 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f38f407a550 con 0x7f390006f2f0 2024-09-12T02:28:48.488 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f38ec06be30 msgr2=0x7f38ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f38ec06be30 0x7f38ec06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38f000a830 tx=0x7f38f0008040 comp rx=0 tx=0).stop 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 msgr2=0x7f3900151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f3900151360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097a0 tx=0x7f38f40046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 shutdown_connections 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f38ec06be30 0x7f38ec06e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f390015c4f0 0x7f390015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390006f2f0 0x7f3900151360 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 --2- 172.21.15.181:0/1636833462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f390006dbb0 0x7f390015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 >> 172.21.15.181:0/1636833462 conn(0x7f39000b21c0 msgr2=0x7f39000b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 shutdown_connections 2024-09-12T02:28:48.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.489+0000 7f39066ba640 1 -- 172.21.15.181:0/1636833462 wait complete. 2024-09-12T02:28:48.500 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi204.front.sepia.ceph.com... 2024-09-12T02:28:48.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:48.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T02:28:48.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:48.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:28:48.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:48.533 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:28:48.595 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:28:48.595 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:48.612 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:28:48.612 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:48.668 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:48.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.806+0000 7f76f3230640 1 Processor -- start 2024-09-12T02:28:48.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.806+0000 7f76f3230640 1 -- start start 2024-09-12T02:28:48.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76f3230640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec15e7c0 0x7f76ec162b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76f3230640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f76ec0cf480 0x7f76ec0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76f3230640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec0b39a0 con 0x7f76ec15f900 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76f3230640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f76ec1630d0 con 0x7f76ec0cf480 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76f3230640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec15eba0 con 0x7f76ec15e7c0 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76e3fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f76ec0cf480 0x7f76ec0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76e3fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f76ec0cf480 0x7f76ec0b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45006/0 (socket says 172.21.15.181:45006) 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76e3fff640 1 -- 172.21.15.181:0/138356470 learned_addr learned my addr 172.21.15.181:0/138356470 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76e3fff640 1 -- 172.21.15.181:0/138356470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec15e7c0 msgr2=0x7f76ec162b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76e3fff640 1 --2- 172.21.15.181:0/138356470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec15e7c0 0x7f76ec162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76e3fff640 1 -- 172.21.15.181:0/138356470 >> v1:172.21.15.204:6789/0 conn(0x7f76ec15f900 legacy=0x7f76ec0b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:48.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.807+0000 7f76e3fff640 1 -- 172.21.15.181:0/138356470 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec0cfc60 con 0x7f76ec0cf480 2024-09-12T02:28:48.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.808+0000 7f76e3fff640 1 --2- 172.21.15.181:0/138356470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec0cf480 0x7f76ec0b6330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009870 tx=0x7f76dc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3ba56f02e86f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.808+0000 7f76e37fe640 1 -- 172.21.15.181:0/138356470 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc037070 con 0x7f76ec0cf480 2024-09-12T02:28:48.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.808+0000 7f76e37fe640 1 -- 172.21.15.181:0/138356470 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc032440 con 0x7f76ec0cf480 2024-09-12T02:28:48.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.808+0000 7f76e37fe640 1 -- 172.21.15.181:0/138356470 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc032810 con 0x7f76ec0cf480 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.808+0000 7f76f3230640 1 -- 172.21.15.181:0/138356470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec0cf480 msgr2=0x7f76ec0b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.808+0000 7f76f3230640 1 --2- 172.21.15.181:0/138356470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec0cf480 0x7f76ec0b6330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009870 tx=0x7f76dc02a2a0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.808+0000 7f76f3230640 1 -- 172.21.15.181:0/138356470 shutdown_connections 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.809+0000 7f76f3230640 1 --2- 172.21.15.181:0/138356470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec0cf480 0x7f76ec0b6330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.809+0000 7f76f3230640 1 --2- 172.21.15.181:0/138356470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec15e7c0 0x7f76ec162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.809+0000 7f76f3230640 1 -- 172.21.15.181:0/138356470 >> 172.21.15.181:0/138356470 conn(0x7f76ec0d1320 msgr2=0x7f76ec0d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.809+0000 7f76f3230640 1 -- 172.21.15.181:0/138356470 shutdown_connections 2024-09-12T02:28:48.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.809+0000 7f76f3230640 1 -- 172.21.15.181:0/138356470 wait complete. 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.810+0000 7f76f3230640 1 Processor -- start 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.810+0000 7f76f3230640 1 -- start start 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec0cf480 0x7f76ec14f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec15e7c0 0x7f76ec0b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76ec15f900 0x7f76ec0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec15f100 con 0x7f76ec15e7c0 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec15ee20 con 0x7f76ec15f900 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec15f3e0 con 0x7f76ec0cf480 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec15e7c0 0x7f76ec0b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec15e7c0 0x7f76ec0b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45014/0 (socket says 172.21.15.181:45014) 2024-09-12T02:28:48.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 -- 172.21.15.181:0/1103039816 learned_addr learned my addr 172.21.15.181:0/1103039816 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f0fcc640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec0cf480 0x7f76ec14f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 -- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec0cf480 msgr2=0x7f76ec14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f17cd640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76ec15f900 0x7f76ec0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec0cf480 0x7f76ec14f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 -- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76ec15f900 msgr2=0x7f76ec0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76ec15f900 0x7f76ec0b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 -- 172.21.15.181:0/1103039816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec14fd80 con 0x7f76ec15e7c0 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e3fff640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec15e7c0 0x7f76ec0b50c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f76dc000c00 tx=0x7f76dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e17fa640 1 -- 172.21.15.181:0/1103039816 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc041070 con 0x7f76ec15e7c0 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e17fa640 1 -- 172.21.15.181:0/1103039816 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc03c870 con 0x7f76ec15e7c0 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec0ccb70 con 0x7f76ec15e7c0 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76e17fa640 1 -- 172.21.15.181:0/1103039816 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc037040 con 0x7f76ec15e7c0 2024-09-12T02:28:48.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.811+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec0cd130 con 0x7f76ec15e7c0 2024-09-12T02:28:48.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.812+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec0761a0 con 0x7f76ec15e7c0 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.813+0000 7f76e17fa640 1 -- 172.21.15.181:0/1103039816 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76dc044070 con 0x7f76ec15e7c0 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.813+0000 7f76e17fa640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f76d806be30 0x7f76d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.814+0000 7f76f0fcc640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f76d806be30 0x7f76d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.814+0000 7f76e17fa640 1 -- 172.21.15.181:0/1103039816 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f76dc0ab8e0 con 0x7f76ec15e7c0 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.814+0000 7f76f0fcc640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f76d806be30 0x7f76d806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f76e800a810 tx=0x7f76e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.818+0000 7f76e17fa640 1 -- 172.21.15.181:0/1103039816 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76ec0761a0 con 0x7f76ec15e7c0 2024-09-12T02:28:48.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.994+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76ec0ce810 con 0x7f76ec15e7c0 2024-09-12T02:28:48.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.995+0000 7f76e17fa640 1 -- 172.21.15.181:0/1103039816 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f76ec0ce810 con 0x7f76ec15e7c0 2024-09-12T02:28:48.996 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:48.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f76d806be30 msgr2=0x7f76d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f76d806be30 0x7f76d806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f76e800a810 tx=0x7f76e8008040 comp rx=0 tx=0).stop 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec15e7c0 msgr2=0x7f76ec0b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec15e7c0 0x7f76ec0b50c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f76dc000c00 tx=0x7f76dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 shutdown_connections 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f76d806be30 0x7f76d806e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f76ec15f900 0x7f76ec0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ec15e7c0 0x7f76ec0b50c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 --2- 172.21.15.181:0/1103039816 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f76ec0cf480 0x7f76ec14f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 >> 172.21.15.181:0/1103039816 conn(0x7f76ec0d1320 msgr2=0x7f76ec0d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 shutdown_connections 2024-09-12T02:28:48.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:48.997+0000 7f76f3230640 1 -- 172.21.15.181:0/1103039816 wait complete. 2024-09-12T02:28:49.009 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:28:49.009 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:49.024 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:49.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.163+0000 7fa9c648b640 1 Processor -- start 2024-09-12T02:28:49.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.163+0000 7fa9c648b640 1 -- start start 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9c648b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa9c015e8c0 0x7fa9c00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9c648b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c006cec0 con 0x7fa9c015e4e0 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9c648b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c006d160 con 0x7fa9c00b6ee0 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9c648b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c00d2d40 con 0x7fa9c015e8c0 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9bffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa9c015e4e0 0x7fa9c00b67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45052/0 (socket says 172.21.15.181:45052) 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9bffff640 1 -- 172.21.15.181:0/3887891969 learned_addr learned my addr 172.21.15.181:0/3887891969 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9bf7fe640 1 --2- 172.21.15.181:0/3887891969 >> v2:172.21.15.204:3300/0 conn(0x7fa9c015e8c0 0x7fa9c00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083551109 0 0) 0x7fa9c006cec0 con 0x7fa9c015e4e0 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.164+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9a8003520 con 0x7fa9c015e4e0 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 287146075 0 0) 0x7fa9a8003520 con 0x7fa9c015e4e0 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 >> v2:172.21.15.204:3300/0 conn(0x7fa9c015e8c0 msgr2=0x7fa9c00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 --2- 172.21.15.181:0/3887891969 >> v2:172.21.15.204:3300/0 conn(0x7fa9c015e8c0 0x7fa9c00d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 >> v1:172.21.15.204:6789/0 conn(0x7fa9c00b6ee0 legacy=0x7fa9c00d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c006d440 con 0x7fa9c015e4e0 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fa9b0001690 con 0x7fa9c015e4e0 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 >> v1:172.21.15.181:6789/0 conn(0x7fa9c015e4e0 legacy=0x7fa9c00b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9a80039b0 0x7fa9a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9a8004800 0x7fa9a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00d2d40 con 0x7fa9a80051c0 2024-09-12T02:28:49.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a800c160 con 0x7fa9a80039b0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a800c360 con 0x7fa9a8004800 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9c4a28640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9bffff640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9a80039b0 0x7fa9a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9bf7fe640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9a8004800 0x7fa9a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9c4a28640 1 -- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9a8004800 msgr2=0x7fa9a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9c4a28640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9a8004800 0x7fa9a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9c4a28640 1 -- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9a80039b0 msgr2=0x7fa9a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9c4a28640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9a80039b0 0x7fa9a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.165+0000 7fa9c4a28640 1 -- 172.21.15.181:0/3887891969 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a8003520 con 0x7fa9a80051c0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c4a28640 1 -- 172.21.15.181:0/3887891969 reap_dead start 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c4a28640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9a800b9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8001e50 tx=0x7fa9a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa642a8002b684f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8001a70 con 0x7fa9a80051c0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b8003970 con 0x7fa9a80051c0 2024-09-12T02:28:49.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9beffd640 1 -- 172.21.15.181:0/3887891969 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8003d60 con 0x7fa9a80051c0 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c648b640 1 -- 172.21.15.181:0/3887891969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 msgr2=0x7fa9a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c648b640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9a800b9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8001e50 tx=0x7fa9a8005830 comp rx=0 tx=0).stop 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c648b640 1 -- 172.21.15.181:0/3887891969 shutdown_connections 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c648b640 1 --2- 172.21.15.181:0/3887891969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9a800b9c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c648b640 1 -- 172.21.15.181:0/3887891969 >> 172.21.15.181:0/3887891969 conn(0x7fa9c006f400 msgr2=0x7fa9c006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c648b640 1 -- 172.21.15.181:0/3887891969 shutdown_connections 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.166+0000 7fa9c648b640 1 -- 172.21.15.181:0/3887891969 wait complete. 2024-09-12T02:28:49.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.168+0000 7fa9c648b640 1 Processor -- start 2024-09-12T02:28:49.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.168+0000 7fa9c648b640 1 -- start start 2024-09-12T02:28:49.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.168+0000 7fa9c648b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9c0145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.168+0000 7fa9c648b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c00b19c0 0x7fa9c00b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.168+0000 7fa9c648b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c0159240 0x7fa9c01596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.168+0000 7fa9c648b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00b6950 con 0x7fa9a80051c0 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9c648b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00b67d0 con 0x7fa9c0159240 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9c648b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c00b6ad0 con 0x7fa9c00b19c0 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9c0145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9c0145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45024/0 (socket says 172.21.15.181:45024) 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 -- 172.21.15.181:0/681294838 learned_addr learned my addr 172.21.15.181:0/681294838 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 -- 172.21.15.181:0/681294838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c00b19c0 msgr2=0x7fa9c00b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c00b19c0 0x7fa9c00b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 -- 172.21.15.181:0/681294838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c0159240 msgr2=0x7fa9c01596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c0159240 0x7fa9c01596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 -- 172.21.15.181:0/681294838 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c00b2380 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bffff640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9c0145a70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0007320 tx=0x7fa9b00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bcff9640 1 -- 172.21.15.181:0/681294838 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b001a070 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bcff9640 1 -- 172.21.15.181:0/681294838 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b000f9a0 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9bcff9640 1 -- 172.21.15.181:0/681294838 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000fd90 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c0159f70 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.169+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c0146460 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.170+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c00d1fc0 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.171+0000 7fa9bcff9640 1 -- 172.21.15.181:0/681294838 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9b001d070 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.171+0000 7fa9bcff9640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.171+0000 7fa9bcff9640 1 -- 172.21.15.181:0/681294838 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa9b008a900 con 0x7fa9a80051c0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.171+0000 7fa9bf7fe640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.172+0000 7fa9bf7fe640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00aef50 tx=0x7fa9b4009320 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.176+0000 7fa9bcff9640 1 -- 172.21.15.181:0/681294838 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9b00592b0 con 0x7fa9a80051c0 2024-09-12T02:28:49.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.354+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa9c00d27c0 con 0x7fa9a80051c0 2024-09-12T02:28:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.355+0000 7fa9bcff9640 1 -- 172.21.15.181:0/681294838 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fa9b0058bb0 con 0x7fa9a80051c0 2024-09-12T02:28:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa9ac06be30 msgr2=0x7fa9ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00aef50 tx=0x7fa9b4009320 comp rx=0 tx=0).stop 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 msgr2=0x7fa9c0145a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9c0145a70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0007320 tx=0x7fa9b00077e0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 shutdown_connections 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c0159240 0x7fa9c01596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c00b19c0 0x7fa9c00b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 --2- 172.21.15.181:0/681294838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80051c0 0x7fa9c0145a70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 >> 172.21.15.181:0/681294838 conn(0x7fa9c006f400 msgr2=0x7fa9c015b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 shutdown_connections 2024-09-12T02:28:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.357+0000 7fa9c648b640 1 -- 172.21.15.181:0/681294838 wait complete. 2024-09-12T02:28:49.368 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:28:49.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:49.368 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-12T02:28:49.393 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:49.393 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:28:49.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:49.394 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:28:49.449 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:28:49.449 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:49.468 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:28:49.468 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:49.528 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:49.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.626+0000 7f98d27d8640 1 Processor -- start 2024-09-12T02:28:49.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.626+0000 7f98d27d8640 1 -- start start 2024-09-12T02:28:49.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.626+0000 7f98d27d8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 0x7f98cc0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.626+0000 7f98d27d8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f98cc0cf6f0 0x7f98cc0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.626+0000 7f98d27d8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98cc15ea20 con 0x7f98cc15e640 2024-09-12T02:28:49.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.626+0000 7f98d27d8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f98cc0b3d00 con 0x7f98cc0cf6f0 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.626+0000 7f98d27d8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f98cc0b2860 con 0x7f98cc0cf2b0 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98cbfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f98cc15e640 0x7f98cc0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44240/0 (socket says 172.21.15.181:44240) 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98cbfff640 1 -- 172.21.15.181:0/3694209593 learned_addr learned my addr 172.21.15.181:0/3694209593 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425930192 0 0) 0x7f98cc15ea20 con 0x7f98cc15e640 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98b8003520 con 0x7f98cc15e640 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98cb7fe640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 0x7f98cc0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98d0d75640 1 --2- 172.21.15.181:0/3694209593 >> v2:172.21.15.204:3300/0 conn(0x7f98cc0cf6f0 0x7f98cc0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3237090323 0 0) 0x7f98b8003520 con 0x7f98cc15e640 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 msgr2=0x7f98cc0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 0x7f98cc0d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 >> v2:172.21.15.204:3300/0 conn(0x7f98cc0cf6f0 msgr2=0x7f98cc0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 --2- 172.21.15.181:0/3694209593 >> v2:172.21.15.204:3300/0 conn(0x7f98cc0cf6f0 0x7f98cc0d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc0b1c50 con 0x7f98cc15e640 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f98bc001670 con 0x7f98cc15e640 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 >> v1:172.21.15.181:6789/0 conn(0x7f98cc15e640 legacy=0x7f98cc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 0x7f98b80039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8003f50 0x7f98b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b8004d40 0x7f98b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc0b2860 con 0x7f98b8004d40 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f98b800b9c0 con 0x7f98b8003f50 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f98b800bbc0 con 0x7f98cc0cf2b0 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98d0d75640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b8004d40 0x7f98b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98cbfff640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 0x7f98b80039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.627+0000 7f98cb7fe640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8003f50 0x7f98b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98d0d75640 1 -- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 msgr2=0x7f98b80039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98d0d75640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc0cf2b0 0x7f98b80039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98d0d75640 1 -- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8003f50 msgr2=0x7f98b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98d0d75640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8003f50 0x7f98b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98d0d75640 1 -- 172.21.15.181:0/3694209593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b8003520 con 0x7f98b8004d40 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98cb7fe640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98b8003f50 0x7f98b8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98d0d75640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b8004d40 0x7f98b80051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009f90 tx=0x7f98b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36733098af2b1261 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4009c10 con 0x7f98b8004d40 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c4036070 con 0x7f98b8004d40 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.628+0000 7f98caffd640 1 -- 172.21.15.181:0/3694209593 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4031880 con 0x7f98b8004d40 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.629+0000 7f98d27d8640 1 -- 172.21.15.181:0/3694209593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b8004d40 msgr2=0x7f98b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.629+0000 7f98d27d8640 1 --2- 172.21.15.181:0/3694209593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b8004d40 0x7f98b80051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009f90 tx=0x7f98b8005830 comp rx=0 tx=0).stop 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.629+0000 7f98d0d75640 1 -- 172.21.15.181:0/3694209593 reap_dead start 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.629+0000 7f98d27d8640 1 -- 172.21.15.181:0/3694209593 shutdown_connections 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.629+0000 7f98d27d8640 1 -- 172.21.15.181:0/3694209593 >> 172.21.15.181:0/3694209593 conn(0x7f98cc09d820 msgr2=0x7f98cc0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:49.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.629+0000 7f98d27d8640 1 -- 172.21.15.181:0/3694209593 shutdown_connections 2024-09-12T02:28:49.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.629+0000 7f98d27d8640 1 -- 172.21.15.181:0/3694209593 wait complete. 2024-09-12T02:28:49.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.630+0000 7f98d27d8640 1 Processor -- start 2024-09-12T02:28:49.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.630+0000 7f98d27d8640 1 -- start start 2024-09-12T02:28:49.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d27d8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc06c0c0 0x7f98cc1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d27d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98cc06c4a0 0x7f98cc150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d27d8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98cc1f76a0 0x7f98cc1f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d27d8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc0b24f0 con 0x7f98cc06c4a0 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d27d8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc0b2210 con 0x7f98cc1f76a0 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d27d8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f98cc0cfe40 con 0x7f98cc06c0c0 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98cc06c4a0 0x7f98cc150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98cc06c4a0 0x7f98cc150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41366/0 (socket says 172.21.15.181:41366) 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 -- 172.21.15.181:0/2291830 learned_addr learned my addr 172.21.15.181:0/2291830 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cbfff640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc06c0c0 0x7f98cc1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d0d75640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98cc1f76a0 0x7f98cc1f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 -- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc06c0c0 msgr2=0x7f98cc1505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc06c0c0 0x7f98cc1505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 -- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98cc1f76a0 msgr2=0x7f98cc1f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98cc1f76a0 0x7f98cc1f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cb7fe640 1 -- 172.21.15.181:0/2291830 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc1f8320 con 0x7f98cc06c4a0 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98cbfff640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc06c0c0 0x7f98cc1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.631+0000 7f98d0d75640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98cc1f76a0 0x7f98cc1f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:49.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.632+0000 7f98cb7fe640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98cc06c4a0 0x7f98cc150ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f98b4011510 tx=0x7f98b40119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.632+0000 7f98c8ff9640 1 -- 172.21.15.181:0/2291830 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4015870 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.632+0000 7f98c8ff9640 1 -- 172.21.15.181:0/2291830 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4015a10 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.632+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc0cc8e0 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.632+0000 7f98c8ff9640 1 -- 172.21.15.181:0/2291830 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4015dc0 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.632+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc1f8040 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.633+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98cc068eb0 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.633+0000 7f98c8ff9640 1 -- 172.21.15.181:0/2291830 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98b4013400 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.633+0000 7f98c8ff9640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ac06be30 0x7f98ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.634+0000 7f98c8ff9640 1 -- 172.21.15.181:0/2291830 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f98b408b700 con 0x7f98cc06c4a0 2024-09-12T02:28:49.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.634+0000 7f98cbfff640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ac06be30 0x7f98ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.634+0000 7f98cbfff640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ac06be30 0x7f98ac06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98bc004840 tx=0x7f98bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.638+0000 7f98c8ff9640 1 -- 172.21.15.181:0/2291830 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98b4019030 con 0x7f98cc06c4a0 2024-09-12T02:28:49.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.814+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f98cc0b73a0 con 0x7f98cc06c4a0 2024-09-12T02:28:49.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.814+0000 7f98c8ff9640 1 -- 172.21.15.181:0/2291830 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f98b405a140 con 0x7f98cc06c4a0 2024-09-12T02:28:49.815 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:49.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ac06be30 msgr2=0x7f98ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ac06be30 0x7f98ac06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98bc004840 tx=0x7f98bc009040 comp rx=0 tx=0).stop 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98cc06c4a0 msgr2=0x7f98cc150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98cc06c4a0 0x7f98cc150ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f98b4011510 tx=0x7f98b40119d0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 shutdown_connections 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98ac06be30 0x7f98ac06e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98cc1f76a0 0x7f98cc1f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98cc06c4a0 0x7f98cc150ae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 --2- 172.21.15.181:0/2291830 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98cc06c0c0 0x7f98cc1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.816+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 >> 172.21.15.181:0/2291830 conn(0x7f98cc09d820 msgr2=0x7f98cc0b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.817+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 shutdown_connections 2024-09-12T02:28:49.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.817+0000 7f98d27d8640 1 -- 172.21.15.181:0/2291830 wait complete. 2024-09-12T02:28:49.828 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:28:49.828 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:28:49.848 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:28:49.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.948+0000 7f34fcea6640 1 Processor -- start 2024-09-12T02:28:49.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.948+0000 7f34fcea6640 1 -- start start 2024-09-12T02:28:49.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34fcea6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f34f8156990 0x7f34f80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34fcea6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 0x7f34f80b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34fcea6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f80ce160 con 0x7f34f80b22c0 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34fcea6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f34f8156d70 con 0x7f34f8156990 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34fcea6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f34f80cdb10 con 0x7f34f80cd6b0 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34f6d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f34f80b22c0 0x7f34f815fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44242/0 (socket says 172.21.15.181:44242) 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34f6d9d640 1 -- 172.21.15.181:0/928347166 learned_addr learned my addr 172.21.15.181:0/928347166 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34f5d9b640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 0x7f34f80b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187665986 0 0) 0x7f34f80ce160 con 0x7f34f80b22c0 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e0003520 con 0x7f34f80b22c0 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.949+0000 7f34f659c640 1 --2- 172.21.15.181:0/928347166 >> v2:172.21.15.204:3300/0 conn(0x7f34f8156990 0x7f34f80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1974950364 0 0) 0x7f34e0003520 con 0x7f34f80b22c0 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 msgr2=0x7f34f80b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 0x7f34f80b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 >> v2:172.21.15.204:3300/0 conn(0x7f34f8156990 msgr2=0x7f34f80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 --2- 172.21.15.181:0/928347166 >> v2:172.21.15.204:3300/0 conn(0x7f34f8156990 0x7f34f80cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f80731f0 con 0x7f34f80b22c0 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f34f0001670 con 0x7f34f80b22c0 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 >> v1:172.21.15.181:6789/0 conn(0x7f34f80b22c0 legacy=0x7f34f815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34e00039b0 0x7f34e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 0x7f34e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f34e000b9c0 con 0x7f34e0004800 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f34e000bb40 con 0x7f34e00039b0 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f34e000bcf0 con 0x7f34f80cd6b0 2024-09-12T02:28:49.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f5d9b640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f659c640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34e00039b0 0x7f34e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f6d9d640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 0x7f34e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f5d9b640 1 -- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 msgr2=0x7f34e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f5d9b640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f80cd6b0 0x7f34e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f5d9b640 1 -- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34e00039b0 msgr2=0x7f34e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f5d9b640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34e00039b0 0x7f34e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.950+0000 7f34f5d9b640 1 -- 172.21.15.181:0/928347166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e0003520 con 0x7f34e0004800 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.951+0000 7f34f5d9b640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34e0004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009ac0 tx=0x7f34e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfc336f6f394c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.951+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec036070 con 0x7f34e0004800 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.951+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec031400 con 0x7f34e0004800 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.951+0000 7f34f559a640 1 -- 172.21.15.181:0/928347166 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec009690 con 0x7f34e0004800 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.952+0000 7f34fcea6640 1 -- 172.21.15.181:0/928347166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 msgr2=0x7f34e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.952+0000 7f34fcea6640 1 --2- 172.21.15.181:0/928347166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34e0004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009ac0 tx=0x7f34e0005830 comp rx=0 tx=0).stop 2024-09-12T02:28:49.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.952+0000 7f34f6d9d640 1 -- 172.21.15.181:0/928347166 reap_dead start 2024-09-12T02:28:49.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.952+0000 7f34fcea6640 1 -- 172.21.15.181:0/928347166 shutdown_connections 2024-09-12T02:28:49.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.952+0000 7f34fcea6640 1 -- 172.21.15.181:0/928347166 >> 172.21.15.181:0/928347166 conn(0x7f34f806bc10 msgr2=0x7f34f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:49.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.952+0000 7f34fcea6640 1 -- 172.21.15.181:0/928347166 shutdown_connections 2024-09-12T02:28:49.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.952+0000 7f34fcea6640 1 -- 172.21.15.181:0/928347166 wait complete. 2024-09-12T02:28:49.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.953+0000 7f34fcea6640 1 Processor -- start 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.953+0000 7f34fcea6640 1 -- start start 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34fcea6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34f8151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34fcea6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f815cd30 0x7f34f815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34fcea6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f8159790 0x7f34f8159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34fcea6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f34f80ce720 con 0x7f34e0004800 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34fcea6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f34f80cea90 con 0x7f34f8159790 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34fcea6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f34f80b26f0 con 0x7f34f815cd30 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34f8151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34f8151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41388/0 (socket says 172.21.15.181:41388) 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 -- 172.21.15.181:0/3546369121 learned_addr learned my addr 172.21.15.181:0/3546369121 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 -- 172.21.15.181:0/3546369121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f815cd30 msgr2=0x7f34f815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f815cd30 0x7f34f815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 -- 172.21.15.181:0/3546369121 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f8159790 msgr2=0x7f34f8159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f8159790 0x7f34f8159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 -- 172.21.15.181:0/3546369121 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f815d7d0 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34f659c640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34f8151960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009f90 tx=0x7f34e800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.954+0000 7f34e6ffd640 1 -- 172.21.15.181:0/3546369121 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e8015430 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.955+0000 7f34e6ffd640 1 -- 172.21.15.181:0/3546369121 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e80155d0 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.955+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f815dab0 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.955+0000 7f34e6ffd640 1 -- 172.21.15.181:0/3546369121 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e80159c0 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.955+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f815e070 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.955+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f80cef20 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.956+0000 7f34e6ffd640 1 -- 172.21.15.181:0/3546369121 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34e8015b60 con 0x7f34e0004800 2024-09-12T02:28:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.956+0000 7f34e6ffd640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f34d806be30 0x7f34d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:49.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.956+0000 7f34e6ffd640 1 -- 172.21.15.181:0/3546369121 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f34e808bfd0 con 0x7f34e0004800 2024-09-12T02:28:49.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.956+0000 7f34f5d9b640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f34d806be30 0x7f34d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:49.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.957+0000 7f34f5d9b640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f34d806be30 0x7f34d806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f34ec033000 tx=0x7f34ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:49.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:49.960+0000 7f34e6ffd640 1 -- 172.21.15.181:0/3546369121 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34e8019030 con 0x7f34e0004800 2024-09-12T02:28:50.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.139+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f34f8152300 con 0x7f34e0004800 2024-09-12T02:28:50.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.140+0000 7f34e6ffd640 1 -- 172.21.15.181:0/3546369121 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f34e8010040 con 0x7f34e0004800 2024-09-12T02:28:50.141 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f34d806be30 msgr2=0x7f34d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f34d806be30 0x7f34d806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f34ec033000 tx=0x7f34ec02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 msgr2=0x7f34f8151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34f8151960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009f90 tx=0x7f34e800f580 comp rx=0 tx=0).stop 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 shutdown_connections 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f34d806be30 0x7f34d806e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34f8159790 0x7f34f8159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34f815cd30 0x7f34f815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 --2- 172.21.15.181:0/3546369121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e0004800 0x7f34f8151960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 >> 172.21.15.181:0/3546369121 conn(0x7f34f806bc10 msgr2=0x7f34f8154990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 shutdown_connections 2024-09-12T02:28:50.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.142+0000 7f34fcea6640 1 -- 172.21.15.181:0/3546369121 wait complete. 2024-09-12T02:28:50.153 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi204.front.sepia.ceph.com... 2024-09-12T02:28:50.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:50.154 DEBUG:teuthology.orchestra.run.smithi204:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-12T02:28:50.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:50.184 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:28:50.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:28:50.185 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:28:50.242 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:28:50.243 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:50.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.340+0000 7f74b102c640 1 Processor -- start 2024-09-12T02:28:50.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.340+0000 7f74b102c640 1 -- start start 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.341+0000 7f74b102c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f74ac15c4a0 0x7f74ac0cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.341+0000 7f74b102c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74ac0d0a30 con 0x7f74ac0b47a0 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.341+0000 7f74b102c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74ac0b76f0 con 0x7f74ac0d2da0 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.341+0000 7f74b102c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f74ac0d0d30 con 0x7f74ac15c4a0 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.341+0000 7f74ab59e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f74ac0b47a0 0x7f74ac166030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44250/0 (socket says 172.21.15.181:44250) 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.341+0000 7f74ab59e640 1 -- 172.21.15.181:0/371279424 learned_addr learned my addr 172.21.15.181:0/371279424 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74aad9d640 1 --2- 172.21.15.181:0/371279424 >> v2:172.21.15.204:3300/0 conn(0x7f74ac15c4a0 0x7f74ac0cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479783590 0 0) 0x7f74ac0d0a30 con 0x7f74ac0b47a0 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7498003520 con 0x7f74ac0b47a0 2024-09-12T02:28:50.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3781427644 0 0) 0x7f7498003520 con 0x7f74ac0b47a0 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 >> v2:172.21.15.204:3300/0 conn(0x7f74ac15c4a0 msgr2=0x7f74ac0cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 --2- 172.21.15.181:0/371279424 >> v2:172.21.15.204:3300/0 conn(0x7f74ac15c4a0 0x7f74ac0cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 >> v1:172.21.15.204:6789/0 conn(0x7f74ac0d2da0 legacy=0x7f74ac0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac073710 con 0x7f74ac0b47a0 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f74a4001670 con 0x7f74ac0b47a0 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 >> v1:172.21.15.181:6789/0 conn(0x7f74ac0b47a0 legacy=0x7f74ac166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980039b0 0x7f7498003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7498004800 0x7f7498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74980051c0 0x7f749800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0d0d30 con 0x7f74980051c0 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f749800c160 con 0x7f74980039b0 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f749800c360 con 0x7f7498004800 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74ab59e640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74980051c0 0x7f749800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74aad9d640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980039b0 0x7f7498003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74aa59c640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7498004800 0x7f7498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74ab59e640 1 -- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7498004800 msgr2=0x7f7498004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74ab59e640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7498004800 0x7f7498004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74ab59e640 1 -- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980039b0 msgr2=0x7f7498003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74ab59e640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980039b0 0x7f7498003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74ab59e640 1 -- 172.21.15.181:0/371279424 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7498003520 con 0x7f74980051c0 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.342+0000 7f74aa59c640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7498004800 0x7f7498004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.343+0000 7f74ab59e640 1 -- 172.21.15.181:0/371279424 reap_dead start 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.343+0000 7f74ab59e640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74980051c0 0x7f749800b9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0b4c70 tx=0x7f7498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f76bdf5bb88e192 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.343+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4007d10 con 0x7f74980051c0 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.343+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a4005ad0 con 0x7f74980051c0 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.343+0000 7f74a9d9b640 1 -- 172.21.15.181:0/371279424 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4007070 con 0x7f74980051c0 2024-09-12T02:28:50.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.344+0000 7f74b102c640 1 -- 172.21.15.181:0/371279424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74980051c0 msgr2=0x7f749800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.344+0000 7f74b102c640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74980051c0 0x7f749800b9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0b4c70 tx=0x7f7498005830 comp rx=0 tx=0).stop 2024-09-12T02:28:50.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.344+0000 7f74b102c640 1 -- 172.21.15.181:0/371279424 shutdown_connections 2024-09-12T02:28:50.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.344+0000 7f74b102c640 1 --2- 172.21.15.181:0/371279424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74980051c0 0x7f749800b9c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.344+0000 7f74b102c640 1 -- 172.21.15.181:0/371279424 >> 172.21.15.181:0/371279424 conn(0x7f74ac067950 msgr2=0x7f74ac067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.344+0000 7f74b102c640 1 -- 172.21.15.181:0/371279424 shutdown_connections 2024-09-12T02:28:50.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.344+0000 7f74b102c640 1 -- 172.21.15.181:0/371279424 wait complete. 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.345+0000 7f74b102c640 1 Processor -- start 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.345+0000 7f74b102c640 1 -- start start 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74b102c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980051c0 0x7f74ac0af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74b102c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74ac1459c0 0x7f74ac0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74b102c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74ac0b3c70 0x7f74ac148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74b102c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0cff80 con 0x7f74ac0b3c70 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74b102c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0d28e0 con 0x7f74980051c0 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74b102c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f74ac0d0100 con 0x7f74ac1459c0 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74ac0b3c70 0x7f74ac148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74ac0b3c70 0x7f74ac148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41410/0 (socket says 172.21.15.181:41410) 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 -- 172.21.15.181:0/87945644 learned_addr learned my addr 172.21.15.181:0/87945644 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74aa59c640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74ac1459c0 0x7f74ac0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74aad9d640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980051c0 0x7f74ac0af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 -- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74ac1459c0 msgr2=0x7f74ac0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74ac1459c0 0x7f74ac0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 -- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980051c0 msgr2=0x7f74ac0af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980051c0 0x7f74ac0af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.346+0000 7f74ab59e640 1 -- 172.21.15.181:0/87945644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac146170 con 0x7f74ac0b3c70 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.347+0000 7f74ab59e640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74ac0b3c70 0x7f74ac148550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c2d0 tx=0x7f74ac0738e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.347+0000 7f74a37fe640 1 -- 172.21.15.181:0/87945644 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4041070 con 0x7f74ac0b3c70 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.347+0000 7f74a37fe640 1 -- 172.21.15.181:0/87945644 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a4001640 con 0x7f74ac0b3c70 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.347+0000 7f74a37fe640 1 -- 172.21.15.181:0/87945644 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a40049e0 con 0x7f74ac0b3c70 2024-09-12T02:28:50.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.347+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ac145e40 con 0x7f74ac0b3c70 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.347+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ac1466f0 con 0x7f74ac0b3c70 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.348+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74ac15c880 con 0x7f74ac0b3c70 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.348+0000 7f74a37fe640 1 -- 172.21.15.181:0/87945644 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74a4044070 con 0x7f74ac0b3c70 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.349+0000 7f74a37fe640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f748c06be60 0x7f748c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.349+0000 7f74a37fe640 1 -- 172.21.15.181:0/87945644 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f74a40aa240 con 0x7f74ac0b3c70 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.349+0000 7f74aad9d640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f748c06be60 0x7f748c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.349+0000 7f74aad9d640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f748c06be60 0x7f748c06e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f749c014450 tx=0x7f749c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.353+0000 7f74a37fe640 1 -- 172.21.15.181:0/87945644 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74a4078630 con 0x7f74ac0b3c70 2024-09-12T02:28:50.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.554+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74ac0b6250 con 0x7f74ac0b3c70 2024-09-12T02:28:50.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.554+0000 7f74a37fe640 1 -- 172.21.15.181:0/87945644 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7f74a407c930 con 0x7f74ac0b3c70 2024-09-12T02:28:50.555 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:50.556 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:50.556 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.556+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f748c06be60 msgr2=0x7f748c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.556+0000 7f74b102c640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f748c06be60 0x7f748c06e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f749c014450 tx=0x7f749c00b040 comp rx=0 tx=0).stop 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.556+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74ac0b3c70 msgr2=0x7f74ac148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.556+0000 7f74b102c640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74ac0b3c70 0x7f74ac148550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c2d0 tx=0x7f74ac0738e0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 shutdown_connections 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f748c06be60 0x7f748c06e320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74ac0b3c70 0x7f74ac148550 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74ac1459c0 0x7f74ac0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 --2- 172.21.15.181:0/87945644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74980051c0 0x7f74ac0af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 >> 172.21.15.181:0/87945644 conn(0x7f74ac067950 msgr2=0x7f74ac152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 shutdown_connections 2024-09-12T02:28:50.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.557+0000 7f74b102c640 1 -- 172.21.15.181:0/87945644 wait complete. 2024-09-12T02:28:50.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.666+0000 7fa646f6d640 1 Processor -- start 2024-09-12T02:28:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.666+0000 7fa646f6d640 1 -- start start 2024-09-12T02:28:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.666+0000 7fa646f6d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa64015e4e0 0x7fa6400b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.666+0000 7fa646f6d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa6400d26d0 0x7fa6400b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.666+0000 7fa646f6d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa64006cec0 con 0x7fa64015e8c0 2024-09-12T02:28:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa646f6d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa6400d2d40 con 0x7fa6400d26d0 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa646f6d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa6400d2b20 con 0x7fa64015e4e0 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa64550a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa6400d26d0 0x7fa6400b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa63ffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa64015e8c0 0x7fa6400d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44260/0 (socket says 172.21.15.181:44260) 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa63ffff640 1 -- 172.21.15.181:0/1319076306 learned_addr learned my addr 172.21.15.181:0/1319076306 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa644d09640 1 --2- 172.21.15.181:0/1319076306 >> v2:172.21.15.204:3300/0 conn(0x7fa64015e4e0 0x7fa6400b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa64550a640 1 -- 172.21.15.181:0/1319076306 >> v2:172.21.15.204:3300/0 conn(0x7fa64015e4e0 msgr2=0x7fa6400b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa64550a640 1 --2- 172.21.15.181:0/1319076306 >> v2:172.21.15.204:3300/0 conn(0x7fa64015e4e0 0x7fa6400b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa64550a640 1 -- 172.21.15.181:0/1319076306 >> v1:172.21.15.181:6789/0 conn(0x7fa64015e8c0 legacy=0x7fa6400d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa63f7fe640 1 -- 172.21.15.181:0/1319076306 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731964625 0 0) 0x7fa64006cec0 con 0x7fa64015e8c0 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.667+0000 7fa64550a640 1 -- 172.21.15.181:0/1319076306 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64006d160 con 0x7fa6400d26d0 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa64550a640 1 --2- 172.21.15.181:0/1319076306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa6400b6d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa640075a10 tx=0x7fa63802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84275e7e58f2af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa63f7fe640 1 -- 172.21.15.181:0/1319076306 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638007740 con 0x7fa6400d26d0 2024-09-12T02:28:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa63f7fe640 1 -- 172.21.15.181:0/1319076306 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6380078e0 con 0x7fa6400d26d0 2024-09-12T02:28:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa63f7fe640 1 -- 172.21.15.181:0/1319076306 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638007cb0 con 0x7fa6400d26d0 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 -- 172.21.15.181:0/1319076306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 msgr2=0x7fa6400b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 --2- 172.21.15.181:0/1319076306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa6400b6d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa640075a10 tx=0x7fa63802a680 comp rx=0 tx=0).stop 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 -- 172.21.15.181:0/1319076306 shutdown_connections 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 --2- 172.21.15.181:0/1319076306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa6400b6d10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 --2- 172.21.15.181:0/1319076306 >> v2:172.21.15.204:3300/0 conn(0x7fa64015e4e0 0x7fa6400b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 -- 172.21.15.181:0/1319076306 >> 172.21.15.181:0/1319076306 conn(0x7fa64006f400 msgr2=0x7fa64006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 -- 172.21.15.181:0/1319076306 shutdown_connections 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.668+0000 7fa646f6d640 1 -- 172.21.15.181:0/1319076306 wait complete. 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 Processor -- start 2024-09-12T02:28:50.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 -- start start 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa64015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa64015e4e0 0x7fa640153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa64015e8c0 0x7fa6400b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa64006d720 con 0x7fa6400d26d0 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa6400b7250 con 0x7fa64015e4e0 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.670+0000 7fa646f6d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa64006dc40 con 0x7fa64015e8c0 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa64015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa64015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41424/0 (socket says 172.21.15.181:41424) 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 -- 172.21.15.181:0/3615833330 learned_addr learned my addr 172.21.15.181:0/3615833330 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa64550a640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa64015e8c0 0x7fa6400b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa63ffff640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa64015e4e0 0x7fa640153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 -- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa64015e8c0 msgr2=0x7fa6400b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa64015e8c0 0x7fa6400b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 -- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa64015e4e0 msgr2=0x7fa640153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa64015e4e0 0x7fa640153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 -- 172.21.15.181:0/3615833330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6400b02c0 con 0x7fa6400d26d0 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa63ffff640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa64015e4e0 0x7fa640153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa644d09640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa64015a900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa63400e9b0 tx=0x7fa63400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa63d7fa640 1 -- 172.21.15.181:0/3615833330 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634017070 con 0x7fa6400d26d0 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa63d7fa640 1 -- 172.21.15.181:0/3615833330 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63400c9a0 con 0x7fa6400d26d0 2024-09-12T02:28:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6401582a0 con 0x7fa6400d26d0 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa63d7fa640 1 -- 172.21.15.181:0/3615833330 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63400cd90 con 0x7fa6400d26d0 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.671+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6400b0530 con 0x7fa6400d26d0 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.672+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6400d1fc0 con 0x7fa6400d26d0 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.673+0000 7fa63d7fa640 1 -- 172.21.15.181:0/3615833330 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa63401a070 con 0x7fa6400d26d0 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.673+0000 7fa63d7fa640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa62406be60 0x7fa62406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.673+0000 7fa63ffff640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa62406be60 0x7fa62406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.673+0000 7fa63d7fa640 1 -- 172.21.15.181:0/3615833330 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa63408b1e0 con 0x7fa6400d26d0 2024-09-12T02:28:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.673+0000 7fa63ffff640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa62406be60 0x7fa62406e320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6400d0500 tx=0x7fa62c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.677+0000 7fa63d7fa640 1 -- 172.21.15.181:0/3615833330 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa634059b90 con 0x7fa6400d26d0 2024-09-12T02:28:50.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.874+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6400693a0 con 0x7fa6400d26d0 2024-09-12T02:28:50.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.875+0000 7fa63d7fa640 1 -- 172.21.15.181:0/3615833330 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7fa634059490 con 0x7fa6400d26d0 2024-09-12T02:28:50.876 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:50.876 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:50.876 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:50.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa62406be60 msgr2=0x7fa62406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa62406be60 0x7fa62406e320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6400d0500 tx=0x7fa62c009040 comp rx=0 tx=0).stop 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 msgr2=0x7fa64015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa64015a900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa63400e9b0 tx=0x7fa63400ee70 comp rx=0 tx=0).stop 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 shutdown_connections 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa62406be60 0x7fa62406e320 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa64015e4e0 0x7fa640153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa64015e8c0 0x7fa6400b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 --2- 172.21.15.181:0/3615833330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6400d26d0 0x7fa64015a900 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 >> 172.21.15.181:0/3615833330 conn(0x7fa64006f400 msgr2=0x7fa64015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 shutdown_connections 2024-09-12T02:28:50.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.877+0000 7fa646f6d640 1 -- 172.21.15.181:0/3615833330 wait complete. 2024-09-12T02:28:50.888 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:50.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.987+0000 7f68ff1c4640 1 Processor -- start 2024-09-12T02:28:50.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.987+0000 7f68ff1c4640 1 -- start start 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.987+0000 7f68ff1c4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f68f80cdb90 0x7f68f80cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.987+0000 7f68ff1c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cfc80 0x7f68f815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.987+0000 7f68ff1c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f8072740 con 0x7f68f815c380 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.987+0000 7f68ff1c4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f68f80cf1a0 con 0x7f68f80cdb90 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.987+0000 7f68ff1c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f68f80cf480 con 0x7f68f80cfc80 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fd761640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cfc80 0x7f68f815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fcf60640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f68f80cdb90 0x7f68f80cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fd761640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cfc80 0x7f68f815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:37472/0 (socket says 172.21.15.181:37472) 2024-09-12T02:28:50.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fd761640 1 -- 172.21.15.181:0/3413476626 learned_addr learned my addr 172.21.15.181:0/3413476626 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:50.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fd761640 1 -- 172.21.15.181:0/3413476626 >> v2:172.21.15.204:3300/0 conn(0x7f68f80cdb90 msgr2=0x7f68f80cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:50.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fd761640 1 --2- 172.21.15.181:0/3413476626 >> v2:172.21.15.204:3300/0 conn(0x7f68f80cdb90 0x7f68f80cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fd761640 1 -- 172.21.15.181:0/3413476626 >> v1:172.21.15.204:6789/0 conn(0x7f68f815c380 legacy=0x7f68f8071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.988+0000 7f68fd761640 1 -- 172.21.15.181:0/3413476626 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f80cf760 con 0x7f68f80cfc80 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.989+0000 7f68fd761640 1 --2- 172.21.15.181:0/3413476626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cfc80 0x7f68f815c8c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f68e000bb10 tx=0x7f68e002c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9a5faaad97acb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.989+0000 7f68f77fe640 1 -- 172.21.15.181:0/3413476626 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0036020 con 0x7f68f80cfc80 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.989+0000 7f68f77fe640 1 -- 172.21.15.181:0/3413476626 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e0032820 con 0x7f68f80cfc80 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.989+0000 7f68f77fe640 1 -- 172.21.15.181:0/3413476626 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0032bf0 con 0x7f68f80cfc80 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 -- 172.21.15.181:0/3413476626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cfc80 msgr2=0x7f68f815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/3413476626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cfc80 0x7f68f815c8c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f68e000bb10 tx=0x7f68e002c920 comp rx=0 tx=0).stop 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 -- 172.21.15.181:0/3413476626 shutdown_connections 2024-09-12T02:28:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/3413476626 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cfc80 0x7f68f815c8c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/3413476626 >> v2:172.21.15.204:3300/0 conn(0x7f68f80cdb90 0x7f68f80cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 -- 172.21.15.181:0/3413476626 >> 172.21.15.181:0/3413476626 conn(0x7f68f806d110 msgr2=0x7f68f806d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 -- 172.21.15.181:0/3413476626 shutdown_connections 2024-09-12T02:28:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.990+0000 7f68ff1c4640 1 -- 172.21.15.181:0/3413476626 wait complete. 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.991+0000 7f68ff1c4640 1 Processor -- start 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.991+0000 7f68ff1c4640 1 -- start start 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68ff1c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cdb90 0x7f68f8155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68ff1c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68f80cfc80 0x7f68f8155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68ff1c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68f815c380 0x7f68f806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68ff1c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8072a20 con 0x7f68f815c380 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68ff1c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8159050 con 0x7f68f80cfc80 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68ff1c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f68f8072ba0 con 0x7f68f80cdb90 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68f815c380 0x7f68f806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68f815c380 0x7f68f806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41434/0 (socket says 172.21.15.181:41434) 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 -- 172.21.15.181:0/2610202874 learned_addr learned my addr 172.21.15.181:0/2610202874 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68f7fff640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68f80cfc80 0x7f68f8155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fcf60640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cdb90 0x7f68f8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 -- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cdb90 msgr2=0x7f68f8155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cdb90 0x7f68f8155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 -- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68f80cfc80 msgr2=0x7f68f8155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68f80cfc80 0x7f68f8155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 -- 172.21.15.181:0/2610202874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f80cd1f0 con 0x7f68f815c380 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.992+0000 7f68fd761640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68f815c380 0x7f68f806bc10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f68e000b2c0 tx=0x7f68e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.993+0000 7f68f57fa640 1 -- 172.21.15.181:0/2610202874 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0036040 con 0x7f68f815c380 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.993+0000 7f68f57fa640 1 -- 172.21.15.181:0/2610202874 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e003cd70 con 0x7f68f815c380 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.993+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f8155760 con 0x7f68f815c380 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.993+0000 7f68f57fa640 1 -- 172.21.15.181:0/2610202874 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0046630 con 0x7f68f815c380 2024-09-12T02:28:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.993+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f80cc430 con 0x7f68f815c380 2024-09-12T02:28:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.994+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f80d0130 con 0x7f68f815c380 2024-09-12T02:28:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.994+0000 7f68f57fa640 1 -- 172.21.15.181:0/2610202874 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68e0039020 con 0x7f68f815c380 2024-09-12T02:28:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.995+0000 7f68f57fa640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68d806be30 0x7f68d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.995+0000 7f68fcf60640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68d806be30 0x7f68d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.995+0000 7f68f57fa640 1 -- 172.21.15.181:0/2610202874 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f68e00ae200 con 0x7f68f815c380 2024-09-12T02:28:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.995+0000 7f68fcf60640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68d806be30 0x7f68d806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009aa0 tx=0x7f68f0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:50.999+0000 7f68f57fa640 1 -- 172.21.15.181:0/2610202874 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68e0041070 con 0x7f68f815c380 2024-09-12T02:28:51.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.166+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68f8068480 con 0x7f68f815c380 2024-09-12T02:28:51.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.168+0000 7f68f57fa640 1 -- 172.21.15.181:0/2610202874 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16737 (secure 0 0 0) 0x7f68e002f070 con 0x7f68f815c380 2024-09-12T02:28:51.168 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:51.169 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:23.452762+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68d806be30 msgr2=0x7f68d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68d806be30 0x7f68d806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009aa0 tx=0x7f68f0009190 comp rx=0 tx=0).stop 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68f815c380 msgr2=0x7f68f806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68f815c380 0x7f68f806bc10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f68e000b2c0 tx=0x7f68e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 shutdown_connections 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68d806be30 0x7f68d806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68f80cfc80 0x7f68f8155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68f815c380 0x7f68f806bc10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 --2- 172.21.15.181:0/2610202874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68f80cdb90 0x7f68f8155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 >> 172.21.15.181:0/2610202874 conn(0x7f68f806d110 msgr2=0x7f68f80cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 shutdown_connections 2024-09-12T02:28:51.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.170+0000 7f68ff1c4640 1 -- 172.21.15.181:0/2610202874 wait complete. 2024-09-12T02:28:51.181 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:28:51.182 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:51.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.280+0000 7f58cd4c9640 1 Processor -- start 2024-09-12T02:28:51.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.280+0000 7f58cd4c9640 1 -- start start 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58cd4c9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f58c815e640 0x7f58c80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58cd4c9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c815ea20 con 0x7f58c80d3660 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58cd4c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c80b1c50 con 0x7f58c80cf0e0 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58cd4c9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f58c80b2860 con 0x7f58c815e640 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58c6ffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f58c815e640 0x7f58c80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58c77fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f58c80d3660 0x7f58c80b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44264/0 (socket says 172.21.15.181:44264) 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58c77fe640 1 -- 172.21.15.181:0/2565367643 learned_addr learned my addr 172.21.15.181:0/2565367643 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58c6ffd640 1 -- 172.21.15.181:0/2565367643 >> v1:172.21.15.204:6789/0 conn(0x7f58c80cf0e0 legacy=0x7f58c80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58c6ffd640 1 -- 172.21.15.181:0/2565367643 >> v1:172.21.15.181:6789/0 conn(0x7f58c80d3660 legacy=0x7f58c80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58c67fc640 1 -- 172.21.15.181:0/2565367643 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640399961 0 0) 0x7f58c815ea20 con 0x7f58c80d3660 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.281+0000 7f58c6ffd640 1 -- 172.21.15.181:0/2565367643 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c80b1f30 con 0x7f58c815e640 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58c6ffd640 1 --2- 172.21.15.181:0/2565367643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c80ceba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097a0 tx=0x7f58b802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec46f1ee1a527d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58c67fc640 1 -- 172.21.15.181:0/2565367643 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8037070 con 0x7f58c815e640 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58c67fc640 1 -- 172.21.15.181:0/2565367643 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b802ae50 con 0x7f58c815e640 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58c67fc640 1 -- 172.21.15.181:0/2565367643 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8032660 con 0x7f58c815e640 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58cd4c9640 1 -- 172.21.15.181:0/2565367643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 msgr2=0x7f58c80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/2565367643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c80ceba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097a0 tx=0x7f58b802a140 comp rx=0 tx=0).stop 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58cd4c9640 1 -- 172.21.15.181:0/2565367643 shutdown_connections 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/2565367643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c80ceba0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.282+0000 7f58cd4c9640 1 -- 172.21.15.181:0/2565367643 >> 172.21.15.181:0/2565367643 conn(0x7f58c809d820 msgr2=0x7f58c80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.283+0000 7f58cd4c9640 1 -- 172.21.15.181:0/2565367643 shutdown_connections 2024-09-12T02:28:51.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.283+0000 7f58cd4c9640 1 -- 172.21.15.181:0/2565367643 wait complete. 2024-09-12T02:28:51.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 Processor -- start 2024-09-12T02:28:51.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 -- start start 2024-09-12T02:28:51.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58c80cf0e0 0x7f58c81549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58c80d3660 0x7f58c8159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c8159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58c80cfe40 con 0x7f58c815e640 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f58c80b24f0 con 0x7f58c80cf0e0 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.284+0000 7f58cd4c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f58c80b73a0 con 0x7f58c80d3660 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c8159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c8159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41456/0 (socket says 172.21.15.181:41456) 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 -- 172.21.15.181:0/4137164470 learned_addr learned my addr 172.21.15.181:0/4137164470 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:51.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c6ffd640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58c80cf0e0 0x7f58c81549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58be7fc640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58c80d3660 0x7f58c8159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 -- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58c80d3660 msgr2=0x7f58c8159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58c80d3660 0x7f58c8159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 -- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58c80cf0e0 msgr2=0x7f58c81549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58c80cf0e0 0x7f58c81549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 -- 172.21.15.181:0/4137164470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c81587c0 con 0x7f58c815e640 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58c77fe640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c8159e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f58c000cb20 tx=0x7f58c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58bffff640 1 -- 172.21.15.181:0/4137164470 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c000aca0 con 0x7f58c815e640 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58bffff640 1 -- 172.21.15.181:0/4137164470 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c0012400 con 0x7f58c815e640 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58bffff640 1 -- 172.21.15.181:0/4137164470 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c000ae60 con 0x7f58c815e640 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c8158aa0 con 0x7f58c815e640 2024-09-12T02:28:51.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.285+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c8154f30 con 0x7f58c815e640 2024-09-12T02:28:51.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.286+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c8158c70 con 0x7f58c815e640 2024-09-12T02:28:51.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.287+0000 7f58bffff640 1 -- 172.21.15.181:0/4137164470 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58c00127f0 con 0x7f58c815e640 2024-09-12T02:28:51.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.287+0000 7f58bffff640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f58a806be30 0x7f58a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.287+0000 7f58bffff640 1 -- 172.21.15.181:0/4137164470 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f58c008b3f0 con 0x7f58c815e640 2024-09-12T02:28:51.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.287+0000 7f58c6ffd640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f58a806be30 0x7f58a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.288+0000 7f58c6ffd640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f58a806be30 0x7f58a806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58b8034000 tx=0x7f58b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.291+0000 7f58bffff640 1 -- 172.21.15.181:0/4137164470 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58c0059750 con 0x7f58c815e640 2024-09-12T02:28:51.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.491+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58c8068eb0 con 0x7f58c815e640 2024-09-12T02:28:51.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.491+0000 7f58bffff640 1 -- 172.21.15.181:0/4137164470 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7f58c005da50 con 0x7f58c815e640 2024-09-12T02:28:51.492 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:51.492 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:51.492 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f58a806be30 msgr2=0x7f58a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f58a806be30 0x7f58a806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58b8034000 tx=0x7f58b802e000 comp rx=0 tx=0).stop 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 msgr2=0x7f58c8159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c8159e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f58c000cb20 tx=0x7f58c000a060 comp rx=0 tx=0).stop 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 shutdown_connections 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f58a806be30 0x7f58a806e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58c815e640 0x7f58c8159e10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58c80d3660 0x7f58c8159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 --2- 172.21.15.181:0/4137164470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58c80cf0e0 0x7f58c81549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 >> 172.21.15.181:0/4137164470 conn(0x7f58c809d820 msgr2=0x7f58c80b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:51.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 shutdown_connections 2024-09-12T02:28:51.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.493+0000 7f58cd4c9640 1 -- 172.21.15.181:0/4137164470 wait complete. 2024-09-12T02:28:51.506 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:28:51.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.603+0000 7f08ec096640 1 Processor -- start 2024-09-12T02:28:51.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.603+0000 7f08ec096640 1 -- start start 2024-09-12T02:28:51.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.604+0000 7f08ec096640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f08e415eab0 0x7f08e406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.604+0000 7f08ec096640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 0x7f08e40b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.604+0000 7f08ec096640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e40d17e0 con 0x7f08e40b80c0 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.604+0000 7f08ec096640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f08e40d09d0 con 0x7f08e415eab0 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.604+0000 7f08ec096640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f08e415ee90 con 0x7f08e406dae0 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.604+0000 7f08ea633640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f08e40b80c0 0x7f08e40b8550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44266/0 (socket says 172.21.15.181:44266) 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.604+0000 7f08ea633640 1 -- 172.21.15.181:0/3670065187 learned_addr learned my addr 172.21.15.181:0/3670065187 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3670065187 >> v2:172.21.15.204:3300/0 conn(0x7f08e415eab0 0x7f08e406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9631640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 0x7f08e40b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569531372 0 0) 0x7f08e40d17e0 con 0x7f08e40b80c0 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08cc003520 con 0x7f08e40b80c0 2024-09-12T02:28:51.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 803257853 0 0) 0x7f08cc003520 con 0x7f08e40b80c0 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 msgr2=0x7f08e40b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 0x7f08e40b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 >> v2:172.21.15.204:3300/0 conn(0x7f08e415eab0 msgr2=0x7f08e406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 --2- 172.21.15.181:0/3670065187 >> v2:172.21.15.204:3300/0 conn(0x7f08e415eab0 0x7f08e406d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e40cfc10 con 0x7f08e40b80c0 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3670065187 >> v2:172.21.15.204:3300/0 conn(0x7f08e415eab0 0x7f08e406d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f08d40019f0 con 0x7f08e40b80c0 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 >> v1:172.21.15.181:6789/0 conn(0x7f08e40b80c0 legacy=0x7f08e40b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc0039b0 0x7f08cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 0x7f08cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08cc004d40 0x7f08cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08e40d09d0 con 0x7f08cc0039b0 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f08e415ee90 con 0x7f08cc004d40 2024-09-12T02:28:51.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f08cc00b9c0 con 0x7f08e406dae0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc0039b0 0x7f08cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08ea633640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08cc004d40 0x7f08cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9631640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 0x7f08cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 -- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 msgr2=0x7f08cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08e406dae0 0x7f08cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 -- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08cc004d40 msgr2=0x7f08cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08cc004d40 0x7f08cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08e9e32640 1 -- 172.21.15.181:0/3670065187 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc003520 con 0x7f08cc0039b0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.605+0000 7f08ea633640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08cc004d40 0x7f08cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.606+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc0039b0 0x7f08cc003dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009c90 tx=0x7f08cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bc988918963d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.606+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc036070 con 0x7f08cc0039b0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.606+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc031400 con 0x7f08cc0039b0 2024-09-12T02:28:51.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.606+0000 7f08e8e30640 1 -- 172.21.15.181:0/3670065187 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc009860 con 0x7f08cc0039b0 2024-09-12T02:28:51.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.607+0000 7f08ec096640 1 -- 172.21.15.181:0/3670065187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc0039b0 msgr2=0x7f08cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.607+0000 7f08ec096640 1 --2- 172.21.15.181:0/3670065187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08cc0039b0 0x7f08cc003dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009c90 tx=0x7f08cc005830 comp rx=0 tx=0).stop 2024-09-12T02:28:51.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.607+0000 7f08ea633640 1 -- 172.21.15.181:0/3670065187 reap_dead start 2024-09-12T02:28:51.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.607+0000 7f08ec096640 1 -- 172.21.15.181:0/3670065187 shutdown_connections 2024-09-12T02:28:51.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.607+0000 7f08ec096640 1 -- 172.21.15.181:0/3670065187 >> 172.21.15.181:0/3670065187 conn(0x7f08e40d4b30 msgr2=0x7f08e40d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:51.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.607+0000 7f08ec096640 1 -- 172.21.15.181:0/3670065187 shutdown_connections 2024-09-12T02:28:51.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.607+0000 7f08ec096640 1 -- 172.21.15.181:0/3670065187 wait complete. 2024-09-12T02:28:51.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.608+0000 7f08ec096640 1 Processor -- start 2024-09-12T02:28:51.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.608+0000 7f08ec096640 1 -- start start 2024-09-12T02:28:51.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08cc0039b0 0x7f08e41542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08e40ce320 0x7f08e4158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08e415a370 0x7f08e415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08e40d01d0 con 0x7f08e415a370 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f08e406df20 con 0x7f08e40ce320 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f08e40d04b0 con 0x7f08cc0039b0 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08e415a370 0x7f08e415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08e415a370 0x7f08e415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41488/0 (socket says 172.21.15.181:41488) 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 -- 172.21.15.181:0/3725952317 learned_addr learned my addr 172.21.15.181:0/3725952317 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08cc0039b0 0x7f08e41542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08e9631640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08e40ce320 0x7f08e4158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 -- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08cc0039b0 msgr2=0x7f08e41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08cc0039b0 0x7f08e41542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 -- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08e40ce320 msgr2=0x7f08e4158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08e40ce320 0x7f08e4158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 -- 172.21.15.181:0/3725952317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e415a940 con 0x7f08e415a370 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ea633640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08e415a370 0x7f08e415b3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08e40697a0 tx=0x7f08d400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08e27fc640 1 -- 172.21.15.181:0/3725952317 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4007a80 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08e27fc640 1 -- 172.21.15.181:0/3725952317 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4018070 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e4158160 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08e27fc640 1 -- 172.21.15.181:0/3725952317 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4013420 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.609+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e4158720 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.610+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e4161a80 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.611+0000 7f08e27fc640 1 -- 172.21.15.181:0/3725952317 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08d40135c0 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.611+0000 7f08e27fc640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f08d006be30 0x7f08d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.611+0000 7f08e27fc640 1 -- 172.21.15.181:0/3725952317 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f08d408b280 con 0x7f08e415a370 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.611+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f08d006be30 0x7f08d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.612+0000 7f08e9e32640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f08d006be30 0x7f08d006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f08dc033000 tx=0x7f08dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.616+0000 7f08e27fc640 1 -- 172.21.15.181:0/3725952317 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08e4161a80 con 0x7f08e415a370 2024-09-12T02:28:51.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.813+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08e40ceb50 con 0x7f08e415a370 2024-09-12T02:28:51.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.814+0000 7f08e27fc640 1 -- 172.21.15.181:0/3725952317 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5229 (secure 0 0 0) 0x7f08d4059c30 con 0x7f08e415a370 2024-09-12T02:28:51.815 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:51.815 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":6,"btime":"2024-09-12T02:28:24:458184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1452895871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1452895871},{"type":"v1","addr":"172.21.15.204:6835","nonce":1452895871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2694512939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2694512939},{"type":"v1","addr":"172.21.15.181:6835","nonce":2694512939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/4062131860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4062131860},{"type":"v1","addr":"172.21.15.204:6833","nonce":4062131860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:28:21.776422+0000","modified":"2024-09-12T02:28:23.784945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/3219847583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3219847583},{"type":"v1","addr":"172.21.15.181:6837","nonce":3219847583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-12T02:28:51.815 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 6 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f08d006be30 msgr2=0x7f08d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f08d006be30 0x7f08d006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f08dc033000 tx=0x7f08dc008030 comp rx=0 tx=0).stop 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08e415a370 msgr2=0x7f08e415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08e415a370 0x7f08e415b3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08e40697a0 tx=0x7f08d400e530 comp rx=0 tx=0).stop 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 shutdown_connections 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f08d006be30 0x7f08d006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08e40ce320 0x7f08e4158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08e415a370 0x7f08e415b3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 --2- 172.21.15.181:0/3725952317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08cc0039b0 0x7f08e41542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 >> 172.21.15.181:0/3725952317 conn(0x7f08e40d4b30 msgr2=0x7f08e4161370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:51.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 shutdown_connections 2024-09-12T02:28:51.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.816+0000 7f08ec096640 1 -- 172.21.15.181:0/3725952317 wait complete. 2024-09-12T02:28:51.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:28:51.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.925+0000 7fcc49eb7640 1 Processor -- start 2024-09-12T02:28:51.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.925+0000 7fcc49eb7640 1 -- start start 2024-09-12T02:28:51.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.926+0000 7fcc49eb7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcc440b2490 0x7fcc440721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.926+0000 7fcc49eb7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc440ce160 con 0x7fcc440cd880 2024-09-12T02:28:51.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.926+0000 7fcc49eb7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc440ce440 con 0x7fcc44156990 2024-09-12T02:28:51.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.926+0000 7fcc49eb7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fcc44156d70 con 0x7fcc440b2490 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.926+0000 7fcc42ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcc440cd880 0x7fcc440b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44278/0 (socket says 172.21.15.181:44278) 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.926+0000 7fcc42ffd640 1 -- 172.21.15.181:0/1373013761 learned_addr learned my addr 172.21.15.181:0/1373013761 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.926+0000 7fcc43fff640 1 --2- 172.21.15.181:0/1373013761 >> v2:172.21.15.204:3300/0 conn(0x7fcc440b2490 0x7fcc440721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.927+0000 7fcc427fc640 1 -- 172.21.15.181:0/1373013761 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837580675 0 0) 0x7fcc440ce160 con 0x7fcc440cd880 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.927+0000 7fcc427fc640 1 -- 172.21.15.181:0/1373013761 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc2c003520 con 0x7fcc440cd880 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.927+0000 7fcc43fff640 1 -- 172.21.15.181:0/1373013761 >> v1:172.21.15.204:6789/0 conn(0x7fcc44156990 legacy=0x7fcc440cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.927+0000 7fcc43fff640 1 -- 172.21.15.181:0/1373013761 >> v1:172.21.15.181:6789/0 conn(0x7fcc440cd880 legacy=0x7fcc440b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.927+0000 7fcc43fff640 1 -- 172.21.15.181:0/1373013761 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc440ce720 con 0x7fcc440b2490 2024-09-12T02:28:51.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc43fff640 1 --2- 172.21.15.181:0/1373013761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 0x7fcc440721e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097a0 tx=0x7fcc3c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1935478d8d05799 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc427fc640 1 -- 172.21.15.181:0/1373013761 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c037070 con 0x7fcc440b2490 2024-09-12T02:28:51.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc427fc640 1 -- 172.21.15.181:0/1373013761 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c032440 con 0x7fcc440b2490 2024-09-12T02:28:51.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc427fc640 1 -- 172.21.15.181:0/1373013761 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c02ae60 con 0x7fcc440b2490 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1373013761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 msgr2=0x7fcc440721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1373013761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 0x7fcc440721e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097a0 tx=0x7fcc3c02a110 comp rx=0 tx=0).stop 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1373013761 shutdown_connections 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1373013761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 0x7fcc440721e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1373013761 >> 172.21.15.181:0/1373013761 conn(0x7fcc4406bc10 msgr2=0x7fcc4406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1373013761 shutdown_connections 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.928+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1373013761 wait complete. 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.929+0000 7fcc49eb7640 1 Processor -- start 2024-09-12T02:28:51.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc49eb7640 1 -- start start 2024-09-12T02:28:51.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc49eb7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 0x7fcc4415f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc49eb7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc440cd880 0x7fcc4415a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc49eb7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44156990 0x7fcc441596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc49eb7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc440cea90 con 0x7fcc44156990 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc49eb7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fcc440cf130 con 0x7fcc440b2490 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc49eb7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcc44072720 con 0x7fcc440cd880 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.930+0000 7fcc43fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44156990 0x7fcc441596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44156990 0x7fcc441596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41498/0 (socket says 172.21.15.181:41498) 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 -- 172.21.15.181:0/1508749278 learned_addr learned my addr 172.21.15.181:0/1508749278 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc437fe640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 0x7fcc4415f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc42ffd640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc440cd880 0x7fcc4415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 -- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc440cd880 msgr2=0x7fcc4415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc440cd880 0x7fcc4415a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 -- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 msgr2=0x7fcc4415f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 0x7fcc4415f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:51.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 -- 172.21.15.181:0/1508749278 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc44158610 con 0x7fcc44156990 2024-09-12T02:28:51.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc43fff640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44156990 0x7fcc441596b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097a0 tx=0x7fcc3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc2bfff640 1 -- 172.21.15.181:0/1508749278 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c037050 con 0x7fcc44156990 2024-09-12T02:28:51.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc2bfff640 1 -- 172.21.15.181:0/1508749278 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c043070 con 0x7fcc44156990 2024-09-12T02:28:51.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc441588f0 con 0x7fcc44156990 2024-09-12T02:28:51.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc2bfff640 1 -- 172.21.15.181:0/1508749278 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c032810 con 0x7fcc44156990 2024-09-12T02:28:51.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.931+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc44158eb0 con 0x7fcc44156990 2024-09-12T02:28:51.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.932+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc440721e0 con 0x7fcc44156990 2024-09-12T02:28:51.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.933+0000 7fcc2bfff640 1 -- 172.21.15.181:0/1508749278 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc3c0329b0 con 0x7fcc44156990 2024-09-12T02:28:51.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.933+0000 7fcc2bfff640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcc3006be30 0x7fcc3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:51.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.933+0000 7fcc2bfff640 1 -- 172.21.15.181:0/1508749278 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcc3c0ab7f0 con 0x7fcc44156990 2024-09-12T02:28:51.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.933+0000 7fcc437fe640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcc3006be30 0x7fcc3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:51.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.934+0000 7fcc437fe640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcc3006be30 0x7fcc3006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcc4415b650 tx=0x7fcc34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:51.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:51.937+0000 7fcc2bfff640 1 -- 172.21.15.181:0/1508749278 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc3c079ad0 con 0x7fcc44156990 2024-09-12T02:28:52.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.101+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc44068480 con 0x7fcc44156990 2024-09-12T02:28:52.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.102+0000 7fcc2bfff640 1 -- 172.21.15.181:0/1508749278 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16737 (secure 0 0 0) 0x7fcc3c07ddd0 con 0x7fcc44156990 2024-09-12T02:28:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:52.103 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:28:23.452762+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:20.418315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:20.746540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:52.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcc3006be30 msgr2=0x7fcc3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcc3006be30 0x7fcc3006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcc4415b650 tx=0x7fcc34009040 comp rx=0 tx=0).stop 2024-09-12T02:28:52.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44156990 msgr2=0x7fcc441596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44156990 0x7fcc441596b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097a0 tx=0x7fcc3c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 shutdown_connections 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcc3006be30 0x7fcc3006e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44156990 0x7fcc441596b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc440cd880 0x7fcc4415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 --2- 172.21.15.181:0/1508749278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc440b2490 0x7fcc4415f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.104+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 >> 172.21.15.181:0/1508749278 conn(0x7fcc4406bc10 msgr2=0x7fcc44155350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.105+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 shutdown_connections 2024-09-12T02:28:52.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.105+0000 7fcc49eb7640 1 -- 172.21.15.181:0/1508749278 wait complete. 2024-09-12T02:28:52.117 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:28:52.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.214+0000 7fc25ea65640 1 Processor -- start 2024-09-12T02:28:52.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.214+0000 7fc25ea65640 1 -- start start 2024-09-12T02:28:52.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.215+0000 7fc25ea65640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc25815e4e0 0x7fc2580b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.215+0000 7fc25ea65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc2580b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.215+0000 7fc25ea65640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2580d1fc0 0x7fc2580d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.215+0000 7fc25ea65640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc2580d2d40 con 0x7fc2580d1fc0 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.215+0000 7fc25ea65640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fc2580b7250 con 0x7fc25815e4e0 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.215+0000 7fc25ea65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc25806cec0 con 0x7fc25815e8c0 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc2580b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc2580b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:37546/0 (socket says 172.21.15.181:37546) 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 -- 172.21.15.181:0/3359808318 learned_addr learned my addr 172.21.15.181:0/3359808318 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc25d002640 1 --2- 172.21.15.181:0/3359808318 >> v2:172.21.15.181:3300/0 conn(0x7fc2580d1fc0 0x7fc2580d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc25c801640 1 --2- 172.21.15.181:0/3359808318 >> v2:172.21.15.204:3300/0 conn(0x7fc25815e4e0 0x7fc2580b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 -- 172.21.15.181:0/3359808318 >> v2:172.21.15.204:3300/0 conn(0x7fc25815e4e0 msgr2=0x7fc2580b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 --2- 172.21.15.181:0/3359808318 >> v2:172.21.15.204:3300/0 conn(0x7fc25815e4e0 0x7fc2580b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 -- 172.21.15.181:0/3359808318 >> v2:172.21.15.181:3300/0 conn(0x7fc2580d1fc0 msgr2=0x7fc2580d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:52.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 --2- 172.21.15.181:0/3359808318 >> v2:172.21.15.181:3300/0 conn(0x7fc2580d1fc0 0x7fc2580d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.216+0000 7fc257fff640 1 -- 172.21.15.181:0/3359808318 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25806d160 con 0x7fc25815e8c0 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.217+0000 7fc257fff640 1 --2- 172.21.15.181:0/3359808318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc2580b6d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc258075a10 tx=0x7fc24c02a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6e27a68021e06f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.217+0000 7fc2577fe640 1 -- 172.21.15.181:0/3359808318 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c036070 con 0x7fc25815e8c0 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.217+0000 7fc2577fe640 1 -- 172.21.15.181:0/3359808318 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24c031600 con 0x7fc25815e8c0 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.217+0000 7fc2577fe640 1 -- 172.21.15.181:0/3359808318 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0319d0 con 0x7fc25815e8c0 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.217+0000 7fc25ea65640 1 -- 172.21.15.181:0/3359808318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 msgr2=0x7fc2580b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.217+0000 7fc25ea65640 1 --2- 172.21.15.181:0/3359808318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc2580b6d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc258075a10 tx=0x7fc24c02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.217+0000 7fc25ea65640 1 -- 172.21.15.181:0/3359808318 shutdown_connections 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.218+0000 7fc25ea65640 1 --2- 172.21.15.181:0/3359808318 >> v2:172.21.15.181:3300/0 conn(0x7fc2580d1fc0 0x7fc2580d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.218+0000 7fc25ea65640 1 --2- 172.21.15.181:0/3359808318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc2580b6d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.218+0000 7fc25ea65640 1 --2- 172.21.15.181:0/3359808318 >> v2:172.21.15.204:3300/0 conn(0x7fc25815e4e0 0x7fc2580b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.218+0000 7fc25ea65640 1 -- 172.21.15.181:0/3359808318 >> 172.21.15.181:0/3359808318 conn(0x7fc25806f400 msgr2=0x7fc25806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:52.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.218+0000 7fc25ea65640 1 -- 172.21.15.181:0/3359808318 shutdown_connections 2024-09-12T02:28:52.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.218+0000 7fc25ea65640 1 -- 172.21.15.181:0/3359808318 wait complete. 2024-09-12T02:28:52.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.219+0000 7fc25ea65640 1 Processor -- start 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.219+0000 7fc25ea65640 1 -- start start 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25ea65640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2580d1fc0 0x7fc258158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25ea65640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25815e4e0 0x7fc25814d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25ea65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc25814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25ea65640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580d29b0 con 0x7fc2580d1fc0 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25ea65640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc25806d720 con 0x7fc25815e4e0 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25ea65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc258070660 con 0x7fc25815e8c0 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2580d1fc0 0x7fc258158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2580d1fc0 0x7fc258158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41510/0 (socket says 172.21.15.181:41510) 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 -- 172.21.15.181:0/792693541 learned_addr learned my addr 172.21.15.181:0/792693541 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25d002640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc25814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc257fff640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25815e4e0 0x7fc25814d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 -- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 msgr2=0x7fc25814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc25814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 -- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25815e4e0 msgr2=0x7fc25814d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25815e4e0 0x7fc25814d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 -- 172.21.15.181:0/792693541 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc258140be0 con 0x7fc2580d1fc0 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc257fff640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25815e4e0 0x7fc25814d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25c801640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2580d1fc0 0x7fc258158e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc24800e9b0 tx=0x7fc24800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc2557fa640 1 -- 172.21.15.181:0/792693541 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248017070 con 0x7fc2580d1fc0 2024-09-12T02:28:52.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc2557fa640 1 -- 172.21.15.181:0/792693541 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24800c9a0 con 0x7fc2580d1fc0 2024-09-12T02:28:52.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc2557fa640 1 -- 172.21.15.181:0/792693541 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800cd90 con 0x7fc2580d1fc0 2024-09-12T02:28:52.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.220+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25815a810 con 0x7fc2580d1fc0 2024-09-12T02:28:52.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.221+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc258159a50 con 0x7fc2580d1fc0 2024-09-12T02:28:52.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.222+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2580d2470 con 0x7fc2580d1fc0 2024-09-12T02:28:52.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.222+0000 7fc2557fa640 1 -- 172.21.15.181:0/792693541 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc24801a070 con 0x7fc2580d1fc0 2024-09-12T02:28:52.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.222+0000 7fc2557fa640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc24406be60 0x7fc24406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.223+0000 7fc2557fa640 1 -- 172.21.15.181:0/792693541 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc24808add0 con 0x7fc2580d1fc0 2024-09-12T02:28:52.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.223+0000 7fc257fff640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc24406be60 0x7fc24406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.223+0000 7fc257fff640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc24406be60 0x7fc24406e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc24c033000 tx=0x7fc24c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.227+0000 7fc2557fa640 1 -- 172.21.15.181:0/792693541 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc248059780 con 0x7fc2580d1fc0 2024-09-12T02:28:52.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.424+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc25815bbb0 con 0x7fc2580d1fc0 2024-09-12T02:28:52.426 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:28:52.425+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:28:52.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.426+0000 7fc2557fa640 1 -- 172.21.15.181:0/792693541 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fc248059080 con 0x7fc2580d1fc0 2024-09-12T02:28:52.427 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc24406be60 msgr2=0x7fc24406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc24406be60 0x7fc24406e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc24c033000 tx=0x7fc24c009000 comp rx=0 tx=0).stop 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2580d1fc0 msgr2=0x7fc258158e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2580d1fc0 0x7fc258158e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc24800e9b0 tx=0x7fc24800ee70 comp rx=0 tx=0).stop 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 shutdown_connections 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc24406be60 0x7fc24406e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc25815e4e0 0x7fc25814d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc25815e8c0 0x7fc25814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 --2- 172.21.15.181:0/792693541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2580d1fc0 0x7fc258158e00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 >> 172.21.15.181:0/792693541 conn(0x7fc25806f400 msgr2=0x7fc258070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:52.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 shutdown_connections 2024-09-12T02:28:52.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.430+0000 7fc25ea65640 1 -- 172.21.15.181:0/792693541 wait complete. 2024-09-12T02:28:52.432 INFO:tasks.ceph.mds.c.smithi181.stderr: -1917> 2024-09-12T02:28:28.240+0000 7f80f6f88640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:28:52.442 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:28:52.458 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:28:52.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.545+0000 7f96d871f640 1 Processor -- start 2024-09-12T02:28:52.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.545+0000 7f96d871f640 1 -- start start 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.546+0000 7f96d871f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d01620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.546+0000 7f96d871f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f96d00d0ab0 0x7f96d006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.546+0000 7f96d871f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d0162610 con 0x7f96d006c150 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.546+0000 7f96d871f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f96d00741e0 con 0x7f96d00d0ab0 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.546+0000 7f96d871f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f96d0073660 con 0x7f96d0141690 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d6cbc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f96d006c150 0x7f96d0143fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44304/0 (socket says 172.21.15.181:44304) 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d6cbc640 1 -- 172.21.15.181:0/1737910076 learned_addr learned my addr 172.21.15.181:0/1737910076 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d5cba640 1 --2- 172.21.15.181:0/1737910076 >> v2:172.21.15.204:3300/0 conn(0x7f96d00d0ab0 0x7f96d006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d64bb640 1 --2- 172.21.15.181:0/1737910076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d01620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d54b9640 1 -- 172.21.15.181:0/1737910076 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981173289 0 0) 0x7f96d0162610 con 0x7f96d006c150 2024-09-12T02:28:52.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d54b9640 1 -- 172.21.15.181:0/1737910076 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96bc003520 con 0x7f96d006c150 2024-09-12T02:28:52.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d64bb640 1 -- 172.21.15.181:0/1737910076 >> v2:172.21.15.204:3300/0 conn(0x7f96d00d0ab0 msgr2=0x7f96d006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:52.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d64bb640 1 --2- 172.21.15.181:0/1737910076 >> v2:172.21.15.204:3300/0 conn(0x7f96d00d0ab0 0x7f96d006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d64bb640 1 -- 172.21.15.181:0/1737910076 >> v1:172.21.15.181:6789/0 conn(0x7f96d006c150 legacy=0x7f96d0143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d64bb640 1 -- 172.21.15.181:0/1737910076 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d0073940 con 0x7f96d0141690 2024-09-12T02:28:52.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.547+0000 7f96d5cba640 1 --2- 172.21.15.181:0/1737910076 >> v2:172.21.15.204:3300/0 conn(0x7f96d00d0ab0 0x7f96d006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:52.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d64bb640 1 --2- 172.21.15.181:0/1737910076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d01620d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0097a0 tx=0x7f96cc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93ccdb760d873542 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d54b9640 1 -- 172.21.15.181:0/1737910076 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc037070 con 0x7f96d0141690 2024-09-12T02:28:52.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d54b9640 1 -- 172.21.15.181:0/1737910076 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96cc032440 con 0x7f96d0141690 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d54b9640 1 -- 172.21.15.181:0/1737910076 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc032810 con 0x7f96d0141690 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d871f640 1 -- 172.21.15.181:0/1737910076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 msgr2=0x7f96d01620d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d871f640 1 --2- 172.21.15.181:0/1737910076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d01620d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0097a0 tx=0x7f96cc02a180 comp rx=0 tx=0).stop 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d871f640 1 -- 172.21.15.181:0/1737910076 shutdown_connections 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d871f640 1 --2- 172.21.15.181:0/1737910076 >> v2:172.21.15.204:3300/0 conn(0x7f96d00d0ab0 0x7f96d006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d871f640 1 --2- 172.21.15.181:0/1737910076 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d01620d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.548+0000 7f96d871f640 1 -- 172.21.15.181:0/1737910076 >> 172.21.15.181:0/1737910076 conn(0x7f96d00d12e0 msgr2=0x7f96d00d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.549+0000 7f96d871f640 1 -- 172.21.15.181:0/1737910076 shutdown_connections 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.549+0000 7f96d871f640 1 -- 172.21.15.181:0/1737910076 wait complete. 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 Processor -- start 2024-09-12T02:28:52.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 -- start start 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96d006c150 0x7f96d013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96d00d0ab0 0x7f96d0142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d0143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f96d00d0590 con 0x7f96d00d0ab0 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f96d0073f00 con 0x7f96d006c150 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.550+0000 7f96d871f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f96d0073280 con 0x7f96d0141690 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96d00d0ab0 0x7f96d0142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96d00d0ab0 0x7f96d0142fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41538/0 (socket says 172.21.15.181:41538) 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 -- 172.21.15.181:0/4004390488 learned_addr learned my addr 172.21.15.181:0/4004390488 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:52.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d6cbc640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d0143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d64bb640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96d006c150 0x7f96d013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 -- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 msgr2=0x7f96d0143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d0143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 -- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96d006c150 msgr2=0x7f96d013f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96d006c150 0x7f96d013f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 -- 172.21.15.181:0/4004390488 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d00c8600 con 0x7f96d00d0ab0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d5cba640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96d00d0ab0 0x7f96d0142fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96c000e910 tx=0x7f96c000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96c6ffd640 1 -- 172.21.15.181:0/4004390488 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0017070 con 0x7f96d00d0ab0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96c6ffd640 1 -- 172.21.15.181:0/4004390488 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c000c9a0 con 0x7f96d00d0ab0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d00b4560 con 0x7f96d00d0ab0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96c6ffd640 1 -- 172.21.15.181:0/4004390488 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c000cd50 con 0x7f96d00d0ab0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.551+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d00b5040 con 0x7f96d00d0ab0 2024-09-12T02:28:52.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.552+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d00d0f10 con 0x7f96d00d0ab0 2024-09-12T02:28:52.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.553+0000 7f96c6ffd640 1 -- 172.21.15.181:0/4004390488 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96c001a070 con 0x7f96d00d0ab0 2024-09-12T02:28:52.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.553+0000 7f96c6ffd640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f96b406be30 0x7f96b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.553+0000 7f96d64bb640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f96b406be30 0x7f96b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.553+0000 7f96c6ffd640 1 -- 172.21.15.181:0/4004390488 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f96c008b020 con 0x7f96d00d0ab0 2024-09-12T02:28:52.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.554+0000 7f96d64bb640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f96b406be30 0x7f96b406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96cc034000 tx=0x7f96cc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.558+0000 7f96c6ffd640 1 -- 172.21.15.181:0/4004390488 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96c0059320 con 0x7f96d00d0ab0 2024-09-12T02:28:52.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:52.758+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f96d0162c70 con 0x7f96d00d0ab0 2024-09-12T02:28:53.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.428+0000 7f96c6ffd640 1 -- 172.21.15.181:0/4004390488 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f96c005d620 con 0x7f96d00d0ab0 2024-09-12T02:28:53.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f96b406be30 msgr2=0x7f96b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:53.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f96b406be30 0x7f96b406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96cc034000 tx=0x7f96cc02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:53.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96d00d0ab0 msgr2=0x7f96d0142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:53.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96d00d0ab0 0x7f96d0142fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96c000e910 tx=0x7f96c000edd0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 shutdown_connections 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f96b406be30 0x7f96b406e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96d0141690 0x7f96d0143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96d00d0ab0 0x7f96d0142fc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 --2- 172.21.15.181:0/4004390488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96d006c150 0x7f96d013f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 >> 172.21.15.181:0/4004390488 conn(0x7f96d00d12e0 msgr2=0x7f96d00af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.431+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 shutdown_connections 2024-09-12T02:28:53.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.432+0000 7f96d871f640 1 -- 172.21.15.181:0/4004390488 wait complete. 2024-09-12T02:28:53.446 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:28:53.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.593+0000 7f8502606640 1 Processor -- start 2024-09-12T02:28:53.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.593+0000 7f8502606640 1 -- start start 2024-09-12T02:28:53.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8502606640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84fc073b70 0x7f84fc0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:53.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8502606640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84fc162d10 0x7f84fc0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:53.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8502606640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84fc074000 con 0x7f84fc147f50 2024-09-12T02:28:53.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8502606640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f84fc0742e0 con 0x7f84fc162d10 2024-09-12T02:28:53.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8502606640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f84fc162230 con 0x7f84fc073b70 2024-09-12T02:28:53.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8500ba3640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84fc162d10 0x7f84fc0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8500ba3640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84fc162d10 0x7f84fc0b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41554/0 (socket says 172.21.15.181:41554) 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.594+0000 7f8500ba3640 1 -- 172.21.15.181:0/3032649313 learned_addr learned my addr 172.21.15.181:0/3032649313 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.595+0000 7f84fb7fe640 1 --2- 172.21.15.181:0/3032649313 >> v2:172.21.15.204:3300/0 conn(0x7f84fc073b70 0x7f84fc0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.595+0000 7f8500ba3640 1 -- 172.21.15.181:0/3032649313 >> v2:172.21.15.204:3300/0 conn(0x7f84fc073b70 msgr2=0x7f84fc0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.595+0000 7f8500ba3640 1 --2- 172.21.15.181:0/3032649313 >> v2:172.21.15.204:3300/0 conn(0x7f84fc073b70 0x7f84fc0b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.595+0000 7f8500ba3640 1 -- 172.21.15.181:0/3032649313 >> v1:172.21.15.204:6789/0 conn(0x7f84fc147f50 legacy=0x7f84fc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.595+0000 7f8500ba3640 1 -- 172.21.15.181:0/3032649313 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc162510 con 0x7f84fc162d10 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.595+0000 7f84fb7fe640 1 --2- 172.21.15.181:0/3032649313 >> v2:172.21.15.204:3300/0 conn(0x7f84fc073b70 0x7f84fc0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:53.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.595+0000 7f8500ba3640 1 --2- 172.21.15.181:0/3032649313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc162d10 0x7f84fc0b0790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0b0e80 tx=0x7f84f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ad5f454fe0e430 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f84faffd640 1 -- 172.21.15.181:0/3032649313 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4036070 con 0x7f84fc162d10 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f84faffd640 1 -- 172.21.15.181:0/3032649313 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f4031600 con 0x7f84fc162d10 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f84faffd640 1 -- 172.21.15.181:0/3032649313 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40319d0 con 0x7f84fc162d10 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 -- 172.21.15.181:0/3032649313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc162d10 msgr2=0x7f84fc0b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 --2- 172.21.15.181:0/3032649313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc162d10 0x7f84fc0b0790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0b0e80 tx=0x7f84f402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 -- 172.21.15.181:0/3032649313 shutdown_connections 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 --2- 172.21.15.181:0/3032649313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc162d10 0x7f84fc0b0790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 --2- 172.21.15.181:0/3032649313 >> v2:172.21.15.204:3300/0 conn(0x7f84fc073b70 0x7f84fc0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 -- 172.21.15.181:0/3032649313 >> 172.21.15.181:0/3032649313 conn(0x7f84fc0b2fa0 msgr2=0x7f84fc0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 -- 172.21.15.181:0/3032649313 shutdown_connections 2024-09-12T02:28:53.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.596+0000 7f8502606640 1 -- 172.21.15.181:0/3032649313 wait complete. 2024-09-12T02:28:53.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.597+0000 7f8502606640 1 Processor -- start 2024-09-12T02:28:53.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8502606640 1 -- start start 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8502606640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc147f50 0x7f84fc15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8502606640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc162d10 0x7f84fc0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8502606640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc0b21e0 0x7f84fc131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8502606640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc0ae8a0 con 0x7f84fc0b21e0 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8502606640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc070680 con 0x7f84fc162d10 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8502606640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f84fc0aea20 con 0x7f84fc147f50 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8500ba3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc0b21e0 0x7f84fc131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8500ba3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc0b21e0 0x7f84fc131fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41570/0 (socket says 172.21.15.181:41570) 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.598+0000 7f8500ba3640 1 -- 172.21.15.181:0/1546787890 learned_addr learned my addr 172.21.15.181:0/1546787890 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f84fb7fe640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc162d10 0x7f84fc0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:53.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f84fbfff640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc147f50 0x7f84fc15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8500ba3640 1 -- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc147f50 msgr2=0x7f84fc15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8500ba3640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc147f50 0x7f84fc15ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8500ba3640 1 -- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc162d10 msgr2=0x7f84fc0b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8500ba3640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc162d10 0x7f84fc0b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8500ba3640 1 -- 172.21.15.181:0/1546787890 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc12fc90 con 0x7f84fc0b21e0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8500ba3640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc0b21e0 0x7f84fc131fc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009f40 tx=0x7f84f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f84f8ff9640 1 -- 172.21.15.181:0/1546787890 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4036050 con 0x7f84fc0b21e0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f84f8ff9640 1 -- 172.21.15.181:0/1546787890 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f4042070 con 0x7f84fc0b21e0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f84f8ff9640 1 -- 172.21.15.181:0/1546787890 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4009510 con 0x7f84fc0b21e0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84fc0cde50 con 0x7f84fc0b21e0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.599+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84fc0ce410 con 0x7f84fc0b21e0 2024-09-12T02:28:53.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.600+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84fc073460 con 0x7f84fc0b21e0 2024-09-12T02:28:53.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.600+0000 7f84f8ff9640 1 -- 172.21.15.181:0/1546787890 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84f4007bb0 con 0x7f84fc0b21e0 2024-09-12T02:28:53.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.601+0000 7f84f8ff9640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f84e806be60 0x7f84e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:53.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.601+0000 7f84f8ff9640 1 -- 172.21.15.181:0/1546787890 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f84f40ab7f0 con 0x7f84fc0b21e0 2024-09-12T02:28:53.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.601+0000 7f84fbfff640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f84e806be60 0x7f84e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:53.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.601+0000 7f84fbfff640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f84e806be60 0x7f84e806e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f84ec004ea0 tx=0x7f84ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:53.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.605+0000 7f84f8ff9640 1 -- 172.21.15.181:0/1546787890 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84f404b020 con 0x7f84fc0b21e0 2024-09-12T02:28:53.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:53.772+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84fc12fe60 con 0x7f84fc0b21e0 2024-09-12T02:28:54.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.545+0000 7f84f8ff9640 1 -- 172.21.15.181:0/1546787890 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f84f4039300 con 0x7f84fc0b21e0 2024-09-12T02:28:54.546 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f84e806be60 msgr2=0x7f84e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f84e806be60 0x7f84e806e320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f84ec004ea0 tx=0x7f84ec009040 comp rx=0 tx=0).stop 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc0b21e0 msgr2=0x7f84fc131fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc0b21e0 0x7f84fc131fc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009f40 tx=0x7f84f4004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 shutdown_connections 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f84e806be60 0x7f84e806e320 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc162d10 0x7f84fc0b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84fc0b21e0 0x7f84fc131fc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 --2- 172.21.15.181:0/1546787890 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc147f50 0x7f84fc15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 >> 172.21.15.181:0/1546787890 conn(0x7f84fc0b2fa0 msgr2=0x7f84fc1442d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:54.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 shutdown_connections 2024-09-12T02:28:54.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.548+0000 7f8502606640 1 -- 172.21.15.181:0/1546787890 wait complete. 2024-09-12T02:28:54.562 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:28:54.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.666+0000 7f45a9f11640 1 Processor -- start 2024-09-12T02:28:54.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.666+0000 7f45a9f11640 1 -- start start 2024-09-12T02:28:54.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a9f11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a40b0250 0x7f45a415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:54.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a9f11640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45a4073e10 0x7f45a4162090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:54.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a9f11640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a406fae0 con 0x7f45a40b0630 2024-09-12T02:28:54.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a9f11640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f45a40706f0 con 0x7f45a4073e10 2024-09-12T02:28:54.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a9f11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f45a406fdc0 con 0x7f45a40b0250 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a3fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45a4073e10 0x7f45a4162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a3fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45a4073e10 0x7f45a4162090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41582/0 (socket says 172.21.15.181:41582) 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a3fff640 1 -- 172.21.15.181:0/2653254035 learned_addr learned my addr 172.21.15.181:0/2653254035 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a37fe640 1 --2- 172.21.15.181:0/2653254035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a40b0250 0x7f45a415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a3fff640 1 -- 172.21.15.181:0/2653254035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a40b0250 msgr2=0x7f45a415e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a3fff640 1 --2- 172.21.15.181:0/2653254035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a40b0250 0x7f45a415e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a3fff640 1 -- 172.21.15.181:0/2653254035 >> v1:172.21.15.204:6789/0 conn(0x7f45a40b0630 legacy=0x7f45a4073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.667+0000 7f45a3fff640 1 -- 172.21.15.181:0/2653254035 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40700a0 con 0x7f45a4073e10 2024-09-12T02:28:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.668+0000 7f45a3fff640 1 --2- 172.21.15.181:0/2653254035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4073e10 0x7f45a4162090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f459c009870 tx=0x7f459c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a7307b30260e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.668+0000 7f45a27fc640 1 -- 172.21.15.181:0/2653254035 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c037070 con 0x7f45a4073e10 2024-09-12T02:28:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.668+0000 7f45a27fc640 1 -- 172.21.15.181:0/2653254035 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c032440 con 0x7f45a4073e10 2024-09-12T02:28:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.668+0000 7f45a27fc640 1 -- 172.21.15.181:0/2653254035 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c032810 con 0x7f45a4073e10 2024-09-12T02:28:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 -- 172.21.15.181:0/2653254035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4073e10 msgr2=0x7f45a4162090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 --2- 172.21.15.181:0/2653254035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4073e10 0x7f45a4162090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f459c009870 tx=0x7f459c02a270 comp rx=0 tx=0).stop 2024-09-12T02:28:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 -- 172.21.15.181:0/2653254035 shutdown_connections 2024-09-12T02:28:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 --2- 172.21.15.181:0/2653254035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a4073e10 0x7f45a4162090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 --2- 172.21.15.181:0/2653254035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a40b0250 0x7f45a415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 -- 172.21.15.181:0/2653254035 >> 172.21.15.181:0/2653254035 conn(0x7f45a40b2fa0 msgr2=0x7f45a40b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 -- 172.21.15.181:0/2653254035 shutdown_connections 2024-09-12T02:28:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.669+0000 7f45a9f11640 1 -- 172.21.15.181:0/2653254035 wait complete. 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.670+0000 7f45a9f11640 1 Processor -- start 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.670+0000 7f45a9f11640 1 -- start start 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a9f11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a4073e10 0x7f45a40cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a9f11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a40b0250 0x7f45a4161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a9f11640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45a40b0630 0x7f45a40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a9f11640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40b0bd0 con 0x7f45a40b0250 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a9f11640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40b0a50 con 0x7f45a40b0630 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a9f11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f45a4147930 con 0x7f45a4073e10 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a40b0250 0x7f45a4161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a40b0250 0x7f45a4161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41586/0 (socket says 172.21.15.181:41586) 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 -- 172.21.15.181:0/1486509045 learned_addr learned my addr 172.21.15.181:0/1486509045 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a3fff640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45a40b0630 0x7f45a40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a37fe640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a4073e10 0x7f45a40cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 -- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a4073e10 msgr2=0x7f45a40cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a4073e10 0x7f45a40cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 -- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45a40b0630 msgr2=0x7f45a40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45a40b0630 0x7f45a40b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.671+0000 7f45a2ffd640 1 -- 172.21.15.181:0/1486509045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40ce1c0 con 0x7f45a40b0250 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.672+0000 7f45a2ffd640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a40b0250 0x7f45a4161150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f459800c440 tx=0x7f459800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.672+0000 7f458bfff640 1 -- 172.21.15.181:0/1486509045 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980052d0 con 0x7f45a40b0250 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.672+0000 7f458bfff640 1 -- 172.21.15.181:0/1486509045 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598005470 con 0x7f45a40b0250 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.672+0000 7f458bfff640 1 -- 172.21.15.181:0/1486509045 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598007260 con 0x7f45a40b0250 2024-09-12T02:28:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.672+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a40ce460 con 0x7f45a40b0250 2024-09-12T02:28:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.672+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a40cea20 con 0x7f45a40b0250 2024-09-12T02:28:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.673+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a415e9e0 con 0x7f45a40b0250 2024-09-12T02:28:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.673+0000 7f458bfff640 1 -- 172.21.15.181:0/1486509045 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45980074c0 con 0x7f45a40b0250 2024-09-12T02:28:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.674+0000 7f458bfff640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f459006be30 0x7f459006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.674+0000 7f45a37fe640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f459006be30 0x7f459006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.674+0000 7f458bfff640 1 -- 172.21.15.181:0/1486509045 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f459808a050 con 0x7f45a40b0250 2024-09-12T02:28:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.674+0000 7f45a37fe640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f459006be30 0x7f459006e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4594003b80 tx=0x7f45940098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.678+0000 7f458bfff640 1 -- 172.21.15.181:0/1486509045 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45980585a0 con 0x7f45a40b0250 2024-09-12T02:28:54.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:54.842+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45a4162a30 con 0x7f45a40b0250 2024-09-12T02:28:55.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.546+0000 7f458bfff640 1 -- 172.21.15.181:0/1486509045 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f459805c8a0 con 0x7f45a40b0250 2024-09-12T02:28:55.547 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' removed 2024-09-12T02:28:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.551+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f459006be30 msgr2=0x7f459006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.551+0000 7f45a9f11640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f459006be30 0x7f459006e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4594003b80 tx=0x7f45940098d0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.551+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a40b0250 msgr2=0x7f45a4161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.551+0000 7f45a9f11640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a40b0250 0x7f45a4161150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f459800c440 tx=0x7f459800c900 comp rx=0 tx=0).stop 2024-09-12T02:28:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 shutdown_connections 2024-09-12T02:28:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f459006be30 0x7f459006e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45a40b0630 0x7f45a40b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a40b0250 0x7f45a4161150 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 --2- 172.21.15.181:0/1486509045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45a4073e10 0x7f45a40cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 >> 172.21.15.181:0/1486509045 conn(0x7f45a40b2fa0 msgr2=0x7f45a40af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 shutdown_connections 2024-09-12T02:28:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.552+0000 7f45a9f11640 1 -- 172.21.15.181:0/1486509045 wait complete. 2024-09-12T02:28:55.569 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:28:55.569 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:28:55.569 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:28:55.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:55.570 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:28:55.570 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:28:55.570 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:28:55.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:55.570 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:28:55.570 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:28:55.571 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:28:55.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:55.571 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:28:55.571 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:28:55.571 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:28:55.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:55.580 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:28:55.581 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:28:55.581 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:28:55.582 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:28:55.583 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:28:55.583 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:28:55.584 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:28:55.584 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:28:55.623 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:28:55.623 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:55.624 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:28:55.624 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:55.627 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:28:55.627 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:55.627 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:28:55.628 DEBUG:teuthology.parallel:result is None 2024-09-12T02:28:55.628 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:28:55.703 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:28:55.703 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:28:55.708 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:28:55.708 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:28:55.708 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-09-12T02:28:55.707+0000 7f95d54ed640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-12T02:28:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.736+0000 7f32c8435640 1 Processor -- start 2024-09-12T02:28:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.736+0000 7f32c8435640 1 -- start start 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.737+0000 7f32c8435640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.737+0000 7f32c8435640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f32c00cf0e0 0x7f32c00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.737+0000 7f32c8435640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c015ea20 con 0x7f32c00b2cf0 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.737+0000 7f32c8435640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f32c00b2860 con 0x7f32c00cf0e0 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.737+0000 7f32c8435640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32c00b1c50 con 0x7f32c015e640 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c59d0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f32c00cf0e0 0x7f32c00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c59d0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f32c00cf0e0 0x7f32c00cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41614/0 (socket says 172.21.15.181:41614) 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c59d0640 1 -- 172.21.15.181:0/25447537 learned_addr learned my addr 172.21.15.181:0/25447537 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c61d1640 1 --2- 172.21.15.181:0/25447537 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c59d0640 1 -- 172.21.15.181:0/25447537 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 msgr2=0x7f32c00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c59d0640 1 --2- 172.21.15.181:0/25447537 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c59d0640 1 -- 172.21.15.181:0/25447537 >> v1:172.21.15.204:6789/0 conn(0x7f32c00b2cf0 legacy=0x7f32c00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c59d0640 1 -- 172.21.15.181:0/25447537 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c00b1f30 con 0x7f32c00cf0e0 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.738+0000 7f32c61d1640 1 --2- 172.21.15.181:0/25447537 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c59d0640 1 --2- 172.21.15.181:0/25447537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c00cf520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32c015ebf0 tx=0x7f32b402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8fadbddb73e7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c51cf640 1 -- 172.21.15.181:0/25447537 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4037070 con 0x7f32c00cf0e0 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c51cf640 1 -- 172.21.15.181:0/25447537 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b4032440 con 0x7f32c00cf0e0 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c51cf640 1 -- 172.21.15.181:0/25447537 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4032810 con 0x7f32c00cf0e0 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 -- 172.21.15.181:0/25447537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 msgr2=0x7f32c00cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 --2- 172.21.15.181:0/25447537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c00cf520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32c015ebf0 tx=0x7f32b402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 -- 172.21.15.181:0/25447537 shutdown_connections 2024-09-12T02:28:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 --2- 172.21.15.181:0/25447537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c00cf520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 --2- 172.21.15.181:0/25447537 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 -- 172.21.15.181:0/25447537 >> 172.21.15.181:0/25447537 conn(0x7f32c009d820 msgr2=0x7f32c00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 -- 172.21.15.181:0/25447537 shutdown_connections 2024-09-12T02:28:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.739+0000 7f32c8435640 1 -- 172.21.15.181:0/25447537 wait complete. 2024-09-12T02:28:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 Processor -- start 2024-09-12T02:28:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 -- start start 2024-09-12T02:28:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00b2cf0 0x7f32c01e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c01546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32c00cfe40 con 0x7f32c00cf0e0 2024-09-12T02:28:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f32c00b24f0 con 0x7f32c00b2cf0 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c8435640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32c00b73a0 con 0x7f32c015e640 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c59d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c01546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c59d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c01546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41622/0 (socket says 172.21.15.181:41622) 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c59d0640 1 -- 172.21.15.181:0/3995013430 learned_addr learned my addr 172.21.15.181:0/3995013430 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c61d1640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00b2cf0 0x7f32c01e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.741+0000 7f32c69d2640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c59d0640 1 -- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 msgr2=0x7f32c00d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c59d0640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c59d0640 1 -- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00b2cf0 msgr2=0x7f32c01e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c59d0640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00b2cf0 0x7f32c01e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c59d0640 1 -- 172.21.15.181:0/3995013430 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c01550c0 con 0x7f32c00cf0e0 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c59d0640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c01546e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32b402a200 tx=0x7f32b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32b2ffd640 1 -- 172.21.15.181:0/3995013430 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4041020 con 0x7f32c00cf0e0 2024-09-12T02:28:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32b2ffd640 1 -- 172.21.15.181:0/3995013430 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b40306c0 con 0x7f32c00cf0e0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c01553a0 con 0x7f32c00cf0e0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32b2ffd640 1 -- 172.21.15.181:0/3995013430 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4037040 con 0x7f32c00cf0e0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.742+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c0155960 con 0x7f32c00cf0e0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.743+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c0068eb0 con 0x7f32c00cf0e0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.744+0000 7f32b2ffd640 1 -- 172.21.15.181:0/3995013430 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32b4044020 con 0x7f32c00cf0e0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.744+0000 7f32b2ffd640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f32a406be30 0x7f32a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.744+0000 7f32c61d1640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f32a406be30 0x7f32a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.744+0000 7f32b2ffd640 1 -- 172.21.15.181:0/3995013430 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f32b40ab2d0 con 0x7f32c00cf0e0 2024-09-12T02:28:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.745+0000 7f32c61d1640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f32a406be30 0x7f32a406e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006fd0 tx=0x7f32bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:55.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.749+0000 7f32b2ffd640 1 -- 172.21.15.181:0/3995013430 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32b404b030 con 0x7f32c00cf0e0 2024-09-12T02:28:55.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:55.923+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f32c00ceba0 con 0x7f32c00cf0e0 2024-09-12T02:28:56.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.568+0000 7f32b2ffd640 1 -- 172.21.15.181:0/3995013430 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f32b40798a0 con 0x7f32c00cf0e0 2024-09-12T02:28:56.569 INFO:teuthology.orchestra.run.smithi181.stderr: removed all blocklist entries 2024-09-12T02:28:56.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f32a406be30 msgr2=0x7f32a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f32a406be30 0x7f32a406e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006fd0 tx=0x7f32bc008040 comp rx=0 tx=0).stop 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 msgr2=0x7f32c01546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c01546e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32b402a200 tx=0x7f32b40046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 shutdown_connections 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f32a406be30 0x7f32a406e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32c015e640 0x7f32c00d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00cf0e0 0x7f32c01546e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 --2- 172.21.15.181:0/3995013430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32c00b2cf0 0x7f32c01e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.570+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 >> 172.21.15.181:0/3995013430 conn(0x7f32c009d820 msgr2=0x7f32c00b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.571+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 shutdown_connections 2024-09-12T02:28:56.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.571+0000 7f32c8435640 1 -- 172.21.15.181:0/3995013430 wait complete. 2024-09-12T02:28:56.585 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:28:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.685+0000 7f0531578640 1 Processor -- start 2024-09-12T02:28:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f0531578640 1 -- start start 2024-09-12T02:28:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f0531578640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f052c161c60 0x7f052c0d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f0531578640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f052c06cd90 0x7f052c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f0531578640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c0d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f0531578640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f052c0d2df0 con 0x7f052c06cd90 2024-09-12T02:28:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f0531578640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f052c0d3040 con 0x7f052c161c60 2024-09-12T02:28:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f0531578640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f052c073050 con 0x7f052c0d0e20 2024-09-12T02:28:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.686+0000 7f05227fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f052c06cd90 0x7f052c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f052c06cd90 0x7f052c06d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41632/0 (socket says 172.21.15.181:41632) 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 -- 172.21.15.181:0/3774933090 learned_addr learned my addr 172.21.15.181:0/3774933090 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f052b7fe640 1 --2- 172.21.15.181:0/3774933090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c0d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f052affd640 1 --2- 172.21.15.181:0/3774933090 >> v2:172.21.15.204:3300/0 conn(0x7f052c161c60 0x7f052c0d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 -- 172.21.15.181:0/3774933090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 msgr2=0x7f052c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 --2- 172.21.15.181:0/3774933090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c0d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 -- 172.21.15.181:0/3774933090 >> v2:172.21.15.204:3300/0 conn(0x7f052c161c60 msgr2=0x7f052c0d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 --2- 172.21.15.181:0/3774933090 >> v2:172.21.15.204:3300/0 conn(0x7f052c161c60 0x7f052c0d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 -- 172.21.15.181:0/3774933090 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c073330 con 0x7f052c06cd90 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f052affd640 1 --2- 172.21.15.181:0/3774933090 >> v2:172.21.15.204:3300/0 conn(0x7f052c161c60 0x7f052c0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.687+0000 7f05227fc640 1 --2- 172.21.15.181:0/3774933090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c06cd90 0x7f052c06d730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f052c0cfef0 tx=0x7f051402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d8f1fa828bd417 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f052a7fc640 1 -- 172.21.15.181:0/3774933090 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514037070 con 0x7f052c06cd90 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f052a7fc640 1 -- 172.21.15.181:0/3774933090 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051402ae00 con 0x7f052c06cd90 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f052a7fc640 1 -- 172.21.15.181:0/3774933090 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514032660 con 0x7f052c06cd90 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 -- 172.21.15.181:0/3774933090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c06cd90 msgr2=0x7f052c06d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 --2- 172.21.15.181:0/3774933090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c06cd90 0x7f052c06d730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f052c0cfef0 tx=0x7f051402a0b0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 -- 172.21.15.181:0/3774933090 shutdown_connections 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 --2- 172.21.15.181:0/3774933090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c0d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 --2- 172.21.15.181:0/3774933090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c06cd90 0x7f052c06d730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 --2- 172.21.15.181:0/3774933090 >> v2:172.21.15.204:3300/0 conn(0x7f052c161c60 0x7f052c0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 -- 172.21.15.181:0/3774933090 >> 172.21.15.181:0/3774933090 conn(0x7f052c067950 msgr2=0x7f052c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 -- 172.21.15.181:0/3774933090 shutdown_connections 2024-09-12T02:28:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.688+0000 7f0531578640 1 -- 172.21.15.181:0/3774933090 wait complete. 2024-09-12T02:28:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.689+0000 7f0531578640 1 Processor -- start 2024-09-12T02:28:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f0531578640 1 -- start start 2024-09-12T02:28:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f0531578640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f052c06cd90 0x7f052c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f0531578640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f0531578640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c161c60 0x7f052c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f0531578640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f052c06dc70 con 0x7f052c161c60 2024-09-12T02:28:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f0531578640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f052c074100 con 0x7f052c06cd90 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f0531578640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f052c0b4090 con 0x7f052c0d0e20 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f052b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c161c60 0x7f052c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f052b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c161c60 0x7f052c15bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41648/0 (socket says 172.21.15.181:41648) 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f052b7fe640 1 -- 172.21.15.181:0/1432110673 learned_addr learned my addr 172.21.15.181:0/1432110673 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.690+0000 7f052affd640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f052c06cd90 0x7f052c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f05227fc640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f052b7fe640 1 -- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 msgr2=0x7f052c14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f052b7fe640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c14fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f052b7fe640 1 -- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f052c06cd90 msgr2=0x7f052c15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f052b7fe640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f052c06cd90 0x7f052c15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f052b7fe640 1 -- 172.21.15.181:0/1432110673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c15b9f0 con 0x7f052c161c60 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f052b7fe640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c161c60 0x7f052c15bf80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f052400ef00 tx=0x7f052400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f0523fff640 1 -- 172.21.15.181:0/1432110673 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0524018020 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f0523fff640 1 -- 172.21.15.181:0/1432110673 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0524014400 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c154ec0 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f0523fff640 1 -- 172.21.15.181:0/1432110673 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05240147f0 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.691+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c155480 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.692+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052c1613d0 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.692+0000 7f0523fff640 1 -- 172.21.15.181:0/1432110673 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0524005d10 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.693+0000 7f0523fff640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f050c06be30 0x7f050c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.693+0000 7f0523fff640 1 -- 172.21.15.181:0/1432110673 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f052408b0e0 con 0x7f052c161c60 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.693+0000 7f052affd640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f050c06be30 0x7f050c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.693+0000 7f052affd640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f050c06be30 0x7f050c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f052c0cd6c0 tx=0x7f051c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.697+0000 7f0523fff640 1 -- 172.21.15.181:0/1432110673 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f052c1613d0 con 0x7f052c161c60 2024-09-12T02:28:56.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.925+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f052c06d730 con 0x7f052c161c60 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.926+0000 7f0523fff640 1 -- 172.21.15.181:0/1432110673 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f0524022070 con 0x7f052c161c60 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout: "auth_dump": [ 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.a", 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmgqStABAAuR5/mEmoQ93BJ/aXTfZ3Vg==", 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.927 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.b", 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmHB1xDBAA9v9urEvVrgq4ujbl1dq0ow==", 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.928 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.c", 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmA6uoBxAAsY99fp7CzedZ/yS6xKV3Ww==", 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.d", 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmSVuPExAA2lIlASsgadRjRVyKwAD+ig==", 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.0", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCJUeJmXm6kMxAAhxzDDmGdbM/mLqwsr2z0qw==", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.1", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCNUeJm3UvvNBAAiZKHPj471Ql3u3MDU+vYrg==", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.2", 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCRUeJm6pZuJxAABApQFY9e5yj6ehNZsZcerA==", 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.3", 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCVUeJm5e9GKBAA0ZoeZyPDkw7vRVjKLRZIZQ==", 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.4", 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCcUeJmd20TMhAA0MSq5FoRha+jFQ6aJbfs/A==", 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.5", 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCgUeJmcgSVMxAAFDsp8jmrJ2uco7rmn4q9XQ==", 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.6", 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCkUeJmTwSWNBAApWkWkCbc9Mpk7VGR27a4+Q==", 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.7", 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCoUeJmVts/NRAAQ3JpiLZSmnd2VbHLmZyXJQ==", 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.0", 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg==", 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.1", 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm8f6AIBAA96HxvzttXuXOClAGiYwh7g==", 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.2", 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm/+dGHRAAw3bdTqnuOcV2umDd/1577Q==", 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.3", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmCFcdJhAAEpU/Swkitc8CXjG0SKzeLQ==", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.admin", 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmD708IBAAP+FE49F+D1d43sRbMVLBlQ==", 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.bootstrap-mds", 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCvUeJmNxfIHhAAplUGbHvn01nZK/Q7yJjNYg==", 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile bootstrap-mds" 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.bootstrap-mgr", 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCvUeJmEx/IHhAAJZ61Rnfug39i5y1g78sZuQ==", 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.bootstrap-osd", 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCvUeJmvybIHhAAVagNnUnXgsr25hVkfIhG4Q==", 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile bootstrap-osd" 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.bootstrap-rbd", 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCvUeJmYi3IHhAAYcJoZR+TLVNwBCrZfvm+/Q==", 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCvUeJmHzTIHhAAMQrCBHNcQx2QNJOsU8RoZg==", 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.bootstrap-rgw", 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCvUeJmBDvIHhAAwJkPi+RzOzzqMYhBASIG4Q==", 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-12T02:28:56.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.x", 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmmPEKORAAtnB+3V0qg1BS1zEVF5qImQ==", 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.y", 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmMrTWNBAAVU9k50mu969QuqrLSsdtGw==", 2024-09-12T02:28:56.943 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:28:56.944 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:28:56.944 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:28:56.944 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:28:56.944 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.944 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:56.944 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:28:56.944 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f050c06be30 msgr2=0x7f050c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f050c06be30 0x7f050c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f052c0cd6c0 tx=0x7f051c008040 comp rx=0 tx=0).stop 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c161c60 msgr2=0x7f052c15bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c161c60 0x7f052c15bf80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f052400ef00 tx=0x7f052400b480 comp rx=0 tx=0).stop 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 shutdown_connections 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f050c06be30 0x7f050c06e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c161c60 0x7f052c15bf80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f052c0d0e20 0x7f052c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 --2- 172.21.15.181:0/1432110673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f052c06cd90 0x7f052c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 >> 172.21.15.181:0/1432110673 conn(0x7f052c067950 msgr2=0x7f052c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 shutdown_connections 2024-09-12T02:28:56.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:56.928+0000 7f0531578640 1 -- 172.21.15.181:0/1432110673 wait complete. 2024-09-12T02:28:56.947 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-12T02:28:57.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.046+0000 7ff1f465e640 1 Processor -- start 2024-09-12T02:28:57.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.046+0000 7ff1f465e640 1 -- start start 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f465e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff1ec0d0510 0x7ff1ec15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f465e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f465e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1ec0b2820 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f465e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff1ec0b2b00 con 0x7ff1ec0d0510 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f465e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec141730 con 0x7ff1ec0b3800 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f23fa640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff1ec0d0510 0x7ff1ec15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f1bf9640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff1ec0d08f0 0x7ff1ec0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44340/0 (socket says 172.21.15.181:44340) 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f1bf9640 1 -- 172.21.15.181:0/1983230543 learned_addr learned my addr 172.21.15.181:0/1983230543 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:57.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f2bfb640 1 --2- 172.21.15.181:0/1983230543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f23fa640 1 -- 172.21.15.181:0/1983230543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 msgr2=0x7ff1ec072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f23fa640 1 --2- 172.21.15.181:0/1983230543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f23fa640 1 -- 172.21.15.181:0/1983230543 >> v1:172.21.15.181:6789/0 conn(0x7ff1ec0d08f0 legacy=0x7ff1ec0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f13f8640 1 -- 172.21.15.181:0/1983230543 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878442823 0 0) 0x7ff1ec0b2820 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.047+0000 7ff1f23fa640 1 -- 172.21.15.181:0/1983230543 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec144320 con 0x7ff1ec0d0510 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.048+0000 7ff1f23fa640 1 --2- 172.21.15.181:0/1983230543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d0510 0x7ff1ec15ef90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009d90 tx=0x7ff1e802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369b66514e48035f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.048+0000 7ff1f13f8640 1 -- 172.21.15.181:0/1983230543 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8032770 con 0x7ff1ec0d0510 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.048+0000 7ff1f13f8640 1 -- 172.21.15.181:0/1983230543 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e8038070 con 0x7ff1ec0d0510 2024-09-12T02:28:57.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.048+0000 7ff1f13f8640 1 -- 172.21.15.181:0/1983230543 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8032b30 con 0x7ff1ec0d0510 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 -- 172.21.15.181:0/1983230543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d0510 msgr2=0x7ff1ec15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 --2- 172.21.15.181:0/1983230543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d0510 0x7ff1ec15ef90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009d90 tx=0x7ff1e802c870 comp rx=0 tx=0).stop 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 -- 172.21.15.181:0/1983230543 shutdown_connections 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 --2- 172.21.15.181:0/1983230543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 --2- 172.21.15.181:0/1983230543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d0510 0x7ff1ec15ef90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 -- 172.21.15.181:0/1983230543 >> 172.21.15.181:0/1983230543 conn(0x7ff1ec06bc10 msgr2=0x7ff1ec06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 -- 172.21.15.181:0/1983230543 shutdown_connections 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.049+0000 7ff1f465e640 1 -- 172.21.15.181:0/1983230543 wait complete. 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.050+0000 7ff1f465e640 1 Processor -- start 2024-09-12T02:28:57.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.050+0000 7ff1f465e640 1 -- start start 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f465e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f465e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1ec0d0510 0x7ff1ec0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f465e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d08f0 0x7ff1ec0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f465e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec0b1df0 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f465e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec143dc0 con 0x7ff1ec0d0510 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f465e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec0b1f70 con 0x7ff1ec0b3800 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d08f0 0x7ff1ec0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d08f0 0x7ff1ec0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41664/0 (socket says 172.21.15.181:41664) 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 -- 172.21.15.181:0/255308231 learned_addr learned my addr 172.21.15.181:0/255308231 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:57.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f23fa640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 -- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 msgr2=0x7ff1ec15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec15d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 -- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1ec0d0510 msgr2=0x7ff1ec0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f1bf9640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1ec0d0510 0x7ff1ec0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1ec0d0510 0x7ff1ec0ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 -- 172.21.15.181:0/255308231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec0abef0 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1f2bfb640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d08f0 0x7ff1ec0ad6f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400d800 tx=0x7ff1e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1e2ffd640 1 -- 172.21.15.181:0/255308231 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400b6c0 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1e2ffd640 1 -- 172.21.15.181:0/255308231 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4019070 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.051+0000 7ff1e2ffd640 1 -- 172.21.15.181:0/255308231 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400bac0 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.052+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ec0abc10 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.052+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ec0ac9b0 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.053+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ec0b2400 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.053+0000 7ff1e2ffd640 1 -- 172.21.15.181:0/255308231 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1e400bc60 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.054+0000 7ff1e2ffd640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff1d006be30 0x7ff1d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.054+0000 7ff1f23fa640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff1d006be30 0x7ff1d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.054+0000 7ff1e2ffd640 1 -- 172.21.15.181:0/255308231 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7ff1e408aef0 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.054+0000 7ff1f23fa640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff1d006be30 0x7ff1d006e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8037000 tx=0x7ff1e8032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.058+0000 7ff1e2ffd640 1 -- 172.21.15.181:0/255308231 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1e4059c80 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.285+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7ff1ec0b0040 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.287+0000 7ff1e2ffd640 1 -- 172.21.15.181:0/255308231 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7ff1e4059580 con 0x7ff1ec0d08f0 2024-09-12T02:28:57.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff1d006be30 msgr2=0x7ff1d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff1d006be30 0x7ff1d006e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8037000 tx=0x7ff1e8032000 comp rx=0 tx=0).stop 2024-09-12T02:28:57.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d08f0 msgr2=0x7ff1ec0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d08f0 0x7ff1ec0ad6f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400d800 tx=0x7ff1e400dcc0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 shutdown_connections 2024-09-12T02:28:57.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff1d006be30 0x7ff1d006e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1ec0d0510 0x7ff1ec0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1ec0d08f0 0x7ff1ec0ad6f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 --2- 172.21.15.181:0/255308231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1ec0b3800 0x7ff1ec15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 >> 172.21.15.181:0/255308231 conn(0x7ff1ec06bc10 msgr2=0x7ff1ec140b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:57.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 shutdown_connections 2024-09-12T02:28:57.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.289+0000 7ff1f465e640 1 -- 172.21.15.181:0/255308231 wait complete. 2024-09-12T02:28:57.300 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-12T02:28:57.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.400+0000 7ff1866d7640 1 Processor -- start 2024-09-12T02:28:57.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.400+0000 7ff1866d7640 1 -- start start 2024-09-12T02:28:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff1866d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff180156950 0x7ff18015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff1866d7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff18006e240 con 0x7ff18006c320 2024-09-12T02:28:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff1866d7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff180160380 con 0x7ff18015fe70 2024-09-12T02:28:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff1866d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff180156d30 con 0x7ff180156950 2024-09-12T02:28:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff184c74640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff18006c320 0x7ff1800cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44350/0 (socket says 172.21.15.181:44350) 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff184c74640 1 -- 172.21.15.181:0/3243111802 learned_addr learned my addr 172.21.15.181:0/3243111802 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937352137 0 0) 0x7ff178001490 con 0x7ff18006c320 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17ffff640 1 --2- 172.21.15.181:0/3243111802 >> v2:172.21.15.204:3300/0 conn(0x7ff180156950 0x7ff18015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff168003520 con 0x7ff18006c320 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1964008683 0 0) 0x7ff168003520 con 0x7ff18006c320 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 >> v2:172.21.15.204:3300/0 conn(0x7ff180156950 msgr2=0x7ff18015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 --2- 172.21.15.181:0/3243111802 >> v2:172.21.15.204:3300/0 conn(0x7ff180156950 0x7ff18015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 >> v1:172.21.15.204:6789/0 conn(0x7ff18015fe70 legacy=0x7ff18006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff180160660 con 0x7ff18006c320 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7ff178001bc0 con 0x7ff18006c320 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 >> v1:172.21.15.181:6789/0 conn(0x7ff18006c320 legacy=0x7ff1800cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1680039b0 0x7ff168003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff168004800 0x7ff168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1680051c0 0x7ff16800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff180156d30 con 0x7ff1680051c0 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff16800c060 con 0x7ff1680039b0 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.401+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff16800c260 con 0x7ff168004800 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff184c74640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1680051c0 0x7ff16800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff17ffff640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1680039b0 0x7ff168003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff17f7fe640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff168004800 0x7ff168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff184c74640 1 -- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff168004800 msgr2=0x7ff168004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff184c74640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff168004800 0x7ff168004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff184c74640 1 -- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1680039b0 msgr2=0x7ff168003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff184c74640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1680039b0 0x7ff168003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff184c74640 1 -- 172.21.15.181:0/3243111802 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff168003520 con 0x7ff1680051c0 2024-09-12T02:28:57.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.402+0000 7ff184c74640 1 -- 172.21.15.181:0/3243111802 reap_dead start 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff184c74640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1680051c0 0x7ff16800b9c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff17800aa00 tx=0x7ff168005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3235f6dba0ec64c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17800a650 con 0x7ff1680051c0 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17802f070 con 0x7ff1680051c0 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff17effd640 1 -- 172.21.15.181:0/3243111802 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178034470 con 0x7ff1680051c0 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff1866d7640 1 -- 172.21.15.181:0/3243111802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1680051c0 msgr2=0x7ff16800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff1866d7640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1680051c0 0x7ff16800b9c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff17800aa00 tx=0x7ff168005830 comp rx=0 tx=0).stop 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff1866d7640 1 -- 172.21.15.181:0/3243111802 shutdown_connections 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff1866d7640 1 --2- 172.21.15.181:0/3243111802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1680051c0 0x7ff16800b9c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff1866d7640 1 -- 172.21.15.181:0/3243111802 >> 172.21.15.181:0/3243111802 conn(0x7ff180067b30 msgr2=0x7ff18006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff1866d7640 1 -- 172.21.15.181:0/3243111802 shutdown_connections 2024-09-12T02:28:57.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.403+0000 7ff1866d7640 1 -- 172.21.15.181:0/3243111802 wait complete. 2024-09-12T02:28:57.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.404+0000 7ff1866d7640 1 Processor -- start 2024-09-12T02:28:57.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff1866d7640 1 -- start start 2024-09-12T02:28:57.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff1866d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1680051c0 0x7ff1801525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff1866d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff180150690 0x7ff18014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff1866d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff18014ffc0 0x7ff1800b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff1866d7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff1800cede0 con 0x7ff180150690 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff1866d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff180160c20 con 0x7ff18014ffc0 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff1866d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff1800cef60 con 0x7ff1680051c0 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff17f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff180150690 0x7ff18014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff17f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff180150690 0x7ff18014fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41694/0 (socket says 172.21.15.181:41694) 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.405+0000 7ff17f7fe640 1 -- 172.21.15.181:0/1713496188 learned_addr learned my addr 172.21.15.181:0/1713496188 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17ffff640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1680051c0 0x7ff1801525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff184c74640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff18014ffc0 0x7ff1800b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17f7fe640 1 -- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1680051c0 msgr2=0x7ff1801525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17f7fe640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1680051c0 0x7ff1801525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17f7fe640 1 -- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff18014ffc0 msgr2=0x7ff1800b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17f7fe640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff18014ffc0 0x7ff1800b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17f7fe640 1 -- 172.21.15.181:0/1713496188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1801e88f0 con 0x7ff180150690 2024-09-12T02:28:57.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17f7fe640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff180150690 0x7ff18014fa80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff17400f620 tx=0x7ff17400fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17cff9640 1 -- 172.21.15.181:0/1713496188 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1740052e0 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17cff9640 1 -- 172.21.15.181:0/1713496188 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174018070 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff17cff9640 1 -- 172.21.15.181:0/1713496188 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174003810 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1800b1f60 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.406+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1800b2520 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.407+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1801503d0 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.407+0000 7ff17cff9640 1 -- 172.21.15.181:0/1713496188 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1740039b0 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.408+0000 7ff17cff9640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff16c06be30 0x7ff16c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.408+0000 7ff17cff9640 1 -- 172.21.15.181:0/1713496188 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7ff17408a750 con 0x7ff180150690 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.408+0000 7ff17ffff640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff16c06be30 0x7ff16c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.408+0000 7ff17ffff640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff16c06be30 0x7ff16c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff170009b40 tx=0x7ff170009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.412+0000 7ff17cff9640 1 -- 172.21.15.181:0/1713496188 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1801503d0 con 0x7ff180150690 2024-09-12T02:28:57.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.644+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7ff18006bdc0 con 0x7ff180150690 2024-09-12T02:28:57.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.646+0000 7ff17cff9640 1 -- 172.21.15.181:0/1713496188 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7ff174059450 con 0x7ff180150690 2024-09-12T02:28:57.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff16c06be30 msgr2=0x7ff16c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff16c06be30 0x7ff16c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff170009b40 tx=0x7ff170009190 comp rx=0 tx=0).stop 2024-09-12T02:28:57.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff180150690 msgr2=0x7ff18014fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff180150690 0x7ff18014fa80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff17400f620 tx=0x7ff17400fa20 comp rx=0 tx=0).stop 2024-09-12T02:28:57.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 shutdown_connections 2024-09-12T02:28:57.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff16c06be30 0x7ff16c06e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff18014ffc0 0x7ff1800b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff180150690 0x7ff18014fa80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 --2- 172.21.15.181:0/1713496188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1680051c0 0x7ff1801525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 >> 172.21.15.181:0/1713496188 conn(0x7ff180067b30 msgr2=0x7ff18015de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:57.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 shutdown_connections 2024-09-12T02:28:57.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.648+0000 7ff1866d7640 1 -- 172.21.15.181:0/1713496188 wait complete. 2024-09-12T02:28:57.660 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-12T02:28:57.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.759+0000 7f74b7da6640 1 Processor -- start 2024-09-12T02:28:57.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.759+0000 7f74b7da6640 1 -- start start 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b7da6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b015b2e0 0x7f74b00b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b7da6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f74b00cdfc0 0x7f74b00b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b7da6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b00ce4f0 con 0x7f74b00b22c0 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b7da6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f74b015b6c0 con 0x7f74b00cdfc0 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b7da6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f74b00ce7d0 con 0x7f74b015b2e0 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b5341640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f74b00cdfc0 0x7f74b00b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b5b42640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b015b2e0 0x7f74b00b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b6343640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f74b00b22c0 0x7f74b00ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:33424/0 (socket says 172.21.15.181:33424) 2024-09-12T02:28:57.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.760+0000 7f74b6343640 1 -- 172.21.15.181:0/2792433338 learned_addr learned my addr 172.21.15.181:0/2792433338 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:57.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b5b42640 1 -- 172.21.15.181:0/2792433338 >> v2:172.21.15.204:3300/0 conn(0x7f74b00cdfc0 msgr2=0x7f74b00b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:57.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b5b42640 1 --2- 172.21.15.181:0/2792433338 >> v2:172.21.15.204:3300/0 conn(0x7f74b00cdfc0 0x7f74b00b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b5b42640 1 -- 172.21.15.181:0/2792433338 >> v1:172.21.15.204:6789/0 conn(0x7f74b00b22c0 legacy=0x7f74b00ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b5b42640 1 -- 172.21.15.181:0/2792433338 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b00ceab0 con 0x7f74b015b2e0 2024-09-12T02:28:57.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b5341640 1 --2- 172.21.15.181:0/2792433338 >> v2:172.21.15.204:3300/0 conn(0x7f74b00cdfc0 0x7f74b00b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:57.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b5b42640 1 --2- 172.21.15.181:0/2792433338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b015b2e0 0x7f74b00b3d20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0097a0 tx=0x7f74ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64078cccc76ec75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b4b40640 1 -- 172.21.15.181:0/2792433338 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac037070 con 0x7f74b015b2e0 2024-09-12T02:28:57.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b4b40640 1 -- 172.21.15.181:0/2792433338 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ac032440 con 0x7f74b015b2e0 2024-09-12T02:28:57.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.761+0000 7f74b4b40640 1 -- 172.21.15.181:0/2792433338 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac032810 con 0x7f74b015b2e0 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 -- 172.21.15.181:0/2792433338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b015b2e0 msgr2=0x7f74b00b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 --2- 172.21.15.181:0/2792433338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b015b2e0 0x7f74b00b3d20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0097a0 tx=0x7f74ac02a180 comp rx=0 tx=0).stop 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 -- 172.21.15.181:0/2792433338 shutdown_connections 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 --2- 172.21.15.181:0/2792433338 >> v2:172.21.15.204:3300/0 conn(0x7f74b00cdfc0 0x7f74b00b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 --2- 172.21.15.181:0/2792433338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b015b2e0 0x7f74b00b3d20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 -- 172.21.15.181:0/2792433338 >> 172.21.15.181:0/2792433338 conn(0x7f74b006bc10 msgr2=0x7f74b006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 -- 172.21.15.181:0/2792433338 shutdown_connections 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.762+0000 7f74b7da6640 1 -- 172.21.15.181:0/2792433338 wait complete. 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.763+0000 7f74b7da6640 1 Processor -- start 2024-09-12T02:28:57.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.763+0000 7f74b7da6640 1 -- start start 2024-09-12T02:28:57.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b7da6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b00b22c0 0x7f74b014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b7da6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74b00cdfc0 0x7f74b014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b7da6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74b015b2e0 0x7f74b0150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b7da6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f74b00712b0 con 0x7f74b00cdfc0 2024-09-12T02:28:57.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b7da6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f74b0071130 con 0x7f74b015b2e0 2024-09-12T02:28:57.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b7da6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f74b00b4260 con 0x7f74b00b22c0 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74b00cdfc0 0x7f74b014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74b00cdfc0 0x7f74b014c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41700/0 (socket says 172.21.15.181:41700) 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 -- 172.21.15.181:0/1146778156 learned_addr learned my addr 172.21.15.181:0/1146778156 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5b42640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b00b22c0 0x7f74b014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b6343640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74b015b2e0 0x7f74b0150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 -- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b00b22c0 msgr2=0x7f74b014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b00b22c0 0x7f74b014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 -- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74b015b2e0 msgr2=0x7f74b0150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74b015b2e0 0x7f74b0150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.764+0000 7f74b5341640 1 -- 172.21.15.181:0/1146778156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b01500e0 con 0x7f74b00cdfc0 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.765+0000 7f74b5341640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74b00cdfc0 0x7f74b014c910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f74a000ebb0 tx=0x7f74a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.765+0000 7f74a67fc640 1 -- 172.21.15.181:0/1146778156 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0017070 con 0x7f74b00cdfc0 2024-09-12T02:28:57.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.765+0000 7f74a67fc640 1 -- 172.21.15.181:0/1146778156 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a000cc30 con 0x7f74b00cdfc0 2024-09-12T02:28:57.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.765+0000 7f74a67fc640 1 -- 172.21.15.181:0/1146778156 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0013470 con 0x7f74b00cdfc0 2024-09-12T02:28:57.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.765+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b014eb00 con 0x7f74b00cdfc0 2024-09-12T02:28:57.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.765+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b014f0c0 con 0x7f74b00cdfc0 2024-09-12T02:28:57.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.766+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b00b1d80 con 0x7f74b00cdfc0 2024-09-12T02:28:57.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.766+0000 7f74a67fc640 1 -- 172.21.15.181:0/1146778156 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74a001a070 con 0x7f74b00cdfc0 2024-09-12T02:28:57.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.767+0000 7f74a67fc640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f749406be60 0x7f749406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:57.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.767+0000 7f74a67fc640 1 -- 172.21.15.181:0/1146778156 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f74a008aa40 con 0x7f74b00cdfc0 2024-09-12T02:28:57.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.767+0000 7f74b5b42640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f749406be60 0x7f749406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:57.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.767+0000 7f74b5b42640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f749406be60 0x7f749406e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74ac034000 tx=0x7f74ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:57.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.771+0000 7f74a67fc640 1 -- 172.21.15.181:0/1146778156 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74a0059740 con 0x7f74b00cdfc0 2024-09-12T02:28:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:57.998+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f74b0159ee0 con 0x7f74b00cdfc0 2024-09-12T02:28:58.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.001+0000 7f74a67fc640 1 -- 172.21.15.181:0/1146778156 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f74a0059040 con 0x7f74b00cdfc0 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f749406be60 msgr2=0x7f749406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f749406be60 0x7f749406e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74ac034000 tx=0x7f74ac02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74b00cdfc0 msgr2=0x7f74b014c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74b00cdfc0 0x7f74b014c910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f74a000ebb0 tx=0x7f74a000c520 comp rx=0 tx=0).stop 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 shutdown_connections 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f749406be60 0x7f749406e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74b015b2e0 0x7f74b0150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74b00cdfc0 0x7f74b014c910 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 --2- 172.21.15.181:0/1146778156 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74b00b22c0 0x7f74b014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.003+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 >> 172.21.15.181:0/1146778156 conn(0x7f74b006bc10 msgr2=0x7f74b01587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.004+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 shutdown_connections 2024-09-12T02:28:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.004+0000 7f74b7da6640 1 -- 172.21.15.181:0/1146778156 wait complete. 2024-09-12T02:28:58.015 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-12T02:28:58.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.114+0000 7f551fab7640 1 Processor -- start 2024-09-12T02:28:58.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.114+0000 7f551fab7640 1 -- start start 2024-09-12T02:28:58.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551fab7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 0x7f55180b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551fab7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55180ce480 con 0x7f551815b1e0 2024-09-12T02:28:58.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551fab7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55180ce760 con 0x7f55180b22c0 2024-09-12T02:28:58.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551fab7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f55180cea40 con 0x7f55180cdfc0 2024-09-12T02:28:58.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551d853640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f551815b1e0 0x7f55180b3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44358/0 (socket says 172.21.15.181:44358) 2024-09-12T02:28:58.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551d853640 1 -- 172.21.15.181:0/2718654043 learned_addr learned my addr 172.21.15.181:0/2718654043 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:58.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161008836 0 0) 0x7f55180ce480 con 0x7f551815b1e0 2024-09-12T02:28:58.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5504003520 con 0x7f551815b1e0 2024-09-12T02:28:58.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551d052640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 0x7f55180b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1338917566 0 0) 0x7f5504003520 con 0x7f551815b1e0 2024-09-12T02:28:58.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 msgr2=0x7f55180b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 0x7f55180b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 >> v1:172.21.15.204:6789/0 conn(0x7f55180b22c0 legacy=0x7f55180716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55180ced20 con 0x7f551815b1e0 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f5508001670 con 0x7f551815b1e0 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 >> v1:172.21.15.181:6789/0 conn(0x7f551815b1e0 legacy=0x7f55180b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55040039e0 0x7f5504003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f5504004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 0x7f5504005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f55180cea40 con 0x7f5504004800 2024-09-12T02:28:58.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f550400bb20 con 0x7f55040039e0 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f550400bd20 con 0x7f55180cdfc0 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551d052640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f5504004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.115+0000 7f551d853640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55040039e0 0x7f5504003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551e054640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 0x7f5504005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551d052640 1 -- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 msgr2=0x7f5504005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551d052640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 0x7f5504005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551d052640 1 -- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55040039e0 msgr2=0x7f5504003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551d052640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55040039e0 0x7f5504003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551d052640 1 -- 172.21.15.181:0/2718654043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5504003520 con 0x7f5504004800 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551e054640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f55180cdfc0 0x7f5504005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551d853640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55040039e0 0x7f5504003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551d052640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f5504004c80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f551400ba30 tx=0x7f5504005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9352adf1e5242cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514030070 con 0x7f5504004800 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551402ade0 con 0x7f5504004800 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.116+0000 7f551c851640 1 -- 172.21.15.181:0/2718654043 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551400b600 con 0x7f5504004800 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.117+0000 7f551fab7640 1 -- 172.21.15.181:0/2718654043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 msgr2=0x7f5504004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.117+0000 7f551fab7640 1 --2- 172.21.15.181:0/2718654043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f5504004c80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f551400ba30 tx=0x7f5504005830 comp rx=0 tx=0).stop 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.117+0000 7f551e054640 1 -- 172.21.15.181:0/2718654043 reap_dead start 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.117+0000 7f551fab7640 1 -- 172.21.15.181:0/2718654043 shutdown_connections 2024-09-12T02:28:58.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.117+0000 7f551fab7640 1 -- 172.21.15.181:0/2718654043 >> 172.21.15.181:0/2718654043 conn(0x7f551806bc10 msgr2=0x7f551806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.117+0000 7f551fab7640 1 -- 172.21.15.181:0/2718654043 shutdown_connections 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.117+0000 7f551fab7640 1 -- 172.21.15.181:0/2718654043 wait complete. 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.118+0000 7f551fab7640 1 Processor -- start 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.118+0000 7f551fab7640 1 -- start start 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551fab7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f551814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551fab7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f551814bf40 0x7f551814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551fab7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551814ea80 0x7f551815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551fab7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5518071130 con 0x7f5504004800 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551fab7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f551815b5c0 con 0x7f551814ea80 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551fab7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f55180b1d80 con 0x7f551814bf40 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f551814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f551814c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41706/0 (socket says 172.21.15.181:41706) 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 -- 172.21.15.181:0/3407270741 learned_addr learned my addr 172.21.15.181:0/3407270741 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 -- 172.21.15.181:0/3407270741 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f551814bf40 msgr2=0x7f551814e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f551814bf40 0x7f551814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 -- 172.21.15.181:0/3407270741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551814ea80 msgr2=0x7f551815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551e054640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551814ea80 0x7f551815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551814ea80 0x7f551815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.119+0000 7f551d853640 1 -- 172.21.15.181:0/3407270741 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5518155610 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.120+0000 7f551d853640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f551814c710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f550800e8c0 tx=0x7f550800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.120+0000 7f550e7fc640 1 -- 172.21.15.181:0/3407270741 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508019070 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.120+0000 7f550e7fc640 1 -- 172.21.15.181:0/3407270741 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5508005300 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.120+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5518155890 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.120+0000 7f550e7fc640 1 -- 172.21.15.181:0/3407270741 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55080056b0 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.120+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5518156130 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.121+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5518155a60 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.121+0000 7f550e7fc640 1 -- 172.21.15.181:0/3407270741 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55080047e0 con 0x7f5504004800 2024-09-12T02:28:58.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.122+0000 7f550e7fc640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f54fc06be60 0x7f54fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.122+0000 7f550e7fc640 1 -- 172.21.15.181:0/3407270741 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f550808a350 con 0x7f5504004800 2024-09-12T02:28:58.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.122+0000 7f551d052640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f54fc06be60 0x7f54fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.122+0000 7f551d052640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f54fc06be60 0x7f54fc06e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f551400ba00 tx=0x7f551402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.126+0000 7f550e7fc640 1 -- 172.21.15.181:0/3407270741 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5518155610 con 0x7f5504004800 2024-09-12T02:28:58.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.353+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f55180b3c90 con 0x7f5504004800 2024-09-12T02:28:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.356+0000 7f550e7fc640 1 -- 172.21.15.181:0/3407270741 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f5508058a90 con 0x7f5504004800 2024-09-12T02:28:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f54fc06be60 msgr2=0x7f54fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f54fc06be60 0x7f54fc06e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f551400ba00 tx=0x7f551402c000 comp rx=0 tx=0).stop 2024-09-12T02:28:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 msgr2=0x7f551814c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f551814c710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f550800e8c0 tx=0x7f550800ed80 comp rx=0 tx=0).stop 2024-09-12T02:28:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 shutdown_connections 2024-09-12T02:28:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f54fc06be60 0x7f54fc06e320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f551814ea80 0x7f551815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f551814bf40 0x7f551814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 --2- 172.21.15.181:0/3407270741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5504004800 0x7f551814c710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 >> 172.21.15.181:0/3407270741 conn(0x7f551806bc10 msgr2=0x7f5518072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 shutdown_connections 2024-09-12T02:28:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.359+0000 7f551fab7640 1 -- 172.21.15.181:0/3407270741 wait complete. 2024-09-12T02:28:58.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-12T02:28:58.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.468+0000 7f6dff111640 1 Processor -- start 2024-09-12T02:28:58.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.468+0000 7f6dff111640 1 -- start start 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dff111640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6df80cf200 0x7f6df80cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dff111640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 0x7f6df8154c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dff111640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df80cf780 con 0x7f6df80afc70 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dff111640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f6df80ce470 con 0x7f6df80cf200 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dff111640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6df80cfa60 con 0x7f6df80ce020 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dfcead640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6df80afc70 0x7f6df815f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44368/0 (socket says 172.21.15.181:44368) 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dfcead640 1 -- 172.21.15.181:0/3615252601 learned_addr learned my addr 172.21.15.181:0/3615252601 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6dfd6ae640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 0x7f6df8154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902455658 0 0) 0x7f6df80cf780 con 0x7f6df80afc70 2024-09-12T02:28:58.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de0003520 con 0x7f6df80afc70 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.469+0000 7f6df7fff640 1 --2- 172.21.15.181:0/3615252601 >> v2:172.21.15.204:3300/0 conn(0x7f6df80cf200 0x7f6df80cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 294384597 0 0) 0x7f6de0003520 con 0x7f6df80afc70 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 msgr2=0x7f6df8154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 0x7f6df8154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 >> v2:172.21.15.204:3300/0 conn(0x7f6df80cf200 msgr2=0x7f6df80cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 --2- 172.21.15.181:0/3615252601 >> v2:172.21.15.204:3300/0 conn(0x7f6df80cf200 0x7f6df80cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df80cfd40 con 0x7f6df80afc70 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f6de8001670 con 0x7f6df80afc70 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df7fff640 1 --2- 172.21.15.181:0/3615252601 >> v2:172.21.15.204:3300/0 conn(0x7f6df80cf200 0x7f6df80cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:58.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 >> v1:172.21.15.181:6789/0 conn(0x7f6df80afc70 legacy=0x7f6df815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 0x7f6de00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de0003f30 0x7f6de0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6de0004d40 0x7f6de00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80ce470 con 0x7f6de0004d40 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80cfa60 con 0x7f6de0003f30 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6de000ba10 con 0x7f6df80ce020 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6dfd6ae640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6de0004d40 0x7f6de00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6dfcead640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 0x7f6de00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6df7fff640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de0003f30 0x7f6de0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6dfd6ae640 1 -- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 msgr2=0x7f6de00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6dfd6ae640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df80ce020 0x7f6de00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6dfd6ae640 1 -- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de0003f30 msgr2=0x7f6de0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6dfd6ae640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6de0003f30 0x7f6de0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.470+0000 7f6dfd6ae640 1 -- 172.21.15.181:0/3615252601 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de0003520 con 0x7f6de0004d40 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.471+0000 7f6dfd6ae640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6de0004d40 0x7f6de00051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009fc0 tx=0x7f6de0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59bfbd410f7b2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.471+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0009c10 con 0x7f6de0004d40 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.471+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df0036070 con 0x7f6de0004d40 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.471+0000 7f6df77fe640 1 -- 172.21.15.181:0/3615252601 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0031880 con 0x7f6de0004d40 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.472+0000 7f6dff111640 1 -- 172.21.15.181:0/3615252601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6de0004d40 msgr2=0x7f6de00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.472+0000 7f6dff111640 1 --2- 172.21.15.181:0/3615252601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6de0004d40 0x7f6de00051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009fc0 tx=0x7f6de0005830 comp rx=0 tx=0).stop 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.472+0000 7f6dfd6ae640 1 -- 172.21.15.181:0/3615252601 reap_dead start 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.472+0000 7f6dff111640 1 -- 172.21.15.181:0/3615252601 shutdown_connections 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.472+0000 7f6dff111640 1 -- 172.21.15.181:0/3615252601 >> 172.21.15.181:0/3615252601 conn(0x7f6df80b1770 msgr2=0x7f6df80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.472+0000 7f6dff111640 1 -- 172.21.15.181:0/3615252601 shutdown_connections 2024-09-12T02:28:58.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.472+0000 7f6dff111640 1 -- 172.21.15.181:0/3615252601 wait complete. 2024-09-12T02:28:58.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.473+0000 7f6dff111640 1 Processor -- start 2024-09-12T02:28:58.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.473+0000 7f6dff111640 1 -- start start 2024-09-12T02:28:58.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8160810 0x7f6df81f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df8160bf0 0x7f6df8154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df81546d0 0x7f6df81597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80b0050 con 0x7f6df8160bf0 2024-09-12T02:28:58.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80d0300 con 0x7f6df8160810 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6df80b01d0 con 0x7f6df81546d0 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df8160bf0 0x7f6df8154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df8160bf0 0x7f6df8154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41716/0 (socket says 172.21.15.181:41716) 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 -- 172.21.15.181:0/3949187392 learned_addr learned my addr 172.21.15.181:0/3949187392 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dfcead640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8160810 0x7f6df81f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dfd6ae640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df81546d0 0x7f6df81597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 -- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df81546d0 msgr2=0x7f6df81597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df81546d0 0x7f6df81597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 -- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8160810 msgr2=0x7f6df81f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8160810 0x7f6df81f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 -- 172.21.15.181:0/3949187392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df80ad6a0 con 0x7f6df8160bf0 2024-09-12T02:28:58.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df7fff640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df8160bf0 0x7f6df8154190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6dec011700 tx=0x7f6dec011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df57fa640 1 -- 172.21.15.181:0/3949187392 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec019070 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df57fa640 1 -- 172.21.15.181:0/3949187392 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dec004220 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6df57fa640 1 -- 172.21.15.181:0/3949187392 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00f040 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df80ad980 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.474+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df80adf40 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.475+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df8154ae0 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.476+0000 7f6df57fa640 1 -- 172.21.15.181:0/3949187392 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dec00f760 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.476+0000 7f6df57fa640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6de406be60 0x7f6de406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.476+0000 7f6df57fa640 1 -- 172.21.15.181:0/3949187392 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f6dec08ade0 con 0x7f6df8160bf0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.476+0000 7f6dfcead640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6de406be60 0x7f6de406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.477+0000 7f6dfcead640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6de406be60 0x7f6de406e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6de8004840 tx=0x7f6de8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.480+0000 7f6df57fa640 1 -- 172.21.15.181:0/3949187392 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6df8154ae0 con 0x7f6df8160bf0 2024-09-12T02:28:58.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.709+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f6df80b5090 con 0x7f6df8160bf0 2024-09-12T02:28:58.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.711+0000 7f6df57fa640 1 -- 172.21.15.181:0/3949187392 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f6dec059ae0 con 0x7f6df8160bf0 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6de406be60 msgr2=0x7f6de406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6de406be60 0x7f6de406e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6de8004840 tx=0x7f6de8009040 comp rx=0 tx=0).stop 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df8160bf0 msgr2=0x7f6df8154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df8160bf0 0x7f6df8154190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6dec011700 tx=0x7f6dec011bc0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 shutdown_connections 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6de406be60 0x7f6de406e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6df81546d0 0x7f6df81597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df8160bf0 0x7f6df8154190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 --2- 172.21.15.181:0/3949187392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8160810 0x7f6df81f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 >> 172.21.15.181:0/3949187392 conn(0x7f6df80b1770 msgr2=0x7f6df815e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 shutdown_connections 2024-09-12T02:28:58.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.713+0000 7f6dff111640 1 -- 172.21.15.181:0/3949187392 wait complete. 2024-09-12T02:28:58.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-12T02:28:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.824+0000 7f46be14b640 1 Processor -- start 2024-09-12T02:28:58.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.824+0000 7f46be14b640 1 -- start start 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.824+0000 7f46be14b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f46b80cf2b0 0x7f46b80d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46be14b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b815ea20 con 0x7f46b80cf720 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46be14b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b80b1c50 con 0x7f46b815e640 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46be14b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f46b80b3d00 con 0x7f46b80cf2b0 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b7fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f46b80cf720 0x7f46b80d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44376/0 (socket says 172.21.15.181:44376) 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b7fff640 1 -- 172.21.15.181:0/3034940572 learned_addr learned my addr 172.21.15.181:0/3034940572 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610232563 0 0) 0x7f46b815ea20 con 0x7f46b80cf720 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46a0003520 con 0x7f46b80cf720 2024-09-12T02:28:58.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b6ffd640 1 --2- 172.21.15.181:0/3034940572 >> v2:172.21.15.204:3300/0 conn(0x7f46b80cf2b0 0x7f46b80d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 456298610 0 0) 0x7f46a0003520 con 0x7f46b80cf720 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 >> v2:172.21.15.204:3300/0 conn(0x7f46b80cf2b0 msgr2=0x7f46b80d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 --2- 172.21.15.181:0/3034940572 >> v2:172.21.15.204:3300/0 conn(0x7f46b80cf2b0 0x7f46b80d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 >> v1:172.21.15.204:6789/0 conn(0x7f46b815e640 legacy=0x7f46b80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80b1f30 con 0x7f46b80cf720 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f46b00019f0 con 0x7f46b80cf720 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 >> v1:172.21.15.181:6789/0 conn(0x7f46b80cf720 legacy=0x7f46b80d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46a00039b0 0x7f46a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46a0004800 0x7f46a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f46a000c130 con 0x7f46a00051c0 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f46a000c2e0 con 0x7f46a00039b0 2024-09-12T02:28:58.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f46a000c4e0 con 0x7f46a0004800 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b7fff640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b6ffd640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46a0004800 0x7f46a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.825+0000 7f46b77fe640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46a00039b0 0x7f46a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b7fff640 1 -- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46a0004800 msgr2=0x7f46a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b7fff640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46a0004800 0x7f46a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b7fff640 1 -- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46a00039b0 msgr2=0x7f46a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b7fff640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46a00039b0 0x7f46a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b7fff640 1 -- 172.21.15.181:0/3034940572 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a0003520 con 0x7f46a00051c0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b7fff640 1 -- 172.21.15.181:0/3034940572 reap_dead start 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b7fff640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46a000b9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f46b000a860 tx=0x7f46a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132ffa9d191d1db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b000a480 con 0x7f46a00051c0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b002f070 con 0x7f46a00051c0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.826+0000 7f46b67fc640 1 -- 172.21.15.181:0/3034940572 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b002bcc0 con 0x7f46a00051c0 2024-09-12T02:28:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.827+0000 7f46be14b640 1 -- 172.21.15.181:0/3034940572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 msgr2=0x7f46a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.827+0000 7f46be14b640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46a000b9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f46b000a860 tx=0x7f46a0005830 comp rx=0 tx=0).stop 2024-09-12T02:28:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.827+0000 7f46be14b640 1 -- 172.21.15.181:0/3034940572 shutdown_connections 2024-09-12T02:28:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.827+0000 7f46be14b640 1 --2- 172.21.15.181:0/3034940572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46a000b9c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.827+0000 7f46be14b640 1 -- 172.21.15.181:0/3034940572 >> 172.21.15.181:0/3034940572 conn(0x7f46b809d820 msgr2=0x7f46b80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.827+0000 7f46be14b640 1 -- 172.21.15.181:0/3034940572 shutdown_connections 2024-09-12T02:28:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.827+0000 7f46be14b640 1 -- 172.21.15.181:0/3034940572 wait complete. 2024-09-12T02:28:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.828+0000 7f46be14b640 1 Processor -- start 2024-09-12T02:28:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.828+0000 7f46be14b640 1 -- start start 2024-09-12T02:28:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46be14b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46b80cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46be14b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46b80cc670 0x7f46b814a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46be14b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46b81f46f0 0x7f46b81e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46be14b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f46b80b24f0 con 0x7f46a00051c0 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46be14b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f46b80b2860 con 0x7f46b80cc670 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46be14b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f46b80cfe40 con 0x7f46b81f46f0 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46b77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46b80cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46b77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46b80cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41734/0 (socket says 172.21.15.181:41734) 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46b77fe640 1 -- 172.21.15.181:0/3659303248 learned_addr learned my addr 172.21.15.181:0/3659303248 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.829+0000 7f46b77fe640 1 -- 172.21.15.181:0/3659303248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46b81f46f0 msgr2=0x7f46b81e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f46b77fe640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46b81f46f0 0x7f46b81e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f46b77fe640 1 -- 172.21.15.181:0/3659303248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46b80cc670 msgr2=0x7f46b814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f46b77fe640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46b80cc670 0x7f46b814a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f46b77fe640 1 -- 172.21.15.181:0/3659303248 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80ccc30 con 0x7f46a00051c0 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f46b77fe640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46b80cdcd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f46a8001eb0 tx=0x7f46a800fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f469ffff640 1 -- 172.21.15.181:0/3659303248 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a801a070 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f469ffff640 1 -- 172.21.15.181:0/3659303248 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a8005320 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b80ccf10 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f469ffff640 1 -- 172.21.15.181:0/3659303248 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8007270 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.830+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b80cd4d0 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.831+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b80b73a0 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.831+0000 7f469ffff640 1 -- 172.21.15.181:0/3659303248 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46a801d070 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.832+0000 7f469ffff640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f46a406be30 0x7f46a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.832+0000 7f469ffff640 1 -- 172.21.15.181:0/3659303248 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f46a808a1e0 con 0x7f46a00051c0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.832+0000 7f46b6ffd640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f46a406be30 0x7f46a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.832+0000 7f46b6ffd640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f46a406be30 0x7f46a406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46b81f1910 tx=0x7f46ac009320 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:58.836+0000 7f469ffff640 1 -- 172.21.15.181:0/3659303248 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46a8058f70 con 0x7f46a00051c0 2024-09-12T02:28:59.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.070+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f46b814a5a0 con 0x7f46a00051c0 2024-09-12T02:28:59.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.073+0000 7f469ffff640 1 -- 172.21.15.181:0/3659303248 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f46a8058870 con 0x7f46a00051c0 2024-09-12T02:28:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f46a406be30 msgr2=0x7f46a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f46a406be30 0x7f46a406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46b81f1910 tx=0x7f46ac009320 comp rx=0 tx=0).stop 2024-09-12T02:28:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 msgr2=0x7f46b80cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46b80cdcd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f46a8001eb0 tx=0x7f46a800fa50 comp rx=0 tx=0).stop 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 shutdown_connections 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f46a406be30 0x7f46a406e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f46b80cc670 0x7f46b814a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46b81f46f0 0x7f46b81e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 --2- 172.21.15.181:0/3659303248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a00051c0 0x7f46b80cdcd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.075+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 >> 172.21.15.181:0/3659303248 conn(0x7f46b809d820 msgr2=0x7f46b80b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.076+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 shutdown_connections 2024-09-12T02:28:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.076+0000 7f46be14b640 1 -- 172.21.15.181:0/3659303248 wait complete. 2024-09-12T02:28:59.087 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:28:59.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.184+0000 7fc1c3cd0640 1 Processor -- start 2024-09-12T02:28:59.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.184+0000 7fc1c3cd0640 1 -- start start 2024-09-12T02:28:59.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c3cd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 0x7fc1bc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c3cd0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc1bc0ceaf0 0x7fc1bc0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c3cd0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1bc0731d0 con 0x7fc1bc15ea50 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c3cd0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc1bc0d0040 con 0x7fc1bc0ceaf0 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c3cd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc1bc0cf490 con 0x7fc1bc15e670 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c126b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc1bc0ceaf0 0x7fc1bc0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c126b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc1bc0ceaf0 0x7fc1bc0cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41736/0 (socket says 172.21.15.181:41736) 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.185+0000 7fc1c126b640 1 -- 172.21.15.181:0/438531366 learned_addr learned my addr 172.21.15.181:0/438531366 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.186+0000 7fc1c126b640 1 -- 172.21.15.181:0/438531366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 msgr2=0x7fc1bc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.186+0000 7fc1c126b640 1 --2- 172.21.15.181:0/438531366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 0x7fc1bc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.186+0000 7fc1c126b640 1 -- 172.21.15.181:0/438531366 >> v1:172.21.15.204:6789/0 conn(0x7fc1bc15ea50 legacy=0x7fc1bc15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:59.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.186+0000 7fc1c126b640 1 -- 172.21.15.181:0/438531366 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1bc0734b0 con 0x7fc1bc0ceaf0 2024-09-12T02:28:59.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.186+0000 7fc1c126b640 1 --2- 172.21.15.181:0/438531366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc0ceaf0 0x7fc1bc0cef50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009870 tx=0x7fc1b002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdc310da4c0c7b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:59.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c0a6a640 1 -- 172.21.15.181:0/438531366 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0037070 con 0x7fc1bc0ceaf0 2024-09-12T02:28:59.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c0a6a640 1 -- 172.21.15.181:0/438531366 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b0032440 con 0x7fc1bc0ceaf0 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c0a6a640 1 -- 172.21.15.181:0/438531366 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0032810 con 0x7fc1bc0ceaf0 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/438531366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc0ceaf0 msgr2=0x7fc1bc0cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/438531366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc0ceaf0 0x7fc1bc0cef50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009870 tx=0x7fc1b002a2a0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/438531366 shutdown_connections 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/438531366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc0ceaf0 0x7fc1bc0cef50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/438531366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 0x7fc1bc070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/438531366 >> 172.21.15.181:0/438531366 conn(0x7fc1bc06f400 msgr2=0x7fc1bc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/438531366 shutdown_connections 2024-09-12T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.187+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/438531366 wait complete. 2024-09-12T02:28:59.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.188+0000 7fc1c3cd0640 1 Processor -- start 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.188+0000 7fc1c3cd0640 1 -- start start 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c3cd0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1bc0ceaf0 0x7fc1bc150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c3cd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 0x7fc1bc154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c3cd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc15ea50 0x7fc1bc1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c3cd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc073de0 con 0x7fc1bc15ea50 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c3cd0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc072f80 con 0x7fc1bc0ceaf0 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c3cd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc1bc073a70 con 0x7fc1bc15e670 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc15ea50 0x7fc1bc1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc15ea50 0x7fc1bc1504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41738/0 (socket says 172.21.15.181:41738) 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 -- 172.21.15.181:0/328263761 learned_addr learned my addr 172.21.15.181:0/328263761 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c126b640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 0x7fc1bc154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c1a6c640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1bc0ceaf0 0x7fc1bc150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 -- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 msgr2=0x7fc1bc154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 0x7fc1bc154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 -- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1bc0ceaf0 msgr2=0x7fc1bc150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1bc0ceaf0 0x7fc1bc150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.189+0000 7fc1c226d640 1 -- 172.21.15.181:0/328263761 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1bc1551b0 con 0x7fc1bc15ea50 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.190+0000 7fc1c226d640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc15ea50 0x7fc1bc1504f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400b970 tx=0x7fc1b400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.190+0000 7fc1ba7fc640 1 -- 172.21.15.181:0/328263761 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4019070 con 0x7fc1bc15ea50 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.190+0000 7fc1ba7fc640 1 -- 172.21.15.181:0/328263761 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b400cae0 con 0x7fc1bc15ea50 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.190+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1bc150a30 con 0x7fc1bc15ea50 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.190+0000 7fc1ba7fc640 1 -- 172.21.15.181:0/328263761 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4014440 con 0x7fc1bc15ea50 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.190+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1bc151520 con 0x7fc1bc15ea50 2024-09-12T02:28:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.191+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1bc071410 con 0x7fc1bc15ea50 2024-09-12T02:28:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.191+0000 7fc1ba7fc640 1 -- 172.21.15.181:0/328263761 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1b401c070 con 0x7fc1bc15ea50 2024-09-12T02:28:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.192+0000 7fc1ba7fc640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc1a806be30 0x7fc1a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.192+0000 7fc1ba7fc640 1 -- 172.21.15.181:0/328263761 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fc1b408a710 con 0x7fc1bc15ea50 2024-09-12T02:28:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.192+0000 7fc1c1a6c640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc1a806be30 0x7fc1a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.192+0000 7fc1c1a6c640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc1a806be30 0x7fc1a806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009990 tx=0x7fc1ac009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:59.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.196+0000 7fc1ba7fc640 1 -- 172.21.15.181:0/328263761 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1b4058d30 con 0x7fc1bc15ea50 2024-09-12T02:28:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.364+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc1bc0b6990 con 0x7fc1bc15ea50 2024-09-12T02:28:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.364+0000 7fc1ba7fc640 1 -- 172.21.15.181:0/328263761 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7fc1b405d030 con 0x7fc1bc15ea50 2024-09-12T02:28:59.365 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:28:59.365 INFO:teuthology.orchestra.run.smithi181.stdout:[ 2024-09-12T02:28:59.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:28:59.365 INFO:teuthology.orchestra.run.smithi181.stdout: "poolnum": 1, 2024-09-12T02:28:59.365 INFO:teuthology.orchestra.run.smithi181.stdout: "poolname": ".mgr" 2024-09-12T02:28:59.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:28:59.366 INFO:teuthology.orchestra.run.smithi181.stdout:] 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc1a806be30 msgr2=0x7fc1a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc1a806be30 0x7fc1a806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009990 tx=0x7fc1ac009110 comp rx=0 tx=0).stop 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc15ea50 msgr2=0x7fc1bc1504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc15ea50 0x7fc1bc1504f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400b970 tx=0x7fc1b400bd70 comp rx=0 tx=0).stop 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 shutdown_connections 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc1a806be30 0x7fc1a806e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1bc15ea50 0x7fc1bc1504f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1bc15e670 0x7fc1bc154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 --2- 172.21.15.181:0/328263761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1bc0ceaf0 0x7fc1bc150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 >> 172.21.15.181:0/328263761 conn(0x7fc1bc06f400 msgr2=0x7fc1bc15eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 shutdown_connections 2024-09-12T02:28:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.366+0000 7fc1c3cd0640 1 -- 172.21.15.181:0/328263761 wait complete. 2024-09-12T02:28:59.378 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:28:59.378 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:28:59.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.480+0000 7fb84e923640 1 Processor -- start 2024-09-12T02:28:59.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.480+0000 7fb84e923640 1 -- start start 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.480+0000 7fb84e923640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb84815c470 0x7fb8480d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.480+0000 7fb84e923640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 0x7fb8480d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.480+0000 7fb84e923640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb848073410 con 0x7fb8480ce9d0 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.480+0000 7fb84e923640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb8480d0fe0 con 0x7fb84815c470 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.480+0000 7fb84e923640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb8480731c0 con 0x7fb8480b6af0 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb8477fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb8480ce9d0 0x7fb8480709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51592/0 (socket says 172.21.15.181:51592) 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb8477fe640 1 -- 172.21.15.181:0/1083858625 learned_addr learned my addr 172.21.15.181:0/1083858625 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb847fff640 1 --2- 172.21.15.181:0/1083858625 >> v2:172.21.15.204:3300/0 conn(0x7fb84815c470 0x7fb8480d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb84cec0640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 0x7fb8480d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195016065 0 0) 0x7fb848073410 con 0x7fb8480ce9d0 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb830003520 con 0x7fb8480ce9d0 2024-09-12T02:28:59.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 268773431 0 0) 0x7fb830003520 con 0x7fb8480ce9d0 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 msgr2=0x7fb8480d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 0x7fb8480d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 >> v2:172.21.15.204:3300/0 conn(0x7fb84815c470 msgr2=0x7fb8480d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 --2- 172.21.15.181:0/1083858625 >> v2:172.21.15.204:3300/0 conn(0x7fb84815c470 0x7fb8480d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8480736f0 con 0x7fb8480ce9d0 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fb83c0017f0 con 0x7fb8480ce9d0 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 >> v1:172.21.15.181:6789/0 conn(0x7fb8480ce9d0 legacy=0x7fb8480709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb830003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb830004800 0x7fb830004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 0x7fb8300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb8480731c0 con 0x7fb8300039b0 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb83000b9c0 con 0x7fb830004800 2024-09-12T02:28:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb83000bb40 con 0x7fb8480b6af0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb847fff640 1 --2- 172.21.15.181:0/1083858625 >> v2:172.21.15.204:3300/0 conn(0x7fb84815c470 0x7fb8480d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb847fff640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb830003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb8477fe640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb830004800 0x7fb830004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.481+0000 7fb84cec0640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 0x7fb8300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb847fff640 1 -- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 msgr2=0x7fb8300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb847fff640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8480b6af0 0x7fb8300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb847fff640 1 -- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb830004800 msgr2=0x7fb830004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb847fff640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb830004800 0x7fb830004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb847fff640 1 -- 172.21.15.181:0/1083858625 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb830003520 con 0x7fb8300039b0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb847fff640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb830003dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb838009c70 tx=0x7fb830005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53d5e668b0f2859 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838009840 con 0x7fb8300039b0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb838004020 con 0x7fb8300039b0 2024-09-12T02:28:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.482+0000 7fb846ffd640 1 -- 172.21.15.181:0/1083858625 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380043d0 con 0x7fb8300039b0 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.483+0000 7fb84e923640 1 -- 172.21.15.181:0/1083858625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 msgr2=0x7fb830003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.483+0000 7fb84e923640 1 --2- 172.21.15.181:0/1083858625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb830003dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb838009c70 tx=0x7fb830005830 comp rx=0 tx=0).stop 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.483+0000 7fb84cec0640 1 -- 172.21.15.181:0/1083858625 reap_dead start 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.483+0000 7fb84e923640 1 -- 172.21.15.181:0/1083858625 shutdown_connections 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.483+0000 7fb84e923640 1 -- 172.21.15.181:0/1083858625 >> 172.21.15.181:0/1083858625 conn(0x7fb84806f400 msgr2=0x7fb84806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.483+0000 7fb84e923640 1 -- 172.21.15.181:0/1083858625 shutdown_connections 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.483+0000 7fb84e923640 1 -- 172.21.15.181:0/1083858625 wait complete. 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.484+0000 7fb84e923640 1 Processor -- start 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.484+0000 7fb84e923640 1 -- start start 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb84e923640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb848154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb84e923640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8481f2980 0x7fb8481440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb84e923640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8481e4030 0x7fb8481e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb84e923640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb848073f90 con 0x7fb8300039b0 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb84e923640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb848073cb0 con 0x7fb8481e4030 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb84e923640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb84815c850 con 0x7fb8481f2980 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb847fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb848154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb847fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb848154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53506/0 (socket says 172.21.15.181:53506) 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.485+0000 7fb847fff640 1 -- 172.21.15.181:0/1992566261 learned_addr learned my addr 172.21.15.181:0/1992566261 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb847fff640 1 -- 172.21.15.181:0/1992566261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8481f2980 msgr2=0x7fb8481440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb847fff640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8481f2980 0x7fb8481440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb847fff640 1 -- 172.21.15.181:0/1992566261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8481e4030 msgr2=0x7fb8481e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb847fff640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8481e4030 0x7fb8481e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb847fff640 1 -- 172.21.15.181:0/1992566261 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8481f2e00 con 0x7fb8300039b0 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb847fff640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb848154bc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb838033040 tx=0x7fb838004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:59.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb844ff9640 1 -- 172.21.15.181:0/1992566261 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838040070 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb844ff9640 1 -- 172.21.15.181:0/1992566261 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb838003820 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8481552a0 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb844ff9640 1 -- 172.21.15.181:0/1992566261 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838006e10 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.486+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb848155860 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.487+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8480cfda0 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.487+0000 7fb844ff9640 1 -- 172.21.15.181:0/1992566261 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb838043070 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.488+0000 7fb844ff9640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb83406be60 0x7fb83406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.488+0000 7fb8477fe640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb83406be60 0x7fb83406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.488+0000 7fb844ff9640 1 -- 172.21.15.181:0/1992566261 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb8380ab1b0 con 0x7fb8300039b0 2024-09-12T02:28:59.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.488+0000 7fb8477fe640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb83406be60 0x7fb83406e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0011d0 tx=0x7fb83c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:59.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.492+0000 7fb844ff9640 1 -- 172.21.15.181:0/1992566261 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb838079eb0 con 0x7fb8300039b0 2024-09-12T02:28:59.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:28:59.659+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb8480715e0 con 0x7fb8300039b0 2024-09-12T02:29:00.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.577+0000 7fb844ff9640 1 -- 172.21.15.181:0/1992566261 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7fb8380797b0 con 0x7fb8300039b0 2024-09-12T02:29:00.579 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' created 2024-09-12T02:29:00.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb83406be60 msgr2=0x7fb83406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb83406be60 0x7fb83406e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0011d0 tx=0x7fb83c009040 comp rx=0 tx=0).stop 2024-09-12T02:29:00.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 msgr2=0x7fb848154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb848154bc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb838033040 tx=0x7fb838004730 comp rx=0 tx=0).stop 2024-09-12T02:29:00.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 shutdown_connections 2024-09-12T02:29:00.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb83406be60 0x7fb83406e320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8481e4030 0x7fb8481e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8481f2980 0x7fb8481440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.580+0000 7fb84e923640 1 --2- 172.21.15.181:0/1992566261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8300039b0 0x7fb848154bc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.581+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 >> 172.21.15.181:0/1992566261 conn(0x7fb84806f400 msgr2=0x7fb84806f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:00.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.581+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 shutdown_connections 2024-09-12T02:29:00.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.581+0000 7fb84e923640 1 -- 172.21.15.181:0/1992566261 wait complete. 2024-09-12T02:29:00.599 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:29:00.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.709+0000 7ff839edd640 1 Processor -- start 2024-09-12T02:29:00.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.709+0000 7ff839edd640 1 -- start start 2024-09-12T02:29:00.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff839edd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff8340b4b60 0x7ff8340cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff839edd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8340cfff0 0x7ff834160080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff839edd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8340b5020 con 0x7ff834158d90 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff839edd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff8340b5300 con 0x7ff8340b4b60 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff839edd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff8340b55e0 con 0x7ff8340cfff0 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff8337fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff834158d90 0x7ff83415f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51596/0 (socket says 172.21.15.181:51596) 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff8337fe640 1 -- 172.21.15.181:0/2593457966 learned_addr learned my addr 172.21.15.181:0/2593457966 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.710+0000 7ff832ffd640 1 --2- 172.21.15.181:0/2593457966 >> v2:172.21.15.181:3300/0 conn(0x7ff8340b4b60 0x7ff8340cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff8327fc640 1 -- 172.21.15.181:0/2593457966 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3551884503 0 0) 0x7ff8340b5020 con 0x7ff834158d90 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff8327fc640 1 -- 172.21.15.181:0/2593457966 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff81c003520 con 0x7ff834158d90 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff833fff640 1 --2- 172.21.15.181:0/2593457966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8340cfff0 0x7ff834160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff832ffd640 1 -- 172.21.15.181:0/2593457966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8340cfff0 msgr2=0x7ff834160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff832ffd640 1 --2- 172.21.15.181:0/2593457966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8340cfff0 0x7ff834160080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff832ffd640 1 -- 172.21.15.181:0/2593457966 >> v1:172.21.15.181:6789/0 conn(0x7ff834158d90 legacy=0x7ff83415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff832ffd640 1 -- 172.21.15.181:0/2593457966 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8340b58c0 con 0x7ff8340b4b60 2024-09-12T02:29:00.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.711+0000 7ff832ffd640 1 --2- 172.21.15.181:0/2593457966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340b4b60 0x7ff8340cfab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff8280097a0 tx=0x7ff82802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556c9cb7c598d369 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:00.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff8327fc640 1 -- 172.21.15.181:0/2593457966 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828037070 con 0x7ff8340b4b60 2024-09-12T02:29:00.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff8327fc640 1 -- 172.21.15.181:0/2593457966 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff828032440 con 0x7ff8340b4b60 2024-09-12T02:29:00.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff8327fc640 1 -- 172.21.15.181:0/2593457966 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828032810 con 0x7ff8340b4b60 2024-09-12T02:29:00.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 -- 172.21.15.181:0/2593457966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340b4b60 msgr2=0x7ff8340cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 --2- 172.21.15.181:0/2593457966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340b4b60 0x7ff8340cfab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff8280097a0 tx=0x7ff82802a180 comp rx=0 tx=0).stop 2024-09-12T02:29:00.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 -- 172.21.15.181:0/2593457966 shutdown_connections 2024-09-12T02:29:00.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 --2- 172.21.15.181:0/2593457966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8340cfff0 0x7ff834160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 --2- 172.21.15.181:0/2593457966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340b4b60 0x7ff8340cfab0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 -- 172.21.15.181:0/2593457966 >> 172.21.15.181:0/2593457966 conn(0x7ff8340b1600 msgr2=0x7ff8340b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 -- 172.21.15.181:0/2593457966 shutdown_connections 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.712+0000 7ff839edd640 1 -- 172.21.15.181:0/2593457966 wait complete. 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.713+0000 7ff839edd640 1 Processor -- start 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff839edd640 1 -- start start 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff839edd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8340b4b60 0x7ff834159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff839edd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340cfff0 0x7ff8341570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff839edd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff834158d90 0x7ff834156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff839edd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff834160740 con 0x7ff8340cfff0 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff839edd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff8341605c0 con 0x7ff8340b4b60 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff839edd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff8341608c0 con 0x7ff834158d90 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff832ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340cfff0 0x7ff8341570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff832ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340cfff0 0x7ff8341570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53518/0 (socket says 172.21.15.181:53518) 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.714+0000 7ff832ffd640 1 -- 172.21.15.181:0/3671055173 learned_addr learned my addr 172.21.15.181:0/3671055173 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff833fff640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff834158d90 0x7ff834156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff8337fe640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8340b4b60 0x7ff834159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff832ffd640 1 -- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff834158d90 msgr2=0x7ff834156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff832ffd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff834158d90 0x7ff834156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff832ffd640 1 -- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8340b4b60 msgr2=0x7ff834159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff832ffd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8340b4b60 0x7ff834159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff832ffd640 1 -- 172.21.15.181:0/3671055173 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83415a190 con 0x7ff8340cfff0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff832ffd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340cfff0 0x7ff8341570a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff828035040 tx=0x7ff8280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff81bfff640 1 -- 172.21.15.181:0/3671055173 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828041020 con 0x7ff8340cfff0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff81bfff640 1 -- 172.21.15.181:0/3671055173 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff828030700 con 0x7ff8340cfff0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff81bfff640 1 -- 172.21.15.181:0/3671055173 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828037040 con 0x7ff8340cfff0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83415a470 con 0x7ff8340cfff0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.715+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83415aa30 con 0x7ff8340cfff0 2024-09-12T02:29:00.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.716+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff834161ed0 con 0x7ff8340cfff0 2024-09-12T02:29:00.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.717+0000 7ff81bfff640 1 -- 172.21.15.181:0/3671055173 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff828044020 con 0x7ff8340cfff0 2024-09-12T02:29:00.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.717+0000 7ff81bfff640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff82006be60 0x7ff82006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.717+0000 7ff81bfff640 1 -- 172.21.15.181:0/3671055173 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7ff8280ab3e0 con 0x7ff8340cfff0 2024-09-12T02:29:00.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.717+0000 7ff8337fe640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff82006be60 0x7ff82006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.718+0000 7ff8337fe640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff82006be60 0x7ff82006e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff824005880 tx=0x7ff824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:00.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.722+0000 7ff81bfff640 1 -- 172.21.15.181:0/3671055173 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff82804b030 con 0x7ff8340cfff0 2024-09-12T02:29:00.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:00.890+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff834157820 con 0x7ff8340cfff0 2024-09-12T02:29:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.580+0000 7ff81bfff640 1 -- 172.21.15.181:0/3671055173 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7ff82807a000 con 0x7ff8340cfff0 2024-09-12T02:29:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' created 2024-09-12T02:29:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff82006be60 msgr2=0x7ff82006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff82006be60 0x7ff82006e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff824005880 tx=0x7ff824009040 comp rx=0 tx=0).stop 2024-09-12T02:29:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340cfff0 msgr2=0x7ff8341570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340cfff0 0x7ff8341570a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff828035040 tx=0x7ff8280046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 shutdown_connections 2024-09-12T02:29:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff82006be60 0x7ff82006e320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff834158d90 0x7ff834156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8340cfff0 0x7ff8341570a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 --2- 172.21.15.181:0/3671055173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8340b4b60 0x7ff834159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 >> 172.21.15.181:0/3671055173 conn(0x7ff8340b1600 msgr2=0x7ff8340ab790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 shutdown_connections 2024-09-12T02:29:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.583+0000 7ff839edd640 1 -- 172.21.15.181:0/3671055173 wait complete. 2024-09-12T02:29:01.606 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:29:01.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.707+0000 7ff98298f640 1 Processor -- start 2024-09-12T02:29:01.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.707+0000 7ff98298f640 1 -- start start 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff98298f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 0x7ff97c0b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff98298f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97c15fae0 con 0x7ff97c0b0990 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff98298f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97c15ef60 con 0x7ff97c06bc10 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff98298f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c15f240 con 0x7ff97c0b5030 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff97bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff97c0b0990 0x7ff97c0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51598/0 (socket says 172.21.15.181:51598) 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff97bfff640 1 -- 172.21.15.181:0/1669002328 learned_addr learned my addr 172.21.15.181:0/1669002328 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff97b7fe640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 0x7ff97c0b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033174775 0 0) 0x7ff97c15fae0 con 0x7ff97c0b0990 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.708+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff964003520 con 0x7ff97c0b0990 2024-09-12T02:29:01.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3987036157 0 0) 0x7ff964003520 con 0x7ff97c0b0990 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 msgr2=0x7ff97c0b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 0x7ff97c0b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 >> v1:172.21.15.204:6789/0 conn(0x7ff97c06bc10 legacy=0x7ff97c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c15f520 con 0x7ff97c0b0990 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7ff96c001670 con 0x7ff97c0b0990 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 >> v1:172.21.15.181:6789/0 conn(0x7ff97c0b0990 legacy=0x7ff97c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 0x7ff9640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff964003f20 0x7ff964004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff964004d40 0x7ff9640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c15f240 con 0x7ff964004d40 2024-09-12T02:29:01.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff96400bb80 con 0x7ff964003f20 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff96400bd80 con 0x7ff97c0b5030 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff980f2c640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff964004d40 0x7ff9640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97b7fe640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff964003f20 0x7ff964004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff97bfff640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 0x7ff9640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff980f2c640 1 -- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 msgr2=0x7ff9640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff980f2c640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff97c0b5030 0x7ff9640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff980f2c640 1 -- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff964003f20 msgr2=0x7ff964004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff980f2c640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff964003f20 0x7ff964004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.709+0000 7ff980f2c640 1 -- 172.21.15.181:0/1669002328 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff964003520 con 0x7ff964004d40 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff980f2c640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff964004d40 0x7ff9640051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff974001f60 tx=0x7ff964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd8ad092d2ea1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974001b30 con 0x7ff964004d40 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974031620 con 0x7ff964004d40 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff97affd640 1 -- 172.21.15.181:0/1669002328 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974031a10 con 0x7ff964004d40 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff98298f640 1 -- 172.21.15.181:0/1669002328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff964004d40 msgr2=0x7ff9640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:01.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff98298f640 1 --2- 172.21.15.181:0/1669002328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff964004d40 0x7ff9640051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff974001f60 tx=0x7ff964005830 comp rx=0 tx=0).stop 2024-09-12T02:29:01.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff980f2c640 1 -- 172.21.15.181:0/1669002328 reap_dead start 2024-09-12T02:29:01.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff98298f640 1 -- 172.21.15.181:0/1669002328 shutdown_connections 2024-09-12T02:29:01.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.710+0000 7ff98298f640 1 -- 172.21.15.181:0/1669002328 >> 172.21.15.181:0/1669002328 conn(0x7ff97c0b30f0 msgr2=0x7ff97c0b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:01.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.711+0000 7ff98298f640 1 -- 172.21.15.181:0/1669002328 shutdown_connections 2024-09-12T02:29:01.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.711+0000 7ff98298f640 1 -- 172.21.15.181:0/1669002328 wait complete. 2024-09-12T02:29:01.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.712+0000 7ff98298f640 1 Processor -- start 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.712+0000 7ff98298f640 1 -- start start 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff964004d40 0x7ff97c1f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff97c1f1610 0x7ff97c1f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97c073680 0x7ff97c073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c15eb30 con 0x7ff97c073680 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c0b0d70 con 0x7ff97c1f1610 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c15ecb0 con 0x7ff964004d40 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97c073680 0x7ff97c073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97c073680 0x7ff97c073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53536/0 (socket says 172.21.15.181:53536) 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff97bfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff964004d40 0x7ff97c1f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 -- 172.21.15.181:0/3570405273 learned_addr learned my addr 172.21.15.181:0/3570405273 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff97b7fe640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff97c1f1610 0x7ff97c1f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 -- 172.21.15.181:0/3570405273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff964004d40 msgr2=0x7ff97c1f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff964004d40 0x7ff97c1f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 -- 172.21.15.181:0/3570405273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff97c1f1610 msgr2=0x7ff97c1f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff97c1f1610 0x7ff97c1f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 -- 172.21.15.181:0/3570405273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c1f50d0 con 0x7ff97c073680 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff980f2c640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97c073680 0x7ff97c073b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff974002050 tx=0x7ff9740015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff978ff9640 1 -- 172.21.15.181:0/3570405273 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974006d60 con 0x7ff97c073680 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff978ff9640 1 -- 172.21.15.181:0/3570405273 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9740317d0 con 0x7ff97c073680 2024-09-12T02:29:01.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c147bb0 con 0x7ff97c073680 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff978ff9640 1 -- 172.21.15.181:0/3570405273 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974031ba0 con 0x7ff97c073680 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.713+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c148170 con 0x7ff97c073680 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.714+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97c0b5c50 con 0x7ff97c073680 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.715+0000 7ff978ff9640 1 -- 172.21.15.181:0/3570405273 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff974044020 con 0x7ff97c073680 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.715+0000 7ff978ff9640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff96806be60 0x7ff96806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.715+0000 7ff978ff9640 1 -- 172.21.15.181:0/3570405273 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7ff9740ab230 con 0x7ff97c073680 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.715+0000 7ff97bfff640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff96806be60 0x7ff96806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.716+0000 7ff97bfff640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff96806be60 0x7ff96806e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0010e0 tx=0x7ff96c001c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.720+0000 7ff978ff9640 1 -- 172.21.15.181:0/3570405273 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff974079560 con 0x7ff97c073680 2024-09-12T02:29:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:01.920+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff97c0723b0 con 0x7ff97c073680 2024-09-12T02:29:02.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.605+0000 7ff978ff9640 1 -- 172.21.15.181:0/3570405273 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7ff97407d860 con 0x7ff97c073680 2024-09-12T02:29:02.606 INFO:teuthology.orchestra.run.smithi181.stderr:new fs with metadata pool 4 and data pool 5 2024-09-12T02:29:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.610+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff96806be60 msgr2=0x7ff96806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.610+0000 7ff98298f640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff96806be60 0x7ff96806e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0010e0 tx=0x7ff96c001c30 comp rx=0 tx=0).stop 2024-09-12T02:29:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.610+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97c073680 msgr2=0x7ff97c073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.610+0000 7ff98298f640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97c073680 0x7ff97c073b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff974002050 tx=0x7ff9740015b0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.611+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 shutdown_connections 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.611+0000 7ff98298f640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff96806be60 0x7ff96806e320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.611+0000 7ff98298f640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff97c1f1610 0x7ff97c1f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.611+0000 7ff98298f640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97c073680 0x7ff97c073b30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.611+0000 7ff98298f640 1 --2- 172.21.15.181:0/3570405273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff964004d40 0x7ff97c1f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.612+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 >> 172.21.15.181:0/3570405273 conn(0x7ff97c0b30f0 msgr2=0x7ff97c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.612+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 shutdown_connections 2024-09-12T02:29:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.612+0000 7ff98298f640 1 -- 172.21.15.181:0/3570405273 wait complete. 2024-09-12T02:29:02.633 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:02.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.732+0000 7fa848542640 1 Processor -- start 2024-09-12T02:29:02.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.732+0000 7fa848542640 1 -- start start 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa848542640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa8400cf200 0x7fa8400cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa848542640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8400ce430 con 0x7fa8400ce020 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa848542640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8400cf780 con 0x7fa8400afc70 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa848542640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa8400cfa60 con 0x7fa8400cf200 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa846adf640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa8400ce020 0x7fa840154c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51608/0 (socket says 172.21.15.181:51608) 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa846adf640 1 -- 172.21.15.181:0/2118812469 learned_addr learned my addr 172.21.15.181:0/2118812469 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 664388021 0 0) 0x7fa838001490 con 0x7fa8400ce020 2024-09-12T02:29:02.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa845add640 1 --2- 172.21.15.181:0/2118812469 >> v2:172.21.15.204:3300/0 conn(0x7fa8400cf200 0x7fa8400cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa82c003520 con 0x7fa8400ce020 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1526960408 0 0) 0x7fa82c003520 con 0x7fa8400ce020 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 >> v2:172.21.15.204:3300/0 conn(0x7fa8400cf200 msgr2=0x7fa8400cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 --2- 172.21.15.181:0/2118812469 >> v2:172.21.15.204:3300/0 conn(0x7fa8400cf200 0x7fa8400cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 >> v1:172.21.15.204:6789/0 conn(0x7fa8400afc70 legacy=0x7fa84015f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8400cfd40 con 0x7fa8400ce020 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fa838001bc0 con 0x7fa8400ce020 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 >> v1:172.21.15.181:6789/0 conn(0x7fa8400ce020 legacy=0x7fa840154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c0039b0 0x7fa82c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c004800 0x7fa82c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c0051c0 0x7fa82c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa8400cfa60 con 0x7fa82c004800 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c00c060 con 0x7fa82c0051c0 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.733+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c00c260 con 0x7fa82c0039b0 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa845add640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c004800 0x7fa82c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa8462de640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c0039b0 0x7fa82c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa846adf640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c0051c0 0x7fa82c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa845add640 1 -- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c0039b0 msgr2=0x7fa82c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa845add640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c0039b0 0x7fa82c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa845add640 1 -- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c0051c0 msgr2=0x7fa82c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa845add640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa82c0051c0 0x7fa82c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa845add640 1 -- 172.21.15.181:0/2118812469 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c003520 con 0x7fa82c004800 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa8462de640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c0039b0 0x7fa82c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa846adf640 1 -- 172.21.15.181:0/2118812469 reap_dead start 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.734+0000 7fa845add640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c004800 0x7fa82c004c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa830009ac0 tx=0x7fa82c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baa4f7645e50a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830036070 con 0x7fa82c004800 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa830031400 con 0x7fa82c004800 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa8452dc640 1 -- 172.21.15.181:0/2118812469 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830009690 con 0x7fa82c004800 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa848542640 1 -- 172.21.15.181:0/2118812469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c004800 msgr2=0x7fa82c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa848542640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c004800 0x7fa82c004c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa830009ac0 tx=0x7fa82c005830 comp rx=0 tx=0).stop 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa848542640 1 -- 172.21.15.181:0/2118812469 shutdown_connections 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa848542640 1 --2- 172.21.15.181:0/2118812469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa82c004800 0x7fa82c004c80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa848542640 1 -- 172.21.15.181:0/2118812469 >> 172.21.15.181:0/2118812469 conn(0x7fa8400b1770 msgr2=0x7fa8400b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa848542640 1 -- 172.21.15.181:0/2118812469 shutdown_connections 2024-09-12T02:29:02.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.735+0000 7fa848542640 1 -- 172.21.15.181:0/2118812469 wait complete. 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.736+0000 7fa848542640 1 Processor -- start 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.736+0000 7fa848542640 1 -- start start 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa848542640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c004800 0x7fa8400af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa848542640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8400ab450 0x7fa840154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa848542640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa840161090 0x7fa840161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa848542640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa8400b0050 con 0x7fa8400ab450 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa848542640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa8400d0300 con 0x7fa840161090 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa848542640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa8400b01d0 con 0x7fa82c004800 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8400ab450 0x7fa840154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8400ab450 0x7fa840154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53550/0 (socket says 172.21.15.181:53550) 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 -- 172.21.15.181:0/3862009277 learned_addr learned my addr 172.21.15.181:0/3862009277 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa8462de640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c004800 0x7fa8400af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa846adf640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa840161090 0x7fa840161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 -- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c004800 msgr2=0x7fa8400af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c004800 0x7fa8400af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 -- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa840161090 msgr2=0x7fa840161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa840161090 0x7fa840161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.737+0000 7fa845add640 1 -- 172.21.15.181:0/3862009277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8401608e0 con 0x7fa8400ab450 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.738+0000 7fa845add640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8400ab450 0x7fa840154400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa830034040 tx=0x7fa830004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.738+0000 7fa836ffd640 1 -- 172.21.15.181:0/3862009277 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83003f020 con 0x7fa8400ab450 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.738+0000 7fa836ffd640 1 -- 172.21.15.181:0/3862009277 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa830037040 con 0x7fa8400ab450 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.738+0000 7fa836ffd640 1 -- 172.21.15.181:0/3862009277 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830036070 con 0x7fa8400ab450 2024-09-12T02:29:02.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.738+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8401e7e40 con 0x7fa8400ab450 2024-09-12T02:29:02.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.738+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa840160bc0 con 0x7fa8400ab450 2024-09-12T02:29:02.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.739+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8401588b0 con 0x7fa8400ab450 2024-09-12T02:29:02.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.739+0000 7fa836ffd640 1 -- 172.21.15.181:0/3862009277 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa830042020 con 0x7fa8400ab450 2024-09-12T02:29:02.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.740+0000 7fa836ffd640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa82406be30 0x7fa82406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.740+0000 7fa836ffd640 1 -- 172.21.15.181:0/3862009277 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa8300aaf80 con 0x7fa8400ab450 2024-09-12T02:29:02.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.740+0000 7fa8462de640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa82406be30 0x7fa82406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.740+0000 7fa8462de640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa82406be30 0x7fa82406e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000c00 tx=0x7fa83c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.744+0000 7fa836ffd640 1 -- 172.21.15.181:0/3862009277 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa830049030 con 0x7fa8400ab450 2024-09-12T02:29:02.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.909+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa84015eb10 con 0x7fa8400ab450 2024-09-12T02:29:02.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.910+0000 7fa836ffd640 1 -- 172.21.15.181:0/3862009277 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16814 (secure 0 0 0) 0x7fa8300799f0 con 0x7fa8400ab450 2024-09-12T02:29:02.911 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:02.911 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":31,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:01.921783+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:59.678168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:00.909444+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:02.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.912+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa82406be30 msgr2=0x7fa82406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.912+0000 7fa848542640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa82406be30 0x7fa82406e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000c00 tx=0x7fa83c009040 comp rx=0 tx=0).stop 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.912+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8400ab450 msgr2=0x7fa840154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.912+0000 7fa848542640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8400ab450 0x7fa840154400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa830034040 tx=0x7fa830004730 comp rx=0 tx=0).stop 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 shutdown_connections 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa82406be30 0x7fa82406e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa840161090 0x7fa840161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8400ab450 0x7fa840154400 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 --2- 172.21.15.181:0/3862009277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa82c004800 0x7fa8400af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 >> 172.21.15.181:0/3862009277 conn(0x7fa8400b1770 msgr2=0x7fa840072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 shutdown_connections 2024-09-12T02:29:02.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:02.913+0000 7fa848542640 1 -- 172.21.15.181:0/3862009277 wait complete. 2024-09-12T02:29:02.924 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:03.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.023+0000 7fd969352640 1 Processor -- start 2024-09-12T02:29:03.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.023+0000 7fd969352640 1 -- start start 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd969352640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd96415e640 0x7fd9640ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd969352640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd96415ea20 con 0x7fd9640d3660 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd969352640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9640b1c50 con 0x7fd9640cf0e0 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd969352640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd9640b2860 con 0x7fd96415e640 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd9637fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd9640d3660 0x7fd9640b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51612/0 (socket says 172.21.15.181:51612) 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd9637fe640 1 -- 172.21.15.181:0/2680205370 learned_addr learned my addr 172.21.15.181:0/2680205370 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd962ffd640 1 --2- 172.21.15.181:0/2680205370 >> v2:172.21.15.204:3300/0 conn(0x7fd96415e640 0x7fd9640ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd9627fc640 1 -- 172.21.15.181:0/2680205370 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914396990 0 0) 0x7fd96415ea20 con 0x7fd9640d3660 2024-09-12T02:29:03.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd9627fc640 1 -- 172.21.15.181:0/2680205370 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd950003520 con 0x7fd9640d3660 2024-09-12T02:29:03.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd962ffd640 1 -- 172.21.15.181:0/2680205370 >> v1:172.21.15.204:6789/0 conn(0x7fd9640cf0e0 legacy=0x7fd9640b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd962ffd640 1 -- 172.21.15.181:0/2680205370 >> v1:172.21.15.181:6789/0 conn(0x7fd9640d3660 legacy=0x7fd9640b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.024+0000 7fd962ffd640 1 -- 172.21.15.181:0/2680205370 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9640b1f30 con 0x7fd96415e640 2024-09-12T02:29:03.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.025+0000 7fd962ffd640 1 --2- 172.21.15.181:0/2680205370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 0x7fd9640ceba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9540097a0 tx=0x7fd95402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b0b35ca6def4c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.025+0000 7fd9627fc640 1 -- 172.21.15.181:0/2680205370 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954037070 con 0x7fd96415e640 2024-09-12T02:29:03.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.025+0000 7fd9627fc640 1 -- 172.21.15.181:0/2680205370 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd954032440 con 0x7fd96415e640 2024-09-12T02:29:03.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.025+0000 7fd9627fc640 1 -- 172.21.15.181:0/2680205370 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9540327f0 con 0x7fd96415e640 2024-09-12T02:29:03.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.026+0000 7fd969352640 1 -- 172.21.15.181:0/2680205370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 msgr2=0x7fd9640ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.026+0000 7fd969352640 1 --2- 172.21.15.181:0/2680205370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 0x7fd9640ceba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9540097a0 tx=0x7fd95402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.026+0000 7fd969352640 1 -- 172.21.15.181:0/2680205370 shutdown_connections 2024-09-12T02:29:03.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.026+0000 7fd969352640 1 --2- 172.21.15.181:0/2680205370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 0x7fd9640ceba0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.026+0000 7fd969352640 1 -- 172.21.15.181:0/2680205370 >> 172.21.15.181:0/2680205370 conn(0x7fd96409d820 msgr2=0x7fd9640d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:03.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.026+0000 7fd969352640 1 -- 172.21.15.181:0/2680205370 shutdown_connections 2024-09-12T02:29:03.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.026+0000 7fd969352640 1 -- 172.21.15.181:0/2680205370 wait complete. 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.027+0000 7fd969352640 1 Processor -- start 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.027+0000 7fd969352640 1 -- start start 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd969352640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9640cf0e0 0x7fd964159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd969352640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640d3660 0x7fd964157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd969352640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 0x7fd964159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd969352640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd9640cfe40 con 0x7fd9640d3660 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd969352640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd9640b24f0 con 0x7fd96415e640 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd969352640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd9640b73a0 con 0x7fd9640cf0e0 2024-09-12T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640d3660 0x7fd964157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640d3660 0x7fd964157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53558/0 (socket says 172.21.15.181:53558) 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 -- 172.21.15.181:0/1795403059 learned_addr learned my addr 172.21.15.181:0/1795403059 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd962ffd640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9640cf0e0 0x7fd964159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd9637fe640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 0x7fd964159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 -- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9640cf0e0 msgr2=0x7fd964159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9640cf0e0 0x7fd964159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 -- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 msgr2=0x7fd964159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 0x7fd964159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.028+0000 7fd95a7fc640 1 -- 172.21.15.181:0/1795403059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd964159950 con 0x7fd9640d3660 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.029+0000 7fd95a7fc640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640d3660 0x7fd964157bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00c3f0 tx=0x7fd94c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.029+0000 7fd95bfff640 1 -- 172.21.15.181:0/1795403059 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0052d0 con 0x7fd9640d3660 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.029+0000 7fd95bfff640 1 -- 172.21.15.181:0/1795403059 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94c005490 con 0x7fd9640d3660 2024-09-12T02:29:03.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.029+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd964158650 con 0x7fd9640d3660 2024-09-12T02:29:03.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.029+0000 7fd95bfff640 1 -- 172.21.15.181:0/1795403059 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c007260 con 0x7fd9640d3660 2024-09-12T02:29:03.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.029+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd964158c10 con 0x7fd9640d3660 2024-09-12T02:29:03.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.030+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9640d1d00 con 0x7fd9640d3660 2024-09-12T02:29:03.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.030+0000 7fd95bfff640 1 -- 172.21.15.181:0/1795403059 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd94c007400 con 0x7fd9640d3660 2024-09-12T02:29:03.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.031+0000 7fd95bfff640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94406be30 0x7fd94406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.031+0000 7fd95bfff640 1 -- 172.21.15.181:0/1795403059 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd94c08a290 con 0x7fd9640d3660 2024-09-12T02:29:03.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.031+0000 7fd962ffd640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94406be30 0x7fd94406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.031+0000 7fd962ffd640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94406be30 0x7fd94406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd954034000 tx=0x7fd95402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.035+0000 7fd95bfff640 1 -- 172.21.15.181:0/1795403059 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd94c058cd0 con 0x7fd9640d3660 2024-09-12T02:29:03.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.201+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd96406c900 con 0x7fd9640d3660 2024-09-12T02:29:03.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.203+0000 7fd95bfff640 1 -- 172.21.15.181:0/1795403059 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16814 (secure 0 0 0) 0x7fd94c0871c0 con 0x7fd9640d3660 2024-09-12T02:29:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:03.204 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":31,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:01.921783+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:59.678168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:00.909444+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:03.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94406be30 msgr2=0x7fd94406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94406be30 0x7fd94406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd954034000 tx=0x7fd95402e000 comp rx=0 tx=0).stop 2024-09-12T02:29:03.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640d3660 msgr2=0x7fd964157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640d3660 0x7fd964157bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00c3f0 tx=0x7fd94c00c8b0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 shutdown_connections 2024-09-12T02:29:03.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94406be30 0x7fd94406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd96415e640 0x7fd964159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640d3660 0x7fd964157bb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 --2- 172.21.15.181:0/1795403059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9640cf0e0 0x7fd964159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 >> 172.21.15.181:0/1795403059 conn(0x7fd96409d820 msgr2=0x7fd9640cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:03.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 shutdown_connections 2024-09-12T02:29:03.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.205+0000 7fd969352640 1 -- 172.21.15.181:0/1795403059 wait complete. 2024-09-12T02:29:03.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:29:03.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.317+0000 7f250035b640 1 Processor -- start 2024-09-12T02:29:03.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.317+0000 7f250035b640 1 -- start start 2024-09-12T02:29:03.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f250035b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f24f8145110 0x7f24f80af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f250035b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f24f8145700 0x7f24f80b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f250035b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f80b2770 con 0x7f24f80b2360 2024-09-12T02:29:03.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f250035b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f24f8073b60 con 0x7f24f8145110 2024-09-12T02:29:03.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f250035b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f24f81454f0 con 0x7f24f8145700 2024-09-12T02:29:03.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fe8f8640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f24f80b2360 0x7f24f815ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51616/0 (socket says 172.21.15.181:51616) 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fe0f7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f24f8145110 0x7f24f80af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fe8f8640 1 -- 172.21.15.181:0/1966939915 learned_addr learned my addr 172.21.15.181:0/1966939915 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fd8f6640 1 --2- 172.21.15.181:0/1966939915 >> v2:172.21.15.204:3300/0 conn(0x7f24f8145700 0x7f24f80b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fe0f7640 1 -- 172.21.15.181:0/1966939915 >> v2:172.21.15.204:3300/0 conn(0x7f24f8145700 msgr2=0x7f24f80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fe0f7640 1 --2- 172.21.15.181:0/1966939915 >> v2:172.21.15.204:3300/0 conn(0x7f24f8145700 0x7f24f80b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fd0f5640 1 -- 172.21.15.181:0/1966939915 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109057310 0 0) 0x7f24f0001490 con 0x7f24f80b2360 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fe0f7640 1 -- 172.21.15.181:0/1966939915 >> v1:172.21.15.181:6789/0 conn(0x7f24f80b2360 legacy=0x7f24f815ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.318+0000 7f24fe0f7640 1 -- 172.21.15.181:0/1966939915 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f8072f50 con 0x7f24f8145110 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.319+0000 7f24fe0f7640 1 --2- 172.21.15.181:0/1966939915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f80af6f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f24f80cd250 tx=0x7f24f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f73e647268e491 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.319+0000 7f24fd0f5640 1 -- 172.21.15.181:0/1966939915 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4037070 con 0x7f24f8145110 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.319+0000 7f24fd0f5640 1 -- 172.21.15.181:0/1966939915 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f4032440 con 0x7f24f8145110 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.319+0000 7f24fd0f5640 1 -- 172.21.15.181:0/1966939915 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f402ae60 con 0x7f24f8145110 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 -- 172.21.15.181:0/1966939915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 msgr2=0x7f24f80af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 --2- 172.21.15.181:0/1966939915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f80af6f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f24f80cd250 tx=0x7f24f402a110 comp rx=0 tx=0).stop 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 -- 172.21.15.181:0/1966939915 shutdown_connections 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 --2- 172.21.15.181:0/1966939915 >> v2:172.21.15.204:3300/0 conn(0x7f24f8145700 0x7f24f80b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 --2- 172.21.15.181:0/1966939915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f80af6f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 -- 172.21.15.181:0/1966939915 >> 172.21.15.181:0/1966939915 conn(0x7f24f806bc10 msgr2=0x7f24f806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 -- 172.21.15.181:0/1966939915 shutdown_connections 2024-09-12T02:29:03.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.320+0000 7f250035b640 1 -- 172.21.15.181:0/1966939915 wait complete. 2024-09-12T02:29:03.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.321+0000 7f250035b640 1 Processor -- start 2024-09-12T02:29:03.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.321+0000 7f250035b640 1 -- start start 2024-09-12T02:29:03.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24f80b2360 0x7f24f81401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24f8145700 0x7f24f80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24f80737f0 con 0x7f24f8145110 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f24f8073510 con 0x7f24f8145700 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f24f80d0740 con 0x7f24f80b2360 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f815f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53568/0 (socket says 172.21.15.181:53568) 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 -- 172.21.15.181:0/1933138434 learned_addr learned my addr 172.21.15.181:0/1933138434 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 -- 172.21.15.181:0/1933138434 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24f80b2360 msgr2=0x7f24f81401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24f80b2360 0x7f24f81401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 -- 172.21.15.181:0/1933138434 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24f8145700 msgr2=0x7f24f80ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24f8145700 0x7f24f80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 -- 172.21.15.181:0/1933138434 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f815fd50 con 0x7f24f8145110 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24fd8f6640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f815f400 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24e800c820 tx=0x7f24e800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24eeffd640 1 -- 172.21.15.181:0/1933138434 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8015070 con 0x7f24f8145110 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24eeffd640 1 -- 172.21.15.181:0/1933138434 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e8004020 con 0x7f24f8145110 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f8160030 con 0x7f24f8145110 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f24eeffd640 1 -- 172.21.15.181:0/1933138434 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e80043f0 con 0x7f24f8145110 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.322+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f81605f0 con 0x7f24f8145110 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.323+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f8069170 con 0x7f24f8145110 2024-09-12T02:29:03.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.324+0000 7f24eeffd640 1 -- 172.21.15.181:0/1933138434 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24e80077d0 con 0x7f24f8145110 2024-09-12T02:29:03.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.324+0000 7f24eeffd640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24dc06be60 0x7f24dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.325+0000 7f24fe0f7640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24dc06be60 0x7f24dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.325+0000 7f24eeffd640 1 -- 172.21.15.181:0/1933138434 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f24e808ac40 con 0x7f24f8145110 2024-09-12T02:29:03.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.325+0000 7f24fe0f7640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24dc06be60 0x7f24dc06e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.329+0000 7f24eeffd640 1 -- 172.21.15.181:0/1933138434 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24e8059560 con 0x7f24f8145110 2024-09-12T02:29:03.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.528+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f24f80af6f0 con 0x7f24f8145110 2024-09-12T02:29:03.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.605+0000 7f24eeffd640 1 -- 172.21.15.181:0/1933138434 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f24e8058e60 con 0x7f24f8145110 2024-09-12T02:29:03.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24dc06be60 msgr2=0x7f24dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24dc06be60 0x7f24dc06e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402c000 comp rx=0 tx=0).stop 2024-09-12T02:29:03.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 msgr2=0x7f24f815f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f815f400 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24e800c820 tx=0x7f24e800cce0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 shutdown_connections 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24dc06be60 0x7f24dc06e320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f24f8145700 0x7f24f80ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24f8145110 0x7f24f815f400 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 --2- 172.21.15.181:0/1933138434 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f24f80b2360 0x7f24f81401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 >> 172.21.15.181:0/1933138434 conn(0x7f24f806bc10 msgr2=0x7f24f80ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 shutdown_connections 2024-09-12T02:29:03.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.607+0000 7f250035b640 1 -- 172.21.15.181:0/1933138434 wait complete. 2024-09-12T02:29:03.622 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:29:03.622 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:29:03.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.723+0000 7ff122ab7640 1 Processor -- start 2024-09-12T02:29:03.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.723+0000 7ff122ab7640 1 -- start start 2024-09-12T02:29:03.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff122ab7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0ad0 0x7ff11c06d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff122ab7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff11c0d0f10 0x7ff11c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff122ab7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c155b20 con 0x7ff11c0d2350 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff122ab7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff11c06f470 con 0x7ff11c0d0f10 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff122ab7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c06f750 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff121054640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff11c0d0f10 0x7ff11c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff121054640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff11c0d0f10 0x7ff11c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53576/0 (socket says 172.21.15.181:53576) 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff121054640 1 -- 172.21.15.181:0/3692852722 learned_addr learned my addr 172.21.15.181:0/3692852722 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff121054640 1 -- 172.21.15.181:0/3692852722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0ad0 msgr2=0x7ff11c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff113fff640 1 --2- 172.21.15.181:0/3692852722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0ad0 0x7ff11c06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff121054640 1 --2- 172.21.15.181:0/3692852722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0ad0 0x7ff11c06d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff121054640 1 -- 172.21.15.181:0/3692852722 >> v1:172.21.15.204:6789/0 conn(0x7ff11c0d2350 legacy=0x7ff11c0d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:03.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.724+0000 7ff121054640 1 -- 172.21.15.181:0/3692852722 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c06fa30 con 0x7ff11c0d0f10 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.725+0000 7ff121054640 1 --2- 172.21.15.181:0/3692852722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0f10 0x7ff11c06d580 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff114009e50 tx=0x7ff11402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476df0d5e8066fba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.725+0000 7ff1137fe640 1 -- 172.21.15.181:0/3692852722 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114036070 con 0x7ff11c0d0f10 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.725+0000 7ff1137fe640 1 -- 172.21.15.181:0/3692852722 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff114031600 con 0x7ff11c0d0f10 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.725+0000 7ff1137fe640 1 -- 172.21.15.181:0/3692852722 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140319d0 con 0x7ff11c0d0f10 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 -- 172.21.15.181:0/3692852722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0f10 msgr2=0x7ff11c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 --2- 172.21.15.181:0/3692852722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0f10 0x7ff11c06d580 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff114009e50 tx=0x7ff11402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 -- 172.21.15.181:0/3692852722 shutdown_connections 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 --2- 172.21.15.181:0/3692852722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0f10 0x7ff11c06d580 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 --2- 172.21.15.181:0/3692852722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0ad0 0x7ff11c06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 -- 172.21.15.181:0/3692852722 >> 172.21.15.181:0/3692852722 conn(0x7ff11c0b7db0 msgr2=0x7ff11c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 -- 172.21.15.181:0/3692852722 shutdown_connections 2024-09-12T02:29:03.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.726+0000 7ff122ab7640 1 -- 172.21.15.181:0/3692852722 wait complete. 2024-09-12T02:29:03.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.727+0000 7ff122ab7640 1 Processor -- start 2024-09-12T02:29:03.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.727+0000 7ff122ab7640 1 -- start start 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff122ab7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0ad0 0x7ff11c15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff122ab7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0f10 0x7ff11c14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff122ab7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c0d2350 0x7ff11c14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff122ab7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0d0560 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff122ab7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0d03e0 con 0x7ff11c0d2350 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff122ab7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c06dac0 con 0x7ff11c0d0f10 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0ad0 0x7ff11c15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0ad0 0x7ff11c15b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53592/0 (socket says 172.21.15.181:53592) 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 -- 172.21.15.181:0/2678214821 learned_addr learned my addr 172.21.15.181:0/2678214821 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 -- 172.21.15.181:0/2678214821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0f10 msgr2=0x7ff11c14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0f10 0x7ff11c14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 -- 172.21.15.181:0/2678214821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c0d2350 msgr2=0x7ff11c14e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c0d2350 0x7ff11c14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.728+0000 7ff120853640 1 -- 172.21.15.181:0/2678214821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c0cf6b0 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.729+0000 7ff120853640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0ad0 0x7ff11c15b2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b3f0 tx=0x7ff11800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.729+0000 7ff1117fa640 1 -- 172.21.15.181:0/2678214821 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118015020 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.729+0000 7ff1117fa640 1 -- 172.21.15.181:0/2678214821 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118011830 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.729+0000 7ff1117fa640 1 -- 172.21.15.181:0/2678214821 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118011c20 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.729+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c155d90 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.729+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c0cf990 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.730+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c1564a0 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.730+0000 7ff1117fa640 1 -- 172.21.15.181:0/2678214821 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff118018020 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.731+0000 7ff1117fa640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff10806be30 0x7ff10806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:03.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.731+0000 7ff1117fa640 1 -- 172.21.15.181:0/2678214821 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff11808ab00 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.731+0000 7ff113fff640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff10806be30 0x7ff10806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:03.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.731+0000 7ff113fff640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff10806be30 0x7ff10806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff11c1f7c20 tx=0x7ff10c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.735+0000 7ff1117fa640 1 -- 172.21.15.181:0/2678214821 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff11801f030 con 0x7ff11c0d0ad0 2024-09-12T02:29:03.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:03.938+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff11c0d2730 con 0x7ff11c0d0ad0 2024-09-12T02:29:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.613+0000 7ff1117fa640 1 -- 172.21.15.181:0/2678214821 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7ff1180172c0 con 0x7ff11c0d0ad0 2024-09-12T02:29:04.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff10806be30 msgr2=0x7ff10806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff10806be30 0x7ff10806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff11c1f7c20 tx=0x7ff10c008040 comp rx=0 tx=0).stop 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0ad0 msgr2=0x7ff11c15b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0ad0 0x7ff11c15b2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b3f0 tx=0x7ff11800b8b0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 shutdown_connections 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff10806be30 0x7ff10806e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c0d2350 0x7ff11c14e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c0d0f10 0x7ff11c14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 --2- 172.21.15.181:0/2678214821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff11c0d0ad0 0x7ff11c15b2d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.616+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 >> 172.21.15.181:0/2678214821 conn(0x7ff11c0b7db0 msgr2=0x7ff11c0b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.617+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 shutdown_connections 2024-09-12T02:29:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.617+0000 7ff122ab7640 1 -- 172.21.15.181:0/2678214821 wait complete. 2024-09-12T02:29:04.630 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:29:04.631 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:04.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.733+0000 7f2875277640 1 Processor -- start 2024-09-12T02:29:04.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.733+0000 7f2875277640 1 -- start start 2024-09-12T02:29:04.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f2875277640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f287015b2e0 0x7f28700b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f2875277640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700cdfc0 0x7f28700b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f2875277640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f28700b22c0 0x7f28700ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f2875277640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f287015b6c0 con 0x7f287015b2e0 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f2875277640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f28700ce4f0 con 0x7f28700b22c0 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f2875277640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f28700ce7d0 con 0x7f28700cdfc0 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f286effd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f287015b2e0 0x7f28700b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f286effd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f287015b2e0 0x7f28700b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53606/0 (socket says 172.21.15.181:53606) 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.734+0000 7f286effd640 1 -- 172.21.15.181:0/2913375359 learned_addr learned my addr 172.21.15.181:0/2913375359 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f286f7fe640 1 --2- 172.21.15.181:0/2913375359 >> v2:172.21.15.204:3300/0 conn(0x7f28700b22c0 0x7f28700ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f28667fc640 1 --2- 172.21.15.181:0/2913375359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700cdfc0 0x7f28700b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f286effd640 1 -- 172.21.15.181:0/2913375359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700cdfc0 msgr2=0x7f28700b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f286effd640 1 --2- 172.21.15.181:0/2913375359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700cdfc0 0x7f28700b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f286effd640 1 -- 172.21.15.181:0/2913375359 >> v2:172.21.15.204:3300/0 conn(0x7f28700b22c0 msgr2=0x7f28700ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f286effd640 1 --2- 172.21.15.181:0/2913375359 >> v2:172.21.15.204:3300/0 conn(0x7f28700b22c0 0x7f28700ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f286effd640 1 -- 172.21.15.181:0/2913375359 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28700ceab0 con 0x7f287015b2e0 2024-09-12T02:29:04.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f28667fc640 1 --2- 172.21.15.181:0/2913375359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700cdfc0 0x7f28700b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:04.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.735+0000 7f286effd640 1 --2- 172.21.15.181:0/2913375359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28700b3d20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28700d0050 tx=0x7f286002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b41d9747350ccf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:04.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f286e7fc640 1 -- 172.21.15.181:0/2913375359 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860037070 con 0x7f287015b2e0 2024-09-12T02:29:04.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f286e7fc640 1 -- 172.21.15.181:0/2913375359 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2860032440 con 0x7f287015b2e0 2024-09-12T02:29:04.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f286e7fc640 1 -- 172.21.15.181:0/2913375359 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860032810 con 0x7f287015b2e0 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 -- 172.21.15.181:0/2913375359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 msgr2=0x7f28700b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 --2- 172.21.15.181:0/2913375359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28700b3d20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28700d0050 tx=0x7f286002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 -- 172.21.15.181:0/2913375359 shutdown_connections 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 --2- 172.21.15.181:0/2913375359 >> v2:172.21.15.204:3300/0 conn(0x7f28700b22c0 0x7f28700ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 --2- 172.21.15.181:0/2913375359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700cdfc0 0x7f28700b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 --2- 172.21.15.181:0/2913375359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28700b3d20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 -- 172.21.15.181:0/2913375359 >> 172.21.15.181:0/2913375359 conn(0x7f287006bc10 msgr2=0x7f287006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 -- 172.21.15.181:0/2913375359 shutdown_connections 2024-09-12T02:29:04.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.736+0000 7f2875277640 1 -- 172.21.15.181:0/2913375359 wait complete. 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.737+0000 7f2875277640 1 Processor -- start 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f2875277640 1 -- start start 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f2875277640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700b22c0 0x7f2870142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f2875277640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28700cdfc0 0x7f287015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f2875277640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28701f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f2875277640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f28700712b0 con 0x7f287015b2e0 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f2875277640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2870071130 con 0x7f28700cdfc0 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f2875277640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f28700b4260 con 0x7f28700b22c0 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f286f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28701f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f286f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28701f1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53610/0 (socket says 172.21.15.181:53610) 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.738+0000 7f286f7fe640 1 -- 172.21.15.181:0/598361236 learned_addr learned my addr 172.21.15.181:0/598361236 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f286effd640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700b22c0 0x7f2870142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f28667fc640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28700cdfc0 0x7f287015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f286f7fe640 1 -- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700b22c0 msgr2=0x7f2870142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f286f7fe640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700b22c0 0x7f2870142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f286f7fe640 1 -- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28700cdfc0 msgr2=0x7f287015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f286f7fe640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28700cdfc0 0x7f287015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f286f7fe640 1 -- 172.21.15.181:0/598361236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287015dd00 con 0x7f287015b2e0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f286f7fe640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28701f1de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2868007e40 tx=0x7f286800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f2867fff640 1 -- 172.21.15.181:0/598361236 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868014620 con 0x7f287015b2e0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f2867fff640 1 -- 172.21.15.181:0/598361236 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2868019070 con 0x7f287015b2e0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287015dfe0 con 0x7f287015b2e0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f2867fff640 1 -- 172.21.15.181:0/598361236 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868014a20 con 0x7f287015b2e0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.739+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2870142fe0 con 0x7f287015b2e0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.740+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28700b1d80 con 0x7f287015b2e0 2024-09-12T02:29:04.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.740+0000 7f2867fff640 1 -- 172.21.15.181:0/598361236 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2868014bc0 con 0x7f287015b2e0 2024-09-12T02:29:04.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.741+0000 7f2867fff640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f285006be60 0x7f285006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.741+0000 7f2867fff640 1 -- 172.21.15.181:0/598361236 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f286808b680 con 0x7f287015b2e0 2024-09-12T02:29:04.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.741+0000 7f286effd640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f285006be60 0x7f285006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.741+0000 7f286effd640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f285006be60 0x7f285006e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2860034000 tx=0x7f286002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:04.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.745+0000 7f2867fff640 1 -- 172.21.15.181:0/598361236 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f286805a0c0 con 0x7f287015b2e0 2024-09-12T02:29:04.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.944+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28700cf070 con 0x7f287015b2e0 2024-09-12T02:29:04.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.945+0000 7f2867fff640 1 -- 172.21.15.181:0/598361236 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5234 (secure 0 0 0) 0x7f28680599c0 con 0x7f287015b2e0 2024-09-12T02:29:04.946 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:04.946 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":13,"btime":"2024-09-12T02:29:04:610592+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:03.940253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4756":{"gid":4756,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2347584783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2347584783},{"type":"v1","addr":"172.21.15.204:6835","nonce":2347584783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4756,"qdb_cluster":[4756]},"id":2}]} 2024-09-12T02:29:04.946 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 13 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f285006be60 msgr2=0x7f285006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f285006be60 0x7f285006e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2860034000 tx=0x7f286002e000 comp rx=0 tx=0).stop 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 msgr2=0x7f28701f1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28701f1de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2868007e40 tx=0x7f286800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 shutdown_connections 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f285006be60 0x7f285006e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28700cdfc0 0x7f287015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f287015b2e0 0x7f28701f1de0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 --2- 172.21.15.181:0/598361236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28700b22c0 0x7f2870142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 >> 172.21.15.181:0/598361236 conn(0x7f287006bc10 msgr2=0x7f287006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 shutdown_connections 2024-09-12T02:29:04.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:04.947+0000 7f2875277640 1 -- 172.21.15.181:0/598361236 wait complete. 2024-09-12T02:29:04.958 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:05.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.056+0000 7f5571d52640 1 Processor -- start 2024-09-12T02:29:05.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.056+0000 7f5571d52640 1 -- start start 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.056+0000 7f5571d52640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f556c0cf2b0 0x7f556c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.056+0000 7f5571d52640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556c15ea20 con 0x7f556c15e640 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.056+0000 7f5571d52640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556c0b1c50 con 0x7f556c0cf720 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.056+0000 7f5571d52640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f556c0b3d00 con 0x7f556c0cf2b0 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.057+0000 7f556affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f556c0cf2b0 0x7f556c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.057+0000 7f556b7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f556c15e640 0x7f556c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51618/0 (socket says 172.21.15.181:51618) 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.057+0000 7f556b7fe640 1 -- 172.21.15.181:0/2997723866 learned_addr learned my addr 172.21.15.181:0/2997723866 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.057+0000 7f556affd640 1 -- 172.21.15.181:0/2997723866 >> v1:172.21.15.204:6789/0 conn(0x7f556c0cf720 legacy=0x7f556c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.057+0000 7f556affd640 1 -- 172.21.15.181:0/2997723866 >> v1:172.21.15.181:6789/0 conn(0x7f556c15e640 legacy=0x7f556c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.057+0000 7f556a7fc640 1 -- 172.21.15.181:0/2997723866 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116869104 0 0) 0x7f556c15ea20 con 0x7f556c15e640 2024-09-12T02:29:05.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.057+0000 7f556affd640 1 -- 172.21.15.181:0/2997723866 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556c0b1f30 con 0x7f556c0cf2b0 2024-09-12T02:29:05.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f556affd640 1 --2- 172.21.15.181:0/2997723866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c0d2650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f556c0cb580 tx=0x7f556002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5315aa811a84a81c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f556a7fc640 1 -- 172.21.15.181:0/2997723866 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560037070 con 0x7f556c0cf2b0 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f556a7fc640 1 -- 172.21.15.181:0/2997723866 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556002ae20 con 0x7f556c0cf2b0 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f556a7fc640 1 -- 172.21.15.181:0/2997723866 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560032660 con 0x7f556c0cf2b0 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f5571d52640 1 -- 172.21.15.181:0/2997723866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 msgr2=0x7f556c0d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f5571d52640 1 --2- 172.21.15.181:0/2997723866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c0d2650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f556c0cb580 tx=0x7f556002a110 comp rx=0 tx=0).stop 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f5571d52640 1 -- 172.21.15.181:0/2997723866 shutdown_connections 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f5571d52640 1 --2- 172.21.15.181:0/2997723866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c0d2650 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f5571d52640 1 -- 172.21.15.181:0/2997723866 >> 172.21.15.181:0/2997723866 conn(0x7f556c09d820 msgr2=0x7f556c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f5571d52640 1 -- 172.21.15.181:0/2997723866 shutdown_connections 2024-09-12T02:29:05.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.058+0000 7f5571d52640 1 -- 172.21.15.181:0/2997723866 wait complete. 2024-09-12T02:29:05.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 Processor -- start 2024-09-12T02:29:05.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 -- start start 2024-09-12T02:29:05.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c1f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f556c0cf720 0x7f556c1f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556c15e640 0x7f556c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f556c0b24f0 con 0x7f556c0cf2b0 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f556c0b2860 con 0x7f556c15e640 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.060+0000 7f5571d52640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f556c0cfe40 con 0x7f556c0cf720 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c1f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c1f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53616/0 (socket says 172.21.15.181:53616) 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 -- 172.21.15.181:0/235063495 learned_addr learned my addr 172.21.15.181:0/235063495 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556affd640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f556c0cf720 0x7f556c1f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556bfff640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556c15e640 0x7f556c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 -- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f556c0cf720 msgr2=0x7f556c1f6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f556c0cf720 0x7f556c1f6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 -- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556c15e640 msgr2=0x7f556c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556c15e640 0x7f556c15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 -- 172.21.15.181:0/235063495 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556c1f4d30 con 0x7f556c0cf2b0 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556bfff640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556c15e640 0x7f556c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f556b7fe640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c1f4f20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c4d0 tx=0x7f555c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f5553fff640 1 -- 172.21.15.181:0/235063495 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c018070 con 0x7f556c0cf2b0 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f5553fff640 1 -- 172.21.15.181:0/235063495 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c007500 con 0x7f556c0cf2b0 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f5553fff640 1 -- 172.21.15.181:0/235063495 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c004a20 con 0x7f556c0cf2b0 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556c1f4a50 con 0x7f556c0cf2b0 2024-09-12T02:29:05.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.061+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556c0b52d0 con 0x7f556c0cf2b0 2024-09-12T02:29:05.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.062+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556c0b73a0 con 0x7f556c0cf2b0 2024-09-12T02:29:05.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.063+0000 7f5553fff640 1 -- 172.21.15.181:0/235063495 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f555c01b070 con 0x7f556c0cf2b0 2024-09-12T02:29:05.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.063+0000 7f5553fff640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f555806be30 0x7f555806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.063+0000 7f5553fff640 1 -- 172.21.15.181:0/235063495 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f555c08a130 con 0x7f556c0cf2b0 2024-09-12T02:29:05.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.063+0000 7f556affd640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f555806be30 0x7f555806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.063+0000 7f556affd640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f555806be30 0x7f555806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5560034000 tx=0x7f556002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.067+0000 7f5553fff640 1 -- 172.21.15.181:0/235063495 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f555c058490 con 0x7f556c0cf2b0 2024-09-12T02:29:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.232+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f556c1f7070 con 0x7f556c0cf2b0 2024-09-12T02:29:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.233+0000 7f5553fff640 1 -- 172.21.15.181:0/235063495 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16801 (secure 0 0 0) 0x7f555c05c790 con 0x7f556c0cf2b0 2024-09-12T02:29:05.234 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:05.234 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":32,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:03.605499+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:59.678168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:00.909444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f555806be30 msgr2=0x7f555806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f555806be30 0x7f555806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5560034000 tx=0x7f556002e000 comp rx=0 tx=0).stop 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 msgr2=0x7f556c1f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c1f4f20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c4d0 tx=0x7f555c00c990 comp rx=0 tx=0).stop 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 shutdown_connections 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f555806be30 0x7f555806e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f556c15e640 0x7f556c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f556c0cf720 0x7f556c1f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 --2- 172.21.15.181:0/235063495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f556c0cf2b0 0x7f556c1f4f20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 >> 172.21.15.181:0/235063495 conn(0x7f556c09d820 msgr2=0x7f556c0b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 shutdown_connections 2024-09-12T02:29:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.235+0000 7f5571d52640 1 -- 172.21.15.181:0/235063495 wait complete. 2024-09-12T02:29:05.247 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:29:05.247 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:05.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.345+0000 7f23c82c9640 1 Processor -- start 2024-09-12T02:29:05.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.345+0000 7f23c82c9640 1 -- start start 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c82c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c00d08f0 0x7f23c00d2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c82c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f23c0160a00 0x7f23c00d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c82c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c00d2e60 con 0x7f23c015c050 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c82c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f23c0070ec0 con 0x7f23c0160a00 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c82c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f23c015ff20 con 0x7f23c00d08f0 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c6065640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f23c015c050 0x7f23c00d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:36008/0 (socket says 172.21.15.181:36008) 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c6866640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f23c0160a00 0x7f23c00d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c6065640 1 -- 172.21.15.181:0/3614630622 learned_addr learned my addr 172.21.15.181:0/3614630622 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c5864640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c00d08f0 0x7f23c00d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c5864640 1 -- 172.21.15.181:0/3614630622 >> v2:172.21.15.204:3300/0 conn(0x7f23c0160a00 msgr2=0x7f23c00d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:05.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c5864640 1 --2- 172.21.15.181:0/3614630622 >> v2:172.21.15.204:3300/0 conn(0x7f23c0160a00 0x7f23c00d2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c5864640 1 -- 172.21.15.181:0/3614630622 >> v1:172.21.15.204:6789/0 conn(0x7f23c015c050 legacy=0x7f23c00d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.346+0000 7f23c5864640 1 -- 172.21.15.181:0/3614630622 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c0160200 con 0x7f23c00d08f0 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.347+0000 7f23c5864640 1 --2- 172.21.15.181:0/3614630622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c00d08f0 0x7f23c00d2210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097a0 tx=0x7f23b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e40513ca8426ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.347+0000 7f23c5063640 1 -- 172.21.15.181:0/3614630622 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4037070 con 0x7f23c00d08f0 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.347+0000 7f23c5063640 1 -- 172.21.15.181:0/3614630622 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b4032440 con 0x7f23c00d08f0 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.347+0000 7f23c5063640 1 -- 172.21.15.181:0/3614630622 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4032810 con 0x7f23c00d08f0 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 -- 172.21.15.181:0/3614630622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c00d08f0 msgr2=0x7f23c00d2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 --2- 172.21.15.181:0/3614630622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c00d08f0 0x7f23c00d2210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097a0 tx=0x7f23b402a180 comp rx=0 tx=0).stop 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 -- 172.21.15.181:0/3614630622 shutdown_connections 2024-09-12T02:29:05.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 --2- 172.21.15.181:0/3614630622 >> v2:172.21.15.204:3300/0 conn(0x7f23c0160a00 0x7f23c00d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 --2- 172.21.15.181:0/3614630622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c00d08f0 0x7f23c00d2210 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 -- 172.21.15.181:0/3614630622 >> 172.21.15.181:0/3614630622 conn(0x7f23c006f400 msgr2=0x7f23c006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:05.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 -- 172.21.15.181:0/3614630622 shutdown_connections 2024-09-12T02:29:05.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.348+0000 7f23c82c9640 1 -- 172.21.15.181:0/3614630622 wait complete. 2024-09-12T02:29:05.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.349+0000 7f23c82c9640 1 Processor -- start 2024-09-12T02:29:05.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.349+0000 7f23c82c9640 1 -- start start 2024-09-12T02:29:05.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c82c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23c00d08f0 0x7f23c01e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c82c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23c015c050 0x7f23c01e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c82c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c0160a00 0x7f23c015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c82c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23c015c5b0 con 0x7f23c015c050 2024-09-12T02:29:05.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c82c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f23c015c430 con 0x7f23c00d08f0 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c82c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f23c00ce830 con 0x7f23c0160a00 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23c015c050 0x7f23c01e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23c015c050 0x7f23c01e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53628/0 (socket says 172.21.15.181:53628) 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 -- 172.21.15.181:0/373380510 learned_addr learned my addr 172.21.15.181:0/373380510 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c6065640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23c00d08f0 0x7f23c01e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c6866640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c0160a00 0x7f23c015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 -- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c0160a00 msgr2=0x7f23c015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c0160a00 0x7f23c015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 -- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23c00d08f0 msgr2=0x7f23c01e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23c00d08f0 0x7f23c01e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 -- 172.21.15.181:0/373380510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c01e64a0 con 0x7f23c015c050 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c5864640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23c015c050 0x7f23c01e7540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f23b4035040 tx=0x7f23b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23beffd640 1 -- 172.21.15.181:0/373380510 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4037040 con 0x7f23c015c050 2024-09-12T02:29:05.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23beffd640 1 -- 172.21.15.181:0/373380510 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b4030500 con 0x7f23c015c050 2024-09-12T02:29:05.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c01e6780 con 0x7f23c015c050 2024-09-12T02:29:05.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.350+0000 7f23beffd640 1 -- 172.21.15.181:0/373380510 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b40308d0 con 0x7f23c015c050 2024-09-12T02:29:05.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.351+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c01e7020 con 0x7f23c015c050 2024-09-12T02:29:05.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.351+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c0069ac0 con 0x7f23c015c050 2024-09-12T02:29:05.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.352+0000 7f23beffd640 1 -- 172.21.15.181:0/373380510 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23b4044020 con 0x7f23c015c050 2024-09-12T02:29:05.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.352+0000 7f23beffd640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f23ac06be30 0x7f23ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.352+0000 7f23beffd640 1 -- 172.21.15.181:0/373380510 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f23b40aafe0 con 0x7f23c015c050 2024-09-12T02:29:05.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.352+0000 7f23c6065640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f23ac06be30 0x7f23ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.353+0000 7f23c6065640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f23ac06be30 0x7f23ac06e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007fd0 tx=0x7f23b8007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.357+0000 7f23beffd640 1 -- 172.21.15.181:0/373380510 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23c0069ac0 con 0x7f23c015c050 2024-09-12T02:29:05.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.517+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23c00d01e0 con 0x7f23ac06be30 2024-09-12T02:29:05.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.523+0000 7f23beffd640 1 -- 172.21.15.181:0/373380510 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250408 (secure 0 0 0) 0x7f23c00d01e0 con 0x7f23ac06be30 2024-09-12T02:29:05.526 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:05.528 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:05.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f23ac06be30 msgr2=0x7f23ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f23ac06be30 0x7f23ac06e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007fd0 tx=0x7f23b8007e80 comp rx=0 tx=0).stop 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23c015c050 msgr2=0x7f23c01e7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23c015c050 0x7f23c01e7540 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f23b4035040 tx=0x7f23b40046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 shutdown_connections 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f23ac06be30 0x7f23ac06e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23c0160a00 0x7f23c015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23c015c050 0x7f23c01e7540 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 --2- 172.21.15.181:0/373380510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23c00d08f0 0x7f23c01e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 >> 172.21.15.181:0/373380510 conn(0x7f23c006f400 msgr2=0x7f23c0156830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 shutdown_connections 2024-09-12T02:29:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.526+0000 7f23c82c9640 1 -- 172.21.15.181:0/373380510 wait complete. 2024-09-12T02:29:05.538 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-12T02:29:03.620150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219952,"kb_used_data":3708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754768,"statfs":{"total":773094113280,"available":772868882432,"internally_reserved":0,"allocated":3796992,"data_stored":2151649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000545"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621991+0000","last_change":"2024-09-12T02:29:02.616935+0000","last_active":"2024-09-12T02:29:02.621991+0000","last_peered":"2024-09-12T02:29:02.621991+0000","last_clean":"2024-09-12T02:29:02.621991+0000","last_became_active":"2024-09-12T02:29:02.616651+0000","last_became_peered":"2024-09-12T02:29:02.616651+0000","last_unstale":"2024-09-12T02:29:02.621991+0000","last_undegraded":"2024-09-12T02:29:02.621991+0000","last_fullsized":"2024-09-12T02:29:02.621991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.593315+0000","last_change":"2024-09-12T02:29:01.593315+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.593315+0000","last_undegraded":"2024-09-12T02:29:01.593315+0000","last_fullsized":"2024-09-12T02:29:01.593315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622654+0000","last_change":"2024-09-12T02:29:02.617918+0000","last_active":"2024-09-12T02:29:02.622654+0000","last_peered":"2024-09-12T02:29:02.622654+0000","last_clean":"2024-09-12T02:29:02.622654+0000","last_became_active":"2024-09-12T02:29:02.617296+0000","last_became_peered":"2024-09-12T02:29:02.617296+0000","last_unstale":"2024-09-12T02:29:02.622654+0000","last_undegraded":"2024-09-12T02:29:02.622654+0000","last_fullsized":"2024-09-12T02:29:02.622654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620632+0000","last_change":"2024-09-12T02:29:02.617491+0000","last_active":"2024-09-12T02:29:02.620632+0000","last_peered":"2024-09-12T02:29:02.620632+0000","last_clean":"2024-09-12T02:29:02.620632+0000","last_became_active":"2024-09-12T02:29:02.617229+0000","last_became_peered":"2024-09-12T02:29:02.617229+0000","last_unstale":"2024-09-12T02:29:02.620632+0000","last_undegraded":"2024-09-12T02:29:02.620632+0000","last_fullsized":"2024-09-12T02:29:02.620632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587614+0000","last_change":"2024-09-12T02:29:01.587614+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587614+0000","last_undegraded":"2024-09-12T02:29:01.587614+0000","last_fullsized":"2024-09-12T02:29:01.587614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590003+0000","last_change":"2024-09-12T02:29:01.590003+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590003+0000","last_undegraded":"2024-09-12T02:29:01.590003+0000","last_fullsized":"2024-09-12T02:29:01.590003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615107+0000","last_change":"2024-09-12T02:29:02.613356+0000","last_active":"2024-09-12T02:29:02.615107+0000","last_peered":"2024-09-12T02:29:02.615107+0000","last_clean":"2024-09-12T02:29:02.615107+0000","last_became_active":"2024-09-12T02:29:02.613093+0000","last_became_peered":"2024-09-12T02:29:02.613093+0000","last_unstale":"2024-09-12T02:29:02.615107+0000","last_undegraded":"2024-09-12T02:29:02.615107+0000","last_fullsized":"2024-09-12T02:29:02.615107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612094+0000","last_change":"2024-09-12T02:29:02.608265+0000","last_active":"2024-09-12T02:29:02.612094+0000","last_peered":"2024-09-12T02:29:02.612094+0000","last_clean":"2024-09-12T02:29:02.612094+0000","last_became_active":"2024-09-12T02:29:02.607991+0000","last_became_peered":"2024-09-12T02:29:02.607991+0000","last_unstale":"2024-09-12T02:29:02.612094+0000","last_undegraded":"2024-09-12T02:29:02.612094+0000","last_fullsized":"2024-09-12T02:29:02.612094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615727+0000","last_change":"2024-09-12T02:29:02.608629+0000","last_active":"2024-09-12T02:29:02.615727+0000","last_peered":"2024-09-12T02:29:02.615727+0000","last_clean":"2024-09-12T02:29:02.615727+0000","last_became_active":"2024-09-12T02:29:02.608224+0000","last_became_peered":"2024-09-12T02:29:02.608224+0000","last_unstale":"2024-09-12T02:29:02.615727+0000","last_undegraded":"2024-09-12T02:29:02.615727+0000","last_fullsized":"2024-09-12T02:29:02.615727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625722+0000","last_change":"2024-09-12T02:29:02.618718+0000","last_active":"2024-09-12T02:29:02.625722+0000","last_peered":"2024-09-12T02:29:02.625722+0000","last_clean":"2024-09-12T02:29:02.625722+0000","last_became_active":"2024-09-12T02:29:02.618431+0000","last_became_peered":"2024-09-12T02:29:02.618431+0000","last_unstale":"2024-09-12T02:29:02.625722+0000","last_undegraded":"2024-09-12T02:29:02.625722+0000","last_fullsized":"2024-09-12T02:29:02.625722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615135+0000","last_change":"2024-09-12T02:29:02.612372+0000","last_active":"2024-09-12T02:29:02.615135+0000","last_peered":"2024-09-12T02:29:02.615135+0000","last_clean":"2024-09-12T02:29:02.615135+0000","last_became_active":"2024-09-12T02:29:02.612114+0000","last_became_peered":"2024-09-12T02:29:02.612114+0000","last_unstale":"2024-09-12T02:29:02.615135+0000","last_undegraded":"2024-09-12T02:29:02.615135+0000","last_fullsized":"2024-09-12T02:29:02.615135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615927+0000","last_change":"2024-09-12T02:29:02.613466+0000","last_active":"2024-09-12T02:29:02.615927+0000","last_peered":"2024-09-12T02:29:02.615927+0000","last_clean":"2024-09-12T02:29:02.615927+0000","last_became_active":"2024-09-12T02:29:02.613203+0000","last_became_peered":"2024-09-12T02:29:02.613203+0000","last_unstale":"2024-09-12T02:29:02.615927+0000","last_undegraded":"2024-09-12T02:29:02.615927+0000","last_fullsized":"2024-09-12T02:29:02.615927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587203+0000","last_change":"2024-09-12T02:29:01.587203+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587203+0000","last_undegraded":"2024-09-12T02:29:01.587203+0000","last_fullsized":"2024-09-12T02:29:01.587203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589414+0000","last_change":"2024-09-12T02:29:01.589414+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589414+0000","last_undegraded":"2024-09-12T02:29:01.589414+0000","last_fullsized":"2024-09-12T02:29:01.589414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622779+0000","last_change":"2024-09-12T02:29:02.620045+0000","last_active":"2024-09-12T02:29:02.622779+0000","last_peered":"2024-09-12T02:29:02.622779+0000","last_clean":"2024-09-12T02:29:02.622779+0000","last_became_active":"2024-09-12T02:29:02.619376+0000","last_became_peered":"2024-09-12T02:29:02.619376+0000","last_unstale":"2024-09-12T02:29:02.622779+0000","last_undegraded":"2024-09-12T02:29:02.622779+0000","last_fullsized":"2024-09-12T02:29:02.622779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:19.331506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620723+0000","last_change":"2024-09-12T02:29:02.618015+0000","last_active":"2024-09-12T02:29:02.620723+0000","last_peered":"2024-09-12T02:29:02.620723+0000","last_clean":"2024-09-12T02:29:02.620723+0000","last_became_active":"2024-09-12T02:29:02.617750+0000","last_became_peered":"2024-09-12T02:29:02.617750+0000","last_unstale":"2024-09-12T02:29:02.620723+0000","last_undegraded":"2024-09-12T02:29:02.620723+0000","last_fullsized":"2024-09-12T02:29:02.620723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.619552+0000","last_change":"2024-09-12T02:29:02.616002+0000","last_active":"2024-09-12T02:29:02.619552+0000","last_peered":"2024-09-12T02:29:02.619552+0000","last_clean":"2024-09-12T02:29:02.619552+0000","last_became_active":"2024-09-12T02:29:02.615650+0000","last_became_peered":"2024-09-12T02:29:02.615650+0000","last_unstale":"2024-09-12T02:29:02.619552+0000","last_undegraded":"2024-09-12T02:29:02.619552+0000","last_fullsized":"2024-09-12T02:29:02.619552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592939+0000","last_change":"2024-09-12T02:29:01.592939+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592939+0000","last_undegraded":"2024-09-12T02:29:01.592939+0000","last_fullsized":"2024-09-12T02:29:01.592939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589490+0000","last_change":"2024-09-12T02:29:01.589490+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589490+0000","last_undegraded":"2024-09-12T02:29:01.589490+0000","last_fullsized":"2024-09-12T02:29:01.589490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586573+0000","last_change":"2024-09-12T02:29:01.586573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586573+0000","last_undegraded":"2024-09-12T02:29:01.586573+0000","last_fullsized":"2024-09-12T02:29:01.586573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616748+0000","last_change":"2024-09-12T02:29:02.612217+0000","last_active":"2024-09-12T02:29:02.616748+0000","last_peered":"2024-09-12T02:29:02.616748+0000","last_clean":"2024-09-12T02:29:02.616748+0000","last_became_active":"2024-09-12T02:29:02.611931+0000","last_became_peered":"2024-09-12T02:29:02.611931+0000","last_unstale":"2024-09-12T02:29:02.616748+0000","last_undegraded":"2024-09-12T02:29:02.616748+0000","last_fullsized":"2024-09-12T02:29:02.616748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:02.620384+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:02.618647+0000","last_became_peered":"2024-09-12T02:29:02.618647+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.611401+0000","last_change":"2024-09-12T02:29:02.608849+0000","last_active":"2024-09-12T02:29:02.611401+0000","last_peered":"2024-09-12T02:29:02.611401+0000","last_clean":"2024-09-12T02:29:02.611401+0000","last_became_active":"2024-09-12T02:29:02.608571+0000","last_became_peered":"2024-09-12T02:29:02.608571+0000","last_unstale":"2024-09-12T02:29:02.611401+0000","last_undegraded":"2024-09-12T02:29:02.611401+0000","last_fullsized":"2024-09-12T02:29:02.611401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614879+0000","last_change":"2024-09-12T02:29:02.611689+0000","last_active":"2024-09-12T02:29:02.614879+0000","last_peered":"2024-09-12T02:29:02.614879+0000","last_clean":"2024-09-12T02:29:02.614879+0000","last_became_active":"2024-09-12T02:29:02.611155+0000","last_became_peered":"2024-09-12T02:29:02.611155+0000","last_unstale":"2024-09-12T02:29:02.614879+0000","last_undegraded":"2024-09-12T02:29:02.614879+0000","last_fullsized":"2024-09-12T02:29:02.614879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616086+0000","last_change":"2024-09-12T02:29:02.610975+0000","last_active":"2024-09-12T02:29:02.616086+0000","last_peered":"2024-09-12T02:29:02.616086+0000","last_clean":"2024-09-12T02:29:02.616086+0000","last_became_active":"2024-09-12T02:29:02.610711+0000","last_became_peered":"2024-09-12T02:29:02.610711+0000","last_unstale":"2024-09-12T02:29:02.616086+0000","last_undegraded":"2024-09-12T02:29:02.616086+0000","last_fullsized":"2024-09-12T02:29:02.616086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592508+0000","last_change":"2024-09-12T02:29:01.592508+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592508+0000","last_undegraded":"2024-09-12T02:29:01.592508+0000","last_fullsized":"2024-09-12T02:29:01.592508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620634+0000","last_change":"2024-09-12T02:29:02.617285+0000","last_active":"2024-09-12T02:29:02.620634+0000","last_peered":"2024-09-12T02:29:02.620634+0000","last_clean":"2024-09-12T02:29:02.620634+0000","last_became_active":"2024-09-12T02:29:02.617000+0000","last_became_peered":"2024-09-12T02:29:02.617000+0000","last_unstale":"2024-09-12T02:29:02.620634+0000","last_undegraded":"2024-09-12T02:29:02.620634+0000","last_fullsized":"2024-09-12T02:29:02.620634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621177+0000","last_change":"2024-09-12T02:29:02.614642+0000","last_active":"2024-09-12T02:29:02.621177+0000","last_peered":"2024-09-12T02:29:02.621177+0000","last_clean":"2024-09-12T02:29:02.621177+0000","last_became_active":"2024-09-12T02:29:02.614378+0000","last_became_peered":"2024-09-12T02:29:02.614378+0000","last_unstale":"2024-09-12T02:29:02.621177+0000","last_undegraded":"2024-09-12T02:29:02.621177+0000","last_fullsized":"2024-09-12T02:29:02.621177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625610+0000","last_change":"2024-09-12T02:29:02.618923+0000","last_active":"2024-09-12T02:29:02.625610+0000","last_peered":"2024-09-12T02:29:02.625610+0000","last_clean":"2024-09-12T02:29:02.625610+0000","last_became_active":"2024-09-12T02:29:02.618672+0000","last_became_peered":"2024-09-12T02:29:02.618672+0000","last_unstale":"2024-09-12T02:29:02.625610+0000","last_undegraded":"2024-09-12T02:29:02.625610+0000","last_fullsized":"2024-09-12T02:29:02.625610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612121+0000","last_change":"2024-09-12T02:29:02.607465+0000","last_active":"2024-09-12T02:29:02.612121+0000","last_peered":"2024-09-12T02:29:02.612121+0000","last_clean":"2024-09-12T02:29:02.612121+0000","last_became_active":"2024-09-12T02:29:02.607166+0000","last_became_peered":"2024-09-12T02:29:02.607166+0000","last_unstale":"2024-09-12T02:29:02.612121+0000","last_undegraded":"2024-09-12T02:29:02.612121+0000","last_fullsized":"2024-09-12T02:29:02.612121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614453+0000","last_change":"2024-09-12T02:29:02.607409+0000","last_active":"2024-09-12T02:29:02.614453+0000","last_peered":"2024-09-12T02:29:02.614453+0000","last_clean":"2024-09-12T02:29:02.614453+0000","last_became_active":"2024-09-12T02:29:02.607135+0000","last_became_peered":"2024-09-12T02:29:02.607135+0000","last_unstale":"2024-09-12T02:29:02.614453+0000","last_undegraded":"2024-09-12T02:29:02.614453+0000","last_fullsized":"2024-09-12T02:29:02.614453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614876+0000","last_change":"2024-09-12T02:29:02.610003+0000","last_active":"2024-09-12T02:29:02.614876+0000","last_peered":"2024-09-12T02:29:02.614876+0000","last_clean":"2024-09-12T02:29:02.614876+0000","last_became_active":"2024-09-12T02:29:02.609706+0000","last_became_peered":"2024-09-12T02:29:02.609706+0000","last_unstale":"2024-09-12T02:29:02.614876+0000","last_undegraded":"2024-09-12T02:29:02.614876+0000","last_fullsized":"2024-09-12T02:29:02.614876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614771+0000","last_change":"2024-09-12T02:29:02.609713+0000","last_active":"2024-09-12T02:29:02.614771+0000","last_peered":"2024-09-12T02:29:02.614771+0000","last_clean":"2024-09-12T02:29:02.614771+0000","last_became_active":"2024-09-12T02:29:02.609443+0000","last_became_peered":"2024-09-12T02:29:02.609443+0000","last_unstale":"2024-09-12T02:29:02.614771+0000","last_undegraded":"2024-09-12T02:29:02.614771+0000","last_fullsized":"2024-09-12T02:29:02.614771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625719+0000","last_change":"2024-09-12T02:29:01.601092+0000","last_active":"2024-09-12T02:29:02.625719+0000","last_peered":"2024-09-12T02:29:02.625719+0000","last_clean":"2024-09-12T02:29:02.625719+0000","last_became_active":"2024-09-12T02:29:01.600800+0000","last_became_peered":"2024-09-12T02:29:01.600800+0000","last_unstale":"2024-09-12T02:29:02.625719+0000","last_undegraded":"2024-09-12T02:29:02.625719+0000","last_fullsized":"2024-09-12T02:29:02.625719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612633+0000","last_change":"2024-09-12T02:29:02.604002+0000","last_active":"2024-09-12T02:29:02.612633+0000","last_peered":"2024-09-12T02:29:02.612633+0000","last_clean":"2024-09-12T02:29:02.612633+0000","last_became_active":"2024-09-12T02:29:02.603729+0000","last_became_peered":"2024-09-12T02:29:02.603729+0000","last_unstale":"2024-09-12T02:29:02.612633+0000","last_undegraded":"2024-09-12T02:29:02.612633+0000","last_fullsized":"2024-09-12T02:29:02.612633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621841+0000","last_change":"2024-09-12T02:29:01.603395+0000","last_active":"2024-09-12T02:29:02.621841+0000","last_peered":"2024-09-12T02:29:02.621841+0000","last_clean":"2024-09-12T02:29:02.621841+0000","last_became_active":"2024-09-12T02:29:01.602799+0000","last_became_peered":"2024-09-12T02:29:01.602799+0000","last_unstale":"2024-09-12T02:29:02.621841+0000","last_undegraded":"2024-09-12T02:29:02.621841+0000","last_fullsized":"2024-09-12T02:29:02.621841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625432+0000","last_change":"2024-09-12T02:29:02.618545+0000","last_active":"2024-09-12T02:29:02.625432+0000","last_peered":"2024-09-12T02:29:02.625432+0000","last_clean":"2024-09-12T02:29:02.625432+0000","last_became_active":"2024-09-12T02:29:02.618260+0000","last_became_peered":"2024-09-12T02:29:02.618260+0000","last_unstale":"2024-09-12T02:29:02.625432+0000","last_undegraded":"2024-09-12T02:29:02.625432+0000","last_fullsized":"2024-09-12T02:29:02.625432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598422+0000","last_change":"2024-09-12T02:29:01.596866+0000","last_active":"2024-09-12T02:29:01.598422+0000","last_peered":"2024-09-12T02:29:01.598422+0000","last_clean":"2024-09-12T02:29:01.598422+0000","last_became_active":"2024-09-12T02:29:01.596619+0000","last_became_peered":"2024-09-12T02:29:01.596619+0000","last_unstale":"2024-09-12T02:29:01.598422+0000","last_undegraded":"2024-09-12T02:29:01.598422+0000","last_fullsized":"2024-09-12T02:29:01.598422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:57.183138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620599+0000","last_change":"2024-09-12T02:29:02.617228+0000","last_active":"2024-09-12T02:29:02.620599+0000","last_peered":"2024-09-12T02:29:02.620599+0000","last_clean":"2024-09-12T02:29:02.620599+0000","last_became_active":"2024-09-12T02:29:02.616632+0000","last_became_peered":"2024-09-12T02:29:02.616632+0000","last_unstale":"2024-09-12T02:29:02.620599+0000","last_undegraded":"2024-09-12T02:29:02.620599+0000","last_fullsized":"2024-09-12T02:29:02.620599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.597901+0000","last_change":"2024-09-12T02:29:01.592790+0000","last_active":"2024-09-12T02:29:01.597901+0000","last_peered":"2024-09-12T02:29:01.597901+0000","last_clean":"2024-09-12T02:29:01.597901+0000","last_became_active":"2024-09-12T02:29:01.592540+0000","last_became_peered":"2024-09-12T02:29:01.592540+0000","last_unstale":"2024-09-12T02:29:01.597901+0000","last_undegraded":"2024-09-12T02:29:01.597901+0000","last_fullsized":"2024-09-12T02:29:01.597901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.981441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615049+0000","last_change":"2024-09-12T02:29:02.612926+0000","last_active":"2024-09-12T02:29:02.615049+0000","last_peered":"2024-09-12T02:29:02.615049+0000","last_clean":"2024-09-12T02:29:02.615049+0000","last_became_active":"2024-09-12T02:29:02.612684+0000","last_became_peered":"2024-09-12T02:29:02.612684+0000","last_unstale":"2024-09-12T02:29:02.615049+0000","last_undegraded":"2024-09-12T02:29:02.615049+0000","last_fullsized":"2024-09-12T02:29:02.615049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625767+0000","last_change":"2024-09-12T02:29:01.599459+0000","last_active":"2024-09-12T02:29:02.625767+0000","last_peered":"2024-09-12T02:29:02.625767+0000","last_clean":"2024-09-12T02:29:02.625767+0000","last_became_active":"2024-09-12T02:29:01.599152+0000","last_became_peered":"2024-09-12T02:29:01.599152+0000","last_unstale":"2024-09-12T02:29:02.625767+0000","last_undegraded":"2024-09-12T02:29:02.625767+0000","last_fullsized":"2024-09-12T02:29:02.625767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621065+0000","last_change":"2024-09-12T02:29:02.614585+0000","last_active":"2024-09-12T02:29:02.621065+0000","last_peered":"2024-09-12T02:29:02.621065+0000","last_clean":"2024-09-12T02:29:02.621065+0000","last_became_active":"2024-09-12T02:29:02.614301+0000","last_became_peered":"2024-09-12T02:29:02.614301+0000","last_unstale":"2024-09-12T02:29:02.621065+0000","last_undegraded":"2024-09-12T02:29:02.621065+0000","last_fullsized":"2024-09-12T02:29:02.621065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625841+0000","last_change":"2024-09-12T02:29:01.593974+0000","last_active":"2024-09-12T02:29:02.625841+0000","last_peered":"2024-09-12T02:29:02.625841+0000","last_clean":"2024-09-12T02:29:02.625841+0000","last_became_active":"2024-09-12T02:29:01.593658+0000","last_became_peered":"2024-09-12T02:29:01.593658+0000","last_unstale":"2024-09-12T02:29:02.625841+0000","last_undegraded":"2024-09-12T02:29:02.625841+0000","last_fullsized":"2024-09-12T02:29:02.625841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:23.538881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.609403+0000","last_change":"2024-09-12T02:29:02.602008+0000","last_active":"2024-09-12T02:29:02.609403+0000","last_peered":"2024-09-12T02:29:02.609403+0000","last_clean":"2024-09-12T02:29:02.609403+0000","last_became_active":"2024-09-12T02:29:02.601671+0000","last_became_peered":"2024-09-12T02:29:02.601671+0000","last_unstale":"2024-09-12T02:29:02.609403+0000","last_undegraded":"2024-09-12T02:29:02.609403+0000","last_fullsized":"2024-09-12T02:29:02.609403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:57.529582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.601079+0000","last_change":"2024-09-12T02:29:01.599132+0000","last_active":"2024-09-12T02:29:01.601079+0000","last_peered":"2024-09-12T02:29:01.601079+0000","last_clean":"2024-09-12T02:29:01.601079+0000","last_became_active":"2024-09-12T02:29:01.598859+0000","last_became_peered":"2024-09-12T02:29:01.598859+0000","last_unstale":"2024-09-12T02:29:01.601079+0000","last_undegraded":"2024-09-12T02:29:01.601079+0000","last_fullsized":"2024-09-12T02:29:01.601079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:00.893583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616148+0000","last_change":"2024-09-12T02:29:02.612688+0000","last_active":"2024-09-12T02:29:02.616148+0000","last_peered":"2024-09-12T02:29:02.616148+0000","last_clean":"2024-09-12T02:29:02.616148+0000","last_became_active":"2024-09-12T02:29:02.612433+0000","last_became_peered":"2024-09-12T02:29:02.612433+0000","last_unstale":"2024-09-12T02:29:02.616148+0000","last_undegraded":"2024-09-12T02:29:02.616148+0000","last_fullsized":"2024-09-12T02:29:02.616148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596822+0000","last_change":"2024-09-12T02:29:01.591494+0000","last_active":"2024-09-12T02:29:02.596822+0000","last_peered":"2024-09-12T02:29:02.596822+0000","last_clean":"2024-09-12T02:29:02.596822+0000","last_became_active":"2024-09-12T02:29:01.591190+0000","last_became_peered":"2024-09-12T02:29:01.591190+0000","last_unstale":"2024-09-12T02:29:02.596822+0000","last_undegraded":"2024-09-12T02:29:02.596822+0000","last_fullsized":"2024-09-12T02:29:02.596822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.939513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622766+0000","last_change":"2024-09-12T02:29:02.619913+0000","last_active":"2024-09-12T02:29:02.622766+0000","last_peered":"2024-09-12T02:29:02.622766+0000","last_clean":"2024-09-12T02:29:02.622766+0000","last_became_active":"2024-09-12T02:29:02.619304+0000","last_became_peered":"2024-09-12T02:29:02.619304+0000","last_unstale":"2024-09-12T02:29:02.622766+0000","last_undegraded":"2024-09-12T02:29:02.622766+0000","last_fullsized":"2024-09-12T02:29:02.622766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.348921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.604457+0000","last_change":"2024-09-12T02:29:01.602933+0000","last_active":"2024-09-12T02:29:01.604457+0000","last_peered":"2024-09-12T02:29:01.604457+0000","last_clean":"2024-09-12T02:29:01.604457+0000","last_became_active":"2024-09-12T02:29:01.602627+0000","last_became_peered":"2024-09-12T02:29:01.602627+0000","last_unstale":"2024-09-12T02:29:01.604457+0000","last_undegraded":"2024-09-12T02:29:01.604457+0000","last_fullsized":"2024-09-12T02:29:01.604457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:20.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.594568+0000","last_change":"2024-09-12T02:29:01.594568+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.594568+0000","last_undegraded":"2024-09-12T02:29:01.594568+0000","last_fullsized":"2024-09-12T02:29:01.594568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601453+0000","last_change":"2024-09-12T02:29:01.599918+0000","last_active":"2024-09-12T02:29:02.601453+0000","last_peered":"2024-09-12T02:29:02.601453+0000","last_clean":"2024-09-12T02:29:02.601453+0000","last_became_active":"2024-09-12T02:29:01.599628+0000","last_became_peered":"2024-09-12T02:29:01.599628+0000","last_unstale":"2024-09-12T02:29:02.601453+0000","last_undegraded":"2024-09-12T02:29:02.601453+0000","last_fullsized":"2024-09-12T02:29:02.601453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590800+0000","last_change":"2024-09-12T02:29:01.590800+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590800+0000","last_undegraded":"2024-09-12T02:29:01.590800+0000","last_fullsized":"2024-09-12T02:29:01.590800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.626194+0000","last_change":"2024-09-12T02:29:01.605522+0000","last_active":"2024-09-12T02:29:02.626194+0000","last_peered":"2024-09-12T02:29:02.626194+0000","last_clean":"2024-09-12T02:29:02.626194+0000","last_became_active":"2024-09-12T02:29:01.605265+0000","last_became_peered":"2024-09-12T02:29:01.605265+0000","last_unstale":"2024-09-12T02:29:02.626194+0000","last_undegraded":"2024-09-12T02:29:02.626194+0000","last_fullsized":"2024-09-12T02:29:02.626194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.872408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622682+0000","last_change":"2024-09-12T02:29:02.618134+0000","last_active":"2024-09-12T02:29:02.622682+0000","last_peered":"2024-09-12T02:29:02.622682+0000","last_clean":"2024-09-12T02:29:02.622682+0000","last_became_active":"2024-09-12T02:29:02.617667+0000","last_became_peered":"2024-09-12T02:29:02.617667+0000","last_unstale":"2024-09-12T02:29:02.622682+0000","last_undegraded":"2024-09-12T02:29:02.622682+0000","last_fullsized":"2024-09-12T02:29:02.622682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598457+0000","last_change":"2024-09-12T02:29:01.595079+0000","last_active":"2024-09-12T02:29:01.598457+0000","last_peered":"2024-09-12T02:29:01.598457+0000","last_clean":"2024-09-12T02:29:01.598457+0000","last_became_active":"2024-09-12T02:29:01.594811+0000","last_became_peered":"2024-09-12T02:29:01.594811+0000","last_unstale":"2024-09-12T02:29:01.598457+0000","last_undegraded":"2024-09-12T02:29:01.598457+0000","last_fullsized":"2024-09-12T02:29:01.598457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:35.663288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616231+0000","last_change":"2024-09-12T02:29:02.613674+0000","last_active":"2024-09-12T02:29:02.616231+0000","last_peered":"2024-09-12T02:29:02.616231+0000","last_clean":"2024-09-12T02:29:02.616231+0000","last_became_active":"2024-09-12T02:29:02.613418+0000","last_became_peered":"2024-09-12T02:29:02.613418+0000","last_unstale":"2024-09-12T02:29:02.616231+0000","last_undegraded":"2024-09-12T02:29:02.616231+0000","last_fullsized":"2024-09-12T02:29:02.616231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625565+0000","last_change":"2024-09-12T02:29:01.593677+0000","last_active":"2024-09-12T02:29:02.625565+0000","last_peered":"2024-09-12T02:29:02.625565+0000","last_clean":"2024-09-12T02:29:02.625565+0000","last_became_active":"2024-09-12T02:29:01.593403+0000","last_became_peered":"2024-09-12T02:29:01.593403+0000","last_unstale":"2024-09-12T02:29:02.625565+0000","last_undegraded":"2024-09-12T02:29:02.625565+0000","last_fullsized":"2024-09-12T02:29:02.625565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592274+0000","last_change":"2024-09-12T02:29:01.592274+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592274+0000","last_undegraded":"2024-09-12T02:29:01.592274+0000","last_fullsized":"2024-09-12T02:29:01.592274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603704+0000","last_change":"2024-09-12T02:29:01.600635+0000","last_active":"2024-09-12T02:29:02.603704+0000","last_peered":"2024-09-12T02:29:02.603704+0000","last_clean":"2024-09-12T02:29:02.603704+0000","last_became_active":"2024-09-12T02:29:01.600147+0000","last_became_peered":"2024-09-12T02:29:01.600147+0000","last_unstale":"2024-09-12T02:29:02.603704+0000","last_undegraded":"2024-09-12T02:29:02.603704+0000","last_fullsized":"2024-09-12T02:29:02.603704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614900+0000","last_change":"2024-09-12T02:29:02.610088+0000","last_active":"2024-09-12T02:29:02.614900+0000","last_peered":"2024-09-12T02:29:02.614900+0000","last_clean":"2024-09-12T02:29:02.614900+0000","last_became_active":"2024-09-12T02:29:02.609800+0000","last_became_peered":"2024-09-12T02:29:02.609800+0000","last_unstale":"2024-09-12T02:29:02.614900+0000","last_undegraded":"2024-09-12T02:29:02.614900+0000","last_fullsized":"2024-09-12T02:29:02.614900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599261+0000","last_change":"2024-09-12T02:29:01.597990+0000","last_active":"2024-09-12T02:29:01.599261+0000","last_peered":"2024-09-12T02:29:01.599261+0000","last_clean":"2024-09-12T02:29:01.599261+0000","last_became_active":"2024-09-12T02:29:01.597733+0000","last_became_peered":"2024-09-12T02:29:01.597733+0000","last_unstale":"2024-09-12T02:29:01.599261+0000","last_undegraded":"2024-09-12T02:29:01.599261+0000","last_fullsized":"2024-09-12T02:29:01.599261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:46.537630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612439+0000","last_change":"2024-09-12T02:29:02.605133+0000","last_active":"2024-09-12T02:29:02.612439+0000","last_peered":"2024-09-12T02:29:02.612439+0000","last_clean":"2024-09-12T02:29:02.612439+0000","last_became_active":"2024-09-12T02:29:02.604822+0000","last_became_peered":"2024-09-12T02:29:02.604822+0000","last_unstale":"2024-09-12T02:29:02.612439+0000","last_undegraded":"2024-09-12T02:29:02.612439+0000","last_fullsized":"2024-09-12T02:29:02.612439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598320+0000","last_change":"2024-09-12T02:29:01.594764+0000","last_active":"2024-09-12T02:29:01.598320+0000","last_peered":"2024-09-12T02:29:01.598320+0000","last_clean":"2024-09-12T02:29:01.598320+0000","last_became_active":"2024-09-12T02:29:01.594268+0000","last_became_peered":"2024-09-12T02:29:01.594268+0000","last_unstale":"2024-09-12T02:29:01.598320+0000","last_undegraded":"2024-09-12T02:29:01.598320+0000","last_fullsized":"2024-09-12T02:29:01.598320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:35.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617256+0000","last_change":"2024-09-12T02:29:02.611999+0000","last_active":"2024-09-12T02:29:02.617256+0000","last_peered":"2024-09-12T02:29:02.617256+0000","last_clean":"2024-09-12T02:29:02.617256+0000","last_became_active":"2024-09-12T02:29:02.611694+0000","last_became_peered":"2024-09-12T02:29:02.611694+0000","last_unstale":"2024-09-12T02:29:02.617256+0000","last_undegraded":"2024-09-12T02:29:02.617256+0000","last_fullsized":"2024-09-12T02:29:02.617256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:01.602071+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:01.601793+0000","last_became_peered":"2024-09-12T02:29:01.601793+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622619+0000","last_change":"2024-09-12T02:29:02.616753+0000","last_active":"2024-09-12T02:29:02.622619+0000","last_peered":"2024-09-12T02:29:02.622619+0000","last_clean":"2024-09-12T02:29:02.622619+0000","last_became_active":"2024-09-12T02:29:02.616476+0000","last_became_peered":"2024-09-12T02:29:02.616476+0000","last_unstale":"2024-09-12T02:29:02.622619+0000","last_undegraded":"2024-09-12T02:29:02.622619+0000","last_fullsized":"2024-09-12T02:29:02.622619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625356+0000","last_change":"2024-09-12T02:29:01.600094+0000","last_active":"2024-09-12T02:29:02.625356+0000","last_peered":"2024-09-12T02:29:02.625356+0000","last_clean":"2024-09-12T02:29:02.625356+0000","last_became_active":"2024-09-12T02:29:01.599825+0000","last_became_peered":"2024-09-12T02:29:01.599825+0000","last_unstale":"2024-09-12T02:29:02.625356+0000","last_undegraded":"2024-09-12T02:29:02.625356+0000","last_fullsized":"2024-09-12T02:29:02.625356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620396+0000","last_change":"2024-09-12T02:29:02.616662+0000","last_active":"2024-09-12T02:29:02.620396+0000","last_peered":"2024-09-12T02:29:02.620396+0000","last_clean":"2024-09-12T02:29:02.620396+0000","last_became_active":"2024-09-12T02:29:02.616348+0000","last_became_peered":"2024-09-12T02:29:02.616348+0000","last_unstale":"2024-09-12T02:29:02.620396+0000","last_undegraded":"2024-09-12T02:29:02.620396+0000","last_fullsized":"2024-09-12T02:29:02.620396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625350+0000","last_change":"2024-09-12T02:29:01.601320+0000","last_active":"2024-09-12T02:29:02.625350+0000","last_peered":"2024-09-12T02:29:02.625350+0000","last_clean":"2024-09-12T02:29:02.625350+0000","last_became_active":"2024-09-12T02:29:01.601010+0000","last_became_peered":"2024-09-12T02:29:01.601010+0000","last_unstale":"2024-09-12T02:29:02.625350+0000","last_undegraded":"2024-09-12T02:29:02.625350+0000","last_fullsized":"2024-09-12T02:29:02.625350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:18.815610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586743+0000","last_change":"2024-09-12T02:29:01.586743+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586743+0000","last_undegraded":"2024-09-12T02:29:01.586743+0000","last_fullsized":"2024-09-12T02:29:01.586743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.599422+0000","last_change":"2024-09-12T02:29:01.599517+0000","last_active":"2024-09-12T02:29:02.599422+0000","last_peered":"2024-09-12T02:29:02.599422+0000","last_clean":"2024-09-12T02:29:02.599422+0000","last_became_active":"2024-09-12T02:29:01.599119+0000","last_became_peered":"2024-09-12T02:29:01.599119+0000","last_unstale":"2024-09-12T02:29:02.599422+0000","last_undegraded":"2024-09-12T02:29:02.599422+0000","last_fullsized":"2024-09-12T02:29:02.599422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:50.828257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586572+0000","last_change":"2024-09-12T02:29:01.586572+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586572+0000","last_undegraded":"2024-09-12T02:29:01.586572+0000","last_fullsized":"2024-09-12T02:29:01.586572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625037+0000","last_change":"2024-09-12T02:29:01.602422+0000","last_active":"2024-09-12T02:29:02.625037+0000","last_peered":"2024-09-12T02:29:02.625037+0000","last_clean":"2024-09-12T02:29:02.625037+0000","last_became_active":"2024-09-12T02:29:01.602077+0000","last_became_peered":"2024-09-12T02:29:01.602077+0000","last_unstale":"2024-09-12T02:29:02.625037+0000","last_undegraded":"2024-09-12T02:29:02.625037+0000","last_fullsized":"2024-09-12T02:29:02.625037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586513+0000","last_change":"2024-09-12T02:29:01.586513+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586513+0000","last_undegraded":"2024-09-12T02:29:01.586513+0000","last_fullsized":"2024-09-12T02:29:01.586513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597708+0000","last_change":"2024-09-12T02:29:01.597327+0000","last_active":"2024-09-12T02:29:02.597708+0000","last_peered":"2024-09-12T02:29:02.597708+0000","last_clean":"2024-09-12T02:29:02.597708+0000","last_became_active":"2024-09-12T02:29:01.596766+0000","last_became_peered":"2024-09-12T02:29:01.596766+0000","last_unstale":"2024-09-12T02:29:02.597708+0000","last_undegraded":"2024-09-12T02:29:02.597708+0000","last_fullsized":"2024-09-12T02:29:02.597708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587988+0000","last_change":"2024-09-12T02:29:01.587988+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587988+0000","last_undegraded":"2024-09-12T02:29:01.587988+0000","last_fullsized":"2024-09-12T02:29:01.587988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597669+0000","last_change":"2024-09-12T02:29:01.594610+0000","last_active":"2024-09-12T02:29:02.597669+0000","last_peered":"2024-09-12T02:29:02.597669+0000","last_clean":"2024-09-12T02:29:02.597669+0000","last_became_active":"2024-09-12T02:29:01.594373+0000","last_became_peered":"2024-09-12T02:29:01.594373+0000","last_unstale":"2024-09-12T02:29:02.597669+0000","last_undegraded":"2024-09-12T02:29:02.597669+0000","last_fullsized":"2024-09-12T02:29:02.597669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:09.467337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615086+0000","last_change":"2024-09-12T02:29:02.613333+0000","last_active":"2024-09-12T02:29:02.615086+0000","last_peered":"2024-09-12T02:29:02.615086+0000","last_clean":"2024-09-12T02:29:02.615086+0000","last_became_active":"2024-09-12T02:29:02.613020+0000","last_became_peered":"2024-09-12T02:29:02.613020+0000","last_unstale":"2024-09-12T02:29:02.615086+0000","last_undegraded":"2024-09-12T02:29:02.615086+0000","last_fullsized":"2024-09-12T02:29:02.615086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.606014+0000","last_change":"2024-09-12T02:29:01.600161+0000","last_active":"2024-09-12T02:29:02.606014+0000","last_peered":"2024-09-12T02:29:02.606014+0000","last_clean":"2024-09-12T02:29:02.606014+0000","last_became_active":"2024-09-12T02:29:01.599858+0000","last_became_peered":"2024-09-12T02:29:01.599858+0000","last_unstale":"2024-09-12T02:29:02.606014+0000","last_undegraded":"2024-09-12T02:29:02.606014+0000","last_fullsized":"2024-09-12T02:29:02.606014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:59.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586026+0000","last_change":"2024-09-12T02:29:01.586026+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586026+0000","last_undegraded":"2024-09-12T02:29:01.586026+0000","last_fullsized":"2024-09-12T02:29:01.586026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625648+0000","last_change":"2024-09-12T02:29:01.604076+0000","last_active":"2024-09-12T02:29:02.625648+0000","last_peered":"2024-09-12T02:29:02.625648+0000","last_clean":"2024-09-12T02:29:02.625648+0000","last_became_active":"2024-09-12T02:29:01.603786+0000","last_became_peered":"2024-09-12T02:29:01.603786+0000","last_unstale":"2024-09-12T02:29:02.625648+0000","last_undegraded":"2024-09-12T02:29:02.625648+0000","last_fullsized":"2024-09-12T02:29:02.625648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:02.920830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614961+0000","last_change":"2024-09-12T02:29:02.611837+0000","last_active":"2024-09-12T02:29:02.614961+0000","last_peered":"2024-09-12T02:29:02.614961+0000","last_clean":"2024-09-12T02:29:02.614961+0000","last_became_active":"2024-09-12T02:29:02.611576+0000","last_became_peered":"2024-09-12T02:29:02.611576+0000","last_unstale":"2024-09-12T02:29:02.614961+0000","last_undegraded":"2024-09-12T02:29:02.614961+0000","last_fullsized":"2024-09-12T02:29:02.614961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601352+0000","last_change":"2024-09-12T02:29:01.596912+0000","last_active":"2024-09-12T02:29:02.601352+0000","last_peered":"2024-09-12T02:29:02.601352+0000","last_clean":"2024-09-12T02:29:02.601352+0000","last_became_active":"2024-09-12T02:29:01.596630+0000","last_became_peered":"2024-09-12T02:29:01.596630+0000","last_unstale":"2024-09-12T02:29:02.601352+0000","last_undegraded":"2024-09-12T02:29:02.601352+0000","last_fullsized":"2024-09-12T02:29:02.601352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615648+0000","last_change":"2024-09-12T02:29:02.612642+0000","last_active":"2024-09-12T02:29:02.615648+0000","last_peered":"2024-09-12T02:29:02.615648+0000","last_clean":"2024-09-12T02:29:02.615648+0000","last_became_active":"2024-09-12T02:29:02.611562+0000","last_became_peered":"2024-09-12T02:29:02.611562+0000","last_unstale":"2024-09-12T02:29:02.615648+0000","last_undegraded":"2024-09-12T02:29:02.615648+0000","last_fullsized":"2024-09-12T02:29:02.615648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603588+0000","last_change":"2024-09-12T02:29:01.598396+0000","last_active":"2024-09-12T02:29:02.603588+0000","last_peered":"2024-09-12T02:29:02.603588+0000","last_clean":"2024-09-12T02:29:02.603588+0000","last_became_active":"2024-09-12T02:29:01.598101+0000","last_became_peered":"2024-09-12T02:29:01.598101+0000","last_unstale":"2024-09-12T02:29:02.603588+0000","last_undegraded":"2024-09-12T02:29:02.603588+0000","last_fullsized":"2024-09-12T02:29:02.603588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614058+0000","last_change":"2024-09-12T02:29:02.611150+0000","last_active":"2024-09-12T02:29:02.614058+0000","last_peered":"2024-09-12T02:29:02.614058+0000","last_clean":"2024-09-12T02:29:02.614058+0000","last_became_active":"2024-09-12T02:29:02.610804+0000","last_became_peered":"2024-09-12T02:29:02.610804+0000","last_unstale":"2024-09-12T02:29:02.614058+0000","last_undegraded":"2024-09-12T02:29:02.614058+0000","last_fullsized":"2024-09-12T02:29:02.614058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601328+0000","last_change":"2024-09-12T02:29:01.603466+0000","last_active":"2024-09-12T02:29:02.601328+0000","last_peered":"2024-09-12T02:29:02.601328+0000","last_clean":"2024-09-12T02:29:02.601328+0000","last_became_active":"2024-09-12T02:29:01.603162+0000","last_became_peered":"2024-09-12T02:29:01.603162+0000","last_unstale":"2024-09-12T02:29:02.601328+0000","last_undegraded":"2024-09-12T02:29:02.601328+0000","last_fullsized":"2024-09-12T02:29:02.601328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617426+0000","last_change":"2024-09-12T02:29:02.615106+0000","last_active":"2024-09-12T02:29:02.617426+0000","last_peered":"2024-09-12T02:29:02.617426+0000","last_clean":"2024-09-12T02:29:02.617426+0000","last_became_active":"2024-09-12T02:29:02.614701+0000","last_became_peered":"2024-09-12T02:29:02.614701+0000","last_unstale":"2024-09-12T02:29:02.617426+0000","last_undegraded":"2024-09-12T02:29:02.617426+0000","last_fullsized":"2024-09-12T02:29:02.617426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603855+0000","last_change":"2024-09-12T02:29:01.602856+0000","last_active":"2024-09-12T02:29:02.603855+0000","last_peered":"2024-09-12T02:29:02.603855+0000","last_clean":"2024-09-12T02:29:02.603855+0000","last_became_active":"2024-09-12T02:29:01.602602+0000","last_became_peered":"2024-09-12T02:29:01.602602+0000","last_unstale":"2024-09-12T02:29:02.603855+0000","last_undegraded":"2024-09-12T02:29:02.603855+0000","last_fullsized":"2024-09-12T02:29:02.603855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587573+0000","last_change":"2024-09-12T02:29:01.587573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587573+0000","last_undegraded":"2024-09-12T02:29:01.587573+0000","last_fullsized":"2024-09-12T02:29:01.587573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597837+0000","last_change":"2024-09-12T02:29:01.602771+0000","last_active":"2024-09-12T02:29:02.597837+0000","last_peered":"2024-09-12T02:29:02.597837+0000","last_clean":"2024-09-12T02:29:02.597837+0000","last_became_active":"2024-09-12T02:29:01.602503+0000","last_became_peered":"2024-09-12T02:29:01.602503+0000","last_unstale":"2024-09-12T02:29:02.597837+0000","last_undegraded":"2024-09-12T02:29:02.597837+0000","last_fullsized":"2024-09-12T02:29:02.597837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:25.395144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625226+0000","last_change":"2024-09-12T02:29:02.618017+0000","last_active":"2024-09-12T02:29:02.625226+0000","last_peered":"2024-09-12T02:29:02.625226+0000","last_clean":"2024-09-12T02:29:02.625226+0000","last_became_active":"2024-09-12T02:29:02.617733+0000","last_became_peered":"2024-09-12T02:29:02.617733+0000","last_unstale":"2024-09-12T02:29:02.625226+0000","last_undegraded":"2024-09-12T02:29:02.625226+0000","last_fullsized":"2024-09-12T02:29:02.625226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599135+0000","last_change":"2024-09-12T02:29:01.597751+0000","last_active":"2024-09-12T02:29:01.599135+0000","last_peered":"2024-09-12T02:29:01.599135+0000","last_clean":"2024-09-12T02:29:01.599135+0000","last_became_active":"2024-09-12T02:29:01.597513+0000","last_became_peered":"2024-09-12T02:29:01.597513+0000","last_unstale":"2024-09-12T02:29:01.599135+0000","last_undegraded":"2024-09-12T02:29:01.599135+0000","last_fullsized":"2024-09-12T02:29:01.599135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.741427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612062+0000","last_change":"2024-09-12T02:29:02.608831+0000","last_active":"2024-09-12T02:29:02.612062+0000","last_peered":"2024-09-12T02:29:02.612062+0000","last_clean":"2024-09-12T02:29:02.612062+0000","last_became_active":"2024-09-12T02:29:02.608580+0000","last_became_peered":"2024-09-12T02:29:02.608580+0000","last_unstale":"2024-09-12T02:29:02.612062+0000","last_undegraded":"2024-09-12T02:29:02.612062+0000","last_fullsized":"2024-09-12T02:29:02.612062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596538+0000","last_change":"2024-09-12T02:29:01.600549+0000","last_active":"2024-09-12T02:29:02.596538+0000","last_peered":"2024-09-12T02:29:02.596538+0000","last_clean":"2024-09-12T02:29:02.596538+0000","last_became_active":"2024-09-12T02:29:01.600196+0000","last_became_peered":"2024-09-12T02:29:01.600196+0000","last_unstale":"2024-09-12T02:29:02.596538+0000","last_undegraded":"2024-09-12T02:29:02.596538+0000","last_fullsized":"2024-09-12T02:29:02.596538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.600032+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:02.600032+0000","last_peered":"2024-09-12T02:29:02.600032+0000","last_clean":"2024-09-12T02:29:02.600032+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:02.600032+0000","last_undegraded":"2024-09-12T02:29:02.600032+0000","last_fullsized":"2024-09-12T02:29:02.600032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":128859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:05.542 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:05.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.678+0000 7ff66dbfd640 1 Processor -- start 2024-09-12T02:29:05.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.678+0000 7ff66dbfd640 1 -- start start 2024-09-12T02:29:05.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff66dbfd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff6680b26c0 0x7ff668073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff66dbfd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6680ce210 con 0x7ff6680cf9d0 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff66dbfd640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6680ce4f0 con 0x7ff66815c3f0 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff66dbfd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff66815c7d0 con 0x7ff6680b26c0 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff666ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff6680cf9d0 0x7ff6680b1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51622/0 (socket says 172.21.15.181:51622) 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff666ffd640 1 -- 172.21.15.181:0/2622170736 learned_addr learned my addr 172.21.15.181:0/2622170736 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168693182 0 0) 0x7ff6680ce210 con 0x7ff6680cf9d0 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff650003520 con 0x7ff6680cf9d0 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff667fff640 1 --2- 172.21.15.181:0/2622170736 >> v2:172.21.15.204:3300/0 conn(0x7ff6680b26c0 0x7ff668073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3313673628 0 0) 0x7ff650003520 con 0x7ff6680cf9d0 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 >> v2:172.21.15.204:3300/0 conn(0x7ff6680b26c0 msgr2=0x7ff668073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.679+0000 7ff6667fc640 1 --2- 172.21.15.181:0/2622170736 >> v2:172.21.15.204:3300/0 conn(0x7ff6680b26c0 0x7ff668073280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 >> v1:172.21.15.204:6789/0 conn(0x7ff66815c3f0 legacy=0x7ff6680cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6680ce7d0 con 0x7ff6680cf9d0 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7ff65c001690 con 0x7ff6680cf9d0 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 >> v1:172.21.15.181:6789/0 conn(0x7ff6680cf9d0 legacy=0x7ff6680b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6500039b0 0x7ff650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff650004800 0x7ff650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6500051c0 0x7ff65000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff66815c7d0 con 0x7ff650004800 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff65000c060 con 0x7ff6500039b0 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff65000c260 con 0x7ff6500051c0 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff666ffd640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff650004800 0x7ff650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff6677fe640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6500039b0 0x7ff650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff667fff640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6500051c0 0x7ff65000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff666ffd640 1 -- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6500051c0 msgr2=0x7ff65000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:05.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff666ffd640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6500051c0 0x7ff65000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff666ffd640 1 -- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6500039b0 msgr2=0x7ff650003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff666ffd640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6500039b0 0x7ff650003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff666ffd640 1 -- 172.21.15.181:0/2622170736 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff650003520 con 0x7ff650004800 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff667fff640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6500051c0 0x7ff65000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.680+0000 7ff667fff640 1 -- 172.21.15.181:0/2622170736 reap_dead start 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff666ffd640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff650004800 0x7ff650004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c210 tx=0x7ff650005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0a635b2bdb5906 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c007d30 con 0x7ff650004800 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c02e070 con 0x7ff650004800 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff6667fc640 1 -- 172.21.15.181:0/2622170736 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c005d30 con 0x7ff650004800 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff66dbfd640 1 -- 172.21.15.181:0/2622170736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff650004800 msgr2=0x7ff650004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff650004800 0x7ff650004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c210 tx=0x7ff650005830 comp rx=0 tx=0).stop 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff66dbfd640 1 -- 172.21.15.181:0/2622170736 shutdown_connections 2024-09-12T02:29:05.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/2622170736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff650004800 0x7ff650004c80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.681+0000 7ff66dbfd640 1 -- 172.21.15.181:0/2622170736 >> 172.21.15.181:0/2622170736 conn(0x7ff66806bc10 msgr2=0x7ff66806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:05.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.682+0000 7ff66dbfd640 1 -- 172.21.15.181:0/2622170736 shutdown_connections 2024-09-12T02:29:05.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.682+0000 7ff66dbfd640 1 -- 172.21.15.181:0/2622170736 wait complete. 2024-09-12T02:29:05.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.683+0000 7ff66dbfd640 1 Processor -- start 2024-09-12T02:29:05.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.683+0000 7ff66dbfd640 1 -- start start 2024-09-12T02:29:05.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff650004800 0x7ff66814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff66815dea0 0x7ff668147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff668152700 0x7ff668152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680b1fb0 con 0x7ff668152700 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680cdfc0 con 0x7ff66815dea0 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff6680b2130 con 0x7ff650004800 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff668152700 0x7ff668152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff668152700 0x7ff668152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53656/0 (socket says 172.21.15.181:53656) 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 -- 172.21.15.181:0/3299458645 learned_addr learned my addr 172.21.15.181:0/3299458645 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff6677fe640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff650004800 0x7ff66814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff666ffd640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff66815dea0 0x7ff668147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 -- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff650004800 msgr2=0x7ff66814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff650004800 0x7ff66814c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 -- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff66815dea0 msgr2=0x7ff668147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff66815dea0 0x7ff668147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 -- 172.21.15.181:0/3299458645 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66815e680 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff667fff640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff668152700 0x7ff668152b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6680b2e80 tx=0x7ff6600115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff64ffff640 1 -- 172.21.15.181:0/3299458645 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660011db0 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff64ffff640 1 -- 172.21.15.181:0/3299458645 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66001c070 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66815e960 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff64ffff640 1 -- 172.21.15.181:0/3299458645 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6600166b0 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.684+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66815ef20 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.685+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6680cf2c0 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.686+0000 7ff64ffff640 1 -- 172.21.15.181:0/3299458645 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff660005d10 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.686+0000 7ff64ffff640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff65406be60 0x7ff65406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.686+0000 7ff64ffff640 1 -- 172.21.15.181:0/3299458645 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff66008b6c0 con 0x7ff668152700 2024-09-12T02:29:05.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.686+0000 7ff6677fe640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff65406be60 0x7ff65406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.687+0000 7ff6677fe640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff65406be60 0x7ff65406e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff658000c00 tx=0x7ff658009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:05.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.691+0000 7ff64ffff640 1 -- 172.21.15.181:0/3299458645 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff660026020 con 0x7ff668152700 2024-09-12T02:29:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.852+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff668072c50 con 0x7ff65406be60 2024-09-12T02:29:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.858+0000 7ff64ffff640 1 -- 172.21.15.181:0/3299458645 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250408 (secure 0 0 0) 0x7ff668072c50 con 0x7ff65406be60 2024-09-12T02:29:05.861 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff65406be60 msgr2=0x7ff65406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff65406be60 0x7ff65406e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff658000c00 tx=0x7ff658009040 comp rx=0 tx=0).stop 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff668152700 msgr2=0x7ff668152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff668152700 0x7ff668152b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6680b2e80 tx=0x7ff6600115a0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 shutdown_connections 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff65406be60 0x7ff65406e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff66815dea0 0x7ff668147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff668152700 0x7ff668152b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 --2- 172.21.15.181:0/3299458645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff650004800 0x7ff66814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 >> 172.21.15.181:0/3299458645 conn(0x7ff66806bc10 msgr2=0x7ff66806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:05.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 shutdown_connections 2024-09-12T02:29:05.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:05.861+0000 7ff66dbfd640 1 -- 172.21.15.181:0/3299458645 wait complete. 2024-09-12T02:29:05.872 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-12T02:29:05.620405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219952,"kb_used_data":3708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754768,"statfs":{"total":773094113280,"available":772868882432,"internally_reserved":0,"allocated":3796992,"data_stored":2151649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040652"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621991+0000","last_change":"2024-09-12T02:29:02.616935+0000","last_active":"2024-09-12T02:29:02.621991+0000","last_peered":"2024-09-12T02:29:02.621991+0000","last_clean":"2024-09-12T02:29:02.621991+0000","last_became_active":"2024-09-12T02:29:02.616651+0000","last_became_peered":"2024-09-12T02:29:02.616651+0000","last_unstale":"2024-09-12T02:29:02.621991+0000","last_undegraded":"2024-09-12T02:29:02.621991+0000","last_fullsized":"2024-09-12T02:29:02.621991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.593315+0000","last_change":"2024-09-12T02:29:01.593315+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.593315+0000","last_undegraded":"2024-09-12T02:29:01.593315+0000","last_fullsized":"2024-09-12T02:29:01.593315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622654+0000","last_change":"2024-09-12T02:29:02.617918+0000","last_active":"2024-09-12T02:29:02.622654+0000","last_peered":"2024-09-12T02:29:02.622654+0000","last_clean":"2024-09-12T02:29:02.622654+0000","last_became_active":"2024-09-12T02:29:02.617296+0000","last_became_peered":"2024-09-12T02:29:02.617296+0000","last_unstale":"2024-09-12T02:29:02.622654+0000","last_undegraded":"2024-09-12T02:29:02.622654+0000","last_fullsized":"2024-09-12T02:29:02.622654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620632+0000","last_change":"2024-09-12T02:29:02.617491+0000","last_active":"2024-09-12T02:29:02.620632+0000","last_peered":"2024-09-12T02:29:02.620632+0000","last_clean":"2024-09-12T02:29:02.620632+0000","last_became_active":"2024-09-12T02:29:02.617229+0000","last_became_peered":"2024-09-12T02:29:02.617229+0000","last_unstale":"2024-09-12T02:29:02.620632+0000","last_undegraded":"2024-09-12T02:29:02.620632+0000","last_fullsized":"2024-09-12T02:29:02.620632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587614+0000","last_change":"2024-09-12T02:29:01.587614+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587614+0000","last_undegraded":"2024-09-12T02:29:01.587614+0000","last_fullsized":"2024-09-12T02:29:01.587614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590003+0000","last_change":"2024-09-12T02:29:01.590003+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590003+0000","last_undegraded":"2024-09-12T02:29:01.590003+0000","last_fullsized":"2024-09-12T02:29:01.590003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615107+0000","last_change":"2024-09-12T02:29:02.613356+0000","last_active":"2024-09-12T02:29:02.615107+0000","last_peered":"2024-09-12T02:29:02.615107+0000","last_clean":"2024-09-12T02:29:02.615107+0000","last_became_active":"2024-09-12T02:29:02.613093+0000","last_became_peered":"2024-09-12T02:29:02.613093+0000","last_unstale":"2024-09-12T02:29:02.615107+0000","last_undegraded":"2024-09-12T02:29:02.615107+0000","last_fullsized":"2024-09-12T02:29:02.615107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612094+0000","last_change":"2024-09-12T02:29:02.608265+0000","last_active":"2024-09-12T02:29:02.612094+0000","last_peered":"2024-09-12T02:29:02.612094+0000","last_clean":"2024-09-12T02:29:02.612094+0000","last_became_active":"2024-09-12T02:29:02.607991+0000","last_became_peered":"2024-09-12T02:29:02.607991+0000","last_unstale":"2024-09-12T02:29:02.612094+0000","last_undegraded":"2024-09-12T02:29:02.612094+0000","last_fullsized":"2024-09-12T02:29:02.612094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615727+0000","last_change":"2024-09-12T02:29:02.608629+0000","last_active":"2024-09-12T02:29:02.615727+0000","last_peered":"2024-09-12T02:29:02.615727+0000","last_clean":"2024-09-12T02:29:02.615727+0000","last_became_active":"2024-09-12T02:29:02.608224+0000","last_became_peered":"2024-09-12T02:29:02.608224+0000","last_unstale":"2024-09-12T02:29:02.615727+0000","last_undegraded":"2024-09-12T02:29:02.615727+0000","last_fullsized":"2024-09-12T02:29:02.615727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625722+0000","last_change":"2024-09-12T02:29:02.618718+0000","last_active":"2024-09-12T02:29:02.625722+0000","last_peered":"2024-09-12T02:29:02.625722+0000","last_clean":"2024-09-12T02:29:02.625722+0000","last_became_active":"2024-09-12T02:29:02.618431+0000","last_became_peered":"2024-09-12T02:29:02.618431+0000","last_unstale":"2024-09-12T02:29:02.625722+0000","last_undegraded":"2024-09-12T02:29:02.625722+0000","last_fullsized":"2024-09-12T02:29:02.625722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615135+0000","last_change":"2024-09-12T02:29:02.612372+0000","last_active":"2024-09-12T02:29:02.615135+0000","last_peered":"2024-09-12T02:29:02.615135+0000","last_clean":"2024-09-12T02:29:02.615135+0000","last_became_active":"2024-09-12T02:29:02.612114+0000","last_became_peered":"2024-09-12T02:29:02.612114+0000","last_unstale":"2024-09-12T02:29:02.615135+0000","last_undegraded":"2024-09-12T02:29:02.615135+0000","last_fullsized":"2024-09-12T02:29:02.615135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615927+0000","last_change":"2024-09-12T02:29:02.613466+0000","last_active":"2024-09-12T02:29:02.615927+0000","last_peered":"2024-09-12T02:29:02.615927+0000","last_clean":"2024-09-12T02:29:02.615927+0000","last_became_active":"2024-09-12T02:29:02.613203+0000","last_became_peered":"2024-09-12T02:29:02.613203+0000","last_unstale":"2024-09-12T02:29:02.615927+0000","last_undegraded":"2024-09-12T02:29:02.615927+0000","last_fullsized":"2024-09-12T02:29:02.615927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587203+0000","last_change":"2024-09-12T02:29:01.587203+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587203+0000","last_undegraded":"2024-09-12T02:29:01.587203+0000","last_fullsized":"2024-09-12T02:29:01.587203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589414+0000","last_change":"2024-09-12T02:29:01.589414+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589414+0000","last_undegraded":"2024-09-12T02:29:01.589414+0000","last_fullsized":"2024-09-12T02:29:01.589414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622779+0000","last_change":"2024-09-12T02:29:02.620045+0000","last_active":"2024-09-12T02:29:02.622779+0000","last_peered":"2024-09-12T02:29:02.622779+0000","last_clean":"2024-09-12T02:29:02.622779+0000","last_became_active":"2024-09-12T02:29:02.619376+0000","last_became_peered":"2024-09-12T02:29:02.619376+0000","last_unstale":"2024-09-12T02:29:02.622779+0000","last_undegraded":"2024-09-12T02:29:02.622779+0000","last_fullsized":"2024-09-12T02:29:02.622779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:19.331506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620723+0000","last_change":"2024-09-12T02:29:02.618015+0000","last_active":"2024-09-12T02:29:02.620723+0000","last_peered":"2024-09-12T02:29:02.620723+0000","last_clean":"2024-09-12T02:29:02.620723+0000","last_became_active":"2024-09-12T02:29:02.617750+0000","last_became_peered":"2024-09-12T02:29:02.617750+0000","last_unstale":"2024-09-12T02:29:02.620723+0000","last_undegraded":"2024-09-12T02:29:02.620723+0000","last_fullsized":"2024-09-12T02:29:02.620723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.619552+0000","last_change":"2024-09-12T02:29:02.616002+0000","last_active":"2024-09-12T02:29:02.619552+0000","last_peered":"2024-09-12T02:29:02.619552+0000","last_clean":"2024-09-12T02:29:02.619552+0000","last_became_active":"2024-09-12T02:29:02.615650+0000","last_became_peered":"2024-09-12T02:29:02.615650+0000","last_unstale":"2024-09-12T02:29:02.619552+0000","last_undegraded":"2024-09-12T02:29:02.619552+0000","last_fullsized":"2024-09-12T02:29:02.619552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592939+0000","last_change":"2024-09-12T02:29:01.592939+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592939+0000","last_undegraded":"2024-09-12T02:29:01.592939+0000","last_fullsized":"2024-09-12T02:29:01.592939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589490+0000","last_change":"2024-09-12T02:29:01.589490+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589490+0000","last_undegraded":"2024-09-12T02:29:01.589490+0000","last_fullsized":"2024-09-12T02:29:01.589490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586573+0000","last_change":"2024-09-12T02:29:01.586573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586573+0000","last_undegraded":"2024-09-12T02:29:01.586573+0000","last_fullsized":"2024-09-12T02:29:01.586573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616748+0000","last_change":"2024-09-12T02:29:02.612217+0000","last_active":"2024-09-12T02:29:02.616748+0000","last_peered":"2024-09-12T02:29:02.616748+0000","last_clean":"2024-09-12T02:29:02.616748+0000","last_became_active":"2024-09-12T02:29:02.611931+0000","last_became_peered":"2024-09-12T02:29:02.611931+0000","last_unstale":"2024-09-12T02:29:02.616748+0000","last_undegraded":"2024-09-12T02:29:02.616748+0000","last_fullsized":"2024-09-12T02:29:02.616748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:02.620384+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:02.618647+0000","last_became_peered":"2024-09-12T02:29:02.618647+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.611401+0000","last_change":"2024-09-12T02:29:02.608849+0000","last_active":"2024-09-12T02:29:02.611401+0000","last_peered":"2024-09-12T02:29:02.611401+0000","last_clean":"2024-09-12T02:29:02.611401+0000","last_became_active":"2024-09-12T02:29:02.608571+0000","last_became_peered":"2024-09-12T02:29:02.608571+0000","last_unstale":"2024-09-12T02:29:02.611401+0000","last_undegraded":"2024-09-12T02:29:02.611401+0000","last_fullsized":"2024-09-12T02:29:02.611401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614879+0000","last_change":"2024-09-12T02:29:02.611689+0000","last_active":"2024-09-12T02:29:02.614879+0000","last_peered":"2024-09-12T02:29:02.614879+0000","last_clean":"2024-09-12T02:29:02.614879+0000","last_became_active":"2024-09-12T02:29:02.611155+0000","last_became_peered":"2024-09-12T02:29:02.611155+0000","last_unstale":"2024-09-12T02:29:02.614879+0000","last_undegraded":"2024-09-12T02:29:02.614879+0000","last_fullsized":"2024-09-12T02:29:02.614879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616086+0000","last_change":"2024-09-12T02:29:02.610975+0000","last_active":"2024-09-12T02:29:02.616086+0000","last_peered":"2024-09-12T02:29:02.616086+0000","last_clean":"2024-09-12T02:29:02.616086+0000","last_became_active":"2024-09-12T02:29:02.610711+0000","last_became_peered":"2024-09-12T02:29:02.610711+0000","last_unstale":"2024-09-12T02:29:02.616086+0000","last_undegraded":"2024-09-12T02:29:02.616086+0000","last_fullsized":"2024-09-12T02:29:02.616086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592508+0000","last_change":"2024-09-12T02:29:01.592508+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592508+0000","last_undegraded":"2024-09-12T02:29:01.592508+0000","last_fullsized":"2024-09-12T02:29:01.592508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620634+0000","last_change":"2024-09-12T02:29:02.617285+0000","last_active":"2024-09-12T02:29:02.620634+0000","last_peered":"2024-09-12T02:29:02.620634+0000","last_clean":"2024-09-12T02:29:02.620634+0000","last_became_active":"2024-09-12T02:29:02.617000+0000","last_became_peered":"2024-09-12T02:29:02.617000+0000","last_unstale":"2024-09-12T02:29:02.620634+0000","last_undegraded":"2024-09-12T02:29:02.620634+0000","last_fullsized":"2024-09-12T02:29:02.620634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621177+0000","last_change":"2024-09-12T02:29:02.614642+0000","last_active":"2024-09-12T02:29:02.621177+0000","last_peered":"2024-09-12T02:29:02.621177+0000","last_clean":"2024-09-12T02:29:02.621177+0000","last_became_active":"2024-09-12T02:29:02.614378+0000","last_became_peered":"2024-09-12T02:29:02.614378+0000","last_unstale":"2024-09-12T02:29:02.621177+0000","last_undegraded":"2024-09-12T02:29:02.621177+0000","last_fullsized":"2024-09-12T02:29:02.621177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625610+0000","last_change":"2024-09-12T02:29:02.618923+0000","last_active":"2024-09-12T02:29:02.625610+0000","last_peered":"2024-09-12T02:29:02.625610+0000","last_clean":"2024-09-12T02:29:02.625610+0000","last_became_active":"2024-09-12T02:29:02.618672+0000","last_became_peered":"2024-09-12T02:29:02.618672+0000","last_unstale":"2024-09-12T02:29:02.625610+0000","last_undegraded":"2024-09-12T02:29:02.625610+0000","last_fullsized":"2024-09-12T02:29:02.625610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612121+0000","last_change":"2024-09-12T02:29:02.607465+0000","last_active":"2024-09-12T02:29:02.612121+0000","last_peered":"2024-09-12T02:29:02.612121+0000","last_clean":"2024-09-12T02:29:02.612121+0000","last_became_active":"2024-09-12T02:29:02.607166+0000","last_became_peered":"2024-09-12T02:29:02.607166+0000","last_unstale":"2024-09-12T02:29:02.612121+0000","last_undegraded":"2024-09-12T02:29:02.612121+0000","last_fullsized":"2024-09-12T02:29:02.612121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614453+0000","last_change":"2024-09-12T02:29:02.607409+0000","last_active":"2024-09-12T02:29:02.614453+0000","last_peered":"2024-09-12T02:29:02.614453+0000","last_clean":"2024-09-12T02:29:02.614453+0000","last_became_active":"2024-09-12T02:29:02.607135+0000","last_became_peered":"2024-09-12T02:29:02.607135+0000","last_unstale":"2024-09-12T02:29:02.614453+0000","last_undegraded":"2024-09-12T02:29:02.614453+0000","last_fullsized":"2024-09-12T02:29:02.614453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614876+0000","last_change":"2024-09-12T02:29:02.610003+0000","last_active":"2024-09-12T02:29:02.614876+0000","last_peered":"2024-09-12T02:29:02.614876+0000","last_clean":"2024-09-12T02:29:02.614876+0000","last_became_active":"2024-09-12T02:29:02.609706+0000","last_became_peered":"2024-09-12T02:29:02.609706+0000","last_unstale":"2024-09-12T02:29:02.614876+0000","last_undegraded":"2024-09-12T02:29:02.614876+0000","last_fullsized":"2024-09-12T02:29:02.614876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614771+0000","last_change":"2024-09-12T02:29:02.609713+0000","last_active":"2024-09-12T02:29:02.614771+0000","last_peered":"2024-09-12T02:29:02.614771+0000","last_clean":"2024-09-12T02:29:02.614771+0000","last_became_active":"2024-09-12T02:29:02.609443+0000","last_became_peered":"2024-09-12T02:29:02.609443+0000","last_unstale":"2024-09-12T02:29:02.614771+0000","last_undegraded":"2024-09-12T02:29:02.614771+0000","last_fullsized":"2024-09-12T02:29:02.614771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625719+0000","last_change":"2024-09-12T02:29:01.601092+0000","last_active":"2024-09-12T02:29:02.625719+0000","last_peered":"2024-09-12T02:29:02.625719+0000","last_clean":"2024-09-12T02:29:02.625719+0000","last_became_active":"2024-09-12T02:29:01.600800+0000","last_became_peered":"2024-09-12T02:29:01.600800+0000","last_unstale":"2024-09-12T02:29:02.625719+0000","last_undegraded":"2024-09-12T02:29:02.625719+0000","last_fullsized":"2024-09-12T02:29:02.625719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612633+0000","last_change":"2024-09-12T02:29:02.604002+0000","last_active":"2024-09-12T02:29:02.612633+0000","last_peered":"2024-09-12T02:29:02.612633+0000","last_clean":"2024-09-12T02:29:02.612633+0000","last_became_active":"2024-09-12T02:29:02.603729+0000","last_became_peered":"2024-09-12T02:29:02.603729+0000","last_unstale":"2024-09-12T02:29:02.612633+0000","last_undegraded":"2024-09-12T02:29:02.612633+0000","last_fullsized":"2024-09-12T02:29:02.612633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621841+0000","last_change":"2024-09-12T02:29:01.603395+0000","last_active":"2024-09-12T02:29:02.621841+0000","last_peered":"2024-09-12T02:29:02.621841+0000","last_clean":"2024-09-12T02:29:02.621841+0000","last_became_active":"2024-09-12T02:29:01.602799+0000","last_became_peered":"2024-09-12T02:29:01.602799+0000","last_unstale":"2024-09-12T02:29:02.621841+0000","last_undegraded":"2024-09-12T02:29:02.621841+0000","last_fullsized":"2024-09-12T02:29:02.621841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625432+0000","last_change":"2024-09-12T02:29:02.618545+0000","last_active":"2024-09-12T02:29:02.625432+0000","last_peered":"2024-09-12T02:29:02.625432+0000","last_clean":"2024-09-12T02:29:02.625432+0000","last_became_active":"2024-09-12T02:29:02.618260+0000","last_became_peered":"2024-09-12T02:29:02.618260+0000","last_unstale":"2024-09-12T02:29:02.625432+0000","last_undegraded":"2024-09-12T02:29:02.625432+0000","last_fullsized":"2024-09-12T02:29:02.625432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598422+0000","last_change":"2024-09-12T02:29:01.596866+0000","last_active":"2024-09-12T02:29:01.598422+0000","last_peered":"2024-09-12T02:29:01.598422+0000","last_clean":"2024-09-12T02:29:01.598422+0000","last_became_active":"2024-09-12T02:29:01.596619+0000","last_became_peered":"2024-09-12T02:29:01.596619+0000","last_unstale":"2024-09-12T02:29:01.598422+0000","last_undegraded":"2024-09-12T02:29:01.598422+0000","last_fullsized":"2024-09-12T02:29:01.598422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:57.183138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620599+0000","last_change":"2024-09-12T02:29:02.617228+0000","last_active":"2024-09-12T02:29:02.620599+0000","last_peered":"2024-09-12T02:29:02.620599+0000","last_clean":"2024-09-12T02:29:02.620599+0000","last_became_active":"2024-09-12T02:29:02.616632+0000","last_became_peered":"2024-09-12T02:29:02.616632+0000","last_unstale":"2024-09-12T02:29:02.620599+0000","last_undegraded":"2024-09-12T02:29:02.620599+0000","last_fullsized":"2024-09-12T02:29:02.620599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.597901+0000","last_change":"2024-09-12T02:29:01.592790+0000","last_active":"2024-09-12T02:29:01.597901+0000","last_peered":"2024-09-12T02:29:01.597901+0000","last_clean":"2024-09-12T02:29:01.597901+0000","last_became_active":"2024-09-12T02:29:01.592540+0000","last_became_peered":"2024-09-12T02:29:01.592540+0000","last_unstale":"2024-09-12T02:29:01.597901+0000","last_undegraded":"2024-09-12T02:29:01.597901+0000","last_fullsized":"2024-09-12T02:29:01.597901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.981441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615049+0000","last_change":"2024-09-12T02:29:02.612926+0000","last_active":"2024-09-12T02:29:02.615049+0000","last_peered":"2024-09-12T02:29:02.615049+0000","last_clean":"2024-09-12T02:29:02.615049+0000","last_became_active":"2024-09-12T02:29:02.612684+0000","last_became_peered":"2024-09-12T02:29:02.612684+0000","last_unstale":"2024-09-12T02:29:02.615049+0000","last_undegraded":"2024-09-12T02:29:02.615049+0000","last_fullsized":"2024-09-12T02:29:02.615049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625767+0000","last_change":"2024-09-12T02:29:01.599459+0000","last_active":"2024-09-12T02:29:02.625767+0000","last_peered":"2024-09-12T02:29:02.625767+0000","last_clean":"2024-09-12T02:29:02.625767+0000","last_became_active":"2024-09-12T02:29:01.599152+0000","last_became_peered":"2024-09-12T02:29:01.599152+0000","last_unstale":"2024-09-12T02:29:02.625767+0000","last_undegraded":"2024-09-12T02:29:02.625767+0000","last_fullsized":"2024-09-12T02:29:02.625767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621065+0000","last_change":"2024-09-12T02:29:02.614585+0000","last_active":"2024-09-12T02:29:02.621065+0000","last_peered":"2024-09-12T02:29:02.621065+0000","last_clean":"2024-09-12T02:29:02.621065+0000","last_became_active":"2024-09-12T02:29:02.614301+0000","last_became_peered":"2024-09-12T02:29:02.614301+0000","last_unstale":"2024-09-12T02:29:02.621065+0000","last_undegraded":"2024-09-12T02:29:02.621065+0000","last_fullsized":"2024-09-12T02:29:02.621065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625841+0000","last_change":"2024-09-12T02:29:01.593974+0000","last_active":"2024-09-12T02:29:02.625841+0000","last_peered":"2024-09-12T02:29:02.625841+0000","last_clean":"2024-09-12T02:29:02.625841+0000","last_became_active":"2024-09-12T02:29:01.593658+0000","last_became_peered":"2024-09-12T02:29:01.593658+0000","last_unstale":"2024-09-12T02:29:02.625841+0000","last_undegraded":"2024-09-12T02:29:02.625841+0000","last_fullsized":"2024-09-12T02:29:02.625841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:23.538881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.609403+0000","last_change":"2024-09-12T02:29:02.602008+0000","last_active":"2024-09-12T02:29:02.609403+0000","last_peered":"2024-09-12T02:29:02.609403+0000","last_clean":"2024-09-12T02:29:02.609403+0000","last_became_active":"2024-09-12T02:29:02.601671+0000","last_became_peered":"2024-09-12T02:29:02.601671+0000","last_unstale":"2024-09-12T02:29:02.609403+0000","last_undegraded":"2024-09-12T02:29:02.609403+0000","last_fullsized":"2024-09-12T02:29:02.609403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:57.529582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.601079+0000","last_change":"2024-09-12T02:29:01.599132+0000","last_active":"2024-09-12T02:29:01.601079+0000","last_peered":"2024-09-12T02:29:01.601079+0000","last_clean":"2024-09-12T02:29:01.601079+0000","last_became_active":"2024-09-12T02:29:01.598859+0000","last_became_peered":"2024-09-12T02:29:01.598859+0000","last_unstale":"2024-09-12T02:29:01.601079+0000","last_undegraded":"2024-09-12T02:29:01.601079+0000","last_fullsized":"2024-09-12T02:29:01.601079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:00.893583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616148+0000","last_change":"2024-09-12T02:29:02.612688+0000","last_active":"2024-09-12T02:29:02.616148+0000","last_peered":"2024-09-12T02:29:02.616148+0000","last_clean":"2024-09-12T02:29:02.616148+0000","last_became_active":"2024-09-12T02:29:02.612433+0000","last_became_peered":"2024-09-12T02:29:02.612433+0000","last_unstale":"2024-09-12T02:29:02.616148+0000","last_undegraded":"2024-09-12T02:29:02.616148+0000","last_fullsized":"2024-09-12T02:29:02.616148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596822+0000","last_change":"2024-09-12T02:29:01.591494+0000","last_active":"2024-09-12T02:29:02.596822+0000","last_peered":"2024-09-12T02:29:02.596822+0000","last_clean":"2024-09-12T02:29:02.596822+0000","last_became_active":"2024-09-12T02:29:01.591190+0000","last_became_peered":"2024-09-12T02:29:01.591190+0000","last_unstale":"2024-09-12T02:29:02.596822+0000","last_undegraded":"2024-09-12T02:29:02.596822+0000","last_fullsized":"2024-09-12T02:29:02.596822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.939513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622766+0000","last_change":"2024-09-12T02:29:02.619913+0000","last_active":"2024-09-12T02:29:02.622766+0000","last_peered":"2024-09-12T02:29:02.622766+0000","last_clean":"2024-09-12T02:29:02.622766+0000","last_became_active":"2024-09-12T02:29:02.619304+0000","last_became_peered":"2024-09-12T02:29:02.619304+0000","last_unstale":"2024-09-12T02:29:02.622766+0000","last_undegraded":"2024-09-12T02:29:02.622766+0000","last_fullsized":"2024-09-12T02:29:02.622766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.348921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.604457+0000","last_change":"2024-09-12T02:29:01.602933+0000","last_active":"2024-09-12T02:29:01.604457+0000","last_peered":"2024-09-12T02:29:01.604457+0000","last_clean":"2024-09-12T02:29:01.604457+0000","last_became_active":"2024-09-12T02:29:01.602627+0000","last_became_peered":"2024-09-12T02:29:01.602627+0000","last_unstale":"2024-09-12T02:29:01.604457+0000","last_undegraded":"2024-09-12T02:29:01.604457+0000","last_fullsized":"2024-09-12T02:29:01.604457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:20.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.594568+0000","last_change":"2024-09-12T02:29:01.594568+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.594568+0000","last_undegraded":"2024-09-12T02:29:01.594568+0000","last_fullsized":"2024-09-12T02:29:01.594568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601453+0000","last_change":"2024-09-12T02:29:01.599918+0000","last_active":"2024-09-12T02:29:02.601453+0000","last_peered":"2024-09-12T02:29:02.601453+0000","last_clean":"2024-09-12T02:29:02.601453+0000","last_became_active":"2024-09-12T02:29:01.599628+0000","last_became_peered":"2024-09-12T02:29:01.599628+0000","last_unstale":"2024-09-12T02:29:02.601453+0000","last_undegraded":"2024-09-12T02:29:02.601453+0000","last_fullsized":"2024-09-12T02:29:02.601453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590800+0000","last_change":"2024-09-12T02:29:01.590800+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590800+0000","last_undegraded":"2024-09-12T02:29:01.590800+0000","last_fullsized":"2024-09-12T02:29:01.590800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.626194+0000","last_change":"2024-09-12T02:29:01.605522+0000","last_active":"2024-09-12T02:29:02.626194+0000","last_peered":"2024-09-12T02:29:02.626194+0000","last_clean":"2024-09-12T02:29:02.626194+0000","last_became_active":"2024-09-12T02:29:01.605265+0000","last_became_peered":"2024-09-12T02:29:01.605265+0000","last_unstale":"2024-09-12T02:29:02.626194+0000","last_undegraded":"2024-09-12T02:29:02.626194+0000","last_fullsized":"2024-09-12T02:29:02.626194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.872408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622682+0000","last_change":"2024-09-12T02:29:02.618134+0000","last_active":"2024-09-12T02:29:02.622682+0000","last_peered":"2024-09-12T02:29:02.622682+0000","last_clean":"2024-09-12T02:29:02.622682+0000","last_became_active":"2024-09-12T02:29:02.617667+0000","last_became_peered":"2024-09-12T02:29:02.617667+0000","last_unstale":"2024-09-12T02:29:02.622682+0000","last_undegraded":"2024-09-12T02:29:02.622682+0000","last_fullsized":"2024-09-12T02:29:02.622682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598457+0000","last_change":"2024-09-12T02:29:01.595079+0000","last_active":"2024-09-12T02:29:01.598457+0000","last_peered":"2024-09-12T02:29:01.598457+0000","last_clean":"2024-09-12T02:29:01.598457+0000","last_became_active":"2024-09-12T02:29:01.594811+0000","last_became_peered":"2024-09-12T02:29:01.594811+0000","last_unstale":"2024-09-12T02:29:01.598457+0000","last_undegraded":"2024-09-12T02:29:01.598457+0000","last_fullsized":"2024-09-12T02:29:01.598457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:35.663288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616231+0000","last_change":"2024-09-12T02:29:02.613674+0000","last_active":"2024-09-12T02:29:02.616231+0000","last_peered":"2024-09-12T02:29:02.616231+0000","last_clean":"2024-09-12T02:29:02.616231+0000","last_became_active":"2024-09-12T02:29:02.613418+0000","last_became_peered":"2024-09-12T02:29:02.613418+0000","last_unstale":"2024-09-12T02:29:02.616231+0000","last_undegraded":"2024-09-12T02:29:02.616231+0000","last_fullsized":"2024-09-12T02:29:02.616231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625565+0000","last_change":"2024-09-12T02:29:01.593677+0000","last_active":"2024-09-12T02:29:02.625565+0000","last_peered":"2024-09-12T02:29:02.625565+0000","last_clean":"2024-09-12T02:29:02.625565+0000","last_became_active":"2024-09-12T02:29:01.593403+0000","last_became_peered":"2024-09-12T02:29:01.593403+0000","last_unstale":"2024-09-12T02:29:02.625565+0000","last_undegraded":"2024-09-12T02:29:02.625565+0000","last_fullsized":"2024-09-12T02:29:02.625565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592274+0000","last_change":"2024-09-12T02:29:01.592274+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592274+0000","last_undegraded":"2024-09-12T02:29:01.592274+0000","last_fullsized":"2024-09-12T02:29:01.592274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603704+0000","last_change":"2024-09-12T02:29:01.600635+0000","last_active":"2024-09-12T02:29:02.603704+0000","last_peered":"2024-09-12T02:29:02.603704+0000","last_clean":"2024-09-12T02:29:02.603704+0000","last_became_active":"2024-09-12T02:29:01.600147+0000","last_became_peered":"2024-09-12T02:29:01.600147+0000","last_unstale":"2024-09-12T02:29:02.603704+0000","last_undegraded":"2024-09-12T02:29:02.603704+0000","last_fullsized":"2024-09-12T02:29:02.603704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614900+0000","last_change":"2024-09-12T02:29:02.610088+0000","last_active":"2024-09-12T02:29:02.614900+0000","last_peered":"2024-09-12T02:29:02.614900+0000","last_clean":"2024-09-12T02:29:02.614900+0000","last_became_active":"2024-09-12T02:29:02.609800+0000","last_became_peered":"2024-09-12T02:29:02.609800+0000","last_unstale":"2024-09-12T02:29:02.614900+0000","last_undegraded":"2024-09-12T02:29:02.614900+0000","last_fullsized":"2024-09-12T02:29:02.614900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599261+0000","last_change":"2024-09-12T02:29:01.597990+0000","last_active":"2024-09-12T02:29:01.599261+0000","last_peered":"2024-09-12T02:29:01.599261+0000","last_clean":"2024-09-12T02:29:01.599261+0000","last_became_active":"2024-09-12T02:29:01.597733+0000","last_became_peered":"2024-09-12T02:29:01.597733+0000","last_unstale":"2024-09-12T02:29:01.599261+0000","last_undegraded":"2024-09-12T02:29:01.599261+0000","last_fullsized":"2024-09-12T02:29:01.599261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:46.537630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612439+0000","last_change":"2024-09-12T02:29:02.605133+0000","last_active":"2024-09-12T02:29:02.612439+0000","last_peered":"2024-09-12T02:29:02.612439+0000","last_clean":"2024-09-12T02:29:02.612439+0000","last_became_active":"2024-09-12T02:29:02.604822+0000","last_became_peered":"2024-09-12T02:29:02.604822+0000","last_unstale":"2024-09-12T02:29:02.612439+0000","last_undegraded":"2024-09-12T02:29:02.612439+0000","last_fullsized":"2024-09-12T02:29:02.612439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598320+0000","last_change":"2024-09-12T02:29:01.594764+0000","last_active":"2024-09-12T02:29:01.598320+0000","last_peered":"2024-09-12T02:29:01.598320+0000","last_clean":"2024-09-12T02:29:01.598320+0000","last_became_active":"2024-09-12T02:29:01.594268+0000","last_became_peered":"2024-09-12T02:29:01.594268+0000","last_unstale":"2024-09-12T02:29:01.598320+0000","last_undegraded":"2024-09-12T02:29:01.598320+0000","last_fullsized":"2024-09-12T02:29:01.598320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:35.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617256+0000","last_change":"2024-09-12T02:29:02.611999+0000","last_active":"2024-09-12T02:29:02.617256+0000","last_peered":"2024-09-12T02:29:02.617256+0000","last_clean":"2024-09-12T02:29:02.617256+0000","last_became_active":"2024-09-12T02:29:02.611694+0000","last_became_peered":"2024-09-12T02:29:02.611694+0000","last_unstale":"2024-09-12T02:29:02.617256+0000","last_undegraded":"2024-09-12T02:29:02.617256+0000","last_fullsized":"2024-09-12T02:29:02.617256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:01.602071+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:01.601793+0000","last_became_peered":"2024-09-12T02:29:01.601793+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622619+0000","last_change":"2024-09-12T02:29:02.616753+0000","last_active":"2024-09-12T02:29:02.622619+0000","last_peered":"2024-09-12T02:29:02.622619+0000","last_clean":"2024-09-12T02:29:02.622619+0000","last_became_active":"2024-09-12T02:29:02.616476+0000","last_became_peered":"2024-09-12T02:29:02.616476+0000","last_unstale":"2024-09-12T02:29:02.622619+0000","last_undegraded":"2024-09-12T02:29:02.622619+0000","last_fullsized":"2024-09-12T02:29:02.622619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625356+0000","last_change":"2024-09-12T02:29:01.600094+0000","last_active":"2024-09-12T02:29:02.625356+0000","last_peered":"2024-09-12T02:29:02.625356+0000","last_clean":"2024-09-12T02:29:02.625356+0000","last_became_active":"2024-09-12T02:29:01.599825+0000","last_became_peered":"2024-09-12T02:29:01.599825+0000","last_unstale":"2024-09-12T02:29:02.625356+0000","last_undegraded":"2024-09-12T02:29:02.625356+0000","last_fullsized":"2024-09-12T02:29:02.625356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620396+0000","last_change":"2024-09-12T02:29:02.616662+0000","last_active":"2024-09-12T02:29:02.620396+0000","last_peered":"2024-09-12T02:29:02.620396+0000","last_clean":"2024-09-12T02:29:02.620396+0000","last_became_active":"2024-09-12T02:29:02.616348+0000","last_became_peered":"2024-09-12T02:29:02.616348+0000","last_unstale":"2024-09-12T02:29:02.620396+0000","last_undegraded":"2024-09-12T02:29:02.620396+0000","last_fullsized":"2024-09-12T02:29:02.620396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625350+0000","last_change":"2024-09-12T02:29:01.601320+0000","last_active":"2024-09-12T02:29:02.625350+0000","last_peered":"2024-09-12T02:29:02.625350+0000","last_clean":"2024-09-12T02:29:02.625350+0000","last_became_active":"2024-09-12T02:29:01.601010+0000","last_became_peered":"2024-09-12T02:29:01.601010+0000","last_unstale":"2024-09-12T02:29:02.625350+0000","last_undegraded":"2024-09-12T02:29:02.625350+0000","last_fullsized":"2024-09-12T02:29:02.625350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:18.815610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586743+0000","last_change":"2024-09-12T02:29:01.586743+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586743+0000","last_undegraded":"2024-09-12T02:29:01.586743+0000","last_fullsized":"2024-09-12T02:29:01.586743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.599422+0000","last_change":"2024-09-12T02:29:01.599517+0000","last_active":"2024-09-12T02:29:02.599422+0000","last_peered":"2024-09-12T02:29:02.599422+0000","last_clean":"2024-09-12T02:29:02.599422+0000","last_became_active":"2024-09-12T02:29:01.599119+0000","last_became_peered":"2024-09-12T02:29:01.599119+0000","last_unstale":"2024-09-12T02:29:02.599422+0000","last_undegraded":"2024-09-12T02:29:02.599422+0000","last_fullsized":"2024-09-12T02:29:02.599422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:50.828257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586572+0000","last_change":"2024-09-12T02:29:01.586572+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586572+0000","last_undegraded":"2024-09-12T02:29:01.586572+0000","last_fullsized":"2024-09-12T02:29:01.586572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625037+0000","last_change":"2024-09-12T02:29:01.602422+0000","last_active":"2024-09-12T02:29:02.625037+0000","last_peered":"2024-09-12T02:29:02.625037+0000","last_clean":"2024-09-12T02:29:02.625037+0000","last_became_active":"2024-09-12T02:29:01.602077+0000","last_became_peered":"2024-09-12T02:29:01.602077+0000","last_unstale":"2024-09-12T02:29:02.625037+0000","last_undegraded":"2024-09-12T02:29:02.625037+0000","last_fullsized":"2024-09-12T02:29:02.625037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586513+0000","last_change":"2024-09-12T02:29:01.586513+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586513+0000","last_undegraded":"2024-09-12T02:29:01.586513+0000","last_fullsized":"2024-09-12T02:29:01.586513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597708+0000","last_change":"2024-09-12T02:29:01.597327+0000","last_active":"2024-09-12T02:29:02.597708+0000","last_peered":"2024-09-12T02:29:02.597708+0000","last_clean":"2024-09-12T02:29:02.597708+0000","last_became_active":"2024-09-12T02:29:01.596766+0000","last_became_peered":"2024-09-12T02:29:01.596766+0000","last_unstale":"2024-09-12T02:29:02.597708+0000","last_undegraded":"2024-09-12T02:29:02.597708+0000","last_fullsized":"2024-09-12T02:29:02.597708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587988+0000","last_change":"2024-09-12T02:29:01.587988+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587988+0000","last_undegraded":"2024-09-12T02:29:01.587988+0000","last_fullsized":"2024-09-12T02:29:01.587988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597669+0000","last_change":"2024-09-12T02:29:01.594610+0000","last_active":"2024-09-12T02:29:02.597669+0000","last_peered":"2024-09-12T02:29:02.597669+0000","last_clean":"2024-09-12T02:29:02.597669+0000","last_became_active":"2024-09-12T02:29:01.594373+0000","last_became_peered":"2024-09-12T02:29:01.594373+0000","last_unstale":"2024-09-12T02:29:02.597669+0000","last_undegraded":"2024-09-12T02:29:02.597669+0000","last_fullsized":"2024-09-12T02:29:02.597669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:09.467337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615086+0000","last_change":"2024-09-12T02:29:02.613333+0000","last_active":"2024-09-12T02:29:02.615086+0000","last_peered":"2024-09-12T02:29:02.615086+0000","last_clean":"2024-09-12T02:29:02.615086+0000","last_became_active":"2024-09-12T02:29:02.613020+0000","last_became_peered":"2024-09-12T02:29:02.613020+0000","last_unstale":"2024-09-12T02:29:02.615086+0000","last_undegraded":"2024-09-12T02:29:02.615086+0000","last_fullsized":"2024-09-12T02:29:02.615086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.606014+0000","last_change":"2024-09-12T02:29:01.600161+0000","last_active":"2024-09-12T02:29:02.606014+0000","last_peered":"2024-09-12T02:29:02.606014+0000","last_clean":"2024-09-12T02:29:02.606014+0000","last_became_active":"2024-09-12T02:29:01.599858+0000","last_became_peered":"2024-09-12T02:29:01.599858+0000","last_unstale":"2024-09-12T02:29:02.606014+0000","last_undegraded":"2024-09-12T02:29:02.606014+0000","last_fullsized":"2024-09-12T02:29:02.606014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:59.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586026+0000","last_change":"2024-09-12T02:29:01.586026+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586026+0000","last_undegraded":"2024-09-12T02:29:01.586026+0000","last_fullsized":"2024-09-12T02:29:01.586026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625648+0000","last_change":"2024-09-12T02:29:01.604076+0000","last_active":"2024-09-12T02:29:02.625648+0000","last_peered":"2024-09-12T02:29:02.625648+0000","last_clean":"2024-09-12T02:29:02.625648+0000","last_became_active":"2024-09-12T02:29:01.603786+0000","last_became_peered":"2024-09-12T02:29:01.603786+0000","last_unstale":"2024-09-12T02:29:02.625648+0000","last_undegraded":"2024-09-12T02:29:02.625648+0000","last_fullsized":"2024-09-12T02:29:02.625648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:02.920830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614961+0000","last_change":"2024-09-12T02:29:02.611837+0000","last_active":"2024-09-12T02:29:02.614961+0000","last_peered":"2024-09-12T02:29:02.614961+0000","last_clean":"2024-09-12T02:29:02.614961+0000","last_became_active":"2024-09-12T02:29:02.611576+0000","last_became_peered":"2024-09-12T02:29:02.611576+0000","last_unstale":"2024-09-12T02:29:02.614961+0000","last_undegraded":"2024-09-12T02:29:02.614961+0000","last_fullsized":"2024-09-12T02:29:02.614961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601352+0000","last_change":"2024-09-12T02:29:01.596912+0000","last_active":"2024-09-12T02:29:02.601352+0000","last_peered":"2024-09-12T02:29:02.601352+0000","last_clean":"2024-09-12T02:29:02.601352+0000","last_became_active":"2024-09-12T02:29:01.596630+0000","last_became_peered":"2024-09-12T02:29:01.596630+0000","last_unstale":"2024-09-12T02:29:02.601352+0000","last_undegraded":"2024-09-12T02:29:02.601352+0000","last_fullsized":"2024-09-12T02:29:02.601352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615648+0000","last_change":"2024-09-12T02:29:02.612642+0000","last_active":"2024-09-12T02:29:02.615648+0000","last_peered":"2024-09-12T02:29:02.615648+0000","last_clean":"2024-09-12T02:29:02.615648+0000","last_became_active":"2024-09-12T02:29:02.611562+0000","last_became_peered":"2024-09-12T02:29:02.611562+0000","last_unstale":"2024-09-12T02:29:02.615648+0000","last_undegraded":"2024-09-12T02:29:02.615648+0000","last_fullsized":"2024-09-12T02:29:02.615648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603588+0000","last_change":"2024-09-12T02:29:01.598396+0000","last_active":"2024-09-12T02:29:02.603588+0000","last_peered":"2024-09-12T02:29:02.603588+0000","last_clean":"2024-09-12T02:29:02.603588+0000","last_became_active":"2024-09-12T02:29:01.598101+0000","last_became_peered":"2024-09-12T02:29:01.598101+0000","last_unstale":"2024-09-12T02:29:02.603588+0000","last_undegraded":"2024-09-12T02:29:02.603588+0000","last_fullsized":"2024-09-12T02:29:02.603588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614058+0000","last_change":"2024-09-12T02:29:02.611150+0000","last_active":"2024-09-12T02:29:02.614058+0000","last_peered":"2024-09-12T02:29:02.614058+0000","last_clean":"2024-09-12T02:29:02.614058+0000","last_became_active":"2024-09-12T02:29:02.610804+0000","last_became_peered":"2024-09-12T02:29:02.610804+0000","last_unstale":"2024-09-12T02:29:02.614058+0000","last_undegraded":"2024-09-12T02:29:02.614058+0000","last_fullsized":"2024-09-12T02:29:02.614058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601328+0000","last_change":"2024-09-12T02:29:01.603466+0000","last_active":"2024-09-12T02:29:02.601328+0000","last_peered":"2024-09-12T02:29:02.601328+0000","last_clean":"2024-09-12T02:29:02.601328+0000","last_became_active":"2024-09-12T02:29:01.603162+0000","last_became_peered":"2024-09-12T02:29:01.603162+0000","last_unstale":"2024-09-12T02:29:02.601328+0000","last_undegraded":"2024-09-12T02:29:02.601328+0000","last_fullsized":"2024-09-12T02:29:02.601328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617426+0000","last_change":"2024-09-12T02:29:02.615106+0000","last_active":"2024-09-12T02:29:02.617426+0000","last_peered":"2024-09-12T02:29:02.617426+0000","last_clean":"2024-09-12T02:29:02.617426+0000","last_became_active":"2024-09-12T02:29:02.614701+0000","last_became_peered":"2024-09-12T02:29:02.614701+0000","last_unstale":"2024-09-12T02:29:02.617426+0000","last_undegraded":"2024-09-12T02:29:02.617426+0000","last_fullsized":"2024-09-12T02:29:02.617426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603855+0000","last_change":"2024-09-12T02:29:01.602856+0000","last_active":"2024-09-12T02:29:02.603855+0000","last_peered":"2024-09-12T02:29:02.603855+0000","last_clean":"2024-09-12T02:29:02.603855+0000","last_became_active":"2024-09-12T02:29:01.602602+0000","last_became_peered":"2024-09-12T02:29:01.602602+0000","last_unstale":"2024-09-12T02:29:02.603855+0000","last_undegraded":"2024-09-12T02:29:02.603855+0000","last_fullsized":"2024-09-12T02:29:02.603855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587573+0000","last_change":"2024-09-12T02:29:01.587573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587573+0000","last_undegraded":"2024-09-12T02:29:01.587573+0000","last_fullsized":"2024-09-12T02:29:01.587573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597837+0000","last_change":"2024-09-12T02:29:01.602771+0000","last_active":"2024-09-12T02:29:02.597837+0000","last_peered":"2024-09-12T02:29:02.597837+0000","last_clean":"2024-09-12T02:29:02.597837+0000","last_became_active":"2024-09-12T02:29:01.602503+0000","last_became_peered":"2024-09-12T02:29:01.602503+0000","last_unstale":"2024-09-12T02:29:02.597837+0000","last_undegraded":"2024-09-12T02:29:02.597837+0000","last_fullsized":"2024-09-12T02:29:02.597837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:25.395144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625226+0000","last_change":"2024-09-12T02:29:02.618017+0000","last_active":"2024-09-12T02:29:02.625226+0000","last_peered":"2024-09-12T02:29:02.625226+0000","last_clean":"2024-09-12T02:29:02.625226+0000","last_became_active":"2024-09-12T02:29:02.617733+0000","last_became_peered":"2024-09-12T02:29:02.617733+0000","last_unstale":"2024-09-12T02:29:02.625226+0000","last_undegraded":"2024-09-12T02:29:02.625226+0000","last_fullsized":"2024-09-12T02:29:02.625226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599135+0000","last_change":"2024-09-12T02:29:01.597751+0000","last_active":"2024-09-12T02:29:01.599135+0000","last_peered":"2024-09-12T02:29:01.599135+0000","last_clean":"2024-09-12T02:29:01.599135+0000","last_became_active":"2024-09-12T02:29:01.597513+0000","last_became_peered":"2024-09-12T02:29:01.597513+0000","last_unstale":"2024-09-12T02:29:01.599135+0000","last_undegraded":"2024-09-12T02:29:01.599135+0000","last_fullsized":"2024-09-12T02:29:01.599135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.741427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612062+0000","last_change":"2024-09-12T02:29:02.608831+0000","last_active":"2024-09-12T02:29:02.612062+0000","last_peered":"2024-09-12T02:29:02.612062+0000","last_clean":"2024-09-12T02:29:02.612062+0000","last_became_active":"2024-09-12T02:29:02.608580+0000","last_became_peered":"2024-09-12T02:29:02.608580+0000","last_unstale":"2024-09-12T02:29:02.612062+0000","last_undegraded":"2024-09-12T02:29:02.612062+0000","last_fullsized":"2024-09-12T02:29:02.612062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596538+0000","last_change":"2024-09-12T02:29:01.600549+0000","last_active":"2024-09-12T02:29:02.596538+0000","last_peered":"2024-09-12T02:29:02.596538+0000","last_clean":"2024-09-12T02:29:02.596538+0000","last_became_active":"2024-09-12T02:29:01.600196+0000","last_became_peered":"2024-09-12T02:29:01.600196+0000","last_unstale":"2024-09-12T02:29:02.596538+0000","last_undegraded":"2024-09-12T02:29:02.596538+0000","last_fullsized":"2024-09-12T02:29:02.596538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.600032+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:02.600032+0000","last_peered":"2024-09-12T02:29:02.600032+0000","last_clean":"2024-09-12T02:29:02.600032+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:02.600032+0000","last_undegraded":"2024-09-12T02:29:02.600032+0000","last_fullsized":"2024-09-12T02:29:02.600032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":128859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:05.876 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:06.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.010+0000 7fed20db7640 1 Processor -- start 2024-09-12T02:29:06.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.010+0000 7fed20db7640 1 -- start start 2024-09-12T02:29:06.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed20db7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed1c15eab0 0x7fed1c06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed20db7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c0b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed20db7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fed1c0b80c0 0x7fed1c0b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed20db7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fed1c0d09d0 con 0x7fed1c15eab0 2024-09-12T02:29:06.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed20db7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fed1c15ee90 con 0x7fed1c0b80c0 2024-09-12T02:29:06.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed20db7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fed1c06df20 con 0x7fed1c06dae0 2024-09-12T02:29:06.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed1a59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed1c15eab0 0x7fed1c06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed1a59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed1c15eab0 0x7fed1c06d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53670/0 (socket says 172.21.15.181:53670) 2024-09-12T02:29:06.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed1a59c640 1 -- 172.21.15.181:0/1525378694 learned_addr learned my addr 172.21.15.181:0/1525378694 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:06.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed19d9b640 1 --2- 172.21.15.181:0/1525378694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c0b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.011+0000 7fed1ad9d640 1 --2- 172.21.15.181:0/1525378694 >> v2:172.21.15.204:3300/0 conn(0x7fed1c0b80c0 0x7fed1c0b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1a59c640 1 -- 172.21.15.181:0/1525378694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 msgr2=0x7fed1c0b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1a59c640 1 --2- 172.21.15.181:0/1525378694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c0b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1a59c640 1 -- 172.21.15.181:0/1525378694 >> v2:172.21.15.204:3300/0 conn(0x7fed1c0b80c0 msgr2=0x7fed1c0b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1a59c640 1 --2- 172.21.15.181:0/1525378694 >> v2:172.21.15.204:3300/0 conn(0x7fed1c0b80c0 0x7fed1c0b8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1a59c640 1 -- 172.21.15.181:0/1525378694 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c0d17e0 con 0x7fed1c15eab0 2024-09-12T02:29:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1a59c640 1 --2- 172.21.15.181:0/1525378694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c15eab0 0x7fed1c06d5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0688e0 tx=0x7fed0c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4971e6ff042294a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1959a640 1 -- 172.21.15.181:0/1525378694 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c037070 con 0x7fed1c15eab0 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1959a640 1 -- 172.21.15.181:0/1525378694 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c032440 con 0x7fed1c15eab0 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.012+0000 7fed1959a640 1 -- 172.21.15.181:0/1525378694 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c032810 con 0x7fed1c15eab0 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 -- 172.21.15.181:0/1525378694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c15eab0 msgr2=0x7fed1c06d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 --2- 172.21.15.181:0/1525378694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c15eab0 0x7fed1c06d5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0688e0 tx=0x7fed0c02a2a0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 -- 172.21.15.181:0/1525378694 shutdown_connections 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 --2- 172.21.15.181:0/1525378694 >> v2:172.21.15.204:3300/0 conn(0x7fed1c0b80c0 0x7fed1c0b8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 --2- 172.21.15.181:0/1525378694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c0b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 --2- 172.21.15.181:0/1525378694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c15eab0 0x7fed1c06d5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 -- 172.21.15.181:0/1525378694 >> 172.21.15.181:0/1525378694 conn(0x7fed1c0d4b30 msgr2=0x7fed1c0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 -- 172.21.15.181:0/1525378694 shutdown_connections 2024-09-12T02:29:06.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.013+0000 7fed20db7640 1 -- 172.21.15.181:0/1525378694 wait complete. 2024-09-12T02:29:06.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.014+0000 7fed20db7640 1 Processor -- start 2024-09-12T02:29:06.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.014+0000 7fed20db7640 1 -- start start 2024-09-12T02:29:06.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed20db7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c1e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed20db7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c0b80c0 0x7fed1c14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed20db7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1c15eab0 0x7fed1c14bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed20db7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c0d01d0 con 0x7fed1c0b80c0 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed20db7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c0cfef0 con 0x7fed1c15eab0 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed20db7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fed1c0d04b0 con 0x7fed1c06dae0 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c0b80c0 0x7fed1c14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c0b80c0 0x7fed1c14b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53682/0 (socket says 172.21.15.181:53682) 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 -- 172.21.15.181:0/313374641 learned_addr learned my addr 172.21.15.181:0/313374641 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed1ad9d640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1c15eab0 0x7fed1c14bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed1a59c640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c1e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 -- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 msgr2=0x7fed1c1e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c1e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 -- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1c15eab0 msgr2=0x7fed1c14bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1c15eab0 0x7fed1c14bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.015+0000 7fed19d9b640 1 -- 172.21.15.181:0/313374641 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c14a750 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.016+0000 7fed19d9b640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c0b80c0 0x7fed1c14b7f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed1000d800 tx=0x7fed1000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.016+0000 7fed0affd640 1 -- 172.21.15.181:0/313374641 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10018030 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.016+0000 7fed0affd640 1 -- 172.21.15.181:0/313374641 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed100096a0 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.016+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1c14aa30 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.016+0000 7fed0affd640 1 -- 172.21.15.181:0/313374641 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10009870 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.016+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1c14aff0 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.017+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1c0ceb50 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.017+0000 7fed0affd640 1 -- 172.21.15.181:0/313374641 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed1001b070 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.018+0000 7fed0affd640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fecfc06be30 0x7fecfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.018+0000 7fed1a59c640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fecfc06be30 0x7fecfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.018+0000 7fed0affd640 1 -- 172.21.15.181:0/313374641 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fed1008af50 con 0x7fed1c0b80c0 2024-09-12T02:29:06.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.018+0000 7fed1a59c640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fecfc06be30 0x7fecfc06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed0c034000 tx=0x7fed0c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.022+0000 7fed0affd640 1 -- 172.21.15.181:0/313374641 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed10059340 con 0x7fed1c0b80c0 2024-09-12T02:29:06.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.183+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed1c0b9a50 con 0x7fecfc06be30 2024-09-12T02:29:06.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.189+0000 7fed0affd640 1 -- 172.21.15.181:0/313374641 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250408 (secure 0 0 0) 0x7fed1c0b9a50 con 0x7fecfc06be30 2024-09-12T02:29:06.192 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:06.193 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:06.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fecfc06be30 msgr2=0x7fecfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fecfc06be30 0x7fecfc06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed0c034000 tx=0x7fed0c02e000 comp rx=0 tx=0).stop 2024-09-12T02:29:06.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c0b80c0 msgr2=0x7fed1c14b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c0b80c0 0x7fed1c14b7f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed1000d800 tx=0x7fed1000dcc0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 shutdown_connections 2024-09-12T02:29:06.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fecfc06be30 0x7fecfc06e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed1c15eab0 0x7fed1c14bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed1c0b80c0 0x7fed1c14b7f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 --2- 172.21.15.181:0/313374641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed1c06dae0 0x7fed1c1e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 >> 172.21.15.181:0/313374641 conn(0x7fed1c0d4b30 msgr2=0x7fed1c0b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 shutdown_connections 2024-09-12T02:29:06.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.192+0000 7fed20db7640 1 -- 172.21.15.181:0/313374641 wait complete. 2024-09-12T02:29:06.204 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-12T02:29:05.620405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219952,"kb_used_data":3708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754768,"statfs":{"total":773094113280,"available":772868882432,"internally_reserved":0,"allocated":3796992,"data_stored":2151649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040652"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621991+0000","last_change":"2024-09-12T02:29:02.616935+0000","last_active":"2024-09-12T02:29:02.621991+0000","last_peered":"2024-09-12T02:29:02.621991+0000","last_clean":"2024-09-12T02:29:02.621991+0000","last_became_active":"2024-09-12T02:29:02.616651+0000","last_became_peered":"2024-09-12T02:29:02.616651+0000","last_unstale":"2024-09-12T02:29:02.621991+0000","last_undegraded":"2024-09-12T02:29:02.621991+0000","last_fullsized":"2024-09-12T02:29:02.621991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.593315+0000","last_change":"2024-09-12T02:29:01.593315+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.593315+0000","last_undegraded":"2024-09-12T02:29:01.593315+0000","last_fullsized":"2024-09-12T02:29:01.593315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622654+0000","last_change":"2024-09-12T02:29:02.617918+0000","last_active":"2024-09-12T02:29:02.622654+0000","last_peered":"2024-09-12T02:29:02.622654+0000","last_clean":"2024-09-12T02:29:02.622654+0000","last_became_active":"2024-09-12T02:29:02.617296+0000","last_became_peered":"2024-09-12T02:29:02.617296+0000","last_unstale":"2024-09-12T02:29:02.622654+0000","last_undegraded":"2024-09-12T02:29:02.622654+0000","last_fullsized":"2024-09-12T02:29:02.622654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620632+0000","last_change":"2024-09-12T02:29:02.617491+0000","last_active":"2024-09-12T02:29:02.620632+0000","last_peered":"2024-09-12T02:29:02.620632+0000","last_clean":"2024-09-12T02:29:02.620632+0000","last_became_active":"2024-09-12T02:29:02.617229+0000","last_became_peered":"2024-09-12T02:29:02.617229+0000","last_unstale":"2024-09-12T02:29:02.620632+0000","last_undegraded":"2024-09-12T02:29:02.620632+0000","last_fullsized":"2024-09-12T02:29:02.620632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587614+0000","last_change":"2024-09-12T02:29:01.587614+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587614+0000","last_undegraded":"2024-09-12T02:29:01.587614+0000","last_fullsized":"2024-09-12T02:29:01.587614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590003+0000","last_change":"2024-09-12T02:29:01.590003+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590003+0000","last_undegraded":"2024-09-12T02:29:01.590003+0000","last_fullsized":"2024-09-12T02:29:01.590003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615107+0000","last_change":"2024-09-12T02:29:02.613356+0000","last_active":"2024-09-12T02:29:02.615107+0000","last_peered":"2024-09-12T02:29:02.615107+0000","last_clean":"2024-09-12T02:29:02.615107+0000","last_became_active":"2024-09-12T02:29:02.613093+0000","last_became_peered":"2024-09-12T02:29:02.613093+0000","last_unstale":"2024-09-12T02:29:02.615107+0000","last_undegraded":"2024-09-12T02:29:02.615107+0000","last_fullsized":"2024-09-12T02:29:02.615107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612094+0000","last_change":"2024-09-12T02:29:02.608265+0000","last_active":"2024-09-12T02:29:02.612094+0000","last_peered":"2024-09-12T02:29:02.612094+0000","last_clean":"2024-09-12T02:29:02.612094+0000","last_became_active":"2024-09-12T02:29:02.607991+0000","last_became_peered":"2024-09-12T02:29:02.607991+0000","last_unstale":"2024-09-12T02:29:02.612094+0000","last_undegraded":"2024-09-12T02:29:02.612094+0000","last_fullsized":"2024-09-12T02:29:02.612094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615727+0000","last_change":"2024-09-12T02:29:02.608629+0000","last_active":"2024-09-12T02:29:02.615727+0000","last_peered":"2024-09-12T02:29:02.615727+0000","last_clean":"2024-09-12T02:29:02.615727+0000","last_became_active":"2024-09-12T02:29:02.608224+0000","last_became_peered":"2024-09-12T02:29:02.608224+0000","last_unstale":"2024-09-12T02:29:02.615727+0000","last_undegraded":"2024-09-12T02:29:02.615727+0000","last_fullsized":"2024-09-12T02:29:02.615727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625722+0000","last_change":"2024-09-12T02:29:02.618718+0000","last_active":"2024-09-12T02:29:02.625722+0000","last_peered":"2024-09-12T02:29:02.625722+0000","last_clean":"2024-09-12T02:29:02.625722+0000","last_became_active":"2024-09-12T02:29:02.618431+0000","last_became_peered":"2024-09-12T02:29:02.618431+0000","last_unstale":"2024-09-12T02:29:02.625722+0000","last_undegraded":"2024-09-12T02:29:02.625722+0000","last_fullsized":"2024-09-12T02:29:02.625722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615135+0000","last_change":"2024-09-12T02:29:02.612372+0000","last_active":"2024-09-12T02:29:02.615135+0000","last_peered":"2024-09-12T02:29:02.615135+0000","last_clean":"2024-09-12T02:29:02.615135+0000","last_became_active":"2024-09-12T02:29:02.612114+0000","last_became_peered":"2024-09-12T02:29:02.612114+0000","last_unstale":"2024-09-12T02:29:02.615135+0000","last_undegraded":"2024-09-12T02:29:02.615135+0000","last_fullsized":"2024-09-12T02:29:02.615135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615927+0000","last_change":"2024-09-12T02:29:02.613466+0000","last_active":"2024-09-12T02:29:02.615927+0000","last_peered":"2024-09-12T02:29:02.615927+0000","last_clean":"2024-09-12T02:29:02.615927+0000","last_became_active":"2024-09-12T02:29:02.613203+0000","last_became_peered":"2024-09-12T02:29:02.613203+0000","last_unstale":"2024-09-12T02:29:02.615927+0000","last_undegraded":"2024-09-12T02:29:02.615927+0000","last_fullsized":"2024-09-12T02:29:02.615927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587203+0000","last_change":"2024-09-12T02:29:01.587203+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587203+0000","last_undegraded":"2024-09-12T02:29:01.587203+0000","last_fullsized":"2024-09-12T02:29:01.587203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589414+0000","last_change":"2024-09-12T02:29:01.589414+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589414+0000","last_undegraded":"2024-09-12T02:29:01.589414+0000","last_fullsized":"2024-09-12T02:29:01.589414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622779+0000","last_change":"2024-09-12T02:29:02.620045+0000","last_active":"2024-09-12T02:29:02.622779+0000","last_peered":"2024-09-12T02:29:02.622779+0000","last_clean":"2024-09-12T02:29:02.622779+0000","last_became_active":"2024-09-12T02:29:02.619376+0000","last_became_peered":"2024-09-12T02:29:02.619376+0000","last_unstale":"2024-09-12T02:29:02.622779+0000","last_undegraded":"2024-09-12T02:29:02.622779+0000","last_fullsized":"2024-09-12T02:29:02.622779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:19.331506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620723+0000","last_change":"2024-09-12T02:29:02.618015+0000","last_active":"2024-09-12T02:29:02.620723+0000","last_peered":"2024-09-12T02:29:02.620723+0000","last_clean":"2024-09-12T02:29:02.620723+0000","last_became_active":"2024-09-12T02:29:02.617750+0000","last_became_peered":"2024-09-12T02:29:02.617750+0000","last_unstale":"2024-09-12T02:29:02.620723+0000","last_undegraded":"2024-09-12T02:29:02.620723+0000","last_fullsized":"2024-09-12T02:29:02.620723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.619552+0000","last_change":"2024-09-12T02:29:02.616002+0000","last_active":"2024-09-12T02:29:02.619552+0000","last_peered":"2024-09-12T02:29:02.619552+0000","last_clean":"2024-09-12T02:29:02.619552+0000","last_became_active":"2024-09-12T02:29:02.615650+0000","last_became_peered":"2024-09-12T02:29:02.615650+0000","last_unstale":"2024-09-12T02:29:02.619552+0000","last_undegraded":"2024-09-12T02:29:02.619552+0000","last_fullsized":"2024-09-12T02:29:02.619552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592939+0000","last_change":"2024-09-12T02:29:01.592939+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592939+0000","last_undegraded":"2024-09-12T02:29:01.592939+0000","last_fullsized":"2024-09-12T02:29:01.592939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589490+0000","last_change":"2024-09-12T02:29:01.589490+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589490+0000","last_undegraded":"2024-09-12T02:29:01.589490+0000","last_fullsized":"2024-09-12T02:29:01.589490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586573+0000","last_change":"2024-09-12T02:29:01.586573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586573+0000","last_undegraded":"2024-09-12T02:29:01.586573+0000","last_fullsized":"2024-09-12T02:29:01.586573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616748+0000","last_change":"2024-09-12T02:29:02.612217+0000","last_active":"2024-09-12T02:29:02.616748+0000","last_peered":"2024-09-12T02:29:02.616748+0000","last_clean":"2024-09-12T02:29:02.616748+0000","last_became_active":"2024-09-12T02:29:02.611931+0000","last_became_peered":"2024-09-12T02:29:02.611931+0000","last_unstale":"2024-09-12T02:29:02.616748+0000","last_undegraded":"2024-09-12T02:29:02.616748+0000","last_fullsized":"2024-09-12T02:29:02.616748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:02.620384+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:02.618647+0000","last_became_peered":"2024-09-12T02:29:02.618647+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.611401+0000","last_change":"2024-09-12T02:29:02.608849+0000","last_active":"2024-09-12T02:29:02.611401+0000","last_peered":"2024-09-12T02:29:02.611401+0000","last_clean":"2024-09-12T02:29:02.611401+0000","last_became_active":"2024-09-12T02:29:02.608571+0000","last_became_peered":"2024-09-12T02:29:02.608571+0000","last_unstale":"2024-09-12T02:29:02.611401+0000","last_undegraded":"2024-09-12T02:29:02.611401+0000","last_fullsized":"2024-09-12T02:29:02.611401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614879+0000","last_change":"2024-09-12T02:29:02.611689+0000","last_active":"2024-09-12T02:29:02.614879+0000","last_peered":"2024-09-12T02:29:02.614879+0000","last_clean":"2024-09-12T02:29:02.614879+0000","last_became_active":"2024-09-12T02:29:02.611155+0000","last_became_peered":"2024-09-12T02:29:02.611155+0000","last_unstale":"2024-09-12T02:29:02.614879+0000","last_undegraded":"2024-09-12T02:29:02.614879+0000","last_fullsized":"2024-09-12T02:29:02.614879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616086+0000","last_change":"2024-09-12T02:29:02.610975+0000","last_active":"2024-09-12T02:29:02.616086+0000","last_peered":"2024-09-12T02:29:02.616086+0000","last_clean":"2024-09-12T02:29:02.616086+0000","last_became_active":"2024-09-12T02:29:02.610711+0000","last_became_peered":"2024-09-12T02:29:02.610711+0000","last_unstale":"2024-09-12T02:29:02.616086+0000","last_undegraded":"2024-09-12T02:29:02.616086+0000","last_fullsized":"2024-09-12T02:29:02.616086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592508+0000","last_change":"2024-09-12T02:29:01.592508+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592508+0000","last_undegraded":"2024-09-12T02:29:01.592508+0000","last_fullsized":"2024-09-12T02:29:01.592508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620634+0000","last_change":"2024-09-12T02:29:02.617285+0000","last_active":"2024-09-12T02:29:02.620634+0000","last_peered":"2024-09-12T02:29:02.620634+0000","last_clean":"2024-09-12T02:29:02.620634+0000","last_became_active":"2024-09-12T02:29:02.617000+0000","last_became_peered":"2024-09-12T02:29:02.617000+0000","last_unstale":"2024-09-12T02:29:02.620634+0000","last_undegraded":"2024-09-12T02:29:02.620634+0000","last_fullsized":"2024-09-12T02:29:02.620634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621177+0000","last_change":"2024-09-12T02:29:02.614642+0000","last_active":"2024-09-12T02:29:02.621177+0000","last_peered":"2024-09-12T02:29:02.621177+0000","last_clean":"2024-09-12T02:29:02.621177+0000","last_became_active":"2024-09-12T02:29:02.614378+0000","last_became_peered":"2024-09-12T02:29:02.614378+0000","last_unstale":"2024-09-12T02:29:02.621177+0000","last_undegraded":"2024-09-12T02:29:02.621177+0000","last_fullsized":"2024-09-12T02:29:02.621177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625610+0000","last_change":"2024-09-12T02:29:02.618923+0000","last_active":"2024-09-12T02:29:02.625610+0000","last_peered":"2024-09-12T02:29:02.625610+0000","last_clean":"2024-09-12T02:29:02.625610+0000","last_became_active":"2024-09-12T02:29:02.618672+0000","last_became_peered":"2024-09-12T02:29:02.618672+0000","last_unstale":"2024-09-12T02:29:02.625610+0000","last_undegraded":"2024-09-12T02:29:02.625610+0000","last_fullsized":"2024-09-12T02:29:02.625610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612121+0000","last_change":"2024-09-12T02:29:02.607465+0000","last_active":"2024-09-12T02:29:02.612121+0000","last_peered":"2024-09-12T02:29:02.612121+0000","last_clean":"2024-09-12T02:29:02.612121+0000","last_became_active":"2024-09-12T02:29:02.607166+0000","last_became_peered":"2024-09-12T02:29:02.607166+0000","last_unstale":"2024-09-12T02:29:02.612121+0000","last_undegraded":"2024-09-12T02:29:02.612121+0000","last_fullsized":"2024-09-12T02:29:02.612121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614453+0000","last_change":"2024-09-12T02:29:02.607409+0000","last_active":"2024-09-12T02:29:02.614453+0000","last_peered":"2024-09-12T02:29:02.614453+0000","last_clean":"2024-09-12T02:29:02.614453+0000","last_became_active":"2024-09-12T02:29:02.607135+0000","last_became_peered":"2024-09-12T02:29:02.607135+0000","last_unstale":"2024-09-12T02:29:02.614453+0000","last_undegraded":"2024-09-12T02:29:02.614453+0000","last_fullsized":"2024-09-12T02:29:02.614453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614876+0000","last_change":"2024-09-12T02:29:02.610003+0000","last_active":"2024-09-12T02:29:02.614876+0000","last_peered":"2024-09-12T02:29:02.614876+0000","last_clean":"2024-09-12T02:29:02.614876+0000","last_became_active":"2024-09-12T02:29:02.609706+0000","last_became_peered":"2024-09-12T02:29:02.609706+0000","last_unstale":"2024-09-12T02:29:02.614876+0000","last_undegraded":"2024-09-12T02:29:02.614876+0000","last_fullsized":"2024-09-12T02:29:02.614876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614771+0000","last_change":"2024-09-12T02:29:02.609713+0000","last_active":"2024-09-12T02:29:02.614771+0000","last_peered":"2024-09-12T02:29:02.614771+0000","last_clean":"2024-09-12T02:29:02.614771+0000","last_became_active":"2024-09-12T02:29:02.609443+0000","last_became_peered":"2024-09-12T02:29:02.609443+0000","last_unstale":"2024-09-12T02:29:02.614771+0000","last_undegraded":"2024-09-12T02:29:02.614771+0000","last_fullsized":"2024-09-12T02:29:02.614771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625719+0000","last_change":"2024-09-12T02:29:01.601092+0000","last_active":"2024-09-12T02:29:02.625719+0000","last_peered":"2024-09-12T02:29:02.625719+0000","last_clean":"2024-09-12T02:29:02.625719+0000","last_became_active":"2024-09-12T02:29:01.600800+0000","last_became_peered":"2024-09-12T02:29:01.600800+0000","last_unstale":"2024-09-12T02:29:02.625719+0000","last_undegraded":"2024-09-12T02:29:02.625719+0000","last_fullsized":"2024-09-12T02:29:02.625719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612633+0000","last_change":"2024-09-12T02:29:02.604002+0000","last_active":"2024-09-12T02:29:02.612633+0000","last_peered":"2024-09-12T02:29:02.612633+0000","last_clean":"2024-09-12T02:29:02.612633+0000","last_became_active":"2024-09-12T02:29:02.603729+0000","last_became_peered":"2024-09-12T02:29:02.603729+0000","last_unstale":"2024-09-12T02:29:02.612633+0000","last_undegraded":"2024-09-12T02:29:02.612633+0000","last_fullsized":"2024-09-12T02:29:02.612633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621841+0000","last_change":"2024-09-12T02:29:01.603395+0000","last_active":"2024-09-12T02:29:02.621841+0000","last_peered":"2024-09-12T02:29:02.621841+0000","last_clean":"2024-09-12T02:29:02.621841+0000","last_became_active":"2024-09-12T02:29:01.602799+0000","last_became_peered":"2024-09-12T02:29:01.602799+0000","last_unstale":"2024-09-12T02:29:02.621841+0000","last_undegraded":"2024-09-12T02:29:02.621841+0000","last_fullsized":"2024-09-12T02:29:02.621841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625432+0000","last_change":"2024-09-12T02:29:02.618545+0000","last_active":"2024-09-12T02:29:02.625432+0000","last_peered":"2024-09-12T02:29:02.625432+0000","last_clean":"2024-09-12T02:29:02.625432+0000","last_became_active":"2024-09-12T02:29:02.618260+0000","last_became_peered":"2024-09-12T02:29:02.618260+0000","last_unstale":"2024-09-12T02:29:02.625432+0000","last_undegraded":"2024-09-12T02:29:02.625432+0000","last_fullsized":"2024-09-12T02:29:02.625432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598422+0000","last_change":"2024-09-12T02:29:01.596866+0000","last_active":"2024-09-12T02:29:01.598422+0000","last_peered":"2024-09-12T02:29:01.598422+0000","last_clean":"2024-09-12T02:29:01.598422+0000","last_became_active":"2024-09-12T02:29:01.596619+0000","last_became_peered":"2024-09-12T02:29:01.596619+0000","last_unstale":"2024-09-12T02:29:01.598422+0000","last_undegraded":"2024-09-12T02:29:01.598422+0000","last_fullsized":"2024-09-12T02:29:01.598422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:57.183138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620599+0000","last_change":"2024-09-12T02:29:02.617228+0000","last_active":"2024-09-12T02:29:02.620599+0000","last_peered":"2024-09-12T02:29:02.620599+0000","last_clean":"2024-09-12T02:29:02.620599+0000","last_became_active":"2024-09-12T02:29:02.616632+0000","last_became_peered":"2024-09-12T02:29:02.616632+0000","last_unstale":"2024-09-12T02:29:02.620599+0000","last_undegraded":"2024-09-12T02:29:02.620599+0000","last_fullsized":"2024-09-12T02:29:02.620599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.597901+0000","last_change":"2024-09-12T02:29:01.592790+0000","last_active":"2024-09-12T02:29:01.597901+0000","last_peered":"2024-09-12T02:29:01.597901+0000","last_clean":"2024-09-12T02:29:01.597901+0000","last_became_active":"2024-09-12T02:29:01.592540+0000","last_became_peered":"2024-09-12T02:29:01.592540+0000","last_unstale":"2024-09-12T02:29:01.597901+0000","last_undegraded":"2024-09-12T02:29:01.597901+0000","last_fullsized":"2024-09-12T02:29:01.597901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.981441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615049+0000","last_change":"2024-09-12T02:29:02.612926+0000","last_active":"2024-09-12T02:29:02.615049+0000","last_peered":"2024-09-12T02:29:02.615049+0000","last_clean":"2024-09-12T02:29:02.615049+0000","last_became_active":"2024-09-12T02:29:02.612684+0000","last_became_peered":"2024-09-12T02:29:02.612684+0000","last_unstale":"2024-09-12T02:29:02.615049+0000","last_undegraded":"2024-09-12T02:29:02.615049+0000","last_fullsized":"2024-09-12T02:29:02.615049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625767+0000","last_change":"2024-09-12T02:29:01.599459+0000","last_active":"2024-09-12T02:29:02.625767+0000","last_peered":"2024-09-12T02:29:02.625767+0000","last_clean":"2024-09-12T02:29:02.625767+0000","last_became_active":"2024-09-12T02:29:01.599152+0000","last_became_peered":"2024-09-12T02:29:01.599152+0000","last_unstale":"2024-09-12T02:29:02.625767+0000","last_undegraded":"2024-09-12T02:29:02.625767+0000","last_fullsized":"2024-09-12T02:29:02.625767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621065+0000","last_change":"2024-09-12T02:29:02.614585+0000","last_active":"2024-09-12T02:29:02.621065+0000","last_peered":"2024-09-12T02:29:02.621065+0000","last_clean":"2024-09-12T02:29:02.621065+0000","last_became_active":"2024-09-12T02:29:02.614301+0000","last_became_peered":"2024-09-12T02:29:02.614301+0000","last_unstale":"2024-09-12T02:29:02.621065+0000","last_undegraded":"2024-09-12T02:29:02.621065+0000","last_fullsized":"2024-09-12T02:29:02.621065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625841+0000","last_change":"2024-09-12T02:29:01.593974+0000","last_active":"2024-09-12T02:29:02.625841+0000","last_peered":"2024-09-12T02:29:02.625841+0000","last_clean":"2024-09-12T02:29:02.625841+0000","last_became_active":"2024-09-12T02:29:01.593658+0000","last_became_peered":"2024-09-12T02:29:01.593658+0000","last_unstale":"2024-09-12T02:29:02.625841+0000","last_undegraded":"2024-09-12T02:29:02.625841+0000","last_fullsized":"2024-09-12T02:29:02.625841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:23.538881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.609403+0000","last_change":"2024-09-12T02:29:02.602008+0000","last_active":"2024-09-12T02:29:02.609403+0000","last_peered":"2024-09-12T02:29:02.609403+0000","last_clean":"2024-09-12T02:29:02.609403+0000","last_became_active":"2024-09-12T02:29:02.601671+0000","last_became_peered":"2024-09-12T02:29:02.601671+0000","last_unstale":"2024-09-12T02:29:02.609403+0000","last_undegraded":"2024-09-12T02:29:02.609403+0000","last_fullsized":"2024-09-12T02:29:02.609403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:57.529582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.601079+0000","last_change":"2024-09-12T02:29:01.599132+0000","last_active":"2024-09-12T02:29:01.601079+0000","last_peered":"2024-09-12T02:29:01.601079+0000","last_clean":"2024-09-12T02:29:01.601079+0000","last_became_active":"2024-09-12T02:29:01.598859+0000","last_became_peered":"2024-09-12T02:29:01.598859+0000","last_unstale":"2024-09-12T02:29:01.601079+0000","last_undegraded":"2024-09-12T02:29:01.601079+0000","last_fullsized":"2024-09-12T02:29:01.601079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:00.893583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616148+0000","last_change":"2024-09-12T02:29:02.612688+0000","last_active":"2024-09-12T02:29:02.616148+0000","last_peered":"2024-09-12T02:29:02.616148+0000","last_clean":"2024-09-12T02:29:02.616148+0000","last_became_active":"2024-09-12T02:29:02.612433+0000","last_became_peered":"2024-09-12T02:29:02.612433+0000","last_unstale":"2024-09-12T02:29:02.616148+0000","last_undegraded":"2024-09-12T02:29:02.616148+0000","last_fullsized":"2024-09-12T02:29:02.616148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596822+0000","last_change":"2024-09-12T02:29:01.591494+0000","last_active":"2024-09-12T02:29:02.596822+0000","last_peered":"2024-09-12T02:29:02.596822+0000","last_clean":"2024-09-12T02:29:02.596822+0000","last_became_active":"2024-09-12T02:29:01.591190+0000","last_became_peered":"2024-09-12T02:29:01.591190+0000","last_unstale":"2024-09-12T02:29:02.596822+0000","last_undegraded":"2024-09-12T02:29:02.596822+0000","last_fullsized":"2024-09-12T02:29:02.596822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.939513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622766+0000","last_change":"2024-09-12T02:29:02.619913+0000","last_active":"2024-09-12T02:29:02.622766+0000","last_peered":"2024-09-12T02:29:02.622766+0000","last_clean":"2024-09-12T02:29:02.622766+0000","last_became_active":"2024-09-12T02:29:02.619304+0000","last_became_peered":"2024-09-12T02:29:02.619304+0000","last_unstale":"2024-09-12T02:29:02.622766+0000","last_undegraded":"2024-09-12T02:29:02.622766+0000","last_fullsized":"2024-09-12T02:29:02.622766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.348921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.604457+0000","last_change":"2024-09-12T02:29:01.602933+0000","last_active":"2024-09-12T02:29:01.604457+0000","last_peered":"2024-09-12T02:29:01.604457+0000","last_clean":"2024-09-12T02:29:01.604457+0000","last_became_active":"2024-09-12T02:29:01.602627+0000","last_became_peered":"2024-09-12T02:29:01.602627+0000","last_unstale":"2024-09-12T02:29:01.604457+0000","last_undegraded":"2024-09-12T02:29:01.604457+0000","last_fullsized":"2024-09-12T02:29:01.604457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:20.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.594568+0000","last_change":"2024-09-12T02:29:01.594568+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.594568+0000","last_undegraded":"2024-09-12T02:29:01.594568+0000","last_fullsized":"2024-09-12T02:29:01.594568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601453+0000","last_change":"2024-09-12T02:29:01.599918+0000","last_active":"2024-09-12T02:29:02.601453+0000","last_peered":"2024-09-12T02:29:02.601453+0000","last_clean":"2024-09-12T02:29:02.601453+0000","last_became_active":"2024-09-12T02:29:01.599628+0000","last_became_peered":"2024-09-12T02:29:01.599628+0000","last_unstale":"2024-09-12T02:29:02.601453+0000","last_undegraded":"2024-09-12T02:29:02.601453+0000","last_fullsized":"2024-09-12T02:29:02.601453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590800+0000","last_change":"2024-09-12T02:29:01.590800+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590800+0000","last_undegraded":"2024-09-12T02:29:01.590800+0000","last_fullsized":"2024-09-12T02:29:01.590800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.626194+0000","last_change":"2024-09-12T02:29:01.605522+0000","last_active":"2024-09-12T02:29:02.626194+0000","last_peered":"2024-09-12T02:29:02.626194+0000","last_clean":"2024-09-12T02:29:02.626194+0000","last_became_active":"2024-09-12T02:29:01.605265+0000","last_became_peered":"2024-09-12T02:29:01.605265+0000","last_unstale":"2024-09-12T02:29:02.626194+0000","last_undegraded":"2024-09-12T02:29:02.626194+0000","last_fullsized":"2024-09-12T02:29:02.626194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.872408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622682+0000","last_change":"2024-09-12T02:29:02.618134+0000","last_active":"2024-09-12T02:29:02.622682+0000","last_peered":"2024-09-12T02:29:02.622682+0000","last_clean":"2024-09-12T02:29:02.622682+0000","last_became_active":"2024-09-12T02:29:02.617667+0000","last_became_peered":"2024-09-12T02:29:02.617667+0000","last_unstale":"2024-09-12T02:29:02.622682+0000","last_undegraded":"2024-09-12T02:29:02.622682+0000","last_fullsized":"2024-09-12T02:29:02.622682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598457+0000","last_change":"2024-09-12T02:29:01.595079+0000","last_active":"2024-09-12T02:29:01.598457+0000","last_peered":"2024-09-12T02:29:01.598457+0000","last_clean":"2024-09-12T02:29:01.598457+0000","last_became_active":"2024-09-12T02:29:01.594811+0000","last_became_peered":"2024-09-12T02:29:01.594811+0000","last_unstale":"2024-09-12T02:29:01.598457+0000","last_undegraded":"2024-09-12T02:29:01.598457+0000","last_fullsized":"2024-09-12T02:29:01.598457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:35.663288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616231+0000","last_change":"2024-09-12T02:29:02.613674+0000","last_active":"2024-09-12T02:29:02.616231+0000","last_peered":"2024-09-12T02:29:02.616231+0000","last_clean":"2024-09-12T02:29:02.616231+0000","last_became_active":"2024-09-12T02:29:02.613418+0000","last_became_peered":"2024-09-12T02:29:02.613418+0000","last_unstale":"2024-09-12T02:29:02.616231+0000","last_undegraded":"2024-09-12T02:29:02.616231+0000","last_fullsized":"2024-09-12T02:29:02.616231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625565+0000","last_change":"2024-09-12T02:29:01.593677+0000","last_active":"2024-09-12T02:29:02.625565+0000","last_peered":"2024-09-12T02:29:02.625565+0000","last_clean":"2024-09-12T02:29:02.625565+0000","last_became_active":"2024-09-12T02:29:01.593403+0000","last_became_peered":"2024-09-12T02:29:01.593403+0000","last_unstale":"2024-09-12T02:29:02.625565+0000","last_undegraded":"2024-09-12T02:29:02.625565+0000","last_fullsized":"2024-09-12T02:29:02.625565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592274+0000","last_change":"2024-09-12T02:29:01.592274+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592274+0000","last_undegraded":"2024-09-12T02:29:01.592274+0000","last_fullsized":"2024-09-12T02:29:01.592274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603704+0000","last_change":"2024-09-12T02:29:01.600635+0000","last_active":"2024-09-12T02:29:02.603704+0000","last_peered":"2024-09-12T02:29:02.603704+0000","last_clean":"2024-09-12T02:29:02.603704+0000","last_became_active":"2024-09-12T02:29:01.600147+0000","last_became_peered":"2024-09-12T02:29:01.600147+0000","last_unstale":"2024-09-12T02:29:02.603704+0000","last_undegraded":"2024-09-12T02:29:02.603704+0000","last_fullsized":"2024-09-12T02:29:02.603704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614900+0000","last_change":"2024-09-12T02:29:02.610088+0000","last_active":"2024-09-12T02:29:02.614900+0000","last_peered":"2024-09-12T02:29:02.614900+0000","last_clean":"2024-09-12T02:29:02.614900+0000","last_became_active":"2024-09-12T02:29:02.609800+0000","last_became_peered":"2024-09-12T02:29:02.609800+0000","last_unstale":"2024-09-12T02:29:02.614900+0000","last_undegraded":"2024-09-12T02:29:02.614900+0000","last_fullsized":"2024-09-12T02:29:02.614900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599261+0000","last_change":"2024-09-12T02:29:01.597990+0000","last_active":"2024-09-12T02:29:01.599261+0000","last_peered":"2024-09-12T02:29:01.599261+0000","last_clean":"2024-09-12T02:29:01.599261+0000","last_became_active":"2024-09-12T02:29:01.597733+0000","last_became_peered":"2024-09-12T02:29:01.597733+0000","last_unstale":"2024-09-12T02:29:01.599261+0000","last_undegraded":"2024-09-12T02:29:01.599261+0000","last_fullsized":"2024-09-12T02:29:01.599261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:46.537630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612439+0000","last_change":"2024-09-12T02:29:02.605133+0000","last_active":"2024-09-12T02:29:02.612439+0000","last_peered":"2024-09-12T02:29:02.612439+0000","last_clean":"2024-09-12T02:29:02.612439+0000","last_became_active":"2024-09-12T02:29:02.604822+0000","last_became_peered":"2024-09-12T02:29:02.604822+0000","last_unstale":"2024-09-12T02:29:02.612439+0000","last_undegraded":"2024-09-12T02:29:02.612439+0000","last_fullsized":"2024-09-12T02:29:02.612439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598320+0000","last_change":"2024-09-12T02:29:01.594764+0000","last_active":"2024-09-12T02:29:01.598320+0000","last_peered":"2024-09-12T02:29:01.598320+0000","last_clean":"2024-09-12T02:29:01.598320+0000","last_became_active":"2024-09-12T02:29:01.594268+0000","last_became_peered":"2024-09-12T02:29:01.594268+0000","last_unstale":"2024-09-12T02:29:01.598320+0000","last_undegraded":"2024-09-12T02:29:01.598320+0000","last_fullsized":"2024-09-12T02:29:01.598320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:35.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617256+0000","last_change":"2024-09-12T02:29:02.611999+0000","last_active":"2024-09-12T02:29:02.617256+0000","last_peered":"2024-09-12T02:29:02.617256+0000","last_clean":"2024-09-12T02:29:02.617256+0000","last_became_active":"2024-09-12T02:29:02.611694+0000","last_became_peered":"2024-09-12T02:29:02.611694+0000","last_unstale":"2024-09-12T02:29:02.617256+0000","last_undegraded":"2024-09-12T02:29:02.617256+0000","last_fullsized":"2024-09-12T02:29:02.617256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:01.602071+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:01.601793+0000","last_became_peered":"2024-09-12T02:29:01.601793+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622619+0000","last_change":"2024-09-12T02:29:02.616753+0000","last_active":"2024-09-12T02:29:02.622619+0000","last_peered":"2024-09-12T02:29:02.622619+0000","last_clean":"2024-09-12T02:29:02.622619+0000","last_became_active":"2024-09-12T02:29:02.616476+0000","last_became_peered":"2024-09-12T02:29:02.616476+0000","last_unstale":"2024-09-12T02:29:02.622619+0000","last_undegraded":"2024-09-12T02:29:02.622619+0000","last_fullsized":"2024-09-12T02:29:02.622619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625356+0000","last_change":"2024-09-12T02:29:01.600094+0000","last_active":"2024-09-12T02:29:02.625356+0000","last_peered":"2024-09-12T02:29:02.625356+0000","last_clean":"2024-09-12T02:29:02.625356+0000","last_became_active":"2024-09-12T02:29:01.599825+0000","last_became_peered":"2024-09-12T02:29:01.599825+0000","last_unstale":"2024-09-12T02:29:02.625356+0000","last_undegraded":"2024-09-12T02:29:02.625356+0000","last_fullsized":"2024-09-12T02:29:02.625356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620396+0000","last_change":"2024-09-12T02:29:02.616662+0000","last_active":"2024-09-12T02:29:02.620396+0000","last_peered":"2024-09-12T02:29:02.620396+0000","last_clean":"2024-09-12T02:29:02.620396+0000","last_became_active":"2024-09-12T02:29:02.616348+0000","last_became_peered":"2024-09-12T02:29:02.616348+0000","last_unstale":"2024-09-12T02:29:02.620396+0000","last_undegraded":"2024-09-12T02:29:02.620396+0000","last_fullsized":"2024-09-12T02:29:02.620396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625350+0000","last_change":"2024-09-12T02:29:01.601320+0000","last_active":"2024-09-12T02:29:02.625350+0000","last_peered":"2024-09-12T02:29:02.625350+0000","last_clean":"2024-09-12T02:29:02.625350+0000","last_became_active":"2024-09-12T02:29:01.601010+0000","last_became_peered":"2024-09-12T02:29:01.601010+0000","last_unstale":"2024-09-12T02:29:02.625350+0000","last_undegraded":"2024-09-12T02:29:02.625350+0000","last_fullsized":"2024-09-12T02:29:02.625350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:18.815610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586743+0000","last_change":"2024-09-12T02:29:01.586743+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586743+0000","last_undegraded":"2024-09-12T02:29:01.586743+0000","last_fullsized":"2024-09-12T02:29:01.586743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.599422+0000","last_change":"2024-09-12T02:29:01.599517+0000","last_active":"2024-09-12T02:29:02.599422+0000","last_peered":"2024-09-12T02:29:02.599422+0000","last_clean":"2024-09-12T02:29:02.599422+0000","last_became_active":"2024-09-12T02:29:01.599119+0000","last_became_peered":"2024-09-12T02:29:01.599119+0000","last_unstale":"2024-09-12T02:29:02.599422+0000","last_undegraded":"2024-09-12T02:29:02.599422+0000","last_fullsized":"2024-09-12T02:29:02.599422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:50.828257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586572+0000","last_change":"2024-09-12T02:29:01.586572+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586572+0000","last_undegraded":"2024-09-12T02:29:01.586572+0000","last_fullsized":"2024-09-12T02:29:01.586572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625037+0000","last_change":"2024-09-12T02:29:01.602422+0000","last_active":"2024-09-12T02:29:02.625037+0000","last_peered":"2024-09-12T02:29:02.625037+0000","last_clean":"2024-09-12T02:29:02.625037+0000","last_became_active":"2024-09-12T02:29:01.602077+0000","last_became_peered":"2024-09-12T02:29:01.602077+0000","last_unstale":"2024-09-12T02:29:02.625037+0000","last_undegraded":"2024-09-12T02:29:02.625037+0000","last_fullsized":"2024-09-12T02:29:02.625037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586513+0000","last_change":"2024-09-12T02:29:01.586513+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586513+0000","last_undegraded":"2024-09-12T02:29:01.586513+0000","last_fullsized":"2024-09-12T02:29:01.586513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597708+0000","last_change":"2024-09-12T02:29:01.597327+0000","last_active":"2024-09-12T02:29:02.597708+0000","last_peered":"2024-09-12T02:29:02.597708+0000","last_clean":"2024-09-12T02:29:02.597708+0000","last_became_active":"2024-09-12T02:29:01.596766+0000","last_became_peered":"2024-09-12T02:29:01.596766+0000","last_unstale":"2024-09-12T02:29:02.597708+0000","last_undegraded":"2024-09-12T02:29:02.597708+0000","last_fullsized":"2024-09-12T02:29:02.597708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587988+0000","last_change":"2024-09-12T02:29:01.587988+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587988+0000","last_undegraded":"2024-09-12T02:29:01.587988+0000","last_fullsized":"2024-09-12T02:29:01.587988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597669+0000","last_change":"2024-09-12T02:29:01.594610+0000","last_active":"2024-09-12T02:29:02.597669+0000","last_peered":"2024-09-12T02:29:02.597669+0000","last_clean":"2024-09-12T02:29:02.597669+0000","last_became_active":"2024-09-12T02:29:01.594373+0000","last_became_peered":"2024-09-12T02:29:01.594373+0000","last_unstale":"2024-09-12T02:29:02.597669+0000","last_undegraded":"2024-09-12T02:29:02.597669+0000","last_fullsized":"2024-09-12T02:29:02.597669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:09.467337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615086+0000","last_change":"2024-09-12T02:29:02.613333+0000","last_active":"2024-09-12T02:29:02.615086+0000","last_peered":"2024-09-12T02:29:02.615086+0000","last_clean":"2024-09-12T02:29:02.615086+0000","last_became_active":"2024-09-12T02:29:02.613020+0000","last_became_peered":"2024-09-12T02:29:02.613020+0000","last_unstale":"2024-09-12T02:29:02.615086+0000","last_undegraded":"2024-09-12T02:29:02.615086+0000","last_fullsized":"2024-09-12T02:29:02.615086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.606014+0000","last_change":"2024-09-12T02:29:01.600161+0000","last_active":"2024-09-12T02:29:02.606014+0000","last_peered":"2024-09-12T02:29:02.606014+0000","last_clean":"2024-09-12T02:29:02.606014+0000","last_became_active":"2024-09-12T02:29:01.599858+0000","last_became_peered":"2024-09-12T02:29:01.599858+0000","last_unstale":"2024-09-12T02:29:02.606014+0000","last_undegraded":"2024-09-12T02:29:02.606014+0000","last_fullsized":"2024-09-12T02:29:02.606014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:59.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586026+0000","last_change":"2024-09-12T02:29:01.586026+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586026+0000","last_undegraded":"2024-09-12T02:29:01.586026+0000","last_fullsized":"2024-09-12T02:29:01.586026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625648+0000","last_change":"2024-09-12T02:29:01.604076+0000","last_active":"2024-09-12T02:29:02.625648+0000","last_peered":"2024-09-12T02:29:02.625648+0000","last_clean":"2024-09-12T02:29:02.625648+0000","last_became_active":"2024-09-12T02:29:01.603786+0000","last_became_peered":"2024-09-12T02:29:01.603786+0000","last_unstale":"2024-09-12T02:29:02.625648+0000","last_undegraded":"2024-09-12T02:29:02.625648+0000","last_fullsized":"2024-09-12T02:29:02.625648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:02.920830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614961+0000","last_change":"2024-09-12T02:29:02.611837+0000","last_active":"2024-09-12T02:29:02.614961+0000","last_peered":"2024-09-12T02:29:02.614961+0000","last_clean":"2024-09-12T02:29:02.614961+0000","last_became_active":"2024-09-12T02:29:02.611576+0000","last_became_peered":"2024-09-12T02:29:02.611576+0000","last_unstale":"2024-09-12T02:29:02.614961+0000","last_undegraded":"2024-09-12T02:29:02.614961+0000","last_fullsized":"2024-09-12T02:29:02.614961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601352+0000","last_change":"2024-09-12T02:29:01.596912+0000","last_active":"2024-09-12T02:29:02.601352+0000","last_peered":"2024-09-12T02:29:02.601352+0000","last_clean":"2024-09-12T02:29:02.601352+0000","last_became_active":"2024-09-12T02:29:01.596630+0000","last_became_peered":"2024-09-12T02:29:01.596630+0000","last_unstale":"2024-09-12T02:29:02.601352+0000","last_undegraded":"2024-09-12T02:29:02.601352+0000","last_fullsized":"2024-09-12T02:29:02.601352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615648+0000","last_change":"2024-09-12T02:29:02.612642+0000","last_active":"2024-09-12T02:29:02.615648+0000","last_peered":"2024-09-12T02:29:02.615648+0000","last_clean":"2024-09-12T02:29:02.615648+0000","last_became_active":"2024-09-12T02:29:02.611562+0000","last_became_peered":"2024-09-12T02:29:02.611562+0000","last_unstale":"2024-09-12T02:29:02.615648+0000","last_undegraded":"2024-09-12T02:29:02.615648+0000","last_fullsized":"2024-09-12T02:29:02.615648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603588+0000","last_change":"2024-09-12T02:29:01.598396+0000","last_active":"2024-09-12T02:29:02.603588+0000","last_peered":"2024-09-12T02:29:02.603588+0000","last_clean":"2024-09-12T02:29:02.603588+0000","last_became_active":"2024-09-12T02:29:01.598101+0000","last_became_peered":"2024-09-12T02:29:01.598101+0000","last_unstale":"2024-09-12T02:29:02.603588+0000","last_undegraded":"2024-09-12T02:29:02.603588+0000","last_fullsized":"2024-09-12T02:29:02.603588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614058+0000","last_change":"2024-09-12T02:29:02.611150+0000","last_active":"2024-09-12T02:29:02.614058+0000","last_peered":"2024-09-12T02:29:02.614058+0000","last_clean":"2024-09-12T02:29:02.614058+0000","last_became_active":"2024-09-12T02:29:02.610804+0000","last_became_peered":"2024-09-12T02:29:02.610804+0000","last_unstale":"2024-09-12T02:29:02.614058+0000","last_undegraded":"2024-09-12T02:29:02.614058+0000","last_fullsized":"2024-09-12T02:29:02.614058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601328+0000","last_change":"2024-09-12T02:29:01.603466+0000","last_active":"2024-09-12T02:29:02.601328+0000","last_peered":"2024-09-12T02:29:02.601328+0000","last_clean":"2024-09-12T02:29:02.601328+0000","last_became_active":"2024-09-12T02:29:01.603162+0000","last_became_peered":"2024-09-12T02:29:01.603162+0000","last_unstale":"2024-09-12T02:29:02.601328+0000","last_undegraded":"2024-09-12T02:29:02.601328+0000","last_fullsized":"2024-09-12T02:29:02.601328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617426+0000","last_change":"2024-09-12T02:29:02.615106+0000","last_active":"2024-09-12T02:29:02.617426+0000","last_peered":"2024-09-12T02:29:02.617426+0000","last_clean":"2024-09-12T02:29:02.617426+0000","last_became_active":"2024-09-12T02:29:02.614701+0000","last_became_peered":"2024-09-12T02:29:02.614701+0000","last_unstale":"2024-09-12T02:29:02.617426+0000","last_undegraded":"2024-09-12T02:29:02.617426+0000","last_fullsized":"2024-09-12T02:29:02.617426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603855+0000","last_change":"2024-09-12T02:29:01.602856+0000","last_active":"2024-09-12T02:29:02.603855+0000","last_peered":"2024-09-12T02:29:02.603855+0000","last_clean":"2024-09-12T02:29:02.603855+0000","last_became_active":"2024-09-12T02:29:01.602602+0000","last_became_peered":"2024-09-12T02:29:01.602602+0000","last_unstale":"2024-09-12T02:29:02.603855+0000","last_undegraded":"2024-09-12T02:29:02.603855+0000","last_fullsized":"2024-09-12T02:29:02.603855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587573+0000","last_change":"2024-09-12T02:29:01.587573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587573+0000","last_undegraded":"2024-09-12T02:29:01.587573+0000","last_fullsized":"2024-09-12T02:29:01.587573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597837+0000","last_change":"2024-09-12T02:29:01.602771+0000","last_active":"2024-09-12T02:29:02.597837+0000","last_peered":"2024-09-12T02:29:02.597837+0000","last_clean":"2024-09-12T02:29:02.597837+0000","last_became_active":"2024-09-12T02:29:01.602503+0000","last_became_peered":"2024-09-12T02:29:01.602503+0000","last_unstale":"2024-09-12T02:29:02.597837+0000","last_undegraded":"2024-09-12T02:29:02.597837+0000","last_fullsized":"2024-09-12T02:29:02.597837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:25.395144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625226+0000","last_change":"2024-09-12T02:29:02.618017+0000","last_active":"2024-09-12T02:29:02.625226+0000","last_peered":"2024-09-12T02:29:02.625226+0000","last_clean":"2024-09-12T02:29:02.625226+0000","last_became_active":"2024-09-12T02:29:02.617733+0000","last_became_peered":"2024-09-12T02:29:02.617733+0000","last_unstale":"2024-09-12T02:29:02.625226+0000","last_undegraded":"2024-09-12T02:29:02.625226+0000","last_fullsized":"2024-09-12T02:29:02.625226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599135+0000","last_change":"2024-09-12T02:29:01.597751+0000","last_active":"2024-09-12T02:29:01.599135+0000","last_peered":"2024-09-12T02:29:01.599135+0000","last_clean":"2024-09-12T02:29:01.599135+0000","last_became_active":"2024-09-12T02:29:01.597513+0000","last_became_peered":"2024-09-12T02:29:01.597513+0000","last_unstale":"2024-09-12T02:29:01.599135+0000","last_undegraded":"2024-09-12T02:29:01.599135+0000","last_fullsized":"2024-09-12T02:29:01.599135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.741427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612062+0000","last_change":"2024-09-12T02:29:02.608831+0000","last_active":"2024-09-12T02:29:02.612062+0000","last_peered":"2024-09-12T02:29:02.612062+0000","last_clean":"2024-09-12T02:29:02.612062+0000","last_became_active":"2024-09-12T02:29:02.608580+0000","last_became_peered":"2024-09-12T02:29:02.608580+0000","last_unstale":"2024-09-12T02:29:02.612062+0000","last_undegraded":"2024-09-12T02:29:02.612062+0000","last_fullsized":"2024-09-12T02:29:02.612062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596538+0000","last_change":"2024-09-12T02:29:01.600549+0000","last_active":"2024-09-12T02:29:02.596538+0000","last_peered":"2024-09-12T02:29:02.596538+0000","last_clean":"2024-09-12T02:29:02.596538+0000","last_became_active":"2024-09-12T02:29:01.600196+0000","last_became_peered":"2024-09-12T02:29:01.600196+0000","last_unstale":"2024-09-12T02:29:02.596538+0000","last_undegraded":"2024-09-12T02:29:02.596538+0000","last_fullsized":"2024-09-12T02:29:02.596538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.600032+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:02.600032+0000","last_peered":"2024-09-12T02:29:02.600032+0000","last_clean":"2024-09-12T02:29:02.600032+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:02.600032+0000","last_undegraded":"2024-09-12T02:29:02.600032+0000","last_fullsized":"2024-09-12T02:29:02.600032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":128859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:06.208 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-12T02:29:06.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.593315+0000', 'last_change': '2024-09-12T02:29:01.593315+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.593315+0000', 'last_undegraded': '2024-09-12T02:29:01.593315+0000', 'last_fullsized': '2024-09-12T02:29:01.593315+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.208 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.587614+0000', 'last_change': '2024-09-12T02:29:01.587614+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.587614+0000', 'last_undegraded': '2024-09-12T02:29:01.587614+0000', 'last_fullsized': '2024-09-12T02:29:01.587614+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.590003+0000', 'last_change': '2024-09-12T02:29:01.590003+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.590003+0000', 'last_undegraded': '2024-09-12T02:29:01.590003+0000', 'last_fullsized': '2024-09-12T02:29:01.590003+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.587203+0000', 'last_change': '2024-09-12T02:29:01.587203+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.587203+0000', 'last_undegraded': '2024-09-12T02:29:01.587203+0000', 'last_fullsized': '2024-09-12T02:29:01.587203+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.589414+0000', 'last_change': '2024-09-12T02:29:01.589414+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.589414+0000', 'last_undegraded': '2024-09-12T02:29:01.589414+0000', 'last_fullsized': '2024-09-12T02:29:01.589414+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.592939+0000', 'last_change': '2024-09-12T02:29:01.592939+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.592939+0000', 'last_undegraded': '2024-09-12T02:29:01.592939+0000', 'last_fullsized': '2024-09-12T02:29:01.592939+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.209 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.589490+0000', 'last_change': '2024-09-12T02:29:01.589490+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.589490+0000', 'last_undegraded': '2024-09-12T02:29:01.589490+0000', 'last_fullsized': '2024-09-12T02:29:01.589490+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.586573+0000', 'last_change': '2024-09-12T02:29:01.586573+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.586573+0000', 'last_undegraded': '2024-09-12T02:29:01.586573+0000', 'last_fullsized': '2024-09-12T02:29:01.586573+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.592508+0000', 'last_change': '2024-09-12T02:29:01.592508+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.592508+0000', 'last_undegraded': '2024-09-12T02:29:01.592508+0000', 'last_fullsized': '2024-09-12T02:29:01.592508+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.594568+0000', 'last_change': '2024-09-12T02:29:01.594568+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.594568+0000', 'last_undegraded': '2024-09-12T02:29:01.594568+0000', 'last_fullsized': '2024-09-12T02:29:01.594568+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.590800+0000', 'last_change': '2024-09-12T02:29:01.590800+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.590800+0000', 'last_undegraded': '2024-09-12T02:29:01.590800+0000', 'last_fullsized': '2024-09-12T02:29:01.590800+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-12T02:29:06.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.592274+0000', 'last_change': '2024-09-12T02:29:01.592274+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.592274+0000', 'last_undegraded': '2024-09-12T02:29:01.592274+0000', 'last_fullsized': '2024-09-12T02:29:01.592274+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.586743+0000', 'last_change': '2024-09-12T02:29:01.586743+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.586743+0000', 'last_undegraded': '2024-09-12T02:29:01.586743+0000', 'last_fullsized': '2024-09-12T02:29:01.586743+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.586572+0000', 'last_change': '2024-09-12T02:29:01.586572+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.586572+0000', 'last_undegraded': '2024-09-12T02:29:01.586572+0000', 'last_fullsized': '2024-09-12T02:29:01.586572+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.586513+0000', 'last_change': '2024-09-12T02:29:01.586513+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.586513+0000', 'last_undegraded': '2024-09-12T02:29:01.586513+0000', 'last_fullsized': '2024-09-12T02:29:01.586513+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.587988+0000', 'last_change': '2024-09-12T02:29:01.587988+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.587988+0000', 'last_undegraded': '2024-09-12T02:29:01.587988+0000', 'last_fullsized': '2024-09-12T02:29:01.587988+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.586026+0000', 'last_change': '2024-09-12T02:29:01.586026+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.586026+0000', 'last_undegraded': '2024-09-12T02:29:01.586026+0000', 'last_fullsized': '2024-09-12T02:29:01.586026+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:06.211 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-12T02:29:06.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:01.587573+0000', 'last_change': '2024-09-12T02:29:01.587573+0000', 'last_active': '2024-09-12T02:29:01.578884+0000', 'last_peered': '2024-09-12T02:29:01.578884+0000', 'last_clean': '2024-09-12T02:29:01.578884+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:01.587573+0000', 'last_undegraded': '2024-09-12T02:29:01.587573+0000', 'last_fullsized': '2024-09-12T02:29:01.587573+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:01.578884+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:06.212 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:29:06.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.342+0000 7f40a7fe8640 1 Processor -- start 2024-09-12T02:29:06.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.343+0000 7f40a7fe8640 1 -- start start 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.343+0000 7f40a7fe8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a00b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.343+0000 7f40a7fe8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40a00cf840 0x7f40a00b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.343+0000 7f40a7fe8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a015e970 con 0x7f40a015e590 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.343+0000 7f40a7fe8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f40a00d41f0 con 0x7f40a00cf840 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.343+0000 7f40a7fe8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40a00d2800 con 0x7f40a00b7530 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a6585640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40a00cf840 0x7f40a00b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a6585640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40a00cf840 0x7f40a00b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53692/0 (socket says 172.21.15.181:53692) 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a6585640 1 -- 172.21.15.181:0/1874380417 learned_addr learned my addr 172.21.15.181:0/1874380417 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a5583640 1 --2- 172.21.15.181:0/1874380417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a00b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a6585640 1 -- 172.21.15.181:0/1874380417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 msgr2=0x7f40a00b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:06.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a6585640 1 --2- 172.21.15.181:0/1874380417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a00b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a6585640 1 -- 172.21.15.181:0/1874380417 >> v1:172.21.15.204:6789/0 conn(0x7f40a015e590 legacy=0x7f40a00d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.344+0000 7f40a6585640 1 -- 172.21.15.181:0/1874380417 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a00d2ae0 con 0x7f40a00cf840 2024-09-12T02:29:06.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a6585640 1 --2- 172.21.15.181:0/1874380417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a00cf840 0x7f40a00b6460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4098009e50 tx=0x7f409802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b03f0d8139de17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a4d82640 1 -- 172.21.15.181:0/1874380417 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098036070 con 0x7f40a00cf840 2024-09-12T02:29:06.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a4d82640 1 -- 172.21.15.181:0/1874380417 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4098031600 con 0x7f40a00cf840 2024-09-12T02:29:06.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a4d82640 1 -- 172.21.15.181:0/1874380417 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40980319d0 con 0x7f40a00cf840 2024-09-12T02:29:06.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 -- 172.21.15.181:0/1874380417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a00cf840 msgr2=0x7f40a00b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/1874380417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a00cf840 0x7f40a00b6460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4098009e50 tx=0x7f409802a680 comp rx=0 tx=0).stop 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 -- 172.21.15.181:0/1874380417 shutdown_connections 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/1874380417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a00cf840 0x7f40a00b6460 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/1874380417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a00b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 -- 172.21.15.181:0/1874380417 >> 172.21.15.181:0/1874380417 conn(0x7f40a0067d70 msgr2=0x7f40a0068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 -- 172.21.15.181:0/1874380417 shutdown_connections 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.345+0000 7f40a7fe8640 1 -- 172.21.15.181:0/1874380417 wait complete. 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 Processor -- start 2024-09-12T02:29:06.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 -- start start 2024-09-12T02:29:06.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a0158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40a00cf840 0x7f40a00cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a015e590 0x7f40a0160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f40a0162070 con 0x7f40a015e590 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00d30a0 con 0x7f40a00cf840 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.347+0000 7f40a7fe8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40a01621f0 con 0x7f40a00b7530 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a015e590 0x7f40a0160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a015e590 0x7f40a0160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53696/0 (socket says 172.21.15.181:53696) 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 -- 172.21.15.181:0/3369972879 learned_addr learned my addr 172.21.15.181:0/3369972879 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a5d84640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a0158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a5583640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40a00cf840 0x7f40a00cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 -- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 msgr2=0x7f40a0158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a0158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 -- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40a00cf840 msgr2=0x7f40a00cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40a00cf840 0x7f40a00cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 -- 172.21.15.181:0/3369972879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a0161010 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a5583640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40a00cf840 0x7f40a00cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a6585640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a015e590 0x7f40a0160710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4098009f70 tx=0x7f4098004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40927fc640 1 -- 172.21.15.181:0/3369972879 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409803f020 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40927fc640 1 -- 172.21.15.181:0/3369972879 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4098037040 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40927fc640 1 -- 172.21.15.181:0/3369972879 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098036070 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a00c8220 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.348+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a0160c50 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.349+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a00d3930 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.350+0000 7f40927fc640 1 -- 172.21.15.181:0/3369972879 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4098042020 con 0x7f40a015e590 2024-09-12T02:29:06.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.350+0000 7f40927fc640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f408406be60 0x7f408406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.350+0000 7f40927fc640 1 -- 172.21.15.181:0/3369972879 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f40980ab190 con 0x7f40a015e590 2024-09-12T02:29:06.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.350+0000 7f40a5d84640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f408406be60 0x7f408406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.350+0000 7f40a5d84640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f408406be60 0x7f408406e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40a00b95b0 tx=0x7f4094009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.354+0000 7f40927fc640 1 -- 172.21.15.181:0/3369972879 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4098049030 con 0x7f40a015e590 2024-09-12T02:29:06.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.583+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f40a00cf3b0 con 0x7f40a015e590 2024-09-12T02:29:06.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.583+0000 7f40927fc640 1 -- 172.21.15.181:0/3369972879 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1140 (secure 0 0 0) 0x7f4098079b30 con 0x7f40a015e590 2024-09-12T02:29:06.584 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:06.584 INFO:teuthology.orchestra.run.smithi181.stdout:{"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":67,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1726108091,"num_in_osds":8,"osd_in_since":1726108081,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":79},{"state_name":"creating+peering","count":18}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":591166,"bytes_used":225230848,"bytes_avail":772868882432,"bytes_total":773094113280,"inactive_pgs_ratio":0.18556700646877289,"write_bytes_sec":2815,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":13,"btime":"2024-09-12T02:29:04:610592+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4756}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T02:27:59.517050+0000","services":{}},"progress_events":{}} 2024-09-12T02:29:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f408406be60 msgr2=0x7f408406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f408406be60 0x7f408406e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40a00b95b0 tx=0x7f4094009040 comp rx=0 tx=0).stop 2024-09-12T02:29:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a015e590 msgr2=0x7f40a0160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a015e590 0x7f40a0160710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4098009f70 tx=0x7f4098004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 shutdown_connections 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f408406be60 0x7f408406e320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40a00cf840 0x7f40a00cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40a015e590 0x7f40a0160710 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 --2- 172.21.15.181:0/3369972879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40a00b7530 0x7f40a0158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 >> 172.21.15.181:0/3369972879 conn(0x7f40a0067d70 msgr2=0x7f40a00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 shutdown_connections 2024-09-12T02:29:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.585+0000 7f40a7fe8640 1 -- 172.21.15.181:0/3369972879 wait complete. 2024-09-12T02:29:06.597 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:29:06.597 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:06.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.695+0000 7f7e1350a640 1 Processor -- start 2024-09-12T02:29:06.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.696+0000 7f7e1350a640 1 -- start start 2024-09-12T02:29:06.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.696+0000 7f7e1350a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cf2b0 0x7f7e0c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.696+0000 7f7e1350a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.696+0000 7f7e1350a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e0c15ea20 con 0x7f7e0c15e640 2024-09-12T02:29:06.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.696+0000 7f7e1350a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7e0c0b3d00 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.696+0000 7f7e1350a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c0b2860 con 0x7f7e0c0cf720 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e10aa5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cf2b0 0x7f7e0c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e11aa7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e10aa5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cf2b0 0x7f7e0c0d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:54644/0 (socket says 172.21.15.181:54644) 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e11aa7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c0d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:42204/0 (socket says 172.21.15.181:42204) 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e10aa5640 1 -- 172.21.15.181:0/3285618092 learned_addr learned my addr 172.21.15.181:0/3285618092 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e112a6640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f7e0c15e640 0x7f7e0c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:36038/0 (socket says 172.21.15.181:36038) 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e11aa7640 1 -- 172.21.15.181:0/3285618092 >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cf2b0 msgr2=0x7f7e0c0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e11aa7640 1 --2- 172.21.15.181:0/3285618092 >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cf2b0 0x7f7e0c0d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e11aa7640 1 -- 172.21.15.181:0/3285618092 >> v1:172.21.15.204:6789/0 conn(0x7f7e0c15e640 legacy=0x7f7e0c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e11aa7640 1 -- 172.21.15.181:0/3285618092 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c0b1c50 con 0x7f7e0c0cf720 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.697+0000 7f7e10aa5640 1 --2- 172.21.15.181:0/3285618092 >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cf2b0 0x7f7e0c0d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.698+0000 7f7e11aa7640 1 --2- 172.21.15.181:0/3285618092 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c0d2b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009d90 tx=0x7f7e0402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51787c03344abc08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.698+0000 7f7e03fff640 1 -- 172.21.15.181:0/3285618092 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04031600 con 0x7f7e0c0cf720 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.698+0000 7f7e03fff640 1 -- 172.21.15.181:0/3285618092 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e040317a0 con 0x7f7e0c0cf720 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.698+0000 7f7e03fff640 1 -- 172.21.15.181:0/3285618092 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04031b70 con 0x7f7e0c0cf720 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.698+0000 7f7e1350a640 1 -- 172.21.15.181:0/3285618092 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 msgr2=0x7f7e0c0d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.698+0000 7f7e1350a640 1 --2- 172.21.15.181:0/3285618092 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c0d2b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009d90 tx=0x7f7e0402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.699+0000 7f7e1350a640 1 -- 172.21.15.181:0/3285618092 shutdown_connections 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.699+0000 7f7e1350a640 1 --2- 172.21.15.181:0/3285618092 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c0d2b90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.699+0000 7f7e1350a640 1 --2- 172.21.15.181:0/3285618092 >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cf2b0 0x7f7e0c0d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.699+0000 7f7e1350a640 1 -- 172.21.15.181:0/3285618092 >> 172.21.15.181:0/3285618092 conn(0x7f7e0c09d820 msgr2=0x7f7e0c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.699+0000 7f7e1350a640 1 -- 172.21.15.181:0/3285618092 shutdown_connections 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.699+0000 7f7e1350a640 1 -- 172.21.15.181:0/3285618092 wait complete. 2024-09-12T02:29:06.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.700+0000 7f7e1350a640 1 Processor -- start 2024-09-12T02:29:06.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.700+0000 7f7e1350a640 1 -- start start 2024-09-12T02:29:06.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e1350a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0cf2b0 0x7f7e0c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e1350a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e1350a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c15e640 0x7f7e0c1f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e1350a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0b24f0 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e1350a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0b2210 con 0x7f7e0c15e640 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e1350a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c0cfe40 con 0x7f7e0c0cf720 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0cf2b0 0x7f7e0c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0cf2b0 0x7f7e0c0c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53710/0 (socket says 172.21.15.181:53710) 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 -- 172.21.15.181:0/1559616603 learned_addr learned my addr 172.21.15.181:0/1559616603 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e10aa5640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e11aa7640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c15e640 0x7f7e0c1f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 -- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 msgr2=0x7f7e0c160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 -- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c15e640 msgr2=0x7f7e0c1f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c15e640 0x7f7e0c1f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 -- 172.21.15.181:0/1559616603 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c1f4860 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e11aa7640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c15e640 0x7f7e0c1f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e112a6640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0cf2b0 0x7f7e0c0c93c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c400 tx=0x7f7e0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e01ffb640 1 -- 172.21.15.181:0/1559616603 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e080074e0 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e01ffb640 1 -- 172.21.15.181:0/1559616603 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08007680 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c1f4b00 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.701+0000 7f7e01ffb640 1 -- 172.21.15.181:0/1559616603 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08004a00 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.702+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c1f50c0 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.703+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c068eb0 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.703+0000 7f7e01ffb640 1 -- 172.21.15.181:0/1559616603 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e0801a020 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.703+0000 7f7e01ffb640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7df006be30 0x7f7df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.704+0000 7f7e01ffb640 1 -- 172.21.15.181:0/1559616603 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7e0808a680 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.704+0000 7f7e10aa5640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7df006be30 0x7f7df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.704+0000 7f7e10aa5640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7df006be30 0x7f7df006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c15e1f0 tx=0x7f7dfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.708+0000 7f7e01ffb640 1 -- 172.21.15.181:0/1559616603 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e08010300 con 0x7f7e0c0cf2b0 2024-09-12T02:29:06.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.869+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e0c0b8930 con 0x7f7df006be30 2024-09-12T02:29:06.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.875+0000 7f7e01ffb640 1 -- 172.21.15.181:0/1559616603 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250408 (secure 0 0 0) 0x7f7e0c0b8930 con 0x7f7df006be30 2024-09-12T02:29:06.879 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:06.880 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:06.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7df006be30 msgr2=0x7f7df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7df006be30 0x7f7df006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c15e1f0 tx=0x7f7dfc008040 comp rx=0 tx=0).stop 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0cf2b0 msgr2=0x7f7e0c0c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0cf2b0 0x7f7e0c0c93c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c400 tx=0x7f7e0800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 shutdown_connections 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7df006be30 0x7f7df006e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c15e640 0x7f7e0c1f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cf720 0x7f7e0c160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 --2- 172.21.15.181:0/1559616603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0cf2b0 0x7f7e0c0c93c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 >> 172.21.15.181:0/1559616603 conn(0x7f7e0c09d820 msgr2=0x7f7e0c0b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 shutdown_connections 2024-09-12T02:29:06.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:06.878+0000 7f7e1350a640 1 -- 172.21.15.181:0/1559616603 wait complete. 2024-09-12T02:29:06.890 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-12T02:29:05.620405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219952,"kb_used_data":3708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754768,"statfs":{"total":773094113280,"available":772868882432,"internally_reserved":0,"allocated":3796992,"data_stored":2151649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040652"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621991+0000","last_change":"2024-09-12T02:29:02.616935+0000","last_active":"2024-09-12T02:29:02.621991+0000","last_peered":"2024-09-12T02:29:02.621991+0000","last_clean":"2024-09-12T02:29:02.621991+0000","last_became_active":"2024-09-12T02:29:02.616651+0000","last_became_peered":"2024-09-12T02:29:02.616651+0000","last_unstale":"2024-09-12T02:29:02.621991+0000","last_undegraded":"2024-09-12T02:29:02.621991+0000","last_fullsized":"2024-09-12T02:29:02.621991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.593315+0000","last_change":"2024-09-12T02:29:01.593315+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.593315+0000","last_undegraded":"2024-09-12T02:29:01.593315+0000","last_fullsized":"2024-09-12T02:29:01.593315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622654+0000","last_change":"2024-09-12T02:29:02.617918+0000","last_active":"2024-09-12T02:29:02.622654+0000","last_peered":"2024-09-12T02:29:02.622654+0000","last_clean":"2024-09-12T02:29:02.622654+0000","last_became_active":"2024-09-12T02:29:02.617296+0000","last_became_peered":"2024-09-12T02:29:02.617296+0000","last_unstale":"2024-09-12T02:29:02.622654+0000","last_undegraded":"2024-09-12T02:29:02.622654+0000","last_fullsized":"2024-09-12T02:29:02.622654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620632+0000","last_change":"2024-09-12T02:29:02.617491+0000","last_active":"2024-09-12T02:29:02.620632+0000","last_peered":"2024-09-12T02:29:02.620632+0000","last_clean":"2024-09-12T02:29:02.620632+0000","last_became_active":"2024-09-12T02:29:02.617229+0000","last_became_peered":"2024-09-12T02:29:02.617229+0000","last_unstale":"2024-09-12T02:29:02.620632+0000","last_undegraded":"2024-09-12T02:29:02.620632+0000","last_fullsized":"2024-09-12T02:29:02.620632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587614+0000","last_change":"2024-09-12T02:29:01.587614+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587614+0000","last_undegraded":"2024-09-12T02:29:01.587614+0000","last_fullsized":"2024-09-12T02:29:01.587614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590003+0000","last_change":"2024-09-12T02:29:01.590003+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590003+0000","last_undegraded":"2024-09-12T02:29:01.590003+0000","last_fullsized":"2024-09-12T02:29:01.590003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615107+0000","last_change":"2024-09-12T02:29:02.613356+0000","last_active":"2024-09-12T02:29:02.615107+0000","last_peered":"2024-09-12T02:29:02.615107+0000","last_clean":"2024-09-12T02:29:02.615107+0000","last_became_active":"2024-09-12T02:29:02.613093+0000","last_became_peered":"2024-09-12T02:29:02.613093+0000","last_unstale":"2024-09-12T02:29:02.615107+0000","last_undegraded":"2024-09-12T02:29:02.615107+0000","last_fullsized":"2024-09-12T02:29:02.615107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612094+0000","last_change":"2024-09-12T02:29:02.608265+0000","last_active":"2024-09-12T02:29:02.612094+0000","last_peered":"2024-09-12T02:29:02.612094+0000","last_clean":"2024-09-12T02:29:02.612094+0000","last_became_active":"2024-09-12T02:29:02.607991+0000","last_became_peered":"2024-09-12T02:29:02.607991+0000","last_unstale":"2024-09-12T02:29:02.612094+0000","last_undegraded":"2024-09-12T02:29:02.612094+0000","last_fullsized":"2024-09-12T02:29:02.612094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615727+0000","last_change":"2024-09-12T02:29:02.608629+0000","last_active":"2024-09-12T02:29:02.615727+0000","last_peered":"2024-09-12T02:29:02.615727+0000","last_clean":"2024-09-12T02:29:02.615727+0000","last_became_active":"2024-09-12T02:29:02.608224+0000","last_became_peered":"2024-09-12T02:29:02.608224+0000","last_unstale":"2024-09-12T02:29:02.615727+0000","last_undegraded":"2024-09-12T02:29:02.615727+0000","last_fullsized":"2024-09-12T02:29:02.615727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625722+0000","last_change":"2024-09-12T02:29:02.618718+0000","last_active":"2024-09-12T02:29:02.625722+0000","last_peered":"2024-09-12T02:29:02.625722+0000","last_clean":"2024-09-12T02:29:02.625722+0000","last_became_active":"2024-09-12T02:29:02.618431+0000","last_became_peered":"2024-09-12T02:29:02.618431+0000","last_unstale":"2024-09-12T02:29:02.625722+0000","last_undegraded":"2024-09-12T02:29:02.625722+0000","last_fullsized":"2024-09-12T02:29:02.625722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615135+0000","last_change":"2024-09-12T02:29:02.612372+0000","last_active":"2024-09-12T02:29:02.615135+0000","last_peered":"2024-09-12T02:29:02.615135+0000","last_clean":"2024-09-12T02:29:02.615135+0000","last_became_active":"2024-09-12T02:29:02.612114+0000","last_became_peered":"2024-09-12T02:29:02.612114+0000","last_unstale":"2024-09-12T02:29:02.615135+0000","last_undegraded":"2024-09-12T02:29:02.615135+0000","last_fullsized":"2024-09-12T02:29:02.615135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615927+0000","last_change":"2024-09-12T02:29:02.613466+0000","last_active":"2024-09-12T02:29:02.615927+0000","last_peered":"2024-09-12T02:29:02.615927+0000","last_clean":"2024-09-12T02:29:02.615927+0000","last_became_active":"2024-09-12T02:29:02.613203+0000","last_became_peered":"2024-09-12T02:29:02.613203+0000","last_unstale":"2024-09-12T02:29:02.615927+0000","last_undegraded":"2024-09-12T02:29:02.615927+0000","last_fullsized":"2024-09-12T02:29:02.615927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587203+0000","last_change":"2024-09-12T02:29:01.587203+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587203+0000","last_undegraded":"2024-09-12T02:29:01.587203+0000","last_fullsized":"2024-09-12T02:29:01.587203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589414+0000","last_change":"2024-09-12T02:29:01.589414+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589414+0000","last_undegraded":"2024-09-12T02:29:01.589414+0000","last_fullsized":"2024-09-12T02:29:01.589414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622779+0000","last_change":"2024-09-12T02:29:02.620045+0000","last_active":"2024-09-12T02:29:02.622779+0000","last_peered":"2024-09-12T02:29:02.622779+0000","last_clean":"2024-09-12T02:29:02.622779+0000","last_became_active":"2024-09-12T02:29:02.619376+0000","last_became_peered":"2024-09-12T02:29:02.619376+0000","last_unstale":"2024-09-12T02:29:02.622779+0000","last_undegraded":"2024-09-12T02:29:02.622779+0000","last_fullsized":"2024-09-12T02:29:02.622779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:19.331506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620723+0000","last_change":"2024-09-12T02:29:02.618015+0000","last_active":"2024-09-12T02:29:02.620723+0000","last_peered":"2024-09-12T02:29:02.620723+0000","last_clean":"2024-09-12T02:29:02.620723+0000","last_became_active":"2024-09-12T02:29:02.617750+0000","last_became_peered":"2024-09-12T02:29:02.617750+0000","last_unstale":"2024-09-12T02:29:02.620723+0000","last_undegraded":"2024-09-12T02:29:02.620723+0000","last_fullsized":"2024-09-12T02:29:02.620723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.619552+0000","last_change":"2024-09-12T02:29:02.616002+0000","last_active":"2024-09-12T02:29:02.619552+0000","last_peered":"2024-09-12T02:29:02.619552+0000","last_clean":"2024-09-12T02:29:02.619552+0000","last_became_active":"2024-09-12T02:29:02.615650+0000","last_became_peered":"2024-09-12T02:29:02.615650+0000","last_unstale":"2024-09-12T02:29:02.619552+0000","last_undegraded":"2024-09-12T02:29:02.619552+0000","last_fullsized":"2024-09-12T02:29:02.619552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592939+0000","last_change":"2024-09-12T02:29:01.592939+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592939+0000","last_undegraded":"2024-09-12T02:29:01.592939+0000","last_fullsized":"2024-09-12T02:29:01.592939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.589490+0000","last_change":"2024-09-12T02:29:01.589490+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.589490+0000","last_undegraded":"2024-09-12T02:29:01.589490+0000","last_fullsized":"2024-09-12T02:29:01.589490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586573+0000","last_change":"2024-09-12T02:29:01.586573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586573+0000","last_undegraded":"2024-09-12T02:29:01.586573+0000","last_fullsized":"2024-09-12T02:29:01.586573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616748+0000","last_change":"2024-09-12T02:29:02.612217+0000","last_active":"2024-09-12T02:29:02.616748+0000","last_peered":"2024-09-12T02:29:02.616748+0000","last_clean":"2024-09-12T02:29:02.616748+0000","last_became_active":"2024-09-12T02:29:02.611931+0000","last_became_peered":"2024-09-12T02:29:02.611931+0000","last_unstale":"2024-09-12T02:29:02.616748+0000","last_undegraded":"2024-09-12T02:29:02.616748+0000","last_fullsized":"2024-09-12T02:29:02.616748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:02.620384+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:02.618647+0000","last_became_peered":"2024-09-12T02:29:02.618647+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.611401+0000","last_change":"2024-09-12T02:29:02.608849+0000","last_active":"2024-09-12T02:29:02.611401+0000","last_peered":"2024-09-12T02:29:02.611401+0000","last_clean":"2024-09-12T02:29:02.611401+0000","last_became_active":"2024-09-12T02:29:02.608571+0000","last_became_peered":"2024-09-12T02:29:02.608571+0000","last_unstale":"2024-09-12T02:29:02.611401+0000","last_undegraded":"2024-09-12T02:29:02.611401+0000","last_fullsized":"2024-09-12T02:29:02.611401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614879+0000","last_change":"2024-09-12T02:29:02.611689+0000","last_active":"2024-09-12T02:29:02.614879+0000","last_peered":"2024-09-12T02:29:02.614879+0000","last_clean":"2024-09-12T02:29:02.614879+0000","last_became_active":"2024-09-12T02:29:02.611155+0000","last_became_peered":"2024-09-12T02:29:02.611155+0000","last_unstale":"2024-09-12T02:29:02.614879+0000","last_undegraded":"2024-09-12T02:29:02.614879+0000","last_fullsized":"2024-09-12T02:29:02.614879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616086+0000","last_change":"2024-09-12T02:29:02.610975+0000","last_active":"2024-09-12T02:29:02.616086+0000","last_peered":"2024-09-12T02:29:02.616086+0000","last_clean":"2024-09-12T02:29:02.616086+0000","last_became_active":"2024-09-12T02:29:02.610711+0000","last_became_peered":"2024-09-12T02:29:02.610711+0000","last_unstale":"2024-09-12T02:29:02.616086+0000","last_undegraded":"2024-09-12T02:29:02.616086+0000","last_fullsized":"2024-09-12T02:29:02.616086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592508+0000","last_change":"2024-09-12T02:29:01.592508+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592508+0000","last_undegraded":"2024-09-12T02:29:01.592508+0000","last_fullsized":"2024-09-12T02:29:01.592508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620634+0000","last_change":"2024-09-12T02:29:02.617285+0000","last_active":"2024-09-12T02:29:02.620634+0000","last_peered":"2024-09-12T02:29:02.620634+0000","last_clean":"2024-09-12T02:29:02.620634+0000","last_became_active":"2024-09-12T02:29:02.617000+0000","last_became_peered":"2024-09-12T02:29:02.617000+0000","last_unstale":"2024-09-12T02:29:02.620634+0000","last_undegraded":"2024-09-12T02:29:02.620634+0000","last_fullsized":"2024-09-12T02:29:02.620634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621177+0000","last_change":"2024-09-12T02:29:02.614642+0000","last_active":"2024-09-12T02:29:02.621177+0000","last_peered":"2024-09-12T02:29:02.621177+0000","last_clean":"2024-09-12T02:29:02.621177+0000","last_became_active":"2024-09-12T02:29:02.614378+0000","last_became_peered":"2024-09-12T02:29:02.614378+0000","last_unstale":"2024-09-12T02:29:02.621177+0000","last_undegraded":"2024-09-12T02:29:02.621177+0000","last_fullsized":"2024-09-12T02:29:02.621177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625610+0000","last_change":"2024-09-12T02:29:02.618923+0000","last_active":"2024-09-12T02:29:02.625610+0000","last_peered":"2024-09-12T02:29:02.625610+0000","last_clean":"2024-09-12T02:29:02.625610+0000","last_became_active":"2024-09-12T02:29:02.618672+0000","last_became_peered":"2024-09-12T02:29:02.618672+0000","last_unstale":"2024-09-12T02:29:02.625610+0000","last_undegraded":"2024-09-12T02:29:02.625610+0000","last_fullsized":"2024-09-12T02:29:02.625610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612121+0000","last_change":"2024-09-12T02:29:02.607465+0000","last_active":"2024-09-12T02:29:02.612121+0000","last_peered":"2024-09-12T02:29:02.612121+0000","last_clean":"2024-09-12T02:29:02.612121+0000","last_became_active":"2024-09-12T02:29:02.607166+0000","last_became_peered":"2024-09-12T02:29:02.607166+0000","last_unstale":"2024-09-12T02:29:02.612121+0000","last_undegraded":"2024-09-12T02:29:02.612121+0000","last_fullsized":"2024-09-12T02:29:02.612121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614453+0000","last_change":"2024-09-12T02:29:02.607409+0000","last_active":"2024-09-12T02:29:02.614453+0000","last_peered":"2024-09-12T02:29:02.614453+0000","last_clean":"2024-09-12T02:29:02.614453+0000","last_became_active":"2024-09-12T02:29:02.607135+0000","last_became_peered":"2024-09-12T02:29:02.607135+0000","last_unstale":"2024-09-12T02:29:02.614453+0000","last_undegraded":"2024-09-12T02:29:02.614453+0000","last_fullsized":"2024-09-12T02:29:02.614453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:32.972013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614876+0000","last_change":"2024-09-12T02:29:02.610003+0000","last_active":"2024-09-12T02:29:02.614876+0000","last_peered":"2024-09-12T02:29:02.614876+0000","last_clean":"2024-09-12T02:29:02.614876+0000","last_became_active":"2024-09-12T02:29:02.609706+0000","last_became_peered":"2024-09-12T02:29:02.609706+0000","last_unstale":"2024-09-12T02:29:02.614876+0000","last_undegraded":"2024-09-12T02:29:02.614876+0000","last_fullsized":"2024-09-12T02:29:02.614876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614771+0000","last_change":"2024-09-12T02:29:02.609713+0000","last_active":"2024-09-12T02:29:02.614771+0000","last_peered":"2024-09-12T02:29:02.614771+0000","last_clean":"2024-09-12T02:29:02.614771+0000","last_became_active":"2024-09-12T02:29:02.609443+0000","last_became_peered":"2024-09-12T02:29:02.609443+0000","last_unstale":"2024-09-12T02:29:02.614771+0000","last_undegraded":"2024-09-12T02:29:02.614771+0000","last_fullsized":"2024-09-12T02:29:02.614771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625719+0000","last_change":"2024-09-12T02:29:01.601092+0000","last_active":"2024-09-12T02:29:02.625719+0000","last_peered":"2024-09-12T02:29:02.625719+0000","last_clean":"2024-09-12T02:29:02.625719+0000","last_became_active":"2024-09-12T02:29:01.600800+0000","last_became_peered":"2024-09-12T02:29:01.600800+0000","last_unstale":"2024-09-12T02:29:02.625719+0000","last_undegraded":"2024-09-12T02:29:02.625719+0000","last_fullsized":"2024-09-12T02:29:02.625719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612633+0000","last_change":"2024-09-12T02:29:02.604002+0000","last_active":"2024-09-12T02:29:02.612633+0000","last_peered":"2024-09-12T02:29:02.612633+0000","last_clean":"2024-09-12T02:29:02.612633+0000","last_became_active":"2024-09-12T02:29:02.603729+0000","last_became_peered":"2024-09-12T02:29:02.603729+0000","last_unstale":"2024-09-12T02:29:02.612633+0000","last_undegraded":"2024-09-12T02:29:02.612633+0000","last_fullsized":"2024-09-12T02:29:02.612633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:55.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621841+0000","last_change":"2024-09-12T02:29:01.603395+0000","last_active":"2024-09-12T02:29:02.621841+0000","last_peered":"2024-09-12T02:29:02.621841+0000","last_clean":"2024-09-12T02:29:02.621841+0000","last_became_active":"2024-09-12T02:29:01.602799+0000","last_became_peered":"2024-09-12T02:29:01.602799+0000","last_unstale":"2024-09-12T02:29:02.621841+0000","last_undegraded":"2024-09-12T02:29:02.621841+0000","last_fullsized":"2024-09-12T02:29:02.621841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625432+0000","last_change":"2024-09-12T02:29:02.618545+0000","last_active":"2024-09-12T02:29:02.625432+0000","last_peered":"2024-09-12T02:29:02.625432+0000","last_clean":"2024-09-12T02:29:02.625432+0000","last_became_active":"2024-09-12T02:29:02.618260+0000","last_became_peered":"2024-09-12T02:29:02.618260+0000","last_unstale":"2024-09-12T02:29:02.625432+0000","last_undegraded":"2024-09-12T02:29:02.625432+0000","last_fullsized":"2024-09-12T02:29:02.625432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:03.926540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598422+0000","last_change":"2024-09-12T02:29:01.596866+0000","last_active":"2024-09-12T02:29:01.598422+0000","last_peered":"2024-09-12T02:29:01.598422+0000","last_clean":"2024-09-12T02:29:01.598422+0000","last_became_active":"2024-09-12T02:29:01.596619+0000","last_became_peered":"2024-09-12T02:29:01.596619+0000","last_unstale":"2024-09-12T02:29:01.598422+0000","last_undegraded":"2024-09-12T02:29:01.598422+0000","last_fullsized":"2024-09-12T02:29:01.598422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:57.183138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620599+0000","last_change":"2024-09-12T02:29:02.617228+0000","last_active":"2024-09-12T02:29:02.620599+0000","last_peered":"2024-09-12T02:29:02.620599+0000","last_clean":"2024-09-12T02:29:02.620599+0000","last_became_active":"2024-09-12T02:29:02.616632+0000","last_became_peered":"2024-09-12T02:29:02.616632+0000","last_unstale":"2024-09-12T02:29:02.620599+0000","last_undegraded":"2024-09-12T02:29:02.620599+0000","last_fullsized":"2024-09-12T02:29:02.620599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.597901+0000","last_change":"2024-09-12T02:29:01.592790+0000","last_active":"2024-09-12T02:29:01.597901+0000","last_peered":"2024-09-12T02:29:01.597901+0000","last_clean":"2024-09-12T02:29:01.597901+0000","last_became_active":"2024-09-12T02:29:01.592540+0000","last_became_peered":"2024-09-12T02:29:01.592540+0000","last_unstale":"2024-09-12T02:29:01.597901+0000","last_undegraded":"2024-09-12T02:29:01.597901+0000","last_fullsized":"2024-09-12T02:29:01.597901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.981441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615049+0000","last_change":"2024-09-12T02:29:02.612926+0000","last_active":"2024-09-12T02:29:02.615049+0000","last_peered":"2024-09-12T02:29:02.615049+0000","last_clean":"2024-09-12T02:29:02.615049+0000","last_became_active":"2024-09-12T02:29:02.612684+0000","last_became_peered":"2024-09-12T02:29:02.612684+0000","last_unstale":"2024-09-12T02:29:02.615049+0000","last_undegraded":"2024-09-12T02:29:02.615049+0000","last_fullsized":"2024-09-12T02:29:02.615049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625767+0000","last_change":"2024-09-12T02:29:01.599459+0000","last_active":"2024-09-12T02:29:02.625767+0000","last_peered":"2024-09-12T02:29:02.625767+0000","last_clean":"2024-09-12T02:29:02.625767+0000","last_became_active":"2024-09-12T02:29:01.599152+0000","last_became_peered":"2024-09-12T02:29:01.599152+0000","last_unstale":"2024-09-12T02:29:02.625767+0000","last_undegraded":"2024-09-12T02:29:02.625767+0000","last_fullsized":"2024-09-12T02:29:02.625767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.621065+0000","last_change":"2024-09-12T02:29:02.614585+0000","last_active":"2024-09-12T02:29:02.621065+0000","last_peered":"2024-09-12T02:29:02.621065+0000","last_clean":"2024-09-12T02:29:02.621065+0000","last_became_active":"2024-09-12T02:29:02.614301+0000","last_became_peered":"2024-09-12T02:29:02.614301+0000","last_unstale":"2024-09-12T02:29:02.621065+0000","last_undegraded":"2024-09-12T02:29:02.621065+0000","last_fullsized":"2024-09-12T02:29:02.621065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625841+0000","last_change":"2024-09-12T02:29:01.593974+0000","last_active":"2024-09-12T02:29:02.625841+0000","last_peered":"2024-09-12T02:29:02.625841+0000","last_clean":"2024-09-12T02:29:02.625841+0000","last_became_active":"2024-09-12T02:29:01.593658+0000","last_became_peered":"2024-09-12T02:29:01.593658+0000","last_unstale":"2024-09-12T02:29:02.625841+0000","last_undegraded":"2024-09-12T02:29:02.625841+0000","last_fullsized":"2024-09-12T02:29:02.625841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:23.538881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.609403+0000","last_change":"2024-09-12T02:29:02.602008+0000","last_active":"2024-09-12T02:29:02.609403+0000","last_peered":"2024-09-12T02:29:02.609403+0000","last_clean":"2024-09-12T02:29:02.609403+0000","last_became_active":"2024-09-12T02:29:02.601671+0000","last_became_peered":"2024-09-12T02:29:02.601671+0000","last_unstale":"2024-09-12T02:29:02.609403+0000","last_undegraded":"2024-09-12T02:29:02.609403+0000","last_fullsized":"2024-09-12T02:29:02.609403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:57.529582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.601079+0000","last_change":"2024-09-12T02:29:01.599132+0000","last_active":"2024-09-12T02:29:01.601079+0000","last_peered":"2024-09-12T02:29:01.601079+0000","last_clean":"2024-09-12T02:29:01.601079+0000","last_became_active":"2024-09-12T02:29:01.598859+0000","last_became_peered":"2024-09-12T02:29:01.598859+0000","last_unstale":"2024-09-12T02:29:01.601079+0000","last_undegraded":"2024-09-12T02:29:01.601079+0000","last_fullsized":"2024-09-12T02:29:01.601079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:00.893583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616148+0000","last_change":"2024-09-12T02:29:02.612688+0000","last_active":"2024-09-12T02:29:02.616148+0000","last_peered":"2024-09-12T02:29:02.616148+0000","last_clean":"2024-09-12T02:29:02.616148+0000","last_became_active":"2024-09-12T02:29:02.612433+0000","last_became_peered":"2024-09-12T02:29:02.612433+0000","last_unstale":"2024-09-12T02:29:02.616148+0000","last_undegraded":"2024-09-12T02:29:02.616148+0000","last_fullsized":"2024-09-12T02:29:02.616148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596822+0000","last_change":"2024-09-12T02:29:01.591494+0000","last_active":"2024-09-12T02:29:02.596822+0000","last_peered":"2024-09-12T02:29:02.596822+0000","last_clean":"2024-09-12T02:29:02.596822+0000","last_became_active":"2024-09-12T02:29:01.591190+0000","last_became_peered":"2024-09-12T02:29:01.591190+0000","last_unstale":"2024-09-12T02:29:02.596822+0000","last_undegraded":"2024-09-12T02:29:02.596822+0000","last_fullsized":"2024-09-12T02:29:02.596822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.939513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622766+0000","last_change":"2024-09-12T02:29:02.619913+0000","last_active":"2024-09-12T02:29:02.622766+0000","last_peered":"2024-09-12T02:29:02.622766+0000","last_clean":"2024-09-12T02:29:02.622766+0000","last_became_active":"2024-09-12T02:29:02.619304+0000","last_became_peered":"2024-09-12T02:29:02.619304+0000","last_unstale":"2024-09-12T02:29:02.622766+0000","last_undegraded":"2024-09-12T02:29:02.622766+0000","last_fullsized":"2024-09-12T02:29:02.622766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.348921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.604457+0000","last_change":"2024-09-12T02:29:01.602933+0000","last_active":"2024-09-12T02:29:01.604457+0000","last_peered":"2024-09-12T02:29:01.604457+0000","last_clean":"2024-09-12T02:29:01.604457+0000","last_became_active":"2024-09-12T02:29:01.602627+0000","last_became_peered":"2024-09-12T02:29:01.602627+0000","last_unstale":"2024-09-12T02:29:01.604457+0000","last_undegraded":"2024-09-12T02:29:01.604457+0000","last_fullsized":"2024-09-12T02:29:01.604457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:20.448084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.594568+0000","last_change":"2024-09-12T02:29:01.594568+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.594568+0000","last_undegraded":"2024-09-12T02:29:01.594568+0000","last_fullsized":"2024-09-12T02:29:01.594568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601453+0000","last_change":"2024-09-12T02:29:01.599918+0000","last_active":"2024-09-12T02:29:02.601453+0000","last_peered":"2024-09-12T02:29:02.601453+0000","last_clean":"2024-09-12T02:29:02.601453+0000","last_became_active":"2024-09-12T02:29:01.599628+0000","last_became_peered":"2024-09-12T02:29:01.599628+0000","last_unstale":"2024-09-12T02:29:02.601453+0000","last_undegraded":"2024-09-12T02:29:02.601453+0000","last_fullsized":"2024-09-12T02:29:02.601453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.590800+0000","last_change":"2024-09-12T02:29:01.590800+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.590800+0000","last_undegraded":"2024-09-12T02:29:01.590800+0000","last_fullsized":"2024-09-12T02:29:01.590800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.626194+0000","last_change":"2024-09-12T02:29:01.605522+0000","last_active":"2024-09-12T02:29:02.626194+0000","last_peered":"2024-09-12T02:29:02.626194+0000","last_clean":"2024-09-12T02:29:02.626194+0000","last_became_active":"2024-09-12T02:29:01.605265+0000","last_became_peered":"2024-09-12T02:29:01.605265+0000","last_unstale":"2024-09-12T02:29:02.626194+0000","last_undegraded":"2024-09-12T02:29:02.626194+0000","last_fullsized":"2024-09-12T02:29:02.626194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.872408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622682+0000","last_change":"2024-09-12T02:29:02.618134+0000","last_active":"2024-09-12T02:29:02.622682+0000","last_peered":"2024-09-12T02:29:02.622682+0000","last_clean":"2024-09-12T02:29:02.622682+0000","last_became_active":"2024-09-12T02:29:02.617667+0000","last_became_peered":"2024-09-12T02:29:02.617667+0000","last_unstale":"2024-09-12T02:29:02.622682+0000","last_undegraded":"2024-09-12T02:29:02.622682+0000","last_fullsized":"2024-09-12T02:29:02.622682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598457+0000","last_change":"2024-09-12T02:29:01.595079+0000","last_active":"2024-09-12T02:29:01.598457+0000","last_peered":"2024-09-12T02:29:01.598457+0000","last_clean":"2024-09-12T02:29:01.598457+0000","last_became_active":"2024-09-12T02:29:01.594811+0000","last_became_peered":"2024-09-12T02:29:01.594811+0000","last_unstale":"2024-09-12T02:29:01.598457+0000","last_undegraded":"2024-09-12T02:29:01.598457+0000","last_fullsized":"2024-09-12T02:29:01.598457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:35.663288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.616231+0000","last_change":"2024-09-12T02:29:02.613674+0000","last_active":"2024-09-12T02:29:02.616231+0000","last_peered":"2024-09-12T02:29:02.616231+0000","last_clean":"2024-09-12T02:29:02.616231+0000","last_became_active":"2024-09-12T02:29:02.613418+0000","last_became_peered":"2024-09-12T02:29:02.613418+0000","last_unstale":"2024-09-12T02:29:02.616231+0000","last_undegraded":"2024-09-12T02:29:02.616231+0000","last_fullsized":"2024-09-12T02:29:02.616231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625565+0000","last_change":"2024-09-12T02:29:01.593677+0000","last_active":"2024-09-12T02:29:02.625565+0000","last_peered":"2024-09-12T02:29:02.625565+0000","last_clean":"2024-09-12T02:29:02.625565+0000","last_became_active":"2024-09-12T02:29:01.593403+0000","last_became_peered":"2024-09-12T02:29:01.593403+0000","last_unstale":"2024-09-12T02:29:02.625565+0000","last_undegraded":"2024-09-12T02:29:02.625565+0000","last_fullsized":"2024-09-12T02:29:02.625565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.592274+0000","last_change":"2024-09-12T02:29:01.592274+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.592274+0000","last_undegraded":"2024-09-12T02:29:01.592274+0000","last_fullsized":"2024-09-12T02:29:01.592274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603704+0000","last_change":"2024-09-12T02:29:01.600635+0000","last_active":"2024-09-12T02:29:02.603704+0000","last_peered":"2024-09-12T02:29:02.603704+0000","last_clean":"2024-09-12T02:29:02.603704+0000","last_became_active":"2024-09-12T02:29:01.600147+0000","last_became_peered":"2024-09-12T02:29:01.600147+0000","last_unstale":"2024-09-12T02:29:02.603704+0000","last_undegraded":"2024-09-12T02:29:02.603704+0000","last_fullsized":"2024-09-12T02:29:02.603704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614900+0000","last_change":"2024-09-12T02:29:02.610088+0000","last_active":"2024-09-12T02:29:02.614900+0000","last_peered":"2024-09-12T02:29:02.614900+0000","last_clean":"2024-09-12T02:29:02.614900+0000","last_became_active":"2024-09-12T02:29:02.609800+0000","last_became_peered":"2024-09-12T02:29:02.609800+0000","last_unstale":"2024-09-12T02:29:02.614900+0000","last_undegraded":"2024-09-12T02:29:02.614900+0000","last_fullsized":"2024-09-12T02:29:02.614900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599261+0000","last_change":"2024-09-12T02:29:01.597990+0000","last_active":"2024-09-12T02:29:01.599261+0000","last_peered":"2024-09-12T02:29:01.599261+0000","last_clean":"2024-09-12T02:29:01.599261+0000","last_became_active":"2024-09-12T02:29:01.597733+0000","last_became_peered":"2024-09-12T02:29:01.597733+0000","last_unstale":"2024-09-12T02:29:01.599261+0000","last_undegraded":"2024-09-12T02:29:01.599261+0000","last_fullsized":"2024-09-12T02:29:01.599261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:46.537630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612439+0000","last_change":"2024-09-12T02:29:02.605133+0000","last_active":"2024-09-12T02:29:02.612439+0000","last_peered":"2024-09-12T02:29:02.612439+0000","last_clean":"2024-09-12T02:29:02.612439+0000","last_became_active":"2024-09-12T02:29:02.604822+0000","last_became_peered":"2024-09-12T02:29:02.604822+0000","last_unstale":"2024-09-12T02:29:02.612439+0000","last_undegraded":"2024-09-12T02:29:02.612439+0000","last_fullsized":"2024-09-12T02:29:02.612439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.598320+0000","last_change":"2024-09-12T02:29:01.594764+0000","last_active":"2024-09-12T02:29:01.598320+0000","last_peered":"2024-09-12T02:29:01.598320+0000","last_clean":"2024-09-12T02:29:01.598320+0000","last_became_active":"2024-09-12T02:29:01.594268+0000","last_became_peered":"2024-09-12T02:29:01.594268+0000","last_unstale":"2024-09-12T02:29:01.598320+0000","last_undegraded":"2024-09-12T02:29:01.598320+0000","last_fullsized":"2024-09-12T02:29:01.598320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:35.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617256+0000","last_change":"2024-09-12T02:29:02.611999+0000","last_active":"2024-09-12T02:29:02.617256+0000","last_peered":"2024-09-12T02:29:02.617256+0000","last_clean":"2024-09-12T02:29:02.617256+0000","last_became_active":"2024-09-12T02:29:02.611694+0000","last_became_peered":"2024-09-12T02:29:02.611694+0000","last_unstale":"2024-09-12T02:29:02.617256+0000","last_undegraded":"2024-09-12T02:29:02.617256+0000","last_fullsized":"2024-09-12T02:29:02.617256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:22.866047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625554+0000","last_change":"2024-09-12T02:29:01.602071+0000","last_active":"2024-09-12T02:29:02.625554+0000","last_peered":"2024-09-12T02:29:02.625554+0000","last_clean":"2024-09-12T02:29:02.625554+0000","last_became_active":"2024-09-12T02:29:01.601793+0000","last_became_peered":"2024-09-12T02:29:01.601793+0000","last_unstale":"2024-09-12T02:29:02.625554+0000","last_undegraded":"2024-09-12T02:29:02.625554+0000","last_fullsized":"2024-09-12T02:29:02.625554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.622619+0000","last_change":"2024-09-12T02:29:02.616753+0000","last_active":"2024-09-12T02:29:02.622619+0000","last_peered":"2024-09-12T02:29:02.622619+0000","last_clean":"2024-09-12T02:29:02.622619+0000","last_became_active":"2024-09-12T02:29:02.616476+0000","last_became_peered":"2024-09-12T02:29:02.616476+0000","last_unstale":"2024-09-12T02:29:02.622619+0000","last_undegraded":"2024-09-12T02:29:02.622619+0000","last_fullsized":"2024-09-12T02:29:02.622619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625356+0000","last_change":"2024-09-12T02:29:01.600094+0000","last_active":"2024-09-12T02:29:02.625356+0000","last_peered":"2024-09-12T02:29:02.625356+0000","last_clean":"2024-09-12T02:29:02.625356+0000","last_became_active":"2024-09-12T02:29:01.599825+0000","last_became_peered":"2024-09-12T02:29:01.599825+0000","last_unstale":"2024-09-12T02:29:02.625356+0000","last_undegraded":"2024-09-12T02:29:02.625356+0000","last_fullsized":"2024-09-12T02:29:02.625356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.620396+0000","last_change":"2024-09-12T02:29:02.616662+0000","last_active":"2024-09-12T02:29:02.620396+0000","last_peered":"2024-09-12T02:29:02.620396+0000","last_clean":"2024-09-12T02:29:02.620396+0000","last_became_active":"2024-09-12T02:29:02.616348+0000","last_became_peered":"2024-09-12T02:29:02.616348+0000","last_unstale":"2024-09-12T02:29:02.620396+0000","last_undegraded":"2024-09-12T02:29:02.620396+0000","last_fullsized":"2024-09-12T02:29:02.620396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625350+0000","last_change":"2024-09-12T02:29:01.601320+0000","last_active":"2024-09-12T02:29:02.625350+0000","last_peered":"2024-09-12T02:29:02.625350+0000","last_clean":"2024-09-12T02:29:02.625350+0000","last_became_active":"2024-09-12T02:29:01.601010+0000","last_became_peered":"2024-09-12T02:29:01.601010+0000","last_unstale":"2024-09-12T02:29:02.625350+0000","last_undegraded":"2024-09-12T02:29:02.625350+0000","last_fullsized":"2024-09-12T02:29:02.625350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:18.815610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586743+0000","last_change":"2024-09-12T02:29:01.586743+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586743+0000","last_undegraded":"2024-09-12T02:29:01.586743+0000","last_fullsized":"2024-09-12T02:29:01.586743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.599422+0000","last_change":"2024-09-12T02:29:01.599517+0000","last_active":"2024-09-12T02:29:02.599422+0000","last_peered":"2024-09-12T02:29:02.599422+0000","last_clean":"2024-09-12T02:29:02.599422+0000","last_became_active":"2024-09-12T02:29:01.599119+0000","last_became_peered":"2024-09-12T02:29:01.599119+0000","last_unstale":"2024-09-12T02:29:02.599422+0000","last_undegraded":"2024-09-12T02:29:02.599422+0000","last_fullsized":"2024-09-12T02:29:02.599422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:50.828257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586572+0000","last_change":"2024-09-12T02:29:01.586572+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586572+0000","last_undegraded":"2024-09-12T02:29:01.586572+0000","last_fullsized":"2024-09-12T02:29:01.586572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625037+0000","last_change":"2024-09-12T02:29:01.602422+0000","last_active":"2024-09-12T02:29:02.625037+0000","last_peered":"2024-09-12T02:29:02.625037+0000","last_clean":"2024-09-12T02:29:02.625037+0000","last_became_active":"2024-09-12T02:29:01.602077+0000","last_became_peered":"2024-09-12T02:29:01.602077+0000","last_unstale":"2024-09-12T02:29:02.625037+0000","last_undegraded":"2024-09-12T02:29:02.625037+0000","last_fullsized":"2024-09-12T02:29:02.625037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586513+0000","last_change":"2024-09-12T02:29:01.586513+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586513+0000","last_undegraded":"2024-09-12T02:29:01.586513+0000","last_fullsized":"2024-09-12T02:29:01.586513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597708+0000","last_change":"2024-09-12T02:29:01.597327+0000","last_active":"2024-09-12T02:29:02.597708+0000","last_peered":"2024-09-12T02:29:02.597708+0000","last_clean":"2024-09-12T02:29:02.597708+0000","last_became_active":"2024-09-12T02:29:01.596766+0000","last_became_peered":"2024-09-12T02:29:01.596766+0000","last_unstale":"2024-09-12T02:29:02.597708+0000","last_undegraded":"2024-09-12T02:29:02.597708+0000","last_fullsized":"2024-09-12T02:29:02.597708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587988+0000","last_change":"2024-09-12T02:29:01.587988+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587988+0000","last_undegraded":"2024-09-12T02:29:01.587988+0000","last_fullsized":"2024-09-12T02:29:01.587988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597669+0000","last_change":"2024-09-12T02:29:01.594610+0000","last_active":"2024-09-12T02:29:02.597669+0000","last_peered":"2024-09-12T02:29:02.597669+0000","last_clean":"2024-09-12T02:29:02.597669+0000","last_became_active":"2024-09-12T02:29:01.594373+0000","last_became_peered":"2024-09-12T02:29:01.594373+0000","last_unstale":"2024-09-12T02:29:02.597669+0000","last_undegraded":"2024-09-12T02:29:02.597669+0000","last_fullsized":"2024-09-12T02:29:02.597669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:09.467337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615086+0000","last_change":"2024-09-12T02:29:02.613333+0000","last_active":"2024-09-12T02:29:02.615086+0000","last_peered":"2024-09-12T02:29:02.615086+0000","last_clean":"2024-09-12T02:29:02.615086+0000","last_became_active":"2024-09-12T02:29:02.613020+0000","last_became_peered":"2024-09-12T02:29:02.613020+0000","last_unstale":"2024-09-12T02:29:02.615086+0000","last_undegraded":"2024-09-12T02:29:02.615086+0000","last_fullsized":"2024-09-12T02:29:02.615086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.606014+0000","last_change":"2024-09-12T02:29:01.600161+0000","last_active":"2024-09-12T02:29:02.606014+0000","last_peered":"2024-09-12T02:29:02.606014+0000","last_clean":"2024-09-12T02:29:02.606014+0000","last_became_active":"2024-09-12T02:29:01.599858+0000","last_became_peered":"2024-09-12T02:29:01.599858+0000","last_unstale":"2024-09-12T02:29:02.606014+0000","last_undegraded":"2024-09-12T02:29:02.606014+0000","last_fullsized":"2024-09-12T02:29:02.606014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:59.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.586026+0000","last_change":"2024-09-12T02:29:01.586026+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.586026+0000","last_undegraded":"2024-09-12T02:29:01.586026+0000","last_fullsized":"2024-09-12T02:29:01.586026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625648+0000","last_change":"2024-09-12T02:29:01.604076+0000","last_active":"2024-09-12T02:29:02.625648+0000","last_peered":"2024-09-12T02:29:02.625648+0000","last_clean":"2024-09-12T02:29:02.625648+0000","last_became_active":"2024-09-12T02:29:01.603786+0000","last_became_peered":"2024-09-12T02:29:01.603786+0000","last_unstale":"2024-09-12T02:29:02.625648+0000","last_undegraded":"2024-09-12T02:29:02.625648+0000","last_fullsized":"2024-09-12T02:29:02.625648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:02.920830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614961+0000","last_change":"2024-09-12T02:29:02.611837+0000","last_active":"2024-09-12T02:29:02.614961+0000","last_peered":"2024-09-12T02:29:02.614961+0000","last_clean":"2024-09-12T02:29:02.614961+0000","last_became_active":"2024-09-12T02:29:02.611576+0000","last_became_peered":"2024-09-12T02:29:02.611576+0000","last_unstale":"2024-09-12T02:29:02.614961+0000","last_undegraded":"2024-09-12T02:29:02.614961+0000","last_fullsized":"2024-09-12T02:29:02.614961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601352+0000","last_change":"2024-09-12T02:29:01.596912+0000","last_active":"2024-09-12T02:29:02.601352+0000","last_peered":"2024-09-12T02:29:02.601352+0000","last_clean":"2024-09-12T02:29:02.601352+0000","last_became_active":"2024-09-12T02:29:01.596630+0000","last_became_peered":"2024-09-12T02:29:01.596630+0000","last_unstale":"2024-09-12T02:29:02.601352+0000","last_undegraded":"2024-09-12T02:29:02.601352+0000","last_fullsized":"2024-09-12T02:29:02.601352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.615648+0000","last_change":"2024-09-12T02:29:02.612642+0000","last_active":"2024-09-12T02:29:02.615648+0000","last_peered":"2024-09-12T02:29:02.615648+0000","last_clean":"2024-09-12T02:29:02.615648+0000","last_became_active":"2024-09-12T02:29:02.611562+0000","last_became_peered":"2024-09-12T02:29:02.611562+0000","last_unstale":"2024-09-12T02:29:02.615648+0000","last_undegraded":"2024-09-12T02:29:02.615648+0000","last_fullsized":"2024-09-12T02:29:02.615648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603588+0000","last_change":"2024-09-12T02:29:01.598396+0000","last_active":"2024-09-12T02:29:02.603588+0000","last_peered":"2024-09-12T02:29:02.603588+0000","last_clean":"2024-09-12T02:29:02.603588+0000","last_became_active":"2024-09-12T02:29:01.598101+0000","last_became_peered":"2024-09-12T02:29:01.598101+0000","last_unstale":"2024-09-12T02:29:02.603588+0000","last_undegraded":"2024-09-12T02:29:02.603588+0000","last_fullsized":"2024-09-12T02:29:02.603588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.614058+0000","last_change":"2024-09-12T02:29:02.611150+0000","last_active":"2024-09-12T02:29:02.614058+0000","last_peered":"2024-09-12T02:29:02.614058+0000","last_clean":"2024-09-12T02:29:02.614058+0000","last_became_active":"2024-09-12T02:29:02.610804+0000","last_became_peered":"2024-09-12T02:29:02.610804+0000","last_unstale":"2024-09-12T02:29:02.614058+0000","last_undegraded":"2024-09-12T02:29:02.614058+0000","last_fullsized":"2024-09-12T02:29:02.614058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.601328+0000","last_change":"2024-09-12T02:29:01.603466+0000","last_active":"2024-09-12T02:29:02.601328+0000","last_peered":"2024-09-12T02:29:02.601328+0000","last_clean":"2024-09-12T02:29:02.601328+0000","last_became_active":"2024-09-12T02:29:01.603162+0000","last_became_peered":"2024-09-12T02:29:01.603162+0000","last_unstale":"2024-09-12T02:29:02.601328+0000","last_undegraded":"2024-09-12T02:29:02.601328+0000","last_fullsized":"2024-09-12T02:29:02.601328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.617426+0000","last_change":"2024-09-12T02:29:02.615106+0000","last_active":"2024-09-12T02:29:02.617426+0000","last_peered":"2024-09-12T02:29:02.617426+0000","last_clean":"2024-09-12T02:29:02.617426+0000","last_became_active":"2024-09-12T02:29:02.614701+0000","last_became_peered":"2024-09-12T02:29:02.614701+0000","last_unstale":"2024-09-12T02:29:02.617426+0000","last_undegraded":"2024-09-12T02:29:02.617426+0000","last_fullsized":"2024-09-12T02:29:02.617426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.603855+0000","last_change":"2024-09-12T02:29:01.602856+0000","last_active":"2024-09-12T02:29:02.603855+0000","last_peered":"2024-09-12T02:29:02.603855+0000","last_clean":"2024-09-12T02:29:02.603855+0000","last_became_active":"2024-09-12T02:29:01.602602+0000","last_became_peered":"2024-09-12T02:29:01.602602+0000","last_unstale":"2024-09-12T02:29:02.603855+0000","last_undegraded":"2024-09-12T02:29:02.603855+0000","last_fullsized":"2024-09-12T02:29:02.603855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-12T02:29:01.587573+0000","last_change":"2024-09-12T02:29:01.587573+0000","last_active":"2024-09-12T02:29:01.578884+0000","last_peered":"2024-09-12T02:29:01.578884+0000","last_clean":"2024-09-12T02:29:01.578884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:01.587573+0000","last_undegraded":"2024-09-12T02:29:01.587573+0000","last_fullsized":"2024-09-12T02:29:01.587573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.597837+0000","last_change":"2024-09-12T02:29:01.602771+0000","last_active":"2024-09-12T02:29:02.597837+0000","last_peered":"2024-09-12T02:29:02.597837+0000","last_clean":"2024-09-12T02:29:02.597837+0000","last_became_active":"2024-09-12T02:29:01.602503+0000","last_became_peered":"2024-09-12T02:29:01.602503+0000","last_unstale":"2024-09-12T02:29:02.597837+0000","last_undegraded":"2024-09-12T02:29:02.597837+0000","last_fullsized":"2024-09-12T02:29:02.597837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:25.395144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.625226+0000","last_change":"2024-09-12T02:29:02.618017+0000","last_active":"2024-09-12T02:29:02.625226+0000","last_peered":"2024-09-12T02:29:02.625226+0000","last_clean":"2024-09-12T02:29:02.625226+0000","last_became_active":"2024-09-12T02:29:02.617733+0000","last_became_peered":"2024-09-12T02:29:02.617733+0000","last_unstale":"2024-09-12T02:29:02.625226+0000","last_undegraded":"2024-09-12T02:29:02.625226+0000","last_fullsized":"2024-09-12T02:29:02.625226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.976411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.599135+0000","last_change":"2024-09-12T02:29:01.597751+0000","last_active":"2024-09-12T02:29:01.599135+0000","last_peered":"2024-09-12T02:29:01.599135+0000","last_clean":"2024-09-12T02:29:01.599135+0000","last_became_active":"2024-09-12T02:29:01.597513+0000","last_became_peered":"2024-09-12T02:29:01.597513+0000","last_unstale":"2024-09-12T02:29:01.599135+0000","last_undegraded":"2024-09-12T02:29:01.599135+0000","last_fullsized":"2024-09-12T02:29:01.599135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:21.741427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.612062+0000","last_change":"2024-09-12T02:29:02.608831+0000","last_active":"2024-09-12T02:29:02.612062+0000","last_peered":"2024-09-12T02:29:02.612062+0000","last_clean":"2024-09-12T02:29:02.612062+0000","last_became_active":"2024-09-12T02:29:02.608580+0000","last_became_peered":"2024-09-12T02:29:02.608580+0000","last_unstale":"2024-09-12T02:29:02.612062+0000","last_undegraded":"2024-09-12T02:29:02.612062+0000","last_fullsized":"2024-09-12T02:29:02.612062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.596538+0000","last_change":"2024-09-12T02:29:01.600549+0000","last_active":"2024-09-12T02:29:02.596538+0000","last_peered":"2024-09-12T02:29:02.596538+0000","last_clean":"2024-09-12T02:29:02.596538+0000","last_became_active":"2024-09-12T02:29:01.600196+0000","last_became_peered":"2024-09-12T02:29:01.600196+0000","last_unstale":"2024-09-12T02:29:02.596538+0000","last_undegraded":"2024-09-12T02:29:02.596538+0000","last_fullsized":"2024-09-12T02:29:02.596538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.600032+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:02.600032+0000","last_peered":"2024-09-12T02:29:02.600032+0000","last_clean":"2024-09-12T02:29:02.600032+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:02.600032+0000","last_undegraded":"2024-09-12T02:29:02.600032+0000","last_fullsized":"2024-09-12T02:29:02.600032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":128859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":712452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":115817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:07.568 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-09-12T02:29:07.567+0000 7f95cf4e1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:29:09.894 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:10.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.004+0000 7f1a0ef31640 1 Processor -- start 2024-09-12T02:29:10.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.005+0000 7f1a0ef31640 1 -- start start 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.005+0000 7f1a0ef31640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a0815c4a0 0x7f1a080cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.005+0000 7f1a0ef31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a080b47a0 0x7f1a0815c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.005+0000 7f1a0ef31640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a080d0a30 con 0x7f1a080d2da0 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.005+0000 7f1a0ef31640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1a080d0d30 con 0x7f1a0815c4a0 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.005+0000 7f1a0ef31640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1a080b76f0 con 0x7f1a080b47a0 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a07fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1a080d2da0 0x7f1a080b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35136/0 (socket says 172.21.15.181:35136) 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a07fff640 1 -- 172.21.15.181:0/1864299043 learned_addr learned my addr 172.21.15.181:0/1864299043 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a0cccd640 1 --2- 172.21.15.181:0/1864299043 >> v2:172.21.15.204:3300/0 conn(0x7f1a0815c4a0 0x7f1a080cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a0d4ce640 1 --2- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a080b47a0 0x7f1a0815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a077fe640 1 -- 172.21.15.181:0/1864299043 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465305845 0 0) 0x7f1a080d0a30 con 0x7f1a080d2da0 2024-09-12T02:29:10.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a077fe640 1 -- 172.21.15.181:0/1864299043 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19f4003520 con 0x7f1a080d2da0 2024-09-12T02:29:10.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a0cccd640 1 -- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a080b47a0 msgr2=0x7f1a0815c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:10.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a0cccd640 1 --2- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a080b47a0 0x7f1a0815c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a0cccd640 1 -- 172.21.15.181:0/1864299043 >> v1:172.21.15.181:6789/0 conn(0x7f1a080d2da0 legacy=0x7f1a080b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a0cccd640 1 -- 172.21.15.181:0/1864299043 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a08073710 con 0x7f1a0815c4a0 2024-09-12T02:29:10.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.006+0000 7f1a0d4ce640 1 --2- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a080b47a0 0x7f1a0815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.007+0000 7f1a0cccd640 1 --2- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a0815c4a0 0x7f1a080cff80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a000097a0 tx=0x7f1a0002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187229a4fc4fd36c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.007+0000 7f1a077fe640 1 -- 172.21.15.181:0/1864299043 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00037070 con 0x7f1a0815c4a0 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.007+0000 7f1a077fe640 1 -- 172.21.15.181:0/1864299043 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0002ae50 con 0x7f1a0815c4a0 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.007+0000 7f1a077fe640 1 -- 172.21.15.181:0/1864299043 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00032660 con 0x7f1a0815c4a0 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 -- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a0815c4a0 msgr2=0x7f1a080cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a0815c4a0 0x7f1a080cff80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a000097a0 tx=0x7f1a0002a100 comp rx=0 tx=0).stop 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 -- 172.21.15.181:0/1864299043 shutdown_connections 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a080b47a0 0x7f1a0815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/1864299043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a0815c4a0 0x7f1a080cff80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 -- 172.21.15.181:0/1864299043 >> 172.21.15.181:0/1864299043 conn(0x7f1a08067950 msgr2=0x7f1a08067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 -- 172.21.15.181:0/1864299043 shutdown_connections 2024-09-12T02:29:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.008+0000 7f1a0ef31640 1 -- 172.21.15.181:0/1864299043 wait complete. 2024-09-12T02:29:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.009+0000 7f1a0ef31640 1 Processor -- start 2024-09-12T02:29:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.009+0000 7f1a0ef31640 1 -- start start 2024-09-12T02:29:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0ef31640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a080b47a0 0x7f1a08151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0ef31640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a080d2da0 0x7f1a0815a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0ef31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a0815c4a0 0x7f1a080aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0ef31640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a08166030 con 0x7f1a080d2da0 2024-09-12T02:29:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0ef31640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080d28e0 con 0x7f1a080b47a0 2024-09-12T02:29:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0ef31640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1a081661b0 con 0x7f1a0815c4a0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a080d2da0 0x7f1a0815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a080d2da0 0x7f1a0815a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51336/0 (socket says 172.21.15.181:51336) 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 -- 172.21.15.181:0/3693300949 learned_addr learned my addr 172.21.15.181:0/3693300949 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0cccd640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a080b47a0 0x7f1a08151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a0d4ce640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a0815c4a0 0x7f1a080aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 -- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a0815c4a0 msgr2=0x7f1a080aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a0815c4a0 0x7f1a080aac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 -- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a080b47a0 msgr2=0x7f1a08151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a080b47a0 0x7f1a08151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 -- 172.21.15.181:0/3693300949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0814f320 con 0x7f1a080d2da0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.010+0000 7f1a07fff640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a080d2da0 0x7f1a0815a970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f19f800cbb0 tx=0x7f19f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.011+0000 7f1a057fa640 1 -- 172.21.15.181:0/3693300949 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8017070 con 0x7f1a080d2da0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.011+0000 7f1a057fa640 1 -- 172.21.15.181:0/3693300949 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f800ad60 con 0x7f1a080d2da0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.011+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a08152000 con 0x7f1a080d2da0 2024-09-12T02:29:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.011+0000 7f1a057fa640 1 -- 172.21.15.181:0/3693300949 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8012640 con 0x7f1a080d2da0 2024-09-12T02:29:10.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.011+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a081525c0 con 0x7f1a080d2da0 2024-09-12T02:29:10.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.012+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0815c880 con 0x7f1a080d2da0 2024-09-12T02:29:10.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.012+0000 7f1a057fa640 1 -- 172.21.15.181:0/3693300949 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19f801a070 con 0x7f1a080d2da0 2024-09-12T02:29:10.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.013+0000 7f1a057fa640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19e806be30 0x7f19e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.013+0000 7f1a057fa640 1 -- 172.21.15.181:0/3693300949 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f19f808ac20 con 0x7f1a080d2da0 2024-09-12T02:29:10.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.013+0000 7f1a0cccd640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19e806be30 0x7f19e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.013+0000 7f1a0cccd640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19e806be30 0x7f19e806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1a00034000 tx=0x7f1a0002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.017+0000 7f1a057fa640 1 -- 172.21.15.181:0/3693300949 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19f8059660 con 0x7f1a080d2da0 2024-09-12T02:29:10.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.178+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a080b68b0 con 0x7f19e806be30 2024-09-12T02:29:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.183+0000 7f1a057fa640 1 -- 172.21.15.181:0/3693300949 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251911 (secure 0 0 0) 0x7f1a0007f820 con 0x7f19e806be30 2024-09-12T02:29:10.187 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:10.188 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:10.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.186+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19e806be30 msgr2=0x7f19e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.186+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19e806be30 0x7f19e806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1a00034000 tx=0x7f1a0002e000 comp rx=0 tx=0).stop 2024-09-12T02:29:10.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.186+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a080d2da0 msgr2=0x7f1a0815a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.186+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a080d2da0 0x7f1a0815a970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f19f800cbb0 tx=0x7f19f800a430 comp rx=0 tx=0).stop 2024-09-12T02:29:10.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 shutdown_connections 2024-09-12T02:29:10.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f19e806be30 0x7f19e806e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a0815c4a0 0x7f1a080aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a080d2da0 0x7f1a0815a970 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 --2- 172.21.15.181:0/3693300949 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a080b47a0 0x7f1a08151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 >> 172.21.15.181:0/3693300949 conn(0x7f1a08067950 msgr2=0x7f1a080b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 shutdown_connections 2024-09-12T02:29:10.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.187+0000 7f1a0ef31640 1 -- 172.21.15.181:0/3693300949 wait complete. 2024-09-12T02:29:10.198 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-12T02:29:09.621057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220224,"kb_used_data":3976,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754496,"statfs":{"total":773094113280,"available":772868603904,"internally_reserved":0,"allocated":4071424,"data_stored":2266828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001214"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614622+0000","last_change":"2024-09-12T02:29:02.616935+0000","last_active":"2024-09-12T02:29:03.614622+0000","last_peered":"2024-09-12T02:29:03.614622+0000","last_clean":"2024-09-12T02:29:03.614622+0000","last_became_active":"2024-09-12T02:29:02.616651+0000","last_became_peered":"2024-09-12T02:29:02.616651+0000","last_unstale":"2024-09-12T02:29:03.614622+0000","last_undegraded":"2024-09-12T02:29:03.614622+0000","last_fullsized":"2024-09-12T02:29:03.614622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923053+0000","last_change":"2024-09-12T02:29:02.614182+0000","last_active":"2024-09-12T02:29:03.923053+0000","last_peered":"2024-09-12T02:29:03.923053+0000","last_clean":"2024-09-12T02:29:03.923053+0000","last_became_active":"2024-09-12T02:29:02.613870+0000","last_became_peered":"2024-09-12T02:29:02.613870+0000","last_unstale":"2024-09-12T02:29:03.923053+0000","last_undegraded":"2024-09-12T02:29:03.923053+0000","last_fullsized":"2024-09-12T02:29:03.923053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:41.988029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613451+0000","last_change":"2024-09-12T02:29:02.617918+0000","last_active":"2024-09-12T02:29:03.613451+0000","last_peered":"2024-09-12T02:29:03.613451+0000","last_clean":"2024-09-12T02:29:03.613451+0000","last_became_active":"2024-09-12T02:29:02.617296+0000","last_became_peered":"2024-09-12T02:29:02.617296+0000","last_unstale":"2024-09-12T02:29:03.613451+0000","last_undegraded":"2024-09-12T02:29:03.613451+0000","last_fullsized":"2024-09-12T02:29:03.613451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:37.652254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614125+0000","last_change":"2024-09-12T02:29:02.617491+0000","last_active":"2024-09-12T02:29:03.614125+0000","last_peered":"2024-09-12T02:29:03.614125+0000","last_clean":"2024-09-12T02:29:03.614125+0000","last_became_active":"2024-09-12T02:29:02.617229+0000","last_became_peered":"2024-09-12T02:29:02.617229+0000","last_unstale":"2024-09-12T02:29:03.614125+0000","last_undegraded":"2024-09-12T02:29:03.614125+0000","last_fullsized":"2024-09-12T02:29:03.614125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922467+0000","last_change":"2024-09-12T02:29:02.615185+0000","last_active":"2024-09-12T02:29:03.922467+0000","last_peered":"2024-09-12T02:29:03.922467+0000","last_clean":"2024-09-12T02:29:03.922467+0000","last_became_active":"2024-09-12T02:29:02.614876+0000","last_became_peered":"2024-09-12T02:29:02.614876+0000","last_unstale":"2024-09-12T02:29:03.922467+0000","last_undegraded":"2024-09-12T02:29:03.922467+0000","last_fullsized":"2024-09-12T02:29:03.922467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:14.668261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922928+0000","last_change":"2024-09-12T02:29:02.619069+0000","last_active":"2024-09-12T02:29:03.922928+0000","last_peered":"2024-09-12T02:29:03.922928+0000","last_clean":"2024-09-12T02:29:03.922928+0000","last_became_active":"2024-09-12T02:29:02.617890+0000","last_became_peered":"2024-09-12T02:29:02.617890+0000","last_unstale":"2024-09-12T02:29:03.922928+0000","last_undegraded":"2024-09-12T02:29:03.922928+0000","last_fullsized":"2024-09-12T02:29:03.922928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:54.916224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910581+0000","last_change":"2024-09-12T02:29:02.613356+0000","last_active":"2024-09-12T02:29:03.910581+0000","last_peered":"2024-09-12T02:29:03.910581+0000","last_clean":"2024-09-12T02:29:03.910581+0000","last_became_active":"2024-09-12T02:29:02.613093+0000","last_became_peered":"2024-09-12T02:29:02.613093+0000","last_unstale":"2024-09-12T02:29:03.910581+0000","last_undegraded":"2024-09-12T02:29:03.910581+0000","last_fullsized":"2024-09-12T02:29:03.910581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:45.885218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910373+0000","last_change":"2024-09-12T02:29:02.608265+0000","last_active":"2024-09-12T02:29:03.910373+0000","last_peered":"2024-09-12T02:29:03.910373+0000","last_clean":"2024-09-12T02:29:03.910373+0000","last_became_active":"2024-09-12T02:29:02.607991+0000","last_became_peered":"2024-09-12T02:29:02.607991+0000","last_unstale":"2024-09-12T02:29:03.910373+0000","last_undegraded":"2024-09-12T02:29:03.910373+0000","last_fullsized":"2024-09-12T02:29:03.910373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.348921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614969+0000","last_change":"2024-09-12T02:29:02.608629+0000","last_active":"2024-09-12T02:29:03.614969+0000","last_peered":"2024-09-12T02:29:03.614969+0000","last_clean":"2024-09-12T02:29:03.614969+0000","last_became_active":"2024-09-12T02:29:02.608224+0000","last_became_peered":"2024-09-12T02:29:02.608224+0000","last_unstale":"2024-09-12T02:29:03.614969+0000","last_undegraded":"2024-09-12T02:29:03.614969+0000","last_fullsized":"2024-09-12T02:29:03.614969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614288+0000","last_change":"2024-09-12T02:29:02.618718+0000","last_active":"2024-09-12T02:29:03.614288+0000","last_peered":"2024-09-12T02:29:03.614288+0000","last_clean":"2024-09-12T02:29:03.614288+0000","last_became_active":"2024-09-12T02:29:02.618431+0000","last_became_peered":"2024-09-12T02:29:02.618431+0000","last_unstale":"2024-09-12T02:29:03.614288+0000","last_undegraded":"2024-09-12T02:29:03.614288+0000","last_fullsized":"2024-09-12T02:29:03.614288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:56.348921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.911063+0000","last_change":"2024-09-12T02:29:02.612372+0000","last_active":"2024-09-12T02:29:03.911063+0000","last_peered":"2024-09-12T02:29:03.911063+0000","last_clean":"2024-09-12T02:29:03.911063+0000","last_became_active":"2024-09-12T02:29:02.612114+0000","last_became_peered":"2024-09-12T02:29:02.612114+0000","last_unstale":"2024-09-12T02:29:03.911063+0000","last_undegraded":"2024-09-12T02:29:03.911063+0000","last_fullsized":"2024-09-12T02:29:03.911063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:00.462540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613515+0000","last_change":"2024-09-12T02:29:02.613466+0000","last_active":"2024-09-12T02:29:03.613515+0000","last_peered":"2024-09-12T02:29:03.613515+0000","last_clean":"2024-09-12T02:29:03.613515+0000","last_became_active":"2024-09-12T02:29:02.613203+0000","last_became_peered":"2024-09-12T02:29:02.613203+0000","last_unstale":"2024-09-12T02:29:03.613515+0000","last_undegraded":"2024-09-12T02:29:03.613515+0000","last_fullsized":"2024-09-12T02:29:03.613515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:35.640589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922615+0000","last_change":"2024-09-12T02:29:02.610856+0000","last_active":"2024-09-12T02:29:03.922615+0000","last_peered":"2024-09-12T02:29:03.922615+0000","last_clean":"2024-09-12T02:29:03.922615+0000","last_became_active":"2024-09-12T02:29:02.610534+0000","last_became_peered":"2024-09-12T02:29:02.610534+0000","last_unstale":"2024-09-12T02:29:03.922615+0000","last_undegraded":"2024-09-12T02:29:03.922615+0000","last_fullsized":"2024-09-12T02:29:03.922615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:58.188848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923111+0000","last_change":"2024-09-12T02:29:02.615830+0000","last_active":"2024-09-12T02:29:03.923111+0000","last_peered":"2024-09-12T02:29:03.923111+0000","last_clean":"2024-09-12T02:29:03.923111+0000","last_became_active":"2024-09-12T02:29:02.615291+0000","last_became_peered":"2024-09-12T02:29:02.615291+0000","last_unstale":"2024-09-12T02:29:03.923111+0000","last_undegraded":"2024-09-12T02:29:03.923111+0000","last_fullsized":"2024-09-12T02:29:03.923111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:15.717530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612827+0000","last_change":"2024-09-12T02:29:02.620045+0000","last_active":"2024-09-12T02:29:03.612827+0000","last_peered":"2024-09-12T02:29:03.612827+0000","last_clean":"2024-09-12T02:29:03.612827+0000","last_became_active":"2024-09-12T02:29:02.619376+0000","last_became_peered":"2024-09-12T02:29:02.619376+0000","last_unstale":"2024-09-12T02:29:03.612827+0000","last_undegraded":"2024-09-12T02:29:03.612827+0000","last_fullsized":"2024-09-12T02:29:03.612827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:03.190386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910724+0000","last_change":"2024-09-12T02:29:02.618015+0000","last_active":"2024-09-12T02:29:03.910724+0000","last_peered":"2024-09-12T02:29:03.910724+0000","last_clean":"2024-09-12T02:29:03.910724+0000","last_became_active":"2024-09-12T02:29:02.617750+0000","last_became_peered":"2024-09-12T02:29:02.617750+0000","last_unstale":"2024-09-12T02:29:03.910724+0000","last_undegraded":"2024-09-12T02:29:03.910724+0000","last_fullsized":"2024-09-12T02:29:03.910724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:08.850906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.911143+0000","last_change":"2024-09-12T02:29:02.616002+0000","last_active":"2024-09-12T02:29:03.911143+0000","last_peered":"2024-09-12T02:29:03.911143+0000","last_clean":"2024-09-12T02:29:03.911143+0000","last_became_active":"2024-09-12T02:29:02.615650+0000","last_became_peered":"2024-09-12T02:29:02.615650+0000","last_unstale":"2024-09-12T02:29:03.911143+0000","last_undegraded":"2024-09-12T02:29:03.911143+0000","last_fullsized":"2024-09-12T02:29:03.911143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:59.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923189+0000","last_change":"2024-09-12T02:29:02.619484+0000","last_active":"2024-09-12T02:29:03.923189+0000","last_peered":"2024-09-12T02:29:03.923189+0000","last_clean":"2024-09-12T02:29:03.923189+0000","last_became_active":"2024-09-12T02:29:02.619204+0000","last_became_peered":"2024-09-12T02:29:02.619204+0000","last_unstale":"2024-09-12T02:29:03.923189+0000","last_undegraded":"2024-09-12T02:29:03.923189+0000","last_fullsized":"2024-09-12T02:29:03.923189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:30.059800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922887+0000","last_change":"2024-09-12T02:29:02.619415+0000","last_active":"2024-09-12T02:29:03.922887+0000","last_peered":"2024-09-12T02:29:03.922887+0000","last_clean":"2024-09-12T02:29:03.922887+0000","last_became_active":"2024-09-12T02:29:02.618918+0000","last_became_peered":"2024-09-12T02:29:02.618918+0000","last_unstale":"2024-09-12T02:29:03.922887+0000","last_undegraded":"2024-09-12T02:29:03.922887+0000","last_fullsized":"2024-09-12T02:29:03.922887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:02.628132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922786+0000","last_change":"2024-09-12T02:29:02.612187+0000","last_active":"2024-09-12T02:29:03.922786+0000","last_peered":"2024-09-12T02:29:03.922786+0000","last_clean":"2024-09-12T02:29:03.922786+0000","last_became_active":"2024-09-12T02:29:02.611919+0000","last_became_peered":"2024-09-12T02:29:02.611919+0000","last_unstale":"2024-09-12T02:29:03.922786+0000","last_undegraded":"2024-09-12T02:29:03.922786+0000","last_fullsized":"2024-09-12T02:29:03.922786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.543341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614460+0000","last_change":"2024-09-12T02:29:02.612217+0000","last_active":"2024-09-12T02:29:03.614460+0000","last_peered":"2024-09-12T02:29:03.614460+0000","last_clean":"2024-09-12T02:29:03.614460+0000","last_became_active":"2024-09-12T02:29:02.611931+0000","last_became_peered":"2024-09-12T02:29:02.611931+0000","last_unstale":"2024-09-12T02:29:03.614460+0000","last_undegraded":"2024-09-12T02:29:03.614460+0000","last_fullsized":"2024-09-12T02:29:03.614460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614483+0000","last_change":"2024-09-12T02:29:02.620384+0000","last_active":"2024-09-12T02:29:03.614483+0000","last_peered":"2024-09-12T02:29:03.614483+0000","last_clean":"2024-09-12T02:29:03.614483+0000","last_became_active":"2024-09-12T02:29:02.618647+0000","last_became_peered":"2024-09-12T02:29:02.618647+0000","last_unstale":"2024-09-12T02:29:03.614483+0000","last_undegraded":"2024-09-12T02:29:03.614483+0000","last_fullsized":"2024-09-12T02:29:03.614483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.611939+0000","last_change":"2024-09-12T02:29:02.608849+0000","last_active":"2024-09-12T02:29:03.611939+0000","last_peered":"2024-09-12T02:29:03.611939+0000","last_clean":"2024-09-12T02:29:03.611939+0000","last_became_active":"2024-09-12T02:29:02.608571+0000","last_became_peered":"2024-09-12T02:29:02.608571+0000","last_unstale":"2024-09-12T02:29:03.611939+0000","last_undegraded":"2024-09-12T02:29:03.611939+0000","last_fullsized":"2024-09-12T02:29:03.611939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612760+0000","last_change":"2024-09-12T02:29:02.611689+0000","last_active":"2024-09-12T02:29:03.612760+0000","last_peered":"2024-09-12T02:29:03.612760+0000","last_clean":"2024-09-12T02:29:03.612760+0000","last_became_active":"2024-09-12T02:29:02.611155+0000","last_became_peered":"2024-09-12T02:29:02.611155+0000","last_unstale":"2024-09-12T02:29:03.612760+0000","last_undegraded":"2024-09-12T02:29:03.612760+0000","last_fullsized":"2024-09-12T02:29:03.612760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:14.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614357+0000","last_change":"2024-09-12T02:29:02.610975+0000","last_active":"2024-09-12T02:29:03.614357+0000","last_peered":"2024-09-12T02:29:03.614357+0000","last_clean":"2024-09-12T02:29:03.614357+0000","last_became_active":"2024-09-12T02:29:02.610711+0000","last_became_peered":"2024-09-12T02:29:02.610711+0000","last_unstale":"2024-09-12T02:29:03.614357+0000","last_undegraded":"2024-09-12T02:29:03.614357+0000","last_fullsized":"2024-09-12T02:29:03.614357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:14.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923236+0000","last_change":"2024-09-12T02:29:02.613712+0000","last_active":"2024-09-12T02:29:03.923236+0000","last_peered":"2024-09-12T02:29:03.923236+0000","last_clean":"2024-09-12T02:29:03.923236+0000","last_became_active":"2024-09-12T02:29:02.613396+0000","last_became_peered":"2024-09-12T02:29:02.613396+0000","last_unstale":"2024-09-12T02:29:03.923236+0000","last_undegraded":"2024-09-12T02:29:03.923236+0000","last_fullsized":"2024-09-12T02:29:03.923236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:17.078123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614468+0000","last_change":"2024-09-12T02:29:02.617285+0000","last_active":"2024-09-12T02:29:03.614468+0000","last_peered":"2024-09-12T02:29:03.614468+0000","last_clean":"2024-09-12T02:29:03.614468+0000","last_became_active":"2024-09-12T02:29:02.617000+0000","last_became_peered":"2024-09-12T02:29:02.617000+0000","last_unstale":"2024-09-12T02:29:03.614468+0000","last_undegraded":"2024-09-12T02:29:03.614468+0000","last_fullsized":"2024-09-12T02:29:03.614468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:03.190386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613664+0000","last_change":"2024-09-12T02:29:02.614642+0000","last_active":"2024-09-12T02:29:03.613664+0000","last_peered":"2024-09-12T02:29:03.613664+0000","last_clean":"2024-09-12T02:29:03.613664+0000","last_became_active":"2024-09-12T02:29:02.614378+0000","last_became_peered":"2024-09-12T02:29:02.614378+0000","last_unstale":"2024-09-12T02:29:03.613664+0000","last_undegraded":"2024-09-12T02:29:03.613664+0000","last_fullsized":"2024-09-12T02:29:03.613664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:55.894691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614660+0000","last_change":"2024-09-12T02:29:02.618923+0000","last_active":"2024-09-12T02:29:03.614660+0000","last_peered":"2024-09-12T02:29:03.614660+0000","last_clean":"2024-09-12T02:29:03.614660+0000","last_became_active":"2024-09-12T02:29:02.618672+0000","last_became_peered":"2024-09-12T02:29:02.618672+0000","last_unstale":"2024-09-12T02:29:03.614660+0000","last_undegraded":"2024-09-12T02:29:03.614660+0000","last_fullsized":"2024-09-12T02:29:03.614660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910522+0000","last_change":"2024-09-12T02:29:02.607465+0000","last_active":"2024-09-12T02:29:03.910522+0000","last_peered":"2024-09-12T02:29:03.910522+0000","last_clean":"2024-09-12T02:29:03.910522+0000","last_became_active":"2024-09-12T02:29:02.607166+0000","last_became_peered":"2024-09-12T02:29:02.607166+0000","last_unstale":"2024-09-12T02:29:03.910522+0000","last_undegraded":"2024-09-12T02:29:03.910522+0000","last_fullsized":"2024-09-12T02:29:03.910522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:26.746426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613317+0000","last_change":"2024-09-12T02:29:02.607409+0000","last_active":"2024-09-12T02:29:03.613317+0000","last_peered":"2024-09-12T02:29:03.613317+0000","last_clean":"2024-09-12T02:29:03.613317+0000","last_became_active":"2024-09-12T02:29:02.607135+0000","last_became_peered":"2024-09-12T02:29:02.607135+0000","last_unstale":"2024-09-12T02:29:03.613317+0000","last_undegraded":"2024-09-12T02:29:03.613317+0000","last_fullsized":"2024-09-12T02:29:03.613317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:00.668044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910424+0000","last_change":"2024-09-12T02:29:02.610003+0000","last_active":"2024-09-12T02:29:03.910424+0000","last_peered":"2024-09-12T02:29:03.910424+0000","last_clean":"2024-09-12T02:29:03.910424+0000","last_became_active":"2024-09-12T02:29:02.609706+0000","last_became_peered":"2024-09-12T02:29:02.609706+0000","last_unstale":"2024-09-12T02:29:03.910424+0000","last_undegraded":"2024-09-12T02:29:03.910424+0000","last_fullsized":"2024-09-12T02:29:03.910424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:14.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612223+0000","last_change":"2024-09-12T02:29:02.609713+0000","last_active":"2024-09-12T02:29:03.612223+0000","last_peered":"2024-09-12T02:29:03.612223+0000","last_clean":"2024-09-12T02:29:03.612223+0000","last_became_active":"2024-09-12T02:29:02.609443+0000","last_became_peered":"2024-09-12T02:29:02.609443+0000","last_unstale":"2024-09-12T02:29:03.612223+0000","last_undegraded":"2024-09-12T02:29:03.612223+0000","last_fullsized":"2024-09-12T02:29:03.612223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:50.718009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614742+0000","last_change":"2024-09-12T02:29:01.601092+0000","last_active":"2024-09-12T02:29:03.614742+0000","last_peered":"2024-09-12T02:29:03.614742+0000","last_clean":"2024-09-12T02:29:03.614742+0000","last_became_active":"2024-09-12T02:29:01.600800+0000","last_became_peered":"2024-09-12T02:29:01.600800+0000","last_unstale":"2024-09-12T02:29:03.614742+0000","last_undegraded":"2024-09-12T02:29:03.614742+0000","last_fullsized":"2024-09-12T02:29:03.614742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614665+0000","last_change":"2024-09-12T02:29:02.604002+0000","last_active":"2024-09-12T02:29:03.614665+0000","last_peered":"2024-09-12T02:29:03.614665+0000","last_clean":"2024-09-12T02:29:03.614665+0000","last_became_active":"2024-09-12T02:29:02.603729+0000","last_became_peered":"2024-09-12T02:29:02.603729+0000","last_unstale":"2024-09-12T02:29:03.614665+0000","last_undegraded":"2024-09-12T02:29:03.614665+0000","last_fullsized":"2024-09-12T02:29:03.614665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612123+0000","last_change":"2024-09-12T02:29:01.603395+0000","last_active":"2024-09-12T02:29:03.612123+0000","last_peered":"2024-09-12T02:29:03.612123+0000","last_clean":"2024-09-12T02:29:03.612123+0000","last_became_active":"2024-09-12T02:29:01.602799+0000","last_became_peered":"2024-09-12T02:29:01.602799+0000","last_unstale":"2024-09-12T02:29:03.612123+0000","last_undegraded":"2024-09-12T02:29:03.612123+0000","last_fullsized":"2024-09-12T02:29:03.612123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.615024+0000","last_change":"2024-09-12T02:29:02.618545+0000","last_active":"2024-09-12T02:29:03.615024+0000","last_peered":"2024-09-12T02:29:03.615024+0000","last_clean":"2024-09-12T02:29:03.615024+0000","last_became_active":"2024-09-12T02:29:02.618260+0000","last_became_peered":"2024-09-12T02:29:02.618260+0000","last_unstale":"2024-09-12T02:29:03.615024+0000","last_undegraded":"2024-09-12T02:29:03.615024+0000","last_fullsized":"2024-09-12T02:29:03.615024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.634372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922936+0000","last_change":"2024-09-12T02:29:01.596866+0000","last_active":"2024-09-12T02:29:03.922936+0000","last_peered":"2024-09-12T02:29:03.922936+0000","last_clean":"2024-09-12T02:29:03.922936+0000","last_became_active":"2024-09-12T02:29:01.596619+0000","last_became_peered":"2024-09-12T02:29:01.596619+0000","last_unstale":"2024-09-12T02:29:03.922936+0000","last_undegraded":"2024-09-12T02:29:03.922936+0000","last_fullsized":"2024-09-12T02:29:03.922936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:20.835526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614549+0000","last_change":"2024-09-12T02:29:02.617228+0000","last_active":"2024-09-12T02:29:03.614549+0000","last_peered":"2024-09-12T02:29:03.614549+0000","last_clean":"2024-09-12T02:29:03.614549+0000","last_became_active":"2024-09-12T02:29:02.616632+0000","last_became_peered":"2024-09-12T02:29:02.616632+0000","last_unstale":"2024-09-12T02:29:03.614549+0000","last_undegraded":"2024-09-12T02:29:03.614549+0000","last_fullsized":"2024-09-12T02:29:03.614549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:26.746426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922870+0000","last_change":"2024-09-12T02:29:01.592790+0000","last_active":"2024-09-12T02:29:03.922870+0000","last_peered":"2024-09-12T02:29:03.922870+0000","last_clean":"2024-09-12T02:29:03.922870+0000","last_became_active":"2024-09-12T02:29:01.592540+0000","last_became_peered":"2024-09-12T02:29:01.592540+0000","last_unstale":"2024-09-12T02:29:03.922870+0000","last_undegraded":"2024-09-12T02:29:03.922870+0000","last_fullsized":"2024-09-12T02:29:03.922870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.636681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910589+0000","last_change":"2024-09-12T02:29:02.612926+0000","last_active":"2024-09-12T02:29:03.910589+0000","last_peered":"2024-09-12T02:29:03.910589+0000","last_clean":"2024-09-12T02:29:03.910589+0000","last_became_active":"2024-09-12T02:29:02.612684+0000","last_became_peered":"2024-09-12T02:29:02.612684+0000","last_unstale":"2024-09-12T02:29:03.910589+0000","last_undegraded":"2024-09-12T02:29:03.910589+0000","last_fullsized":"2024-09-12T02:29:03.910589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:35.640589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614891+0000","last_change":"2024-09-12T02:29:01.599459+0000","last_active":"2024-09-12T02:29:03.614891+0000","last_peered":"2024-09-12T02:29:03.614891+0000","last_clean":"2024-09-12T02:29:03.614891+0000","last_became_active":"2024-09-12T02:29:01.599152+0000","last_became_peered":"2024-09-12T02:29:01.599152+0000","last_unstale":"2024-09-12T02:29:03.614891+0000","last_undegraded":"2024-09-12T02:29:03.614891+0000","last_fullsized":"2024-09-12T02:29:03.614891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613324+0000","last_change":"2024-09-12T02:29:02.614585+0000","last_active":"2024-09-12T02:29:03.613324+0000","last_peered":"2024-09-12T02:29:03.613324+0000","last_clean":"2024-09-12T02:29:03.613324+0000","last_became_active":"2024-09-12T02:29:02.614301+0000","last_became_peered":"2024-09-12T02:29:02.614301+0000","last_unstale":"2024-09-12T02:29:03.613324+0000","last_undegraded":"2024-09-12T02:29:03.613324+0000","last_fullsized":"2024-09-12T02:29:03.613324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:45.885218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614920+0000","last_change":"2024-09-12T02:29:01.593974+0000","last_active":"2024-09-12T02:29:03.614920+0000","last_peered":"2024-09-12T02:29:03.614920+0000","last_clean":"2024-09-12T02:29:03.614920+0000","last_became_active":"2024-09-12T02:29:01.593658+0000","last_became_peered":"2024-09-12T02:29:01.593658+0000","last_unstale":"2024-09-12T02:29:03.614920+0000","last_undegraded":"2024-09-12T02:29:03.614920+0000","last_fullsized":"2024-09-12T02:29:03.614920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:23.538881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614089+0000","last_change":"2024-09-12T02:29:02.602008+0000","last_active":"2024-09-12T02:29:03.614089+0000","last_peered":"2024-09-12T02:29:03.614089+0000","last_clean":"2024-09-12T02:29:03.614089+0000","last_became_active":"2024-09-12T02:29:02.601671+0000","last_became_peered":"2024-09-12T02:29:02.601671+0000","last_unstale":"2024-09-12T02:29:03.614089+0000","last_undegraded":"2024-09-12T02:29:03.614089+0000","last_fullsized":"2024-09-12T02:29:03.614089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:49.884613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922732+0000","last_change":"2024-09-12T02:29:01.599132+0000","last_active":"2024-09-12T02:29:03.922732+0000","last_peered":"2024-09-12T02:29:03.922732+0000","last_clean":"2024-09-12T02:29:03.922732+0000","last_became_active":"2024-09-12T02:29:01.598859+0000","last_became_peered":"2024-09-12T02:29:01.598859+0000","last_unstale":"2024-09-12T02:29:03.922732+0000","last_undegraded":"2024-09-12T02:29:03.922732+0000","last_fullsized":"2024-09-12T02:29:03.922732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:18.653628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614019+0000","last_change":"2024-09-12T02:29:02.612688+0000","last_active":"2024-09-12T02:29:03.614019+0000","last_peered":"2024-09-12T02:29:03.614019+0000","last_clean":"2024-09-12T02:29:03.614019+0000","last_became_active":"2024-09-12T02:29:02.612433+0000","last_became_peered":"2024-09-12T02:29:02.612433+0000","last_unstale":"2024-09-12T02:29:03.614019+0000","last_undegraded":"2024-09-12T02:29:03.614019+0000","last_fullsized":"2024-09-12T02:29:03.614019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:42.273785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614155+0000","last_change":"2024-09-12T02:29:01.591494+0000","last_active":"2024-09-12T02:29:03.614155+0000","last_peered":"2024-09-12T02:29:03.614155+0000","last_clean":"2024-09-12T02:29:03.614155+0000","last_became_active":"2024-09-12T02:29:01.591190+0000","last_became_peered":"2024-09-12T02:29:01.591190+0000","last_unstale":"2024-09-12T02:29:03.614155+0000","last_undegraded":"2024-09-12T02:29:03.614155+0000","last_fullsized":"2024-09-12T02:29:03.614155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.939513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613539+0000","last_change":"2024-09-12T02:29:02.619913+0000","last_active":"2024-09-12T02:29:03.613539+0000","last_peered":"2024-09-12T02:29:03.613539+0000","last_clean":"2024-09-12T02:29:03.613539+0000","last_became_active":"2024-09-12T02:29:02.619304+0000","last_became_peered":"2024-09-12T02:29:02.619304+0000","last_unstale":"2024-09-12T02:29:03.613539+0000","last_undegraded":"2024-09-12T02:29:03.613539+0000","last_fullsized":"2024-09-12T02:29:03.613539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:08.850906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922749+0000","last_change":"2024-09-12T02:29:01.602933+0000","last_active":"2024-09-12T02:29:03.922749+0000","last_peered":"2024-09-12T02:29:03.922749+0000","last_clean":"2024-09-12T02:29:03.922749+0000","last_became_active":"2024-09-12T02:29:01.602627+0000","last_became_peered":"2024-09-12T02:29:01.602627+0000","last_unstale":"2024-09-12T02:29:03.922749+0000","last_undegraded":"2024-09-12T02:29:03.922749+0000","last_fullsized":"2024-09-12T02:29:03.922749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:28.594205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922598+0000","last_change":"2024-09-12T02:29:02.619065+0000","last_active":"2024-09-12T02:29:03.922598+0000","last_peered":"2024-09-12T02:29:03.922598+0000","last_clean":"2024-09-12T02:29:03.922598+0000","last_became_active":"2024-09-12T02:29:02.618774+0000","last_became_peered":"2024-09-12T02:29:02.618774+0000","last_unstale":"2024-09-12T02:29:03.922598+0000","last_undegraded":"2024-09-12T02:29:03.922598+0000","last_fullsized":"2024-09-12T02:29:03.922598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:02.740014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612211+0000","last_change":"2024-09-12T02:29:01.599918+0000","last_active":"2024-09-12T02:29:03.612211+0000","last_peered":"2024-09-12T02:29:03.612211+0000","last_clean":"2024-09-12T02:29:03.612211+0000","last_became_active":"2024-09-12T02:29:01.599628+0000","last_became_peered":"2024-09-12T02:29:01.599628+0000","last_unstale":"2024-09-12T02:29:03.612211+0000","last_undegraded":"2024-09-12T02:29:03.612211+0000","last_fullsized":"2024-09-12T02:29:03.612211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923392+0000","last_change":"2024-09-12T02:29:02.616678+0000","last_active":"2024-09-12T02:29:03.923392+0000","last_peered":"2024-09-12T02:29:03.923392+0000","last_clean":"2024-09-12T02:29:03.923392+0000","last_became_active":"2024-09-12T02:29:02.616441+0000","last_became_peered":"2024-09-12T02:29:02.616441+0000","last_unstale":"2024-09-12T02:29:03.923392+0000","last_undegraded":"2024-09-12T02:29:03.923392+0000","last_fullsized":"2024-09-12T02:29:03.923392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:51.228054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613563+0000","last_change":"2024-09-12T02:29:01.605522+0000","last_active":"2024-09-12T02:29:03.613563+0000","last_peered":"2024-09-12T02:29:03.613563+0000","last_clean":"2024-09-12T02:29:03.613563+0000","last_became_active":"2024-09-12T02:29:01.605265+0000","last_became_peered":"2024-09-12T02:29:01.605265+0000","last_unstale":"2024-09-12T02:29:03.613563+0000","last_undegraded":"2024-09-12T02:29:03.613563+0000","last_fullsized":"2024-09-12T02:29:03.613563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.872408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613287+0000","last_change":"2024-09-12T02:29:02.618134+0000","last_active":"2024-09-12T02:29:03.613287+0000","last_peered":"2024-09-12T02:29:03.613287+0000","last_clean":"2024-09-12T02:29:03.613287+0000","last_became_active":"2024-09-12T02:29:02.617667+0000","last_became_peered":"2024-09-12T02:29:02.617667+0000","last_unstale":"2024-09-12T02:29:03.613287+0000","last_undegraded":"2024-09-12T02:29:03.613287+0000","last_fullsized":"2024-09-12T02:29:03.613287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:26.746426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923433+0000","last_change":"2024-09-12T02:29:01.595079+0000","last_active":"2024-09-12T02:29:03.923433+0000","last_peered":"2024-09-12T02:29:03.923433+0000","last_clean":"2024-09-12T02:29:03.923433+0000","last_became_active":"2024-09-12T02:29:01.594811+0000","last_became_peered":"2024-09-12T02:29:01.594811+0000","last_unstale":"2024-09-12T02:29:03.923433+0000","last_undegraded":"2024-09-12T02:29:03.923433+0000","last_fullsized":"2024-09-12T02:29:03.923433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:53.744227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614018+0000","last_change":"2024-09-12T02:29:02.613674+0000","last_active":"2024-09-12T02:29:03.614018+0000","last_peered":"2024-09-12T02:29:03.614018+0000","last_clean":"2024-09-12T02:29:03.614018+0000","last_became_active":"2024-09-12T02:29:02.613418+0000","last_became_peered":"2024-09-12T02:29:02.613418+0000","last_unstale":"2024-09-12T02:29:03.614018+0000","last_undegraded":"2024-09-12T02:29:03.614018+0000","last_fullsized":"2024-09-12T02:29:03.614018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:49.937590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614788+0000","last_change":"2024-09-12T02:29:01.593677+0000","last_active":"2024-09-12T02:29:03.614788+0000","last_peered":"2024-09-12T02:29:03.614788+0000","last_clean":"2024-09-12T02:29:03.614788+0000","last_became_active":"2024-09-12T02:29:01.593403+0000","last_became_peered":"2024-09-12T02:29:01.593403+0000","last_unstale":"2024-09-12T02:29:03.614788+0000","last_undegraded":"2024-09-12T02:29:03.614788+0000","last_fullsized":"2024-09-12T02:29:03.614788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923324+0000","last_change":"2024-09-12T02:29:02.614070+0000","last_active":"2024-09-12T02:29:03.923324+0000","last_peered":"2024-09-12T02:29:03.923324+0000","last_clean":"2024-09-12T02:29:03.923324+0000","last_became_active":"2024-09-12T02:29:02.613499+0000","last_became_peered":"2024-09-12T02:29:02.613499+0000","last_unstale":"2024-09-12T02:29:03.923324+0000","last_undegraded":"2024-09-12T02:29:03.923324+0000","last_fullsized":"2024-09-12T02:29:03.923324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:12.327474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613973+0000","last_change":"2024-09-12T02:29:01.600635+0000","last_active":"2024-09-12T02:29:03.613973+0000","last_peered":"2024-09-12T02:29:03.613973+0000","last_clean":"2024-09-12T02:29:03.613973+0000","last_became_active":"2024-09-12T02:29:01.600147+0000","last_became_peered":"2024-09-12T02:29:01.600147+0000","last_unstale":"2024-09-12T02:29:03.613973+0000","last_undegraded":"2024-09-12T02:29:03.613973+0000","last_fullsized":"2024-09-12T02:29:03.613973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910624+0000","last_change":"2024-09-12T02:29:02.610088+0000","last_active":"2024-09-12T02:29:03.910624+0000","last_peered":"2024-09-12T02:29:03.910624+0000","last_clean":"2024-09-12T02:29:03.910624+0000","last_became_active":"2024-09-12T02:29:02.609800+0000","last_became_peered":"2024-09-12T02:29:02.609800+0000","last_unstale":"2024-09-12T02:29:03.910624+0000","last_undegraded":"2024-09-12T02:29:03.910624+0000","last_fullsized":"2024-09-12T02:29:03.910624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:37.652254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922814+0000","last_change":"2024-09-12T02:29:01.597990+0000","last_active":"2024-09-12T02:29:03.922814+0000","last_peered":"2024-09-12T02:29:03.922814+0000","last_clean":"2024-09-12T02:29:03.922814+0000","last_became_active":"2024-09-12T02:29:01.597733+0000","last_became_peered":"2024-09-12T02:29:01.597733+0000","last_unstale":"2024-09-12T02:29:03.922814+0000","last_undegraded":"2024-09-12T02:29:03.922814+0000","last_fullsized":"2024-09-12T02:29:03.922814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:21.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613477+0000","last_change":"2024-09-12T02:29:02.605133+0000","last_active":"2024-09-12T02:29:03.613477+0000","last_peered":"2024-09-12T02:29:03.613477+0000","last_clean":"2024-09-12T02:29:03.613477+0000","last_became_active":"2024-09-12T02:29:02.604822+0000","last_became_peered":"2024-09-12T02:29:02.604822+0000","last_unstale":"2024-09-12T02:29:03.613477+0000","last_undegraded":"2024-09-12T02:29:03.613477+0000","last_fullsized":"2024-09-12T02:29:03.613477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:51.878118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922660+0000","last_change":"2024-09-12T02:29:01.594764+0000","last_active":"2024-09-12T02:29:03.922660+0000","last_peered":"2024-09-12T02:29:03.922660+0000","last_clean":"2024-09-12T02:29:03.922660+0000","last_became_active":"2024-09-12T02:29:01.594268+0000","last_became_peered":"2024-09-12T02:29:01.594268+0000","last_unstale":"2024-09-12T02:29:03.922660+0000","last_undegraded":"2024-09-12T02:29:03.922660+0000","last_fullsized":"2024-09-12T02:29:03.922660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:15.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614636+0000","last_change":"2024-09-12T02:29:02.611999+0000","last_active":"2024-09-12T02:29:03.614636+0000","last_peered":"2024-09-12T02:29:03.614636+0000","last_clean":"2024-09-12T02:29:03.614636+0000","last_became_active":"2024-09-12T02:29:02.611694+0000","last_became_peered":"2024-09-12T02:29:02.611694+0000","last_unstale":"2024-09-12T02:29:03.614636+0000","last_undegraded":"2024-09-12T02:29:03.614636+0000","last_fullsized":"2024-09-12T02:29:03.614636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.341506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614401+0000","last_change":"2024-09-12T02:29:01.602071+0000","last_active":"2024-09-12T02:29:03.614401+0000","last_peered":"2024-09-12T02:29:03.614401+0000","last_clean":"2024-09-12T02:29:03.614401+0000","last_became_active":"2024-09-12T02:29:01.601793+0000","last_became_peered":"2024-09-12T02:29:01.601793+0000","last_unstale":"2024-09-12T02:29:03.614401+0000","last_undegraded":"2024-09-12T02:29:03.614401+0000","last_fullsized":"2024-09-12T02:29:03.614401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.970701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613853+0000","last_change":"2024-09-12T02:29:02.616753+0000","last_active":"2024-09-12T02:29:03.613853+0000","last_peered":"2024-09-12T02:29:03.613853+0000","last_clean":"2024-09-12T02:29:03.613853+0000","last_became_active":"2024-09-12T02:29:02.616476+0000","last_became_peered":"2024-09-12T02:29:02.616476+0000","last_unstale":"2024-09-12T02:29:03.613853+0000","last_undegraded":"2024-09-12T02:29:03.613853+0000","last_fullsized":"2024-09-12T02:29:03.613853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:00.462540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614576+0000","last_change":"2024-09-12T02:29:01.600094+0000","last_active":"2024-09-12T02:29:03.614576+0000","last_peered":"2024-09-12T02:29:03.614576+0000","last_clean":"2024-09-12T02:29:03.614576+0000","last_became_active":"2024-09-12T02:29:01.599825+0000","last_became_peered":"2024-09-12T02:29:01.599825+0000","last_unstale":"2024-09-12T02:29:03.614576+0000","last_undegraded":"2024-09-12T02:29:03.614576+0000","last_fullsized":"2024-09-12T02:29:03.614576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614269+0000","last_change":"2024-09-12T02:29:02.616662+0000","last_active":"2024-09-12T02:29:03.614269+0000","last_peered":"2024-09-12T02:29:03.614269+0000","last_clean":"2024-09-12T02:29:03.614269+0000","last_became_active":"2024-09-12T02:29:02.616348+0000","last_became_peered":"2024-09-12T02:29:02.616348+0000","last_unstale":"2024-09-12T02:29:03.614269+0000","last_undegraded":"2024-09-12T02:29:03.614269+0000","last_fullsized":"2024-09-12T02:29:03.614269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:19.331506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614825+0000","last_change":"2024-09-12T02:29:01.601320+0000","last_active":"2024-09-12T02:29:03.614825+0000","last_peered":"2024-09-12T02:29:03.614825+0000","last_clean":"2024-09-12T02:29:03.614825+0000","last_became_active":"2024-09-12T02:29:01.601010+0000","last_became_peered":"2024-09-12T02:29:01.601010+0000","last_unstale":"2024-09-12T02:29:03.614825+0000","last_undegraded":"2024-09-12T02:29:03.614825+0000","last_fullsized":"2024-09-12T02:29:03.614825+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:18.815610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.923048+0000","last_change":"2024-09-12T02:29:02.610353+0000","last_active":"2024-09-12T02:29:03.923048+0000","last_peered":"2024-09-12T02:29:03.923048+0000","last_clean":"2024-09-12T02:29:03.923048+0000","last_became_active":"2024-09-12T02:29:02.610062+0000","last_became_peered":"2024-09-12T02:29:02.610062+0000","last_unstale":"2024-09-12T02:29:03.923048+0000","last_undegraded":"2024-09-12T02:29:03.923048+0000","last_fullsized":"2024-09-12T02:29:03.923048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:01.899293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614853+0000","last_change":"2024-09-12T02:29:01.599517+0000","last_active":"2024-09-12T02:29:03.614853+0000","last_peered":"2024-09-12T02:29:03.614853+0000","last_clean":"2024-09-12T02:29:03.614853+0000","last_became_active":"2024-09-12T02:29:01.599119+0000","last_became_peered":"2024-09-12T02:29:01.599119+0000","last_unstale":"2024-09-12T02:29:03.614853+0000","last_undegraded":"2024-09-12T02:29:03.614853+0000","last_fullsized":"2024-09-12T02:29:03.614853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:50.828257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922426+0000","last_change":"2024-09-12T02:29:02.613238+0000","last_active":"2024-09-12T02:29:03.922426+0000","last_peered":"2024-09-12T02:29:03.922426+0000","last_clean":"2024-09-12T02:29:03.922426+0000","last_became_active":"2024-09-12T02:29:02.612261+0000","last_became_peered":"2024-09-12T02:29:02.612261+0000","last_unstale":"2024-09-12T02:29:03.922426+0000","last_undegraded":"2024-09-12T02:29:03.922426+0000","last_fullsized":"2024-09-12T02:29:03.922426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:40.826919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612144+0000","last_change":"2024-09-12T02:29:01.602422+0000","last_active":"2024-09-12T02:29:03.612144+0000","last_peered":"2024-09-12T02:29:03.612144+0000","last_clean":"2024-09-12T02:29:03.612144+0000","last_became_active":"2024-09-12T02:29:01.602077+0000","last_became_peered":"2024-09-12T02:29:01.602077+0000","last_unstale":"2024-09-12T02:29:03.612144+0000","last_undegraded":"2024-09-12T02:29:03.612144+0000","last_fullsized":"2024-09-12T02:29:03.612144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:56.523872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922752+0000","last_change":"2024-09-12T02:29:02.613657+0000","last_active":"2024-09-12T02:29:03.922752+0000","last_peered":"2024-09-12T02:29:03.922752+0000","last_clean":"2024-09-12T02:29:03.922752+0000","last_became_active":"2024-09-12T02:29:02.613405+0000","last_became_peered":"2024-09-12T02:29:02.613405+0000","last_unstale":"2024-09-12T02:29:03.922752+0000","last_undegraded":"2024-09-12T02:29:03.922752+0000","last_fullsized":"2024-09-12T02:29:03.922752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:22.747137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.613040+0000","last_change":"2024-09-12T02:29:01.597327+0000","last_active":"2024-09-12T02:29:03.613040+0000","last_peered":"2024-09-12T02:29:03.613040+0000","last_clean":"2024-09-12T02:29:03.613040+0000","last_became_active":"2024-09-12T02:29:01.596766+0000","last_became_peered":"2024-09-12T02:29:01.596766+0000","last_unstale":"2024-09-12T02:29:03.613040+0000","last_undegraded":"2024-09-12T02:29:03.613040+0000","last_fullsized":"2024-09-12T02:29:03.613040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:56.540600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922551+0000","last_change":"2024-09-12T02:29:02.610306+0000","last_active":"2024-09-12T02:29:03.922551+0000","last_peered":"2024-09-12T02:29:03.922551+0000","last_clean":"2024-09-12T02:29:03.922551+0000","last_became_active":"2024-09-12T02:29:02.610034+0000","last_became_peered":"2024-09-12T02:29:02.610034+0000","last_unstale":"2024-09-12T02:29:03.922551+0000","last_undegraded":"2024-09-12T02:29:03.922551+0000","last_fullsized":"2024-09-12T02:29:03.922551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:36.722480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614205+0000","last_change":"2024-09-12T02:29:01.594610+0000","last_active":"2024-09-12T02:29:03.614205+0000","last_peered":"2024-09-12T02:29:03.614205+0000","last_clean":"2024-09-12T02:29:03.614205+0000","last_became_active":"2024-09-12T02:29:01.594373+0000","last_became_peered":"2024-09-12T02:29:01.594373+0000","last_unstale":"2024-09-12T02:29:03.614205+0000","last_undegraded":"2024-09-12T02:29:03.614205+0000","last_fullsized":"2024-09-12T02:29:03.614205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:09.467337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910490+0000","last_change":"2024-09-12T02:29:02.613333+0000","last_active":"2024-09-12T02:29:03.910490+0000","last_peered":"2024-09-12T02:29:03.910490+0000","last_clean":"2024-09-12T02:29:03.910490+0000","last_became_active":"2024-09-12T02:29:02.613020+0000","last_became_peered":"2024-09-12T02:29:02.613020+0000","last_unstale":"2024-09-12T02:29:03.910490+0000","last_undegraded":"2024-09-12T02:29:03.910490+0000","last_fullsized":"2024-09-12T02:29:03.910490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:03.190386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612869+0000","last_change":"2024-09-12T02:29:01.600161+0000","last_active":"2024-09-12T02:29:03.612869+0000","last_peered":"2024-09-12T02:29:03.612869+0000","last_clean":"2024-09-12T02:29:03.612869+0000","last_became_active":"2024-09-12T02:29:01.599858+0000","last_became_peered":"2024-09-12T02:29:01.599858+0000","last_unstale":"2024-09-12T02:29:03.612869+0000","last_undegraded":"2024-09-12T02:29:03.612869+0000","last_fullsized":"2024-09-12T02:29:03.612869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:59.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922576+0000","last_change":"2024-09-12T02:29:02.612962+0000","last_active":"2024-09-12T02:29:03.922576+0000","last_peered":"2024-09-12T02:29:03.922576+0000","last_clean":"2024-09-12T02:29:03.922576+0000","last_became_active":"2024-09-12T02:29:02.611995+0000","last_became_peered":"2024-09-12T02:29:02.611995+0000","last_unstale":"2024-09-12T02:29:03.922576+0000","last_undegraded":"2024-09-12T02:29:03.922576+0000","last_fullsized":"2024-09-12T02:29:03.922576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:36.668998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614450+0000","last_change":"2024-09-12T02:29:01.604076+0000","last_active":"2024-09-12T02:29:03.614450+0000","last_peered":"2024-09-12T02:29:03.614450+0000","last_clean":"2024-09-12T02:29:03.614450+0000","last_became_active":"2024-09-12T02:29:01.603786+0000","last_became_peered":"2024-09-12T02:29:01.603786+0000","last_unstale":"2024-09-12T02:29:03.614450+0000","last_undegraded":"2024-09-12T02:29:03.614450+0000","last_fullsized":"2024-09-12T02:29:03.614450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:02.920830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614017+0000","last_change":"2024-09-12T02:29:02.611837+0000","last_active":"2024-09-12T02:29:03.614017+0000","last_peered":"2024-09-12T02:29:03.614017+0000","last_clean":"2024-09-12T02:29:03.614017+0000","last_became_active":"2024-09-12T02:29:02.611576+0000","last_became_peered":"2024-09-12T02:29:02.611576+0000","last_unstale":"2024-09-12T02:29:03.614017+0000","last_undegraded":"2024-09-12T02:29:03.614017+0000","last_fullsized":"2024-09-12T02:29:03.614017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:59.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612300+0000","last_change":"2024-09-12T02:29:01.596912+0000","last_active":"2024-09-12T02:29:03.612300+0000","last_peered":"2024-09-12T02:29:03.612300+0000","last_clean":"2024-09-12T02:29:03.612300+0000","last_became_active":"2024-09-12T02:29:01.596630+0000","last_became_peered":"2024-09-12T02:29:01.596630+0000","last_unstale":"2024-09-12T02:29:03.612300+0000","last_undegraded":"2024-09-12T02:29:03.612300+0000","last_fullsized":"2024-09-12T02:29:03.612300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612057+0000","last_change":"2024-09-12T02:29:02.612642+0000","last_active":"2024-09-12T02:29:03.612057+0000","last_peered":"2024-09-12T02:29:03.612057+0000","last_clean":"2024-09-12T02:29:03.612057+0000","last_became_active":"2024-09-12T02:29:02.611562+0000","last_became_peered":"2024-09-12T02:29:02.611562+0000","last_unstale":"2024-09-12T02:29:03.612057+0000","last_undegraded":"2024-09-12T02:29:03.612057+0000","last_fullsized":"2024-09-12T02:29:03.612057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614312+0000","last_change":"2024-09-12T02:29:01.598396+0000","last_active":"2024-09-12T02:29:03.614312+0000","last_peered":"2024-09-12T02:29:03.614312+0000","last_clean":"2024-09-12T02:29:03.614312+0000","last_became_active":"2024-09-12T02:29:01.598101+0000","last_became_peered":"2024-09-12T02:29:01.598101+0000","last_unstale":"2024-09-12T02:29:03.614312+0000","last_undegraded":"2024-09-12T02:29:03.614312+0000","last_fullsized":"2024-09-12T02:29:03.614312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:54.692329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612932+0000","last_change":"2024-09-12T02:29:02.611150+0000","last_active":"2024-09-12T02:29:03.612932+0000","last_peered":"2024-09-12T02:29:03.612932+0000","last_clean":"2024-09-12T02:29:03.612932+0000","last_became_active":"2024-09-12T02:29:02.610804+0000","last_became_peered":"2024-09-12T02:29:02.610804+0000","last_unstale":"2024-09-12T02:29:03.612932+0000","last_undegraded":"2024-09-12T02:29:03.612932+0000","last_fullsized":"2024-09-12T02:29:03.612932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:33.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612234+0000","last_change":"2024-09-12T02:29:01.603466+0000","last_active":"2024-09-12T02:29:03.612234+0000","last_peered":"2024-09-12T02:29:03.612234+0000","last_clean":"2024-09-12T02:29:03.612234+0000","last_became_active":"2024-09-12T02:29:01.603162+0000","last_became_peered":"2024-09-12T02:29:01.603162+0000","last_unstale":"2024-09-12T02:29:03.612234+0000","last_undegraded":"2024-09-12T02:29:03.612234+0000","last_fullsized":"2024-09-12T02:29:03.612234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.860337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612128+0000","last_change":"2024-09-12T02:29:02.615106+0000","last_active":"2024-09-12T02:29:03.612128+0000","last_peered":"2024-09-12T02:29:03.612128+0000","last_clean":"2024-09-12T02:29:03.612128+0000","last_became_active":"2024-09-12T02:29:02.614701+0000","last_became_peered":"2024-09-12T02:29:02.614701+0000","last_unstale":"2024-09-12T02:29:03.612128+0000","last_undegraded":"2024-09-12T02:29:03.612128+0000","last_fullsized":"2024-09-12T02:29:03.612128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:35.383898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614102+0000","last_change":"2024-09-12T02:29:01.602856+0000","last_active":"2024-09-12T02:29:03.614102+0000","last_peered":"2024-09-12T02:29:03.614102+0000","last_clean":"2024-09-12T02:29:03.614102+0000","last_became_active":"2024-09-12T02:29:01.602602+0000","last_became_peered":"2024-09-12T02:29:01.602602+0000","last_unstale":"2024-09-12T02:29:03.614102+0000","last_undegraded":"2024-09-12T02:29:03.614102+0000","last_fullsized":"2024-09-12T02:29:03.614102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:31.966303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922569+0000","last_change":"2024-09-12T02:29:02.621590+0000","last_active":"2024-09-12T02:29:03.922569+0000","last_peered":"2024-09-12T02:29:03.922569+0000","last_clean":"2024-09-12T02:29:03.922569+0000","last_became_active":"2024-09-12T02:29:02.621319+0000","last_became_peered":"2024-09-12T02:29:02.621319+0000","last_unstale":"2024-09-12T02:29:03.922569+0000","last_undegraded":"2024-09-12T02:29:03.922569+0000","last_fullsized":"2024-09-12T02:29:03.922569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:24.857450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614303+0000","last_change":"2024-09-12T02:29:01.602771+0000","last_active":"2024-09-12T02:29:03.614303+0000","last_peered":"2024-09-12T02:29:03.614303+0000","last_clean":"2024-09-12T02:29:03.614303+0000","last_became_active":"2024-09-12T02:29:01.602503+0000","last_became_peered":"2024-09-12T02:29:01.602503+0000","last_unstale":"2024-09-12T02:29:03.614303+0000","last_undegraded":"2024-09-12T02:29:03.614303+0000","last_fullsized":"2024-09-12T02:29:03.614303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:25.395144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.614103+0000","last_change":"2024-09-12T02:29:02.618017+0000","last_active":"2024-09-12T02:29:03.614103+0000","last_peered":"2024-09-12T02:29:03.614103+0000","last_clean":"2024-09-12T02:29:03.614103+0000","last_became_active":"2024-09-12T02:29:02.617733+0000","last_became_peered":"2024-09-12T02:29:02.617733+0000","last_unstale":"2024-09-12T02:29:03.614103+0000","last_undegraded":"2024-09-12T02:29:03.614103+0000","last_fullsized":"2024-09-12T02:29:03.614103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:16.254535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.922750+0000","last_change":"2024-09-12T02:29:01.597751+0000","last_active":"2024-09-12T02:29:03.922750+0000","last_peered":"2024-09-12T02:29:03.922750+0000","last_clean":"2024-09-12T02:29:03.922750+0000","last_became_active":"2024-09-12T02:29:01.597513+0000","last_became_peered":"2024-09-12T02:29:01.597513+0000","last_unstale":"2024-09-12T02:29:03.922750+0000","last_undegraded":"2024-09-12T02:29:03.922750+0000","last_fullsized":"2024-09-12T02:29:03.922750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:50.607602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910788+0000","last_change":"2024-09-12T02:29:02.608831+0000","last_active":"2024-09-12T02:29:03.910788+0000","last_peered":"2024-09-12T02:29:03.910788+0000","last_clean":"2024-09-12T02:29:03.910788+0000","last_became_active":"2024-09-12T02:29:02.608580+0000","last_became_peered":"2024-09-12T02:29:02.608580+0000","last_unstale":"2024-09-12T02:29:03.910788+0000","last_undegraded":"2024-09-12T02:29:03.910788+0000","last_fullsized":"2024-09-12T02:29:03.910788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:01.578884+0000","last_clean_scrub_stamp":"2024-09-12T02:29:01.578884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:55.894691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.612988+0000","last_change":"2024-09-12T02:29:01.600549+0000","last_active":"2024-09-12T02:29:03.612988+0000","last_peered":"2024-09-12T02:29:03.612988+0000","last_clean":"2024-09-12T02:29:03.612988+0000","last_became_active":"2024-09-12T02:29:01.600196+0000","last_became_peered":"2024-09-12T02:29:01.600196+0000","last_unstale":"2024-09-12T02:29:03.612988+0000","last_undegraded":"2024-09-12T02:29:03.612988+0000","last_fullsized":"2024-09-12T02:29:03.612988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:00.573174+0000","last_clean_scrub_stamp":"2024-09-12T02:29:00.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.913597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.910720+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:03.910720+0000","last_peered":"2024-09-12T02:29:03.910720+0000","last_clean":"2024-09-12T02:29:03.910720+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:03.910720+0000","last_undegraded":"2024-09-12T02:29:03.910720+0000","last_fullsized":"2024-09-12T02:29:03.910720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":725617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":135775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":135831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":360448,"data_stored":135263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":136793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":725527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":136793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":135229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:10.202 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:29:10.202 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:29:10.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.343+0000 7f0cbd94b640 1 Processor -- start 2024-09-12T02:29:10.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.343+0000 7f0cbd94b640 1 -- start start 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.344+0000 7f0cbd94b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 0x7f0cb80d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.344+0000 7f0cbd94b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb80d3890 con 0x7f0cb80b69f0 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.344+0000 7f0cbd94b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb80d3b70 con 0x7f0cb80d33a0 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.344+0000 7f0cbd94b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb80c7ff0 con 0x7f0cb815e6b0 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.344+0000 7f0cb77fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0cb80b69f0 0x7f0cb80c8480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35140/0 (socket says 172.21.15.181:35140) 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.344+0000 7f0cb77fe640 1 -- 172.21.15.181:0/2158803318 learned_addr learned my addr 172.21.15.181:0/2158803318 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743545481 0 0) 0x7f0cb80d3890 con 0x7f0cb80b69f0 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 0x7f0cb80d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca0003520 con 0x7f0cb80b69f0 2024-09-12T02:29:10.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964934532 0 0) 0x7f0ca0003520 con 0x7f0cb80b69f0 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 msgr2=0x7f0cb80d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 0x7f0cb80d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 >> v1:172.21.15.204:6789/0 conn(0x7f0cb80d33a0 legacy=0x7f0cb80b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb80d3e50 con 0x7f0cb80b69f0 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f0cb00019f0 con 0x7f0cb80b69f0 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 >> v1:172.21.15.181:6789/0 conn(0x7f0cb80b69f0 legacy=0x7f0cb80c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 0x7f0ca0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0004d40 0x7f0ca00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb80c7ff0 con 0x7f0ca00039e0 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca000bb00 con 0x7f0ca0004d40 2024-09-12T02:29:10.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca000bd00 con 0x7f0cb815e6b0 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb77fe640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0004d40 0x7f0ca00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb67fc640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 0x7f0ca0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb6ffd640 1 -- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 msgr2=0x7f0ca0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb815e6b0 0x7f0ca0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb6ffd640 1 -- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0004d40 msgr2=0x7f0ca00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ca0004d40 0x7f0ca00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.345+0000 7f0cb6ffd640 1 -- 172.21.15.181:0/2158803318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca0003520 con 0x7f0ca00039e0 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.346+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009a90 tx=0x7f0ca0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf2521e68142858 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.346+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8036070 con 0x7f0ca00039e0 2024-09-12T02:29:10.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.346+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8031400 con 0x7f0ca00039e0 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.346+0000 7f0cb5ffb640 1 -- 172.21.15.181:0/2158803318 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8009690 con 0x7f0ca00039e0 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.347+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2158803318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 msgr2=0x7f0ca0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.347+0000 7f0cbd94b640 1 --2- 172.21.15.181:0/2158803318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0ca0003e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009a90 tx=0x7f0ca0005830 comp rx=0 tx=0).stop 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.347+0000 7f0cb77fe640 1 -- 172.21.15.181:0/2158803318 reap_dead start 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.347+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2158803318 shutdown_connections 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.347+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2158803318 >> 172.21.15.181:0/2158803318 conn(0x7f0cb80d1340 msgr2=0x7f0cb80d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.347+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2158803318 shutdown_connections 2024-09-12T02:29:10.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.347+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2158803318 wait complete. 2024-09-12T02:29:10.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.348+0000 7f0cbd94b640 1 Processor -- start 2024-09-12T02:29:10.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.348+0000 7f0cbd94b640 1 -- start start 2024-09-12T02:29:10.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cbd94b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0cb80cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cbd94b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb8157bf0 0x7f0cb81f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cbd94b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cb80c8380 0x7f0cb80c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cbd94b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb80cf740 con 0x7f0ca00039e0 2024-09-12T02:29:10.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cbd94b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb80cf5c0 con 0x7f0cb80c8380 2024-09-12T02:29:10.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cbd94b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb80d2e60 con 0x7f0cb8157bf0 2024-09-12T02:29:10.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0cb80cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0cb80cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51340/0 (socket says 172.21.15.181:51340) 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 -- 172.21.15.181:0/2880716672 learned_addr learned my addr 172.21.15.181:0/2880716672 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb67fc640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb8157bf0 0x7f0cb81f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb77fe640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cb80c8380 0x7f0cb80c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 -- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb8157bf0 msgr2=0x7f0cb81f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb8157bf0 0x7f0cb81f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 -- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cb80c8380 msgr2=0x7f0cb80c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cb80c8380 0x7f0cb80c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 -- 172.21.15.181:0/2880716672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb80cd790 con 0x7f0ca00039e0 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.349+0000 7f0cb6ffd640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0cb80cb7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009a90 tx=0x7f0ca8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.350+0000 7f0c9ffff640 1 -- 172.21.15.181:0/2880716672 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8040020 con 0x7f0ca00039e0 2024-09-12T02:29:10.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.350+0000 7f0c9ffff640 1 -- 172.21.15.181:0/2880716672 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8003bc0 con 0x7f0ca00039e0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.350+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb80cbff0 con 0x7f0ca00039e0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.350+0000 7f0c9ffff640 1 -- 172.21.15.181:0/2880716672 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8036040 con 0x7f0ca00039e0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.350+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb80cda10 con 0x7f0ca00039e0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.351+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb80ce130 con 0x7f0ca00039e0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.351+0000 7f0c9ffff640 1 -- 172.21.15.181:0/2880716672 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ca8043020 con 0x7f0ca00039e0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.352+0000 7f0c9ffff640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ca406be30 0x7f0ca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.352+0000 7f0cb67fc640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ca406be30 0x7f0ca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.352+0000 7f0c9ffff640 1 -- 172.21.15.181:0/2880716672 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0ca80aae70 con 0x7f0ca00039e0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.352+0000 7f0cb67fc640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ca406be30 0x7f0ca406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80c7b00 tx=0x7f0cac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.356+0000 7f0c9ffff640 1 -- 172.21.15.181:0/2880716672 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ca804a070 con 0x7f0ca00039e0 2024-09-12T02:29:10.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.587+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0cb80b62e0 con 0x7f0ca00039e0 2024-09-12T02:29:10.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.589+0000 7f0c9ffff640 1 -- 172.21.15.181:0/2880716672 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f0cb80cd790 con 0x7f0ca00039e0 2024-09-12T02:29:10.590 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-12T02:29:10.590 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg== 2024-09-12T02:29:10.590 INFO:teuthology.orchestra.run.smithi181.stdout: caps mds = "allow" 2024-09-12T02:29:10.590 INFO:teuthology.orchestra.run.smithi181.stdout: caps mon = "allow r" 2024-09-12T02:29:10.590 INFO:teuthology.orchestra.run.smithi181.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:29:10.590 INFO:teuthology.orchestra.run.smithi181.stderr:updated caps for client.0 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ca406be30 msgr2=0x7f0ca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ca406be30 0x7f0ca406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80c7b00 tx=0x7f0cac009040 comp rx=0 tx=0).stop 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 msgr2=0x7f0cb80cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0cb80cb7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009a90 tx=0x7f0ca8004730 comp rx=0 tx=0).stop 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 shutdown_connections 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ca406be30 0x7f0ca406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cb80c8380 0x7f0cb80c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cb8157bf0 0x7f0cb81f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 --2- 172.21.15.181:0/2880716672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ca00039e0 0x7f0cb80cb7a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 >> 172.21.15.181:0/2880716672 conn(0x7f0cb80d1340 msgr2=0x7f0cb80c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 shutdown_connections 2024-09-12T02:29:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.592+0000 7f0cbd94b640 1 -- 172.21.15.181:0/2880716672 wait complete. 2024-09-12T02:29:10.604 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.704+0000 7f4d88065640 1 Processor -- start 2024-09-12T02:29:10.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.704+0000 7f4d88065640 1 -- start start 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d88065640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 0x7f4d800ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d88065640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8015ea20 con 0x7f4d800d3660 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d88065640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d800b1c50 con 0x7f4d800cf0e0 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d88065640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d800b2860 con 0x7f4d8015e640 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d86602640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4d800d3660 0x7f4d800b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35154/0 (socket says 172.21.15.181:35154) 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d86602640 1 -- 172.21.15.181:0/4022980098 learned_addr learned my addr 172.21.15.181:0/4022980098 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d85e01640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 0x7f4d800ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034426443 0 0) 0x7f4d8015ea20 con 0x7f4d800d3660 2024-09-12T02:29:10.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.705+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d64003520 con 0x7f4d800d3660 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420441347 0 0) 0x7f4d800b1c50 con 0x7f4d800cf0e0 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d8015ea20 con 0x7f4d800cf0e0 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2186359855 0 0) 0x7f4d64003520 con 0x7f4d800d3660 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 msgr2=0x7f4d800ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 0x7f4d800ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 >> v1:172.21.15.204:6789/0 conn(0x7f4d800cf0e0 legacy=0x7f4d800b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d800b1f30 con 0x7f4d800d3660 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f4d700019f0 con 0x7f4d800d3660 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85e01640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 0x7f4d800ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 >> v1:172.21.15.181:6789/0 conn(0x7f4d800d3660 legacy=0x7f4d800b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64003b70 0x7f4d64003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d64004800 0x7f4d64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 0x7f4d64005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d800b2860 con 0x7f4d64004800 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6400bb50 con 0x7f4d64003b70 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6400bd20 con 0x7f4d8015e640 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85600640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d64004800 0x7f4d64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d86602640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 0x7f4d64005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85e01640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64003b70 0x7f4d64003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85600640 1 -- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 msgr2=0x7f4d64005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85600640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d8015e640 0x7f4d64005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85600640 1 -- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64003b70 msgr2=0x7f4d64003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85600640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64003b70 0x7f4d64003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.706+0000 7f4d85600640 1 -- 172.21.15.181:0/4022980098 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d64003520 con 0x7f4d64004800 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.707+0000 7f4d85600640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d64004800 0x7f4d64004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4d8015ebf0 tx=0x7f4d64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13d805e547a8be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.707+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c001500 con 0x7f4d64004800 2024-09-12T02:29:10.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.707+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6c0052d0 con 0x7f4d64004800 2024-09-12T02:29:10.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.707+0000 7f4d84dff640 1 -- 172.21.15.181:0/4022980098 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c02ac40 con 0x7f4d64004800 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.708+0000 7f4d88065640 1 -- 172.21.15.181:0/4022980098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d64004800 msgr2=0x7f4d64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.708+0000 7f4d88065640 1 --2- 172.21.15.181:0/4022980098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d64004800 0x7f4d64004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4d8015ebf0 tx=0x7f4d64005830 comp rx=0 tx=0).stop 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.708+0000 7f4d86602640 1 -- 172.21.15.181:0/4022980098 reap_dead start 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.708+0000 7f4d88065640 1 -- 172.21.15.181:0/4022980098 shutdown_connections 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.708+0000 7f4d88065640 1 -- 172.21.15.181:0/4022980098 >> 172.21.15.181:0/4022980098 conn(0x7f4d8009d820 msgr2=0x7f4d800d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.708+0000 7f4d88065640 1 -- 172.21.15.181:0/4022980098 shutdown_connections 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.708+0000 7f4d88065640 1 -- 172.21.15.181:0/4022980098 wait complete. 2024-09-12T02:29:10.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.709+0000 7f4d88065640 1 Processor -- start 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.709+0000 7f4d88065640 1 -- start start 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d88065640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64004800 0x7f4d8015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d88065640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d800cadc0 0x7f4d801604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d88065640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d8014b8d0 0x7f4d8015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d88065640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d800cfe40 con 0x7f4d8014b8d0 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d88065640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4d800b24f0 con 0x7f4d64004800 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d88065640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d800b73a0 con 0x7f4d800cadc0 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d8014b8d0 0x7f4d8015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d8014b8d0 0x7f4d8015cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51360/0 (socket says 172.21.15.181:51360) 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 -- 172.21.15.181:0/238531886 learned_addr learned my addr 172.21.15.181:0/238531886 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d85e01640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64004800 0x7f4d8015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d85600640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d800cadc0 0x7f4d801604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 -- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d800cadc0 msgr2=0x7f4d801604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d800cadc0 0x7f4d801604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 -- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64004800 msgr2=0x7f4d8015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64004800 0x7f4d8015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 -- 172.21.15.181:0/238531886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8015f420 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d85600640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d800cadc0 0x7f4d801604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d86602640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d8014b8d0 0x7f4d8015cd20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d8008d6c0 tx=0x7f4d70007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d7e7fc640 1 -- 172.21.15.181:0/238531886 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000ab30 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.710+0000 7f4d7e7fc640 1 -- 172.21.15.181:0/238531886 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d70019070 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.711+0000 7f4d7e7fc640 1 -- 172.21.15.181:0/238531886 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d700133f0 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.711+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8015f700 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.711+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8015fcc0 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.712+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d80068eb0 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.712+0000 7f4d7e7fc640 1 -- 172.21.15.181:0/238531886 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d70013590 con 0x7f4d8014b8d0 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.712+0000 7f4d7e7fc640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d6806be30 0x7f4d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.713+0000 7f4d7e7fc640 1 -- 172.21.15.181:0/238531886 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4d7008b310 con 0x7f4d8014b8d0 2024-09-12T02:29:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.713+0000 7f4d85e01640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d6806be30 0x7f4d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.713+0000 7f4d85e01640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d6806be30 0x7f4d6806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d800d14e0 tx=0x7f4d78009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.717+0000 7f4d7e7fc640 1 -- 172.21.15.181:0/238531886 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d70059cc0 con 0x7f4d8014b8d0 2024-09-12T02:29:10.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.915+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d800ceba0 con 0x7f4d8014b8d0 2024-09-12T02:29:10.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.916+0000 7f4d7e7fc640 1 -- 172.21.15.181:0/238531886 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5234 (secure 0 0 0) 0x7f4d700595c0 con 0x7f4d8014b8d0 2024-09-12T02:29:10.917 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:10.917 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":13,"btime":"2024-09-12T02:29:04:610592+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:03.940253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4756":{"gid":4756,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2347584783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2347584783},{"type":"v1","addr":"172.21.15.204:6835","nonce":2347584783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4756,"qdb_cluster":[4756]},"id":2}]} 2024-09-12T02:29:10.917 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 13 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d6806be30 msgr2=0x7f4d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d6806be30 0x7f4d6806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d800d14e0 tx=0x7f4d78009190 comp rx=0 tx=0).stop 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d8014b8d0 msgr2=0x7f4d8015cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d8014b8d0 0x7f4d8015cd20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d8008d6c0 tx=0x7f4d70007b00 comp rx=0 tx=0).stop 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 shutdown_connections 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d6806be30 0x7f4d6806e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d8014b8d0 0x7f4d8015cd20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d800cadc0 0x7f4d801604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 --2- 172.21.15.181:0/238531886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d64004800 0x7f4d8015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 >> 172.21.15.181:0/238531886 conn(0x7f4d8009d820 msgr2=0x7f4d800cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 shutdown_connections 2024-09-12T02:29:10.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:10.918+0000 7f4d88065640 1 -- 172.21.15.181:0/238531886 wait complete. 2024-09-12T02:29:11.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:01.922105+0000', 'modified': '2024-09-12T02:29:03.940253+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4756': {'gid': 4756, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6835/2347584783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6833', 'nonce': 2347584783}, {'type': 'v1', 'addr': '172.21.15.204:6835', 'nonce': 2347584783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4756, 'qdb_cluster': [4756]} 2024-09-12T02:29:11.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:29:11.334 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:29:11.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.436+0000 7f3541968640 1 Processor -- start 2024-09-12T02:29:11.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.436+0000 7f3541968640 1 -- start start 2024-09-12T02:29:11.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f3541968640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 0x7f353c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f3541968640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c15ea20 con 0x7f353c0d3660 2024-09-12T02:29:11.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f3541968640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c0b1c50 con 0x7f353c0cf0e0 2024-09-12T02:29:11.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f3541968640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f353c0b2860 con 0x7f353c15e640 2024-09-12T02:29:11.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f353b7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f353c0d3660 0x7f353c0b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35162/0 (socket says 172.21.15.181:35162) 2024-09-12T02:29:11.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f353b7fe640 1 -- 172.21.15.181:0/2704221570 learned_addr learned my addr 172.21.15.181:0/2704221570 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:11.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f353affd640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 0x7f353c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244565229 0 0) 0x7f353c15ea20 con 0x7f353c0d3660 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.437+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3528003520 con 0x7f353c0d3660 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3253105248 0 0) 0x7f3528003520 con 0x7f353c0d3660 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 msgr2=0x7f353c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 0x7f353c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 >> v1:172.21.15.204:6789/0 conn(0x7f353c0cf0e0 legacy=0x7f353c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c0b1f30 con 0x7f353c0d3660 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f3534001670 con 0x7f353c0d3660 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 >> v1:172.21.15.181:6789/0 conn(0x7f353c0d3660 legacy=0x7f353c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 0x7f35280039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528003f20 0x7f3528004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3528004d40 0x7f35280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0b2860 con 0x7f3528004d40 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f352800bb80 con 0x7f3528003f20 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f352800bd80 con 0x7f353c15e640 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353affd640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 0x7f35280039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528003f20 0x7f3528004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3528004d40 0x7f35280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353b7fe640 1 -- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 msgr2=0x7f35280039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c15e640 0x7f35280039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353b7fe640 1 -- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528003f20 msgr2=0x7f3528004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528003f20 0x7f3528004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.438+0000 7f353b7fe640 1 -- 172.21.15.181:0/2704221570 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3528003520 con 0x7f3528004d40 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3528004d40 0x7f35280051c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f353400c240 tx=0x7f3528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56300a5dff32782d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534007d30 con 0x7f3528004d40 2024-09-12T02:29:11.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3534005af0 con 0x7f3528004d40 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3539ffb640 1 -- 172.21.15.181:0/2704221570 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534007070 con 0x7f3528004d40 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3541968640 1 -- 172.21.15.181:0/2704221570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3528004d40 msgr2=0x7f35280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3541968640 1 --2- 172.21.15.181:0/2704221570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3528004d40 0x7f35280051c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f353400c240 tx=0x7f3528005830 comp rx=0 tx=0).stop 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f353b7fe640 1 -- 172.21.15.181:0/2704221570 reap_dead start 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3541968640 1 -- 172.21.15.181:0/2704221570 shutdown_connections 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3541968640 1 -- 172.21.15.181:0/2704221570 >> 172.21.15.181:0/2704221570 conn(0x7f353c09d820 msgr2=0x7f353c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.439+0000 7f3541968640 1 -- 172.21.15.181:0/2704221570 shutdown_connections 2024-09-12T02:29:11.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.440+0000 7f3541968640 1 -- 172.21.15.181:0/2704221570 wait complete. 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.441+0000 7f3541968640 1 Processor -- start 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.441+0000 7f3541968640 1 -- start start 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.441+0000 7f3541968640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528004d40 0x7f353c0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3541968640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c1615e0 0x7f353c0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3541968640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353c0ce0d0 0x7f353c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3541968640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0cfe40 con 0x7f353c0ce0d0 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3541968640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0b24f0 con 0x7f3528004d40 2024-09-12T02:29:11.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3541968640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f353c0b73a0 con 0x7f353c1615e0 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353c0ce0d0 0x7f353c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353c0ce0d0 0x7f353c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51378/0 (socket says 172.21.15.181:51378) 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 -- 172.21.15.181:0/2952682766 learned_addr learned my addr 172.21.15.181:0/2952682766 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353affd640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528004d40 0x7f353c0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c1615e0 0x7f353c0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 -- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c1615e0 msgr2=0x7f353c0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c1615e0 0x7f353c0cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 -- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528004d40 msgr2=0x7f353c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528004d40 0x7f353c0cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 -- 172.21.15.181:0/2952682766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c0cc0d0 con 0x7f353c0ce0d0 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353c0ce0d0 0x7f353c06c990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f353400c360 tx=0x7f353c0b1e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3533fff640 1 -- 172.21.15.181:0/2952682766 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534043020 con 0x7f353c0ce0d0 2024-09-12T02:29:11.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3533fff640 1 -- 172.21.15.181:0/2952682766 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3534007070 con 0x7f353c0ce0d0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c0cc3b0 con 0x7f353c0ce0d0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3533fff640 1 -- 172.21.15.181:0/2952682766 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534007d30 con 0x7f353c0ce0d0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.442+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c0cc970 con 0x7f353c0ce0d0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.444+0000 7f3533fff640 1 -- 172.21.15.181:0/2952682766 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3534046070 con 0x7f353c0ce0d0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.444+0000 7f3533fff640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f351c06be30 0x7f351c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.444+0000 7f3533fff640 1 -- 172.21.15.181:0/2952682766 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f35340aa360 con 0x7f353c0ce0d0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.444+0000 7f353affd640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f351c06be30 0x7f351c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.445+0000 7f353affd640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f351c06be30 0x7f351c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f352c014510 tx=0x7f352c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.445+0000 7f35447da740 1 Processor -- start 2024-09-12T02:29:11.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.445+0000 7f35447da740 1 -- start start 2024-09-12T02:29:11.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b909b2c0 0x5559b90e0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f35447da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b9098a80 0x5559b909b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f35447da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559b8ffd520 con 0x5559b9098a80 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5559b8fa53e0 con 0x5559b909ca50 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5559b8ff94e0 con 0x5559b909b2c0 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f353a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b9098a80 0x5559b909b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f353a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b9098a80 0x5559b909b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51380/0 (socket says 172.21.15.181:51380) 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f353a7fc640 1 -- 172.21.15.181:0/2380160496 learned_addr learned my addr 172.21.15.181:0/2380160496 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f353affd640 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b909b2c0 0x5559b90e0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.446+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353a7fc640 1 -- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b909b2c0 msgr2=0x5559b90e0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b909b2c0 0x5559b90e0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353a7fc640 1 -- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 msgr2=0x5559b90958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353a7fc640 1 -- 172.21.15.181:0/2380160496 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b8fc02f0 con 0x5559b9098a80 2024-09-12T02:29:11.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353b7fe640 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353affd640 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b909b2c0 0x5559b90e0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b9098a80 0x5559b909b6a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3524001950 tx=0x7f3524001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f625797c54a6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f35317fa640 1 -- 172.21.15.181:0/2380160496 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352401a030 con 0x5559b9098a80 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f35317fa640 1 -- 172.21.15.181:0/2380160496 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35240052e0 con 0x5559b9098a80 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f35317fa640 1 -- 172.21.15.181:0/2380160496 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524005490 con 0x5559b9098a80 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f35447da740 1 -- 172.21.15.181:0/2380160496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b9098a80 msgr2=0x5559b909b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.447+0000 7f35447da740 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b9098a80 0x5559b909b6a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3524001950 tx=0x7f3524001e10 comp rx=0 tx=0).stop 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 -- 172.21.15.181:0/2380160496 shutdown_connections 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b9098a80 0x5559b909b6a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 --2- 172.21.15.181:0/2380160496 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b909b2c0 0x5559b90e0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 -- 172.21.15.181:0/2380160496 >> 172.21.15.181:0/2380160496 conn(0x5559b9097a80 msgr2=0x5559b90dff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 -- 172.21.15.181:0/2380160496 shutdown_connections 2024-09-12T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 -- 172.21.15.181:0/2380160496 wait complete. 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 -- start start 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.448+0000 7f35447da740 1 Processor -- start 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f35447da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90bb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90de590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f35447da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559b9096f20 con 0x5559b909b2c0 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5559b8f86450 con 0x5559b909ca50 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5559b90e1290 con 0x5559b90962e0 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f35447da740 10 client.0 _ll_register_callbacks cb 0x5559b8d0fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51382/0 (socket says 172.21.15.181:51382) 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 -- 172.21.15.181:0/358056047 learned_addr learned my addr 172.21.15.181:0/358056047 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:11.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 -- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 msgr2=0x5559b90de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 -- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 msgr2=0x5559b90bb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90bb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 -- 172.21.15.181:0/358056047 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b8d102d0 con 0x5559b909b2c0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.449+0000 7f353affd640 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90c4610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f352c016e70 tx=0x7f352c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883d10eea15347bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f351a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f351a7fc640 1 -- 172.21.15.181:0/358056047 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c02d680 con 0x5559b909b2c0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f351a7fc640 1 -- 172.21.15.181:0/358056047 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f352c02d820 con 0x5559b909b2c0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35240052e0 con 0x5559b909b2c0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f351a7fc640 1 -- 172.21.15.181:0/358056047 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f352c02da20 con 0x5559b909b2c0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 10 client.5031 fetch_fsmap learned FSMap version 13 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5559b8dda6b0 con 0x5559b909b2c0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f351a7fc640 1 -- 172.21.15.181:0/358056047 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35240052e0 con 0x5559b909b2c0 2024-09-12T02:29:11.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f351a7fc640 1 -- 172.21.15.181:0/358056047 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f352c02dbc0 con 0x5559b909b2c0 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 10 client.5031 fetch_fsmap finished waiting for FSMap version 13 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 10 client.5031 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 20 client.5031 populate_metadata read hostname 'smithi181' 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b90fbf50 0x5559b90fe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 4 client.5031 mds_command: new command op to 4756 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 --> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559b900ac50 con 0x5559b90fbf50 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.450+0000 7f353a7fc640 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b90fbf50 0x5559b90fe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.451+0000 7f353a7fc640 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b90fbf50 0x5559b90fe340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654d7b5b6e872b1b server_cookie=eab95fc2b599f8a0 in_seq=0 out_seq=0 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.451+0000 7f351a7fc640 10 client.5031 ms_handle_connect on v2:172.21.15.204:6833/2347584783 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f351a7fc640 1 -- 172.21.15.181:0/358056047 <== mds.0 v2:172.21.15.204:6833/2347584783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559b900ac50 con 0x5559b90fbf50 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f351a7fc640 10 client.5031 handle_command_reply: tid=0 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 client.5031 shutdown 2024-09-12T02:29:11.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 msgr2=0x5559b90c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90c4610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f352c016e70 tx=0x7f352c004ab0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 shutdown_connections 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b90fbf50 0x5559b90fe340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90bb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f351a7fc640 0 client.5031 ms_handle_reset on v2:172.21.15.204:6833/2347584783 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 --2- 172.21.15.181:0/358056047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90c4610 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 >> 172.21.15.181:0/358056047 conn(0x5559b9098a80 msgr2=0x5559b90e3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 shutdown_connections 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 1 -- 172.21.15.181:0/358056047 wait complete. 2024-09-12T02:29:11.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.452+0000 7f35447da740 20 client.5031 trim_cache size 0 max 16384 2024-09-12T02:29:11.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.469+0000 7f35447da740 1 Processor -- start 2024-09-12T02:29:11.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.469+0000 7f35447da740 1 -- start start 2024-09-12T02:29:11.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f35447da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90b9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f35447da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f353c1ffef0 con 0x5559b909b2c0 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f353c1f6360 con 0x5559b909ca50 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f353c1ff8a0 con 0x5559b90962e0 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f353a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f353a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90b9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51396/0 (socket says 172.21.15.181:51396) 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.470+0000 7f353a7fc640 1 -- 172.21.15.181:0/2151155069 learned_addr learned my addr 172.21.15.181:0/2151155069 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f353a7fc640 1 -- 172.21.15.181:0/2151155069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 msgr2=0x5559b90b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2151155069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f353a7fc640 1 -- 172.21.15.181:0/2151155069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 msgr2=0x5559b90c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2151155069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f353a7fc640 1 -- 172.21.15.181:0/2151155069 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b90918b0 con 0x5559b909b2c0 2024-09-12T02:29:11.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f353a7fc640 1 --2- 172.21.15.181:0/2151155069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90b9450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3524007000 tx=0x7f3524015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7236a9f2fcf8bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f3530ff9640 1 -- 172.21.15.181:0/2151155069 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524012a20 con 0x5559b909b2c0 2024-09-12T02:29:11.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f3530ff9640 1 -- 172.21.15.181:0/2151155069 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524012be0 con 0x5559b909b2c0 2024-09-12T02:29:11.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f3530ff9640 1 -- 172.21.15.181:0/2151155069 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35240067d0 con 0x5559b909b2c0 2024-09-12T02:29:11.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f35447da740 1 -- 172.21.15.181:0/2151155069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 msgr2=0x5559b90b9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.471+0000 7f35447da740 1 --2- 172.21.15.181:0/2151155069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90b9450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3524007000 tx=0x7f3524015000 comp rx=0 tx=0).stop 2024-09-12T02:29:11.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 -- 172.21.15.181:0/2151155069 shutdown_connections 2024-09-12T02:29:11.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 --2- 172.21.15.181:0/2151155069 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909ca50 0x5559b90c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 --2- 172.21.15.181:0/2151155069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909b2c0 0x5559b90b9450 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 --2- 172.21.15.181:0/2151155069 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 -- 172.21.15.181:0/2151155069 >> 172.21.15.181:0/2151155069 conn(0x5559b9098a80 msgr2=0x5559b9090ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 -- 172.21.15.181:0/2151155069 shutdown_connections 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 -- 172.21.15.181:0/2151155069 wait complete. 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 -- start start 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.472+0000 7f35447da740 1 Processor -- start 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f35447da740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909b2c0 0x5559b9099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f35447da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909ca50 0x5559b9161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f35447da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559b90ba290 con 0x5559b909ca50 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5559b90deeb0 con 0x5559b909b2c0 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f35447da740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5559b9094da0 con 0x5559b90962e0 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f35447da740 10 client.0 _ll_register_callbacks cb 0x7f352c01a050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909ca50 0x5559b9161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909ca50 0x5559b9161c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51404/0 (socket says 172.21.15.181:51404) 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 -- 172.21.15.181:0/3204074150 learned_addr learned my addr 172.21.15.181:0/3204074150 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:11.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353a7fc640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909b2c0 0x5559b9099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353affd640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 -- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 msgr2=0x5559b90c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 -- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909b2c0 msgr2=0x5559b9099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909b2c0 0x5559b9099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 -- 172.21.15.181:0/3204074150 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b90e38d0 con 0x5559b909ca50 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353affd640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f353b7fe640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909ca50 0x5559b9161c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3534078650 tx=0x7f3534078020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fcc3f94759ace1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.473+0000 7f351a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f351a7fc640 1 -- 172.21.15.181:0/3204074150 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353407c9c0 con 0x5559b909ca50 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f351a7fc640 1 -- 172.21.15.181:0/3204074150 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3534080d60 con 0x5559b909ca50 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3524012be0 con 0x5559b909ca50 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f351a7fc640 1 -- 172.21.15.181:0/3204074150 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f35340811f0 con 0x5559b909ca50 2024-09-12T02:29:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 10 client.5037 fetch_fsmap learned FSMap version 13 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5559b90c15a0 con 0x5559b909ca50 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f351a7fc640 1 -- 172.21.15.181:0/3204074150 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524012be0 con 0x5559b909ca50 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f351a7fc640 1 -- 172.21.15.181:0/3204074150 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f353407db50 con 0x5559b909ca50 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 10 client.5037 fetch_fsmap finished waiting for FSMap version 13 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 10 client.5037 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 20 client.5037 populate_metadata read hostname 'smithi181' 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b9162500 0x5559b915e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 4 client.5037 mds_command: new command op to 4756 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 --> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] -- command(tid 0: {"prefix": "status"}) -- 0x5559b9004fa0 con 0x5559b9162500 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.474+0000 7f353affd640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b9162500 0x5559b915e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f351a7fc640 10 client.5037 ms_handle_connect on v2:172.21.15.204:6833/2347584783 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f353affd640 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b9162500 0x5559b915e4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2506f496432c1ea3 server_cookie=ecd06a561aac83e8 in_seq=0 out_seq=0 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f351a7fc640 1 -- 172.21.15.181:0/3204074150 <== mds.0 v2:172.21.15.204:6833/2347584783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5559b9004fa0 con 0x5559b9162500 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f351a7fc640 10 client.5037 handle_command_reply: tid=0 2024-09-12T02:29:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 client.5037 shutdown 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909ca50 msgr2=0x5559b9161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909ca50 0x5559b9161c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3534078650 tx=0x7f3534078020 comp rx=0 tx=0).stop 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 shutdown_connections 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:6833/2347584783,v1:172.21.15.204:6835/2347584783] conn(0x5559b9162500 0x5559b915e4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559b909b2c0 0x5559b9099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f351a7fc640 0 client.5037 ms_handle_reset on v2:172.21.15.204:6833/2347584783 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559b909ca50 0x5559b9161c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 --2- 172.21.15.181:0/3204074150 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559b90962e0 0x5559b90c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 >> 172.21.15.181:0/3204074150 conn(0x5559b9098a80 msgr2=0x5559b90b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 shutdown_connections 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 1 -- 172.21.15.181:0/3204074150 wait complete. 2024-09-12T02:29:11.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.475+0000 7f35447da740 20 client.5037 trim_cache size 0 max 16384 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 4756, 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 8.8688125069999995, 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 13, 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 32, 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 32, 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 15.765982349 2024-09-12T02:29:11.482 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:29:11.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f351c06be30 msgr2=0x7f351c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f351c06be30 0x7f351c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f352c014510 tx=0x7f352c00b040 comp rx=0 tx=0).stop 2024-09-12T02:29:11.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353c0ce0d0 msgr2=0x7f353c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353c0ce0d0 0x7f353c06c990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f353400c360 tx=0x7f353c0b1e20 comp rx=0 tx=0).stop 2024-09-12T02:29:11.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 shutdown_connections 2024-09-12T02:29:11.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f351c06be30 0x7f351c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353c0ce0d0 0x7f353c06c990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f353c1615e0 0x7f353c0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 --2- 172.21.15.181:0/2952682766 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3528004d40 0x7f353c0cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 >> 172.21.15.181:0/2952682766 conn(0x7f353c09d820 msgr2=0x7f353c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 shutdown_connections 2024-09-12T02:29:11.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.476+0000 7f3541968640 1 -- 172.21.15.181:0/2952682766 wait complete. 2024-09-12T02:29:11.487 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:29:11.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.585+0000 7fed39447640 1 Processor -- start 2024-09-12T02:29:11.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.585+0000 7fed39447640 1 -- start start 2024-09-12T02:29:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed39447640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fed340afc70 0x7fed3415f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed39447640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340cf200 0x7fed340cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed39447640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed340ce430 con 0x7fed340ce020 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed39447640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fed3415f950 con 0x7fed340afc70 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed39447640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fed340cf780 con 0x7fed340cf200 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed337fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fed340ce020 0x7fed34154c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35166/0 (socket says 172.21.15.181:35166) 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed337fe640 1 -- 172.21.15.181:0/3187660773 learned_addr learned my addr 172.21.15.181:0/3187660773 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed327fc640 1 --2- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340cf200 0x7fed340cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.586+0000 7fed32ffd640 1 --2- 172.21.15.181:0/3187660773 >> v2:172.21.15.204:3300/0 conn(0x7fed340afc70 0x7fed3415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.587+0000 7fed31ffb640 1 -- 172.21.15.181:0/3187660773 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555139671 0 0) 0x7fed2c001490 con 0x7fed340ce020 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.587+0000 7fed31ffb640 1 -- 172.21.15.181:0/3187660773 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed1c003520 con 0x7fed340ce020 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.587+0000 7fed32ffd640 1 -- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340cf200 msgr2=0x7fed340cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.587+0000 7fed32ffd640 1 --2- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340cf200 0x7fed340cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.587+0000 7fed32ffd640 1 -- 172.21.15.181:0/3187660773 >> v1:172.21.15.181:6789/0 conn(0x7fed340ce020 legacy=0x7fed34154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.587+0000 7fed32ffd640 1 -- 172.21.15.181:0/3187660773 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed340cfa60 con 0x7fed340afc70 2024-09-12T02:29:11.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed32ffd640 1 --2- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340afc70 0x7fed3415f410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed240097a0 tx=0x7fed2402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90e308ae0f13ec75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed31ffb640 1 -- 172.21.15.181:0/3187660773 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed24037070 con 0x7fed340afc70 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed31ffb640 1 -- 172.21.15.181:0/3187660773 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed24032440 con 0x7fed340afc70 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed31ffb640 1 -- 172.21.15.181:0/3187660773 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed240327f0 con 0x7fed340afc70 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 -- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340afc70 msgr2=0x7fed3415f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 --2- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340afc70 0x7fed3415f410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed240097a0 tx=0x7fed2402a180 comp rx=0 tx=0).stop 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 -- 172.21.15.181:0/3187660773 shutdown_connections 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 --2- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340cf200 0x7fed340cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 --2- 172.21.15.181:0/3187660773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340afc70 0x7fed3415f410 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 -- 172.21.15.181:0/3187660773 >> 172.21.15.181:0/3187660773 conn(0x7fed340b1770 msgr2=0x7fed340b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 -- 172.21.15.181:0/3187660773 shutdown_connections 2024-09-12T02:29:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.588+0000 7fed39447640 1 -- 172.21.15.181:0/3187660773 wait complete. 2024-09-12T02:29:11.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 Processor -- start 2024-09-12T02:29:11.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 -- start start 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340afc70 0x7fed34154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed340ce020 0x7fed340aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340cf200 0x7fed341574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed340d0300 con 0x7fed340ce020 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fed340d0020 con 0x7fed340cf200 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed39447640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fed340b0050 con 0x7fed340afc70 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed327fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed340ce020 0x7fed340aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.590+0000 7fed327fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed340ce020 0x7fed340aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51416/0 (socket says 172.21.15.181:51416) 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed327fc640 1 -- 172.21.15.181:0/1831071624 learned_addr learned my addr 172.21.15.181:0/1831071624 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed337fe640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340cf200 0x7fed341574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed32ffd640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340afc70 0x7fed34154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed327fc640 1 -- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340afc70 msgr2=0x7fed34154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed327fc640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340afc70 0x7fed34154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed327fc640 1 -- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340cf200 msgr2=0x7fed341574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed327fc640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340cf200 0x7fed341574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed327fc640 1 -- 172.21.15.181:0/1831071624 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed340aba80 con 0x7fed340ce020 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed327fc640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed340ce020 0x7fed340aef20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e9e0 tx=0x7fed2800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed1b7fe640 1 -- 172.21.15.181:0/1831071624 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28017070 con 0x7fed340ce020 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed1b7fe640 1 -- 172.21.15.181:0/1831071624 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2800c9d0 con 0x7fed340ce020 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed340abd20 con 0x7fed340ce020 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed1b7fe640 1 -- 172.21.15.181:0/1831071624 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2800cdc0 con 0x7fed340ce020 2024-09-12T02:29:11.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.591+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed340ac2e0 con 0x7fed340ce020 2024-09-12T02:29:11.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.592+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed34158130 con 0x7fed340ce020 2024-09-12T02:29:11.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.593+0000 7fed1b7fe640 1 -- 172.21.15.181:0/1831071624 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed2801a070 con 0x7fed340ce020 2024-09-12T02:29:11.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.593+0000 7fed1b7fe640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fed2006be30 0x7fed2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.593+0000 7fed1b7fe640 1 -- 172.21.15.181:0/1831071624 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fed2808ade0 con 0x7fed340ce020 2024-09-12T02:29:11.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.593+0000 7fed32ffd640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fed2006be30 0x7fed2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.594+0000 7fed32ffd640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fed2006be30 0x7fed2006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed24034000 tx=0x7fed2402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.598+0000 7fed1b7fe640 1 -- 172.21.15.181:0/1831071624 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed28059140 con 0x7fed340ce020 2024-09-12T02:29:11.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.802+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fed340af460 con 0x7fed340ce020 2024-09-12T02:29:11.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.803+0000 7fed1b7fe640 1 -- 172.21.15.181:0/1831071624 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7fed2805d440 con 0x7fed340ce020 2024-09-12T02:29:11.804 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fed2006be30 msgr2=0x7fed2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fed2006be30 0x7fed2006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed24034000 tx=0x7fed2402e000 comp rx=0 tx=0).stop 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed340ce020 msgr2=0x7fed340aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed340ce020 0x7fed340aef20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e9e0 tx=0x7fed2800eea0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 shutdown_connections 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fed2006be30 0x7fed2006e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed340cf200 0x7fed341574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed340ce020 0x7fed340aef20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 --2- 172.21.15.181:0/1831071624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed340afc70 0x7fed34154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 >> 172.21.15.181:0/1831071624 conn(0x7fed340b1770 msgr2=0x7fed340b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 shutdown_connections 2024-09-12T02:29:11.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:11.805+0000 7fed39447640 1 -- 172.21.15.181:0/1831071624 wait complete. 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:29:11.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:29:11.818 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:11.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:11.818 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:29:11.833 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:29:11.833 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:29:11.834 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42691sec preferred_lft 42691sec 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:29:11.835 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:11.836 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:29:11.836 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:11.836 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:29:11.836 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:11.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:11.836 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:29:11.896 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:29:11.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:11.898 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:29:11.954 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:29:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:29:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:29:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:29:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:29:11.955 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:29:11.955 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:29:11.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:29:11.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:29:11.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:29:11.956 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:29:12.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:29:12.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:12.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:12.080 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:29:12.094 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:29:12.095 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:29:12.095 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:12.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:12.095 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:29:12.159 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:29:12.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:29:12.160 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:12.215 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:12.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:29:12.215 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:12.269 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:29:12.334 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:29:12.391 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:29:12.538 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:29:12.538 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:29:12.538 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:29:12.539 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:29:12.540 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:12.541 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:12.541 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:12.541 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:12.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:12.541 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:29:12.557 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:29:12.557 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:29:12.600 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:29:12.625 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:29:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:29:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:12.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:12.685 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:29:12.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:29:12.681+0000 7faa0bf21480 -1 init, newargv = 0x5634780d0a70 newargc=15 2024-09-12T02:29:12.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[48317]: starting ceph client 2024-09-12T02:29:12.688 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[48317]: starting fuse 2024-09-12T02:29:12.700 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:29:12.701 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:29:12.703 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:29:12.703 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:29:12.703 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:12.703 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:29:12.703 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.48317.asok 2024-09-12T02:29:12.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:12.828 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48317.asok 2024-09-12T02:29:12.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:12.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48317.asok status 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:29:12.960 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "48317", 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 5052, 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 5052 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:29:12.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 4224597600 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 4224597600 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.5052 192.168.0.1:0/4224597600", 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/4224597600", 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 13, 2024-09-12T02:29:12.962 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 32, 2024-09-12T02:29:12.963 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:29:12.963 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:29:12.963 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:29:12.963 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:29:12.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:12.968 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:29:12.969 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:29:12.985 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:12.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:12.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:13.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.050 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rootfile) 2024-09-12T02:29:13.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.112 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T02:29:13.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.173 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subdirfile) 2024-09-12T02:29:13.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.233 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir linkdir) 2024-09-12T02:29:13.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.291 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link0) 2024-09-12T02:29:13.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.352 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link0) 2024-09-12T02:29:13.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.410 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link0) 2024-09-12T02:29:13.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.468 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link1) 2024-09-12T02:29:13.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.527 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link2) 2024-09-12T02:29:13.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.585 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link2) 2024-09-12T02:29:13.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.645 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link2) 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.703 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link3) 2024-09-12T02:29:13.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.763 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link3) 2024-09-12T02:29:13.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.822 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln rootfile linkdir/link3) 2024-09-12T02:29:13.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.879 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/subsubdir) 2024-09-12T02:29:13.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:13.937 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync) 2024-09-12T02:29:14.183 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:14.183 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:14.183 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:14.183 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:14.183 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2024-09-12T02:29:14.183 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:14.248 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627776 2024-09-12T02:29:14.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:14.257 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:14.257 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:14.257 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:14.257 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:14.257 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-09-12T02:29:14.257 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:14.363 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627777 2024-09-12T02:29:14.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:14.372 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:14.372 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:14.372 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:14.372 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:14.372 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir").st_ino) 2024-09-12T02:29:14.372 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:14.476 INFO:teuthology.orchestra.run.smithi181.stdout:1099511628279 2024-09-12T02:29:14.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:14.485 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:14.485 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:14.485 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:14.485 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:14.485 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2024-09-12T02:29:14.486 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:14.591 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627778 2024-09-12T02:29:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:14.600 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:14.600 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:14.600 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:14.600 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:14.601 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2024-09-12T02:29:14.601 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:14.706 INFO:teuthology.orchestra.run.smithi181.stdout:1099511628282 2024-09-12T02:29:14.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:14.715 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:14.715 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:14.772 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:29:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.910+0000 7f0693bcd640 1 Processor -- start 2024-09-12T02:29:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.910+0000 7f0693bcd640 1 -- start start 2024-09-12T02:29:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0693bcd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c15b2e0 0x7f068c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0693bcd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f068c0cdfc0 0x7f068c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0693bcd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f068c0b22c0 0x7f068c0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0693bcd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f068c15b6c0 con 0x7f068c0b22c0 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0693bcd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f068c0ce4f0 con 0x7f068c0cdfc0 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0693bcd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f068c0ce7d0 con 0x7f068c15b2e0 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f068c0b22c0 0x7f068c0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f068c0b22c0 0x7f068c0ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51428/0 (socket says 172.21.15.181:51428) 2024-09-12T02:29:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 -- 172.21.15.181:0/3998596124 learned_addr learned my addr 172.21.15.181:0/3998596124 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0691168640 1 --2- 172.21.15.181:0/3998596124 >> v2:172.21.15.204:3300/0 conn(0x7f068c0cdfc0 0x7f068c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0691969640 1 --2- 172.21.15.181:0/3998596124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c15b2e0 0x7f068c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 -- 172.21.15.181:0/3998596124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c15b2e0 msgr2=0x7f068c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 --2- 172.21.15.181:0/3998596124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c15b2e0 0x7f068c0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 -- 172.21.15.181:0/3998596124 >> v2:172.21.15.204:3300/0 conn(0x7f068c0cdfc0 msgr2=0x7f068c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 --2- 172.21.15.181:0/3998596124 >> v2:172.21.15.204:3300/0 conn(0x7f068c0cdfc0 0x7f068c0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f069216a640 1 -- 172.21.15.181:0/3998596124 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c0ceab0 con 0x7f068c0b22c0 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.911+0000 7f0691168640 1 --2- 172.21.15.181:0/3998596124 >> v2:172.21.15.204:3300/0 conn(0x7f068c0cdfc0 0x7f068c0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.912+0000 7f069216a640 1 --2- 172.21.15.181:0/3998596124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c0b22c0 0x7f068c0ccad0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f068c0cdce0 tx=0x7f068402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7b9b77dc4cbaed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.912+0000 7f0690967640 1 -- 172.21.15.181:0/3998596124 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684036070 con 0x7f068c0b22c0 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.912+0000 7f0690967640 1 -- 172.21.15.181:0/3998596124 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684031600 con 0x7f068c0b22c0 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.912+0000 7f0690967640 1 -- 172.21.15.181:0/3998596124 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840319d0 con 0x7f068c0b22c0 2024-09-12T02:29:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 -- 172.21.15.181:0/3998596124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c0b22c0 msgr2=0x7f068c0ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 --2- 172.21.15.181:0/3998596124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c0b22c0 0x7f068c0ccad0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f068c0cdce0 tx=0x7f068402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 -- 172.21.15.181:0/3998596124 shutdown_connections 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 --2- 172.21.15.181:0/3998596124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c0b22c0 0x7f068c0ccad0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 --2- 172.21.15.181:0/3998596124 >> v2:172.21.15.204:3300/0 conn(0x7f068c0cdfc0 0x7f068c0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 --2- 172.21.15.181:0/3998596124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c15b2e0 0x7f068c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 -- 172.21.15.181:0/3998596124 >> 172.21.15.181:0/3998596124 conn(0x7f068c06bc10 msgr2=0x7f068c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 -- 172.21.15.181:0/3998596124 shutdown_connections 2024-09-12T02:29:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.913+0000 7f0693bcd640 1 -- 172.21.15.181:0/3998596124 wait complete. 2024-09-12T02:29:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.914+0000 7f0693bcd640 1 Processor -- start 2024-09-12T02:29:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.914+0000 7f0693bcd640 1 -- start start 2024-09-12T02:29:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c0b22c0 0x7f068c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f068c0cdfc0 0x7f068c157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c15b2e0 0x7f068c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f068c0712b0 con 0x7f068c15b2e0 2024-09-12T02:29:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f068c071130 con 0x7f068c0cdfc0 2024-09-12T02:29:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f068c0b4260 con 0x7f068c0b22c0 2024-09-12T02:29:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c15b2e0 0x7f068c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c15b2e0 0x7f068c1576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51434/0 (socket says 172.21.15.181:51434) 2024-09-12T02:29:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 -- 172.21.15.181:0/1677435943 learned_addr learned my addr 172.21.15.181:0/1677435943 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0691168640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f068c0cdfc0 0x7f068c157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0691969640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c0b22c0 0x7f068c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 -- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c0b22c0 msgr2=0x7f068c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c0b22c0 0x7f068c14e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 -- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f068c0cdfc0 msgr2=0x7f068c157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f068c0cdfc0 0x7f068c157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 -- 172.21.15.181:0/1677435943 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c1e4560 con 0x7f068c15b2e0 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f069216a640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c15b2e0 0x7f068c1576d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0684034040 tx=0x7f0684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f06827fc640 1 -- 172.21.15.181:0/1677435943 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684041020 con 0x7f068c15b2e0 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f06827fc640 1 -- 172.21.15.181:0/1677435943 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06840077a0 con 0x7f068c15b2e0 2024-09-12T02:29:14.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c152370 con 0x7f068c15b2e0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f06827fc640 1 -- 172.21.15.181:0/1677435943 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684036040 con 0x7f068c15b2e0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.915+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c14ed50 con 0x7f068c15b2e0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.916+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c152890 con 0x7f068c15b2e0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.917+0000 7f06827fc640 1 -- 172.21.15.181:0/1677435943 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0684044020 con 0x7f068c15b2e0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.917+0000 7f06827fc640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f067006be30 0x7f067006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.918+0000 7f0691969640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f067006be30 0x7f067006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.918+0000 7f06827fc640 1 -- 172.21.15.181:0/1677435943 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f06840abb90 con 0x7f068c15b2e0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.918+0000 7f0691969640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f067006be30 0x7f067006e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f068800a9a0 tx=0x7f0688008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:14.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:14.922+0000 7f06827fc640 1 -- 172.21.15.181:0/1677435943 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f068c152890 con 0x7f068c15b2e0 2024-09-12T02:29:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.098+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f068c152160 con 0x7f068c15b2e0 2024-09-12T02:29:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.098+0000 7f06827fc640 1 -- 172.21.15.181:0/1677435943 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f068404b030 con 0x7f068c15b2e0 2024-09-12T02:29:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:29:15.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f067006be30 msgr2=0x7f067006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f067006be30 0x7f067006e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f068800a9a0 tx=0x7f0688008040 comp rx=0 tx=0).stop 2024-09-12T02:29:15.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c15b2e0 msgr2=0x7f068c1576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c15b2e0 0x7f068c1576d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0684034040 tx=0x7f0684004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 shutdown_connections 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f067006be30 0x7f067006e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f068c0cdfc0 0x7f068c157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f068c15b2e0 0x7f068c1576d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 --2- 172.21.15.181:0/1677435943 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f068c0b22c0 0x7f068c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 >> 172.21.15.181:0/1677435943 conn(0x7f068c06bc10 msgr2=0x7f068c1590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 shutdown_connections 2024-09-12T02:29:15.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.100+0000 7f0693bcd640 1 -- 172.21.15.181:0/1677435943 wait complete. 2024-09-12T02:29:15.112 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:15.112 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:15.128 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:29:15.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.265+0000 7f6f200c3640 1 Processor -- start 2024-09-12T02:29:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.265+0000 7f6f200c3640 1 -- start start 2024-09-12T02:29:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f200c3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 0x7f6f180cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f200c3640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f180ce060 con 0x7f6f180b2590 2024-09-12T02:29:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f200c3640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f180ce340 con 0x7f6f180cf800 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f200c3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6f180cf100 con 0x7f6f1815c480 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1e660640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6f180b2590 0x7f6f18072270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35174/0 (socket says 172.21.15.181:35174) 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1e660640 1 -- 172.21.15.181:0/3377432291 learned_addr learned my addr 172.21.15.181:0/3377432291 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703446286 0 0) 0x7f6f180ce060 con 0x7f6f180b2590 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 0x7f6f180cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f04003520 con 0x7f6f180b2590 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 913811550 0 0) 0x7f6f04003520 con 0x7f6f180b2590 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 msgr2=0x7f6f180cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 0x7f6f180cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 >> v1:172.21.15.204:6789/0 conn(0x7f6f180cf800 legacy=0x7f6f180b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f180ce620 con 0x7f6f180b2590 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f6f100019f0 con 0x7f6f180b2590 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 >> v1:172.21.15.181:6789/0 conn(0x7f6f180b2590 legacy=0x7f6f18072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f040039e0 0x7f6f04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f04004390 0x7f6f04004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 0x7f6f040050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f180cf100 con 0x7f6f040039e0 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0400b9c0 con 0x7f6f04004390 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.266+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0400bbc0 con 0x7f6f1815c480 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f040039e0 0x7f6f04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1d65e640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f04004390 0x7f6f04004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1e660640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 0x7f6f040050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1de5f640 1 -- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 msgr2=0x7f6f040050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f1815c480 0x7f6f040050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1de5f640 1 -- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f04004390 msgr2=0x7f6f04004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f04004390 0x7f6f04004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1de5f640 1 -- 172.21.15.181:0/3377432291 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f04003520 con 0x7f6f040039e0 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.267+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f040039e0 0x7f6f04003dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009ac0 tx=0x7f6f04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6694f61fe102f512 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14036070 con 0x7f6f040039e0 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f14031400 con 0x7f6f040039e0 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f1ce5d640 1 -- 172.21.15.181:0/3377432291 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14009690 con 0x7f6f040039e0 2024-09-12T02:29:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f200c3640 1 -- 172.21.15.181:0/3377432291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f040039e0 msgr2=0x7f6f04003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f200c3640 1 --2- 172.21.15.181:0/3377432291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f040039e0 0x7f6f04003dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009ac0 tx=0x7f6f04005830 comp rx=0 tx=0).stop 2024-09-12T02:29:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f1e660640 1 -- 172.21.15.181:0/3377432291 reap_dead start 2024-09-12T02:29:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f200c3640 1 -- 172.21.15.181:0/3377432291 shutdown_connections 2024-09-12T02:29:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f200c3640 1 -- 172.21.15.181:0/3377432291 >> 172.21.15.181:0/3377432291 conn(0x7f6f1806bc10 msgr2=0x7f6f1806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f200c3640 1 -- 172.21.15.181:0/3377432291 shutdown_connections 2024-09-12T02:29:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.268+0000 7f6f200c3640 1 -- 172.21.15.181:0/3377432291 wait complete. 2024-09-12T02:29:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.269+0000 7f6f200c3640 1 Processor -- start 2024-09-12T02:29:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.269+0000 7f6f200c3640 1 -- start start 2024-09-12T02:29:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f200c3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f040039e0 0x7f6f1815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f200c3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f18150250 0x7f6f181506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f200c3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f18140800 0x7f6f18140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f200c3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f180cebe0 con 0x7f6f18150250 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f200c3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6f180cfc40 con 0x7f6f18140800 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f200c3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6f180cf2c0 con 0x7f6f040039e0 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1d65e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f18150250 0x7f6f181506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1d65e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f18150250 0x7f6f181506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51450/0 (socket says 172.21.15.181:51450) 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1d65e640 1 -- 172.21.15.181:0/2359836257 learned_addr learned my addr 172.21.15.181:0/2359836257 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1e660640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f18140800 0x7f6f18140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f040039e0 0x7f6f1815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1d65e640 1 -- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f040039e0 msgr2=0x7f6f1815edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1d65e640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f040039e0 0x7f6f1815edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1d65e640 1 -- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f18140800 msgr2=0x7f6f18140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.270+0000 7f6f1d65e640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f18140800 0x7f6f18140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.271+0000 7f6f1d65e640 1 -- 172.21.15.181:0/2359836257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1815dd20 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.271+0000 7f6f1d65e640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f18150250 0x7f6f181506d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800f770 tx=0x7f6f0800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.271+0000 7f6f0e7fc640 1 -- 172.21.15.181:0/2359836257 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f080050d0 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.271+0000 7f6f0e7fc640 1 -- 172.21.15.181:0/2359836257 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f08018070 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.271+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1815e000 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.271+0000 7f6f0e7fc640 1 -- 172.21.15.181:0/2359836257 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800d6d0 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.271+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1815e5c0 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.272+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f180b1e80 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.272+0000 7f6f0e7fc640 1 -- 172.21.15.181:0/2359836257 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f0800d870 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.273+0000 7f6f0e7fc640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6efc06be60 0x7f6efc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.273+0000 7f6f0e7fc640 1 -- 172.21.15.181:0/2359836257 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6f0808ac90 con 0x7f6f18150250 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.273+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6efc06be60 0x7f6efc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.273+0000 7f6f1de5f640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6efc06be60 0x7f6efc06e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009ac0 tx=0x7f6f14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.277+0000 7f6f0e7fc640 1 -- 172.21.15.181:0/2359836257 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f0801a310 con 0x7f6f18150250 2024-09-12T02:29:15.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.452+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6f18073680 con 0x7f6f18150250 2024-09-12T02:29:15.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.453+0000 7f6f0e7fc640 1 -- 172.21.15.181:0/2359836257 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f6f08059640 con 0x7f6f18150250 2024-09-12T02:29:15.454 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:29:15.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6efc06be60 msgr2=0x7f6efc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6efc06be60 0x7f6efc06e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009ac0 tx=0x7f6f14008030 comp rx=0 tx=0).stop 2024-09-12T02:29:15.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f18150250 msgr2=0x7f6f181506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f18150250 0x7f6f181506d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800f770 tx=0x7f6f0800fb70 comp rx=0 tx=0).stop 2024-09-12T02:29:15.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 shutdown_connections 2024-09-12T02:29:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6efc06be60 0x7f6efc06e320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6f18140800 0x7f6f18140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f18150250 0x7f6f181506d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 --2- 172.21.15.181:0/2359836257 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6f040039e0 0x7f6f1815edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 >> 172.21.15.181:0/2359836257 conn(0x7f6f1806bc10 msgr2=0x7f6f1815b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 shutdown_connections 2024-09-12T02:29:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:15.455+0000 7f6f200c3640 1 -- 172.21.15.181:0/2359836257 wait complete. 2024-09-12T02:29:15.467 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:29:15.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:15.467 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:15.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[48317]: fuse finished with error 0 and tester_r 0 2024-09-12T02:29:15.492 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:29:15.759 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:15.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:21.594 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:29:21.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:21.595 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:29:21.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:29:21.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.764+0000 7f52f43b7640 1 Processor -- start 2024-09-12T02:29:21.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.764+0000 7f52f43b7640 1 -- start start 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f43b7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f52ec15c480 0x7f52ec0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f43b7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f52ec0cf800 0x7f52ec0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f43b7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52ec0ce060 con 0x7f52ec0b23c0 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f43b7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f52ec0cf100 con 0x7f52ec0cf800 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f43b7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f52ec0cfc40 con 0x7f52ec15c480 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f1952640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f52ec0cf800 0x7f52ec0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f1952640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f52ec0cf800 0x7f52ec0b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45944/0 (socket says 172.21.15.181:45944) 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f1952640 1 -- 172.21.15.181:0/2097966277 learned_addr learned my addr 172.21.15.181:0/2097966277 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f2153640 1 --2- 172.21.15.181:0/2097966277 >> v2:172.21.15.204:3300/0 conn(0x7f52ec15c480 0x7f52ec0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f1952640 1 -- 172.21.15.181:0/2097966277 >> v2:172.21.15.204:3300/0 conn(0x7f52ec15c480 msgr2=0x7f52ec0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f1952640 1 --2- 172.21.15.181:0/2097966277 >> v2:172.21.15.204:3300/0 conn(0x7f52ec15c480 0x7f52ec0cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f1952640 1 -- 172.21.15.181:0/2097966277 >> v1:172.21.15.204:6789/0 conn(0x7f52ec0b23c0 legacy=0x7f52ec0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:21.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.765+0000 7f52f1952640 1 -- 172.21.15.181:0/2097966277 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec0ce340 con 0x7f52ec0cf800 2024-09-12T02:29:21.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.766+0000 7f52f1952640 1 --2- 172.21.15.181:0/2097966277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b1e80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0d1130 tx=0x7f52e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85caa01d5cb46f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:21.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.766+0000 7f52f1151640 1 -- 172.21.15.181:0/2097966277 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8037070 con 0x7f52ec0cf800 2024-09-12T02:29:21.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.766+0000 7f52f1151640 1 -- 172.21.15.181:0/2097966277 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e8032440 con 0x7f52ec0cf800 2024-09-12T02:29:21.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.766+0000 7f52f1151640 1 -- 172.21.15.181:0/2097966277 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8032810 con 0x7f52ec0cf800 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 -- 172.21.15.181:0/2097966277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0cf800 msgr2=0x7f52ec0b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2097966277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b1e80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0d1130 tx=0x7f52e802a230 comp rx=0 tx=0).stop 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 -- 172.21.15.181:0/2097966277 shutdown_connections 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2097966277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b1e80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2097966277 >> v2:172.21.15.204:3300/0 conn(0x7f52ec15c480 0x7f52ec0cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 -- 172.21.15.181:0/2097966277 >> 172.21.15.181:0/2097966277 conn(0x7f52ec06bc10 msgr2=0x7f52ec06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 -- 172.21.15.181:0/2097966277 shutdown_connections 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.767+0000 7f52f43b7640 1 -- 172.21.15.181:0/2097966277 wait complete. 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.768+0000 7f52f43b7640 1 Processor -- start 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.768+0000 7f52f43b7640 1 -- start start 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f43b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0b23c0 0x7f52ec147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f43b7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f43b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52ec15c480 0x7f52ec0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f43b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec0cebe0 con 0x7f52ec0b23c0 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f43b7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec0ce900 con 0x7f52ec0cf800 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f43b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f52ec0b2830 con 0x7f52ec15c480 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0b23c0 0x7f52ec147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0b23c0 0x7f52ec147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45960/0 (socket says 172.21.15.181:45960) 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 -- 172.21.15.181:0/2428473529 learned_addr learned my addr 172.21.15.181:0/2428473529 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f1952640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2954640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52ec15c480 0x7f52ec0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 -- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52ec15c480 msgr2=0x7f52ec0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52ec15c480 0x7f52ec0ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 -- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52ec0cf800 msgr2=0x7f52ec0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 -- 172.21.15.181:0/2428473529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec148230 con 0x7f52ec0b23c0 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2954640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52ec15c480 0x7f52ec0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f1952640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f2153640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0b23c0 0x7f52ec147cf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52e000c820 tx=0x7f52e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52deffd640 1 -- 172.21.15.181:0/2428473529 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0015070 con 0x7f52ec0b23c0 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52deffd640 1 -- 172.21.15.181:0/2428473529 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e0004020 con 0x7f52ec0b23c0 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52deffd640 1 -- 172.21.15.181:0/2428473529 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e00043f0 con 0x7f52ec0b23c0 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.769+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec0ca1f0 con 0x7f52ec0b23c0 2024-09-12T02:29:21.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.770+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec158dc0 con 0x7f52ec0b23c0 2024-09-12T02:29:21.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.771+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec0ca710 con 0x7f52ec0b23c0 2024-09-12T02:29:21.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.771+0000 7f52deffd640 1 -- 172.21.15.181:0/2428473529 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52e0007830 con 0x7f52ec0b23c0 2024-09-12T02:29:21.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.771+0000 7f52deffd640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f52d006be30 0x7f52d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:21.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.772+0000 7f52deffd640 1 -- 172.21.15.181:0/2428473529 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f52e008aba0 con 0x7f52ec0b23c0 2024-09-12T02:29:21.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.772+0000 7f52f1952640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f52d006be30 0x7f52d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:21.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.772+0000 7f52f1952640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f52d006be30 0x7f52d006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f52e8034000 tx=0x7f52e802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:21.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.776+0000 7f52deffd640 1 -- 172.21.15.181:0/2428473529 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52ec0ca710 con 0x7f52ec0b23c0 2024-09-12T02:29:21.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.975+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f52ec0b1e80 con 0x7f52ec0b23c0 2024-09-12T02:29:21.976 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:29:21.975+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:29:21.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.977+0000 7f52deffd640 1 -- 172.21.15.181:0/2428473529 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 161+0+0 (secure 0 0 0) 0x7f52ec148230 con 0x7f52ec0b23c0 2024-09-12T02:29:21.977 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:29:21.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.979+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f52d006be30 msgr2=0x7f52d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:21.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.979+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f52d006be30 0x7f52d006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f52e8034000 tx=0x7f52e802e000 comp rx=0 tx=0).stop 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.979+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0b23c0 msgr2=0x7f52ec147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.979+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0b23c0 0x7f52ec147cf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52e000c820 tx=0x7f52e000cce0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 shutdown_connections 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f52d006be30 0x7f52d006e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52ec0cf800 0x7f52ec0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52ec15c480 0x7f52ec0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 --2- 172.21.15.181:0/2428473529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec0b23c0 0x7f52ec147cf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 >> 172.21.15.181:0/2428473529 conn(0x7f52ec06bc10 msgr2=0x7f52ec157870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 shutdown_connections 2024-09-12T02:29:21.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:21.980+0000 7f52f43b7640 1 -- 172.21.15.181:0/2428473529 wait complete. 2024-09-12T02:29:21.985 INFO:tasks.ceph.mds.b.smithi204.stderr: -8792> 2024-09-12T02:29:07.567+0000 7f95cf4e1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:29:21.992 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2024-09-12T02:29:22.022 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:29:22.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.033+0000 7ff0e387bf40 1 Processor -- start 2024-09-12T02:29:22.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.033+0000 7ff0e387bf40 1 -- start start 2024-09-12T02:29:22.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e387bf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cd32910 0x55c72cd180b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e387bf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cda15d0 0x55c72cce74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e387bf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd31940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e387bf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c72cc3a510 con 0x55c72cd32910 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e387bf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55c72cda22f0 con 0x55c72cda15d0 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e387bf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55c72cdbe5c0 con 0x55c72cdc12f0 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cd32910 0x55c72cd180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cd32910 0x55c72cd180b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45980/0 (socket says 172.21.15.181:45980) 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 -- 172.21.15.181:0/1759012018 learned_addr learned my addr 172.21.15.181:0/1759012018 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0dbfff640 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cda15d0 0x55c72cce74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1b72640 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd31940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 -- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 msgr2=0x55c72cd31940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd31940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 -- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cda15d0 msgr2=0x55c72cce74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cda15d0 0x55c72cce74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 -- 172.21.15.181:0/1759012018 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c72cce99e0 con 0x55c72cd32910 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0dbfff640 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cda15d0 0x55c72cce74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1b72640 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd31940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0e1371640 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cd32910 0x55c72cd180b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009750 tx=0x7ff0d4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611c50790f5ed9d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.034+0000 7ff0db7fe640 1 -- 172.21.15.181:0/1759012018 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4019070 con 0x55c72cd32910 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0db7fe640 1 -- 172.21.15.181:0/1759012018 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d4008890 con 0x55c72cd32910 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0db7fe640 1 -- 172.21.15.181:0/1759012018 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4008c60 con 0x55c72cd32910 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 -- 172.21.15.181:0/1759012018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cd32910 msgr2=0x55c72cd180b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cd32910 0x55c72cd180b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009750 tx=0x7ff0d4005a00 comp rx=0 tx=0).stop 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 -- 172.21.15.181:0/1759012018 shutdown_connections 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cda15d0 0x55c72cce74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd31940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/1759012018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cd32910 0x55c72cd180b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 -- 172.21.15.181:0/1759012018 >> 172.21.15.181:0/1759012018 conn(0x55c72cd13400 msgr2=0x55c72cce9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 -- 172.21.15.181:0/1759012018 shutdown_connections 2024-09-12T02:29:22.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.035+0000 7ff0e387bf40 1 -- 172.21.15.181:0/1759012018 wait complete. 2024-09-12T02:29:22.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 Processor -- start 2024-09-12T02:29:22.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 -- start start 2024-09-12T02:29:22.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cd32910 0x55c72cd9eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cda15d0 0x55c72cce9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd166a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c72cda0880 con 0x55c72cda15d0 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55c72cda0eb0 con 0x55c72cd32910 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0e387bf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55c72cda1280 con 0x55c72cdc12f0 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0dbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cda15d0 0x55c72cce9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0dbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cda15d0 0x55c72cce9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45982/0 (socket says 172.21.15.181:45982) 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.036+0000 7ff0dbfff640 1 -- 172.21.15.181:0/2302518340 learned_addr learned my addr 172.21.15.181:0/2302518340 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0e1b72640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0e1371640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cd32910 0x55c72cd9eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0dbfff640 1 -- 172.21.15.181:0/2302518340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 msgr2=0x55c72cd166a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0dbfff640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55c72cdc12f0 0x55c72cd166a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0dbfff640 1 -- 172.21.15.181:0/2302518340 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cd32910 msgr2=0x55c72cd9eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0dbfff640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55c72cd32910 0x55c72cd9eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0dbfff640 1 -- 172.21.15.181:0/2302518340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c72cdbaec0 con 0x55c72cda15d0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0dbfff640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cda15d0 0x55c72cce9be0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc001d90 tx=0x7ff0cc00a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0da7fc640 1 -- 172.21.15.181:0/2302518340 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00ae60 con 0x55c72cda15d0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0da7fc640 1 -- 172.21.15.181:0/2302518340 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc010470 con 0x55c72cda15d0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c72cdbb1a0 con 0x55c72cda15d0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0da7fc640 1 -- 172.21.15.181:0/2302518340 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc010860 con 0x55c72cda15d0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.037+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c72cdbb760 con 0x55c72cda15d0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.038+0000 7ff0da7fc640 1 -- 172.21.15.181:0/2302518340 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0cc00e040 con 0x55c72cda15d0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.039+0000 7ff0da7fc640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0c406a840 0x7ff0c406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.039+0000 7ff0e1371640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0c406a840 0x7ff0c406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.039+0000 7ff0da7fc640 1 -- 172.21.15.181:0/2302518340 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7ff0cc089690 con 0x55c72cda15d0 2024-09-12T02:29:22.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.039+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55c72ccea120 0x55c72cdb68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.039+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c72cdb6e10 con 0x55c72ccea120 2024-09-12T02:29:22.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.039+0000 7ff0e1b72640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55c72ccea120 0x55c72cdb68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.039+0000 7ff0e1371640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0c406a840 0x7ff0c406cd00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4017040 tx=0x7ff0d4008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.040+0000 7ff0e1b72640 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55c72ccea120 0x55c72cdb68d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:22.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e1b72640 1 -- 172.21.15.181:0/2302518340 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7ff0dc04f990 con 0x55c72ccea120 2024-09-12T02:29:22.046 INFO:teuthology.orchestra.run.smithi181.stderr:error getting omap key set cephfs_metadata/10000000001.00000000: (2) No such file or directory 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55c72ccea120 msgr2=0x55c72cdb68d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55c72ccea120 0x55c72cdb68d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0c406a840 msgr2=0x7ff0c406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0c406a840 0x7ff0c406cd00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4017040 tx=0x7ff0d4008000 comp rx=0 tx=0).stop 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cda15d0 msgr2=0x55c72cce9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 --2- 172.21.15.181:0/2302518340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c72cda15d0 0x55c72cce9be0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc001d90 tx=0x7ff0cc00a5a0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e1b72640 1 -- 172.21.15.181:0/2302518340 reap_dead start 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 shutdown_connections 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 >> 172.21.15.181:0/2302518340 conn(0x55c72cd13400 msgr2=0x55c72cd9fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 shutdown_connections 2024-09-12T02:29:22.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.042+0000 7ff0e387bf40 1 -- 172.21.15.181:0/2302518340 wait complete. 2024-09-12T02:29:22.048 ERROR:tasks.cephfs.filesystem:Command failed on smithi181 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000' 2024-09-12T02:29:22.048 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-09-12T02:29:22.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 Processor -- start 2024-09-12T02:29:22.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 -- start start 2024-09-12T02:29:22.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e47d80 0x5608c5e65570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5e65f80 0x5608c5ef3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5ef2cb0 0x5608c5ef4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5608c5d6d510 con 0x5608c5e65f80 2024-09-12T02:29:22.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5608c5dc6c50 con 0x5608c5e47d80 2024-09-12T02:29:22.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.129+0000 7fd2436eff40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5608c5e62fd0 con 0x5608c5ef2cb0 2024-09-12T02:29:22.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5e65f80 0x5608c5ef3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5e65f80 0x5608c5ef3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45998/0 (socket says 172.21.15.181:45998) 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 -- 172.21.15.181:0/613885602 learned_addr learned my addr 172.21.15.181:0/613885602 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd2411e5640 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e47d80 0x5608c5e65570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd2419e6640 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5ef2cb0 0x5608c5ef4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 -- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5ef2cb0 msgr2=0x5608c5ef4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5ef2cb0 0x5608c5ef4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 -- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e47d80 msgr2=0x5608c5e65570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e47d80 0x5608c5e65570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 -- 172.21.15.181:0/613885602 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c5ef6180 con 0x5608c5e65f80 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23bfff640 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5e65f80 0x5608c5ef3090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00b4d0 tx=0x7fd22c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5b4624e54afd5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23b7fe640 1 -- 172.21.15.181:0/613885602 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c012070 con 0x5608c5e65f80 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23b7fe640 1 -- 172.21.15.181:0/613885602 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c00d690 con 0x5608c5e65f80 2024-09-12T02:29:22.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.130+0000 7fd23b7fe640 1 -- 172.21.15.181:0/613885602 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00da80 con 0x5608c5e65f80 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 -- 172.21.15.181:0/613885602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5e65f80 msgr2=0x5608c5ef3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5e65f80 0x5608c5ef3090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00b4d0 tx=0x7fd22c00b990 comp rx=0 tx=0).stop 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 -- 172.21.15.181:0/613885602 shutdown_connections 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5ef2cb0 0x5608c5ef4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5e65f80 0x5608c5ef3090 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 --2- 172.21.15.181:0/613885602 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e47d80 0x5608c5e65570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 -- 172.21.15.181:0/613885602 >> 172.21.15.181:0/613885602 conn(0x5608c5e46280 msgr2=0x5608c5e4b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 -- 172.21.15.181:0/613885602 shutdown_connections 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 -- 172.21.15.181:0/613885602 wait complete. 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 Processor -- start 2024-09-12T02:29:22.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.131+0000 7fd2436eff40 1 -- start start 2024-09-12T02:29:22.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2436eff40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5e47d80 0x5608c5edd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2436eff40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e65f80 0x5608c5ee71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2436eff40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5ef2cb0 0x5608c5ee64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2436eff40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5608c5ef6440 con 0x5608c5ef2cb0 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2436eff40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5608c5e650e0 con 0x5608c5e65f80 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2436eff40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5608c5e64d70 con 0x5608c5e47d80 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5ef2cb0 0x5608c5ee64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5ef2cb0 0x5608c5ee64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46002/0 (socket says 172.21.15.181:46002) 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 -- 172.21.15.181:0/670176658 learned_addr learned my addr 172.21.15.181:0/670176658 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd23bfff640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e65f80 0x5608c5ee71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2411e5640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5e47d80 0x5608c5edd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 -- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5e47d80 msgr2=0x5608c5edd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5608c5e47d80 0x5608c5edd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 -- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e65f80 msgr2=0x5608c5ee71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5608c5e65f80 0x5608c5ee71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 -- 172.21.15.181:0/670176658 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c5e60860 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.132+0000 7fd2419e6640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5ef2cb0 0x5608c5ee64f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd23c006fa0 tx=0x7fd23c00d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.133+0000 7fd23a7fc640 1 -- 172.21.15.181:0/670176658 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c018070 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.133+0000 7fd23a7fc640 1 -- 172.21.15.181:0/670176658 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23c0030d0 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.133+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608c5e60b40 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.133+0000 7fd23a7fc640 1 -- 172.21.15.181:0/670176658 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0034a0 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.133+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c5e61100 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.134+0000 7fd23a7fc640 1 -- 172.21.15.181:0/670176658 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd23c01b070 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.134+0000 7fd23a7fc640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd22406a810 0x7fd22406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.134+0000 7fd23a7fc640 1 -- 172.21.15.181:0/670176658 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fd23c089160 con 0x5608c5ef2cb0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.134+0000 7fd2411e5640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd22406a810 0x7fd22406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.135+0000 7fd2436eff40 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5608c5e603b0 0x5608c5e49be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.135+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5608c5ee7720 con 0x5608c5e603b0 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.135+0000 7fd23bfff640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5608c5e603b0 0x5608c5e49be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.135+0000 7fd2411e5640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd22406a810 0x7fd22406ccd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd234056000 tx=0x7fd234050000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.135+0000 7fd23bfff640 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5608c5e603b0 0x5608c5e49be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd23bfff640 1 -- 172.21.15.181:0/670176658 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 154+0+5 (crc 0 0 0) 0x7fd22c014030 con 0x5608c5e603b0 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5608c5e603b0 msgr2=0x5608c5e49be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5608c5e603b0 0x5608c5e49be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd22406a810 msgr2=0x7fd22406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd22406a810 0x7fd22406ccd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd234056000 tx=0x7fd234050000 comp rx=0 tx=0).stop 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5ef2cb0 msgr2=0x5608c5ee64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 --2- 172.21.15.181:0/670176658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608c5ef2cb0 0x5608c5ee64f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd23c006fa0 tx=0x7fd23c00d5f0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2419e6640 1 -- 172.21.15.181:0/670176658 reap_dead start 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 shutdown_connections 2024-09-12T02:29:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 >> 172.21.15.181:0/670176658 conn(0x5608c5e46280 msgr2=0x5608c5ef4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 shutdown_connections 2024-09-12T02:29:22.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.136+0000 7fd2436eff40 1 -- 172.21.15.181:0/670176658 wait complete. 2024-09-12T02:29:22.142 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries list 2024-09-12T02:29:22.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 -- start start 2024-09-12T02:29:22.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 Processor -- start 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562647f4ac00 0x562647fc6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562647f4b800 0x562647fc6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562647f4bc00 0x562647fc7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562648cca180 con 0x562647f4bc00 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562648cca300 con 0x562647f4ac00 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d67a74280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562648cca480 con 0x562647f4b800 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d66a1c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562647f4bc00 0x562647fc7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d66a1c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562647f4bc00 0x562647fc7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46032/0 (socket says 172.21.15.181:46032) 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.223+0000 7f7d66a1c640 1 -- 172.21.15.181:0/4002528187 learned_addr learned my addr 172.21.15.181:0/4002528187 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d66a1c640 1 -- 172.21.15.181:0/4002528187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562647f4b800 msgr2=0x562647fc6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d66a1c640 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562647f4b800 0x562647fc6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d66a1c640 1 -- 172.21.15.181:0/4002528187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562647f4ac00 msgr2=0x562647fc6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d6621b640 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562647f4ac00 0x562647fc6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d66a1c640 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562647f4ac00 0x562647fc6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d66a1c640 1 -- 172.21.15.181:0/4002528187 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562647f82780 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d66a1c640 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562647f4bc00 0x562647fc7080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x562648d6b740 tx=0x562648cec840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d59252799c99bea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d63a16640 1 -- 172.21.15.181:0/4002528187 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562647f709c0 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d63a16640 1 -- 172.21.15.181:0/4002528187 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562647f76fc0 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d63a16640 1 -- 172.21.15.181:0/4002528187 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562647f70680 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d67a74280 1 -- 172.21.15.181:0/4002528187 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562647f834a0 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d67a74280 1 -- 172.21.15.181:0/4002528187 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562647f82000 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d67a74280 4 waiting for MDS map... 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d63a16640 1 -- 172.21.15.181:0/4002528187 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x562648e1c200 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d63a16640 1 -- 172.21.15.181:0/4002528187 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 14) ==== 2893+0+0 (secure 0 0 0) 0x562647fa5180 con 0x562647f4bc00 2024-09-12T02:29:22.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d67a74280 4 Got MDS map 14 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d67a74280 10 main: JournalTool::main 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.224+0000 7f7d67a74280 4 main: JournalTool: connecting to RADOS... 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 Processor -- start 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 -- start start 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e000 0x562647fc7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e400 0x562647fc7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562648cca600 con 0x562648e7e400 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562648cca780 con 0x562648e7e800 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.225+0000 7f7d67a74280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562648cca900 con 0x562648e7e000 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e400 0x562647fc7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e400 0x562647fc7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46046/0 (socket says 172.21.15.181:46046) 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 -- 172.21.15.181:0/93630188 learned_addr learned my addr 172.21.15.181:0/93630188 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e000 0x562647fc7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 -- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e000 msgr2=0x562647fc7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e000 0x562647fc7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 -- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 msgr2=0x562647fc8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 -- 172.21.15.181:0/93630188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562647f823c0 con 0x562648e7e400 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d6621b640 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e400 0x562647fc7b80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x562648e2a810 tx=0x562648e30cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972bce1f1d25d891 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d61a12640 1 -- 172.21.15.181:0/93630188 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562647f709c0 con 0x562648e7e400 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d61a12640 1 -- 172.21.15.181:0/93630188 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562647f76a80 con 0x562648e7e400 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.226+0000 7f7d61a12640 1 -- 172.21.15.181:0/93630188 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562647f70680 con 0x562648e7e400 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 -- 172.21.15.181:0/93630188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e400 msgr2=0x562647fc7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e400 0x562647fc7b80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x562648e2a810 tx=0x562648e30cc0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 -- 172.21.15.181:0/93630188 shutdown_connections 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e400 0x562647fc7b80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 --2- 172.21.15.181:0/93630188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e000 0x562647fc7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 -- 172.21.15.181:0/93630188 >> 172.21.15.181:0/93630188 conn(0x562648cebc00 msgr2=0x562648037000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 -- 172.21.15.181:0/93630188 shutdown_connections 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 -- 172.21.15.181:0/93630188 wait complete. 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 Processor -- start 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.227+0000 7f7d67a74280 1 -- start start 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e000 0x562647fc9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e400 0x562647fc8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562648ccbc80 con 0x562648e7e000 2024-09-12T02:29:22.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562648ccbb00 con 0x562648e7e800 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562648ccb980 con 0x562648e7e400 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e000 0x562647fc9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e000 0x562647fc9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46062/0 (socket says 172.21.15.181:46062) 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 learned_addr learned my addr 172.21.15.181:0/1176933456 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d6621b640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e400 0x562647fc8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e400 msgr2=0x562647fc8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562648e7e400 0x562647fc8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 msgr2=0x562647fc8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562648e7e800 0x562647fc8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562647f82960 con 0x562648e7e000 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e000 0x562647fc9180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x562648e2bb00 tx=0x562648e30e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d6020f640 1 -- 172.21.15.181:0/1176933456 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562647f709c0 con 0x562648e7e000 2024-09-12T02:29:22.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d6020f640 1 -- 172.21.15.181:0/1176933456 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562647f76c40 con 0x562648e7e000 2024-09-12T02:29:22.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562647f83680 con 0x562648e7e000 2024-09-12T02:29:22.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d6020f640 1 -- 172.21.15.181:0/1176933456 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562647f70680 con 0x562648e7e000 2024-09-12T02:29:22.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562647f83860 con 0x562648e7e000 2024-09-12T02:29:22.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.228+0000 7f7d67a74280 4 main: JournalTool: resolving pool 4 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d6020f640 1 -- 172.21.15.181:0/1176933456 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562648e92c00 con 0x562648e7e000 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d6020f640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562648ea8c00 0x562647fc9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d6020f640 1 -- 172.21.15.181:0/1176933456 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x562648e85000 con 0x562648e7e000 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d67a74280 4 main: JournalTool: creating IoCtx.. 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d67a74280 4 main: Executing for rank 0 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d6621b640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562648ea8c00 0x562647fc9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562648e7ec00 0x562647fc8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x562648e7ec00 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562648e7ec00 0x562647fc8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d6621b640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562648ea8c00 0x562647fc9700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x562648e2a810 tx=0x562648e30c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.230+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562648e7ec00 0x562647fc8100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.231+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x562648cd6000 con 0x562648e7ec00 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.231+0000 7f7d67a74280 4 Pointer 400.00000000 is readable 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.231+0000 7f7d67a74280 4 JournalScanner::scan: reading header object '200.00000000' 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.231+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x562648ea9000 0x562647fc7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.231+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x562648ea9000 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.231+0000 7f7d66a1c640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x562648ea9000 0x562647fc7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.231+0000 7f7d66a1c640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x562648ea9000 0x562647fc7b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Header 0x400000 0x400000 0x40c138 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Starting journal scan from offset 0x400000 2024-09-12T02:29:22.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x562648ea9000 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(3 200.00000001 [read 0~52253 out=52253b] v0'0 uv23 ondisk = 0) ==== 156+0+52253 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 4 Read 0xcc1d bytes from 200.00000001 gap=0 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Parsing data, 0xcc1d bytes available 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x400000 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x30 bytes 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x400000 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x400030 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x37c bytes 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x400030 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x4003ac 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x1bb bytes 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x4003ac 2024-09-12T02:29:22.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x400567 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x32f bytes 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x400567 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x400896 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x6b2 bytes 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x400896 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x400f48 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x7ce bytes 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x400f48 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x401716 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x7ac bytes 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x401716 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x401ec2 2024-09-12T02:29:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x7df bytes 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x401ec2 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x4026a1 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x472 bytes 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x4026a1 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x402b13 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x7a8 bytes 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x402b13 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x4032bb 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xc8c bytes 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x4032bb 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x403f47 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x79a bytes 2024-09-12T02:29:22.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x403f47 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x4046e1 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x78b bytes 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x4046e1 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x404e6c 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xb60 bytes 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x404e6c 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x4059cc 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xb60 bytes 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x4059cc 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40652c 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xb60 bytes 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40652c 2024-09-12T02:29:22.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40708c 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xb63 bytes 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40708c 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x407bef 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x7a8 bytes 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x407bef 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x408397 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xb6e bytes 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x408397 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x408f05 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xb63 bytes 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x408f05 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x409a68 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x681 bytes 2024-09-12T02:29:22.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x409a68 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40a0e9 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xa56 bytes 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40a0e9 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40ab3f 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x8d9 bytes 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40ab3f 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40b418 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x9d0 bytes 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40b418 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40bde8 2024-09-12T02:29:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0xad bytes 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40bde8 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40be95 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x4c bytes 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40be95 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40bee1 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x257 bytes 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40bee1 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40c138 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x472 bytes 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40c138 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Attempting decode at 0x40c5aa 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Consumed 0x673 bytes 2024-09-12T02:29:22.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 10 Valid entry at 0x40c5aa 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x562648ea9c00 0x562647fc7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.232+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x562648ea9c00 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d6621b640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x562648ea9c00 0x562647fc7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d6621b640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x562648ea9c00 0x562647fc7600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 4 Reached end of journal objects 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 4 Scanned objects, 0 missing, 1 valid 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 4 Events scanned, 0 gaps 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 4 Found 29 valid events 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 4 Selected 29 events events for processing 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5626482fe400 0x562648308000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.233+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:5 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x5626482fe400 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5626482fe400 0x562648308000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d65a1a640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5626482fe400 0x562648308000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v1 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:6 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x5626482fe400 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100.00000000 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.234+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:7 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x562648ea9c00 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v1 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:8 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x562648ea9c00 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:9 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff800 con 0x562648ea9000 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.235+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 2 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.236+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:10 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x562648ea9000 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.237+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v33'24 uv24 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.237+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.237+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:11 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x5626482fe400 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.237+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.237+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v3 2024-09-12T02:29:22.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.237+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.237+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:12 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x5626482fe400 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.238+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 4 ==== osd_op_reply(12 1.00000000 [omap-set-header] v33'5 uv5 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.238+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:13 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x5626482fe400 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.239+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 5 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.239+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.239+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.239+0000 7f7d67a74280 4 recover_dentries: writing i dentry rootfile_head into frag 1.00000000 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.239+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.239+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:14 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=563b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482fe400 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 6 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v33'6 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:15 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x562648ea9000 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(15 1.00000000.inode [read 0~582 out=582b] v0'0 uv24 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 3 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.240+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:16 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x562648ea9000 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.241+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 6 ==== osd_op_reply(16 1.00000000.inode [writefull 0~582] v33'25 uv25 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.241+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.241+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:17 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x5626482fe400 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.241+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 7 ==== osd_op_reply(17 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.241+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v3 vs new v5 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.241+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.241+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:18 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482fe400 2024-09-12T02:29:22.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.242+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 8 ==== osd_op_reply(18 1.00000000 [omap-set-header] v33'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.243+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:19 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x5626482fe400 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.243+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 9 ==== osd_op_reply(19 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.243+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.243+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.243+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.243+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.243+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:20 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x5626482fe400 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.244+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 10 ==== osd_op_reply(20 1.00000000 [omap-set-vals] v33'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.244+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.244+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:21 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x562648e7ec00 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.244+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(21 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x562648cd6000 con 0x562648e7ec00 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.244+0000 7f7d67a74280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000001.00000000 (2) No such file or directory 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.244+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.244+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:22 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff800 con 0x562648e7ec00 2024-09-12T02:29:22.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.245+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 3 ==== osd_op_reply(22 10000000001.00000000 [omap-set-header] v33'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6000 con 0x562648e7ec00 2024-09-12T02:29:22.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.245+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:23 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x562648e7ec00 2024-09-12T02:29:22.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 4 ==== osd_op_reply(23 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6000 con 0x562648e7ec00 2024-09-12T02:29:22.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:24 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x562648ea9000 2024-09-12T02:29:22.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 7 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv25 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 4 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.246+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:25 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x562648ea9000 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.248+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 8 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v33'26 uv26 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.248+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.248+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:26 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482fe400 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.249+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 11 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.249+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v5 vs new v7 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.249+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.249+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:27 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482fe400 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 12 ==== osd_op_reply(27 1.00000000 [omap-set-header] v33'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:28 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482fe400 2024-09-12T02:29:22.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 13 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv9 ondisk = 0) ==== 154+0+523 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.250+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:29 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482fe400 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.251+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 14 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v33'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562648cd6000 con 0x5626482fe400 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.251+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.251+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:30 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x562648e7ec00 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.251+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 5 ==== osd_op_reply(30 10000000001.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.251+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v1 vs new v3 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.251+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.251+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:31 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x562648e7ec00 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.252+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 6 ==== osd_op_reply(31 10000000001.00000000 [omap-set-header] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.252+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:32 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x562648e7ec00 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.253+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 7 ==== osd_op_reply(32 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.253+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.253+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.253+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.253+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.253+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:33 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff800 con 0x562648e7ec00 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.254+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 8 ==== osd_op_reply(33 10000000001.00000000 [omap-set-vals] v33'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.254+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.254+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:34 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x5626482fe400 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.254+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 15 ==== osd_op_reply(34 1.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.254+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v7 vs new v9 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.254+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.254+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:35 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x5626482fe400 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 16 ==== osd_op_reply(35 1.00000000 [omap-set-header] v33'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:36 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x5626482fe400 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 17 ==== osd_op_reply(36 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.255+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:37 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x5626482fe400 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.256+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 18 ==== osd_op_reply(37 1.00000000 [omap-set-vals] v33'12 uv12 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.256+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.256+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x5626482ff800 0x562648308580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.257+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:38 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482ff800 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.257+0000 7f7d66a1c640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x5626482ff800 0x562648308580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.257+0000 7f7d66a1c640 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x5626482ff800 0x562648308580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.257+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(38 100000001f7.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.257+0000 7f7d67a74280 4 recover_dentries: failed to read OMAP header from directory fragment 100000001f7.00000000 (2) No such file or directory 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.257+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.257+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:39 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482ff800 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.258+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(39 100000001f7.00000000 [omap-set-header] v33'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.258+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:40 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482ff800 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.258+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(40 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.258+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.258+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.258+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:41 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x562648ea9000 2024-09-12T02:29:22.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.259+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 9 ==== osd_op_reply(41 1.00000000.inode [read 0~582 out=582b] v0'0 uv26 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.259+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.259+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.259+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 5 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.259+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:42 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x562648ea9000 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.260+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 10 ==== osd_op_reply(42 1.00000000.inode [writefull 0~582] v33'27 uv27 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.260+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.260+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:43 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x5626482fe400 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.260+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 19 ==== osd_op_reply(43 1.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.260+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v9 vs new v10 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.260+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.260+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:44 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482fe400 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.261+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 20 ==== osd_op_reply(44 1.00000000 [omap-set-header] v33'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.261+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:45 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x5626482fe400 2024-09-12T02:29:22.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 21 ==== osd_op_reply(45 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:46 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x562648ea9000 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 11 ==== osd_op_reply(46 1.00000000.inode [read 0~582 out=582b] v0'0 uv27 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 6 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.262+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:47 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322000 con 0x562648ea9000 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.263+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 12 ==== osd_op_reply(47 1.00000000.inode [writefull 0~582] v33'28 uv28 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.263+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.263+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:48 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x5626482fe400 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.263+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 22 ==== osd_op_reply(48 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.263+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v10 vs new v12 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.263+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.263+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:49 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322800 con 0x5626482fe400 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.264+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 23 ==== osd_op_reply(49 1.00000000 [omap-set-header] v33'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.264+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:50 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322c00 con 0x5626482fe400 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 24 ==== osd_op_reply(50 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv14 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 11 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.265+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:51 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323000 con 0x5626482fe400 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.266+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 25 ==== osd_op_reply(51 1.00000000 [omap-set-vals] v33'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.266+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.266+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:52 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x5626482ff800 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.266+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(52 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.266+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v1 vs new v3 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.266+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.266+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:53 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x5626482ff800 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(53 100000001f7.00000000 [omap-set-header] v33'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:54 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x5626482ff800 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(54 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link0 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d67a74280 4 recover_dentries: writing i dentry link0_head into frag 100000001f7.00000000 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.267+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:55 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=560b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322000 con 0x5626482ff800 2024-09-12T02:29:22.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.270+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 7 ==== osd_op_reply(55 100000001f7.00000000 [omap-set-vals] v33'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.270+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.270+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:56 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x5626482fe400 2024-09-12T02:29:22.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.270+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 26 ==== osd_op_reply(56 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.270+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v12 vs new v14 2024-09-12T02:29:22.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.270+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.270+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:57 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x5626482fe400 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.271+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 27 ==== osd_op_reply(57 1.00000000 [omap-set-header] v33'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.271+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:58 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x5626482fe400 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 28 ==== osd_op_reply(58 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv16 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 11 vs fullbit version 13 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.272+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:59 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x5626482fe400 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.273+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 29 ==== osd_op_reply(59 1.00000000 [omap-set-vals] v33'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.273+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100.00000000 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.273+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:60 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x562648ea9c00 2024-09-12T02:29:22.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.273+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(60 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.273+0000 7f7d67a74280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v3 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.273+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.273+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:61 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x562648ea9c00 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.274+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 5 ==== osd_op_reply(61 100.00000000 [omap-set-header] v33'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.274+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:62 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x562648ea9c00 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.274+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 6 ==== osd_op_reply(62 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.274+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.274+0000 7f7d67a74280 4 recover_dentries: dentry stray2_head existed already 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.274+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.275+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 1 vs fullbit version 2 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.275+0000 7f7d67a74280 4 recover_dentries: writing i dentry stray2_head into frag 100.00000000 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.275+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.275+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:63 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x562648ea9c00 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.275+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 7 ==== osd_op_reply(63 100.00000000 [omap-set-vals] v33'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.276+0000 7f7d67a74280 4 recover_dentries: inspecting lump 602.00000000 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.276+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:64 4.10 4:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x562648ea9000 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.276+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 13 ==== osd_op_reply(64 602.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.276+0000 7f7d67a74280 4 recover_dentries: frag 602.00000000 fnode old v1 vs new v4 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.276+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.276+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:65 4.10 4:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x562648ea9000 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 14 ==== osd_op_reply(65 602.00000000 [omap-set-header] v33'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:66 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x562648ea9000 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 15 ==== osd_op_reply(66 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 602.00000000/100000001f8 2024-09-12T02:29:22.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d67a74280 4 recover_dentries: writing i dentry 100000001f8_head into frag 602.00000000 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.277+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:67 4.10 4:0bd6d154:::602.00000000:head [omap-set-vals in=580b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x562648ea9000 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.280+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 16 ==== osd_op_reply(67 602.00000000 [omap-set-vals] v33'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.280+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.280+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:68 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482ff800 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.280+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 8 ==== osd_op_reply(68 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.280+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v3 vs new v5 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.280+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.280+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:69 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482ff800 2024-09-12T02:29:22.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.282+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 9 ==== osd_op_reply(69 100000001f7.00000000 [omap-set-header] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.282+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:70 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e000 con 0x5626482ff800 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.283+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 10 ==== osd_op_reply(70 100000001f7.00000000 [omap-get-vals-by-keys out=560b] v0'0 uv4 ondisk = 0) ==== 164+0+560 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.283+0000 7f7d67a74280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link0 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.283+0000 7f7d67a74280 4 recover_dentries: dentry exists, will remove 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.283+0000 7f7d67a74280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn 'link0' with lump fnode version 5vs existing fnode version 3 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.283+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:71 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e400 con 0x5626482ff800 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.285+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 11 ==== osd_op_reply(71 100000001f7.00000000 [omap-rm-keys] v33'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.285+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100.00000000 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.285+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:72 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e800 con 0x562648ea9c00 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.285+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 8 ==== osd_op_reply(72 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.285+0000 7f7d67a74280 4 recover_dentries: frag 100.00000000 fnode old v3 vs new v5 2024-09-12T02:29:22.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.285+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.285+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:73 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831ec00 con 0x562648ea9c00 2024-09-12T02:29:22.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 9 ==== osd_op_reply(73 100.00000000 [omap-set-header] v33'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:74 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831f000 con 0x562648ea9c00 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 10 ==== osd_op_reply(74 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv5 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 4 recover_dentries: dentry stray2_head existed already 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 4 recover_dentries: writing i dentry stray2_head into frag 100.00000000 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.287+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:75 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831f400 con 0x562648ea9c00 2024-09-12T02:29:22.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.289+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 11 ==== osd_op_reply(75 100.00000000 [omap-set-vals] v33'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5626482fb400 con 0x562648ea9c00 2024-09-12T02:29:22.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.289+0000 7f7d67a74280 4 recover_dentries: inspecting lump 602.00000000 2024-09-12T02:29:22.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.289+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:76 4.10 4:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831f800 con 0x562648ea9000 2024-09-12T02:29:22.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.290+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 17 ==== osd_op_reply(76 602.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.290+0000 7f7d67a74280 4 recover_dentries: frag 602.00000000 fnode old v4 vs new v6 2024-09-12T02:29:22.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.290+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.290+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:77 4.10 4:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831fc00 con 0x562648ea9000 2024-09-12T02:29:22.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.290+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 18 ==== osd_op_reply(77 602.00000000 [omap-set-header] v33'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.290+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:78 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e800 con 0x562648ea9000 2024-09-12T02:29:22.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 19 ==== osd_op_reply(78 602.00000000 [omap-get-vals-by-keys out=580b] v0'0 uv11 ondisk = 0) ==== 156+0+580 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 602.00000000/100000001f8 2024-09-12T02:29:22.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d67a74280 4 recover_dentries: dentry 100000001f8_head existed already 2024-09-12T02:29:22.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 3 vs fullbit version 5 2024-09-12T02:29:22.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d67a74280 4 recover_dentries: writing i dentry 100000001f8_head into frag 602.00000000 2024-09-12T02:29:22.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.291+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:79 4.10 4:0bd6d154:::602.00000000:head [omap-set-vals in=542b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e000 con 0x562648ea9000 2024-09-12T02:29:22.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.294+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 20 ==== osd_op_reply(79 602.00000000 [omap-set-vals] v33'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.294+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.294+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:80 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482fe400 2024-09-12T02:29:22.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.294+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 30 ==== osd_op_reply(80 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.294+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v14 vs new v16 2024-09-12T02:29:22.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.294+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.294+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:81 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482fe400 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 31 ==== osd_op_reply(81 1.00000000 [omap-set-header] v33'18 uv18 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:82 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x5626482fe400 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 32 ==== osd_op_reply(82 1.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv18 ondisk = 0) ==== 154+0+523 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 15 2024-09-12T02:29:22.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.295+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:83 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482fe400 2024-09-12T02:29:22.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.296+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 33 ==== osd_op_reply(83 1.00000000 [omap-set-vals] v33'19 uv19 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.296+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.296+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:84 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x562648e7ec00 2024-09-12T02:29:22.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.297+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 9 ==== osd_op_reply(84 10000000001.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.297+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v3 vs new v5 2024-09-12T02:29:22.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.297+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.297+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:85 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x562648e7ec00 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 10 ==== osd_op_reply(85 10000000001.00000000 [omap-set-header] v33'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:86 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x562648e7ec00 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 11 ==== osd_op_reply(86 10000000001.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv6 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 4 recover_dentries: dentry subdirfile_head existed already 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.298+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:87 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=527b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x562648e7ec00 2024-09-12T02:29:22.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.300+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 12 ==== osd_op_reply(87 10000000001.00000000 [omap-set-vals] v33'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.300+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.300+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:88 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x5626482fe400 2024-09-12T02:29:22.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.300+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 34 ==== osd_op_reply(88 1.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.300+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v16 vs new v20 2024-09-12T02:29:22.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.300+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.300+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:89 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x5626482fe400 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 35 ==== osd_op_reply(89 1.00000000 [omap-set-header] v33'20 uv20 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:90 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322000 con 0x5626482fe400 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 36 ==== osd_op_reply(90 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv20 ondisk = 0) ==== 154+0+1043 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 13 vs fullbit version 17 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 15 vs fullbit version 19 2024-09-12T02:29:22.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.301+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:91 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482fe400 2024-09-12T02:29:22.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.302+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 37 ==== osd_op_reply(91 1.00000000 [omap-set-vals] v33'21 uv21 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.302+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.303+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:92 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482ff800 2024-09-12T02:29:22.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.303+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 12 ==== osd_op_reply(92 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.303+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v5 vs new v7 2024-09-12T02:29:22.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.303+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.303+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:93 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322800 con 0x5626482ff800 2024-09-12T02:29:22.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.304+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 13 ==== osd_op_reply(93 100000001f7.00000000 [omap-set-header] v33'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.304+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:94 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322c00 con 0x5626482ff800 2024-09-12T02:29:22.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.304+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 14 ==== osd_op_reply(94 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.304+0000 7f7d67a74280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link0 2024-09-12T02:29:22.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.304+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.304+0000 7f7d67a74280 4 recover_dentries: writing L dentry link0_head into frag 100000001f7.00000000 2024-09-12T02:29:22.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.304+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:95 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323000 con 0x5626482ff800 2024-09-12T02:29:22.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.305+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 15 ==== osd_op_reply(95 100000001f7.00000000 [omap-set-vals] v33'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.305+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.305+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:96 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x562648e7ec00 2024-09-12T02:29:22.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.305+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 13 ==== osd_op_reply(96 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.305+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v5 vs new v7 2024-09-12T02:29:22.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.305+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.305+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:97 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x562648e7ec00 2024-09-12T02:29:22.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 14 ==== osd_op_reply(97 10000000001.00000000 [omap-set-header] v33'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:98 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x562648e7ec00 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 15 ==== osd_op_reply(98 10000000001.00000000 [omap-get-vals-by-keys out=527b] v0'0 uv8 ondisk = 0) ==== 164+0+527 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 4 recover_dentries: dentry subdirfile_head existed already 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.307+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:99 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x562648e7ec00 2024-09-12T02:29:22.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.308+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 16 ==== osd_op_reply(99 10000000001.00000000 [omap-set-vals] v33'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.308+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.308+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:100 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482fe400 2024-09-12T02:29:22.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.308+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 38 ==== osd_op_reply(100 1.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.308+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v20 vs new v24 2024-09-12T02:29:22.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.308+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.308+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:101 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482fe400 2024-09-12T02:29:22.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.309+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 39 ==== osd_op_reply(101 1.00000000 [omap-set-header] v33'22 uv22 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:102 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322800 con 0x5626482fe400 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 40 ==== osd_op_reply(102 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv22 ondisk = 0) ==== 154+0+1043 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 17 vs fullbit version 21 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 19 vs fullbit version 23 2024-09-12T02:29:22.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.310+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:103 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322c00 con 0x5626482fe400 2024-09-12T02:29:22.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.311+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 41 ==== osd_op_reply(103 1.00000000 [omap-set-vals] v33'23 uv23 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.311+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.311+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:104 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323000 con 0x5626482ff800 2024-09-12T02:29:22.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.312+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 16 ==== osd_op_reply(104 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.312+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v7 vs new v9 2024-09-12T02:29:22.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.312+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.312+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:105 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322000 con 0x5626482ff800 2024-09-12T02:29:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.313+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 17 ==== osd_op_reply(105 100000001f7.00000000 [omap-set-header] v33'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.313+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:106 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x5626482ff800 2024-09-12T02:29:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.313+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 18 ==== osd_op_reply(106 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.313+0000 7f7d67a74280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link1 2024-09-12T02:29:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.313+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.313+0000 7f7d67a74280 4 recover_dentries: writing L dentry link1_head into frag 100000001f7.00000000 2024-09-12T02:29:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.313+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:107 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x5626482ff800 2024-09-12T02:29:22.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.314+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 19 ==== osd_op_reply(107 100000001f7.00000000 [omap-set-vals] v33'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.314+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.314+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:108 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x562648e7ec00 2024-09-12T02:29:22.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.314+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 17 ==== osd_op_reply(108 10000000001.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.314+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v7 vs new v9 2024-09-12T02:29:22.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.314+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.314+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:109 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x562648e7ec00 2024-09-12T02:29:22.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.315+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 18 ==== osd_op_reply(109 10000000001.00000000 [omap-set-header] v33'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.315+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:110 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x562648e7ec00 2024-09-12T02:29:22.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 19 ==== osd_op_reply(110 10000000001.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv10 ondisk = 0) ==== 164+0+605 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d67a74280 4 recover_dentries: dentry subdirfile_head existed already 2024-09-12T02:29:22.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 8 2024-09-12T02:29:22.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.316+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:111 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x562648e7ec00 2024-09-12T02:29:22.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.317+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 20 ==== osd_op_reply(111 10000000001.00000000 [omap-set-vals] v33'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.317+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.317+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:112 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x5626482fe400 2024-09-12T02:29:22.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.317+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 42 ==== osd_op_reply(112 1.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.317+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v24 vs new v28 2024-09-12T02:29:22.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.317+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.317+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:113 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482fe400 2024-09-12T02:29:22.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.318+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 43 ==== osd_op_reply(113 1.00000000 [omap-set-header] v33'24 uv24 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.318+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:114 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e400 con 0x5626482fe400 2024-09-12T02:29:22.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 44 ==== osd_op_reply(114 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv24 ondisk = 0) ==== 154+0+1043 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 21 vs fullbit version 25 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 23 vs fullbit version 27 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.319+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:115 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831f800 con 0x5626482fe400 2024-09-12T02:29:22.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.320+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 45 ==== osd_op_reply(115 1.00000000 [omap-set-vals] v33'25 uv25 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.320+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.320+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:116 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831fc00 con 0x5626482ff800 2024-09-12T02:29:22.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.320+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 20 ==== osd_op_reply(116 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.320+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v9 vs new v11 2024-09-12T02:29:22.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.320+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.320+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:117 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e800 con 0x5626482ff800 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.321+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 21 ==== osd_op_reply(117 100000001f7.00000000 [omap-set-header] v33'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.321+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:118 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e000 con 0x5626482ff800 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.321+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 22 ==== osd_op_reply(118 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.321+0000 7f7d67a74280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link2 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.321+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.321+0000 7f7d67a74280 4 recover_dentries: writing L dentry link2_head into frag 100000001f7.00000000 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.321+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:119 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x5626482ff800 2024-09-12T02:29:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.322+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 23 ==== osd_op_reply(119 100000001f7.00000000 [omap-set-vals] v33'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.322+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.322+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:120 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x562648e7ec00 2024-09-12T02:29:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.322+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 21 ==== osd_op_reply(120 10000000001.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.322+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v9 vs new v11 2024-09-12T02:29:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.322+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.322+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:121 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x562648e7ec00 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 22 ==== osd_op_reply(121 10000000001.00000000 [omap-set-header] v33'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:122 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x562648e7ec00 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 23 ==== osd_op_reply(122 10000000001.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv12 ondisk = 0) ==== 164+0+605 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 4 recover_dentries: dentry subdirfile_head existed already 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 10 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.324+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:123 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x562648e7ec00 2024-09-12T02:29:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.325+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 24 ==== osd_op_reply(123 10000000001.00000000 [omap-set-vals] v33'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.325+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.325+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:124 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x5626482fe400 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.325+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 46 ==== osd_op_reply(124 1.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.325+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v28 vs new v32 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.325+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.325+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:125 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x5626482fe400 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 47 ==== osd_op_reply(125 1.00000000 [omap-set-header] v33'26 uv26 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:126 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322800 con 0x5626482fe400 2024-09-12T02:29:22.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 48 ==== osd_op_reply(126 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv26 ondisk = 0) ==== 154+0+1043 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 25 vs fullbit version 29 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 27 vs fullbit version 31 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.326+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:127 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322c00 con 0x5626482fe400 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.327+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 49 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v33'27 uv27 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.328+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.328+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:128 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x562648e7ec00 2024-09-12T02:29:22.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.328+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 25 ==== osd_op_reply(128 10000000001.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.328+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v11 vs new v13 2024-09-12T02:29:22.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.328+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.328+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:129 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x562648e7ec00 2024-09-12T02:29:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 26 ==== osd_op_reply(129 10000000001.00000000 [omap-set-header] v33'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:130 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x562648e7ec00 2024-09-12T02:29:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 27 ==== osd_op_reply(130 10000000001.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv14 ondisk = 0) ==== 164+0+605 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 4 recover_dentries: dentry subdirfile_head existed already 2024-09-12T02:29:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 10 vs fullbit version 12 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.329+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:131 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=619b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x562648e7ec00 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.330+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 28 ==== osd_op_reply(131 10000000001.00000000 [omap-set-vals] v33'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482fa780 con 0x562648e7ec00 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.330+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.330+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:132 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x5626482ff800 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.330+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 24 ==== osd_op_reply(132 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.330+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v11 vs new v13 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.330+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.330+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:133 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x5626482ff800 2024-09-12T02:29:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.331+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 25 ==== osd_op_reply(133 100000001f7.00000000 [omap-set-header] v33'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.331+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:134 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322800 con 0x5626482ff800 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.331+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 26 ==== osd_op_reply(134 100000001f7.00000000 [omap-get-vals-by-keys out=50b] v0'0 uv12 ondisk = 0) ==== 164+0+50 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.331+0000 7f7d67a74280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link2 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.331+0000 7f7d67a74280 4 recover_dentries: dentry exists, will remove 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.331+0000 7f7d67a74280 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link2' with lump fnode version 13vs existing fnode version 11 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.331+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:135 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x5626482ff800 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.332+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 27 ==== osd_op_reply(135 100000001f7.00000000 [omap-rm-keys] v33'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.332+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.332+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:136 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x5626482fe400 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.333+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 50 ==== osd_op_reply(136 1.00000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.333+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v32 vs new v34 2024-09-12T02:29:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.333+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.333+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:137 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x5626482fe400 2024-09-12T02:29:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 51 ==== osd_op_reply(137 1.00000000 [omap-set-header] v33'28 uv28 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:138 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e400 con 0x5626482fe400 2024-09-12T02:29:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 52 ==== osd_op_reply(138 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv28 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 29 vs fullbit version 33 2024-09-12T02:29:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.334+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:139 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831f800 con 0x5626482fe400 2024-09-12T02:29:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.335+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 53 ==== osd_op_reply(139 1.00000000 [omap-set-vals] v33'29 uv29 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482fa780 con 0x5626482fe400 2024-09-12T02:29:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.335+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.335+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:140 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x5626482ff800 2024-09-12T02:29:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.336+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 28 ==== osd_op_reply(140 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.336+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v13 vs new v15 2024-09-12T02:29:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.336+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.336+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:141 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482ff800 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 29 ==== osd_op_reply(141 100000001f7.00000000 [omap-set-header] v33'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:142 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323000 con 0x5626482ff800 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 30 ==== osd_op_reply(142 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d67a74280 4 recover_dentries: writing i dentry link2_head into frag 100000001f7.00000000 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.337+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:143 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=560b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322000 con 0x5626482ff800 2024-09-12T02:29:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.338+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 31 ==== osd_op_reply(143 100000001f7.00000000 [omap-set-vals] v33'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.338+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.338+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:144 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x5626482fe400 2024-09-12T02:29:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.338+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 54 ==== osd_op_reply(144 1.00000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.338+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v34 vs new v38 2024-09-12T02:29:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.338+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.338+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:145 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x5626482fe400 2024-09-12T02:29:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.339+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 55 ==== osd_op_reply(145 1.00000000 [omap-set-header] v33'30 uv30 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.339+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:146 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x5626482fe400 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 56 ==== osd_op_reply(146 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv30 ondisk = 0) ==== 154+0+1043 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 33 vs fullbit version 35 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 31 vs fullbit version 37 2024-09-12T02:29:22.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.340+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:147 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x5626482fe400 2024-09-12T02:29:22.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.341+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 57 ==== osd_op_reply(147 1.00000000 [omap-set-vals] v33'31 uv31 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.341+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.341+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:148 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x5626482ff800 2024-09-12T02:29:22.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.341+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 32 ==== osd_op_reply(148 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.341+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v15 vs new v17 2024-09-12T02:29:22.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.341+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.341+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:149 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831fc00 con 0x5626482ff800 2024-09-12T02:29:22.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.342+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 33 ==== osd_op_reply(149 100000001f7.00000000 [omap-set-header] v33'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.342+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:150 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e800 con 0x5626482ff800 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.343+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 34 ==== osd_op_reply(150 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.343+0000 7f7d67a74280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.343+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.343+0000 7f7d67a74280 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.343+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:151 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e000 con 0x5626482ff800 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.344+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 35 ==== osd_op_reply(151 100000001f7.00000000 [omap-set-vals] v33'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.344+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.344+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:152 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x562648e7ec00 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.344+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 29 ==== osd_op_reply(152 10000000001.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.344+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v13 vs new v15 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.344+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.344+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:153 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x562648e7ec00 2024-09-12T02:29:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 30 ==== osd_op_reply(153 10000000001.00000000 [omap-set-header] v33'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:154 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x562648e7ec00 2024-09-12T02:29:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 31 ==== osd_op_reply(154 10000000001.00000000 [omap-get-vals-by-keys out=619b] v0'0 uv16 ondisk = 0) ==== 164+0+619 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 4 recover_dentries: dentry subdirfile_head existed already 2024-09-12T02:29:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 12 vs fullbit version 14 2024-09-12T02:29:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.345+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:155 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=619b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x562648e7ec00 2024-09-12T02:29:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.346+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 32 ==== osd_op_reply(155 10000000001.00000000 [omap-set-vals] v33'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.346+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.346+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:156 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322c00 con 0x5626482fe400 2024-09-12T02:29:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.346+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 58 ==== osd_op_reply(156 1.00000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.346+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v38 vs new v42 2024-09-12T02:29:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.346+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.346+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:157 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x5626482fe400 2024-09-12T02:29:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.347+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 59 ==== osd_op_reply(157 1.00000000 [omap-set-header] v33'32 uv32 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:158 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x5626482fe400 2024-09-12T02:29:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 60 ==== osd_op_reply(158 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv32 ondisk = 0) ==== 154+0+1043 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 35 vs fullbit version 39 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 37 vs fullbit version 41 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.348+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:159 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x5626482fe400 2024-09-12T02:29:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.349+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 61 ==== osd_op_reply(159 1.00000000 [omap-set-vals] v33'33 uv33 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.349+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.349+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:160 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x562648e7ec00 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.349+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 33 ==== osd_op_reply(160 10000000001.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.349+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v15 vs new v17 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.349+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.349+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:161 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e400 con 0x562648e7ec00 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.350+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 34 ==== osd_op_reply(161 10000000001.00000000 [omap-set-header] v33'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.350+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:162 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831f800 con 0x562648e7ec00 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 35 ==== osd_op_reply(162 10000000001.00000000 [omap-get-vals-by-keys out=619b] v0'0 uv18 ondisk = 0) ==== 164+0+619 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 4 recover_dentries: dentry subdirfile_head existed already 2024-09-12T02:29:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 16 2024-09-12T02:29:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-12T02:29:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:163 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=619b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x562648e7ec00 2024-09-12T02:29:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 36 ==== osd_op_reply(163 10000000001.00000000 [omap-set-vals] v33'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5626482faa00 con 0x562648e7ec00 2024-09-12T02:29:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.351+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:164 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482ff800 2024-09-12T02:29:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.352+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 36 ==== osd_op_reply(164 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.352+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v17 vs new v19 2024-09-12T02:29:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.352+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.352+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:165 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648e7fc00 con 0x5626482ff800 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.353+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 37 ==== osd_op_reply(165 100000001f7.00000000 [omap-set-header] v33'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.353+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:166 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831fc00 con 0x5626482ff800 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.353+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 38 ==== osd_op_reply(166 100000001f7.00000000 [omap-get-vals-by-keys out=50b] v0'0 uv18 ondisk = 0) ==== 164+0+50 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.353+0000 7f7d67a74280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link3 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.353+0000 7f7d67a74280 4 recover_dentries: dentry exists, will remove 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.353+0000 7f7d67a74280 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link3' with lump fnode version 19vs existing fnode version 17 2024-09-12T02:29:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.353+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:167 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e800 con 0x5626482ff800 2024-09-12T02:29:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.354+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 39 ==== osd_op_reply(167 100000001f7.00000000 [omap-rm-keys] v33'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.354+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.354+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:168 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e000 con 0x5626482fe400 2024-09-12T02:29:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.354+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 62 ==== osd_op_reply(168 1.00000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.354+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v42 vs new v44 2024-09-12T02:29:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.354+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.354+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:169 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x5626482fe400 2024-09-12T02:29:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.355+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 63 ==== osd_op_reply(169 1.00000000 [omap-set-header] v33'34 uv34 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:170 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x5626482fe400 2024-09-12T02:29:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 64 ==== osd_op_reply(170 1.00000000 [omap-get-vals-by-keys out=563b] v0'0 uv34 ondisk = 0) ==== 154+0+563 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-09-12T02:29:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 4 recover_dentries: dentry rootfile_head existed already 2024-09-12T02:29:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 43 2024-09-12T02:29:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 4 recover_dentries: writing i dentry rootfile_head into frag 1.00000000 2024-09-12T02:29:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.356+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:171 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322800 con 0x5626482fe400 2024-09-12T02:29:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 65 ==== osd_op_reply(171 1.00000000 [omap-set-vals] v33'35 uv35 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:172 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323000 con 0x562648ea9000 2024-09-12T02:29:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 21 ==== osd_op_reply(172 1.00000000.inode [read 0~582 out=582b] v0'0 uv28 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 7 2024-09-12T02:29:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.358+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:173 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322000 con 0x562648ea9000 2024-09-12T02:29:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.359+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 22 ==== osd_op_reply(173 1.00000000.inode [writefull 0~582] v33'29 uv29 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.359+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.359+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:174 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x5626482fe400 2024-09-12T02:29:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.360+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 66 ==== osd_op_reply(174 1.00000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.360+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v44 vs new v48 2024-09-12T02:29:22.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.360+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.360+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:175 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x5626482fe400 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.360+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 67 ==== osd_op_reply(175 1.00000000 [omap-set-header] v33'36 uv36 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:176 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=37b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x5626482fe400 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 68 ==== osd_op_reply(176 1.00000000 [omap-get-vals-by-keys out=1045b] v0'0 uv36 ondisk = 0) ==== 154+0+1045 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 39 vs fullbit version 46 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-09-12T02:29:22.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: dentry rootfile_head existed already 2024-09-12T02:29:22.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 43 vs fullbit version 45 2024-09-12T02:29:22.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 4 recover_dentries: writing i dentry rootfile_head into frag 1.00000000 2024-09-12T02:29:22.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.361+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:177 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1123b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x5626482fe400 2024-09-12T02:29:22.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.366+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 69 ==== osd_op_reply(177 1.00000000 [omap-set-vals] v33'37 uv37 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.366+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.366+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:178 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x5626482ff800 2024-09-12T02:29:22.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.367+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 40 ==== osd_op_reply(178 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.367+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v19 vs new v21 2024-09-12T02:29:22.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.367+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.367+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:179 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x5626482ff800 2024-09-12T02:29:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.368+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 41 ==== osd_op_reply(179 100000001f7.00000000 [omap-set-header] v33'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.368+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:180 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x5626482ff800 2024-09-12T02:29:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.368+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 42 ==== osd_op_reply(180 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.368+0000 7f7d67a74280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2024-09-12T02:29:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.368+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.368+0000 7f7d67a74280 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2024-09-12T02:29:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.368+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:181 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e400 con 0x5626482ff800 2024-09-12T02:29:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 43 ==== osd_op_reply(181 100000001f7.00000000 [omap-set-vals] v33'21 uv21 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:182 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831f800 con 0x562648ea9000 2024-09-12T02:29:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 23 ==== osd_op_reply(182 1.00000000.inode [read 0~582 out=582b] v0'0 uv29 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.369+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 8 2024-09-12T02:29:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.370+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:183 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e000 con 0x562648ea9000 2024-09-12T02:29:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.371+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 24 ==== osd_op_reply(183 1.00000000.inode [writefull 0~582] v33'30 uv30 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562648cd6500 con 0x562648ea9000 2024-09-12T02:29:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.371+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.371+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:184 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x5626482fe400 2024-09-12T02:29:22.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.371+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 70 ==== osd_op_reply(184 1.00000000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.371+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v48 vs new v50 2024-09-12T02:29:22.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.371+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.371+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:185 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322c00 con 0x5626482fe400 2024-09-12T02:29:22.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 71 ==== osd_op_reply(185 1.00000000 [omap-set-header] v33'38 uv38 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:186 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x5626482fe400 2024-09-12T02:29:22.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 72 ==== osd_op_reply(186 1.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv38 ondisk = 0) ==== 154+0+523 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-12T02:29:22.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 4 recover_dentries: dentry subdir_head existed already 2024-09-12T02:29:22.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 41 vs fullbit version 49 2024-09-12T02:29:22.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-12T02:29:22.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.372+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:187 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x5626482fe400 2024-09-12T02:29:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.375+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 73 ==== osd_op_reply(187 1.00000000 [omap-set-vals] v33'39 uv39 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5626482faa00 con 0x5626482fe400 2024-09-12T02:29:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.375+0000 7f7d67a74280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-12T02:29:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.375+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:188 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x562648e7ec00 2024-09-12T02:29:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.375+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 37 ==== osd_op_reply(188 10000000001.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x56264836e000 con 0x562648e7ec00 2024-09-12T02:29:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.375+0000 7f7d67a74280 4 recover_dentries: frag 10000000001.00000000 fnode old v17 vs new v19 2024-09-12T02:29:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.375+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.375+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:189 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x562648e7ec00 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 38 ==== osd_op_reply(189 10000000001.00000000 [omap-set-header] v33'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56264836e000 con 0x562648e7ec00 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:190 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=22b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264837e000 con 0x562648e7ec00 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 39 ==== osd_op_reply(190 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x56264836e000 con 0x562648e7ec00 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subsubdir 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d67a74280 4 recover_dentries: dentry did not already exist, will create 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d67a74280 4 recover_dentries: writing i dentry subsubdir_head into frag 10000000001.00000000 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.376+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:191 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=526b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264837e400 con 0x562648e7ec00 2024-09-12T02:29:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.377+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.1 v2:172.21.15.181:6826/1372590643 40 ==== osd_op_reply(191 10000000001.00000000 [omap-set-vals] v33'21 uv21 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56264836e000 con 0x562648e7ec00 2024-09-12T02:29:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.377+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001fa.00000000 2024-09-12T02:29:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.377+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:192 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264837e800 con 0x5626482fe400 2024-09-12T02:29:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.378+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 74 ==== osd_op_reply(192 100000001fa.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x56264836e000 con 0x5626482fe400 2024-09-12T02:29:22.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.378+0000 7f7d67a74280 4 recover_dentries: failed to read OMAP header from directory fragment 100000001fa.00000000 (2) No such file or directory 2024-09-12T02:29:22.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.378+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.378+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:193 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264837ec00 con 0x5626482fe400 2024-09-12T02:29:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.381+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 75 ==== osd_op_reply(193 100000001fa.00000000 [omap-set-header] v33'40 uv40 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56264836e000 con 0x5626482fe400 2024-09-12T02:29:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.381+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:194 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264837f000 con 0x5626482fe400 2024-09-12T02:29:22.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.382+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 76 ==== osd_op_reply(194 100000001fa.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x56264836e000 con 0x5626482fe400 2024-09-12T02:29:22.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.382+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.382+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:195 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264837f400 con 0x5626482fe400 2024-09-12T02:29:22.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.382+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 77 ==== osd_op_reply(195 1.00000000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x56264836e000 con 0x5626482fe400 2024-09-12T02:29:22.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.382+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v50 vs new v52 2024-09-12T02:29:22.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.382+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.382+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:196 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264837f800 con 0x5626482fe400 2024-09-12T02:29:22.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 78 ==== osd_op_reply(196 1.00000000 [omap-set-header] v33'41 uv41 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x56264836e000 con 0x5626482fe400 2024-09-12T02:29:22.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:197 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264837fc00 con 0x5626482fe400 2024-09-12T02:29:22.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 79 ==== osd_op_reply(197 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv41 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x56264836e000 con 0x5626482fe400 2024-09-12T02:29:22.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-12T02:29:22.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 4 recover_dentries: dentry linkdir_head existed already 2024-09-12T02:29:22.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 46 vs fullbit version 51 2024-09-12T02:29:22.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-12T02:29:22.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.383+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:198 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264837e000 con 0x5626482fe400 2024-09-12T02:29:22.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.386+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 80 ==== osd_op_reply(198 1.00000000 [omap-set-vals] v33'42 uv42 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x56264836e000 con 0x5626482fe400 2024-09-12T02:29:22.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.386+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-12T02:29:22.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.386+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:199 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264837e400 con 0x5626482ff800 2024-09-12T02:29:22.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.386+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 44 ==== osd_op_reply(199 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.386+0000 7f7d67a74280 4 recover_dentries: frag 100000001f7.00000000 fnode old v21 vs new v23 2024-09-12T02:29:22.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.386+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.386+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:200 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264837e800 con 0x5626482ff800 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 45 ==== osd_op_reply(200 100000001f7.00000000 [omap-set-header] v33'22 uv22 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:201 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648322800 con 0x5626482ff800 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 46 ==== osd_op_reply(201 100000001f7.00000000 [omap-get-vals-by-keys out=560b] v0'0 uv22 ondisk = 0) ==== 164+0+560 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 4 recover_dentries: dentry link2_head existed already 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 22 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 4 recover_dentries: writing i dentry link2_head into frag 100000001f7.00000000 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.387+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:202 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=522b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322c00 con 0x5626482ff800 2024-09-12T02:29:22.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.388+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.0 v2:172.21.15.181:6816/2346029807 47 ==== osd_op_reply(202 100000001f7.00000000 [omap-set-vals] v33'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562648cd6500 con 0x5626482ff800 2024-09-12T02:29:22.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.388+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.388+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.388+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:203 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323400 con 0x562648ea9000 2024-09-12T02:29:22.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.388+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 25 ==== osd_op_reply(203 1.00000000.inode [read 0~582 out=582b] v0'0 uv30 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.388+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.388+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.389+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 9 2024-09-12T02:29:22.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.389+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:204 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648323800 con 0x562648ea9000 2024-09-12T02:29:22.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.389+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 26 ==== osd_op_reply(204 1.00000000.inode [writefull 0~582] v33'31 uv31 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.390+0000 7f7d67a74280 4 recover_dentries: inspecting lump 602.00000000 2024-09-12T02:29:22.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.390+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:205 4.10 4:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648323c00 con 0x562648ea9000 2024-09-12T02:29:22.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.390+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 27 ==== osd_op_reply(205 602.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.390+0000 7f7d67a74280 4 recover_dentries: frag 602.00000000 fnode old v6 vs new v8 2024-09-12T02:29:22.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.390+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.390+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:206 4.10 4:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562648322400 con 0x562648ea9000 2024-09-12T02:29:22.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.391+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 28 ==== osd_op_reply(206 602.00000000 [omap-set-header] v33'13 uv13 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.391+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:207 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648e7f000 con 0x562648ea9000 2024-09-12T02:29:22.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.391+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 29 ==== osd_op_reply(207 602.00000000 [omap-get-vals-by-keys out=542b] v0'0 uv13 ondisk = 0) ==== 156+0+542 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.391+0000 7f7d67a74280 4 recover_dentries: inspecting nullbit 602.00000000/100000001f8 2024-09-12T02:29:22.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.391+0000 7f7d67a74280 4 recover_dentries: dentry exists, will remove 2024-09-12T02:29:22.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.391+0000 7f7d67a74280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '100000001f8' with lump fnode version 8vs existing fnode version 6 2024-09-12T02:29:22.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.391+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:208 4.10 4:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff400 con 0x562648ea9000 2024-09-12T02:29:22.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.392+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 30 ==== osd_op_reply(208 602.00000000 [omap-rm-keys] v33'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.392+0000 7f7d67a74280 4 recover_dentries: inspecting lump 1.00000000 2024-09-12T02:29:22.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.392+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:209 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482ffc00 con 0x5626482fe400 2024-09-12T02:29:22.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.393+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 81 ==== osd_op_reply(209 1.00000000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x56264836ea00 con 0x5626482fe400 2024-09-12T02:29:22.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.393+0000 7f7d67a74280 4 recover_dentries: frag 1.00000000 fnode old v52 vs new v53 2024-09-12T02:29:22.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.393+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.393+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:210 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482ff000 con 0x5626482fe400 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 82 ==== osd_op_reply(210 1.00000000 [omap-set-header] v33'43 uv43 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x56264836ea00 con 0x5626482fe400 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:211 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9400 con 0x5626482fe400 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 83 ==== osd_op_reply(211 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv43 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x56264836ea00 con 0x5626482fe400 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 4 recover_dentries: updating root 0x1 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 4 recover_dentries: object id 1.00000000.inode 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:212 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562648ea9800 con 0x562648ea9000 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 31 ==== osd_op_reply(212 1.00000000.inode [read 0~582 out=582b] v0'0 uv31 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 4 recover_dentries: writing root ino 1.00000000.inode version 10 2024-09-12T02:29:22.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.394+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:213 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264837e400 con 0x562648ea9000 2024-09-12T02:29:22.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.395+0000 7f7d66a1c640 1 -- 172.21.15.181:0/1176933456 <== osd.3 v2:172.21.15.181:6800/1415662156 32 ==== osd_op_reply(213 1.00000000.inode [writefull 0~582] v33'32 uv32 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5626482fbb80 con 0x562648ea9000 2024-09-12T02:29:22.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.395+0000 7f7d67a74280 4 recover_dentries: inspecting lump 100.00000000 2024-09-12T02:29:22.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.395+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:214 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831fc00 con 0x562648ea9c00 2024-09-12T02:29:22.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.395+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 12 ==== osd_op_reply(214 100.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x56264836fb80 con 0x562648ea9c00 2024-09-12T02:29:22.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.395+0000 7f7d67a74280 4 recover_dentries: frag 100.00000000 fnode old v5 vs new v7 2024-09-12T02:29:22.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.395+0000 7f7d67a74280 4 recover_dentries: writing fnode to omap header 2024-09-12T02:29:22.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.395+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:215 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831e800 con 0x562648ea9c00 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.396+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 13 ==== osd_op_reply(215 100.00000000 [omap-set-header] v33'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56264836fb80 con 0x562648ea9c00 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.396+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:216 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e400 con 0x562648ea9c00 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 14 ==== osd_op_reply(216 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv7 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x56264836fb80 con 0x562648ea9c00 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d67a74280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d67a74280 4 recover_dentries: dentry stray2_head existed already 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d67a74280 4 recover_dentries: dentry exists, checking versions... 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d67a74280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d67a74280 4 recover_dentries: writing i dentry stray2_head into frag 100.00000000 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d67a74280 20 recover_dentries: dnfirst = 2 2024-09-12T02:29:22.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.397+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:217 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56264831f800 con 0x562648ea9c00 2024-09-12T02:29:22.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 15 ==== osd_op_reply(217 100.00000000 [omap-set-vals] v33'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56264836fb80 con 0x562648ea9c00 2024-09-12T02:29:22.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d67a74280 4 recover_dentries: updating root 0x100 2024-09-12T02:29:22.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d67a74280 4 recover_dentries: object id 100.00000000.inode 2024-09-12T02:29:22.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:218 4.1f 4:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56264831e000 con 0x5626482fe400 2024-09-12T02:29:22.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 84 ==== osd_op_reply(218 100.00000000.inode [read 0~582 out=582b] v0'0 uv3 ondisk = 0) ==== 162+0+582 (crc 0 0 0) 0x56264836ea00 con 0x5626482fe400 2024-09-12T02:29:22.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d67a74280 4 recover_dentries: root exists, will modify (582) 2024-09-12T02:29:22.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d67a74280 4 recover_dentries: magic ok 2024-09-12T02:29:22.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d67a74280 4 recover_dentries: writing root ino 100.00000000.inode version 2 2024-09-12T02:29:22.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.398+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:219 4.1f 4:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe800 con 0x5626482fe400 2024-09-12T02:29:22.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d65a1a640 1 -- 172.21.15.181:0/1176933456 <== osd.6 v2:172.21.15.204:6800/2226411884 85 ==== osd_op_reply(219 100.00000000.inode [writefull 0~582] v33'44 uv44 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x56264836ea00 con 0x5626482fe400 2024-09-12T02:29:22.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 main_event: consumed 8 inodes 2024-09-12T02:29:22.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:220 4.13 4:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626482fe000 con 0x562648ea9c00 2024-09-12T02:29:22.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 16 ==== osd_op_reply(220 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x56264836fb80 con 0x562648ea9c00 2024-09-12T02:29:22.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: Used ino 0x10000000000 requires inotable update 2024-09-12T02:29:22.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: Used ino 0x10000000001 requires inotable update 2024-09-12T02:29:22.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: Used ino 0x10000000002 requires inotable update 2024-09-12T02:29:22.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: Used ino 0x100000001f7 requires inotable update 2024-09-12T02:29:22.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: Used ino 0x100000001f8 requires inotable update 2024-09-12T02:29:22.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: Used ino 0x100000001f9 requires inotable update 2024-09-12T02:29:22.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: Used ino 0x100000001fa requires inotable update 2024-09-12T02:29:22.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 4 consume_inos: writing modified inotable version 1 2024-09-12T02:29:22.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.401+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:221 4.13 4:c91d4a1d:::mds0_inotable:head [writefull 0~50 in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626482fec00 con 0x562648ea9c00 2024-09-12T02:29:22.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.402+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 <== osd.4 v2:172.21.15.204:6816/3702049597 17 ==== osd_op_reply(221 mds0_inotable [writefull 0~50] v33'9 uv9 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x56264836fb80 con 0x562648ea9c00 2024-09-12T02:29:22.404 INFO:teuthology.orchestra.run.smithi181.stdout:0.000000 0x400000 LID: () 2024-09-12T02:29:22.404 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:02.610233+0000 0x400030 SUBTREEMAP: () 2024-09-12T02:29:22.404 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:12.686578+0000 0x4003ac SESSION: () 2024-09-12T02:29:22.404 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.049119+0000 0x400567 UPDATE: (setattr) 2024-09-12T02:29:22.404 INFO:teuthology.orchestra.run.smithi181.stdout: / 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.109905+0000 0x400896 UPDATE: (openc) 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout: rootfile 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.171743+0000 0x400f48 UPDATE: (mkdir) 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout: subdir 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.232672+0000 0x401716 UPDATE: (openc) 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.291241+0000 0x401ec2 UPDATE: (mkdir) 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.349391+0000 0x4026a1 UPDATE: (scatter_writebehind) 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.351538+0000 0x402b13 UPDATE: (openc) 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link0 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.409663+0000 0x4032bb UPDATE: (unlink_local) 2024-09-12T02:29:22.405 INFO:teuthology.orchestra.run.smithi181.stdout: stray2/100000001f8 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link0 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.409953+0000 0x403f47 UPDATE: (cap update) 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: stray2/100000001f8 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.467365+0000 0x4046e1 UPDATE: (cap update) 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.468040+0000 0x404e6c UPDATE: (link_local) 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link0 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.526617+0000 0x4059cc UPDATE: (link_local) 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link1 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.584497+0000 0x40652c UPDATE: (link_local) 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link2 2024-09-12T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.644941+0000 0x40708c UPDATE: (unlink_local) 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link2 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.702854+0000 0x407bef UPDATE: (openc) 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link2 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.762260+0000 0x408397 UPDATE: (link_local) 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link3 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.821739+0000 0x408f05 UPDATE: (unlink_local) 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subdirfile 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link3 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.878651+0000 0x409a68 UPDATE: (cap update) 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: rootfile 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.879306+0000 0x40a0e9 UPDATE: (link_local) 2024-09-12T02:29:22.407 INFO:teuthology.orchestra.run.smithi181.stdout: rootfile 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link3 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:13.936745+0000 0x40ab3f UPDATE: (mkdir) 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout: subdir/subsubdir 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:15.497089+0000 0x40b418 UPDATE: (cap update) 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout: linkdir/link2 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:15.498935+0000 0x40bde8 SESSION: () 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout:0.000000 0x40be95 PURGED: () 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:15.621668+0000 0x40bee1 UPDATE: (purge_stray) 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout: 100000001f8 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:20.712706+0000 0x40c138 UPDATE: (scatter_writebehind) 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout:2024-09-12T02:29:20.712875+0000 0x40c5aa UPDATE: (scatter_writebehind) 2024-09-12T02:29:22.408 INFO:teuthology.orchestra.run.smithi181.stdout: stray2 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 4 29 events 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x5626482ff800 msgr2=0x562648308580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x5626482ff800 0x562648308580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562648e7ec00 msgr2=0x562647fc8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562648e7ec00 0x562647fc8100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x562648ea9000 msgr2=0x562647fc7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x562648ea9000 0x562647fc7b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x562648ea9c00 msgr2=0x562647fc7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x562648ea9c00 0x562647fc7600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 reap_dead start 2024-09-12T02:29:22.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5626482fe400 msgr2=0x562648308000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5626482fe400 0x562648308000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d6621b640 1 -- 172.21.15.181:0/1176933456 reap_dead start 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562648ea8c00 msgr2=0x562647fc9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562648ea8c00 0x562647fc9700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x562648e2a810 tx=0x562648e30c00 comp rx=0 tx=0).stop 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e000 msgr2=0x562647fc9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e000 0x562647fc9180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x562648e2bb00 tx=0x562648e30e40 comp rx=0 tx=0).stop 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 shutdown_connections 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5626482fe400 0x562648308000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562648ea8c00 0x562647fc9700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/1176933456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562648e7e000 0x562647fc9180 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 >> 172.21.15.181:0/1176933456 conn(0x562648cebc00 msgr2=0x562648037000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 shutdown_connections 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/1176933456 wait complete. 2024-09-12T02:29:22.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/4002528187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562647f4bc00 msgr2=0x562647fc7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562647f4bc00 0x562647fc7080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x562648d6b740 tx=0x562648cec840 comp rx=0 tx=0).stop 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/4002528187 shutdown_connections 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562647f4bc00 0x562647fc7080 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562647f4b800 0x562647fc6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 --2- 172.21.15.181:0/4002528187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562647f4ac00 0x562647fc6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/4002528187 >> 172.21.15.181:0/4002528187 conn(0x562647f4b000 msgr2=0x562648036800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/4002528187 shutdown_connections 2024-09-12T02:29:22.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.403+0000 7f7d67a74280 1 -- 172.21.15.181:0/4002528187 wait complete. 2024-09-12T02:29:22.413 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'list'] in time 0:00:00.271703, result: 0.000000 0x400000 LID: () 2024-09-12T02:29:02.610233+0000 0x400030 SUBTREEMAP: () 2024-09-12T02:29:12.686578+0000 0x4003ac SESSION: () 2024-09-12T02:29:13.049119+0000 0x400567 UPDATE: (setattr) / 2024-09-12T02:29:13.109905+0000 0x400896 UPDATE: (openc) rootfile 2024-09-12T02:29:13.171743+0000 0x400f48 UPDATE: (mkdir) subdir 2024-09-12T02:29:13.232672+0000 0x401716 UPDATE: (openc) subdir/subdirfile 2024-09-12T02:29:13.291241+0000 0x401ec2 UPDATE: (mkdir) linkdir 2024-09-12T02:29:13.349391+0000 0x4026a1 UPDATE: (scatter_writebehind) 2024-09-12T02:29:13.351538+0000 0x402b13 UPDATE: (openc) linkdir/link0 2024-09-12T02:29:13.409663+0000 0x4032bb UPDATE: (unlink_local) stray2/100000001f8 linkdir/link0 2024-09-12T02:29:13.409953+0000 0x403f47 UPDATE: (cap update) stray2/100000001f8 2024-09-12T02:29:13.467365+0000 0x4046e1 UPDATE: (cap update) subdir/subdirfile 2024-09-12T02:29:13.468040+0000 0x404e6c UPDATE: (link_local) subdir/subdirfile linkdir/link0 2024-09-12T02:29:13.526617+0000 0x4059cc UPDATE: (link_local) subdir/subdirfile linkdir/link1 2024-09-12T02:29:13.584497+0000 0x40652c UPDATE: (link_local) subdir/subdirfile linkdir/link2 2024-09-12T02:29:13.644941+0000 0x40708c UPDATE: (unlink_local) subdir/subdirfile linkdir/link2 2024-09-12T02:29:13.702854+0000 0x407bef UPDATE: (openc) linkdir/link2 2024-09-12T02:29:13.762260+0000 0x408397 UPDATE: (link_local) subdir/subdirfile linkdir/link3 2024-09-12T02:29:13.821739+0000 0x408f05 UPDATE: (unlink_local) subdir/subdirfile linkdir/link3 2024-09-12T02:29:13.878651+0000 0x409a68 UPDATE: (cap update) rootfile 2024-09-12T02:29:13.879306+0000 0x40a0e9 UPDATE: (link_local) rootfile linkdir/link3 2024-09-12T02:29:13.936745+0000 0x40ab3f UPDATE: (mkdir) subdir/subsubdir 2024-09-12T02:29:15.497089+0000 0x40b418 UPDATE: (cap update) linkdir/link2 2024-09-12T02:29:15.498935+0000 0x40bde8 SESSION: () 0.000000 0x40be95 PURGED: () 2024-09-12T02:29:15.621668+0000 0x40bee1 UPDATE: (purge_stray) 100000001f8 2024-09-12T02:29:20.712706+0000 0x40c138 UPDATE: (scatter_writebehind) 2024-09-12T02:29:20.712875+0000 0x40c5aa UPDATE: (scatter_writebehind) stray2 2024-09-12T02:29:22.413 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-09-12T02:29:22.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.493+0000 7f8bd3996f40 1 Processor -- start 2024-09-12T02:29:22.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.493+0000 7f8bd3996f40 1 -- start start 2024-09-12T02:29:22.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd3996f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd3996f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43c15d0 0x5583b434f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd3996f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43e12f0 0x5583b4336cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd3996f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5583b4352bb0 con 0x5583b43c15d0 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd3996f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5583b43c22f0 con 0x5583b43e12f0 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd3996f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5583b434f0b0 con 0x5583b4352200 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43c15d0 0x5583b434f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43c15d0 0x5583b434f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46080/0 (socket says 172.21.15.181:46080) 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 -- 172.21.15.181:0/4157524590 learned_addr learned my addr 172.21.15.181:0/4157524590 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd1c8d640 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43e12f0 0x5583b4336cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd148c640 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 -- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 msgr2=0x5583b43dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 -- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43e12f0 msgr2=0x5583b4336cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43e12f0 0x5583b4336cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 -- 172.21.15.181:0/4157524590 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4233cb0 con 0x5583b43c15d0 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bd148c640 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bc8c8b640 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43c15d0 0x5583b434f4d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc025da0 tx=0x7f8bbc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4294f17cf6a21007 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.494+0000 7f8bcbfff640 1 -- 172.21.15.181:0/4157524590 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc055070 con 0x5583b43c15d0 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bcbfff640 1 -- 172.21.15.181:0/4157524590 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0518b0 con 0x5583b43c15d0 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bcbfff640 1 -- 172.21.15.181:0/4157524590 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc051ca0 con 0x5583b43c15d0 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 -- 172.21.15.181:0/4157524590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43c15d0 msgr2=0x5583b434f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43c15d0 0x5583b434f4d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc025da0 tx=0x7f8bbc051000 comp rx=0 tx=0).stop 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 -- 172.21.15.181:0/4157524590 shutdown_connections 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43e12f0 0x5583b4336cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43c15d0 0x5583b434f4d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/4157524590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 -- 172.21.15.181:0/4157524590 >> 172.21.15.181:0/4157524590 conn(0x5583b4333400 msgr2=0x5583b43365a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 -- 172.21.15.181:0/4157524590 shutdown_connections 2024-09-12T02:29:22.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.495+0000 7f8bd3996f40 1 -- 172.21.15.181:0/4157524590 wait complete. 2024-09-12T02:29:22.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 Processor -- start 2024-09-12T02:29:22.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 -- start start 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43c0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43c15d0 0x5583b4466570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43e12f0 0x5583b4336390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5583b434fa10 con 0x5583b43e12f0 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5583b43d4810 con 0x5583b43c15d0 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd3996f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5583b43371f0 con 0x5583b4352200 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd1c8d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43e12f0 0x5583b4336390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd1c8d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43e12f0 0x5583b4336390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46090/0 (socket says 172.21.15.181:46090) 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd1c8d640 1 -- 172.21.15.181:0/2201865667 learned_addr learned my addr 172.21.15.181:0/2201865667 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.496+0000 7f8bd148c640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bc8c8b640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43c15d0 0x5583b4466570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd1c8d640 1 -- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 msgr2=0x5583b43c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd1c8d640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5583b4352200 0x5583b43c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd1c8d640 1 -- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43c15d0 msgr2=0x5583b4466570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd1c8d640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5583b43c15d0 0x5583b4466570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd1c8d640 1 -- 172.21.15.181:0/2201865667 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b43c0ad0 con 0x5583b43e12f0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd1c8d640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43e12f0 0x5583b4336390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00e530 tx=0x7f8bcc00e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bcaffd640 1 -- 172.21.15.181:0/2201865667 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc016070 con 0x5583b43e12f0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bcaffd640 1 -- 172.21.15.181:0/2201865667 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bcc012850 con 0x5583b43e12f0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583b4467500 con 0x5583b43e12f0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bcaffd640 1 -- 172.21.15.181:0/2201865667 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc012c20 con 0x5583b43e12f0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.497+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b4467ac0 con 0x5583b43e12f0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.498+0000 7f8bcaffd640 1 -- 172.21.15.181:0/2201865667 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bcc019070 con 0x5583b43e12f0 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.499+0000 7f8bcaffd640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bb406a810 0x7f8bb406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.499+0000 7f8bcaffd640 1 -- 172.21.15.181:0/2201865667 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f8bcc089fb0 con 0x5583b43e12f0 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.499+0000 7f8bd148c640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bb406a810 0x7f8bb406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.499+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5583b4334480 0x5583b44777b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.499+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583b4477cf0 con 0x5583b4334480 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.499+0000 7f8bc8c8b640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5583b4334480 0x5583b44777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.499+0000 7f8bd148c640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bb406a810 0x7f8bb406ccd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40076a0 tx=0x7f8bc4005a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bc8c8b640 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5583b4334480 0x5583b44777b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bc8c8b640 1 -- 172.21.15.181:0/2201865667 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=53b] v0'0 uv43 ondisk = 0) ==== 154+0+53 (crc 0 0 0) 0x7f8bbc057030 con 0x5583b4334480 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stdout:linkdir_head 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stdout:rootfile_head 2024-09-12T02:29:22.504 INFO:teuthology.orchestra.run.smithi181.stdout:subdir_head 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5583b4334480 msgr2=0x5583b44777b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5583b4334480 0x5583b44777b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bb406a810 msgr2=0x7f8bb406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bb406a810 0x7f8bb406ccd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40076a0 tx=0x7f8bc4005a30 comp rx=0 tx=0).stop 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43e12f0 msgr2=0x5583b4336390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 --2- 172.21.15.181:0/2201865667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583b43e12f0 0x5583b4336390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00e530 tx=0x7f8bcc00e9f0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd1c8d640 1 -- 172.21.15.181:0/2201865667 reap_dead start 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 shutdown_connections 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 >> 172.21.15.181:0/2201865667 conn(0x5583b4333400 msgr2=0x5583b4307600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 shutdown_connections 2024-09-12T02:29:22.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.500+0000 7f8bd3996f40 1 -- 172.21.15.181:0/2201865667 wait complete. 2024-09-12T02:29:22.507 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2024-09-12T02:29:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.588+0000 7fa8c73d5f40 1 Processor -- start 2024-09-12T02:29:22.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.588+0000 7fa8c73d5f40 1 -- start start 2024-09-12T02:29:22.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c73d5f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 0x56132c42aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c73d5f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c73d5f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 0x56132c4a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c73d5f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56132c4bc640 con 0x56132c4bb5c0 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c73d5f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56132c335510 con 0x56132c4bc0e0 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c73d5f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56132c424660 con 0x56132c4b1f90 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4bd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46110/0 (socket says 172.21.15.181:46110) 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 -- 172.21.15.181:0/538505531 learned_addr learned my addr 172.21.15.181:0/538505531 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c56cc640 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 0x56132c4a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8c4ecb640 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 0x56132c42aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 -- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 msgr2=0x56132c42aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 0x56132c42aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 -- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 msgr2=0x56132c4a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 0x56132c4a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 -- 172.21.15.181:0/538505531 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132c42b9e0 con 0x56132c4bb5c0 2024-09-12T02:29:22.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.589+0000 7fa8bffff640 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4bd700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000b2e0 tx=0x7fa8b000b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67baf37ca6a4ca22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8beffd640 1 -- 172.21.15.181:0/538505531 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0008070 con 0x56132c4bb5c0 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8beffd640 1 -- 172.21.15.181:0/538505531 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b000d500 con 0x56132c4bb5c0 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8beffd640 1 -- 172.21.15.181:0/538505531 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000d8f0 con 0x56132c4bb5c0 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/538505531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 msgr2=0x56132c4bd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4bd700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000b2e0 tx=0x7fa8b000b7a0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/538505531 shutdown_connections 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 0x56132c4a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4bd700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/538505531 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 0x56132c42aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/538505531 >> 172.21.15.181:0/538505531 conn(0x56132c40e400 msgr2=0x56132c4136b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/538505531 shutdown_connections 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.590+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/538505531 wait complete. 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.591+0000 7fa8c73d5f40 1 Processor -- start 2024-09-12T02:29:22.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.591+0000 7fa8c73d5f40 1 -- start start 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.591+0000 7fa8c73d5f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 0x56132c4b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.591+0000 7fa8c73d5f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.591+0000 7fa8c73d5f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 0x56132c554ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8c73d5f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56132c42bc80 con 0x56132c4bb5c0 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8c73d5f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56132c42c520 con 0x56132c4bc0e0 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8c73d5f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56132c42bf60 con 0x56132c4b1f90 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46112/0 (socket says 172.21.15.181:46112) 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 -- 172.21.15.181:0/3123760970 learned_addr learned my addr 172.21.15.181:0/3123760970 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8c4ecb640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 0x56132c4b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8c56cc640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 0x56132c554ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 -- 172.21.15.181:0/3123760970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 msgr2=0x56132c4b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56132c4b1f90 0x56132c4b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 -- 172.21.15.181:0/3123760970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 msgr2=0x56132c554ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56132c4bc0e0 0x56132c554ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 -- 172.21.15.181:0/3123760970 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132c4b5940 con 0x56132c4bb5c0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bffff640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4b5010 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x56132c42e0e0 tx=0x7fa8b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bdffb640 1 -- 172.21.15.181:0/3123760970 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0021030 con 0x56132c4bb5c0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bdffb640 1 -- 172.21.15.181:0/3123760970 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b001c650 con 0x56132c4bb5c0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56132c4b2db0 con 0x56132c4bb5c0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8bdffb640 1 -- 172.21.15.181:0/3123760970 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b001c820 con 0x56132c4bb5c0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.592+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56132c4b5660 con 0x56132c4bb5c0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8bdffb640 1 -- 172.21.15.181:0/3123760970 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8b0024070 con 0x56132c4bb5c0 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8bdffb640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa8a806a810 0x7fa8a806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8bdffb640 1 -- 172.21.15.181:0/3123760970 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fa8b008ae20 con 0x56132c4bb5c0 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8c4ecb640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa8a806a810 0x7fa8a806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x56132c4b2370 0x56132c555730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56132c549e70 con 0x56132c4b2370 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8c56cc640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x56132c4b2370 0x56132c555730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.594+0000 7fa8c4ecb640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa8a806a810 0x7fa8a806ccd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8057000 tx=0x7fa8b8052000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c56cc640 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x56132c4b2370 0x56132c555730 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c56cc640 1 -- 172.21.15.181:0/3123760970 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys out=42b] v0'0 uv21 ondisk = 0) ==== 164+0+42 (crc 0 0 0) 0x7fa8c000e970 con 0x56132c4b2370 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stdout:subdirfile_head 2024-09-12T02:29:22.599 INFO:teuthology.orchestra.run.smithi181.stdout:subsubdir_head 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x56132c4b2370 msgr2=0x56132c555730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x56132c4b2370 0x56132c555730 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa8a806a810 msgr2=0x7fa8a806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa8a806a810 0x7fa8a806ccd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8057000 tx=0x7fa8b8052000 comp rx=0 tx=0).stop 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 msgr2=0x56132c4b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 --2- 172.21.15.181:0/3123760970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56132c4bb5c0 0x56132c4b5010 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x56132c42e0e0 tx=0x7fa8b0000ed0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c56cc640 1 -- 172.21.15.181:0/3123760970 reap_dead start 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 shutdown_connections 2024-09-12T02:29:22.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 >> 172.21.15.181:0/3123760970 conn(0x56132c40e400 msgr2=0x56132c413690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 shutdown_connections 2024-09-12T02:29:22.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.595+0000 7fa8c73d5f40 1 -- 172.21.15.181:0/3123760970 wait complete. 2024-09-12T02:29:22.602 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100000001f7.00000000 2024-09-12T02:29:22.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.683+0000 7f2e6ce0bf40 1 Processor -- start 2024-09-12T02:29:22.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.683+0000 7f2e6ce0bf40 1 -- start start 2024-09-12T02:29:22.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6ce0bf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 0x55d715628e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6ce0bf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d71562b0b0 0x55d71556f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6ce0bf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7156492f0 0x55d715645370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6ce0bf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d7155babb0 con 0x55d7156492f0 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6ce0bf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55d7154c2510 con 0x55d71562b0b0 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6ce0bf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55d715629390 con 0x55d7155ba740 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7156492f0 0x55d715645370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7156492f0 0x55d715645370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46116/0 (socket says 172.21.15.181:46116) 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 -- 172.21.15.181:0/3359281180 learned_addr learned my addr 172.21.15.181:0/3359281180 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e69c24640 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 0x55d715628e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e69423640 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d71562b0b0 0x55d71556f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 -- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 msgr2=0x55d715628e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 0x55d715628e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 -- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d71562b0b0 msgr2=0x55d71556f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d71562b0b0 0x55d71556f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.684+0000 7f2e6a425640 1 -- 172.21.15.181:0/3359281180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7156462a0 con 0x55d7156492f0 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6a425640 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7156492f0 0x55d715645370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e640460e0 tx=0x7f2e64051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78b980e5d2cddb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e5bfff640 1 -- 172.21.15.181:0/3359281180 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64068070 con 0x55d7156492f0 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e5bfff640 1 -- 172.21.15.181:0/3359281180 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e64058b50 con 0x55d7156492f0 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e5bfff640 1 -- 172.21.15.181:0/3359281180 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64058600 con 0x55d7156492f0 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/3359281180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7156492f0 msgr2=0x55d715645370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7156492f0 0x55d715645370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e640460e0 tx=0x7f2e64051000 comp rx=0 tx=0).stop 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/3359281180 shutdown_connections 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d71562b0b0 0x55d71556f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7156492f0 0x55d715645370 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/3359281180 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 0x55d715628e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/3359281180 >> 172.21.15.181:0/3359281180 conn(0x55d71559b400 msgr2=0x55d7155a06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/3359281180 shutdown_connections 2024-09-12T02:29:22.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.685+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/3359281180 wait complete. 2024-09-12T02:29:22.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.686+0000 7f2e6ce0bf40 1 Processor -- start 2024-09-12T02:29:22.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.686+0000 7f2e6ce0bf40 1 -- start start 2024-09-12T02:29:22.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 0x55d71563dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d71562b0b0 0x55d715645560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d7156492f0 0x55d7156414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d715571fe0 con 0x55d71562b0b0 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55d7156438d0 con 0x55d7156492f0 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55d7155b0ac0 con 0x55d7155ba740 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d71562b0b0 0x55d715645560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d71562b0b0 0x55d715645560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46130/0 (socket says 172.21.15.181:46130) 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 -- 172.21.15.181:0/756247775 learned_addr learned my addr 172.21.15.181:0/756247775 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69c24640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 0x55d71563dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6a425640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d7156492f0 0x55d7156414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 -- 172.21.15.181:0/756247775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 msgr2=0x55d71563dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d7155ba740 0x55d71563dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 -- 172.21.15.181:0/756247775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d7156492f0 msgr2=0x55d7156414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d7156492f0 0x55d7156414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 -- 172.21.15.181:0/756247775 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d715642ab0 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e69423640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d71562b0b0 0x55d715645560 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2e60008740 tx=0x7f2e60008830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e5affd640 1 -- 172.21.15.181:0/756247775 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e600148a0 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e5affd640 1 -- 172.21.15.181:0/756247775 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6001a070 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d715627b10 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e5affd640 1 -- 172.21.15.181:0/756247775 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e60014c40 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.687+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d715628560 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.689+0000 7f2e5affd640 1 -- 172.21.15.181:0/756247775 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e60015470 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.689+0000 7f2e5affd640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e4c06a810 0x7f2e4c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.689+0000 7f2e5affd640 1 -- 172.21.15.181:0/756247775 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f2e6008a440 con 0x55d71562b0b0 2024-09-12T02:29:22.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.689+0000 7f2e69c24640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e4c06a810 0x7f2e4c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.689+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55d715645aa0 0x55d7156dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.689+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:1 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7155bafd0 con 0x55d715645aa0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6a425640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55d715645aa0 0x55d7156dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e69c24640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e4c06a810 0x7f2e4c06ccd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c004170 tx=0x7f2e5c000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6a425640 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55d715645aa0 0x55d7156dffb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6a425640 1 -- 172.21.15.181:0/756247775 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(1 100000001f7.00000000 [omap-get-keys out=61b] v0'0 uv23 ondisk = 0) ==== 164+0+61 (crc 0 0 0) 0x7f2e6406b040 con 0x55d715645aa0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stdout:link0_head 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stdout:link1_head 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stdout:link2_head 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi181.stdout:link3_head 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55d715645aa0 msgr2=0x55d7156dffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55d715645aa0 0x55d7156dffb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e4c06a810 msgr2=0x7f2e4c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e4c06a810 0x7f2e4c06ccd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c004170 tx=0x7f2e5c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d71562b0b0 msgr2=0x55d715645560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 --2- 172.21.15.181:0/756247775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d71562b0b0 0x55d715645560 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2e60008740 tx=0x7f2e60008830 comp rx=0 tx=0).stop 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6a425640 1 -- 172.21.15.181:0/756247775 reap_dead start 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 shutdown_connections 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 >> 172.21.15.181:0/756247775 conn(0x55d71559b400 msgr2=0x55d715629770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 shutdown_connections 2024-09-12T02:29:22.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.690+0000 7f2e6ce0bf40 1 -- 172.21.15.181:0/756247775 wait complete. 2024-09-12T02:29:22.697 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-12T02:29:22.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 -- start start 2024-09-12T02:29:22.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 Processor -- start 2024-09-12T02:29:22.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a953f1ec00 0x55a953f9a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a953f1f800 0x55a953f9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a953f1fc00 0x55a953f9b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a954d08180 con 0x55a953f1ec00 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a954d08300 con 0x55a953f1f800 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a954d08480 con 0x55a953f1fc00 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f566658b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a953f1ec00 0x55a953f9a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f566658b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a953f1ec00 0x55a953f9a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46146/0 (socket says 172.21.15.181:46146) 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f566658b640 1 -- 172.21.15.181:0/267624422 learned_addr learned my addr 172.21.15.181:0/267624422 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5665d8a640 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a953f1f800 0x55a953f9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.778+0000 7f5666d8c640 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a953f1fc00 0x55a953f9b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f566658b640 1 -- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a953f1fc00 msgr2=0x55a953f9b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f566658b640 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a953f1fc00 0x55a953f9b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f566658b640 1 -- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a953f1f800 msgr2=0x55a953f9ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f566658b640 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a953f1f800 0x55a953f9ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f566658b640 1 -- 172.21.15.181:0/267624422 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953f56780 con 0x55a953f1ec00 2024-09-12T02:29:22.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5665d8a640 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a953f1f800 0x55a953f9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f566658b640 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a953f1ec00 0x55a953f9a580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55a954d41830 tx=0x55a954cc22a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ca13e1f4971fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5663d86640 1 -- 172.21.15.181:0/267624422 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a953f44680 con 0x55a953f1ec00 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5663d86640 1 -- 172.21.15.181:0/267624422 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a953f4aa80 con 0x55a953f1ec00 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5663d86640 1 -- 172.21.15.181:0/267624422 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a953f44b60 con 0x55a953f1ec00 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5667de6280 1 -- 172.21.15.181:0/267624422 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a953f563c0 con 0x55a953f1ec00 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5667de6280 1 -- 172.21.15.181:0/267624422 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a953f57680 con 0x55a953f1ec00 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5667de6280 4 waiting for MDS map... 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5663d86640 1 -- 172.21.15.181:0/267624422 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x55a954e00600 con 0x55a953f1ec00 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5663d86640 1 -- 172.21.15.181:0/267624422 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 14) ==== 2893+0+0 (secure 0 0 0) 0x55a953f79180 con 0x55a953f1ec00 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5667de6280 4 Got MDS map 14 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5667de6280 10 main: JournalTool::main 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.779+0000 7f5667de6280 4 main: JournalTool: connecting to RADOS... 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 Processor -- start 2024-09-12T02:29:22.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 -- start start 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03c00 0x55a953f9b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954e66000 0x55a953f9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954e66400 0x55a953f9c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a954d08600 con 0x55a954e03c00 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a954d08780 con 0x55a954e66400 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.780+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a954d08900 con 0x55a954e66000 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03c00 0x55a953f9b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03c00 0x55a953f9b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46148/0 (socket says 172.21.15.181:46148) 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 -- 172.21.15.181:0/2317000867 learned_addr learned my addr 172.21.15.181:0/2317000867 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f566658b640 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954e66000 0x55a953f9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5665d8a640 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954e66400 0x55a953f9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 -- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954e66000 msgr2=0x55a953f9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954e66000 0x55a953f9bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 -- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954e66400 msgr2=0x55a953f9c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954e66400 0x55a953f9c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 -- 172.21.15.181:0/2317000867 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953f574a0 con 0x55a954e03c00 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5666d8c640 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03c00 0x55a953f9b600 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55a954dee780 tx=0x55a954cc21e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d202e5573035380e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5661d82640 1 -- 172.21.15.181:0/2317000867 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a953f449c0 con 0x55a954e03c00 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5661d82640 1 -- 172.21.15.181:0/2317000867 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a953f4afc0 con 0x55a954e03c00 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5661d82640 1 -- 172.21.15.181:0/2317000867 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a953f44680 con 0x55a954e03c00 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 -- 172.21.15.181:0/2317000867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03c00 msgr2=0x55a953f9b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03c00 0x55a953f9b600 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55a954dee780 tx=0x55a954cc21e0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 -- 172.21.15.181:0/2317000867 shutdown_connections 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954e66400 0x55a953f9c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954e66000 0x55a953f9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 --2- 172.21.15.181:0/2317000867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03c00 0x55a953f9b600 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 -- 172.21.15.181:0/2317000867 >> 172.21.15.181:0/2317000867 conn(0x55a954e03800 msgr2=0x55a954017000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.781+0000 7f5667de6280 1 -- 172.21.15.181:0/2317000867 shutdown_connections 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.782+0000 7f5667de6280 1 -- 172.21.15.181:0/2317000867 wait complete. 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.782+0000 7f5667de6280 1 Processor -- start 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.782+0000 7f5667de6280 1 -- start start 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03800 0x55a953f9d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d22000 0x55a953f9cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d22400 0x55a953f9c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a954d09b00 con 0x55a954e03800 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a954d09980 con 0x55a954d22400 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a954d09800 con 0x55a954d22000 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03800 0x55a953f9d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03800 0x55a953f9d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46156/0 (socket says 172.21.15.181:46156) 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f566658b640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d22000 0x55a953f9cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 -- 172.21.15.181:0/792186035 learned_addr learned my addr 172.21.15.181:0/792186035 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5665d8a640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d22400 0x55a953f9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 -- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d22000 msgr2=0x55a953f9cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d22000 0x55a953f9cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 -- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d22400 msgr2=0x55a953f9c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d22400 0x55a953f9c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 -- 172.21.15.181:0/792186035 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953f56780 con 0x55a954e03800 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5665d8a640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d22400 0x55a953f9c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5666d8c640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03800 0x55a953f9d180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a954d41ef0 tx=0x55a954cc2240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f566057f640 1 -- 172.21.15.181:0/792186035 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a953f44b60 con 0x55a954e03800 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f566057f640 1 -- 172.21.15.181:0/792186035 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a953f4ae00 con 0x55a954e03800 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a953f563c0 con 0x55a954e03800 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f566057f640 1 -- 172.21.15.181:0/792186035 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a953f444e0 con 0x55a954e03800 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a953f57680 con 0x55a954e03800 2024-09-12T02:29:22.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.783+0000 7f5667de6280 4 main: JournalTool: resolving pool 4 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.784+0000 7f566057f640 1 -- 172.21.15.181:0/792186035 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a954e66c00 con 0x55a954e03800 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f566057f640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a954d26800 0x55a953f9d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f566057f640 1 -- 172.21.15.181:0/792186035 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x55a954d24600 con 0x55a954e03800 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f5667de6280 4 main: JournalTool: creating IoCtx.. 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f566658b640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a954d26800 0x55a953f9d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f5667de6280 4 main: Executing for rank 0 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f566658b640 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a954d26800 0x55a953f9d700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55a954dee240 tx=0x55a953fdb380 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f5667de6280 1 -- start start 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.785+0000 7f5667de6280 1 Processor -- start 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5667de6280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954d22c00 0x55a953f9c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d23000 0x55a953f9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5667de6280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d23400 0x55a953f9b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5667de6280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a954d09500 con 0x55a954d22c00 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a954d08780 con 0x55a954d23400 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5667de6280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a954d08a80 con 0x55a954d23000 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954d22c00 0x55a953f9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954d22c00 0x55a953f9c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46168/0 (socket says 172.21.15.181:46168) 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 learned_addr learned my addr 172.21.15.181:0/3270639905 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5665d8a640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d23400 0x55a953f9b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f566658b640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d23000 0x55a953f9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d23000 msgr2=0x55a953f9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d23000 0x55a953f9bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d23400 msgr2=0x55a953f9b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d23400 0x55a953f9b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.786+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953f56000 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f5666d8c640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954d22c00 0x55a953f9c100 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55a954255560 tx=0x55a954e13380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a500c51b19c012 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f565d579640 1 -- 172.21.15.181:0/3270639905 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a954238b60 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f565d579640 1 -- 172.21.15.181:0/3270639905 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a953f4ac40 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f565d579640 1 -- 172.21.15.181:0/3270639905 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a954238d00 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a953f574a0 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a953f56780 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f5667de6280 4 waiting for MDS map... 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f565d579640 1 -- 172.21.15.181:0/3270639905 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x55a954308600 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f565d579640 1 -- 172.21.15.181:0/3270639905 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 14) ==== 2893+0+0 (secure 0 0 0) 0x55a953f79500 con 0x55a954d22c00 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f5667de6280 4 Got MDS map 14 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a954d23800 0x55a954324000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a954d23c00 con 0x55a954d23800 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f566658b640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a954d23800 0x55a954324000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.787+0000 7f566658b640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a954d23800 0x55a954324000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=28ed713f5596a67d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f566658b640 1 -- 172.21.15.181:0/3270639905 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55a95402c000 con 0x55a954d23800 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a95431c400 0x55a954324580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a95431c800 con 0x55a95431c400 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f5665d8a640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a95431c400 0x55a954324580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f5665d8a640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a95431c400 0x55a954324580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=c071d8a562c86495 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f5665d8a640 1 -- 172.21.15.181:0/3270639905 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55a95402c500 con 0x55a95431c400 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f565bd76640 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33) -- 0x55a954332000 con 0x55a95431c400 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f565bd76640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a954332400 0x55a954326680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.788+0000 7f565bd76640 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33) -- 0x55a954332800 con 0x55a954332400 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.789+0000 7f5666d8c640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a954332400 0x55a954326680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.789+0000 7f5665d8a640 1 -- 172.21.15.181:0/3270639905 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55a95402c500 con 0x55a95431c400 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.789+0000 7f5666d8c640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a954332400 0x55a954326680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=4bfe97e5bf53ad63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.789+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a95402c780 con 0x55a954332400 2024-09-12T02:29:22.799 INFO:teuthology.orchestra.run.smithi181.stdout:old journal was 4194304~52253 2024-09-12T02:29:22.799 INFO:teuthology.orchestra.run.smithi181.stdout:new journal start will be 8388608 (4142051 bytes past old end) 2024-09-12T02:29:22.799 INFO:teuthology.orchestra.run.smithi181.stdout:writing journal head 2024-09-12T02:29:22.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.789+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:5 4.14 4:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a95431cc00 con 0x55a95431c400 2024-09-12T02:29:22.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5665d8a640 1 -- 172.21.15.181:0/3270639905 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v33'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a95402c500 con 0x55a95431c400 2024-09-12T02:29:22.800 INFO:teuthology.orchestra.run.smithi181.stdout:writing EResetJournal entry 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:6 4.1b 4:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a95431d000 con 0x55a954332400 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55a95431d400 0x55a954324b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 4.b 4:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a95431d800 con 0x55a95431d400 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a95431dc00 0x55a954325080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:8 4.1f 4:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a954332000 con 0x55a95431dc00 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 4.1a 4:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a954332c00 con 0x55a954332400 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:10 4.1e 4:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a954333000 con 0x55a95431d400 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:11 4.1d 4:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a954333400 con 0x55a95431c400 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.790+0000 7f566658b640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55a95431d400 0x55a954324b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.791+0000 7f5665d8a640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a95431dc00 0x55a954325080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.791+0000 7f566658b640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55a95431d400 0x55a954324b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=d08ceec466ee33d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.791+0000 7f5665d8a640 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a95431dc00 0x55a954325080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=5102693b268cf5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.792+0000 7f5665d8a640 1 -- 172.21.15.181:0/3270639905 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(11 200.00000007 [delete] v33'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a95402c500 con 0x55a95431c400 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.792+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(6 200.00000002 [delete] v33'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a95402c780 con 0x55a954332400 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.792+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(9 200.00000005 [delete] v33'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a95402c780 con 0x55a954332400 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.792+0000 7f566658b640 1 -- 172.21.15.181:0/3270639905 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(10 200.00000006 [delete] v33'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a95402c000 con 0x55a95431d400 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.792+0000 7f5665d8a640 1 -- 172.21.15.181:0/3270639905 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(8 200.00000004 [delete] v33'45 uv44 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a95402c500 con 0x55a95431dc00 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.793+0000 7f566658b640 1 -- 172.21.15.181:0/3270639905 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(7 200.00000003 [delete] v33'4 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a95402c000 con 0x55a95431d400 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.793+0000 7f565bd76640 1 -- 172.21.15.181:0/3270639905 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:12 4.1b 4:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a954340000 con 0x55a954332400 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5666d8c640 1 -- 172.21.15.181:0/3270639905 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v33'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a95402c780 con 0x55a954332400 2024-09-12T02:29:22.803 INFO:teuthology.orchestra.run.smithi181.stdout:done 2024-09-12T02:29:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55a95431d400 msgr2=0x55a954324b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55a95431d400 0x55a954324b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a954d23800 msgr2=0x55a954324000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a954d23800 0x55a954324000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a95431c400 msgr2=0x55a954324580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a95431c400 0x55a954324580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a954332400 msgr2=0x55a954326680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a954332400 0x55a954326680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5665d8a640 1 -- 172.21.15.181:0/3270639905 reap_dead start 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a95431dc00 msgr2=0x55a954325080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.794+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a95431dc00 0x55a954325080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954d22c00 msgr2=0x55a953f9c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/3270639905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954d22c00 0x55a953f9c100 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55a954255560 tx=0x55a954e13380 comp rx=0 tx=0).stop 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5665d8a640 1 -- 172.21.15.181:0/3270639905 reap_dead start 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 shutdown_connections 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 >> 172.21.15.181:0/3270639905 conn(0x55a954d22800 msgr2=0x55a954017800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 shutdown_connections 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/3270639905 wait complete. 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a954d26800 msgr2=0x55a953f9d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a954d26800 0x55a953f9d700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55a954dee240 tx=0x55a953fdb380 comp rx=0 tx=0).stop 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03800 msgr2=0x55a953f9d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03800 0x55a953f9d180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a954d41ef0 tx=0x55a954cc2240 comp rx=0 tx=0).stop 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 shutdown_connections 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a954d26800 0x55a953f9d700 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a954d22400 0x55a953f9c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a954d22000 0x55a953f9cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/792186035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a954e03800 0x55a953f9d180 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 >> 172.21.15.181:0/792186035 conn(0x55a954e03c00 msgr2=0x55a954017000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 shutdown_connections 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/792186035 wait complete. 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/267624422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a953f1ec00 msgr2=0x55a953f9a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a953f1ec00 0x55a953f9a580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55a954d41830 tx=0x55a954cc22a0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/267624422 shutdown_connections 2024-09-12T02:29:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a953f1f800 0x55a953f9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a953f1fc00 0x55a953f9b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 --2- 172.21.15.181:0/267624422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a953f1ec00 0x55a953f9a580 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/267624422 >> 172.21.15.181:0/267624422 conn(0x55a953f1f000 msgr2=0x55a954016800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/267624422 shutdown_connections 2024-09-12T02:29:22.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.795+0000 7f5667de6280 1 -- 172.21.15.181:0/267624422 wait complete. 2024-09-12T02:29:22.809 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--yes-i-really-really-mean-it'] in time 0:00:00.112271, result: old journal was 4194304~52253 new journal start will be 8388608 (4142051 bytes past old end) writing journal head writing EResetJournal entry done 2024-09-12T02:29:22.809 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:29:22.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.947+0000 7f8440778640 1 Processor -- start 2024-09-12T02:29:22.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.947+0000 7f8440778640 1 -- start start 2024-09-12T02:29:22.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f8440778640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84380d2090 0x7f84380d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f8440778640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84380d2500 con 0x7f84380cedd0 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f8440778640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84380d2790 con 0x7f84380b3490 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f8440778640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f84380b7cb0 con 0x7f84380d2090 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f843e514640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f84380cedd0 0x7f84380cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52980/0 (socket says 172.21.15.181:52980) 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f843e514640 1 -- 172.21.15.181:0/194098281 learned_addr learned my addr 172.21.15.181:0/194098281 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216941336 0 0) 0x7f84380d2500 con 0x7f84380cedd0 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.948+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8420003520 con 0x7f84380cedd0 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843ed15640 1 --2- 172.21.15.181:0/194098281 >> v2:172.21.15.204:3300/0 conn(0x7f84380d2090 0x7f84380d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4289869042 0 0) 0x7f8420003520 con 0x7f84380cedd0 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 >> v2:172.21.15.204:3300/0 conn(0x7f84380d2090 msgr2=0x7f84380d3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 --2- 172.21.15.181:0/194098281 >> v2:172.21.15.204:3300/0 conn(0x7f84380d2090 0x7f84380d3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 >> v1:172.21.15.204:6789/0 conn(0x7f84380b3490 legacy=0x7f84380b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84380d2a70 con 0x7f84380cedd0 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f84280019f0 con 0x7f84380cedd0 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 >> v1:172.21.15.181:6789/0 conn(0x7f84380cedd0 legacy=0x7f84380cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8420003a00 0x7f8420003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8420004800 0x7f8420004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420005290 0x7f842000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84380b7cb0 con 0x7f8420003a00 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f842000c1e0 con 0x7f8420004800 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f842000c3e0 con 0x7f8420005290 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843e514640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8420003a00 0x7f8420003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843dd13640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8420004800 0x7f8420004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843ed15640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420005290 0x7f842000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843e514640 1 -- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420005290 msgr2=0x7f842000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843e514640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420005290 0x7f842000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843e514640 1 -- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8420004800 msgr2=0x7f8420004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:22.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843e514640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8420004800 0x7f8420004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843ed15640 1 -- 172.21.15.181:0/194098281 reap_dead start 2024-09-12T02:29:22.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.949+0000 7f843e514640 1 -- 172.21.15.181:0/194098281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8420003520 con 0x7f8420003a00 2024-09-12T02:29:22.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.950+0000 7f843e514640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8420003a00 0x7f8420003e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f842800a7b0 tx=0x7f8420005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34b9b75246b27a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.950+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842800a3d0 con 0x7f8420003a00 2024-09-12T02:29:22.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.950+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842802f070 con 0x7f8420003a00 2024-09-12T02:29:22.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.950+0000 7f843d512640 1 -- 172.21.15.181:0/194098281 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842802bc00 con 0x7f8420003a00 2024-09-12T02:29:22.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.951+0000 7f8440778640 1 -- 172.21.15.181:0/194098281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8420003a00 msgr2=0x7f8420003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.951+0000 7f8440778640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8420003a00 0x7f8420003e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f842800a7b0 tx=0x7f8420005830 comp rx=0 tx=0).stop 2024-09-12T02:29:22.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.951+0000 7f8440778640 1 -- 172.21.15.181:0/194098281 shutdown_connections 2024-09-12T02:29:22.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.951+0000 7f8440778640 1 --2- 172.21.15.181:0/194098281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8420003a00 0x7f8420003e00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.951+0000 7f8440778640 1 -- 172.21.15.181:0/194098281 >> 172.21.15.181:0/194098281 conn(0x7f84380d0f40 msgr2=0x7f84380d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.951+0000 7f8440778640 1 -- 172.21.15.181:0/194098281 shutdown_connections 2024-09-12T02:29:22.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.951+0000 7f8440778640 1 -- 172.21.15.181:0/194098281 wait complete. 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.952+0000 7f8440778640 1 Processor -- start 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.952+0000 7f8440778640 1 -- start start 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420003a00 0x7f84381518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84380cd4b0 0x7f843815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84380cd930 0x7f843815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84380d3030 con 0x7f84380cd4b0 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f84380b6c10 con 0x7f84380cd930 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f84380d3310 con 0x7f8420003a00 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84380cd4b0 0x7f843815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84380cd4b0 0x7f843815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46186/0 (socket says 172.21.15.181:46186) 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 -- 172.21.15.181:0/1377173650 learned_addr learned my addr 172.21.15.181:0/1377173650 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843e514640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420003a00 0x7f84381518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843ed15640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84380cd930 0x7f843815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 -- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420003a00 msgr2=0x7f84381518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420003a00 0x7f84381518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 -- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84380cd930 msgr2=0x7f843815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84380cd930 0x7f843815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 -- 172.21.15.181:0/1377173650 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84380cb970 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f843dd13640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84380cd4b0 0x7f843815a8c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f842c00f540 tx=0x7f842c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8436ffd640 1 -- 172.21.15.181:0/1377173650 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c003a70 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8436ffd640 1 -- 172.21.15.181:0/1377173650 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c003c10 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84380cbc50 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8436ffd640 1 -- 172.21.15.181:0/1377173650 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c007030 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.953+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84380cc210 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.954+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843815e720 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.955+0000 7f8436ffd640 1 -- 172.21.15.181:0/1377173650 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f842c0071d0 con 0x7f84380cd4b0 2024-09-12T02:29:22.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.955+0000 7f8436ffd640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f842406be30 0x7f842406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.955+0000 7f8436ffd640 1 -- 172.21.15.181:0/1377173650 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f842c08af00 con 0x7f84380cd4b0 2024-09-12T02:29:22.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.955+0000 7f843e514640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f842406be30 0x7f842406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.956+0000 7f843e514640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f842406be30 0x7f842406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8428033000 tx=0x7f8428009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:22.960+0000 7f8436ffd640 1 -- 172.21.15.181:0/1377173650 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f842c059200 con 0x7f84380cd4b0 2024-09-12T02:29:23.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.162+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f843815a0c0 con 0x7f84380cd4b0 2024-09-12T02:29:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.983+0000 7f8436ffd640 1 -- 172.21.15.181:0/1377173650 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v16) ==== 162+0+0 (secure 0 0 0) 0x7f842c05d500 con 0x7f84380cd4b0 2024-09-12T02:29:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:29:23.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.985+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f842406be30 msgr2=0x7f842406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.985+0000 7f8440778640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f842406be30 0x7f842406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8428033000 tx=0x7f8428009030 comp rx=0 tx=0).stop 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.985+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84380cd4b0 msgr2=0x7f843815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.985+0000 7f8440778640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84380cd4b0 0x7f843815a8c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f842c00f540 tx=0x7f842c00fa00 comp rx=0 tx=0).stop 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 shutdown_connections 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f842406be30 0x7f842406e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84380cd930 0x7f843815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84380cd4b0 0x7f843815a8c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 --2- 172.21.15.181:0/1377173650 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8420003a00 0x7f84381518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 >> 172.21.15.181:0/1377173650 conn(0x7f84380d0f40 msgr2=0x7f84380b89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 shutdown_connections 2024-09-12T02:29:23.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:23.986+0000 7f8440778640 1 -- 172.21.15.181:0/1377173650 wait complete. 2024-09-12T02:29:24.001 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:24.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.104+0000 7fb0c561e640 1 Processor -- start 2024-09-12T02:29:24.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.104+0000 7fb0c561e640 1 -- start start 2024-09-12T02:29:24.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0c561e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 0x7fb0c00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0c561e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb0c00d3660 0x7fb0c00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0c561e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c015ea20 con 0x7fb0c00cf0e0 2024-09-12T02:29:24.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0c561e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c00b2860 con 0x7fb0c00d3660 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0c561e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c00b1c50 con 0x7fb0c015e640 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0b67fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb0c00cf0e0 0x7fb0c00b2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52992/0 (socket says 172.21.15.181:52992) 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0b67fc640 1 -- 172.21.15.181:0/504138278 learned_addr learned my addr 172.21.15.181:0/504138278 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0bf7fe640 1 --2- 172.21.15.181:0/504138278 >> v2:172.21.15.204:3300/0 conn(0x7fb0c00d3660 0x7fb0c00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0beffd640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 0x7fb0c00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597969237 0 0) 0x7fb0c015ea20 con 0x7fb0c00cf0e0 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.105+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0ac003520 con 0x7fb0c00cf0e0 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3415103938 0 0) 0x7fb0ac003520 con 0x7fb0c00cf0e0 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 msgr2=0x7fb0c00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 0x7fb0c00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 >> v2:172.21.15.204:3300/0 conn(0x7fb0c00d3660 msgr2=0x7fb0c00cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 --2- 172.21.15.181:0/504138278 >> v2:172.21.15.204:3300/0 conn(0x7fb0c00d3660 0x7fb0c00cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c00b1f30 con 0x7fb0c00cf0e0 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fb0a8001670 con 0x7fb0c00cf0e0 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 >> v1:172.21.15.181:6789/0 conn(0x7fb0c00cf0e0 legacy=0x7fb0c00b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0ac0039b0 0x7fb0ac003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac004800 0x7fb0ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 0x7fb0ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00b2860 con 0x7fb0ac0039b0 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00b1c50 con 0x7fb0ac004800 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ac00ba70 con 0x7fb0c015e640 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0bf7fe640 1 --2- 172.21.15.181:0/504138278 >> v2:172.21.15.204:3300/0 conn(0x7fb0c00d3660 0x7fb0c00cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0beffd640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0ac0039b0 0x7fb0ac003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0b67fc640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac004800 0x7fb0ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0bf7fe640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 0x7fb0ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0beffd640 1 -- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 msgr2=0x7fb0ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0beffd640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 0x7fb0ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0beffd640 1 -- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac004800 msgr2=0x7fb0ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0beffd640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac004800 0x7fb0ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0beffd640 1 -- 172.21.15.181:0/504138278 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac003520 con 0x7fb0ac0039b0 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0b67fc640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac004800 0x7fb0ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.106+0000 7fb0bf7fe640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c015e640 0x7fb0ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0beffd640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0ac0039b0 0x7fb0ac003df0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009a90 tx=0x7fb0ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3028393280e863b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0036070 con 0x7fb0ac0039b0 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0031400 con 0x7fb0ac0039b0 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0be7fc640 1 -- 172.21.15.181:0/504138278 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0009690 con 0x7fb0ac0039b0 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0c561e640 1 -- 172.21.15.181:0/504138278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0ac0039b0 msgr2=0x7fb0ac003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0c561e640 1 --2- 172.21.15.181:0/504138278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0ac0039b0 0x7fb0ac003df0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009a90 tx=0x7fb0ac005830 comp rx=0 tx=0).stop 2024-09-12T02:29:24.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0bf7fe640 1 -- 172.21.15.181:0/504138278 reap_dead start 2024-09-12T02:29:24.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0c561e640 1 -- 172.21.15.181:0/504138278 shutdown_connections 2024-09-12T02:29:24.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.107+0000 7fb0c561e640 1 -- 172.21.15.181:0/504138278 >> 172.21.15.181:0/504138278 conn(0x7fb0c009d820 msgr2=0x7fb0c00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.108+0000 7fb0c561e640 1 -- 172.21.15.181:0/504138278 shutdown_connections 2024-09-12T02:29:24.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.108+0000 7fb0c561e640 1 -- 172.21.15.181:0/504138278 wait complete. 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.109+0000 7fb0c561e640 1 Processor -- start 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.109+0000 7fb0c561e640 1 -- start start 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0039b0 0x7fb0c015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0c0157990 0x7fb0c0158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00cd4d0 0x7fb0c0160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00cfe40 con 0x7fb0c0157990 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00b24f0 con 0x7fb0c00cd4d0 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c00b73a0 con 0x7fb0ac0039b0 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0c0157990 0x7fb0c0158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0c0157990 0x7fb0c0158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46204/0 (socket says 172.21.15.181:46204) 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 -- 172.21.15.181:0/3055839189 learned_addr learned my addr 172.21.15.181:0/3055839189 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0beffd640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0039b0 0x7fb0c015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0bf7fe640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00cd4d0 0x7fb0c0160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 -- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0039b0 msgr2=0x7fb0c015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0039b0 0x7fb0c015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 -- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00cd4d0 msgr2=0x7fb0c0160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00cd4d0 0x7fb0c0160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 -- 172.21.15.181:0/3055839189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c00c8c30 con 0x7fb0c0157990 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0bf7fe640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00cd4d0 0x7fb0c0160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b67fc640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0c0157990 0x7fb0c0158ae0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800e760 tx=0x7fb0a800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b7fff640 1 -- 172.21.15.181:0/3055839189 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800c660 con 0x7fb0c0157990 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b7fff640 1 -- 172.21.15.181:0/3055839189 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a8018070 con 0x7fb0c0157990 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c00cda40 con 0x7fb0c0157990 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0b7fff640 1 -- 172.21.15.181:0/3055839189 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800ca20 con 0x7fb0c0157990 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.110+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c00c91b0 con 0x7fb0c0157990 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.111+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c0068eb0 con 0x7fb0c0157990 2024-09-12T02:29:24.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.112+0000 7fb0b7fff640 1 -- 172.21.15.181:0/3055839189 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0a800cbc0 con 0x7fb0c0157990 2024-09-12T02:29:24.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.112+0000 7fb0b7fff640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb0a006be30 0x7fb0a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.112+0000 7fb0beffd640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb0a006be30 0x7fb0a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.112+0000 7fb0b7fff640 1 -- 172.21.15.181:0/3055839189 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fb0a808aa70 con 0x7fb0c0157990 2024-09-12T02:29:24.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.113+0000 7fb0beffd640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb0a006be30 0x7fb0a006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0033000 tx=0x7fb0b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.117+0000 7fb0b7fff640 1 -- 172.21.15.181:0/3055839189 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0a8059450 con 0x7fb0c0157990 2024-09-12T02:29:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.317+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0c00ceba0 con 0x7fb0c0157990 2024-09-12T02:29:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.317+0000 7fb0b7fff640 1 -- 172.21.15.181:0/3055839189 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7fb0a8058d50 con 0x7fb0c0157990 2024-09-12T02:29:24.318 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:24.318 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":17,"btime":"2024-09-12T02:29:23:989074+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:23.989063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4750":{"gid":4750,"name":"a","rank":0,"incarnation":17,"state":"up:replay","state_seq":1,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-12T02:29:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 17 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb0a006be30 msgr2=0x7fb0a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb0a006be30 0x7fb0a006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0033000 tx=0x7fb0b0008030 comp rx=0 tx=0).stop 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0c0157990 msgr2=0x7fb0c0158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0c0157990 0x7fb0c0158ae0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800e760 tx=0x7fb0a800ec20 comp rx=0 tx=0).stop 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 shutdown_connections 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb0a006be30 0x7fb0a006e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00cd4d0 0x7fb0c0160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0c0157990 0x7fb0c0158ae0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 --2- 172.21.15.181:0/3055839189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0039b0 0x7fb0c015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 >> 172.21.15.181:0/3055839189 conn(0x7fb0c009d820 msgr2=0x7fb0c00cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 shutdown_connections 2024-09-12T02:29:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:24.320+0000 7fb0c561e640 1 -- 172.21.15.181:0/3055839189 wait complete. 2024-09-12T02:29:24.735 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:01.922105+0000', 'modified': '2024-09-12T02:29:23.989063+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 33, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4750': {'gid': 4750, 'name': 'a', 'rank': 0, 'incarnation': 17, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/1355989745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1355989745}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1355989745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:29:24.735 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4750:up:replay 2024-09-12T02:29:25.736 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:25.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.846+0000 7f6589e4c640 1 Processor -- start 2024-09-12T02:29:25.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.846+0000 7f6589e4c640 1 -- start start 2024-09-12T02:29:25.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6589e4c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f65840d27b0 0x7f65840b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6589e4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6584070660 0x7f6584070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6589e4c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65840b59b0 con 0x7f658415d2e0 2024-09-12T02:29:25.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6589e4c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f658415e0c0 con 0x7f65840d27b0 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6589e4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f658415d750 con 0x7f6584070660 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6582ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f658415d2e0 0x7f658415d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52996/0 (socket says 172.21.15.181:52996) 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f65837fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f65840d27b0 0x7f65840b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6582ffd640 1 -- 172.21.15.181:0/1038848777 learned_addr learned my addr 172.21.15.181:0/1038848777 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f6583fff640 1 --2- 172.21.15.181:0/1038848777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6584070660 0x7f6584070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f65837fe640 1 -- 172.21.15.181:0/1038848777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6584070660 msgr2=0x7f6584070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f65837fe640 1 --2- 172.21.15.181:0/1038848777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6584070660 0x7f6584070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f65837fe640 1 -- 172.21.15.181:0/1038848777 >> v1:172.21.15.181:6789/0 conn(0x7f658415d2e0 legacy=0x7f658415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.847+0000 7f65827fc640 1 -- 172.21.15.181:0/1038848777 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014830885 0 0) 0x7f65840b59b0 con 0x7f658415d2e0 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.848+0000 7f65837fe640 1 -- 172.21.15.181:0/1038848777 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65840b5c90 con 0x7f65840d27b0 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.848+0000 7f65837fe640 1 --2- 172.21.15.181:0/1038848777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65840d27b0 0x7f65840b5320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f65740097a0 tx=0x7f657402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ab622278c55da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.848+0000 7f65827fc640 1 -- 172.21.15.181:0/1038848777 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574037070 con 0x7f65840d27b0 2024-09-12T02:29:25.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.848+0000 7f65827fc640 1 -- 172.21.15.181:0/1038848777 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6574032440 con 0x7f65840d27b0 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.848+0000 7f65827fc640 1 -- 172.21.15.181:0/1038848777 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574032810 con 0x7f65840d27b0 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 -- 172.21.15.181:0/1038848777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65840d27b0 msgr2=0x7f65840b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 --2- 172.21.15.181:0/1038848777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65840d27b0 0x7f65840b5320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f65740097a0 tx=0x7f657402a180 comp rx=0 tx=0).stop 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 -- 172.21.15.181:0/1038848777 shutdown_connections 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 --2- 172.21.15.181:0/1038848777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6584070660 0x7f6584070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 --2- 172.21.15.181:0/1038848777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65840d27b0 0x7f65840b5320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 -- 172.21.15.181:0/1038848777 >> 172.21.15.181:0/1038848777 conn(0x7f658406f400 msgr2=0x7f658406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 -- 172.21.15.181:0/1038848777 shutdown_connections 2024-09-12T02:29:25.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.849+0000 7f6589e4c640 1 -- 172.21.15.181:0/1038848777 wait complete. 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.850+0000 7f6589e4c640 1 Processor -- start 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.850+0000 7f6589e4c640 1 -- start start 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f6589e4c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6584070660 0x7f65841f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f6589e4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65840d27b0 0x7f658414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f6589e4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f658415d2e0 0x7f658414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f6589e4c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f65840b6250 con 0x7f6584070660 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f6589e4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6584070fd0 con 0x7f658415d2e0 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f6589e4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f65840b6530 con 0x7f65840d27b0 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f65837fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6584070660 0x7f65841f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f65837fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6584070660 0x7f65841f5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46234/0 (socket says 172.21.15.181:46234) 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.851+0000 7f65837fe640 1 -- 172.21.15.181:0/646280918 learned_addr learned my addr 172.21.15.181:0/646280918 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:25.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f65837fe640 1 -- 172.21.15.181:0/646280918 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65840d27b0 msgr2=0x7f658414b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f65837fe640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65840d27b0 0x7f658414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f65837fe640 1 -- 172.21.15.181:0/646280918 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f658415d2e0 msgr2=0x7f658414a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f65837fe640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f658415d2e0 0x7f658414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f65837fe640 1 -- 172.21.15.181:0/646280918 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658414d5a0 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f65837fe640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6584070660 0x7f65841f5b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6574035040 tx=0x7f65740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f656bfff640 1 -- 172.21.15.181:0/646280918 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574037040 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f656bfff640 1 -- 172.21.15.181:0/646280918 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6574030770 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658414d880 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f656bfff640 1 -- 172.21.15.181:0/646280918 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574030b80 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.852+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658414de40 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.853+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65841f6100 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.853+0000 7f656bfff640 1 -- 172.21.15.181:0/646280918 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6574044020 con 0x7f6584070660 2024-09-12T02:29:25.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.854+0000 7f656bfff640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f657006be30 0x7f657006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:25.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.854+0000 7f656bfff640 1 -- 172.21.15.181:0/646280918 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f65740ab400 con 0x7f6584070660 2024-09-12T02:29:25.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.854+0000 7f6582ffd640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f657006be30 0x7f657006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:25.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.854+0000 7f6582ffd640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f657006be30 0x7f657006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6578005880 tx=0x7f6578007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:25.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:25.858+0000 7f656bfff640 1 -- 172.21.15.181:0/646280918 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6574032e20 con 0x7f6584070660 2024-09-12T02:29:26.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.059+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65840d2b90 con 0x7f6584070660 2024-09-12T02:29:26.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.059+0000 7f656bfff640 1 -- 172.21.15.181:0/646280918 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5230 (secure 0 0 0) 0x7f6574079d50 con 0x7f6584070660 2024-09-12T02:29:26.060 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:26.060 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":19,"btime":"2024-09-12T02:29:25:993668+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:24.997993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4750":{"gid":4750,"name":"a","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-12T02:29:26.061 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 19 2024-09-12T02:29:26.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f657006be30 msgr2=0x7f657006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:26.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f657006be30 0x7f657006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6578005880 tx=0x7f6578007a00 comp rx=0 tx=0).stop 2024-09-12T02:29:26.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6584070660 msgr2=0x7f65841f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:26.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6584070660 0x7f65841f5b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6574035040 tx=0x7f65740046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 shutdown_connections 2024-09-12T02:29:26.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f657006be30 0x7f657006e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f658415d2e0 0x7f658414a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f65840d27b0 0x7f658414b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 --2- 172.21.15.181:0/646280918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6584070660 0x7f65841f5b00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 >> 172.21.15.181:0/646280918 conn(0x7f658406f400 msgr2=0x7f65840d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:26.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 shutdown_connections 2024-09-12T02:29:26.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:26.061+0000 7f6589e4c640 1 -- 172.21.15.181:0/646280918 wait complete. 2024-09-12T02:29:26.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:01.922105+0000', 'modified': '2024-09-12T02:29:24.997993+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 33, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4750': {'gid': 4750, 'name': 'a', 'rank': 0, 'incarnation': 17, 'state': 'up:rejoin', 'state_seq': 10, 'addr': '172.21.15.181:6835/1355989745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1355989745}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1355989745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:29:26.475 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4750:up:rejoin 2024-09-12T02:29:27.476 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:27.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.587+0000 7f6292437640 1 Processor -- start 2024-09-12T02:29:27.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.587+0000 7f6292437640 1 -- start start 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f6292437640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f628c0b2490 0x7f628c165db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f6292437640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c0ce4f0 con 0x7f628c0cdfc0 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f6292437640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c0ce7d0 con 0x7f628c15b2e0 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f6292437640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f628c15b6c0 con 0x7f628c0b2490 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f628b7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f628c0cdfc0 0x7f628c0b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53004/0 (socket says 172.21.15.181:53004) 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f628b7fe640 1 -- 172.21.15.181:0/1724123298 learned_addr learned my addr 172.21.15.181:0/1724123298 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f62909d4640 1 --2- 172.21.15.181:0/1724123298 >> v2:172.21.15.204:3300/0 conn(0x7f628c0b2490 0x7f628c165db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f628affd640 1 -- 172.21.15.181:0/1724123298 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683288047 0 0) 0x7f628c0ce4f0 con 0x7f628c0cdfc0 2024-09-12T02:29:27.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f628affd640 1 -- 172.21.15.181:0/1724123298 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6274003520 con 0x7f628c0cdfc0 2024-09-12T02:29:27.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f62909d4640 1 -- 172.21.15.181:0/1724123298 >> v1:172.21.15.204:6789/0 conn(0x7f628c15b2e0 legacy=0x7f628c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f628affd640 1 -- 172.21.15.181:0/1724123298 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089200418 0 0) 0x7f628c0ce7d0 con 0x7f628c15b2e0 2024-09-12T02:29:27.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f62909d4640 1 -- 172.21.15.181:0/1724123298 >> v1:172.21.15.181:6789/0 conn(0x7f628c0cdfc0 legacy=0x7f628c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.588+0000 7f62909d4640 1 -- 172.21.15.181:0/1724123298 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c0ceab0 con 0x7f628c0b2490 2024-09-12T02:29:27.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.589+0000 7f62909d4640 1 --2- 172.21.15.181:0/1724123298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 0x7f628c165db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6284009d90 tx=0x7f628402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeffb3b2eee25208 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.589+0000 7f628affd640 1 -- 172.21.15.181:0/1724123298 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284007740 con 0x7f628c0b2490 2024-09-12T02:29:27.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.589+0000 7f628affd640 1 -- 172.21.15.181:0/1724123298 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62840078e0 con 0x7f628c0b2490 2024-09-12T02:29:27.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.589+0000 7f628affd640 1 -- 172.21.15.181:0/1724123298 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284007c90 con 0x7f628c0b2490 2024-09-12T02:29:27.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.590+0000 7f6292437640 1 -- 172.21.15.181:0/1724123298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 msgr2=0x7f628c165db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.590+0000 7f6292437640 1 --2- 172.21.15.181:0/1724123298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 0x7f628c165db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6284009d90 tx=0x7f628402a660 comp rx=0 tx=0).stop 2024-09-12T02:29:27.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.590+0000 7f6292437640 1 -- 172.21.15.181:0/1724123298 shutdown_connections 2024-09-12T02:29:27.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.590+0000 7f6292437640 1 --2- 172.21.15.181:0/1724123298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 0x7f628c165db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.590+0000 7f6292437640 1 -- 172.21.15.181:0/1724123298 >> 172.21.15.181:0/1724123298 conn(0x7f628c06bc10 msgr2=0x7f628c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:27.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.590+0000 7f6292437640 1 -- 172.21.15.181:0/1724123298 shutdown_connections 2024-09-12T02:29:27.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.590+0000 7f6292437640 1 -- 172.21.15.181:0/1724123298 wait complete. 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.591+0000 7f6292437640 1 Processor -- start 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.591+0000 7f6292437640 1 -- start start 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f6292437640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 0x7f628c15db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f6292437640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f628c0cdfc0 0x7f628c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f6292437640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c15b2e0 0x7f628c0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f6292437640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f628c071130 con 0x7f628c15b2e0 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f6292437640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f628c0b4430 con 0x7f628c0b2490 2024-09-12T02:29:27.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f6292437640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f628c0712b0 con 0x7f628c0cdfc0 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c15b2e0 0x7f628c0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c15b2e0 0x7f628c0b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46248/0 (socket says 172.21.15.181:46248) 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 -- 172.21.15.181:0/3340671429 learned_addr learned my addr 172.21.15.181:0/3340671429 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f628b7fe640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f628c0cdfc0 0x7f628c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f628bfff640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 0x7f628c15db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 -- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f628c0cdfc0 msgr2=0x7f628c14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f628c0cdfc0 0x7f628c14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 -- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 msgr2=0x7f628c15db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 0x7f628c15db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f62909d4640 1 -- 172.21.15.181:0/3340671429 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c15e1b0 con 0x7f628c15b2e0 2024-09-12T02:29:27.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.592+0000 7f628b7fe640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f628c0cdfc0 0x7f628c14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:27.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.593+0000 7f62909d4640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c15b2e0 0x7f628c0b1000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f628402ac50 tx=0x7f6284004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.593+0000 7f6288ff9640 1 -- 172.21.15.181:0/3340671429 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284040070 con 0x7f628c15b2e0 2024-09-12T02:29:27.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.593+0000 7f6288ff9640 1 -- 172.21.15.181:0/3340671429 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6284031bc0 con 0x7f628c15b2e0 2024-09-12T02:29:27.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.593+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c15e490 con 0x7f628c15b2e0 2024-09-12T02:29:27.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.593+0000 7f6288ff9640 1 -- 172.21.15.181:0/3340671429 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284009450 con 0x7f628c15b2e0 2024-09-12T02:29:27.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.593+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c150b10 con 0x7f628c15b2e0 2024-09-12T02:29:27.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.594+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628c150620 con 0x7f628c15b2e0 2024-09-12T02:29:27.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.594+0000 7f6288ff9640 1 -- 172.21.15.181:0/3340671429 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6284039040 con 0x7f628c15b2e0 2024-09-12T02:29:27.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.595+0000 7f6288ff9640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f627806be30 0x7f627806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.595+0000 7f6288ff9640 1 -- 172.21.15.181:0/3340671429 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f62840ac250 con 0x7f628c15b2e0 2024-09-12T02:29:27.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.595+0000 7f628bfff640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f627806be30 0x7f627806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.595+0000 7f628bfff640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f627806be30 0x7f627806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f627c000f60 tx=0x7f627c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.599+0000 7f6288ff9640 1 -- 172.21.15.181:0/3340671429 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f628407ac30 con 0x7f628c15b2e0 2024-09-12T02:29:27.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.800+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f628c072970 con 0x7f628c15b2e0 2024-09-12T02:29:27.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.801+0000 7f6288ff9640 1 -- 172.21.15.181:0/3340671429 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5237 (secure 0 0 0) 0x7f628407a530 con 0x7f628c15b2e0 2024-09-12T02:29:27.802 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:27.802 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":20,"btime":"2024-09-12T02:29:26:998159+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:26.998147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4750":{"gid":4750,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":11,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4750,"qdb_cluster":[4750]},"id":2}]} 2024-09-12T02:29:27.802 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 20 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f627806be30 msgr2=0x7f627806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f627806be30 0x7f627806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f627c000f60 tx=0x7f627c009040 comp rx=0 tx=0).stop 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c15b2e0 msgr2=0x7f628c0b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c15b2e0 0x7f628c0b1000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f628402ac50 tx=0x7f6284004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 shutdown_connections 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f627806be30 0x7f627806e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c15b2e0 0x7f628c0b1000 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f628c0cdfc0 0x7f628c14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 --2- 172.21.15.181:0/3340671429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f628c0b2490 0x7f628c15db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 >> 172.21.15.181:0/3340671429 conn(0x7f628c06bc10 msgr2=0x7f628c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:27.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 shutdown_connections 2024-09-12T02:29:27.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:27.803+0000 7f6292437640 1 -- 172.21.15.181:0/3340671429 wait complete. 2024-09-12T02:29:28.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:01.922105+0000', 'modified': '2024-09-12T02:29:26.998147+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 33, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4750': {'gid': 4750, 'name': 'a', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.181:6835/1355989745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1355989745}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1355989745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4750, 'qdb_cluster': [4750]} 2024-09-12T02:29:28.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:29:28.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:29:28.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.318+0000 7f30fe952640 1 Processor -- start 2024-09-12T02:29:28.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.318+0000 7f30fe952640 1 -- start start 2024-09-12T02:29:28.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.318+0000 7f30fe952640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f30f815e640 0x7f30f80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.318+0000 7f30fe952640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f815ea20 con 0x7f30f80d3660 2024-09-12T02:29:28.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.318+0000 7f30fe952640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f80b1c50 con 0x7f30f80cf0e0 2024-09-12T02:29:28.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.318+0000 7f30fe952640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f30f80b2860 con 0x7f30f815e640 2024-09-12T02:29:28.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30fceef640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f30f80d3660 0x7f30f80b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53010/0 (socket says 172.21.15.181:53010) 2024-09-12T02:29:28.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30fceef640 1 -- 172.21.15.181:0/3371385579 learned_addr learned my addr 172.21.15.181:0/3371385579 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:28.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30f7fff640 1 --2- 172.21.15.181:0/3371385579 >> v2:172.21.15.204:3300/0 conn(0x7f30f815e640 0x7f30f80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30f6ffd640 1 -- 172.21.15.181:0/3371385579 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293976376 0 0) 0x7f30f815ea20 con 0x7f30f80d3660 2024-09-12T02:29:28.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30f6ffd640 1 -- 172.21.15.181:0/3371385579 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e0003520 con 0x7f30f80d3660 2024-09-12T02:29:28.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30f7fff640 1 -- 172.21.15.181:0/3371385579 >> v1:172.21.15.204:6789/0 conn(0x7f30f80cf0e0 legacy=0x7f30f80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30f7fff640 1 -- 172.21.15.181:0/3371385579 >> v1:172.21.15.181:6789/0 conn(0x7f30f80d3660 legacy=0x7f30f80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.319+0000 7f30f7fff640 1 -- 172.21.15.181:0/3371385579 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80b1f30 con 0x7f30f815e640 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.320+0000 7f30f7fff640 1 --2- 172.21.15.181:0/3371385579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 0x7f30f80ceba0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e7da192fa00449a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.320+0000 7f30f6ffd640 1 -- 172.21.15.181:0/3371385579 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8037070 con 0x7f30f815e640 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.320+0000 7f30f6ffd640 1 -- 172.21.15.181:0/3371385579 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e8032440 con 0x7f30f815e640 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.320+0000 7f30f6ffd640 1 -- 172.21.15.181:0/3371385579 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e80327f0 con 0x7f30f815e640 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.320+0000 7f30fe952640 1 -- 172.21.15.181:0/3371385579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 msgr2=0x7f30f80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.320+0000 7f30fe952640 1 --2- 172.21.15.181:0/3371385579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 0x7f30f80ceba0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.321+0000 7f30fe952640 1 -- 172.21.15.181:0/3371385579 shutdown_connections 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.321+0000 7f30fe952640 1 --2- 172.21.15.181:0/3371385579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 0x7f30f80ceba0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.321+0000 7f30fe952640 1 -- 172.21.15.181:0/3371385579 >> 172.21.15.181:0/3371385579 conn(0x7f30f809d820 msgr2=0x7f30f80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.321+0000 7f30fe952640 1 -- 172.21.15.181:0/3371385579 shutdown_connections 2024-09-12T02:29:28.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.321+0000 7f30fe952640 1 -- 172.21.15.181:0/3371385579 wait complete. 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.322+0000 7f30fe952640 1 Processor -- start 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.322+0000 7f30fe952640 1 -- start start 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30fe952640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f80cf0e0 0x7f30f81583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30fe952640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f80d3660 0x7f30f81f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30fe952640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 0x7f30f8160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30fe952640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80cfe40 con 0x7f30f80cf0e0 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30fe952640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80b24f0 con 0x7f30f815e640 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30fe952640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80b73a0 con 0x7f30f80d3660 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f80cf0e0 0x7f30f81583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f80cf0e0 0x7f30f81583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46254/0 (socket says 172.21.15.181:46254) 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 -- 172.21.15.181:0/2541650039 learned_addr learned my addr 172.21.15.181:0/2541650039 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30fceef640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 0x7f30f8160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f77fe640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f80d3660 0x7f30f81f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 -- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f80d3660 msgr2=0x7f30f81f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f80d3660 0x7f30f81f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 -- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 msgr2=0x7f30f8160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 0x7f30f8160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 -- 172.21.15.181:0/2541650039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f81f4ef0 con 0x7f30f80cf0e0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f7fff640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f80cf0e0 0x7f30f81583b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.323+0000 7f30f4ff9640 1 -- 172.21.15.181:0/2541650039 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8037050 con 0x7f30f80cf0e0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.324+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f81f51d0 con 0x7f30f80cf0e0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.324+0000 7f30f4ff9640 1 -- 172.21.15.181:0/2541650039 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e8038040 con 0x7f30f80cf0e0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.324+0000 7f30f4ff9640 1 -- 172.21.15.181:0/2541650039 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8004470 con 0x7f30f80cf0e0 2024-09-12T02:29:28.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.324+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f80c9c70 con 0x7f30f80cf0e0 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.325+0000 7f30f4ff9640 1 -- 172.21.15.181:0/2541650039 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30e803c6d0 con 0x7f30f80cf0e0 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.325+0000 7f30f4ff9640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f30e406be30 0x7f30e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.326+0000 7f30f4ff9640 1 -- 172.21.15.181:0/2541650039 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f30e80ab740 con 0x7f30f80cf0e0 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.326+0000 7f30f77fe640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f30e406be30 0x7f30e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.326+0000 7f30f77fe640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f30e406be30 0x7f30e406e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30f81588f0 tx=0x7f30ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.326+0000 7f31017ca740 1 Processor -- start 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.326+0000 7f31017ca740 1 -- start start 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 0x5609eb3c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb37da80 0x5609eb3806a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f31017ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb37a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f31017ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5609eb2e2520 con 0x5609eb381a50 2024-09-12T02:29:28.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5609eb28a3e0 con 0x5609eb3802c0 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5609eb2de4e0 con 0x5609eb37da80 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb37a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb37a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46258/0 (socket says 172.21.15.181:46258) 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 -- 172.21.15.181:0/3471327397 learned_addr learned my addr 172.21.15.181:0/3471327397 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30f77fe640 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb37da80 0x5609eb3806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30f7fff640 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 0x5609eb3c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 -- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb37da80 msgr2=0x5609eb3806a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb37da80 0x5609eb3806a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 -- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 msgr2=0x5609eb3c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 0x5609eb3c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.327+0000 7f30fceef640 1 -- 172.21.15.181:0/3471327397 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609eb2a52f0 con 0x5609eb381a50 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f30fceef640 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb37a8b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30f000f280 tx=0x7f30f0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f79706a1da214c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f30ddffb640 1 -- 172.21.15.181:0/3471327397 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00072e0 con 0x5609eb381a50 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f30ddffb640 1 -- 172.21.15.181:0/3471327397 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0018070 con 0x5609eb381a50 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f30ddffb640 1 -- 172.21.15.181:0/3471327397 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0007680 con 0x5609eb381a50 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 -- 172.21.15.181:0/3471327397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 msgr2=0x5609eb37a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb37a8b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30f000f280 tx=0x7f30f0001a30 comp rx=0 tx=0).stop 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 -- 172.21.15.181:0/3471327397 shutdown_connections 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb37a8b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb37da80 0x5609eb3806a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 --2- 172.21.15.181:0/3471327397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 0x5609eb3c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 -- 172.21.15.181:0/3471327397 >> 172.21.15.181:0/3471327397 conn(0x5609eb37ca80 msgr2=0x5609eb3c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 -- 172.21.15.181:0/3471327397 shutdown_connections 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.328+0000 7f31017ca740 1 -- 172.21.15.181:0/3471327397 wait complete. 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.329+0000 7f31017ca740 1 -- start start 2024-09-12T02:29:28.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.329+0000 7f31017ca740 1 Processor -- start 2024-09-12T02:29:28.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb3d8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f31017ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3a7dc0 0x5609eb3999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f31017ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5609eb37bf20 con 0x5609eb381a50 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5609eb26b450 con 0x5609eb3a7dc0 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5609eb3c6290 con 0x5609eb3802c0 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f31017ca740 10 client.0 _ll_register_callbacks cb 0x5609eaff4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3d4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46274/0 (socket says 172.21.15.181:46274) 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 -- 172.21.15.181:0/2501702203 learned_addr learned my addr 172.21.15.181:0/2501702203 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f7fff640 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb3d8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30fceef640 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3a7dc0 0x5609eb3999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 -- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 msgr2=0x5609eb3d8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb3d8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 -- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3a7dc0 msgr2=0x5609eb3999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3a7dc0 0x5609eb3999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 -- 172.21.15.181:0/2501702203 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609eaff52d0 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30f77fe640 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3d4dc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006a80 tx=0x7f30ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f80bca93bc4dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.330+0000 7f30d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f30d6ffd640 1 -- 172.21.15.181:0/2501702203 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0075b0 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f0018070 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f30d6ffd640 1 -- 172.21.15.181:0/2501702203 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f30ec021410 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f30d6ffd640 1 -- 172.21.15.181:0/2501702203 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f30ec02e050 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 10 client.5190 fetch_fsmap learned FSMap version 20 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5609eb0bf6b0 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f30d6ffd640 1 -- 172.21.15.181:0/2501702203 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0018070 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f30d6ffd640 1 -- 172.21.15.181:0/2501702203 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f30ec031020 con 0x5609eb381a50 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 10 client.5190 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 10 client.5190 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:29:28.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 20 client.5190 populate_metadata read hostname 'smithi181' 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3abee0 0x5609eb3aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 4 client.5190 mds_command: new command op to 4750 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 --> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609eb2efc50 con 0x5609eb3abee0 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.331+0000 7f30f7fff640 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3abee0 0x5609eb3aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f30d6ffd640 10 client.5190 ms_handle_connect on v2:172.21.15.181:6834/1355989745 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f30f7fff640 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3abee0 0x5609eb3aca60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b5ca662d220ec6 server_cookie=bc111bf81e450d6f in_seq=0 out_seq=0 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f30d6ffd640 1 -- 172.21.15.181:0/2501702203 <== mds.0 v2:172.21.15.181:6834/1355989745 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609eb2efc50 con 0x5609eb3abee0 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f30d6ffd640 10 client.5190 handle_command_reply: tid=0 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 client.5190 shutdown 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 msgr2=0x5609eb3d4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3d4dc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006a80 tx=0x7f30ec000ed0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 shutdown_connections 2024-09-12T02:29:28.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3abee0 0x5609eb3aca60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3a7dc0 0x5609eb3999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3d4dc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 --2- 172.21.15.181:0/2501702203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb3d8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f30d6ffd640 0 client.5190 ms_handle_reset on v2:172.21.15.181:6834/1355989745 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 >> 172.21.15.181:0/2501702203 conn(0x5609eb37da80 msgr2=0x5609eb3c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 shutdown_connections 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.332+0000 7f31017ca740 1 -- 172.21.15.181:0/2501702203 wait complete. 2024-09-12T02:29:28.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.333+0000 7f31017ca740 20 client.5190 trim_cache size 0 max 16384 2024-09-12T02:29:28.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.350+0000 7f31017ca740 1 Processor -- start 2024-09-12T02:29:28.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.350+0000 7f31017ca740 1 -- start start 2024-09-12T02:29:28.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 0x5609eb3acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f31017ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3a7dc0 0x5609eb3c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f31017ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81ffbf0 con 0x5609eb381a50 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f30f815fed0 con 0x5609eb3802c0 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f30f81f8450 con 0x5609eb3a7dc0 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46276/0 (socket says 172.21.15.181:46276) 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 -- 172.21.15.181:0/1765619993 learned_addr learned my addr 172.21.15.181:0/1765619993 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 -- 172.21.15.181:0/1765619993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3a7dc0 msgr2=0x5609eb3c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 --2- 172.21.15.181:0/1765619993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3a7dc0 0x5609eb3c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 -- 172.21.15.181:0/1765619993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 msgr2=0x5609eb3acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 --2- 172.21.15.181:0/1765619993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 0x5609eb3acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 -- 172.21.15.181:0/1765619993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609eb3c20e0 con 0x5609eb381a50 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30f77fe640 1 --2- 172.21.15.181:0/1765619993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3ad160 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00fc40 tx=0x7f30ec01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ce9863cdb6b939 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30dd7fa640 1 -- 172.21.15.181:0/1765619993 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec02b650 con 0x5609eb381a50 2024-09-12T02:29:28.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30dd7fa640 1 -- 172.21.15.181:0/1765619993 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec026070 con 0x5609eb381a50 2024-09-12T02:29:28.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.351+0000 7f30dd7fa640 1 -- 172.21.15.181:0/1765619993 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec02ba10 con 0x5609eb381a50 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 -- 172.21.15.181:0/1765619993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 msgr2=0x5609eb3ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 --2- 172.21.15.181:0/1765619993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3ad160 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00fc40 tx=0x7f30ec01b000 comp rx=0 tx=0).stop 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 -- 172.21.15.181:0/1765619993 shutdown_connections 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 --2- 172.21.15.181:0/1765619993 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3a7dc0 0x5609eb3c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 --2- 172.21.15.181:0/1765619993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb381a50 0x5609eb3ad160 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 --2- 172.21.15.181:0/1765619993 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb3802c0 0x5609eb3acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 -- 172.21.15.181:0/1765619993 >> 172.21.15.181:0/1765619993 conn(0x5609eb37da80 msgr2=0x5609eb3c6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 -- 172.21.15.181:0/1765619993 shutdown_connections 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.352+0000 7f31017ca740 1 -- 172.21.15.181:0/1765619993 wait complete. 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.353+0000 7f31017ca740 1 -- start start 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.353+0000 7f31017ca740 1 Processor -- start 2024-09-12T02:29:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb43d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb381a50 0x5609eb3c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb3a7dc0 0x5609eb3c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5609eb39a110 con 0x5609eb3a7dc0 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5609eb3a8390 con 0x5609eb381a50 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5609eb3aa1d0 con 0x5609eb3802c0 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 10 client.0 _ll_register_callbacks cb 0x7f30ec00fea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb3a7dc0 0x5609eb3c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb3a7dc0 0x5609eb3c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46284/0 (socket says 172.21.15.181:46284) 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 -- 172.21.15.181:0/560349136 learned_addr learned my addr 172.21.15.181:0/560349136 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30f7fff640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb43d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30f77fe640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb381a50 0x5609eb3c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 -- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 msgr2=0x5609eb43d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb43d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 -- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb381a50 msgr2=0x5609eb3c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb381a50 0x5609eb3c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 -- 172.21.15.181:0/560349136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609eb3a63d0 con 0x5609eb3a7dc0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30f77fe640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb381a50 0x5609eb3c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30fceef640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb3a7dc0 0x5609eb3c0e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f30f000f250 tx=0x7f30f0005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccecd5a9edcf23d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30d6ffd640 1 -- 172.21.15.181:0/560349136 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0007a00 con 0x5609eb3a7dc0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30d6ffd640 1 -- 172.21.15.181:0/560349136 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f30f0029b50 con 0x5609eb3a7dc0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30ec026070 con 0x5609eb3a7dc0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f30d6ffd640 1 -- 172.21.15.181:0/560349136 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f30f0030050 con 0x5609eb3a7dc0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 10 client.5196 fetch_fsmap learned FSMap version 20 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.354+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5609eb3c8b70 con 0x5609eb3a7dc0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f30d6ffd640 1 -- 172.21.15.181:0/560349136 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec026070 con 0x5609eb3a7dc0 2024-09-12T02:29:28.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f30d6ffd640 1 -- 172.21.15.181:0/560349136 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f30f0033020 con 0x5609eb3a7dc0 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 10 client.5196 fetch_fsmap finished waiting for FSMap version 20 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 10 client.5196 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 20 client.5196 populate_metadata read hostname 'smithi181' 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3e7d10 0x5609eb3e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 4 client.5196 mds_command: new command op to 4750 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 --> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] -- command(tid 0: {"prefix": "status"}) -- 0x5609eb2e9fa0 con 0x5609eb3e7d10 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f30f7fff640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3e7d10 0x5609eb3e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f30d6ffd640 10 client.5196 ms_handle_connect on v2:172.21.15.181:6834/1355989745 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f30f7fff640 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3e7d10 0x5609eb3e80f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62f985644b6468ac server_cookie=e8e8926bd62b169d in_seq=0 out_seq=0 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f30d6ffd640 1 -- 172.21.15.181:0/560349136 <== mds.0 v2:172.21.15.181:6834/1355989745 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5609eb2e9fa0 con 0x5609eb3e7d10 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f30d6ffd640 10 client.5196 handle_command_reply: tid=0 2024-09-12T02:29:28.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 1 client.5196 shutdown 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.355+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb3a7dc0 msgr2=0x5609eb3c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb3a7dc0 0x5609eb3c0e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f30f000f250 tx=0x7f30f0005b70 comp rx=0 tx=0).stop 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 shutdown_connections 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:6834/1355989745,v1:172.21.15.181:6835/1355989745] conn(0x5609eb3e7d10 0x5609eb3e80f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5609eb381a50 0x5609eb3c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609eb3a7dc0 0x5609eb3c0e00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30d6ffd640 0 client.5196 ms_handle_reset on v2:172.21.15.181:6834/1355989745 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 --2- 172.21.15.181:0/560349136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5609eb3802c0 0x5609eb43d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 >> 172.21.15.181:0/560349136 conn(0x5609eb37da80 msgr2=0x5609eb3ab2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 shutdown_connections 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 1 -- 172.21.15.181:0/560349136 wait complete. 2024-09-12T02:29:28.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f31017ca740 20 client.5196 trim_cache size 0 max 16384 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 4750, 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 4.3627331229999999, 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 20, 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 33, 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 33, 2024-09-12T02:29:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 32.651925525999999 2024-09-12T02:29:28.365 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:29:28.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f30e406be30 msgr2=0x7f30e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f30e406be30 0x7f30e406e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30f81588f0 tx=0x7f30ec009040 comp rx=0 tx=0).stop 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f80cf0e0 msgr2=0x7f30f81583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f80cf0e0 0x7f30f81583b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e80046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 shutdown_connections 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f30e406be30 0x7f30e406e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30f815e640 0x7f30f8160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30f80d3660 0x7f30f81f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 --2- 172.21.15.181:0/2541650039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f80cf0e0 0x7f30f81583b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 >> 172.21.15.181:0/2541650039 conn(0x7f30f809d820 msgr2=0x7f30f80b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 shutdown_connections 2024-09-12T02:29:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.356+0000 7f30fe952640 1 -- 172.21.15.181:0/2541650039 wait complete. 2024-09-12T02:29:28.368 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:29:28.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.466+0000 7fda83311640 1 Processor -- start 2024-09-12T02:29:28.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.466+0000 7fda83311640 1 -- start start 2024-09-12T02:29:28.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda83311640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda83311640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fda7c0b2490 0x7fda7c071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda83311640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7c0ce4f0 con 0x7fda7c0cdfc0 2024-09-12T02:29:28.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda83311640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fda7c15b6c0 con 0x7fda7c0b2490 2024-09-12T02:29:28.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda83311640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c0ce7d0 con 0x7fda7c15b2e0 2024-09-12T02:29:28.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda818ae640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fda7c0b2490 0x7fda7c071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda818ae640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fda7c0b2490 0x7fda7c071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46300/0 (socket says 172.21.15.181:46300) 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda818ae640 1 -- 172.21.15.181:0/3204766750 learned_addr learned my addr 172.21.15.181:0/3204766750 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda810ad640 1 --2- 172.21.15.181:0/3204766750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda818ae640 1 -- 172.21.15.181:0/3204766750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 msgr2=0x7fda7c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda818ae640 1 --2- 172.21.15.181:0/3204766750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda818ae640 1 -- 172.21.15.181:0/3204766750 >> v1:172.21.15.204:6789/0 conn(0x7fda7c0cdfc0 legacy=0x7fda7c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda818ae640 1 -- 172.21.15.181:0/3204766750 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c0ceab0 con 0x7fda7c0b2490 2024-09-12T02:29:28.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.467+0000 7fda810ad640 1 --2- 172.21.15.181:0/3204766750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:28.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.468+0000 7fda818ae640 1 --2- 172.21.15.181:0/3204766750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c071750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda74009e50 tx=0x7fda7402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bd3e7537aaa323 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.468+0000 7fda73fff640 1 -- 172.21.15.181:0/3204766750 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74036070 con 0x7fda7c0b2490 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.468+0000 7fda73fff640 1 -- 172.21.15.181:0/3204766750 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74031600 con 0x7fda7c0b2490 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.468+0000 7fda73fff640 1 -- 172.21.15.181:0/3204766750 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda740319d0 con 0x7fda7c0b2490 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.468+0000 7fda83311640 1 -- 172.21.15.181:0/3204766750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 msgr2=0x7fda7c071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.469+0000 7fda83311640 1 --2- 172.21.15.181:0/3204766750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c071750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda74009e50 tx=0x7fda7402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.469+0000 7fda83311640 1 -- 172.21.15.181:0/3204766750 shutdown_connections 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.469+0000 7fda83311640 1 --2- 172.21.15.181:0/3204766750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c071750 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.469+0000 7fda83311640 1 --2- 172.21.15.181:0/3204766750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.469+0000 7fda83311640 1 -- 172.21.15.181:0/3204766750 >> 172.21.15.181:0/3204766750 conn(0x7fda7c06bc10 msgr2=0x7fda7c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.469+0000 7fda83311640 1 -- 172.21.15.181:0/3204766750 shutdown_connections 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.469+0000 7fda83311640 1 -- 172.21.15.181:0/3204766750 wait complete. 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.470+0000 7fda83311640 1 Processor -- start 2024-09-12T02:29:28.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.470+0000 7fda83311640 1 -- start start 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.470+0000 7fda83311640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.470+0000 7fda83311640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda7c0cdfc0 0x7fda7c156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda83311640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda83311640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c0712b0 con 0x7fda7c0b2490 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda83311640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c071130 con 0x7fda7c0cdfc0 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda83311640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c0b4260 con 0x7fda7c15b2e0 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c0ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46302/0 (socket says 172.21.15.181:46302) 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 -- 172.21.15.181:0/391848897 learned_addr learned my addr 172.21.15.181:0/391848897 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:28.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda818ae640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda808ac640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda7c0cdfc0 0x7fda7c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 -- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 msgr2=0x7fda7c15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 -- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda7c0cdfc0 msgr2=0x7fda7c156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda7c0cdfc0 0x7fda7c156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 -- 172.21.15.181:0/391848897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c0ad700 con 0x7fda7c0b2490 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda808ac640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda7c0cdfc0 0x7fda7c156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda810ad640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c0ae4c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c7f0 tx=0x7fda7800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda71ffb640 1 -- 172.21.15.181:0/391848897 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78015070 con 0x7fda7c0b2490 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda71ffb640 1 -- 172.21.15.181:0/391848897 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda78007820 con 0x7fda7c0b2490 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda71ffb640 1 -- 172.21.15.181:0/391848897 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78007bd0 con 0x7fda7c0b2490 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.471+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7c0ad9e0 con 0x7fda7c0b2490 2024-09-12T02:29:28.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.472+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7c15e450 con 0x7fda7c0b2490 2024-09-12T02:29:28.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.472+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c159ff0 con 0x7fda7c0b2490 2024-09-12T02:29:28.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.473+0000 7fda71ffb640 1 -- 172.21.15.181:0/391848897 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda78018070 con 0x7fda7c0b2490 2024-09-12T02:29:28.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.473+0000 7fda71ffb640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fda6006be30 0x7fda6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:28.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.473+0000 7fda71ffb640 1 -- 172.21.15.181:0/391848897 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fda7808aef0 con 0x7fda7c0b2490 2024-09-12T02:29:28.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.473+0000 7fda808ac640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fda6006be30 0x7fda6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:28.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.474+0000 7fda808ac640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fda6006be30 0x7fda6006e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda7c074300 tx=0x7fda6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:28.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.477+0000 7fda71ffb640 1 -- 172.21.15.181:0/391848897 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda7c159ff0 con 0x7fda7c0b2490 2024-09-12T02:29:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.677+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda7c0b3d20 con 0x7fda7c0b2490 2024-09-12T02:29:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.677+0000 7fda71ffb640 1 -- 172.21.15.181:0/391848897 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7fda78059280 con 0x7fda7c0b2490 2024-09-12T02:29:28.678 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:29:28.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fda6006be30 msgr2=0x7fda6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fda6006be30 0x7fda6006e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda7c074300 tx=0x7fda6c009040 comp rx=0 tx=0).stop 2024-09-12T02:29:28.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 msgr2=0x7fda7c0ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c0ae4c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c7f0 tx=0x7fda7800ccb0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 shutdown_connections 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fda6006be30 0x7fda6006e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda7c0cdfc0 0x7fda7c156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda7c15b2e0 0x7fda7c15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 --2- 172.21.15.181:0/391848897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7c0b2490 0x7fda7c0ae4c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 >> 172.21.15.181:0/391848897 conn(0x7fda7c06bc10 msgr2=0x7fda7c1598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 shutdown_connections 2024-09-12T02:29:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28.679+0000 7fda83311640 1 -- 172.21.15.181:0/391848897 wait complete. 2024-09-12T02:29:28.691 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:29:28.691 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:29:28.691 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:29:28.691 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:29:28.691 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:28.691 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:29:28.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:29:28.692 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:29:28.692 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:28.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:28.692 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:29:28.709 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:29:28.709 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:29:28.709 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:29:28.710 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42675sec preferred_lft 42675sec 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:28.711 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:28.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:28.712 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:29:28.773 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:29:28.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:28.775 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:29:28.830 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:29:28.831 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:29:28.831 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:29:28.831 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:29:28.831 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:29:28.831 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:29:28.831 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:29:28.831 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:29:28.831 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:29:28.832 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:29:28.832 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:29:28.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:29:28.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:28.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:28.956 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:29:28.972 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:29:28.972 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:29:28.972 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:28.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:28.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:29:29.038 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:29:29.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:29:29.038 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:29.094 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:29.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:29:29.094 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:29.149 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:29:29.215 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:29:29.271 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:29:29.272 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:29:29.273 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:29.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:29.274 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:29:29.327 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:29:29.327 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:29:29.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:29:29.394 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:29:29.451 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:29:29.452 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:29.453 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:29.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:29.454 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:29:29.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:29:29.450+0000 7fdd15535480 -1 init, newargv = 0x5633799a1690 newargc=15 2024-09-12T02:29:29.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[49827]: starting ceph client 2024-09-12T02:29:29.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[49827]: starting fuse 2024-09-12T02:29:29.470 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:29:29.470 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:29:29.471 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:29:29.472 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:29.588 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.49827.asok 2024-09-12T02:29:29.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:29.598 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49827.asok 2024-09-12T02:29:29.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:29.599 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49827.asok status 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "49827", 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:29:29.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 5211, 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 5211 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 2176218671 2024-09-12T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 2176218671 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.5211 192.168.0.1:0/2176218671", 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/2176218671", 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 20, 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 33, 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:29:29.733 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:29:29.734 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:29:29.734 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:29:29.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:29.739 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:29:29.739 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:29.755 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:29:29.755 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:29.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:29.755 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:29.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:29.821 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-12T02:29:29.879 INFO:tasks.ceph.mds.a.smithi181.stderr:2024-09-12T02:29:29.878+0000 7fe9506a3640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2024-09-12T02:29:29.882 INFO:tasks.ceph.mds.a.smithi181.stderr:2024-09-12T02:29:29.882+0000 7fe9506a3640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-09-12T02:29:29.884 INFO:teuthology.orchestra.run.smithi181.stdout:.: 2024-09-12T02:29:29.884 INFO:teuthology.orchestra.run.smithi181.stdout:linkdir 2024-09-12T02:29:29.884 INFO:teuthology.orchestra.run.smithi181.stdout:rootfile 2024-09-12T02:29:29.884 INFO:teuthology.orchestra.run.smithi181.stdout:subdir 2024-09-12T02:29:29.884 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:29.884 INFO:teuthology.orchestra.run.smithi181.stdout:./linkdir: 2024-09-12T02:29:29.884 INFO:teuthology.orchestra.run.smithi181.stdout:link2 2024-09-12T02:29:29.885 INFO:teuthology.orchestra.run.smithi181.stdout:link3 2024-09-12T02:29:29.885 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:29.885 INFO:teuthology.orchestra.run.smithi181.stdout:./subdir: 2024-09-12T02:29:29.885 INFO:teuthology.orchestra.run.smithi181.stdout:subdirfile 2024-09-12T02:29:29.885 INFO:teuthology.orchestra.run.smithi181.stdout:subsubdir 2024-09-12T02:29:29.885 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:29.885 INFO:teuthology.orchestra.run.smithi181.stdout:./subdir/subsubdir: 2024-09-12T02:29:29.886 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:29.886 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:29.943 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.081+0000 7f1f98bb9640 1 Processor -- start 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.081+0000 7f1f98bb9640 1 -- start start 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.082+0000 7f1f98bb9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1f940cf2b0 0x7f1f940d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.082+0000 7f1f98bb9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9415ea20 con 0x7f1f9415e640 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.082+0000 7f1f98bb9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f940b1c50 con 0x7f1f940cf720 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.082+0000 7f1f98bb9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1f940b3d00 con 0x7f1f940cf2b0 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.082+0000 7f1f9259c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1f9415e640 0x7f1f940ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:42822/0 (socket says 172.21.15.181:42822) 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.082+0000 7f1f9259c640 1 -- 172.21.15.181:0/3381414535 learned_addr learned my addr 172.21.15.181:0/3381414535 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:30.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.082+0000 7f1f89d9b640 1 --2- 172.21.15.181:0/3381414535 >> v2:172.21.15.204:3300/0 conn(0x7f1f940cf2b0 0x7f1f940d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952330803 0 0) 0x7f1f9415ea20 con 0x7f1f9415e640 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f80003520 con 0x7f1f9415e640 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1391593543 0 0) 0x7f1f80003520 con 0x7f1f9415e640 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 >> v2:172.21.15.204:3300/0 conn(0x7f1f940cf2b0 msgr2=0x7f1f940d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 --2- 172.21.15.181:0/3381414535 >> v2:172.21.15.204:3300/0 conn(0x7f1f940cf2b0 0x7f1f940d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 >> v1:172.21.15.204:6789/0 conn(0x7f1f940cf720 legacy=0x7f1f940d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f940b1f30 con 0x7f1f9415e640 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f1f84001670 con 0x7f1f9415e640 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 >> v1:172.21.15.181:6789/0 conn(0x7f1f9415e640 legacy=0x7f1f940ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f800039b0 0x7f1f80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f80004800 0x7f1f80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800051c0 0x7f1f8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8000c130 con 0x7f1f800051c0 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8000c2e0 con 0x7f1f80004800 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8000c4e0 con 0x7f1f800039b0 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f92d9d640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800051c0 0x7f1f8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f9259c640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f800039b0 0x7f1f80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f89d9b640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f80004800 0x7f1f80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f92d9d640 1 -- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f800039b0 msgr2=0x7f1f80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f92d9d640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f800039b0 0x7f1f80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f92d9d640 1 -- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f80004800 msgr2=0x7f1f80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f92d9d640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f80004800 0x7f1f80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.083+0000 7f1f92d9d640 1 -- 172.21.15.181:0/3381414535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f80003520 con 0x7f1f800051c0 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.084+0000 7f1f92d9d640 1 -- 172.21.15.181:0/3381414535 reap_dead start 2024-09-12T02:29:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.084+0000 7f1f92d9d640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800051c0 0x7f1f8000b9c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c001e20 tx=0x7f1f80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a37d025e3c7f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.084+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c001a70 con 0x7f1f800051c0 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.084+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8c02ae40 con 0x7f1f800051c0 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.084+0000 7f1f91d9b640 1 -- 172.21.15.181:0/3381414535 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c003bb0 con 0x7f1f800051c0 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.085+0000 7f1f98bb9640 1 -- 172.21.15.181:0/3381414535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800051c0 msgr2=0x7f1f8000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.085+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800051c0 0x7f1f8000b9c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c001e20 tx=0x7f1f80005830 comp rx=0 tx=0).stop 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.085+0000 7f1f98bb9640 1 -- 172.21.15.181:0/3381414535 shutdown_connections 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.085+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/3381414535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800051c0 0x7f1f8000b9c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.085+0000 7f1f98bb9640 1 -- 172.21.15.181:0/3381414535 >> 172.21.15.181:0/3381414535 conn(0x7f1f9409d820 msgr2=0x7f1f940d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.085+0000 7f1f98bb9640 1 -- 172.21.15.181:0/3381414535 shutdown_connections 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.085+0000 7f1f98bb9640 1 -- 172.21.15.181:0/3381414535 wait complete. 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.086+0000 7f1f98bb9640 1 Processor -- start 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.086+0000 7f1f98bb9640 1 -- start start 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f98bb9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f800051c0 0x7f1f940cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f98bb9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940cc290 0x7f1f94150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f98bb9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f9409e500 0x7f1f9414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f98bb9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940b24f0 con 0x7f1f940cc290 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f98bb9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940b2860 con 0x7f1f800051c0 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f98bb9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1f940cfe40 con 0x7f1f9409e500 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940cc290 0x7f1f94150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940cc290 0x7f1f94150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39744/0 (socket says 172.21.15.181:39744) 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 -- 172.21.15.181:0/2515180461 learned_addr learned my addr 172.21.15.181:0/2515180461 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f92d9d640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f9409e500 0x7f1f9414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 -- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f9409e500 msgr2=0x7f1f9414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f9409e500 0x7f1f9414d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f9259c640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f800051c0 0x7f1f940cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 -- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f800051c0 msgr2=0x7f1f940cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f800051c0 0x7f1f940cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 -- 172.21.15.181:0/2515180461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f94151360 con 0x7f1f940cc290 2024-09-12T02:29:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.087+0000 7f1f89d9b640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940cc290 0x7f1f94150e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c011910 tx=0x7f1f7c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.088+0000 7f1f8b7fe640 1 -- 172.21.15.181:0/2515180461 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00faf0 con 0x7f1f940cc290 2024-09-12T02:29:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.088+0000 7f1f8b7fe640 1 -- 172.21.15.181:0/2515180461 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c00fc90 con 0x7f1f940cc290 2024-09-12T02:29:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.088+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9415d750 con 0x7f1f940cc290 2024-09-12T02:29:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.088+0000 7f1f8b7fe640 1 -- 172.21.15.181:0/2515180461 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c014440 con 0x7f1f940cc290 2024-09-12T02:29:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.088+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f940ccce0 con 0x7f1f940cc290 2024-09-12T02:29:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.089+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f940b8520 con 0x7f1f940cc290 2024-09-12T02:29:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.089+0000 7f1f8b7fe640 1 -- 172.21.15.181:0/2515180461 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f7c012040 con 0x7f1f940cc290 2024-09-12T02:29:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.089+0000 7f1f8b7fe640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1f7406be30 0x7f1f7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.090+0000 7f1f8b7fe640 1 -- 172.21.15.181:0/2515180461 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f1f7c08b540 con 0x7f1f940cc290 2024-09-12T02:29:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.090+0000 7f1f9259c640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1f7406be30 0x7f1f7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.090+0000 7f1f9259c640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1f7406be30 0x7f1f7406e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f840017b0 tx=0x7f1f84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.094+0000 7f1f8b7fe640 1 -- 172.21.15.181:0/2515180461 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f7c019030 con 0x7f1f940cc290 2024-09-12T02:29:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.271+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1f941619a0 con 0x7f1f940cc290 2024-09-12T02:29:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.271+0000 7f1f8b7fe640 1 -- 172.21.15.181:0/2515180461 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v33) ==== 80+0+124 (secure 0 0 0) 0x7f1f7c059e90 con 0x7f1f940cc290 2024-09-12T02:29:30.272 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6835/2347584783 2024-09-13T02:29:21.976381+0000 2024-09-12T02:29:30.272 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6833/2347584783 2024-09-13T02:29:21.976381+0000 2024-09-12T02:29:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:listed 2 entries 2024-09-12T02:29:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1f7406be30 msgr2=0x7f1f7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1f7406be30 0x7f1f7406e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f840017b0 tx=0x7f1f84009040 comp rx=0 tx=0).stop 2024-09-12T02:29:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940cc290 msgr2=0x7f1f94150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940cc290 0x7f1f94150e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c011910 tx=0x7f1f7c011dd0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 shutdown_connections 2024-09-12T02:29:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1f7406be30 0x7f1f7406e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1f9409e500 0x7f1f9414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f940cc290 0x7f1f94150e20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 --2- 172.21.15.181:0/2515180461 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1f800051c0 0x7f1f940cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 >> 172.21.15.181:0/2515180461 conn(0x7f1f9409d820 msgr2=0x7f1f94160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 shutdown_connections 2024-09-12T02:29:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.273+0000 7f1f98bb9640 1 -- 172.21.15.181:0/2515180461 wait complete. 2024-09-12T02:29:30.285 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:30.285 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:30.301 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:29:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.439+0000 7f326e253640 1 Processor -- start 2024-09-12T02:29:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.439+0000 7f326e253640 1 -- start start 2024-09-12T02:29:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.440+0000 7f326e253640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32680cdfc0 0x7f32680b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.440+0000 7f326e253640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32680b22c0 0x7f3268071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.440+0000 7f326e253640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32680ce4f0 con 0x7f326815b2e0 2024-09-12T02:29:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.440+0000 7f326e253640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f326815b6c0 con 0x7f32680b22c0 2024-09-12T02:29:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.440+0000 7f326e253640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32680b4430 con 0x7f32680cdfc0 2024-09-12T02:29:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32680cdfc0 0x7f32680b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3267fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f32680b22c0 0x7f3268071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32680cdfc0 0x7f32680b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:50406/0 (socket says 172.21.15.181:50406) 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3266ffd640 1 -- 172.21.15.181:0/848341528 learned_addr learned my addr 172.21.15.181:0/848341528 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f32677fe640 1 --1- 172.21.15.181:0/848341528 >> v1:172.21.15.204:6789/0 conn(0x7f326815b2e0 0x7f32680b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:45018/0 (socket says 172.21.15.181:45018) 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3266ffd640 1 -- 172.21.15.181:0/848341528 >> v2:172.21.15.204:3300/0 conn(0x7f32680b22c0 msgr2=0x7f3268071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3266ffd640 1 --2- 172.21.15.181:0/848341528 >> v2:172.21.15.204:3300/0 conn(0x7f32680b22c0 0x7f3268071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3266ffd640 1 -- 172.21.15.181:0/848341528 >> v1:172.21.15.204:6789/0 conn(0x7f326815b2e0 legacy=0x7f32680b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3266ffd640 1 -- 172.21.15.181:0/848341528 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32680ce7d0 con 0x7f32680cdfc0 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.441+0000 7f3267fff640 1 --2- 172.21.15.181:0/848341528 >> v2:172.21.15.204:3300/0 conn(0x7f32680b22c0 0x7f3268071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f3266ffd640 1 --2- 172.21.15.181:0/848341528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32680cdfc0 0x7f32680b1d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f325c009e50 tx=0x7f325c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775654102bfa80ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f32667fc640 1 -- 172.21.15.181:0/848341528 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c036070 con 0x7f32680cdfc0 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f32667fc640 1 -- 172.21.15.181:0/848341528 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c031600 con 0x7f32680cdfc0 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f32667fc640 1 -- 172.21.15.181:0/848341528 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0319d0 con 0x7f32680cdfc0 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 -- 172.21.15.181:0/848341528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32680cdfc0 msgr2=0x7f32680b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 --2- 172.21.15.181:0/848341528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32680cdfc0 0x7f32680b1d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f325c009e50 tx=0x7f325c02a710 comp rx=0 tx=0).stop 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 -- 172.21.15.181:0/848341528 shutdown_connections 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 --2- 172.21.15.181:0/848341528 >> v2:172.21.15.204:3300/0 conn(0x7f32680b22c0 0x7f3268071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 --2- 172.21.15.181:0/848341528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32680cdfc0 0x7f32680b1d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 -- 172.21.15.181:0/848341528 >> 172.21.15.181:0/848341528 conn(0x7f326806bc10 msgr2=0x7f326806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 -- 172.21.15.181:0/848341528 shutdown_connections 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.442+0000 7f326e253640 1 -- 172.21.15.181:0/848341528 wait complete. 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.444+0000 7f326e253640 1 Processor -- start 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.444+0000 7f326e253640 1 -- start start 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32680b22c0 0x7f32681526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32680cdfc0 0x7f32681f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f326815b2e0 0x7f3268153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3268071130 con 0x7f32680b22c0 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f32680ced90 con 0x7f32680cdfc0 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32680712b0 con 0x7f326815b2e0 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32680b22c0 0x7f32681526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32680b22c0 0x7f32681526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39754/0 (socket says 172.21.15.181:39754) 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 -- 172.21.15.181:0/181797720 learned_addr learned my addr 172.21.15.181:0/181797720 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f3266ffd640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32680cdfc0 0x7f32681f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f3267fff640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f326815b2e0 0x7f3268153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 -- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f326815b2e0 msgr2=0x7f3268153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f326815b2e0 0x7f3268153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 -- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32680cdfc0 msgr2=0x7f32681f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32680cdfc0 0x7f32681f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 -- 172.21.15.181:0/181797720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3268150d90 con 0x7f32680b22c0 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f32677fe640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32680b22c0 0x7f32681526f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f325800c3c0 tx=0x7f325800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f324ffff640 1 -- 172.21.15.181:0/181797720 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32580074e0 con 0x7f32680b22c0 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f324ffff640 1 -- 172.21.15.181:0/181797720 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3258007680 con 0x7f32680b22c0 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3268151030 con 0x7f32680b22c0 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f324ffff640 1 -- 172.21.15.181:0/181797720 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258004a00 con 0x7f32680b22c0 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.445+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32681515f0 con 0x7f32680b22c0 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.446+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3268071750 con 0x7f32680b22c0 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.447+0000 7f324ffff640 1 -- 172.21.15.181:0/181797720 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f325801a020 con 0x7f32680b22c0 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.447+0000 7f324ffff640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f325406be30 0x7f325406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.447+0000 7f324ffff640 1 -- 172.21.15.181:0/181797720 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f325808a580 con 0x7f32680b22c0 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.447+0000 7f3266ffd640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f325406be30 0x7f325406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.448+0000 7f3266ffd640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f325406be30 0x7f325406e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f325c009e50 tx=0x7f325c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.452+0000 7f324ffff640 1 -- 172.21.15.181:0/181797720 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3268150d90 con 0x7f32680b22c0 2024-09-12T02:29:30.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.628+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f326806f170 con 0x7f32680b22c0 2024-09-12T02:29:30.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.628+0000 7f324ffff640 1 -- 172.21.15.181:0/181797720 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v33) ==== 80+0+124 (secure 0 0 0) 0x7f3258058e40 con 0x7f32680b22c0 2024-09-12T02:29:30.629 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6835/2347584783 2024-09-13T02:29:21.976381+0000 2024-09-12T02:29:30.629 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6833/2347584783 2024-09-13T02:29:21.976381+0000 2024-09-12T02:29:30.629 INFO:teuthology.orchestra.run.smithi181.stderr:listed 2 entries 2024-09-12T02:29:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f325406be30 msgr2=0x7f325406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f325406be30 0x7f325406e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f325c009e50 tx=0x7f325c009000 comp rx=0 tx=0).stop 2024-09-12T02:29:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32680b22c0 msgr2=0x7f32681526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32680b22c0 0x7f32681526f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f325800c3c0 tx=0x7f325800c7c0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 shutdown_connections 2024-09-12T02:29:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f325406be30 0x7f325406e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f32680cdfc0 0x7f32681f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f326815b2e0 0x7f3268153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 --2- 172.21.15.181:0/181797720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32680b22c0 0x7f32681526f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 >> 172.21.15.181:0/181797720 conn(0x7f326806bc10 msgr2=0x7f32680b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 shutdown_connections 2024-09-12T02:29:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:30.630+0000 7f326e253640 1 -- 172.21.15.181:0/181797720 wait complete. 2024-09-12T02:29:30.642 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:29:30.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:30.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:30.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[49827]: fuse finished with error 0 and tester_r 0 2024-09-12T02:29:30.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:29:31.565 INFO:tasks.ceph.mds.a.smithi181.stderr:2024-09-12T02:29:31.564+0000 7fe9546ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:29:34.014 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:29:34.013+0000 7f727d3e1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T02:29:36.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:29:36.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:36.770 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:29:36.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:29:36.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.939+0000 7fa96f60a640 1 Processor -- start 2024-09-12T02:29:36.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.940+0000 7fa96f60a640 1 -- start start 2024-09-12T02:29:36.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.940+0000 7fa96f60a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa96815b1e0 0x7fa9680b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.940+0000 7fa96f60a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b2490 0x7fa9680716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.940+0000 7fa96f60a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9680ce480 con 0x7fa9680b41d0 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96f60a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa9680ce760 con 0x7fa96815b1e0 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96f60a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa9680cea40 con 0x7fa9680b2490 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96d3a6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa96815b1e0 0x7fa9680b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96d3a6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa96815b1e0 0x7fa9680b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39766/0 (socket says 172.21.15.181:39766) 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96d3a6640 1 -- 172.21.15.181:0/3204266836 learned_addr learned my addr 172.21.15.181:0/3204266836 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96dba7640 1 --2- 172.21.15.181:0/3204266836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b2490 0x7fa9680716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96d3a6640 1 -- 172.21.15.181:0/3204266836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b2490 msgr2=0x7fa9680716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96d3a6640 1 --2- 172.21.15.181:0/3204266836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b2490 0x7fa9680716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96d3a6640 1 -- 172.21.15.181:0/3204266836 >> v1:172.21.15.204:6789/0 conn(0x7fa9680b41d0 legacy=0x7fa9680b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.941+0000 7fa96d3a6640 1 -- 172.21.15.181:0/3204266836 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9680ced20 con 0x7fa96815b1e0 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa96d3a6640 1 --2- 172.21.15.181:0/3204266836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680b3c90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa960009870 tx=0x7fa96002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4877892a1dea8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa967fff640 1 -- 172.21.15.181:0/3204266836 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960037070 con 0x7fa96815b1e0 2024-09-12T02:29:36.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa967fff640 1 -- 172.21.15.181:0/3204266836 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa960032440 con 0x7fa96815b1e0 2024-09-12T02:29:36.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa967fff640 1 -- 172.21.15.181:0/3204266836 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960032810 con 0x7fa96815b1e0 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa96f60a640 1 -- 172.21.15.181:0/3204266836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 msgr2=0x7fa9680b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa96f60a640 1 --2- 172.21.15.181:0/3204266836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680b3c90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa960009870 tx=0x7fa96002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa96f60a640 1 -- 172.21.15.181:0/3204266836 shutdown_connections 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa96f60a640 1 --2- 172.21.15.181:0/3204266836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b2490 0x7fa9680716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa96f60a640 1 --2- 172.21.15.181:0/3204266836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680b3c90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.942+0000 7fa96f60a640 1 -- 172.21.15.181:0/3204266836 >> 172.21.15.181:0/3204266836 conn(0x7fa96806bc10 msgr2=0x7fa96806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.943+0000 7fa96f60a640 1 -- 172.21.15.181:0/3204266836 shutdown_connections 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.943+0000 7fa96f60a640 1 -- 172.21.15.181:0/3204266836 wait complete. 2024-09-12T02:29:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.944+0000 7fa96f60a640 1 Processor -- start 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.944+0000 7fa96f60a640 1 -- start start 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.944+0000 7fa96f60a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680b2490 0x7fa96815dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.944+0000 7fa96f60a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b41d0 0x7fa9680ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96f60a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96f60a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa9680cdfc0 con 0x7fa96815b1e0 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96f60a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa968071130 con 0x7fa9680b2490 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96f60a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa9680ce140 con 0x7fa9680b41d0 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96d3a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680b2490 0x7fa96815dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39776/0 (socket says 172.21.15.181:39776) 2024-09-12T02:29:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 -- 172.21.15.181:0/1509640529 learned_addr learned my addr 172.21.15.181:0/1509640529 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96d3a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680b2490 0x7fa96815dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:55376/0 (socket says 172.21.15.181:55376) 2024-09-12T02:29:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96cba5640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b41d0 0x7fa9680ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 -- 172.21.15.181:0/1509640529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b41d0 msgr2=0x7fa9680ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b41d0 0x7fa9680ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 -- 172.21.15.181:0/1509640529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680b2490 msgr2=0x7fa96815dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680b2490 0x7fa96815dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 -- 172.21.15.181:0/1509640529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9681489f0 con 0x7fa96815b1e0 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96dba7640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680aede0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa958007e10 tx=0x7fa95800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa965ffb640 1 -- 172.21.15.181:0/1509640529 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958014620 con 0x7fa96815b1e0 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa965ffb640 1 -- 172.21.15.181:0/1509640529 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958019070 con 0x7fa96815b1e0 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa968148cd0 con 0x7fa96815b1e0 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.945+0000 7fa965ffb640 1 -- 172.21.15.181:0/1509640529 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958014a20 con 0x7fa96815b1e0 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.946+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96815bba0 con 0x7fa96815b1e0 2024-09-12T02:29:36.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.947+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96814f8a0 con 0x7fa96815b1e0 2024-09-12T02:29:36.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.947+0000 7fa965ffb640 1 -- 172.21.15.181:0/1509640529 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa958014bc0 con 0x7fa96815b1e0 2024-09-12T02:29:36.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.947+0000 7fa965ffb640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa95406be30 0x7fa95406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.947+0000 7fa965ffb640 1 -- 172.21.15.181:0/1509640529 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fa95808b5e0 con 0x7fa96815b1e0 2024-09-12T02:29:36.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.948+0000 7fa96d3a6640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa95406be30 0x7fa95406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.948+0000 7fa96d3a6640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa95406be30 0x7fa95406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa960034000 tx=0x7fa96002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:36.952+0000 7fa965ffb640 1 -- 172.21.15.181:0/1509640529 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9580598e0 con 0x7fa96815b1e0 2024-09-12T02:29:37.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.152+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa96814f2e0 con 0x7fa96815b1e0 2024-09-12T02:29:37.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.152+0000 7fa965ffb640 1 -- 172.21.15.181:0/1509640529 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7fa95805dbe0 con 0x7fa96815b1e0 2024-09-12T02:29:37.153 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:29:37.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa95406be30 msgr2=0x7fa95406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa95406be30 0x7fa95406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa960034000 tx=0x7fa96002e000 comp rx=0 tx=0).stop 2024-09-12T02:29:37.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 msgr2=0x7fa9680aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680aede0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa958007e10 tx=0x7fa95800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 shutdown_connections 2024-09-12T02:29:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa95406be30 0x7fa95406e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa96815b1e0 0x7fa9680aede0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680b41d0 0x7fa9680ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 --2- 172.21.15.181:0/1509640529 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680b2490 0x7fa96815dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 >> 172.21.15.181:0/1509640529 conn(0x7fa96806bc10 msgr2=0x7fa9680b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 shutdown_connections 2024-09-12T02:29:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37.154+0000 7fa96f60a640 1 -- 172.21.15.181:0/1509640529 wait complete. 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:29:37.166 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:37.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:37.167 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:29:37.182 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:29:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42666sec preferred_lft 42666sec 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:29:37.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:37.185 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:29:37.246 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:29:37.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:37.248 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:29:37.305 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:29:37.305 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:29:37.305 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:29:37.305 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:29:37.306 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:29:37.306 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:29:37.306 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:29:37.306 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:29:37.306 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:29:37.306 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:29:37.306 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:29:37.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:29:37.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:37.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:37.432 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:29:37.447 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:29:37.447 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:29:37.448 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:37.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:37.448 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:29:37.513 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:29:37.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:29:37.514 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:37.569 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:29:37.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:29:37.570 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:37.625 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:29:37.694 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:29:37.749 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:29:37.750 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:29:37.751 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:37.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:37.752 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:29:37.805 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:29:37.805 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:29:37.847 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:29:37.872 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:29:37.929 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:29:37.929 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:29:37.929 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:29:37.930 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:29:37.931 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:29:37.932 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:37.932 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:29:37.932 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:37.932 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:29:37.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:37.932 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:29:37.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:29:37.929+0000 7f015f00a480 -1 init, newargv = 0x563c098c1050 newargc=15 2024-09-12T02:29:37.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[50413]: starting ceph client 2024-09-12T02:29:37.934 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[50413]: starting fuse 2024-09-12T02:29:37.948 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:29:37.949 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:29:37.949 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:29:37.950 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:29:37.951 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:37.951 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:29:37.951 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:38.066 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.50413.asok 2024-09-12T02:29:38.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:38.076 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50413.asok 2024-09-12T02:29:38.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:38.076 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50413.asok status 2024-09-12T02:29:38.209 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:29:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:29:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "50413", 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:29:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 5232, 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 5232 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:29:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 1145850118 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 1145850118 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.5232 192.168.0.1:0/1145850118", 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/1145850118", 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 21, 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 33, 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:29:38.213 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:29:38.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:38.217 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:29:38.218 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:38.233 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:29:38.234 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:38.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:38.234 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:38.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:38.304 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-12T02:29:38.380 INFO:teuthology.orchestra.run.smithi181.stdout:.: 2024-09-12T02:29:38.380 INFO:teuthology.orchestra.run.smithi181.stdout:linkdir 2024-09-12T02:29:38.380 INFO:teuthology.orchestra.run.smithi181.stdout:rootfile 2024-09-12T02:29:38.380 INFO:teuthology.orchestra.run.smithi181.stdout:subdir 2024-09-12T02:29:38.380 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:./linkdir: 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:link0 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:link1 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:link2 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:link3 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:./subdir: 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:subdirfile 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:subsubdir 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:38.381 INFO:teuthology.orchestra.run.smithi181.stdout:./subdir/subsubdir: 2024-09-12T02:29:38.382 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:38.382 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:38.382 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:38.382 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:38.382 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2024-09-12T02:29:38.382 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:38.489 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627776 2024-09-12T02:29:38.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:38.497 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:38.497 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:38.497 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:38.497 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:38.497 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-09-12T02:29:38.498 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:38.602 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627777 2024-09-12T02:29:38.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:38.611 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:38.611 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:38.611 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:38.611 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:38.611 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2024-09-12T02:29:38.611 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:38.718 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627778 2024-09-12T02:29:38.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:38.727 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:38.727 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:38.727 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:38.727 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:38.727 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2024-09-12T02:29:38.728 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:38.832 INFO:teuthology.orchestra.run.smithi181.stdout:1099511628282 2024-09-12T02:29:38.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:38.841 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:38.841 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:38.841 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:38.841 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:38.842 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link0").st_ino) 2024-09-12T02:29:38.842 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:38.946 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627778 2024-09-12T02:29:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:38.955 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:38.955 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:38.955 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:38.955 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:38.955 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link1").st_ino) 2024-09-12T02:29:38.955 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:39.061 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627778 2024-09-12T02:29:39.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:39.070 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:39.070 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:39.070 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:39.070 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:39.070 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link2").st_ino) 2024-09-12T02:29:39.070 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:39.173 INFO:teuthology.orchestra.run.smithi181.stdout:1099511628281 2024-09-12T02:29:39.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:39.182 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:39.182 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:39.182 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:39.182 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:39.182 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link3").st_ino) 2024-09-12T02:29:39.182 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:39.287 INFO:teuthology.orchestra.run.smithi181.stdout:1099511627776 2024-09-12T02:29:39.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:39.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:39.296 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch afterwards) 2024-09-12T02:29:39.356 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:29:39.357 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:29:39.357 DEBUG:teuthology.orchestra.run.smithi181:> import stat 2024-09-12T02:29:39.357 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:29:39.357 DEBUG:teuthology.orchestra.run.smithi181:> print(os.stat("/home/ubuntu/cephtest/mnt.0/afterwards").st_ino) 2024-09-12T02:29:39.357 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:29:39.461 INFO:teuthology.orchestra.run.smithi181.stdout:1099521627779 2024-09-12T02:29:39.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:29:39.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:39.470 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subsubdir/subsubdirfile) 2024-09-12T02:29:39.528 INFO:tasks.ceph.mds.a.smithi181.stderr:2024-09-12T02:29:39.528+0000 7fe9506a3640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2024-09-12T02:29:39.531 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:29:39.532 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:29:39.611 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:29:39.654 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:29:39.654 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:29:39.654 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:39.655 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:39.671 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:29:39.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.809+0000 7f05e440e640 1 Processor -- start 2024-09-12T02:29:39.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.809+0000 7f05e440e640 1 -- start start 2024-09-12T02:29:39.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e440e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f05dc15b2e0 0x7f05dc0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e440e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e440e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05dc0ce4f0 con 0x7f05dc0b22c0 2024-09-12T02:29:39.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e440e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc15b6c0 con 0x7f05dc15b2e0 2024-09-12T02:29:39.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e440e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc0ce7d0 con 0x7f05dc0cdfc0 2024-09-12T02:29:39.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e21aa640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f05dc15b2e0 0x7f05dc0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e21aa640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f05dc15b2e0 0x7f05dc0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58578/0 (socket says 172.21.15.181:58578) 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e29ab640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f05dc0b22c0 0x7f05dc0ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36184/0 (socket says 172.21.15.181:36184) 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e21aa640 1 -- 172.21.15.181:0/2775768104 learned_addr learned my addr 172.21.15.181:0/2775768104 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e19a9640 1 --2- 172.21.15.181:0/2775768104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e21aa640 1 -- 172.21.15.181:0/2775768104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 msgr2=0x7f05dc0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e21aa640 1 --2- 172.21.15.181:0/2775768104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e21aa640 1 -- 172.21.15.181:0/2775768104 >> v1:172.21.15.181:6789/0 conn(0x7f05dc0b22c0 legacy=0x7f05dc0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e21aa640 1 -- 172.21.15.181:0/2775768104 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc0ceab0 con 0x7f05dc15b2e0 2024-09-12T02:29:39.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.810+0000 7f05e19a9640 1 --2- 172.21.15.181:0/2775768104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:39.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.811+0000 7f05e21aa640 1 --2- 172.21.15.181:0/2775768104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc15b2e0 0x7f05dc0b3d20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f05d800bb10 tx=0x7f05d802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcba41da5dca331 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.811+0000 7f05e11a8640 1 -- 172.21.15.181:0/2775768104 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8036020 con 0x7f05dc15b2e0 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.811+0000 7f05e11a8640 1 -- 172.21.15.181:0/2775768104 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8032820 con 0x7f05dc15b2e0 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.811+0000 7f05e11a8640 1 -- 172.21.15.181:0/2775768104 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8032bf0 con 0x7f05dc15b2e0 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.811+0000 7f05e440e640 1 -- 172.21.15.181:0/2775768104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc15b2e0 msgr2=0x7f05dc0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.811+0000 7f05e440e640 1 --2- 172.21.15.181:0/2775768104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc15b2e0 0x7f05dc0b3d20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f05d800bb10 tx=0x7f05d802c920 comp rx=0 tx=0).stop 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.812+0000 7f05e440e640 1 -- 172.21.15.181:0/2775768104 shutdown_connections 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.812+0000 7f05e440e640 1 --2- 172.21.15.181:0/2775768104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.812+0000 7f05e440e640 1 --2- 172.21.15.181:0/2775768104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc15b2e0 0x7f05dc0b3d20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.812+0000 7f05e440e640 1 -- 172.21.15.181:0/2775768104 >> 172.21.15.181:0/2775768104 conn(0x7f05dc06bc10 msgr2=0x7f05dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.812+0000 7f05e440e640 1 -- 172.21.15.181:0/2775768104 shutdown_connections 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.812+0000 7f05e440e640 1 -- 172.21.15.181:0/2775768104 wait complete. 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 Processor -- start 2024-09-12T02:29:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 -- start start 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc0b22c0 0x7f05dc073500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05dc15b2e0 0x7f05dc156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc0712b0 con 0x7f05dc0b22c0 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc071130 con 0x7f05dc15b2e0 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.813+0000 7f05e440e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc0b4260 con 0x7f05dc0cdfc0 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc0b22c0 0x7f05dc073500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc0b22c0 0x7f05dc073500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58590/0 (socket says 172.21.15.181:58590) 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 -- 172.21.15.181:0/633079333 learned_addr learned my addr 172.21.15.181:0/633079333 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e19a9640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e29ab640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05dc15b2e0 0x7f05dc156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 -- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 msgr2=0x7f05dc15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 -- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05dc15b2e0 msgr2=0x7f05dc156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05dc15b2e0 0x7f05dc156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 -- 172.21.15.181:0/633079333 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc14f940 con 0x7f05dc0b22c0 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e21aa640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc0b22c0 0x7f05dc073500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f05d802c960 tx=0x7f05d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05d2ffd640 1 -- 172.21.15.181:0/633079333 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8036040 con 0x7f05dc0b22c0 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05d2ffd640 1 -- 172.21.15.181:0/633079333 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d803bd60 con 0x7f05dc0b22c0 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc15d1d0 con 0x7f05dc0b22c0 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05d2ffd640 1 -- 172.21.15.181:0/633079333 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8045610 con 0x7f05dc0b22c0 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.814+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc15d790 con 0x7f05dc0b22c0 2024-09-12T02:29:39.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.815+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc0b1d80 con 0x7f05dc0b22c0 2024-09-12T02:29:39.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.816+0000 7f05d2ffd640 1 -- 172.21.15.181:0/633079333 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05d804c060 con 0x7f05dc0b22c0 2024-09-12T02:29:39.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.816+0000 7f05d2ffd640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.816+0000 7f05d2ffd640 1 -- 172.21.15.181:0/633079333 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f05d80ae100 con 0x7f05dc0b22c0 2024-09-12T02:29:39.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.816+0000 7f05e19a9640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.816+0000 7f05e19a9640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05dc153080 tx=0x7f05cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.820+0000 7f05d2ffd640 1 -- 172.21.15.181:0/633079333 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05d8040070 con 0x7f05dc0b22c0 2024-09-12T02:29:39.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.997+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05dc15db20 con 0x7f05dc0b22c0 2024-09-12T02:29:39.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:39.998+0000 7f05d2ffd640 1 -- 172.21.15.181:0/633079333 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v33) ==== 80+0+124 (secure 0 0 0) 0x7f05d802f070 con 0x7f05dc0b22c0 2024-09-12T02:29:39.999 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6835/2347584783 2024-09-13T02:29:21.976381+0000 2024-09-12T02:29:39.999 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6833/2347584783 2024-09-13T02:29:21.976381+0000 2024-09-12T02:29:40.000 INFO:teuthology.orchestra.run.smithi181.stderr:listed 2 entries 2024-09-12T02:29:40.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05c006be30 msgr2=0x7f05c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05dc153080 tx=0x7f05cc008040 comp rx=0 tx=0).stop 2024-09-12T02:29:40.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc0b22c0 msgr2=0x7f05dc073500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc0b22c0 0x7f05dc073500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f05d802c960 tx=0x7f05d80046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 shutdown_connections 2024-09-12T02:29:40.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05dc15b2e0 0x7f05dc156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f05dc0cdfc0 0x7f05dc15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 --2- 172.21.15.181:0/633079333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05dc0b22c0 0x7f05dc073500 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 >> 172.21.15.181:0/633079333 conn(0x7f05dc06bc10 msgr2=0x7f05dc158890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:40.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 shutdown_connections 2024-09-12T02:29:40.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.000+0000 7f05e440e640 1 -- 172.21.15.181:0/633079333 wait complete. 2024-09-12T02:29:40.011 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:29:40.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:40.011 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:29:40.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[50413]: fuse finished with error 0 and tester_r 0 2024-09-12T02:29:40.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:29:40.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:40.036 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:29:40.118 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:29:40.118 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:29:40.118 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:40.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:29:40.136 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:29:40.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:40.136 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:29:40.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:40.193 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-12T02:29:40.193 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:29:40.193 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:40.193 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:40.210 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:29:40.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:29:40.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:40.210 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:29:40.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:40.267 INFO:teuthology.orchestra.run.smithi181.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T02:29:40.267 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:29:40.267 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:29:40.267 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:40.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:29:40.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:29:40.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:29:40.285 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:29:40.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:40.341 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T02:29:40.342 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.440+0000 7fe18c9fd640 1 Processor -- start 2024-09-12T02:29:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.440+0000 7fe18c9fd640 1 -- start start 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.441+0000 7fe18c9fd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe18815e640 0x7fe1880ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.441+0000 7fe18c9fd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880cf0e0 0x7fe1880cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.441+0000 7fe18c9fd640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18815ea20 con 0x7fe1880b2cf0 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.441+0000 7fe18c9fd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe1880b2860 con 0x7fe18815e640 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.441+0000 7fe18c9fd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe1880b1c50 con 0x7fe1880cf0e0 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe18659c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe18815e640 0x7fe1880ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe185d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880cf0e0 0x7fe1880cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe18659c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe18815e640 0x7fe1880ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:44462/0 (socket says 172.21.15.181:44462) 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe18659c640 1 -- 172.21.15.181:0/3577871221 learned_addr learned my addr 172.21.15.181:0/3577871221 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe186d9d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fe1880b2cf0 0x7fe1880b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:50918/0 (socket says 172.21.15.181:50918) 2024-09-12T02:29:40.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe185d9b640 1 -- 172.21.15.181:0/3577871221 >> v2:172.21.15.204:3300/0 conn(0x7fe18815e640 msgr2=0x7fe1880ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe185d9b640 1 --2- 172.21.15.181:0/3577871221 >> v2:172.21.15.204:3300/0 conn(0x7fe18815e640 0x7fe1880ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe185d9b640 1 -- 172.21.15.181:0/3577871221 >> v1:172.21.15.204:6789/0 conn(0x7fe1880b2cf0 legacy=0x7fe1880b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe185d9b640 1 -- 172.21.15.181:0/3577871221 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1880b1f30 con 0x7fe1880cf0e0 2024-09-12T02:29:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.442+0000 7fe18659c640 1 --2- 172.21.15.181:0/3577871221 >> v2:172.21.15.204:3300/0 conn(0x7fe18815e640 0x7fe1880ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:40.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.443+0000 7fe185d9b640 1 --2- 172.21.15.181:0/3577871221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880cf0e0 0x7fe1880cf520 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe18815ebf0 tx=0x7fe17002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28da24e6eff18cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.443+0000 7fe18559a640 1 -- 172.21.15.181:0/3577871221 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170037070 con 0x7fe1880cf0e0 2024-09-12T02:29:40.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.443+0000 7fe18559a640 1 -- 172.21.15.181:0/3577871221 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17002ae50 con 0x7fe1880cf0e0 2024-09-12T02:29:40.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.443+0000 7fe18559a640 1 -- 172.21.15.181:0/3577871221 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170032660 con 0x7fe1880cf0e0 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.443+0000 7fe18c9fd640 1 -- 172.21.15.181:0/3577871221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880cf0e0 msgr2=0x7fe1880cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.443+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/3577871221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880cf0e0 0x7fe1880cf520 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe18815ebf0 tx=0x7fe17002a100 comp rx=0 tx=0).stop 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.444+0000 7fe18c9fd640 1 -- 172.21.15.181:0/3577871221 shutdown_connections 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.444+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/3577871221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880cf0e0 0x7fe1880cf520 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.444+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/3577871221 >> v2:172.21.15.204:3300/0 conn(0x7fe18815e640 0x7fe1880ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.444+0000 7fe18c9fd640 1 -- 172.21.15.181:0/3577871221 >> 172.21.15.181:0/3577871221 conn(0x7fe18809d820 msgr2=0x7fe1880d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.444+0000 7fe18c9fd640 1 -- 172.21.15.181:0/3577871221 shutdown_connections 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.444+0000 7fe18c9fd640 1 -- 172.21.15.181:0/3577871221 wait complete. 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.445+0000 7fe18c9fd640 1 Processor -- start 2024-09-12T02:29:40.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.445+0000 7fe18c9fd640 1 -- start start 2024-09-12T02:29:40.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18c9fd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880b2cf0 0x7fe1880ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18c9fd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1880cf0e0 0x7fe1881599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18c9fd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe18815e640 0x7fe188159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18c9fd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880cfe40 con 0x7fe1880cf0e0 2024-09-12T02:29:40.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18c9fd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880b24f0 con 0x7fe18815e640 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18c9fd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe1880b73a0 con 0x7fe1880b2cf0 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe185d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1880cf0e0 0x7fe1881599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe185d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1880cf0e0 0x7fe1881599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58600/0 (socket says 172.21.15.181:58600) 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe185d9b640 1 -- 172.21.15.181:0/1072247408 learned_addr learned my addr 172.21.15.181:0/1072247408 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18659c640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880b2cf0 0x7fe1880ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe186d9d640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe18815e640 0x7fe188159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18659c640 1 -- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe18815e640 msgr2=0x7fe188159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18659c640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe18815e640 0x7fe188159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18659c640 1 -- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1880cf0e0 msgr2=0x7fe1881599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18659c640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1880cf0e0 0x7fe1881599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18659c640 1 -- 172.21.15.181:0/1072247408 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18815b820 con 0x7fe1880b2cf0 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe186d9d640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe18815e640 0x7fe188159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe185d9b640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1880cf0e0 0x7fe1881599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18659c640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880b2cf0 0x7fe1880ce190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe18000efb0 tx=0x7fe18000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe17effd640 1 -- 172.21.15.181:0/1072247408 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18000ce60 con 0x7fe1880b2cf0 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe17effd640 1 -- 172.21.15.181:0/1072247408 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe180003990 con 0x7fe1880b2cf0 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe17effd640 1 -- 172.21.15.181:0/1072247408 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180003d60 con 0x7fe1880b2cf0 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.446+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18815a510 con 0x7fe1880b2cf0 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.447+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18815aad0 con 0x7fe1880b2cf0 2024-09-12T02:29:40.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.447+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe188068eb0 con 0x7fe1880b2cf0 2024-09-12T02:29:40.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.448+0000 7fe17effd640 1 -- 172.21.15.181:0/1072247408 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe180005d10 con 0x7fe1880b2cf0 2024-09-12T02:29:40.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.448+0000 7fe17effd640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe16806be30 0x7fe16806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.448+0000 7fe17effd640 1 -- 172.21.15.181:0/1072247408 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fe18008b280 con 0x7fe1880b2cf0 2024-09-12T02:29:40.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.448+0000 7fe185d9b640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe16806be30 0x7fe16806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.449+0000 7fe185d9b640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe16806be30 0x7fe16806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1880b6560 tx=0x7fe17002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.454+0000 7fe17effd640 1 -- 172.21.15.181:0/1072247408 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe180022020 con 0x7fe1880b2cf0 2024-09-12T02:29:40.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.651+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1880ceba0 con 0x7fe1880b2cf0 2024-09-12T02:29:40.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.652+0000 7fe17effd640 1 -- 172.21.15.181:0/1072247408 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5237 (secure 0 0 0) 0x7fe180010040 con 0x7fe1880b2cf0 2024-09-12T02:29:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:40.653 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"btime":"2024-09-12T02:29:34:014610+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:34.001098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4750":{"gid":4750,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4750,"qdb_cluster":[4750]},"id":2}]} 2024-09-12T02:29:40.653 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 21 2024-09-12T02:29:40.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe16806be30 msgr2=0x7fe16806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe16806be30 0x7fe16806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1880b6560 tx=0x7fe17002e000 comp rx=0 tx=0).stop 2024-09-12T02:29:40.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880b2cf0 msgr2=0x7fe1880ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880b2cf0 0x7fe1880ce190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe18000efb0 tx=0x7fe18000c490 comp rx=0 tx=0).stop 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 shutdown_connections 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe16806be30 0x7fe16806e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe18815e640 0x7fe188159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1880cf0e0 0x7fe1881599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 --2- 172.21.15.181:0/1072247408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1880b2cf0 0x7fe1880ce190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 >> 172.21.15.181:0/1072247408 conn(0x7fe18809d820 msgr2=0x7fe1880b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 shutdown_connections 2024-09-12T02:29:40.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.654+0000 7fe18c9fd640 1 -- 172.21.15.181:0/1072247408 wait complete. 2024-09-12T02:29:40.666 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:40.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.763+0000 7f278e32a640 1 Processor -- start 2024-09-12T02:29:40.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.763+0000 7f278e32a640 1 -- start start 2024-09-12T02:29:40.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f278e32a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f27880d0510 0x7f278815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f278e32a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f27880d08f0 0x7f27880b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f278e32a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2788143bb0 0x7f27880b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f278e32a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f27880b2820 con 0x7f27880d08f0 2024-09-12T02:29:40.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f278e32a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f27880b2b00 con 0x7f27880d0510 2024-09-12T02:29:40.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f278e32a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2788141730 con 0x7f2788143bb0 2024-09-12T02:29:40.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f27880d08f0 0x7f27880b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f27880d08f0 0x7f27880b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58606/0 (socket says 172.21.15.181:58606) 2024-09-12T02:29:40.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 -- 172.21.15.181:0/756506237 learned_addr learned my addr 172.21.15.181:0/756506237 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:40.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f278c8c7640 1 --2- 172.21.15.181:0/756506237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2788143bb0 0x7f27880b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 -- 172.21.15.181:0/756506237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2788143bb0 msgr2=0x7f27880b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:40.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f2787fff640 1 --2- 172.21.15.181:0/756506237 >> v2:172.21.15.204:3300/0 conn(0x7f27880d0510 0x7f278815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 --2- 172.21.15.181:0/756506237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2788143bb0 0x7f27880b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 -- 172.21.15.181:0/756506237 >> v2:172.21.15.204:3300/0 conn(0x7f27880d0510 msgr2=0x7f278815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:40.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 --2- 172.21.15.181:0/756506237 >> v2:172.21.15.204:3300/0 conn(0x7f27880d0510 0x7f278815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.764+0000 7f27877fe640 1 -- 172.21.15.181:0/756506237 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2788144320 con 0x7f27880d08f0 2024-09-12T02:29:40.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.765+0000 7f27877fe640 1 --2- 172.21.15.181:0/756506237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d08f0 0x7f27880b30f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f27881445b0 tx=0x7f277c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a7c68dbd1a7753 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.765+0000 7f2786ffd640 1 -- 172.21.15.181:0/756506237 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c03a070 con 0x7f27880d08f0 2024-09-12T02:29:40.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.765+0000 7f2786ffd640 1 -- 172.21.15.181:0/756506237 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c032480 con 0x7f27880d08f0 2024-09-12T02:29:40.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.765+0000 7f2786ffd640 1 -- 172.21.15.181:0/756506237 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c032850 con 0x7f27880d08f0 2024-09-12T02:29:40.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 -- 172.21.15.181:0/756506237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d08f0 msgr2=0x7f27880b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 --2- 172.21.15.181:0/756506237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d08f0 0x7f27880b30f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f27881445b0 tx=0x7f277c02c650 comp rx=0 tx=0).stop 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 -- 172.21.15.181:0/756506237 shutdown_connections 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 --2- 172.21.15.181:0/756506237 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2788143bb0 0x7f27880b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 --2- 172.21.15.181:0/756506237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d08f0 0x7f27880b30f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 --2- 172.21.15.181:0/756506237 >> v2:172.21.15.204:3300/0 conn(0x7f27880d0510 0x7f278815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 -- 172.21.15.181:0/756506237 >> 172.21.15.181:0/756506237 conn(0x7f278806bc10 msgr2=0x7f278806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 -- 172.21.15.181:0/756506237 shutdown_connections 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.766+0000 7f278e32a640 1 -- 172.21.15.181:0/756506237 wait complete. 2024-09-12T02:29:40.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.767+0000 7f278e32a640 1 Processor -- start 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.767+0000 7f278e32a640 1 -- start start 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f278e32a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d0510 0x7f27880ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f278e32a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27880d08f0 0x7f27880aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f278e32a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2788143bb0 0x7f278813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f278e32a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f27880b2180 con 0x7f27880d0510 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f278e32a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f27880b2000 con 0x7f2788143bb0 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f278e32a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f27880b2300 con 0x7f27880d08f0 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d0510 0x7f27880ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d0510 0x7f27880ab610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58618/0 (socket says 172.21.15.181:58618) 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 -- 172.21.15.181:0/944305522 learned_addr learned my addr 172.21.15.181:0/944305522 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 -- 172.21.15.181:0/944305522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27880d08f0 msgr2=0x7f27880aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27880d08f0 0x7f27880aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 -- 172.21.15.181:0/944305522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2788143bb0 msgr2=0x7f278813ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f278c8c7640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2788143bb0 0x7f278813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2788143bb0 0x7f278813ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.768+0000 7f2787fff640 1 -- 172.21.15.181:0/944305522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27880aa920 con 0x7f27880d0510 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.769+0000 7f2787fff640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d0510 0x7f27880ab610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f277800c820 tx=0x7f277800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.769+0000 7f2784ff9640 1 -- 172.21.15.181:0/944305522 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778015070 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.769+0000 7f2784ff9640 1 -- 172.21.15.181:0/944305522 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778004020 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.769+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27881f34e0 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.769+0000 7f2784ff9640 1 -- 172.21.15.181:0/944305522 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27780043f0 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.769+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27880abb50 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.770+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278815ef90 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.770+0000 7f2784ff9640 1 -- 172.21.15.181:0/944305522 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2778007830 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.771+0000 7f2784ff9640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f277406be30 0x7f277406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.771+0000 7f2784ff9640 1 -- 172.21.15.181:0/944305522 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f277808acf0 con 0x7f27880d0510 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.771+0000 7f27877fe640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f277406be30 0x7f277406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.771+0000 7f27877fe640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f277406be30 0x7f277406e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f277c037000 tx=0x7f277c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.775+0000 7f2784ff9640 1 -- 172.21.15.181:0/944305522 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f277808f070 con 0x7f27880d0510 2024-09-12T02:29:40.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.974+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2788142f70 con 0x7f27880d0510 2024-09-12T02:29:40.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.974+0000 7f2784ff9640 1 -- 172.21.15.181:0/944305522 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5237 (secure 0 0 0) 0x7f2778059640 con 0x7f27880d0510 2024-09-12T02:29:40.977 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:40.977 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"btime":"2024-09-12T02:29:34:014610+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:34.001098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4750":{"gid":4750,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4750,"qdb_cluster":[4750]},"id":2}]} 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 21 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f277406be30 msgr2=0x7f277406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f277406be30 0x7f277406e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f277c037000 tx=0x7f277c032000 comp rx=0 tx=0).stop 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d0510 msgr2=0x7f27880ab610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d0510 0x7f27880ab610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f277800c820 tx=0x7f277800cce0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 shutdown_connections 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f277406be30 0x7f277406e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2788143bb0 0x7f278813ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27880d08f0 0x7f27880aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 --2- 172.21.15.181:0/944305522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27880d0510 0x7f27880ab610 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 >> 172.21.15.181:0/944305522 conn(0x7f278806bc10 msgr2=0x7f27880b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:40.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 shutdown_connections 2024-09-12T02:29:40.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:40.976+0000 7f278e32a640 1 -- 172.21.15.181:0/944305522 wait complete. 2024-09-12T02:29:40.989 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.087+0000 7f95f278d640 1 Processor -- start 2024-09-12T02:29:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.087+0000 7f95f278d640 1 -- start start 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.088+0000 7f95f278d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec06f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.088+0000 7f95f278d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ec15c930 con 0x7f95ec06c620 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.088+0000 7f95f278d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ec15cba0 con 0x7f95ec0cfc10 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.088+0000 7f95f278d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec15d4d0 con 0x7f95ec159e60 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.088+0000 7f95eb7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f95ec06c620 0x7f95ec0cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36192/0 (socket says 172.21.15.181:36192) 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.088+0000 7f95eb7fe640 1 -- 172.21.15.181:0/3839531463 learned_addr learned my addr 172.21.15.181:0/3839531463 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.088+0000 7f95ebfff640 1 --2- 172.21.15.181:0/3839531463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.089+0000 7f95eaffd640 1 -- 172.21.15.181:0/3839531463 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536404850 0 0) 0x7f95ec15c930 con 0x7f95ec06c620 2024-09-12T02:29:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.089+0000 7f95eaffd640 1 -- 172.21.15.181:0/3839531463 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95d4003520 con 0x7f95ec06c620 2024-09-12T02:29:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.089+0000 7f95ebfff640 1 -- 172.21.15.181:0/3839531463 >> v1:172.21.15.204:6789/0 conn(0x7f95ec0cfc10 legacy=0x7f95ec06df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.089+0000 7f95ebfff640 1 -- 172.21.15.181:0/3839531463 >> v1:172.21.15.181:6789/0 conn(0x7f95ec06c620 legacy=0x7f95ec0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.089+0000 7f95ebfff640 1 -- 172.21.15.181:0/3839531463 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec15ce80 con 0x7f95ec159e60 2024-09-12T02:29:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.089+0000 7f95ebfff640 1 --2- 172.21.15.181:0/3839531463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec06f840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0097d0 tx=0x7f95dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab1a9ace1315fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.092+0000 7f95eaffd640 1 -- 172.21.15.181:0/3839531463 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc037070 con 0x7f95ec159e60 2024-09-12T02:29:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.092+0000 7f95eaffd640 1 -- 172.21.15.181:0/3839531463 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc032440 con 0x7f95ec159e60 2024-09-12T02:29:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.092+0000 7f95eaffd640 1 -- 172.21.15.181:0/3839531463 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc032810 con 0x7f95ec159e60 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.093+0000 7f95f278d640 1 -- 172.21.15.181:0/3839531463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 msgr2=0x7f95ec06f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.093+0000 7f95f278d640 1 --2- 172.21.15.181:0/3839531463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec06f840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0097d0 tx=0x7f95dc02a180 comp rx=0 tx=0).stop 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.093+0000 7f95f278d640 1 -- 172.21.15.181:0/3839531463 shutdown_connections 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.093+0000 7f95f278d640 1 --2- 172.21.15.181:0/3839531463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec06f840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.093+0000 7f95f278d640 1 -- 172.21.15.181:0/3839531463 >> 172.21.15.181:0/3839531463 conn(0x7f95ec0d0920 msgr2=0x7f95ec0d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.093+0000 7f95f278d640 1 -- 172.21.15.181:0/3839531463 shutdown_connections 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.093+0000 7f95f278d640 1 -- 172.21.15.181:0/3839531463 wait complete. 2024-09-12T02:29:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.094+0000 7f95f278d640 1 Processor -- start 2024-09-12T02:29:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.094+0000 7f95f278d640 1 -- start start 2024-09-12T02:29:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95f278d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec06c620 0x7f95ec0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95f278d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95ec0cfc10 0x7f95ec1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95f278d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95f278d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec06ff00 con 0x7f95ec06c620 2024-09-12T02:29:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95f278d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec06fd80 con 0x7f95ec0cfc10 2024-09-12T02:29:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95f278d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec06e630 con 0x7f95ec159e60 2024-09-12T02:29:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec06c620 0x7f95ec0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec06c620 0x7f95ec0abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58620/0 (socket says 172.21.15.181:58620) 2024-09-12T02:29:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 -- 172.21.15.181:0/1908780208 learned_addr learned my addr 172.21.15.181:0/1908780208 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 -- 172.21.15.181:0/1908780208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 msgr2=0x7f95ec158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 -- 172.21.15.181:0/1908780208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95ec0cfc10 msgr2=0x7f95ec1f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95ec0cfc10 0x7f95ec1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.095+0000 7f95ebfff640 1 -- 172.21.15.181:0/1908780208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec0aa9e0 con 0x7f95ec06c620 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.096+0000 7f95ebfff640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec06c620 0x7f95ec0abd50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f95dc035040 tx=0x7f95dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.096+0000 7f95e8ff9640 1 -- 172.21.15.181:0/1908780208 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc037050 con 0x7f95ec06c620 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.096+0000 7f95e8ff9640 1 -- 172.21.15.181:0/1908780208 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc038040 con 0x7f95ec06c620 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.096+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec0aacc0 con 0x7f95ec06c620 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.096+0000 7f95e8ff9640 1 -- 172.21.15.181:0/1908780208 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc03cb70 con 0x7f95ec06c620 2024-09-12T02:29:41.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.096+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec0ab280 con 0x7f95ec06c620 2024-09-12T02:29:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.097+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec06f840 con 0x7f95ec06c620 2024-09-12T02:29:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.097+0000 7f95e8ff9640 1 -- 172.21.15.181:0/1908780208 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95dc03cd10 con 0x7f95ec06c620 2024-09-12T02:29:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.098+0000 7f95e8ff9640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f95d806be30 0x7f95d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.098+0000 7f95eb7fe640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f95d806be30 0x7f95d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.098+0000 7f95e8ff9640 1 -- 172.21.15.181:0/1908780208 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f95dc0ab960 con 0x7f95ec06c620 2024-09-12T02:29:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.098+0000 7f95eb7fe640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f95d806be30 0x7f95d806e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95ec06d840 tx=0x7f95e0007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.102+0000 7f95e8ff9640 1 -- 172.21.15.181:0/1908780208 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95dc0313a0 con 0x7f95ec06c620 2024-09-12T02:29:41.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.267+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95ec0d0510 con 0x7f95ec06c620 2024-09-12T02:29:41.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.268+0000 7f95e8ff9640 1 -- 172.21.15.181:0/1908780208 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16932 (secure 0 0 0) 0x7f95dc07a3d0 con 0x7f95ec06c620 2024-09-12T02:29:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:41.270 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":33,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:21.976402+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:59.678168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:00.909444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.204:6835/2347584783":"2024-09-13T02:29:21.976381+0000","172.21.15.204:6833/2347584783":"2024-09-13T02:29:21.976381+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:41.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f95d806be30 msgr2=0x7f95d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f95d806be30 0x7f95d806e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95ec06d840 tx=0x7f95e0007930 comp rx=0 tx=0).stop 2024-09-12T02:29:41.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec06c620 msgr2=0x7f95ec0abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec06c620 0x7f95ec0abd50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f95dc035040 tx=0x7f95dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 shutdown_connections 2024-09-12T02:29:41.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f95d806be30 0x7f95d806e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95ec0cfc10 0x7f95ec1f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95ec159e60 0x7f95ec158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 --2- 172.21.15.181:0/1908780208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec06c620 0x7f95ec0abd50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 >> 172.21.15.181:0/1908780208 conn(0x7f95ec0d0920 msgr2=0x7f95ec15f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:41.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 shutdown_connections 2024-09-12T02:29:41.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.270+0000 7f95f278d640 1 -- 172.21.15.181:0/1908780208 wait complete. 2024-09-12T02:29:41.283 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:29:41.283 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:41.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.381+0000 7f4d98e65640 1 Processor -- start 2024-09-12T02:29:41.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.381+0000 7f4d98e65640 1 -- start start 2024-09-12T02:29:41.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.382+0000 7f4d98e65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9415e640 0x7f4d940ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.382+0000 7f4d98e65640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4d940d3660 0x7f4d940cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.382+0000 7f4d98e65640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9415ea20 con 0x7f4d940cf0e0 2024-09-12T02:29:41.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.382+0000 7f4d98e65640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f4d940b2860 con 0x7f4d940d3660 2024-09-12T02:29:41.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.382+0000 7f4d98e65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d940b1c50 con 0x7f4d9415e640 2024-09-12T02:29:41.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d92d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4d940d3660 0x7f4d940cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d9259c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9415e640 0x7f4d940ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d92d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4d940d3660 0x7f4d940cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:44484/0 (socket says 172.21.15.181:44484) 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d92d9d640 1 -- 172.21.15.181:0/396035062 learned_addr learned my addr 172.21.15.181:0/396035062 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d91d9b640 1 --1- 172.21.15.181:0/396035062 >> v1:172.21.15.204:6789/0 conn(0x7f4d940cf0e0 0x7f4d940b2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:50924/0 (socket says 172.21.15.181:50924) 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d92d9d640 1 -- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9415e640 msgr2=0x7f4d940ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d92d9d640 1 --2- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9415e640 0x7f4d940ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d92d9d640 1 -- 172.21.15.181:0/396035062 >> v1:172.21.15.204:6789/0 conn(0x7f4d940cf0e0 legacy=0x7f4d940b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d92d9d640 1 -- 172.21.15.181:0/396035062 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d940b1f30 con 0x7f4d940d3660 2024-09-12T02:29:41.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.383+0000 7f4d9259c640 1 --2- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9415e640 0x7f4d940ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:41.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.384+0000 7f4d92d9d640 1 --2- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940d3660 0x7f4d940cf520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4d9415ebf0 tx=0x7f4d8402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ad1c31f377bf32e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.384+0000 7f4d9159a640 1 -- 172.21.15.181:0/396035062 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84037070 con 0x7f4d940d3660 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.384+0000 7f4d9159a640 1 -- 172.21.15.181:0/396035062 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84032440 con 0x7f4d940d3660 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.384+0000 7f4d9159a640 1 -- 172.21.15.181:0/396035062 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84032810 con 0x7f4d940d3660 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 -- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940d3660 msgr2=0x7f4d940cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 --2- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940d3660 0x7f4d940cf520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4d9415ebf0 tx=0x7f4d8402a130 comp rx=0 tx=0).stop 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 -- 172.21.15.181:0/396035062 shutdown_connections 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 --2- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d940d3660 0x7f4d940cf520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 --2- 172.21.15.181:0/396035062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9415e640 0x7f4d940ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 -- 172.21.15.181:0/396035062 >> 172.21.15.181:0/396035062 conn(0x7f4d9409d820 msgr2=0x7f4d940d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 -- 172.21.15.181:0/396035062 shutdown_connections 2024-09-12T02:29:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.385+0000 7f4d98e65640 1 -- 172.21.15.181:0/396035062 wait complete. 2024-09-12T02:29:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.386+0000 7f4d98e65640 1 Processor -- start 2024-09-12T02:29:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.386+0000 7f4d98e65640 1 -- start start 2024-09-12T02:29:41.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d98e65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d940cf0e0 0x7f4d94154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d98e65640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d940d3660 0x7f4d940c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d98e65640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9415e640 0x7f4d940cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d98e65640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d940cfe40 con 0x7f4d940d3660 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d98e65640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4d940b24f0 con 0x7f4d9415e640 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d98e65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d940b73a0 con 0x7f4d940cf0e0 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d940d3660 0x7f4d940c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d940d3660 0x7f4d940c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58626/0 (socket says 172.21.15.181:58626) 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 -- 172.21.15.181:0/192002290 learned_addr learned my addr 172.21.15.181:0/192002290 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d92d9d640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9415e640 0x7f4d940cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d9259c640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d940cf0e0 0x7f4d94154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 -- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d940cf0e0 msgr2=0x7f4d94154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d940cf0e0 0x7f4d94154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 -- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9415e640 msgr2=0x7f4d940cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9415e640 0x7f4d940cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.387+0000 7f4d91d9b640 1 -- 172.21.15.181:0/192002290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d940ca1d0 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.388+0000 7f4d91d9b640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d940d3660 0x7f4d940c9980 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c440 tx=0x7f4d7c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.388+0000 7f4d8affd640 1 -- 172.21.15.181:0/192002290 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0074e0 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.388+0000 7f4d8affd640 1 -- 172.21.15.181:0/192002290 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7c007680 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.388+0000 7f4d8affd640 1 -- 172.21.15.181:0/192002290 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c004a20 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.388+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d940ca4b0 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.388+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d940cbaa0 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.389+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d94068eb0 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.389+0000 7f4d8affd640 1 -- 172.21.15.181:0/192002290 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d7c01a020 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.390+0000 7f4d8affd640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d7406be60 0x7f4d7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.390+0000 7f4d8affd640 1 -- 172.21.15.181:0/192002290 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f4d7c08a3d0 con 0x7f4d940d3660 2024-09-12T02:29:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.390+0000 7f4d9259c640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d7406be60 0x7f4d7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.390+0000 7f4d9259c640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d7406be60 0x7f4d7406e320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009bd0 tx=0x7f4d8c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.394+0000 7f4d8affd640 1 -- 172.21.15.181:0/192002290 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d7c058760 con 0x7f4d940d3660 2024-09-12T02:29:41.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.592+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d940b7a50 con 0x7f4d940d3660 2024-09-12T02:29:41.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.593+0000 7f4d8affd640 1 -- 172.21.15.181:0/192002290 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5237 (secure 0 0 0) 0x7f4d940b7a50 con 0x7f4d940d3660 2024-09-12T02:29:41.594 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:41.594 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"btime":"2024-09-12T02:29:34:014610+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:34.001098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4750":{"gid":4750,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4750,"qdb_cluster":[4750]},"id":2}]} 2024-09-12T02:29:41.594 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 21 2024-09-12T02:29:41.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d7406be60 msgr2=0x7f4d7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d7406be60 0x7f4d7406e320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009bd0 tx=0x7f4d8c00b040 comp rx=0 tx=0).stop 2024-09-12T02:29:41.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d940d3660 msgr2=0x7f4d940c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d940d3660 0x7f4d940c9980 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c440 tx=0x7f4d7c00c900 comp rx=0 tx=0).stop 2024-09-12T02:29:41.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 shutdown_connections 2024-09-12T02:29:41.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4d7406be60 0x7f4d7406e320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9415e640 0x7f4d940cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d940d3660 0x7f4d940c9980 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 --2- 172.21.15.181:0/192002290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d940cf0e0 0x7f4d94154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 >> 172.21.15.181:0/192002290 conn(0x7f4d9409d820 msgr2=0x7f4d940d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:41.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 shutdown_connections 2024-09-12T02:29:41.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.595+0000 7f4d98e65640 1 -- 172.21.15.181:0/192002290 wait complete. 2024-09-12T02:29:41.608 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:41.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.705+0000 7f799e12a640 1 Processor -- start 2024-09-12T02:29:41.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.705+0000 7f799e12a640 1 -- start start 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f799e12a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f799806dfa0 0x7f799806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f799e12a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79980d1700 0x7f79980d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f799e12a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799806c580 con 0x7f7998147dc0 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f799e12a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f79980d2070 con 0x7f79980d1700 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f799e12a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f799806c860 con 0x7f799806dfa0 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f79977fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7998147dc0 0x7f79980b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36208/0 (socket says 172.21.15.181:36208) 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f79977fe640 1 -- 172.21.15.181:0/3260260828 learned_addr learned my addr 172.21.15.181:0/3260260828 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:41.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.706+0000 7f7997fff640 1 --2- 172.21.15.181:0/3260260828 >> v2:172.21.15.181:3300/0 conn(0x7f79980d1700 0x7f79980d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f7996ffd640 1 -- 172.21.15.181:0/3260260828 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189104748 0 0) 0x7f799806c580 con 0x7f7998147dc0 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f7996ffd640 1 -- 172.21.15.181:0/3260260828 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7984003520 con 0x7f7998147dc0 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f798ffff640 1 --2- 172.21.15.181:0/3260260828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f799806dfa0 0x7f799806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f7997fff640 1 -- 172.21.15.181:0/3260260828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f799806dfa0 msgr2=0x7f799806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f7997fff640 1 --2- 172.21.15.181:0/3260260828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f799806dfa0 0x7f799806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f7997fff640 1 -- 172.21.15.181:0/3260260828 >> v1:172.21.15.181:6789/0 conn(0x7f7998147dc0 legacy=0x7f79980b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f7997fff640 1 -- 172.21.15.181:0/3260260828 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79980afd70 con 0x7f79980d1700 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f798ffff640 1 --2- 172.21.15.181:0/3260260828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f799806dfa0 0x7f799806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.707+0000 7f7997fff640 1 --2- 172.21.15.181:0/3260260828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79980d1700 0x7f79980d1b30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7990009d90 tx=0x7f799002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb4718c22451dce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f7996ffd640 1 -- 172.21.15.181:0/3260260828 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990031600 con 0x7f79980d1700 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f7996ffd640 1 -- 172.21.15.181:0/3260260828 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79900317a0 con 0x7f79980d1700 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f7996ffd640 1 -- 172.21.15.181:0/3260260828 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990031b70 con 0x7f79980d1700 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 -- 172.21.15.181:0/3260260828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79980d1700 msgr2=0x7f79980d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 --2- 172.21.15.181:0/3260260828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79980d1700 0x7f79980d1b30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7990009d90 tx=0x7f799002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 -- 172.21.15.181:0/3260260828 shutdown_connections 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 --2- 172.21.15.181:0/3260260828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79980d1700 0x7f79980d1b30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 --2- 172.21.15.181:0/3260260828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f799806dfa0 0x7f799806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 -- 172.21.15.181:0/3260260828 >> 172.21.15.181:0/3260260828 conn(0x7f799806d110 msgr2=0x7f799806d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 -- 172.21.15.181:0/3260260828 shutdown_connections 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.708+0000 7f799e12a640 1 -- 172.21.15.181:0/3260260828 wait complete. 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.709+0000 7f799e12a640 1 Processor -- start 2024-09-12T02:29:41.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.709+0000 7f799e12a640 1 -- start start 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f799e12a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f799806dfa0 0x7f7998141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f799e12a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79980d1700 0x7f79980b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f799e12a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7998147dc0 0x7f79980b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f799e12a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f799806c2d0 con 0x7f799806dfa0 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f799e12a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f799806c150 con 0x7f7998147dc0 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f799e12a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7998071d60 con 0x7f79980d1700 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f799806dfa0 0x7f7998141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f799806dfa0 0x7f7998141ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58650/0 (socket says 172.21.15.181:58650) 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 -- 172.21.15.181:0/721432592 learned_addr learned my addr 172.21.15.181:0/721432592 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 -- 172.21.15.181:0/721432592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79980d1700 msgr2=0x7f79980b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79980d1700 0x7f79980b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 -- 172.21.15.181:0/721432592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7998147dc0 msgr2=0x7f79980b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7998147dc0 0x7f79980b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.710+0000 7f79977fe640 1 -- 172.21.15.181:0/721432592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7998142610 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.711+0000 7f79977fe640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f799806dfa0 0x7f7998141ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f798800c390 tx=0x7f798800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.711+0000 7f7994ff9640 1 -- 172.21.15.181:0/721432592 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988017070 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.711+0000 7f7994ff9640 1 -- 172.21.15.181:0/721432592 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7988005ce0 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.711+0000 7f7994ff9640 1 -- 172.21.15.181:0/721432592 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79880072f0 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.711+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79981428b0 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.711+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7998142e70 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.712+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799806bc10 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.712+0000 7f7994ff9640 1 -- 172.21.15.181:0/721432592 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f798801a070 con 0x7f799806dfa0 2024-09-12T02:29:41.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.713+0000 7f7994ff9640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f797806be30 0x7f797806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:41.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.713+0000 7f7994ff9640 1 -- 172.21.15.181:0/721432592 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f798808a2c0 con 0x7f799806dfa0 2024-09-12T02:29:41.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.713+0000 7f798ffff640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f797806be30 0x7f797806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:41.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.713+0000 7f798ffff640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f797806be30 0x7f797806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7980006fd0 tx=0x7f7980008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:41.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.717+0000 7f7994ff9640 1 -- 172.21.15.181:0/721432592 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7988058c10 con 0x7f799806dfa0 2024-09-12T02:29:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.915+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7998073230 con 0x7f799806dfa0 2024-09-12T02:29:41.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.916+0000 7f7994ff9640 1 -- 172.21.15.181:0/721432592 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5237 (secure 0 0 0) 0x7f7988058510 con 0x7f799806dfa0 2024-09-12T02:29:41.917 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:41.917 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":21,"btime":"2024-09-12T02:29:34:014610+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:01.922105+0000","modified":"2024-09-12T02:29:34.001098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4750":{"gid":4750,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.181:6835/1355989745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1355989745},{"type":"v1","addr":"172.21.15.181:6835","nonce":1355989745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4750,"qdb_cluster":[4750]},"id":2}]} 2024-09-12T02:29:41.917 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 21 2024-09-12T02:29:41.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f797806be30 msgr2=0x7f797806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f797806be30 0x7f797806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7980006fd0 tx=0x7f7980008040 comp rx=0 tx=0).stop 2024-09-12T02:29:41.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f799806dfa0 msgr2=0x7f7998141ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:41.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f799806dfa0 0x7f7998141ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f798800c390 tx=0x7f798800c850 comp rx=0 tx=0).stop 2024-09-12T02:29:41.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 shutdown_connections 2024-09-12T02:29:41.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f797806be30 0x7f797806e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7998147dc0 0x7f79980b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79980d1700 0x7f79980b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 --2- 172.21.15.181:0/721432592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f799806dfa0 0x7f7998141ee0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:41.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 >> 172.21.15.181:0/721432592 conn(0x7f799806d110 msgr2=0x7f7998073a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:41.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 shutdown_connections 2024-09-12T02:29:41.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:41.918+0000 7f799e12a640 1 -- 172.21.15.181:0/721432592 wait complete. 2024-09-12T02:29:41.930 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:42.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.029+0000 7f9fdb911640 1 Processor -- start 2024-09-12T02:29:42.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.029+0000 7f9fdb911640 1 -- start start 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fdb911640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9fd415e4e0 0x7f9fd40b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fdb911640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9fd415e8c0 0x7f9fd40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fdb911640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd40d1fc0 0x7f9fd40d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fdb911640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd40d2d40 con 0x7f9fd415e8c0 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fdb911640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd40b7250 con 0x7f9fd415e4e0 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fdb911640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd406cec0 con 0x7f9fd40d1fc0 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9fd415e8c0 0x7f9fd40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9fd415e8c0 0x7f9fd40b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58666/0 (socket says 172.21.15.181:58666) 2024-09-12T02:29:42.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 -- 172.21.15.181:0/2716986774 learned_addr learned my addr 172.21.15.181:0/2716986774 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:42.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 -- 172.21.15.181:0/2716986774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd40d1fc0 msgr2=0x7f9fd40d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:42.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 --2- 172.21.15.181:0/2716986774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd40d1fc0 0x7f9fd40d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 -- 172.21.15.181:0/2716986774 >> v2:172.21.15.204:3300/0 conn(0x7f9fd415e4e0 msgr2=0x7f9fd40b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:42.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 --2- 172.21.15.181:0/2716986774 >> v2:172.21.15.204:3300/0 conn(0x7f9fd415e4e0 0x7f9fd40b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.030+0000 7f9fd8eac640 1 -- 172.21.15.181:0/2716986774 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd406d160 con 0x7f9fd415e8c0 2024-09-12T02:29:42.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fd8eac640 1 --2- 172.21.15.181:0/2716986774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e8c0 0x7f9fd40b6d10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4075a10 tx=0x7f9fc402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba437e7fe140dd40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fcbfff640 1 -- 172.21.15.181:0/2716986774 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4037070 con 0x7f9fd415e8c0 2024-09-12T02:29:42.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fcbfff640 1 -- 172.21.15.181:0/2716986774 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4032440 con 0x7f9fd415e8c0 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fcbfff640 1 -- 172.21.15.181:0/2716986774 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4032810 con 0x7f9fd415e8c0 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 -- 172.21.15.181:0/2716986774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e8c0 msgr2=0x7f9fd40b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 --2- 172.21.15.181:0/2716986774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e8c0 0x7f9fd40b6d10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4075a10 tx=0x7f9fc402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 -- 172.21.15.181:0/2716986774 shutdown_connections 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 --2- 172.21.15.181:0/2716986774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd40d1fc0 0x7f9fd40d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 --2- 172.21.15.181:0/2716986774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e8c0 0x7f9fd40b6d10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 --2- 172.21.15.181:0/2716986774 >> v2:172.21.15.204:3300/0 conn(0x7f9fd415e4e0 0x7f9fd40b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 -- 172.21.15.181:0/2716986774 >> 172.21.15.181:0/2716986774 conn(0x7f9fd406f400 msgr2=0x7f9fd406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.031+0000 7f9fdb911640 1 -- 172.21.15.181:0/2716986774 shutdown_connections 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.032+0000 7f9fdb911640 1 -- 172.21.15.181:0/2716986774 wait complete. 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 Processor -- start 2024-09-12T02:29:42.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 -- start start 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fd40d1fc0 0x7f9fd41f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e4e0 0x7f9fd41ea470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd415e8c0 0x7f9fd4157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd40d2990 con 0x7f9fd415e4e0 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd406d720 con 0x7f9fd40d1fc0 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fdb911640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd41e6cf0 con 0x7f9fd415e8c0 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fd8eac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e4e0 0x7f9fd41ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fd8eac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e4e0 0x7f9fd41ea470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58682/0 (socket says 172.21.15.181:58682) 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.033+0000 7f9fd8eac640 1 -- 172.21.15.181:0/1027950338 learned_addr learned my addr 172.21.15.181:0/1027950338 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:42.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd96ad640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fd40d1fc0 0x7f9fd41f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd9eae640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd415e8c0 0x7f9fd4157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd8eac640 1 -- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd415e8c0 msgr2=0x7f9fd4157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd8eac640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd415e8c0 0x7f9fd4157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd8eac640 1 -- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fd40d1fc0 msgr2=0x7f9fd41f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd8eac640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fd40d1fc0 0x7f9fd41f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd8eac640 1 -- 172.21.15.181:0/1027950338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd41f47f0 con 0x7f9fd415e4e0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fd8eac640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e4e0 0x7f9fd41ea470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9fc402a220 tx=0x7f9fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fc9ffb640 1 -- 172.21.15.181:0/1027950338 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4041070 con 0x7f9fd415e4e0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fc9ffb640 1 -- 172.21.15.181:0/1027950338 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc403c890 con 0x7f9fd415e4e0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd41e6f60 con 0x7f9fd415e4e0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fc9ffb640 1 -- 172.21.15.181:0/1027950338 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4037040 con 0x7f9fd415e4e0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.034+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd41e7520 con 0x7f9fd415e4e0 2024-09-12T02:29:42.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.035+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd406dce0 con 0x7f9fd415e4e0 2024-09-12T02:29:42.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.036+0000 7f9fc9ffb640 1 -- 172.21.15.181:0/1027950338 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fc4044070 con 0x7f9fd415e4e0 2024-09-12T02:29:42.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.036+0000 7f9fc9ffb640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9fb806be30 0x7f9fb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.036+0000 7f9fc9ffb640 1 -- 172.21.15.181:0/1027950338 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f9fc40abcc0 con 0x7f9fd415e4e0 2024-09-12T02:29:42.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.036+0000 7f9fd96ad640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9fb806be30 0x7f9fb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.037+0000 7f9fd96ad640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9fb806be30 0x7f9fb806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9fd406eed0 tx=0x7f9fd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.040+0000 7f9fc9ffb640 1 -- 172.21.15.181:0/1027950338 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fc407a730 con 0x7f9fd415e4e0 2024-09-12T02:29:42.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.209+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fd415da20 con 0x7f9fd415e4e0 2024-09-12T02:29:42.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.211+0000 7f9fc9ffb640 1 -- 172.21.15.181:0/1027950338 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16932 (secure 0 0 0) 0x7f9fc407a030 con 0x7f9fd415e4e0 2024-09-12T02:29:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:42.212 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":33,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:21.976402+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:59.678168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:00.909444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.204:6835/2347584783":"2024-09-13T02:29:21.976381+0000","172.21.15.204:6833/2347584783":"2024-09-13T02:29:21.976381+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9fb806be30 msgr2=0x7f9fb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9fb806be30 0x7f9fb806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9fd406eed0 tx=0x7f9fd0008040 comp rx=0 tx=0).stop 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e4e0 msgr2=0x7f9fd41ea470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e4e0 0x7f9fd41ea470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9fc402a220 tx=0x7f9fc40046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 shutdown_connections 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9fb806be30 0x7f9fb806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fd415e8c0 0x7f9fd4157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fd415e4e0 0x7f9fd41ea470 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 --2- 172.21.15.181:0/1027950338 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fd40d1fc0 0x7f9fd41f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 >> 172.21.15.181:0/1027950338 conn(0x7f9fd406f400 msgr2=0x7f9fd415cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 shutdown_connections 2024-09-12T02:29:42.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.213+0000 7f9fdb911640 1 -- 172.21.15.181:0/1027950338 wait complete. 2024-09-12T02:29:42.224 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:29:42.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.323+0000 7f463ccd2640 1 Processor -- start 2024-09-12T02:29:42.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.323+0000 7f463ccd2640 1 -- start start 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.323+0000 7f463ccd2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f46380b2490 0x7f46380721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f463ccd2640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46380ce160 con 0x7f4638156990 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f463ccd2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46380ce440 con 0x7f46380cd880 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f463ccd2640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4638156d70 con 0x7f46380b2490 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f4636d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f46380b2490 0x7f46380721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f463659c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4638156990 0x7f46380cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36224/0 (socket says 172.21.15.181:36224) 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f463659c640 1 -- 172.21.15.181:0/4154275351 learned_addr learned my addr 172.21.15.181:0/4154275351 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f4636d9d640 1 -- 172.21.15.181:0/4154275351 >> v1:172.21.15.204:6789/0 conn(0x7f46380cd880 legacy=0x7f46380b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f4636d9d640 1 -- 172.21.15.181:0/4154275351 >> v1:172.21.15.181:6789/0 conn(0x7f4638156990 legacy=0x7f46380cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f4635d9b640 1 -- 172.21.15.181:0/4154275351 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466507744 0 0) 0x7f46380ce160 con 0x7f4638156990 2024-09-12T02:29:42.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.324+0000 7f4636d9d640 1 -- 172.21.15.181:0/4154275351 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46380ce720 con 0x7f46380b2490 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f4636d9d640 1 --2- 172.21.15.181:0/4154275351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380b2490 0x7f46380721e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4630009d90 tx=0x7f463002a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ce774cbebe5016 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f4635d9b640 1 -- 172.21.15.181:0/4154275351 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630007740 con 0x7f46380b2490 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f4635d9b640 1 -- 172.21.15.181:0/4154275351 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46300078e0 con 0x7f46380b2490 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f4635d9b640 1 -- 172.21.15.181:0/4154275351 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630007cb0 con 0x7f46380b2490 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f463ccd2640 1 -- 172.21.15.181:0/4154275351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380b2490 msgr2=0x7f46380721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f463ccd2640 1 --2- 172.21.15.181:0/4154275351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380b2490 0x7f46380721e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4630009d90 tx=0x7f463002a580 comp rx=0 tx=0).stop 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f463ccd2640 1 -- 172.21.15.181:0/4154275351 shutdown_connections 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f463ccd2640 1 --2- 172.21.15.181:0/4154275351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380b2490 0x7f46380721e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f463ccd2640 1 -- 172.21.15.181:0/4154275351 >> 172.21.15.181:0/4154275351 conn(0x7f463806bc10 msgr2=0x7f463806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f463ccd2640 1 -- 172.21.15.181:0/4154275351 shutdown_connections 2024-09-12T02:29:42.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.325+0000 7f463ccd2640 1 -- 172.21.15.181:0/4154275351 wait complete. 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.327+0000 7f463ccd2640 1 Processor -- start 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.327+0000 7f463ccd2640 1 -- start start 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46380b2490 0x7f4638153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380cd880 0x7f4638157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4638156990 0x7f4638158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f46380cea90 con 0x7f46380cd880 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f46380cf130 con 0x7f4638156990 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4638072720 con 0x7f46380b2490 2024-09-12T02:29:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380cd880 0x7f4638157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380cd880 0x7f4638157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58696/0 (socket says 172.21.15.181:58696) 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 -- 172.21.15.181:0/2269500367 learned_addr learned my addr 172.21.15.181:0/2269500367 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f4636d9d640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4638156990 0x7f4638158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463659c640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46380b2490 0x7f4638153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 -- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46380b2490 msgr2=0x7f4638153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46380b2490 0x7f4638153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 -- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4638156990 msgr2=0x7f4638158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4638156990 0x7f4638158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 -- 172.21.15.181:0/2269500367 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463815ca70 con 0x7f46380cd880 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463659c640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46380b2490 0x7f4638153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f4636d9d640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4638156990 0x7f4638158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462dd9b640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380cd880 0x7f4638157f50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f462000c400 tx=0x7f462000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462f7fe640 1 -- 172.21.15.181:0/2269500367 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620011790 con 0x7f46380cd880 2024-09-12T02:29:42.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462f7fe640 1 -- 172.21.15.181:0/2269500367 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620017070 con 0x7f46380cd880 2024-09-12T02:29:42.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463815cd50 con 0x7f46380cd880 2024-09-12T02:29:42.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f462f7fe640 1 -- 172.21.15.181:0/2269500367 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620011bb0 con 0x7f46380cd880 2024-09-12T02:29:42.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.328+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463815d310 con 0x7f46380cd880 2024-09-12T02:29:42.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.329+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46380721e0 con 0x7f46380cd880 2024-09-12T02:29:42.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.330+0000 7f462f7fe640 1 -- 172.21.15.181:0/2269500367 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f462001c460 con 0x7f46380cd880 2024-09-12T02:29:42.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.330+0000 7f462f7fe640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f461806be30 0x7f461806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.330+0000 7f462f7fe640 1 -- 172.21.15.181:0/2269500367 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f462008ad20 con 0x7f46380cd880 2024-09-12T02:29:42.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.330+0000 7f463659c640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f461806be30 0x7f461806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.331+0000 7f463659c640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f461806be30 0x7f461806e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4628000f60 tx=0x7f4628007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.335+0000 7f462f7fe640 1 -- 172.21.15.181:0/2269500367 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4620059670 con 0x7f46380cd880 2024-09-12T02:29:42.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.535+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4638072ca0 con 0x7f46380cd880 2024-09-12T02:29:42.536 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:29:42.536+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:29:42.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.539+0000 7f462f7fe640 1 -- 172.21.15.181:0/2269500367 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f4620058f70 con 0x7f46380cd880 2024-09-12T02:29:42.540 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:29:42.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f461806be30 msgr2=0x7f461806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f461806be30 0x7f461806e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4628000f60 tx=0x7f4628007ca0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380cd880 msgr2=0x7f4638157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380cd880 0x7f4638157f50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f462000c400 tx=0x7f462000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 shutdown_connections 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f461806be30 0x7f461806e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4638156990 0x7f4638158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46380cd880 0x7f4638157f50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 --2- 172.21.15.181:0/2269500367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46380b2490 0x7f4638153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.541+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 >> 172.21.15.181:0/2269500367 conn(0x7f463806bc10 msgr2=0x7f463815b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.542+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 shutdown_connections 2024-09-12T02:29:42.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.542+0000 7f463ccd2640 1 -- 172.21.15.181:0/2269500367 wait complete. 2024-09-12T02:29:42.547 INFO:tasks.ceph.mds.a.smithi181.stderr: -4305> 2024-09-12T02:29:29.878+0000 7fe9506a3640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2024-09-12T02:29:42.547 INFO:tasks.ceph.mds.a.smithi181.stderr: -3856> 2024-09-12T02:29:29.882+0000 7fe9506a3640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-09-12T02:29:42.548 INFO:tasks.ceph.mds.a.smithi181.stderr: -3516> 2024-09-12T02:29:31.564+0000 7fe9546ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:29:42.550 INFO:tasks.ceph.mds.a.smithi181.stderr: -1722> 2024-09-12T02:29:39.528+0000 7fe9506a3640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2024-09-12T02:29:42.555 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:29:42.578 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:29:42.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.658+0000 7f919d14b640 1 Processor -- start 2024-09-12T02:29:42.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.658+0000 7f919d14b640 1 -- start start 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919d14b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f919806d640 0x7f919806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919d14b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f919806f830 0x7f91981622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919d14b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919815ea20 con 0x7f9198158ac0 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919d14b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f919806d430 con 0x7f919806f830 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919d14b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f919806dad0 con 0x7f919806d640 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919759e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f919806f830 0x7f91981622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919759e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f919806f830 0x7f91981622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58706/0 (socket says 172.21.15.181:58706) 2024-09-12T02:29:42.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.659+0000 7f919759e640 1 -- 172.21.15.181:0/2681424663 learned_addr learned my addr 172.21.15.181:0/2681424663 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.660+0000 7f918e59c640 1 --2- 172.21.15.181:0/2681424663 >> v2:172.21.15.204:3300/0 conn(0x7f919806d640 0x7f919806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.660+0000 7f919759e640 1 -- 172.21.15.181:0/2681424663 >> v2:172.21.15.204:3300/0 conn(0x7f919806d640 msgr2=0x7f919806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.660+0000 7f919759e640 1 --2- 172.21.15.181:0/2681424663 >> v2:172.21.15.204:3300/0 conn(0x7f919806d640 0x7f919806f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.660+0000 7f919759e640 1 -- 172.21.15.181:0/2681424663 >> v1:172.21.15.204:6789/0 conn(0x7f9198158ac0 legacy=0x7f919806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.660+0000 7f919759e640 1 -- 172.21.15.181:0/2681424663 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919815ece0 con 0x7f919806f830 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.660+0000 7f919759e640 1 --2- 172.21.15.181:0/2681424663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f91981622f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9198074220 tx=0x7f919002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd225e39c25c3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.660+0000 7f919659c640 1 -- 172.21.15.181:0/2681424663 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190036070 con 0x7f919806f830 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919659c640 1 -- 172.21.15.181:0/2681424663 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9190031600 con 0x7f919806f830 2024-09-12T02:29:42.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919659c640 1 -- 172.21.15.181:0/2681424663 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900319d0 con 0x7f919806f830 2024-09-12T02:29:42.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 -- 172.21.15.181:0/2681424663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 msgr2=0x7f91981622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 --2- 172.21.15.181:0/2681424663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f91981622f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9198074220 tx=0x7f919002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 -- 172.21.15.181:0/2681424663 shutdown_connections 2024-09-12T02:29:42.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 --2- 172.21.15.181:0/2681424663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f91981622f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 --2- 172.21.15.181:0/2681424663 >> v2:172.21.15.204:3300/0 conn(0x7f919806d640 0x7f919806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 -- 172.21.15.181:0/2681424663 >> 172.21.15.181:0/2681424663 conn(0x7f9198067950 msgr2=0x7f9198067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 -- 172.21.15.181:0/2681424663 shutdown_connections 2024-09-12T02:29:42.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.661+0000 7f919d14b640 1 -- 172.21.15.181:0/2681424663 wait complete. 2024-09-12T02:29:42.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.662+0000 7f919d14b640 1 Processor -- start 2024-09-12T02:29:42.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f919d14b640 1 -- start start 2024-09-12T02:29:42.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f919d14b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f919806d640 0x7f9198157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f919d14b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f919814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f919d14b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9198158ac0 0x7f9198147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f919d14b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9198158ea0 con 0x7f919806f830 2024-09-12T02:29:42.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f919d14b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f919806fc80 con 0x7f9198158ac0 2024-09-12T02:29:42.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f919d14b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f919815f2a0 con 0x7f919806d640 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f918e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f919814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f918e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f919814ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58708/0 (socket says 172.21.15.181:58708) 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.663+0000 7f918e59c640 1 -- 172.21.15.181:0/4067745197 learned_addr learned my addr 172.21.15.181:0/4067745197 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f919759e640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9198158ac0 0x7f9198147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f9196d9d640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f919806d640 0x7f9198157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918e59c640 1 -- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f919806d640 msgr2=0x7f9198157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918e59c640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f919806d640 0x7f9198157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918e59c640 1 -- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9198158ac0 msgr2=0x7f9198147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918e59c640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9198158ac0 0x7f9198147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918e59c640 1 -- 172.21.15.181:0/4067745197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9198156250 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918e59c640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f919814ce80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f918000c7f0 tx=0x7f918000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918ffff640 1 -- 172.21.15.181:0/4067745197 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180015070 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918ffff640 1 -- 172.21.15.181:0/4067745197 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9180004220 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9198156fd0 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f918ffff640 1 -- 172.21.15.181:0/4067745197 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180007620 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.664+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981567d0 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.665+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91980b6110 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.666+0000 7f918ffff640 1 -- 172.21.15.181:0/4067745197 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91800077c0 con 0x7f919806f830 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.666+0000 7f918ffff640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f917806be30 0x7f917806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.666+0000 7f918ffff640 1 -- 172.21.15.181:0/4067745197 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5881+0+0 (secure 0 0 0) 0x7f918008af00 con 0x7f919806f830 2024-09-12T02:29:42.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.666+0000 7f9196d9d640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f917806be30 0x7f917806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.666+0000 7f9196d9d640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f917806be30 0x7f917806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9188004f60 tx=0x7f9188007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.670+0000 7f918ffff640 1 -- 172.21.15.181:0/4067745197 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9180059220 con 0x7f919806f830 2024-09-12T02:29:42.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:42.870+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f91981577d0 con 0x7f919806f830 2024-09-12T02:29:43.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.543+0000 7f918ffff640 1 -- 172.21.15.181:0/4067745197 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f918005d520 con 0x7f919806f830 2024-09-12T02:29:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.545+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f917806be30 msgr2=0x7f917806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.545+0000 7f919d14b640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f917806be30 0x7f917806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9188004f60 tx=0x7f9188007e30 comp rx=0 tx=0).stop 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.545+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 msgr2=0x7f919814ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.545+0000 7f919d14b640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f919814ce80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f918000c7f0 tx=0x7f918000ccb0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 shutdown_connections 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f917806be30 0x7f917806e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9198158ac0 0x7f9198147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f919806f830 0x7f919814ce80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 --2- 172.21.15.181:0/4067745197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f919806d640 0x7f9198157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 >> 172.21.15.181:0/4067745197 conn(0x7f9198067950 msgr2=0x7f9198155810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 shutdown_connections 2024-09-12T02:29:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.546+0000 7f919d14b640 1 -- 172.21.15.181:0/4067745197 wait complete. 2024-09-12T02:29:43.561 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:29:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.709+0000 7f4829dc4640 1 Processor -- start 2024-09-12T02:29:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.709+0000 7f4829dc4640 1 -- start start 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f4829dc4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4824147f50 0x7f4824073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f4829dc4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4824074000 con 0x7f48240b0960 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f4829dc4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4824162230 con 0x7f4824162d10 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f4829dc4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f48240742e0 con 0x7f4824147f50 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f48237fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4824147f50 0x7f4824073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f48237fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4824147f50 0x7f4824073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58722/0 (socket says 172.21.15.181:58722) 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f4823fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f48240b0960 0x7f48240ae8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36254/0 (socket says 172.21.15.181:36254) 2024-09-12T02:29:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f48237fe640 1 -- 172.21.15.181:0/2486863814 learned_addr learned my addr 172.21.15.181:0/2486863814 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:43.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f48237fe640 1 -- 172.21.15.181:0/2486863814 >> v1:172.21.15.204:6789/0 conn(0x7f4824162d10 legacy=0x7f48240b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:43.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f48237fe640 1 -- 172.21.15.181:0/2486863814 >> v1:172.21.15.181:6789/0 conn(0x7f48240b0960 legacy=0x7f48240ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f48227fc640 1 -- 172.21.15.181:0/2486863814 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610753328 0 0) 0x7f4824074000 con 0x7f48240b0960 2024-09-12T02:29:43.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.710+0000 7f48237fe640 1 -- 172.21.15.181:0/2486863814 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4824162510 con 0x7f4824147f50 2024-09-12T02:29:43.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.711+0000 7f48237fe640 1 --2- 172.21.15.181:0/2486863814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f4824073460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4814009870 tx=0x7f481402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f50056cbfea2358 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:43.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.711+0000 7f48227fc640 1 -- 172.21.15.181:0/2486863814 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814037070 con 0x7f4824147f50 2024-09-12T02:29:43.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.711+0000 7f48227fc640 1 -- 172.21.15.181:0/2486863814 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481402ae50 con 0x7f4824147f50 2024-09-12T02:29:43.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.711+0000 7f48227fc640 1 -- 172.21.15.181:0/2486863814 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814032860 con 0x7f4824147f50 2024-09-12T02:29:43.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.712+0000 7f4829dc4640 1 -- 172.21.15.181:0/2486863814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 msgr2=0x7f4824073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.712+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2486863814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f4824073460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4814009870 tx=0x7f481402a300 comp rx=0 tx=0).stop 2024-09-12T02:29:43.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.712+0000 7f4829dc4640 1 -- 172.21.15.181:0/2486863814 shutdown_connections 2024-09-12T02:29:43.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.712+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2486863814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f4824073460 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.712+0000 7f4829dc4640 1 -- 172.21.15.181:0/2486863814 >> 172.21.15.181:0/2486863814 conn(0x7f48240b2fa0 msgr2=0x7f48240b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:43.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.712+0000 7f4829dc4640 1 -- 172.21.15.181:0/2486863814 shutdown_connections 2024-09-12T02:29:43.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.712+0000 7f4829dc4640 1 -- 172.21.15.181:0/2486863814 wait complete. 2024-09-12T02:29:43.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.713+0000 7f4829dc4640 1 Processor -- start 2024-09-12T02:29:43.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.713+0000 7f4829dc4640 1 -- start start 2024-09-12T02:29:43.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48240b0960 0x7f482415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f482415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4824162d10 0x7f4824145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48240739a0 con 0x7f4824147f50 2024-09-12T02:29:43.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4824070680 con 0x7f48240b0960 2024-09-12T02:29:43.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4824073b20 con 0x7f4824162d10 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f482415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f482415dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58730/0 (socket says 172.21.15.181:58730) 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 -- 172.21.15.181:0/2455436945 learned_addr learned my addr 172.21.15.181:0/2455436945 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f48237fe640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48240b0960 0x7f482415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 -- 172.21.15.181:0/2455436945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4824162d10 msgr2=0x7f4824145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4824162d10 0x7f4824145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 -- 172.21.15.181:0/2455436945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48240b0960 msgr2=0x7f482415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48240b0960 0x7f482415fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 -- 172.21.15.181:0/2455436945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48241468d0 con 0x7f4824147f50 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4822ffd640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f482415dfe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f481800c400 tx=0x7f481800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f480bfff640 1 -- 172.21.15.181:0/2455436945 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4818017070 con 0x7f4824147f50 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f480bfff640 1 -- 172.21.15.181:0/2455436945 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48180052d0 con 0x7f4824147f50 2024-09-12T02:29:43.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4824144550 con 0x7f4824147f50 2024-09-12T02:29:43.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f480bfff640 1 -- 172.21.15.181:0/2455436945 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4818003830 con 0x7f4824147f50 2024-09-12T02:29:43.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.714+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48241600e0 con 0x7f4824147f50 2024-09-12T02:29:43.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.716+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4824073460 con 0x7f4824147f50 2024-09-12T02:29:43.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.716+0000 7f480bfff640 1 -- 172.21.15.181:0/2455436945 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f481801a070 con 0x7f4824147f50 2024-09-12T02:29:43.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.717+0000 7f480bfff640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f481006be30 0x7f481006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:43.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.717+0000 7f48237fe640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f481006be30 0x7f481006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:43.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.717+0000 7f480bfff640 1 -- 172.21.15.181:0/2455436945 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5881+0+0 (secure 0 0 0) 0x7f481808a250 con 0x7f4824147f50 2024-09-12T02:29:43.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.717+0000 7f48237fe640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f481006be30 0x7f481006e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4814034000 tx=0x7f481402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.721+0000 7f480bfff640 1 -- 172.21.15.181:0/2455436945 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4818058b60 con 0x7f4824147f50 2024-09-12T02:29:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:43.885+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4824143580 con 0x7f4824147f50 2024-09-12T02:29:44.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.551+0000 7f480bfff640 1 -- 172.21.15.181:0/2455436945 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f4818058460 con 0x7f4824147f50 2024-09-12T02:29:44.552 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:29:44.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f481006be30 msgr2=0x7f481006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f481006be30 0x7f481006e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4814034000 tx=0x7f481402e000 comp rx=0 tx=0).stop 2024-09-12T02:29:44.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 msgr2=0x7f482415dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f482415dfe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f481800c400 tx=0x7f481800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 shutdown_connections 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f481006be30 0x7f481006e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4824162d10 0x7f4824145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824147f50 0x7f482415dfe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 --2- 172.21.15.181:0/2455436945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f48240b0960 0x7f482415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.553+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 >> 172.21.15.181:0/2455436945 conn(0x7f48240b2fa0 msgr2=0x7f48240b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.554+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 shutdown_connections 2024-09-12T02:29:44.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.554+0000 7f4829dc4640 1 -- 172.21.15.181:0/2455436945 wait complete. 2024-09-12T02:29:44.569 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:29:44.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.675+0000 7f2519223640 1 Processor -- start 2024-09-12T02:29:44.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.676+0000 7f2519223640 1 -- start start 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.676+0000 7f2519223640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f25140d1d50 0x7f25140b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.676+0000 7f2519223640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f25140b0700 0x7f2514162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.676+0000 7f2519223640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2514072160 con 0x7f251415e7b0 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.676+0000 7f2519223640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f25140735b0 con 0x7f25140d1d50 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.676+0000 7f2519223640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f25140b65b0 con 0x7f25140b0700 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.676+0000 7f251259c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f25140d1d50 0x7f25140b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.677+0000 7f2512d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f251415e7b0 0x7f25140b5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36258/0 (socket says 172.21.15.181:36258) 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.677+0000 7f2512d9d640 1 -- 172.21.15.181:0/3809155000 learned_addr learned my addr 172.21.15.181:0/3809155000 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.677+0000 7f251259c640 1 -- 172.21.15.181:0/3809155000 >> v2:172.21.15.204:3300/0 conn(0x7f25140b0700 msgr2=0x7f2514162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.677+0000 7f251259c640 1 --2- 172.21.15.181:0/3809155000 >> v2:172.21.15.204:3300/0 conn(0x7f25140b0700 0x7f2514162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.677+0000 7f251259c640 1 -- 172.21.15.181:0/3809155000 >> v1:172.21.15.181:6789/0 conn(0x7f251415e7b0 legacy=0x7f25140b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.677+0000 7f2511d9b640 1 -- 172.21.15.181:0/3809155000 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197871919 0 0) 0x7f2514072160 con 0x7f251415e7b0 2024-09-12T02:29:44.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.677+0000 7f251259c640 1 -- 172.21.15.181:0/3809155000 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2514073830 con 0x7f25140d1d50 2024-09-12T02:29:44.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f251259c640 1 --2- 172.21.15.181:0/3809155000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25140d1d50 0x7f25140b01c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f25080097a0 tx=0x7f250802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45949c5028f36d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:44.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2511d9b640 1 -- 172.21.15.181:0/3809155000 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508037070 con 0x7f25140d1d50 2024-09-12T02:29:44.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2511d9b640 1 -- 172.21.15.181:0/3809155000 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2508032440 con 0x7f25140d1d50 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2511d9b640 1 -- 172.21.15.181:0/3809155000 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508032810 con 0x7f25140d1d50 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 -- 172.21.15.181:0/3809155000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25140d1d50 msgr2=0x7f25140b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 --2- 172.21.15.181:0/3809155000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25140d1d50 0x7f25140b01c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f25080097a0 tx=0x7f250802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 -- 172.21.15.181:0/3809155000 shutdown_connections 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 --2- 172.21.15.181:0/3809155000 >> v2:172.21.15.204:3300/0 conn(0x7f25140b0700 0x7f2514162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 --2- 172.21.15.181:0/3809155000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25140d1d50 0x7f25140b01c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 -- 172.21.15.181:0/3809155000 >> 172.21.15.181:0/3809155000 conn(0x7f25140d1230 msgr2=0x7f25140d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 -- 172.21.15.181:0/3809155000 shutdown_connections 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.678+0000 7f2519223640 1 -- 172.21.15.181:0/3809155000 wait complete. 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.680+0000 7f2519223640 1 Processor -- start 2024-09-12T02:29:44.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.680+0000 7f2519223640 1 -- start start 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.680+0000 7f2519223640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25140b0700 0x7f251414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.680+0000 7f2519223640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25140d1d50 0x7f25140c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f2519223640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f251415e7b0 0x7f25141f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f2519223640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f25140ae8a0 con 0x7f251415e7b0 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f2519223640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2514073df0 con 0x7f25140d1d50 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f2519223640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f25140aea20 con 0x7f25140b0700 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f251415e7b0 0x7f25141f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f251415e7b0 0x7f25141f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58760/0 (socket says 172.21.15.181:58760) 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 -- 172.21.15.181:0/1715851951 learned_addr learned my addr 172.21.15.181:0/1715851951 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251259c640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25140d1d50 0x7f25140c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f2512d9d640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25140b0700 0x7f251414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 -- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25140b0700 msgr2=0x7f251414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25140b0700 0x7f251414fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 -- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25140d1d50 msgr2=0x7f25140c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25140d1d50 0x7f25140c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 -- 172.21.15.181:0/1715851951 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2514150210 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f251359e640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f251415e7b0 0x7f25141f42e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f250c00b970 tx=0x7f250c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f24fb7fe640 1 -- 172.21.15.181:0/1715851951 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c019070 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f24fb7fe640 1 -- 172.21.15.181:0/1715851951 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250c00cb60 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25140cea30 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f24fb7fe640 1 -- 172.21.15.181:0/1715851951 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c014440 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.681+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25140ceff0 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.682+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25140b01c0 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.683+0000 7f24fb7fe640 1 -- 172.21.15.181:0/1715851951 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f250c01c070 con 0x7f251415e7b0 2024-09-12T02:29:44.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.683+0000 7f24fb7fe640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f250006be30 0x7f250006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.683+0000 7f2512d9d640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f250006be30 0x7f250006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.683+0000 7f24fb7fe640 1 -- 172.21.15.181:0/1715851951 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5443+0+0 (secure 0 0 0) 0x7f250c08aa00 con 0x7f251415e7b0 2024-09-12T02:29:44.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.684+0000 7f2512d9d640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f250006be30 0x7f250006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2504000f60 tx=0x7f2504007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:44.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.688+0000 7f24fb7fe640 1 -- 172.21.15.181:0/1715851951 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f250c059540 con 0x7f251415e7b0 2024-09-12T02:29:44.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:44.853+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25140afa30 con 0x7f251415e7b0 2024-09-12T02:29:45.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.552+0000 7f24fb7fe640 1 -- 172.21.15.181:0/1715851951 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f250c058e40 con 0x7f251415e7b0 2024-09-12T02:29:45.553 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' removed 2024-09-12T02:29:45.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f250006be30 msgr2=0x7f250006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f250006be30 0x7f250006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2504000f60 tx=0x7f2504007c00 comp rx=0 tx=0).stop 2024-09-12T02:29:45.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f251415e7b0 msgr2=0x7f25141f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f251415e7b0 0x7f25141f42e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f250c00b970 tx=0x7f250c00be30 comp rx=0 tx=0).stop 2024-09-12T02:29:45.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 shutdown_connections 2024-09-12T02:29:45.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f250006be30 0x7f250006e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25140d1d50 0x7f25140c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f251415e7b0 0x7f25141f42e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 --2- 172.21.15.181:0/1715851951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25140b0700 0x7f251414fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 >> 172.21.15.181:0/1715851951 conn(0x7f25140d1230 msgr2=0x7f25140b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:45.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 shutdown_connections 2024-09-12T02:29:45.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.555+0000 7f2519223640 1 -- 172.21.15.181:0/1715851951 wait complete. 2024-09-12T02:29:45.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:29:45.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.671+0000 7f2f6a99d640 1 Processor -- start 2024-09-12T02:29:45.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.671+0000 7f2f6a99d640 1 -- start start 2024-09-12T02:29:45.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6a99d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f640d0820 0x7f2f64073790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6a99d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2f6406c320 0x7f2f64161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6a99d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f64074090 con 0x7f2f640d0c00 2024-09-12T02:29:45.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6a99d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2f640b5a10 con 0x7f2f640d0820 2024-09-12T02:29:45.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6a99d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2f640b5c70 con 0x7f2f6406c320 2024-09-12T02:29:45.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6999b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f640d0820 0x7f2f64073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6999b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f640d0820 0x7f2f64073790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58770/0 (socket says 172.21.15.181:58770) 2024-09-12T02:29:45.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6999b640 1 -- 172.21.15.181:0/1394522977 learned_addr learned my addr 172.21.15.181:0/1394522977 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:45.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6a19c640 1 --2- 172.21.15.181:0/1394522977 >> v2:172.21.15.204:3300/0 conn(0x7f2f6406c320 0x7f2f64161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6999b640 1 -- 172.21.15.181:0/1394522977 >> v2:172.21.15.204:3300/0 conn(0x7f2f6406c320 msgr2=0x7f2f64161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:45.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6999b640 1 --2- 172.21.15.181:0/1394522977 >> v2:172.21.15.204:3300/0 conn(0x7f2f6406c320 0x7f2f64161fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6999b640 1 -- 172.21.15.181:0/1394522977 >> v1:172.21.15.204:6789/0 conn(0x7f2f640d0c00 legacy=0x7f2f6406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:45.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.672+0000 7f2f6999b640 1 -- 172.21.15.181:0/1394522977 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f640b5f50 con 0x7f2f640d0820 2024-09-12T02:29:45.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.673+0000 7f2f6999b640 1 --2- 172.21.15.181:0/1394522977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f640d0820 0x7f2f64073790 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2f64161f20 tx=0x7f2f6002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fc4115983c8273 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.673+0000 7f2f68999640 1 -- 172.21.15.181:0/1394522977 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60037070 con 0x7f2f640d0820 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.673+0000 7f2f68999640 1 -- 172.21.15.181:0/1394522977 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f60032440 con 0x7f2f640d0820 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.673+0000 7f2f68999640 1 -- 172.21.15.181:0/1394522977 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60032810 con 0x7f2f640d0820 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 -- 172.21.15.181:0/1394522977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f640d0820 msgr2=0x7f2f64073790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/1394522977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f640d0820 0x7f2f64073790 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2f64161f20 tx=0x7f2f6002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 -- 172.21.15.181:0/1394522977 shutdown_connections 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/1394522977 >> v2:172.21.15.204:3300/0 conn(0x7f2f6406c320 0x7f2f64161fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/1394522977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f640d0820 0x7f2f64073790 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 -- 172.21.15.181:0/1394522977 >> 172.21.15.181:0/1394522977 conn(0x7f2f64067d70 msgr2=0x7f2f6406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 -- 172.21.15.181:0/1394522977 shutdown_connections 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.674+0000 7f2f6a99d640 1 -- 172.21.15.181:0/1394522977 wait complete. 2024-09-12T02:29:45.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.675+0000 7f2f6a99d640 1 Processor -- start 2024-09-12T02:29:45.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.675+0000 7f2f6a99d640 1 -- start start 2024-09-12T02:29:45.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f6406c320 0x7f2f641f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f640d0820 0x7f2f641f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f640d0c00 0x7f2f64161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f64073e50 con 0x7f2f6406c320 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2f64073cd0 con 0x7f2f640d0820 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6415e970 con 0x7f2f640d0c00 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f6406c320 0x7f2f641f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f6406c320 0x7f2f641f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58772/0 (socket says 172.21.15.181:58772) 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 -- 172.21.15.181:0/2314227045 learned_addr learned my addr 172.21.15.181:0/2314227045 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6919a640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f640d0820 0x7f2f641f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a19c640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f640d0c00 0x7f2f64161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 -- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f640d0c00 msgr2=0x7f2f64161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f640d0c00 0x7f2f64161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 -- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f640d0820 msgr2=0x7f2f641f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f640d0820 0x7f2f641f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 -- 172.21.15.181:0/2314227045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f641f4540 con 0x7f2f6406c320 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a19c640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f640d0c00 0x7f2f64161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6919a640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f640d0820 0x7f2f641f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6999b640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f6406c320 0x7f2f641f3ef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2f60000c00 tx=0x7f2f600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f5a7fc640 1 -- 172.21.15.181:0/2314227045 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60041020 con 0x7f2f6406c320 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f5a7fc640 1 -- 172.21.15.181:0/2314227045 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f600306c0 con 0x7f2f6406c320 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f641f4820 con 0x7f2f6406c320 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f5a7fc640 1 -- 172.21.15.181:0/2314227045 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60037040 con 0x7f2f6406c320 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.676+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f641f4de0 con 0x7f2f6406c320 2024-09-12T02:29:45.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.677+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6406edb0 con 0x7f2f6406c320 2024-09-12T02:29:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.678+0000 7f2f5a7fc640 1 -- 172.21.15.181:0/2314227045 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f60044020 con 0x7f2f6406c320 2024-09-12T02:29:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.678+0000 7f2f5a7fc640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4806be30 0x7f2f4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.678+0000 7f2f5a7fc640 1 -- 172.21.15.181:0/2314227045 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5029+0+0 (secure 0 0 0) 0x7f2f600ab450 con 0x7f2f6406c320 2024-09-12T02:29:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.678+0000 7f2f6919a640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4806be30 0x7f2f4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.679+0000 7f2f6919a640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4806be30 0x7f2f4806e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f6415f050 tx=0x7f2f54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.682+0000 7f2f5a7fc640 1 -- 172.21.15.181:0/2314227045 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f6004b030 con 0x7f2f6406c320 2024-09-12T02:29:45.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:45.825 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:45.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.852+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2f641535a0 con 0x7f2f6406c320 2024-09-12T02:29:45.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.855+0000 7f2f5a7fc640 1 -- 172.21.15.181:0/2314227045 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f2f6007a0a0 con 0x7f2f6406c320 2024-09-12T02:29:45.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4806be30 msgr2=0x7f2f4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4806be30 0x7f2f4806e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f6415f050 tx=0x7f2f54009040 comp rx=0 tx=0).stop 2024-09-12T02:29:45.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f6406c320 msgr2=0x7f2f641f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f6406c320 0x7f2f641f3ef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2f60000c00 tx=0x7f2f600046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 shutdown_connections 2024-09-12T02:29:45.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4806be30 0x7f2f4806e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f640d0820 0x7f2f641f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f640d0c00 0x7f2f64161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 --2- 172.21.15.181:0/2314227045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f6406c320 0x7f2f641f3ef0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 >> 172.21.15.181:0/2314227045 conn(0x7f2f64067d70 msgr2=0x7f2f6406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:45.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 shutdown_connections 2024-09-12T02:29:45.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:45.857+0000 7f2f6a99d640 1 -- 172.21.15.181:0/2314227045 wait complete. 2024-09-12T02:29:45.869 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2024-09-12T02:29:46.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.014+0000 7f6e145c4640 1 Processor -- start 2024-09-12T02:29:46.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.014+0000 7f6e145c4640 1 -- start start 2024-09-12T02:29:46.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e145c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 0x7f6e0c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e145c4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0c06cec0 con 0x7f6e0c15e4e0 2024-09-12T02:29:46.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e145c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0c06d160 con 0x7f6e0c0b6ee0 2024-09-12T02:29:46.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e145c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c0d2d40 con 0x7f6e0c15e8c0 2024-09-12T02:29:46.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e12360640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6e0c15e4e0 0x7f6e0c0b67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36264/0 (socket says 172.21.15.181:36264) 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e12360640 1 -- 172.21.15.181:0/2351047605 learned_addr learned my addr 172.21.15.181:0/2351047605 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e11b5f640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 0x7f6e0c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2030621978 0 0) 0x7f6e0c06cec0 con 0x7f6e0c15e4e0 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df8003520 con 0x7f6e0c15e4e0 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4045408923 0 0) 0x7f6df8003520 con 0x7f6e0c15e4e0 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 msgr2=0x7f6e0c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 0x7f6e0c0d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 >> v1:172.21.15.204:6789/0 conn(0x7f6e0c0b6ee0 legacy=0x7f6e0c0d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c06d440 con 0x7f6e0c15e4e0 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f6e08001670 con 0x7f6e0c15e4e0 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 >> v1:172.21.15.181:6789/0 conn(0x7f6e0c15e4e0 legacy=0x7f6e0c0b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df80039e0 0x7f6df8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 0x7f6df8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8004d40 0x7f6df80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c0d2d40 con 0x7f6df80039e0 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6df800ba70 con 0x7f6df8004d40 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6df800bc70 con 0x7f6e0c15e8c0 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.015+0000 7f6e12360640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df80039e0 0x7f6df8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e12b61640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8004d40 0x7f6df80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e11b5f640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 0x7f6df8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e12360640 1 -- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 msgr2=0x7f6df8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e12360640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 0x7f6df8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e12360640 1 -- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8004d40 msgr2=0x7f6df80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e12360640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df8004d40 0x7f6df80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e12360640 1 -- 172.21.15.181:0/2351047605 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df8003520 con 0x7f6df80039e0 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e11b5f640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c15e8c0 0x7f6df8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:46.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e12360640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df80039e0 0x7f6df8003dc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800c210 tx=0x7f6df8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526b00f6146d843f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e08007ce0 con 0x7f6df80039e0 2024-09-12T02:29:46.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.016+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e08005af0 con 0x7f6df80039e0 2024-09-12T02:29:46.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e1135e640 1 -- 172.21.15.181:0/2351047605 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e08007070 con 0x7f6df80039e0 2024-09-12T02:29:46.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e145c4640 1 -- 172.21.15.181:0/2351047605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df80039e0 msgr2=0x7f6df8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e145c4640 1 --2- 172.21.15.181:0/2351047605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6df80039e0 0x7f6df8003dc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800c210 tx=0x7f6df8005830 comp rx=0 tx=0).stop 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e12b61640 1 -- 172.21.15.181:0/2351047605 reap_dead start 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e145c4640 1 -- 172.21.15.181:0/2351047605 shutdown_connections 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e145c4640 1 -- 172.21.15.181:0/2351047605 >> 172.21.15.181:0/2351047605 conn(0x7f6e0c06f400 msgr2=0x7f6e0c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e145c4640 1 -- 172.21.15.181:0/2351047605 shutdown_connections 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.017+0000 7f6e145c4640 1 -- 172.21.15.181:0/2351047605 wait complete. 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.018+0000 7f6e145c4640 1 Processor -- start 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.018+0000 7f6e145c4640 1 -- start start 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e145c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df80039e0 0x7f6e0c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e145c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c14b410 0x7f6e0c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e145c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e0c1446d0 0x7f6e0c144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e145c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c0d1fc0 con 0x7f6e0c1446d0 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e145c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c06ec50 con 0x7f6df80039e0 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e145c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c0d2140 con 0x7f6e0c14b410 2024-09-12T02:29:46.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e0c1446d0 0x7f6e0c144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e0c1446d0 0x7f6e0c144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58798/0 (socket says 172.21.15.181:58798) 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12360640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df80039e0 0x7f6e0c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 -- 172.21.15.181:0/1107742920 learned_addr learned my addr 172.21.15.181:0/1107742920 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e11b5f640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c14b410 0x7f6e0c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 -- 172.21.15.181:0/1107742920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c14b410 msgr2=0x7f6e0c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c14b410 0x7f6e0c0b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 -- 172.21.15.181:0/1107742920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df80039e0 msgr2=0x7f6e0c155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df80039e0 0x7f6e0c155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.019+0000 7f6e12b61640 1 -- 172.21.15.181:0/1107742920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c155b80 con 0x7f6e0c1446d0 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.020+0000 7f6e12b61640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e0c1446d0 0x7f6e0c144b60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c072c30 tx=0x7f6e0400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.020+0000 7f6e02ffd640 1 -- 172.21.15.181:0/1107742920 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04019070 con 0x7f6e0c1446d0 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.020+0000 7f6e02ffd640 1 -- 172.21.15.181:0/1107742920 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e04006d60 con 0x7f6e0c1446d0 2024-09-12T02:29:46.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.020+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c155e60 con 0x7f6e0c1446d0 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.020+0000 7f6e02ffd640 1 -- 172.21.15.181:0/1107742920 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04003bb0 con 0x7f6e0c1446d0 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.020+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c1453a0 con 0x7f6e0c1446d0 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.021+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0c0b67d0 con 0x7f6e0c1446d0 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.021+0000 7f6e02ffd640 1 -- 172.21.15.181:0/1107742920 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e0401c070 con 0x7f6e0c1446d0 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.022+0000 7f6e02ffd640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6df006be30 0x7f6df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.022+0000 7f6e12360640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6df006be30 0x7f6df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.022+0000 7f6e02ffd640 1 -- 172.21.15.181:0/1107742920 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5029+0+0 (secure 0 0 0) 0x7f6e04089e00 con 0x7f6e0c1446d0 2024-09-12T02:29:46.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.022+0000 7f6e12360640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6df006be30 0x7f6df006e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e08032000 tx=0x7f6e08034040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.026+0000 7f6e02ffd640 1 -- 172.21.15.181:0/1107742920 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e04058400 con 0x7f6e0c1446d0 2024-09-12T02:29:46.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.263+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) -- 0x7f6e0c071260 con 0x7f6e0c1446d0 2024-09-12T02:29:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.559+0000 7f6e02ffd640 1 -- 172.21.15.181:0/1107742920 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v94) ==== 150+0+0 (secure 0 0 0) 0x7f6e0405c700 con 0x7f6e0c1446d0 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6df006be30 msgr2=0x7f6df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6df006be30 0x7f6df006e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e08032000 tx=0x7f6e08034040 comp rx=0 tx=0).stop 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e0c1446d0 msgr2=0x7f6e0c144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e0c1446d0 0x7f6e0c144b60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c072c30 tx=0x7f6e0400ff70 comp rx=0 tx=0).stop 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 shutdown_connections 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6df006be30 0x7f6df006e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e0c1446d0 0x7f6e0c144b60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6e0c14b410 0x7f6e0c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 --2- 172.21.15.181:0/1107742920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6df80039e0 0x7f6e0c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 >> 172.21.15.181:0/1107742920 conn(0x7f6e0c06f400 msgr2=0x7f6e0c15d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 shutdown_connections 2024-09-12T02:29:46.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.561+0000 7f6e145c4640 1 -- 172.21.15.181:0/1107742920 wait complete. 2024-09-12T02:29:46.573 INFO:tasks.cephfs_test_runner:That when some dentries in the journal but nothing is in ... ok 2024-09-12T02:29:46.573 INFO:tasks.cephfs_test_runner:Starting test: test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-12T02:29:46.574 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.672+0000 7fa34f95f640 1 Processor -- start 2024-09-12T02:29:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.672+0000 7fa34f95f640 1 -- start start 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34f95f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 0x7fa3480cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34f95f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa3480cf800 0x7fa3480b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34f95f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa3480b24f0 0x7fa3480cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34f95f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa34815c7d0 con 0x7fa3480b24f0 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34f95f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa3480cdfc0 con 0x7fa3480cf800 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34f95f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa3480cfc40 con 0x7fa34815c3f0 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa3480b24f0 0x7fa3480cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa3480b24f0 0x7fa3480cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58802/0 (socket says 172.21.15.181:58802) 2024-09-12T02:29:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 -- 172.21.15.181:0/2861552027 learned_addr learned my addr 172.21.15.181:0/2861552027 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 -- 172.21.15.181:0/2861552027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 msgr2=0x7fa3480cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 --2- 172.21.15.181:0/2861552027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 0x7fa3480cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34cefa640 1 --2- 172.21.15.181:0/2861552027 >> v2:172.21.15.204:3300/0 conn(0x7fa3480cf800 0x7fa3480b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 -- 172.21.15.181:0/2861552027 >> v2:172.21.15.204:3300/0 conn(0x7fa3480cf800 msgr2=0x7fa3480b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 --2- 172.21.15.181:0/2861552027 >> v2:172.21.15.204:3300/0 conn(0x7fa3480cf800 0x7fa3480b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.673+0000 7fa34defc640 1 -- 172.21.15.181:0/2861552027 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3480ce210 con 0x7fa3480b24f0 2024-09-12T02:29:46.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.674+0000 7fa34defc640 1 --2- 172.21.15.181:0/2861552027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa3480cce90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3480717c0 tx=0x7fa34002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e1aeae87a1141e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.674+0000 7fa33ffff640 1 -- 172.21.15.181:0/2861552027 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340036070 con 0x7fa3480b24f0 2024-09-12T02:29:46.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.674+0000 7fa33ffff640 1 -- 172.21.15.181:0/2861552027 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa340031600 con 0x7fa3480b24f0 2024-09-12T02:29:46.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.674+0000 7fa33ffff640 1 -- 172.21.15.181:0/2861552027 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400319d0 con 0x7fa3480b24f0 2024-09-12T02:29:46.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 -- 172.21.15.181:0/2861552027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 msgr2=0x7fa3480cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 --2- 172.21.15.181:0/2861552027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa3480cce90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3480717c0 tx=0x7fa34002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 -- 172.21.15.181:0/2861552027 shutdown_connections 2024-09-12T02:29:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 --2- 172.21.15.181:0/2861552027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa3480cce90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 --2- 172.21.15.181:0/2861552027 >> v2:172.21.15.204:3300/0 conn(0x7fa3480cf800 0x7fa3480b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 --2- 172.21.15.181:0/2861552027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 0x7fa3480cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 -- 172.21.15.181:0/2861552027 >> 172.21.15.181:0/2861552027 conn(0x7fa34806bc10 msgr2=0x7fa34806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 -- 172.21.15.181:0/2861552027 shutdown_connections 2024-09-12T02:29:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.675+0000 7fa34f95f640 1 -- 172.21.15.181:0/2861552027 wait complete. 2024-09-12T02:29:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.676+0000 7fa34f95f640 1 Processor -- start 2024-09-12T02:29:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.676+0000 7fa34f95f640 1 -- start start 2024-09-12T02:29:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34f95f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa34815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34f95f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3480cf800 0x7fa3481565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34f95f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 0x7fa3481425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34f95f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa3480ceab0 con 0x7fa3480b24f0 2024-09-12T02:29:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34f95f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa3480ce7d0 con 0x7fa3480cf800 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34f95f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa3480cd3d0 con 0x7fa34815c3f0 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa34815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa34815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58818/0 (socket says 172.21.15.181:58818) 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 -- 172.21.15.181:0/1681763596 learned_addr learned my addr 172.21.15.181:0/1681763596 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34cefa640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3480cf800 0x7fa3481565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34defc640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 0x7fa3481425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 -- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 msgr2=0x7fa3481425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 0x7fa3481425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 -- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3480cf800 msgr2=0x7fa3481565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3480cf800 0x7fa3481565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 -- 172.21.15.181:0/1681763596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3481e57f0 con 0x7fa3480b24f0 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34cefa640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3480cf800 0x7fa3481565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:46.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34d6fb640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa34815dc30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa34400b410 tx=0x7fa34400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa33dffb640 1 -- 172.21.15.181:0/1681763596 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344015020 con 0x7fa3480b24f0 2024-09-12T02:29:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa33dffb640 1 -- 172.21.15.181:0/1681763596 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa344011850 con 0x7fa3480b24f0 2024-09-12T02:29:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa348155b00 con 0x7fa3480b24f0 2024-09-12T02:29:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.677+0000 7fa33dffb640 1 -- 172.21.15.181:0/1681763596 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344011c40 con 0x7fa3480b24f0 2024-09-12T02:29:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.678+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3481560c0 con 0x7fa3480b24f0 2024-09-12T02:29:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.678+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3480b1fb0 con 0x7fa3480b24f0 2024-09-12T02:29:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.679+0000 7fa33dffb640 1 -- 172.21.15.181:0/1681763596 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa344018020 con 0x7fa3480b24f0 2024-09-12T02:29:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.679+0000 7fa33dffb640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa32c06be30 0x7fa32c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.679+0000 7fa33dffb640 1 -- 172.21.15.181:0/1681763596 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5029+0+0 (secure 0 0 0) 0x7fa34408ab60 con 0x7fa3480b24f0 2024-09-12T02:29:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.679+0000 7fa34cefa640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa32c06be30 0x7fa32c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.680+0000 7fa34cefa640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa32c06be30 0x7fa32c06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa338006fd0 tx=0x7fa338008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.684+0000 7fa33dffb640 1 -- 172.21.15.181:0/1681763596 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa34401f020 con 0x7fa3480b24f0 2024-09-12T02:29:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.849+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa34815b850 con 0x7fa3480b24f0 2024-09-12T02:29:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.849+0000 7fa33dffb640 1 -- 172.21.15.181:0/1681763596 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13238 (secure 0 0 0) 0x7fa3440172c0 con 0x7fa3480b24f0 2024-09-12T02:29:46.850 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:46.851 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":36,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:45.552065+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6835/1355989745":"2024-09-13T02:29:42.537128+0000","172.21.15.181:6834/1355989745":"2024-09-13T02:29:42.537128+0000","172.21.15.204:6835/2347584783":"2024-09-13T02:29:21.976381+0000","172.21.15.204:6833/2347584783":"2024-09-13T02:29:21.976381+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.851+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa32c06be30 msgr2=0x7fa32c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.851+0000 7fa34f95f640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa32c06be30 0x7fa32c06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa338006fd0 tx=0x7fa338008040 comp rx=0 tx=0).stop 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.851+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 msgr2=0x7fa34815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa34815dc30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa34400b410 tx=0x7fa34400b8d0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 shutdown_connections 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa32c06be30 0x7fa32c06e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa3480cf800 0x7fa3481565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa34815c3f0 0x7fa3481425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 --2- 172.21.15.181:0/1681763596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480b24f0 0x7fa34815dc30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 >> 172.21.15.181:0/1681763596 conn(0x7fa34806bc10 msgr2=0x7fa34806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:46.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 shutdown_connections 2024-09-12T02:29:46.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.852+0000 7fa34f95f640 1 -- 172.21.15.181:0/1681763596 wait complete. 2024-09-12T02:29:46.864 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:28:11.641634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:29:46.864 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:29:46.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.965+0000 7fefab5ef640 1 Processor -- start 2024-09-12T02:29:46.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.965+0000 7fefab5ef640 1 -- start start 2024-09-12T02:29:46.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefab5ef640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefa415b2e0 0x7fefa40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefab5ef640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa415f9d0 con 0x7fefa40b4990 2024-09-12T02:29:46.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefab5ef640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa415fcb0 con 0x7fefa415f500 2024-09-12T02:29:46.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefab5ef640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fefa4073fe0 con 0x7fefa415b2e0 2024-09-12T02:29:46.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefa938b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefa415b2e0 0x7fefa40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefa938b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefa415b2e0 0x7fefa40ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58834/0 (socket says 172.21.15.181:58834) 2024-09-12T02:29:46.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefa938b640 1 -- 172.21.15.181:0/1583217554 learned_addr learned my addr 172.21.15.181:0/1583217554 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:46.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefa8b8a640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fefa40b4990 0x7fefa415edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36274/0 (socket says 172.21.15.181:36274) 2024-09-12T02:29:46.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefa938b640 1 -- 172.21.15.181:0/1583217554 >> v1:172.21.15.204:6789/0 conn(0x7fefa415f500 legacy=0x7fefa40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:46.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefa938b640 1 -- 172.21.15.181:0/1583217554 >> v1:172.21.15.181:6789/0 conn(0x7fefa40b4990 legacy=0x7fefa415edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.966+0000 7fefa938b640 1 -- 172.21.15.181:0/1583217554 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa40cdea0 con 0x7fefa415b2e0 2024-09-12T02:29:46.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.967+0000 7fefa938b640 1 --2- 172.21.15.181:0/1583217554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415b2e0 0x7fefa40ce980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fefa000bb10 tx=0x7fefa002ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe19d28aaa3cb35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.967+0000 7fef9bfff640 1 -- 172.21.15.181:0/1583217554 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0035070 con 0x7fefa415b2e0 2024-09-12T02:29:46.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.967+0000 7fef9bfff640 1 -- 172.21.15.181:0/1583217554 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa0031610 con 0x7fefa415b2e0 2024-09-12T02:29:46.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.967+0000 7fef9bfff640 1 -- 172.21.15.181:0/1583217554 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa00319e0 con 0x7fefa415b2e0 2024-09-12T02:29:46.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.968+0000 7fefab5ef640 1 -- 172.21.15.181:0/1583217554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415b2e0 msgr2=0x7fefa40ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.968+0000 7fefab5ef640 1 --2- 172.21.15.181:0/1583217554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415b2e0 0x7fefa40ce980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fefa000bb10 tx=0x7fefa002ca00 comp rx=0 tx=0).stop 2024-09-12T02:29:46.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.968+0000 7fefab5ef640 1 -- 172.21.15.181:0/1583217554 shutdown_connections 2024-09-12T02:29:46.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.968+0000 7fefab5ef640 1 --2- 172.21.15.181:0/1583217554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415b2e0 0x7fefa40ce980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.968+0000 7fefab5ef640 1 -- 172.21.15.181:0/1583217554 >> 172.21.15.181:0/1583217554 conn(0x7fefa406bc10 msgr2=0x7fefa406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:46.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.968+0000 7fefab5ef640 1 -- 172.21.15.181:0/1583217554 shutdown_connections 2024-09-12T02:29:46.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.968+0000 7fefab5ef640 1 -- 172.21.15.181:0/1583217554 wait complete. 2024-09-12T02:29:46.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.969+0000 7fefab5ef640 1 Processor -- start 2024-09-12T02:29:46.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.969+0000 7fefab5ef640 1 -- start start 2024-09-12T02:29:46.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefab5ef640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefa40b4990 0x7fefa414cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefab5ef640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefa415b2e0 0x7fefa414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefab5ef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415f500 0x7fefa414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefab5ef640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fefa415b6c0 con 0x7fefa415f500 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefab5ef640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fefa40ce4f0 con 0x7fefa415b2e0 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefab5ef640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fefa40b4dd0 con 0x7fefa40b4990 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415f500 0x7fefa414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415f500 0x7fefa414ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58850/0 (socket says 172.21.15.181:58850) 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 -- 172.21.15.181:0/2565286302 learned_addr learned my addr 172.21.15.181:0/2565286302 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 -- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefa40b4990 msgr2=0x7fefa414cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefa40b4990 0x7fefa414cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 -- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefa415b2e0 msgr2=0x7fefa414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa8b8a640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefa415b2e0 0x7fefa414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefa415b2e0 0x7fefa414f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:46.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 -- 172.21.15.181:0/2565286302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa415c8d0 con 0x7fefa415f500 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa8b8a640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefa415b2e0 0x7fefa414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.970+0000 7fefa9b8c640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415f500 0x7fefa414ff30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00b9e0 tx=0x7fef9c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.971+0000 7fef99ffb640 1 -- 172.21.15.181:0/2565286302 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c003b70 con 0x7fefa415f500 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.971+0000 7fef99ffb640 1 -- 172.21.15.181:0/2565286302 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9c003d10 con 0x7fefa415f500 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.971+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa415cbb0 con 0x7fefa415f500 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.971+0000 7fef99ffb640 1 -- 172.21.15.181:0/2565286302 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00cb60 con 0x7fefa415f500 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.971+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa415d450 con 0x7fefa415f500 2024-09-12T02:29:46.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.972+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa4069170 con 0x7fefa415f500 2024-09-12T02:29:46.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.972+0000 7fef99ffb640 1 -- 172.21.15.181:0/2565286302 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef9c00cd00 con 0x7fefa415f500 2024-09-12T02:29:46.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.973+0000 7fef99ffb640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef8806be30 0x7fef8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.973+0000 7fefa938b640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef8806be30 0x7fef8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.973+0000 7fef99ffb640 1 -- 172.21.15.181:0/2565286302 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5029+0+0 (secure 0 0 0) 0x7fef9c08aa10 con 0x7fefa415f500 2024-09-12T02:29:46.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.973+0000 7fefa938b640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef8806be30 0x7fef8806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefa0037000 tx=0x7fefa0031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:46.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:46.977+0000 7fef99ffb640 1 -- 172.21.15.181:0/2565286302 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef9c059660 con 0x7fefa415f500 2024-09-12T02:29:47.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.141+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fefa415cd80 con 0x7fefa415f500 2024-09-12T02:29:47.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.141+0000 7fef99ffb640 1 -- 172.21.15.181:0/2565286302 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fef9c058f60 con 0x7fefa415f500 2024-09-12T02:29:47.142 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 1 2024-09-12T02:29:47.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef8806be30 msgr2=0x7fef8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef8806be30 0x7fef8806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefa0037000 tx=0x7fefa0031000 comp rx=0 tx=0).stop 2024-09-12T02:29:47.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415f500 msgr2=0x7fefa414ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415f500 0x7fefa414ff30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00b9e0 tx=0x7fef9c00bea0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 shutdown_connections 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef8806be30 0x7fef8806e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefa415b2e0 0x7fefa414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefa415f500 0x7fefa414ff30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 --2- 172.21.15.181:0/2565286302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefa40b4990 0x7fefa414cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 >> 172.21.15.181:0/2565286302 conn(0x7fefa406bc10 msgr2=0x7fefa40b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 shutdown_connections 2024-09-12T02:29:47.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.143+0000 7fefab5ef640 1 -- 172.21.15.181:0/2565286302 wait complete. 2024-09-12T02:29:47.155 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2024-09-12T02:29:47.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.253+0000 7f53f3a42640 1 Processor -- start 2024-09-12T02:29:47.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.253+0000 7f53f3a42640 1 -- start start 2024-09-12T02:29:47.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53f3a42640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f53ec0d27b0 0x7f53ec0b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53f3a42640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ec0b59b0 con 0x7f53ec15d2e0 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53f3a42640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ec0b5c90 con 0x7f53ec070660 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53f3a42640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f53ec15e0c0 con 0x7f53ec0d27b0 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53f0fdd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f53ec15d2e0 0x7f53ec15d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36282/0 (socket says 172.21.15.181:36282) 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53f0fdd640 1 -- 172.21.15.181:0/1024059764 learned_addr learned my addr 172.21.15.181:0/1024059764 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53f17de640 1 --2- 172.21.15.181:0/1024059764 >> v2:172.21.15.204:3300/0 conn(0x7f53ec0d27b0 0x7f53ec0b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835014797 0 0) 0x7f53ec0b59b0 con 0x7f53ec15d2e0 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.254+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d4003520 con 0x7f53ec15d2e0 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1433307070 0 0) 0x7f53d4003520 con 0x7f53ec15d2e0 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 >> v2:172.21.15.204:3300/0 conn(0x7f53ec0d27b0 msgr2=0x7f53ec0b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 --2- 172.21.15.181:0/1024059764 >> v2:172.21.15.204:3300/0 conn(0x7f53ec0d27b0 0x7f53ec0b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 >> v1:172.21.15.204:6789/0 conn(0x7f53ec070660 legacy=0x7f53ec070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec0b5f70 con 0x7f53ec15d2e0 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f53e0001670 con 0x7f53ec15d2e0 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 >> v1:172.21.15.181:6789/0 conn(0x7f53ec15d2e0 legacy=0x7f53ec15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53d4004800 0x7f53d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53d40051c0 0x7f53d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec15e0c0 con 0x7f53d40039b0 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f53d400c060 con 0x7f53d4004800 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f53d400c260 con 0x7f53d40051c0 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f17de640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f0fdd640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53d4004800 0x7f53d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f1fdf640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53d40051c0 0x7f53d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f17de640 1 -- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53d40051c0 msgr2=0x7f53d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:47.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f17de640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53d40051c0 0x7f53d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f17de640 1 -- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53d4004800 msgr2=0x7f53d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f17de640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53d4004800 0x7f53d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f17de640 1 -- 172.21.15.181:0/1024059764 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d4003520 con 0x7f53d40039b0 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f1fdf640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53d40051c0 0x7f53d400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.255+0000 7f53f1fdf640 1 -- 172.21.15.181:0/1024059764 reap_dead start 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.256+0000 7f53f17de640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53d4003dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009fc0 tx=0x7f53d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4020d9c9d8f2591f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.256+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc009c10 con 0x7f53d40039b0 2024-09-12T02:29:47.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.256+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc036070 con 0x7f53d40039b0 2024-09-12T02:29:47.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.256+0000 7f53ebfff640 1 -- 172.21.15.181:0/1024059764 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc031880 con 0x7f53d40039b0 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.256+0000 7f53f3a42640 1 -- 172.21.15.181:0/1024059764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 msgr2=0x7f53d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.256+0000 7f53f3a42640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53d4003dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009fc0 tx=0x7f53d4005830 comp rx=0 tx=0).stop 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.257+0000 7f53f3a42640 1 -- 172.21.15.181:0/1024059764 shutdown_connections 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.257+0000 7f53f3a42640 1 --2- 172.21.15.181:0/1024059764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53d4003dd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.257+0000 7f53f3a42640 1 -- 172.21.15.181:0/1024059764 >> 172.21.15.181:0/1024059764 conn(0x7f53ec06f400 msgr2=0x7f53ec06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.257+0000 7f53f3a42640 1 -- 172.21.15.181:0/1024059764 shutdown_connections 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.257+0000 7f53f3a42640 1 -- 172.21.15.181:0/1024059764 wait complete. 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.258+0000 7f53f3a42640 1 Processor -- start 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.258+0000 7f53f3a42640 1 -- start start 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f3a42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53ec0cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f3a42640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53ec14b210 0x7f53ec0ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f3a42640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53ec0cc1b0 0x7f53ec157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f3a42640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec0b6530 con 0x7f53d40039b0 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f3a42640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec15d750 con 0x7f53ec14b210 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f3a42640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f53ec0d2b90 con 0x7f53ec0cc1b0 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53ec0cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53ec0cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58860/0 (socket says 172.21.15.181:58860) 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 -- 172.21.15.181:0/790567043 learned_addr learned my addr 172.21.15.181:0/790567043 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f0fdd640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53ec14b210 0x7f53ec0ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f1fdf640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53ec0cc1b0 0x7f53ec157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 -- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53ec0cc1b0 msgr2=0x7f53ec157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53ec0cc1b0 0x7f53ec157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 -- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53ec14b210 msgr2=0x7f53ec0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53ec14b210 0x7f53ec0ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 -- 172.21.15.181:0/790567043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec0cad30 con 0x7f53d40039b0 2024-09-12T02:29:47.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f17de640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53ec0cdc30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53dc033040 tx=0x7f53dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53e9ffb640 1 -- 172.21.15.181:0/790567043 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc009c10 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53e9ffb640 1 -- 172.21.15.181:0/790567043 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc003990 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53e9ffb640 1 -- 172.21.15.181:0/790567043 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc003d80 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.259+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec0ccb90 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.260+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec0cd150 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.261+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ec0b5320 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.261+0000 7f53e9ffb640 1 -- 172.21.15.181:0/790567043 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53dc005d10 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.262+0000 7f53e9ffb640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f53d806be30 0x7f53d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.262+0000 7f53e9ffb640 1 -- 172.21.15.181:0/790567043 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5029+0+0 (secure 0 0 0) 0x7f53dc0abd00 con 0x7f53d40039b0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.262+0000 7f53f0fdd640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f53d806be30 0x7f53d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.262+0000 7f53f0fdd640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f53d806be30 0x7f53d806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0ca190 tx=0x7f53e0000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.266+0000 7f53e9ffb640 1 -- 172.21.15.181:0/790567043 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53dc07a9e0 con 0x7f53d40039b0 2024-09-12T02:29:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.492+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) -- 0x7f53ec0d1490 con 0x7f53d40039b0 2024-09-12T02:29:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.560+0000 7f53e9ffb640 1 -- 172.21.15.181:0/790567043 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v95) ==== 151+0+0 (secure 0 0 0) 0x7f53dc07a2e0 con 0x7f53d40039b0 2024-09-12T02:29:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f53d806be30 msgr2=0x7f53d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f53d806be30 0x7f53d806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0ca190 tx=0x7f53e0000ed0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 msgr2=0x7f53ec0cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53ec0cdc30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53dc033040 tx=0x7f53dc009750 comp rx=0 tx=0).stop 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 shutdown_connections 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f53d806be30 0x7f53d806e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f53ec14b210 0x7f53ec0ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f53ec0cc1b0 0x7f53ec157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 --2- 172.21.15.181:0/790567043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53d40039b0 0x7f53ec0cdc30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 >> 172.21.15.181:0/790567043 conn(0x7f53ec06f400 msgr2=0x7f53ec15f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 shutdown_connections 2024-09-12T02:29:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.562+0000 7f53f3a42640 1 -- 172.21.15.181:0/790567043 wait complete. 2024-09-12T02:29:47.574 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:29:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.676+0000 7f217f847640 1 Processor -- start 2024-09-12T02:29:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.676+0000 7f217f847640 1 -- start start 2024-09-12T02:29:47.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217f847640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f21780d2190 0x7f21780b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217f847640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217f847640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217815ec10 con 0x7f217815e830 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217f847640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2178071b10 con 0x7f21780d2190 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217f847640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f21780cc500 con 0x7f21780b54e0 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217d5e3640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f217815e830 0x7f21780d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36294/0 (socket says 172.21.15.181:36294) 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217d5e3640 1 -- 172.21.15.181:0/1756381294 learned_addr learned my addr 172.21.15.181:0/1756381294 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217cde2640 1 --2- 172.21.15.181:0/1756381294 >> v2:172.21.15.204:3300/0 conn(0x7f21780d2190 0x7f21780b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.677+0000 7f217dde4640 1 --2- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.678+0000 7f216ffff640 1 -- 172.21.15.181:0/1756381294 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4060546175 0 0) 0x7f217815ec10 con 0x7f217815e830 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.678+0000 7f216ffff640 1 -- 172.21.15.181:0/1756381294 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2164003520 con 0x7f217815e830 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.678+0000 7f217cde2640 1 -- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 msgr2=0x7f2178073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.678+0000 7f217cde2640 1 --2- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178073440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.678+0000 7f217cde2640 1 -- 172.21.15.181:0/1756381294 >> v1:172.21.15.181:6789/0 conn(0x7f217815e830 legacy=0x7f21780d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.678+0000 7f216ffff640 1 -- 172.21.15.181:0/1756381294 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 978257536 0 0) 0x7f2164003520 con 0x7f217815e830 2024-09-12T02:29:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.678+0000 7f217cde2640 1 -- 172.21.15.181:0/1756381294 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21780cc7e0 con 0x7f21780d2190 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f217cde2640 1 --2- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 0x7f21780b1ad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f21680097a0 tx=0x7f216802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14cbae49bd109660 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f216ffff640 1 -- 172.21.15.181:0/1756381294 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168037070 con 0x7f21780d2190 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f216ffff640 1 -- 172.21.15.181:0/1756381294 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216802ab10 con 0x7f21780d2190 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f216ffff640 1 -- 172.21.15.181:0/1756381294 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174001670 con 0x7f21780d2190 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f217f847640 1 -- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 msgr2=0x7f21780b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f217f847640 1 --2- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 0x7f21780b1ad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f21680097a0 tx=0x7f216802a080 comp rx=0 tx=0).stop 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f217f847640 1 -- 172.21.15.181:0/1756381294 shutdown_connections 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f217f847640 1 --2- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f217f847640 1 --2- 172.21.15.181:0/1756381294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 0x7f21780b1ad0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.679+0000 7f217f847640 1 -- 172.21.15.181:0/1756381294 >> 172.21.15.181:0/1756381294 conn(0x7f21780d2570 msgr2=0x7f21780d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.680+0000 7f217f847640 1 -- 172.21.15.181:0/1756381294 shutdown_connections 2024-09-12T02:29:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.680+0000 7f217f847640 1 -- 172.21.15.181:0/1756381294 wait complete. 2024-09-12T02:29:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 Processor -- start 2024-09-12T02:29:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 -- start start 2024-09-12T02:29:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 0x7f217814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f217815e830 0x7f21781f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f21780cc1b0 con 0x7f217815e830 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f21780717a0 con 0x7f21780d2190 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.681+0000 7f217f847640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f21780d1b20 con 0x7f21780b54e0 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f217815e830 0x7f21781f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f217815e830 0x7f21781f11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58870/0 (socket says 172.21.15.181:58870) 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 -- 172.21.15.181:0/512262553 learned_addr learned my addr 172.21.15.181:0/512262553 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217cde2640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 0x7f217814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217d5e3640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 -- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 msgr2=0x7f2178152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 -- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 msgr2=0x7f217814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 0x7f217814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 -- 172.21.15.181:0/512262553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21781533f0 con 0x7f217815e830 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217dde4640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f217815e830 0x7f21781f11f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f217000efc0 tx=0x7f217000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f216dffb640 1 -- 172.21.15.181:0/512262553 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170018020 con 0x7f217815e830 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f216dffb640 1 -- 172.21.15.181:0/512262553 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2170014480 con 0x7f217815e830 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21781f4e00 con 0x7f217815e830 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f216dffb640 1 -- 172.21.15.181:0/512262553 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170014870 con 0x7f217815e830 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.682+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21781523d0 con 0x7f217815e830 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.683+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21780b1ad0 con 0x7f217815e830 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.684+0000 7f216dffb640 1 -- 172.21.15.181:0/512262553 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2170005d10 con 0x7f217815e830 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.684+0000 7f216dffb640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.684+0000 7f216dffb640 1 -- 172.21.15.181:0/512262553 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5029+0+0 (secure 0 0 0) 0x7f217008b980 con 0x7f217815e830 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.684+0000 7f217d5e3640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.685+0000 7f217d5e3640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f215c06be30 0x7f215c06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2174005880 tx=0x7f2174009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.688+0000 7f216dffb640 1 -- 172.21.15.181:0/512262553 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2170022030 con 0x7f217815e830 2024-09-12T02:29:47.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.852+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f217806da50 con 0x7f217815e830 2024-09-12T02:29:47.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.858+0000 7f216dffb640 1 -- 172.21.15.181:0/512262553 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f2170010040 con 0x7f217815e830 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f215c06be30 msgr2=0x7f215c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f215c06be30 0x7f215c06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2174005880 tx=0x7f2174009040 comp rx=0 tx=0).stop 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f217815e830 msgr2=0x7f21781f11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f217815e830 0x7f21781f11f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f217000efc0 tx=0x7f217000c490 comp rx=0 tx=0).stop 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 shutdown_connections 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21780d2190 0x7f217814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f217815e830 0x7f21781f11f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 --2- 172.21.15.181:0/512262553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21780b54e0 0x7f2178152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 >> 172.21.15.181:0/512262553 conn(0x7f21780d2570 msgr2=0x7f21780cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 shutdown_connections 2024-09-12T02:29:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:47.860+0000 7f217f847640 1 -- 172.21.15.181:0/512262553 wait complete. 2024-09-12T02:29:47.872 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:29:47.872 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:29:47.916 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:29:47.975 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:29:47.976 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:47.976 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:47.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:29:47.992 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:29:47.992 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:48.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:29:48.010 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:29:48.010 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:48.047 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:29:48.047 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:29:48.048 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:29:48.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:29:48.069 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:29:48.069 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:48.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.184+0000 7fbbe7c82640 1 Processor -- start 2024-09-12T02:29:48.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.184+0000 7fbbe7c82640 1 -- start start 2024-09-12T02:29:48.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.185+0000 7fbbe7c82640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbbe015e670 0x7fbbe0070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.185+0000 7fbbe7c82640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe00731d0 con 0x7fbbe00cef50 2024-09-12T02:29:48.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.185+0000 7fbbe7c82640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe00734b0 con 0x7fbbe00ceaf0 2024-09-12T02:29:48.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.185+0000 7fbbe7c82640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe00d0040 con 0x7fbbe015e670 2024-09-12T02:29:48.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.185+0000 7fbbe621f640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbbe00cef50 0x7fbbe015f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36298/0 (socket says 172.21.15.181:36298) 2024-09-12T02:29:48.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.185+0000 7fbbe621f640 1 -- 172.21.15.181:0/1837284281 learned_addr learned my addr 172.21.15.181:0/1837284281 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:48.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570528856 0 0) 0x7fbbe00731d0 con 0x7fbbe00cef50 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbcc003520 con 0x7fbbe00cef50 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe5a1e640 1 --2- 172.21.15.181:0/1837284281 >> v2:172.21.15.204:3300/0 conn(0x7fbbe015e670 0x7fbbe0070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675256530 0 0) 0x7fbbcc003520 con 0x7fbbe00cef50 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 >> v2:172.21.15.204:3300/0 conn(0x7fbbe015e670 msgr2=0x7fbbe0070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 --2- 172.21.15.181:0/1837284281 >> v2:172.21.15.204:3300/0 conn(0x7fbbe015e670 0x7fbbe0070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 >> v1:172.21.15.204:6789/0 conn(0x7fbbe00ceaf0 legacy=0x7fbbe015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe0073790 con 0x7fbbe00cef50 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fbbd80019f0 con 0x7fbbe00cef50 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe5a1e640 1 --2- 172.21.15.181:0/1837284281 >> v2:172.21.15.204:3300/0 conn(0x7fbbe015e670 0x7fbbe0070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 >> v1:172.21.15.181:6789/0 conn(0x7fbbe00cef50 legacy=0x7fbbe015f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbcc0039b0 0x7fbbcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbcc004800 0x7fbbcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc00c0c0 con 0x7fbbcc0051c0 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc00c270 con 0x7fbbcc0039b0 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc00c470 con 0x7fbbcc004800 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe5a1e640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbcc0039b0 0x7fbbcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe621f640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe521d640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbcc004800 0x7fbbcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe621f640 1 -- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbcc004800 msgr2=0x7fbbcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe621f640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbcc004800 0x7fbbcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe621f640 1 -- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbcc0039b0 msgr2=0x7fbbcc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:48.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe621f640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbcc0039b0 0x7fbbcc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.186+0000 7fbbe621f640 1 -- 172.21.15.181:0/1837284281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc003520 con 0x7fbbcc0051c0 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.187+0000 7fbbe621f640 1 -- 172.21.15.181:0/1837284281 reap_dead start 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.187+0000 7fbbe621f640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbcc00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800a860 tx=0x7fbbcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6690f31fd251170e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.187+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800a480 con 0x7fbbcc0051c0 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.187+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd802f070 con 0x7fbbcc0051c0 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.187+0000 7fbbe4a1c640 1 -- 172.21.15.181:0/1837284281 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd802bcc0 con 0x7fbbcc0051c0 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.188+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1837284281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 msgr2=0x7fbbcc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.188+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbcc00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800a860 tx=0x7fbbcc005830 comp rx=0 tx=0).stop 2024-09-12T02:29:48.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.188+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1837284281 shutdown_connections 2024-09-12T02:29:48.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.188+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1837284281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbcc00b9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.188+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1837284281 >> 172.21.15.181:0/1837284281 conn(0x7fbbe006f400 msgr2=0x7fbbe006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:48.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.188+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1837284281 shutdown_connections 2024-09-12T02:29:48.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.188+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1837284281 wait complete. 2024-09-12T02:29:48.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.189+0000 7fbbe7c82640 1 Processor -- start 2024-09-12T02:29:48.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.189+0000 7fbbe7c82640 1 -- start start 2024-09-12T02:29:48.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe7c82640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbe0151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe7c82640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbe01f4c00 0x7fbbe01f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe7c82640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbe01f84c0 0x7fbbe0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe7c82640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe0073de0 con 0x7fbbcc0051c0 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe7c82640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe0072f80 con 0x7fbbe01f84c0 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe7c82640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe00cf380 con 0x7fbbe01f4c00 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbe0151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbe0151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58886/0 (socket says 172.21.15.181:58886) 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 -- 172.21.15.181:0/1283474361 learned_addr learned my addr 172.21.15.181:0/1283474361 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe521d640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbe01f4c00 0x7fbbe01f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe621f640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbe01f84c0 0x7fbbe0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 -- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbe01f4c00 msgr2=0x7fbbe01f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbe01f4c00 0x7fbbe01f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 -- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbe01f84c0 msgr2=0x7fbbe0160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbe01f84c0 0x7fbbe0160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 -- 172.21.15.181:0/1283474361 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe0153810 con 0x7fbbcc0051c0 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe621f640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbe01f84c0 0x7fbbe0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbe5a1e640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbe0151d80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0115c0 tx=0x7fbbdc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.190+0000 7fbbd67fc640 1 -- 172.21.15.181:0/1283474361 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc019070 con 0x7fbbcc0051c0 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.191+0000 7fbbd67fc640 1 -- 172.21.15.181:0/1283474361 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc004220 con 0x7fbbcc0051c0 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.191+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe0153af0 con 0x7fbbcc0051c0 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.191+0000 7fbbd67fc640 1 -- 172.21.15.181:0/1283474361 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00f040 con 0x7fbbcc0051c0 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.191+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe01f7780 con 0x7fbbcc0051c0 2024-09-12T02:29:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.191+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe0071410 con 0x7fbbcc0051c0 2024-09-12T02:29:48.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.192+0000 7fbbd67fc640 1 -- 172.21.15.181:0/1283474361 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbdc015670 con 0x7fbbcc0051c0 2024-09-12T02:29:48.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.192+0000 7fbbd67fc640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbbc406be60 0x7fbbc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.192+0000 7fbbd67fc640 1 -- 172.21.15.181:0/1283474361 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5029+0+0 (secure 0 0 0) 0x7fbbdc08ad50 con 0x7fbbcc0051c0 2024-09-12T02:29:48.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.193+0000 7fbbe521d640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbbc406be60 0x7fbbc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.193+0000 7fbbe521d640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbbc406be60 0x7fbbc406e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0153080 tx=0x7fbbd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.197+0000 7fbbd67fc640 1 -- 172.21.15.181:0/1283474361 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbdc08e030 con 0x7fbbcc0051c0 2024-09-12T02:29:48.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.396+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbe006dbe0 con 0x7fbbcc0051c0 2024-09-12T02:29:48.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.396+0000 7fbbd67fc640 1 -- 172.21.15.181:0/1283474361 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+3923 (secure 0 0 0) 0x7fbbdc0599a0 con 0x7fbbcc0051c0 2024-09-12T02:29:48.397 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:48.397 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":23,"btime":"2024-09-12T02:29:43:540581+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2605762628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2605762628},{"type":"v1","addr":"172.21.15.181:6837","nonce":2605762628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4079381337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":4079381337},{"type":"v1","addr":"172.21.15.204:6834","nonce":4079381337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/4020840549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4020840549},{"type":"v1","addr":"172.21.15.204:6835","nonce":4020840549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3156957286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3156957286},{"type":"v1","addr":"172.21.15.181:6835","nonce":3156957286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[]} 2024-09-12T02:29:48.397 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 23 2024-09-12T02:29:48.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbbc406be60 msgr2=0x7fbbc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbbc406be60 0x7fbbc406e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0153080 tx=0x7fbbd0009040 comp rx=0 tx=0).stop 2024-09-12T02:29:48.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 msgr2=0x7fbbe0151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbe0151d80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0115c0 tx=0x7fbbdc011a80 comp rx=0 tx=0).stop 2024-09-12T02:29:48.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 shutdown_connections 2024-09-12T02:29:48.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbbc406be60 0x7fbbc406e320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbbe01f84c0 0x7fbbe0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbbe01f4c00 0x7fbbe01f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 --2- 172.21.15.181:0/1283474361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbcc0051c0 0x7fbbe0151d80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 >> 172.21.15.181:0/1283474361 conn(0x7fbbe006f400 msgr2=0x7fbbe006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:48.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 shutdown_connections 2024-09-12T02:29:48.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.398+0000 7fbbe7c82640 1 -- 172.21.15.181:0/1283474361 wait complete. 2024-09-12T02:29:48.410 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:29:48.410 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:29:48.410 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:29:48.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:29:48.410 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:29:48.410 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:29:48.411 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:29:48.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:29:48.411 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:29:48.411 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:29:48.411 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:29:48.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:29:48.411 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:29:48.412 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:29:48.412 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:29:48.412 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:29:48.419 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:29:48.420 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:29:48.421 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:29:48.421 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:29:48.424 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:29:48.424 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:29:48.425 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:29:48.425 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:29:48.462 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:29:48.462 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:48.463 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:29:48.463 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:48.467 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:29:48.467 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:48.468 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:29:48.468 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:48.468 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:29:48.537 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:29:48.538 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:29:48.550 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:29:48.551 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:29:48.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.573+0000 7f0e1d9cf640 1 Processor -- start 2024-09-12T02:29:48.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.573+0000 7f0e1d9cf640 1 -- start start 2024-09-12T02:29:48.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e1d9cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e1815c1f0 0x7f0e181607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e1d9cf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0e18071d60 0x7f0e180b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e1d9cf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e18160d30 con 0x7f0e180b5690 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e1d9cf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f0e180b0ae0 con 0x7f0e18071d60 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e1d9cf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0e18072ea0 con 0x7f0e1815c1f0 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e177fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0e180b5690 0x7f0e180d1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36330/0 (socket says 172.21.15.181:36330) 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e177fe640 1 -- 172.21.15.181:0/2370778611 learned_addr learned my addr 172.21.15.181:0/2370778611 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e167fc640 1 --2- 172.21.15.181:0/2370778611 >> v2:172.21.15.204:3300/0 conn(0x7f0e18071d60 0x7f0e180b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e16ffd640 1 --2- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e1815c1f0 0x7f0e181607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e167fc640 1 -- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e1815c1f0 msgr2=0x7f0e181607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e167fc640 1 --2- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e1815c1f0 0x7f0e181607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e167fc640 1 -- 172.21.15.181:0/2370778611 >> v1:172.21.15.181:6789/0 conn(0x7f0e180b5690 legacy=0x7f0e180d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e167fc640 1 -- 172.21.15.181:0/2370778611 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e18072290 con 0x7f0e18071d60 2024-09-12T02:29:48.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.574+0000 7f0e16ffd640 1 --2- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e1815c1f0 0x7f0e181607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:48.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.575+0000 7f0e167fc640 1 --2- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e18071d60 0x7f0e180b5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0097a0 tx=0x7f0e0c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b806fe18c620fba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.575+0000 7f0e15ffb640 1 -- 172.21.15.181:0/2370778611 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c037070 con 0x7f0e18071d60 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.575+0000 7f0e15ffb640 1 -- 172.21.15.181:0/2370778611 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c032440 con 0x7f0e18071d60 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.575+0000 7f0e15ffb640 1 -- 172.21.15.181:0/2370778611 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c032810 con 0x7f0e18071d60 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e18071d60 msgr2=0x7f0e180b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e18071d60 0x7f0e180b5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0097a0 tx=0x7f0e0c02a180 comp rx=0 tx=0).stop 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/2370778611 shutdown_connections 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e18071d60 0x7f0e180b5150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/2370778611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e1815c1f0 0x7f0e181607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/2370778611 >> 172.21.15.181:0/2370778611 conn(0x7f0e1806d110 msgr2=0x7f0e1806d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/2370778611 shutdown_connections 2024-09-12T02:29:48.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.576+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/2370778611 wait complete. 2024-09-12T02:29:48.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.577+0000 7f0e1d9cf640 1 Processor -- start 2024-09-12T02:29:48.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.578+0000 7f0e1d9cf640 1 -- start start 2024-09-12T02:29:48.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.578+0000 7f0e1d9cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e18071d60 0x7f0e18152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e1d9cf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e180b5690 0x7f0e181545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e1d9cf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e1815c1f0 0x7f0e180b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e1d9cf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18072b30 con 0x7f0e1815c1f0 2024-09-12T02:29:48.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e1d9cf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18072850 con 0x7f0e180b5690 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e1d9cf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1815c5d0 con 0x7f0e18071d60 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e177fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e1815c1f0 0x7f0e180b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e167fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e180b5690 0x7f0e181545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e16ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e18071d60 0x7f0e18152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e167fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e180b5690 0x7f0e181545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:44810/0 (socket says 172.21.15.181:44810) 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e167fc640 1 -- 172.21.15.181:0/1372830109 learned_addr learned my addr 172.21.15.181:0/1372830109 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e177fe640 1 -- 172.21.15.181:0/1372830109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e18071d60 msgr2=0x7f0e18152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e177fe640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e18071d60 0x7f0e18152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e177fe640 1 -- 172.21.15.181:0/1372830109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e180b5690 msgr2=0x7f0e181545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e177fe640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e180b5690 0x7f0e181545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e177fe640 1 -- 172.21.15.181:0/1372830109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e180b1880 con 0x7f0e1815c1f0 2024-09-12T02:29:48.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.579+0000 7f0e177fe640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e1815c1f0 0x7f0e180b5e40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000caa0 tx=0x7f0e1000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.581+0000 7f0dfffff640 1 -- 172.21.15.181:0/1372830109 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10017070 con 0x7f0e1815c1f0 2024-09-12T02:29:48.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.581+0000 7f0dfffff640 1 -- 172.21.15.181:0/1372830109 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1000ac00 con 0x7f0e1815c1f0 2024-09-12T02:29:48.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.581+0000 7f0dfffff640 1 -- 172.21.15.181:0/1372830109 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10012400 con 0x7f0e1815c1f0 2024-09-12T02:29:48.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.581+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e180b1b60 con 0x7f0e1815c1f0 2024-09-12T02:29:48.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.581+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e180b6380 con 0x7f0e1815c1f0 2024-09-12T02:29:48.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.582+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e180b5150 con 0x7f0e1815c1f0 2024-09-12T02:29:48.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.583+0000 7f0dfffff640 1 -- 172.21.15.181:0/1372830109 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e1001a070 con 0x7f0e1815c1f0 2024-09-12T02:29:48.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.583+0000 7f0dfffff640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.583+0000 7f0e16ffd640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.584+0000 7f0e16ffd640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0e0406be30 0x7f0e0406e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009560 tx=0x7f0e08009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.586+0000 7f0dfffff640 1 -- 172.21.15.181:0/1372830109 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5029+0+0 (secure 0 0 0) 0x7f0e10088fc0 con 0x7f0e1815c1f0 2024-09-12T02:29:48.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.590+0000 7f0dfffff640 1 -- 172.21.15.181:0/1372830109 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e18160d30 con 0x7f0e1815c1f0 2024-09-12T02:29:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:48.767+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0e1806c4b0 con 0x7f0e1815c1f0 2024-09-12T02:29:49.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.583+0000 7f0dfffff640 1 -- 172.21.15.181:0/1372830109 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) ==== 97+0+0 (secure 0 0 0) 0x7f0e10058d70 con 0x7f0e1815c1f0 2024-09-12T02:29:49.584 INFO:teuthology.orchestra.run.smithi181.stderr: removed all blocklist entries 2024-09-12T02:29:49.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0e0406be30 msgr2=0x7f0e0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0e0406be30 0x7f0e0406e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009560 tx=0x7f0e08009190 comp rx=0 tx=0).stop 2024-09-12T02:29:49.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e1815c1f0 msgr2=0x7f0e180b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e1815c1f0 0x7f0e180b5e40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000caa0 tx=0x7f0e1000cf60 comp rx=0 tx=0).stop 2024-09-12T02:29:49.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 shutdown_connections 2024-09-12T02:29:49.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e180b5690 0x7f0e181545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e1815c1f0 0x7f0e180b5e40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 --2- 172.21.15.181:0/1372830109 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e18071d60 0x7f0e18152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 >> 172.21.15.181:0/1372830109 conn(0x7f0e1806d110 msgr2=0x7f0e1815ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:49.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 shutdown_connections 2024-09-12T02:29:49.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.586+0000 7f0e1d9cf640 1 -- 172.21.15.181:0/1372830109 wait complete. 2024-09-12T02:29:49.600 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:29:49.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.703+0000 7fd899bbd640 1 Processor -- start 2024-09-12T02:29:49.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.703+0000 7fd899bbd640 1 -- start start 2024-09-12T02:29:49.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd899bbd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd89415b1e0 0x7fd8940b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd899bbd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8940b41d0 0x7fd8940b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd899bbd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd8940cdfc0 0x7fd8940b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd899bbd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd8940ce480 con 0x7fd89415b1e0 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd899bbd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd8940ce760 con 0x7fd8940cdfc0 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd899bbd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8940cea40 con 0x7fd8940b41d0 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd8937fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd89415b1e0 0x7fd8940b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd8937fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd89415b1e0 0x7fd8940b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48168/0 (socket says 172.21.15.181:48168) 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd8937fe640 1 -- 172.21.15.181:0/889693789 learned_addr learned my addr 172.21.15.181:0/889693789 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd893fff640 1 --2- 172.21.15.181:0/889693789 >> v2:172.21.15.204:3300/0 conn(0x7fd8940cdfc0 0x7fd8940b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd8937fe640 1 -- 172.21.15.181:0/889693789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8940b41d0 msgr2=0x7fd8940b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd892ffd640 1 --2- 172.21.15.181:0/889693789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8940b41d0 0x7fd8940b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.704+0000 7fd8937fe640 1 --2- 172.21.15.181:0/889693789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8940b41d0 0x7fd8940b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd8937fe640 1 -- 172.21.15.181:0/889693789 >> v2:172.21.15.204:3300/0 conn(0x7fd8940cdfc0 msgr2=0x7fd8940b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd8937fe640 1 --2- 172.21.15.181:0/889693789 >> v2:172.21.15.204:3300/0 conn(0x7fd8940cdfc0 0x7fd8940b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd8937fe640 1 -- 172.21.15.181:0/889693789 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8940ced20 con 0x7fd89415b1e0 2024-09-12T02:29:49.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd893fff640 1 --2- 172.21.15.181:0/889693789 >> v2:172.21.15.204:3300/0 conn(0x7fd8940cdfc0 0x7fd8940b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd8937fe640 1 --2- 172.21.15.181:0/889693789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd89415b1e0 0x7fd8940b3c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd89415ecd0 tx=0x7fd88402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5177587f9efebf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd8927fc640 1 -- 172.21.15.181:0/889693789 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884037070 con 0x7fd89415b1e0 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd8927fc640 1 -- 172.21.15.181:0/889693789 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd884032440 con 0x7fd89415b1e0 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.705+0000 7fd8927fc640 1 -- 172.21.15.181:0/889693789 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884032810 con 0x7fd89415b1e0 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 -- 172.21.15.181:0/889693789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd89415b1e0 msgr2=0x7fd8940b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 --2- 172.21.15.181:0/889693789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd89415b1e0 0x7fd8940b3c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd89415ecd0 tx=0x7fd88402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 -- 172.21.15.181:0/889693789 shutdown_connections 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 --2- 172.21.15.181:0/889693789 >> v2:172.21.15.204:3300/0 conn(0x7fd8940cdfc0 0x7fd8940b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 --2- 172.21.15.181:0/889693789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8940b41d0 0x7fd8940b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 --2- 172.21.15.181:0/889693789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd89415b1e0 0x7fd8940b3c90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 -- 172.21.15.181:0/889693789 >> 172.21.15.181:0/889693789 conn(0x7fd89406bc10 msgr2=0x7fd89406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:49.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 -- 172.21.15.181:0/889693789 shutdown_connections 2024-09-12T02:29:49.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.706+0000 7fd899bbd640 1 -- 172.21.15.181:0/889693789 wait complete. 2024-09-12T02:29:49.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.707+0000 7fd899bbd640 1 Processor -- start 2024-09-12T02:29:49.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.707+0000 7fd899bbd640 1 -- start start 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd899bbd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8940b41d0 0x7fd89414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd899bbd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8940cdfc0 0x7fd89415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd899bbd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89415b1e0 0x7fd894147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd899bbd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940ccad0 con 0x7fd8940b41d0 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd899bbd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd894071130 con 0x7fd8940cdfc0 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd899bbd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8940ccc50 con 0x7fd89415b1e0 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8940b41d0 0x7fd89414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8940b41d0 0x7fd89414fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48178/0 (socket says 172.21.15.181:48178) 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 -- 172.21.15.181:0/3395288193 learned_addr learned my addr 172.21.15.181:0/3395288193 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd893fff640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89415b1e0 0x7fd894147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd892ffd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8940cdfc0 0x7fd89415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 -- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89415b1e0 msgr2=0x7fd894147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89415b1e0 0x7fd894147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 -- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8940cdfc0 msgr2=0x7fd89415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8940cdfc0 0x7fd89415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.708+0000 7fd8937fe640 1 -- 172.21.15.181:0/3395288193 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8941484c0 con 0x7fd8940b41d0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.709+0000 7fd893fff640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89415b1e0 0x7fd894147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.709+0000 7fd8937fe640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8940b41d0 0x7fd89414fa50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd88402a220 tx=0x7fd8840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.709+0000 7fd87bfff640 1 -- 172.21.15.181:0/3395288193 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884037040 con 0x7fd8940b41d0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.709+0000 7fd87bfff640 1 -- 172.21.15.181:0/3395288193 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd884042070 con 0x7fd8940b41d0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.709+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89414dca0 con 0x7fd8940b41d0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.709+0000 7fd87bfff640 1 -- 172.21.15.181:0/3395288193 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884030bb0 con 0x7fd8940b41d0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.709+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89414e260 con 0x7fd8940b41d0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.710+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8940b3c90 con 0x7fd8940b41d0 2024-09-12T02:29:49.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.710+0000 7fd87bfff640 1 -- 172.21.15.181:0/3395288193 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd884047460 con 0x7fd8940b41d0 2024-09-12T02:29:49.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.711+0000 7fd87bfff640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd88006be30 0x7fd88006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.711+0000 7fd87bfff640 1 -- 172.21.15.181:0/3395288193 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fd8840ab790 con 0x7fd8940b41d0 2024-09-12T02:29:49.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.711+0000 7fd892ffd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd88006be30 0x7fd88006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.711+0000 7fd892ffd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd88006be30 0x7fd88006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8940740c0 tx=0x7fd888008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.715+0000 7fd87bfff640 1 -- 172.21.15.181:0/3395288193 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd884045360 con 0x7fd8940b41d0 2024-09-12T02:29:49.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.942+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd894150de0 con 0x7fd8940b41d0 2024-09-12T02:29:49.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.943+0000 7fd87bfff640 1 -- 172.21.15.181:0/3395288193 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7fd88407a490 con 0x7fd8940b41d0 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: "auth_dump": [ 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.a", 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmgqStABAAuR5/mEmoQ93BJ/aXTfZ3Vg==", 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.b", 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmHB1xDBAA9v9urEvVrgq4ujbl1dq0ow==", 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.c", 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmA6uoBxAAsY99fp7CzedZ/yS6xKV3Ww==", 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.d", 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmSVuPExAA2lIlASsgadRjRVyKwAD+ig==", 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.0", 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCJUeJmXm6kMxAAhxzDDmGdbM/mLqwsr2z0qw==", 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.1", 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCNUeJm3UvvNBAAiZKHPj471Ql3u3MDU+vYrg==", 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.948 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.2", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCRUeJm6pZuJxAABApQFY9e5yj6ehNZsZcerA==", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.3", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCVUeJm5e9GKBAA0ZoeZyPDkw7vRVjKLRZIZQ==", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.4", 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCcUeJmd20TMhAA0MSq5FoRha+jFQ6aJbfs/A==", 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.5", 2024-09-12T02:29:49.950 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCgUeJmcgSVMxAAFDsp8jmrJ2uco7rmn4q9XQ==", 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.6", 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCkUeJmTwSWNBAApWkWkCbc9Mpk7VGR27a4+Q==", 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.7", 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCoUeJmVts/NRAAQ3JpiLZSmnd2VbHLmZyXJQ==", 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.0", 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg==", 2024-09-12T02:29:49.952 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow r", 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.1", 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm8f6AIBAA96HxvzttXuXOClAGiYwh7g==", 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:29:49.953 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.2", 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm/+dGHRAAw3bdTqnuOcV2umDd/1577Q==", 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.3", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmCFcdJhAAEpU/Swkitc8CXjG0SKzeLQ==", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.admin", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmD708IBAAP+FE49F+D1d43sRbMVLBlQ==", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:29:49.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.x", 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmmPEKORAAtnB+3V0qg1BS1zEVF5qImQ==", 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:29:49.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.y", 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmMrTWNBAAVU9k50mu969QuqrLSsdtGw==", 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:29:49.957 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd88006be30 msgr2=0x7fd88006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd88006be30 0x7fd88006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8940740c0 tx=0x7fd888008040 comp rx=0 tx=0).stop 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8940b41d0 msgr2=0x7fd89414fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8940b41d0 0x7fd89414fa50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd88402a220 tx=0x7fd8840046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 shutdown_connections 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd88006be30 0x7fd88006e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8940cdfc0 0x7fd89415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89415b1e0 0x7fd894147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 --2- 172.21.15.181:0/3395288193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8940b41d0 0x7fd89414fa50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 >> 172.21.15.181:0/3395288193 conn(0x7fd89406bc10 msgr2=0x7fd894150050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 shutdown_connections 2024-09-12T02:29:49.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:49.945+0000 7fd899bbd640 1 -- 172.21.15.181:0/3395288193 wait complete. 2024-09-12T02:29:49.960 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:29:50.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.058+0000 7f2a82918640 1 Processor -- start 2024-09-12T02:29:50.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.058+0000 7f2a82918640 1 -- start start 2024-09-12T02:29:50.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.059+0000 7f2a82918640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2a7c15b2e0 0x7f2a7c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.059+0000 7f2a82918640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7c0ce4f0 con 0x7f2a7c0b2490 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.059+0000 7f2a82918640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7c0ce7d0 con 0x7f2a7c0cdfc0 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.059+0000 7f2a82918640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7c15b6c0 con 0x7f2a7c15b2e0 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.059+0000 7f2a80eb5640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2a7c0b2490 0x7f2a7c071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44344/0 (socket says 172.21.15.181:44344) 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.059+0000 7f2a80eb5640 1 -- 172.21.15.181:0/3276345989 learned_addr learned my addr 172.21.15.181:0/3276345989 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.059+0000 7f2a7bfff640 1 --2- 172.21.15.181:0/3276345989 >> v2:172.21.15.204:3300/0 conn(0x7f2a7c15b2e0 0x7f2a7c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385291286 0 0) 0x7f2a7c0ce4f0 con 0x7f2a7c0b2490 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a68003520 con 0x7f2a7c0b2490 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219410242 0 0) 0x7f2a7c0ce7d0 con 0x7f2a7c0cdfc0 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a7c0ce4f0 con 0x7f2a7c0cdfc0 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1014004541 0 0) 0x7f2a68003520 con 0x7f2a7c0b2490 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 >> v2:172.21.15.204:3300/0 conn(0x7f2a7c15b2e0 msgr2=0x7f2a7c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 --2- 172.21.15.181:0/3276345989 >> v2:172.21.15.204:3300/0 conn(0x7f2a7c15b2e0 0x7f2a7c0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 >> v1:172.21.15.204:6789/0 conn(0x7f2a7c0cdfc0 legacy=0x7f2a7c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c0ceab0 con 0x7f2a7c0b2490 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f2a740019f0 con 0x7f2a7c0b2490 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 >> v1:172.21.15.181:6789/0 conn(0x7f2a7c0b2490 legacy=0x7f2a7c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a68003b40 0x7f2a68003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a680051c0 0x7f2a6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6800c0c0 con 0x7f2a680051c0 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6800c270 con 0x7f2a68004800 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6800c470 con 0x7f2a68003b40 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a80eb5640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a680051c0 0x7f2a6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a7bfff640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a68003b40 0x7f2a68003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a73fff640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a80eb5640 1 -- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a68003b40 msgr2=0x7f2a68003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a80eb5640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a68003b40 0x7f2a68003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a80eb5640 1 -- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a68004800 msgr2=0x7f2a68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a80eb5640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a80eb5640 1 -- 172.21.15.181:0/3276345989 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a68003520 con 0x7f2a680051c0 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.060+0000 7f2a73fff640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.061+0000 7f2a80eb5640 1 -- 172.21.15.181:0/3276345989 reap_dead start 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.061+0000 7f2a80eb5640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a680051c0 0x7f2a6800b9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c070f00 tx=0x7f2a68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a201a8bfadd77939 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.061+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400a430 con 0x7f2a680051c0 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.061+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7402f070 con 0x7f2a680051c0 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.061+0000 7f2a7b7fe640 1 -- 172.21.15.181:0/3276345989 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7402bc00 con 0x7f2a680051c0 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.062+0000 7f2a82918640 1 -- 172.21.15.181:0/3276345989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a680051c0 msgr2=0x7f2a6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.062+0000 7f2a82918640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a680051c0 0x7f2a6800b9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c070f00 tx=0x7f2a68005830 comp rx=0 tx=0).stop 2024-09-12T02:29:50.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.062+0000 7f2a82918640 1 -- 172.21.15.181:0/3276345989 shutdown_connections 2024-09-12T02:29:50.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.062+0000 7f2a82918640 1 --2- 172.21.15.181:0/3276345989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a680051c0 0x7f2a6800b9c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.062+0000 7f2a82918640 1 -- 172.21.15.181:0/3276345989 >> 172.21.15.181:0/3276345989 conn(0x7f2a7c06bc10 msgr2=0x7f2a7c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.062+0000 7f2a82918640 1 -- 172.21.15.181:0/3276345989 shutdown_connections 2024-09-12T02:29:50.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.062+0000 7f2a82918640 1 -- 172.21.15.181:0/3276345989 wait complete. 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.063+0000 7f2a82918640 1 Processor -- start 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.063+0000 7f2a82918640 1 -- start start 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a82918640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a680051c0 0x7f2a7c13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a82918640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a7c071650 0x7f2a7c071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a82918640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a7c15b6c0 0x7f2a7c15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a82918640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c0712b0 con 0x7f2a7c071650 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a82918640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c071130 con 0x7f2a7c15b6c0 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a82918640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c0b1d80 con 0x7f2a680051c0 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a7c071650 0x7f2a7c071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a7c071650 0x7f2a7c071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48188/0 (socket says 172.21.15.181:48188) 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 -- 172.21.15.181:0/2854201718 learned_addr learned my addr 172.21.15.181:0/2854201718 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a7bfff640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a680051c0 0x7f2a7c13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a80eb5640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a7c15b6c0 0x7f2a7c15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 -- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a680051c0 msgr2=0x7f2a7c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a680051c0 0x7f2a7c13f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 -- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a7c15b6c0 msgr2=0x7f2a7c15bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a7c15b6c0 0x7f2a7c15bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 -- 172.21.15.181:0/2854201718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c0720d0 con 0x7f2a7c071650 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a80eb5640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a7c15b6c0 0x7f2a7c15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a73fff640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a7c071650 0x7f2a7c071ad0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400e5b0 tx=0x7f2a6400e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a797fa640 1 -- 172.21.15.181:0/2854201718 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64019070 con 0x7f2a7c071650 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a797fa640 1 -- 172.21.15.181:0/2854201718 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a640052e0 con 0x7f2a7c071650 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a797fa640 1 -- 172.21.15.181:0/2854201718 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64003810 con 0x7f2a7c071650 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.064+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c0723b0 con 0x7f2a7c071650 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.065+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c072970 con 0x7f2a7c071650 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.066+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c0b2110 con 0x7f2a7c071650 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.066+0000 7f2a797fa640 1 -- 172.21.15.181:0/2854201718 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a640039b0 con 0x7f2a7c071650 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.067+0000 7f2a797fa640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2a5c06bdd0 0x7f2a5c06e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.067+0000 7f2a7bfff640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2a5c06bdd0 0x7f2a5c06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.067+0000 7f2a797fa640 1 -- 172.21.15.181:0/2854201718 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f2a6408a0e0 con 0x7f2a7c071650 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.067+0000 7f2a7bfff640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2a5c06bdd0 0x7f2a5c06e290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009b40 tx=0x7f2a6c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.071+0000 7f2a797fa640 1 -- 172.21.15.181:0/2854201718 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a64058de0 con 0x7f2a7c071650 2024-09-12T02:29:50.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.242+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2a7c0b4310 con 0x7f2a7c071650 2024-09-12T02:29:50.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.242+0000 7f2a797fa640 1 -- 172.21.15.181:0/2854201718 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f2a640586e0 con 0x7f2a7c071650 2024-09-12T02:29:50.243 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:50.243 INFO:teuthology.orchestra.run.smithi181.stdout:[ 2024-09-12T02:29:50.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:29:50.244 INFO:teuthology.orchestra.run.smithi181.stdout: "poolnum": 1, 2024-09-12T02:29:50.244 INFO:teuthology.orchestra.run.smithi181.stdout: "poolname": ".mgr" 2024-09-12T02:29:50.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:29:50.244 INFO:teuthology.orchestra.run.smithi181.stdout:] 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2a5c06bdd0 msgr2=0x7f2a5c06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2a5c06bdd0 0x7f2a5c06e290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009b40 tx=0x7f2a6c009190 comp rx=0 tx=0).stop 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a7c071650 msgr2=0x7f2a7c071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a7c071650 0x7f2a7c071ad0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400e5b0 tx=0x7f2a6400e9b0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 shutdown_connections 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2a5c06bdd0 0x7f2a5c06e290 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a7c15b6c0 0x7f2a7c15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a7c071650 0x7f2a7c071ad0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 --2- 172.21.15.181:0/2854201718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a680051c0 0x7f2a7c13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 >> 172.21.15.181:0/2854201718 conn(0x7f2a7c06bc10 msgr2=0x7f2a7c156f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 shutdown_connections 2024-09-12T02:29:50.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.244+0000 7f2a82918640 1 -- 172.21.15.181:0/2854201718 wait complete. 2024-09-12T02:29:50.256 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:29:50.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:29:50.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.358+0000 7f6605f31640 1 Processor -- start 2024-09-12T02:29:50.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.358+0000 7f6605f31640 1 -- start start 2024-09-12T02:29:50.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f6605f31640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f660013db10 0x7f66000d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f6605f31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f66000b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f6605f31640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f660013dfa0 con 0x7f66000b52e0 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f6605f31640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f660015f640 con 0x7f660013db10 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f6605f31640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f660015b5e0 con 0x7f660015e6c0 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65feffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f660013db10 0x7f66000d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65feffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f660013db10 0x7f66000d0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48192/0 (socket says 172.21.15.181:48192) 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65feffd640 1 -- 172.21.15.181:0/2156551640 learned_addr learned my addr 172.21.15.181:0/2156551640 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65fffff640 1 --2- 172.21.15.181:0/2156551640 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f66000b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65feffd640 1 -- 172.21.15.181:0/2156551640 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 msgr2=0x7f66000b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65feffd640 1 --2- 172.21.15.181:0/2156551640 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f66000b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65feffd640 1 -- 172.21.15.181:0/2156551640 >> v1:172.21.15.204:6789/0 conn(0x7f66000b52e0 legacy=0x7f660015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.359+0000 7f65feffd640 1 -- 172.21.15.181:0/2156551640 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660015f080 con 0x7f660013db10 2024-09-12T02:29:50.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.360+0000 7f65feffd640 1 --2- 172.21.15.181:0/2156551640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f66000d0080 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f660015f7c0 tx=0x7f65f402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a44b3467fafb2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.360+0000 7f65fe7fc640 1 -- 172.21.15.181:0/2156551640 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4037070 con 0x7f660013db10 2024-09-12T02:29:50.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.360+0000 7f65fe7fc640 1 -- 172.21.15.181:0/2156551640 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f4032440 con 0x7f660013db10 2024-09-12T02:29:50.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.360+0000 7f65fe7fc640 1 -- 172.21.15.181:0/2156551640 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4032810 con 0x7f660013db10 2024-09-12T02:29:50.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 -- 172.21.15.181:0/2156551640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 msgr2=0x7f66000d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 --2- 172.21.15.181:0/2156551640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f66000d0080 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f660015f7c0 tx=0x7f65f402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 -- 172.21.15.181:0/2156551640 shutdown_connections 2024-09-12T02:29:50.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 --2- 172.21.15.181:0/2156551640 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f66000b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 --2- 172.21.15.181:0/2156551640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f66000d0080 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 -- 172.21.15.181:0/2156551640 >> 172.21.15.181:0/2156551640 conn(0x7f660006bc10 msgr2=0x7f660006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 -- 172.21.15.181:0/2156551640 shutdown_connections 2024-09-12T02:29:50.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.361+0000 7f6605f31640 1 -- 172.21.15.181:0/2156551640 wait complete. 2024-09-12T02:29:50.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.362+0000 7f6605f31640 1 Processor -- start 2024-09-12T02:29:50.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.362+0000 7f6605f31640 1 -- start start 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f6605f31640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66000b52e0 0x7f660013b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f6605f31640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f6600150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f6605f31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f6600152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f6605f31640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f66000d05c0 con 0x7f660013db10 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f6605f31640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f660015b270 con 0x7f66000b52e0 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f6605f31640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f66000d0740 con 0x7f660015e6c0 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f6600150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f6600150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48194/0 (socket says 172.21.15.181:48194) 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 -- 172.21.15.181:0/2688242612 learned_addr learned my addr 172.21.15.181:0/2688242612 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65ff7fe640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66000b52e0 0x7f660013b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65fffff640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f6600152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 -- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 msgr2=0x7f6600152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f6600152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 -- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66000b52e0 msgr2=0x7f660013b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66000b52e0 0x7f660013b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 -- 172.21.15.181:0/2688242612 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6600150eb0 con 0x7f660013db10 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65ff7fe640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66000b52e0 0x7f660013b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65fffff640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f6600152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65feffd640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f6600150540 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f65f402a200 tx=0x7f65f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.363+0000 7f65e7fff640 1 -- 172.21.15.181:0/2688242612 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4037040 con 0x7f660013db10 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.364+0000 7f65e7fff640 1 -- 172.21.15.181:0/2688242612 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f4042070 con 0x7f660013db10 2024-09-12T02:29:50.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.364+0000 7f65e7fff640 1 -- 172.21.15.181:0/2688242612 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4030880 con 0x7f660013db10 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.364+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6600151190 con 0x7f660013db10 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.364+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6600151750 con 0x7f660013db10 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.365+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6600069170 con 0x7f660013db10 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.365+0000 7f65e7fff640 1 -- 172.21.15.181:0/2688242612 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65f402ad10 con 0x7f660013db10 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.365+0000 7f65e7fff640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f65ec06be30 0x7f65ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.365+0000 7f65e7fff640 1 -- 172.21.15.181:0/2688242612 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f65f40ab1a0 con 0x7f660013db10 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.366+0000 7f65ff7fe640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f65ec06be30 0x7f65ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.366+0000 7f65ff7fe640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f65ec06be30 0x7f65ec06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65f0001700 tx=0x7f65f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.370+0000 7f65e7fff640 1 -- 172.21.15.181:0/2688242612 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65f4079e10 con 0x7f660013db10 2024-09-12T02:29:50.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.538+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f660015eaf0 con 0x7f660013db10 2024-09-12T02:29:50.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.588+0000 7f65e7fff640 1 -- 172.21.15.181:0/2688242612 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f65f4079710 con 0x7f660013db10 2024-09-12T02:29:50.589 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' created 2024-09-12T02:29:50.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f65ec06be30 msgr2=0x7f65ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f65ec06be30 0x7f65ec06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65f0001700 tx=0x7f65f0009040 comp rx=0 tx=0).stop 2024-09-12T02:29:50.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 msgr2=0x7f6600150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f6600150540 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f65f402a200 tx=0x7f65f40046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 shutdown_connections 2024-09-12T02:29:50.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f65ec06be30 0x7f65ec06e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f660015e6c0 0x7f6600152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f660013db10 0x7f6600150540 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 --2- 172.21.15.181:0/2688242612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66000b52e0 0x7f660013b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 >> 172.21.15.181:0/2688242612 conn(0x7f660006bc10 msgr2=0x7f660014b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.591+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 shutdown_connections 2024-09-12T02:29:50.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.592+0000 7f6605f31640 1 -- 172.21.15.181:0/2688242612 wait complete. 2024-09-12T02:29:50.606 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:29:50.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.710+0000 7fdcd46e4640 1 Processor -- start 2024-09-12T02:29:50.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.710+0000 7fdcd46e4640 1 -- start start 2024-09-12T02:29:50.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd46e4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdccc158d90 0x7fdccc15f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd46e4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdccc0b4b60 0x7fdccc0cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd46e4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc15fb50 con 0x7fdccc0cfff0 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd46e4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc0b5020 con 0x7fdccc0b4b60 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd46e4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc0b5300 con 0x7fdccc158d90 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd1c7f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdccc0b4b60 0x7fdccc0cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd1c7f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdccc0b4b60 0x7fdccc0cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48196/0 (socket says 172.21.15.181:48196) 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.711+0000 7fdcd1c7f640 1 -- 172.21.15.181:0/3751498167 learned_addr learned my addr 172.21.15.181:0/3751498167 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.712+0000 7fdcd2480640 1 --2- 172.21.15.181:0/3751498167 >> v2:172.21.15.204:3300/0 conn(0x7fdccc158d90 0x7fdccc15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.712+0000 7fdcd1c7f640 1 -- 172.21.15.181:0/3751498167 >> v2:172.21.15.204:3300/0 conn(0x7fdccc158d90 msgr2=0x7fdccc15f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.712+0000 7fdcd1c7f640 1 --2- 172.21.15.181:0/3751498167 >> v2:172.21.15.204:3300/0 conn(0x7fdccc158d90 0x7fdccc15f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.712+0000 7fdcd1c7f640 1 -- 172.21.15.181:0/3751498167 >> v1:172.21.15.204:6789/0 conn(0x7fdccc0cfff0 legacy=0x7fdccc162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.712+0000 7fdcd1c7f640 1 -- 172.21.15.181:0/3751498167 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc0b55e0 con 0x7fdccc0b4b60 2024-09-12T02:29:50.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.712+0000 7fdcd1c7f640 1 --2- 172.21.15.181:0/3751498167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc0b4b60 0x7fdccc0cfab0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdccc073b30 tx=0x7fdcc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdef3758d098d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd147e640 1 -- 172.21.15.181:0/3751498167 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0037070 con 0x7fdccc0b4b60 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd147e640 1 -- 172.21.15.181:0/3751498167 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc0032440 con 0x7fdccc0b4b60 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd147e640 1 -- 172.21.15.181:0/3751498167 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0032810 con 0x7fdccc0b4b60 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 -- 172.21.15.181:0/3751498167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc0b4b60 msgr2=0x7fdccc0cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/3751498167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc0b4b60 0x7fdccc0cfab0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdccc073b30 tx=0x7fdcc002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 -- 172.21.15.181:0/3751498167 shutdown_connections 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/3751498167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc0b4b60 0x7fdccc0cfab0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/3751498167 >> v2:172.21.15.204:3300/0 conn(0x7fdccc158d90 0x7fdccc15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 -- 172.21.15.181:0/3751498167 >> 172.21.15.181:0/3751498167 conn(0x7fdccc0b1600 msgr2=0x7fdccc0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 -- 172.21.15.181:0/3751498167 shutdown_connections 2024-09-12T02:29:50.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.713+0000 7fdcd46e4640 1 -- 172.21.15.181:0/3751498167 wait complete. 2024-09-12T02:29:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.714+0000 7fdcd46e4640 1 Processor -- start 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.714+0000 7fdcd46e4640 1 -- start start 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd46e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc0b4b60 0x7fdccc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd46e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0cfff0 0x7fdccc154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd46e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc158d90 0x7fdccc154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd46e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc161090 con 0x7fdccc158d90 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd46e4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc0b5ba0 con 0x7fdccc0b4b60 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd46e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc161210 con 0x7fdccc0cfff0 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd2c81640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc158d90 0x7fdccc154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd2c81640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc158d90 0x7fdccc154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48200/0 (socket says 172.21.15.181:48200) 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd2c81640 1 -- 172.21.15.181:0/1982762217 learned_addr learned my addr 172.21.15.181:0/1982762217 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd1c7f640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0cfff0 0x7fdccc154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.715+0000 7fdcd2480640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc0b4b60 0x7fdccc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd2c81640 1 -- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0cfff0 msgr2=0x7fdccc154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd2c81640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0cfff0 0x7fdccc154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd2c81640 1 -- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc0b4b60 msgr2=0x7fdccc14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd2c81640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc0b4b60 0x7fdccc14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd2c81640 1 -- 172.21.15.181:0/1982762217 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc14e930 con 0x7fdccc158d90 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd2c81640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc158d90 0x7fdccc154a60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c400 tx=0x7fdcc400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdccaffd640 1 -- 172.21.15.181:0/1982762217 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4017070 con 0x7fdccc158d90 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdccaffd640 1 -- 172.21.15.181:0/1982762217 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc40052d0 con 0x7fdccc158d90 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc150810 con 0x7fdccc158d90 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdccaffd640 1 -- 172.21.15.181:0/1982762217 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4003810 con 0x7fdccc158d90 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.716+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc150dd0 con 0x7fdccc158d90 2024-09-12T02:29:50.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.717+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc150570 con 0x7fdccc158d90 2024-09-12T02:29:50.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.717+0000 7fdccaffd640 1 -- 172.21.15.181:0/1982762217 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcc401a070 con 0x7fdccc158d90 2024-09-12T02:29:50.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.718+0000 7fdccaffd640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdcb806be30 0x7fdcb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.718+0000 7fdccaffd640 1 -- 172.21.15.181:0/1982762217 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7fdcc408a090 con 0x7fdccc158d90 2024-09-12T02:29:50.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.718+0000 7fdcd2480640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdcb806be30 0x7fdcb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.718+0000 7fdcd2480640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdcb806be30 0x7fdcb806e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009f60 tx=0x7fdcbc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.722+0000 7fdccaffd640 1 -- 172.21.15.181:0/1982762217 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdccc14e930 con 0x7fdccc158d90 2024-09-12T02:29:50.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:50.888+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdccc0b19e0 con 0x7fdccc158d90 2024-09-12T02:29:51.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.591+0000 7fdccaffd640 1 -- 172.21.15.181:0/1982762217 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7fdccc15fb50 con 0x7fdccc158d90 2024-09-12T02:29:51.592 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' created 2024-09-12T02:29:51.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.595+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdcb806be30 msgr2=0x7fdcb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.595+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdcb806be30 0x7fdcb806e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009f60 tx=0x7fdcbc00b040 comp rx=0 tx=0).stop 2024-09-12T02:29:51.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.595+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc158d90 msgr2=0x7fdccc154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.595+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc158d90 0x7fdccc154a60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c400 tx=0x7fdcc400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.597+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 shutdown_connections 2024-09-12T02:29:51.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.597+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdcb806be30 0x7fdcb806e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.597+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdccc158d90 0x7fdccc154a60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.597+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0cfff0 0x7fdccc154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.597+0000 7fdcd46e4640 1 --2- 172.21.15.181:0/1982762217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc0b4b60 0x7fdccc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.598+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 >> 172.21.15.181:0/1982762217 conn(0x7fdccc0b1600 msgr2=0x7fdccc1608c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:51.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.599+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 shutdown_connections 2024-09-12T02:29:51.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.600+0000 7fdcd46e4640 1 -- 172.21.15.181:0/1982762217 wait complete. 2024-09-12T02:29:51.622 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:29:51.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.728+0000 7f58922a6640 1 Processor -- start 2024-09-12T02:29:51.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.728+0000 7f58922a6640 1 -- start start 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.728+0000 7f58922a6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f588c073870 0x7f588c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.728+0000 7f58922a6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588c160750 con 0x7f588c0ce8f0 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.728+0000 7f58922a6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588c160a30 con 0x7f588c160250 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.728+0000 7f58922a6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f588c160d10 con 0x7f588c073870 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f588c0ce8f0 0x7f588c0708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44360/0 (socket says 172.21.15.181:44360) 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588bfff640 1 -- 172.21.15.181:0/4095828160 learned_addr learned my addr 172.21.15.181:0/4095828160 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f5890843640 1 --2- 172.21.15.181:0/4095828160 >> v2:172.21.15.204:3300/0 conn(0x7f588c073870 0x7f588c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861012506 0 0) 0x7f588c160750 con 0x7f588c0ce8f0 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5878003520 con 0x7f588c0ce8f0 2024-09-12T02:29:51.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 384777603 0 0) 0x7f5878003520 con 0x7f588c0ce8f0 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 >> v2:172.21.15.204:3300/0 conn(0x7f588c073870 msgr2=0x7f588c15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 --2- 172.21.15.181:0/4095828160 >> v2:172.21.15.204:3300/0 conn(0x7f588c073870 0x7f588c15cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 >> v1:172.21.15.204:6789/0 conn(0x7f588c160250 legacy=0x7f588c073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588c160ff0 con 0x7f588c0ce8f0 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f587c001670 con 0x7f588c0ce8f0 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 >> v1:172.21.15.181:6789/0 conn(0x7f588c0ce8f0 legacy=0x7f588c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780039b0 0x7f5878003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5878004800 0x7f5878004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780051c0 0x7f587800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f588c160d10 con 0x7f58780051c0 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f587800c160 con 0x7f5878004800 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f587800c360 con 0x7f58780039b0 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f5890843640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780051c0 0x7f587800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f588bfff640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780039b0 0x7f5878003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.729+0000 7f5883fff640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5878004800 0x7f5878004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f5890843640 1 -- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780039b0 msgr2=0x7f5878003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f5890843640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780039b0 0x7f5878003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f5890843640 1 -- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5878004800 msgr2=0x7f5878004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f5890843640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5878004800 0x7f5878004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f5890843640 1 -- 172.21.15.181:0/4095828160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5878003520 con 0x7f58780051c0 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f5890843640 1 -- 172.21.15.181:0/4095828160 reap_dead start 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f5890843640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780051c0 0x7f587800b9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5884009fc0 tx=0x7f5878005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c192d80e1917ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884035020 con 0x7f58780051c0 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884003bd0 con 0x7f58780051c0 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.730+0000 7f588b7fe640 1 -- 172.21.15.181:0/4095828160 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884009c10 con 0x7f58780051c0 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.731+0000 7f58922a6640 1 -- 172.21.15.181:0/4095828160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780051c0 msgr2=0x7f587800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.731+0000 7f58922a6640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780051c0 0x7f587800b9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5884009fc0 tx=0x7f5878005830 comp rx=0 tx=0).stop 2024-09-12T02:29:51.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.731+0000 7f58922a6640 1 -- 172.21.15.181:0/4095828160 shutdown_connections 2024-09-12T02:29:51.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.731+0000 7f58922a6640 1 --2- 172.21.15.181:0/4095828160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58780051c0 0x7f587800b9c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.731+0000 7f58922a6640 1 -- 172.21.15.181:0/4095828160 >> 172.21.15.181:0/4095828160 conn(0x7f588c0d2570 msgr2=0x7f588c0d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:51.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.731+0000 7f58922a6640 1 -- 172.21.15.181:0/4095828160 shutdown_connections 2024-09-12T02:29:51.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.731+0000 7f58922a6640 1 -- 172.21.15.181:0/4095828160 wait complete. 2024-09-12T02:29:51.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.732+0000 7f58922a6640 1 Processor -- start 2024-09-12T02:29:51.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.732+0000 7f58922a6640 1 -- start start 2024-09-12T02:29:51.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f58922a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780051c0 0x7f588c159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f58922a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f588c15d120 0x7f588c0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f58922a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f588c0c9cb0 0x7f588c1f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f58922a6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f588c0d3250 con 0x7f588c0c9cb0 2024-09-12T02:29:51.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f58922a6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f588c0d30d0 con 0x7f588c15d120 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f58922a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f588c15cc10 con 0x7f58780051c0 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f588c0c9cb0 0x7f588c1f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f588c0c9cb0 0x7f588c1f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48226/0 (socket says 172.21.15.181:48226) 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 -- 172.21.15.181:0/3108369909 learned_addr learned my addr 172.21.15.181:0/3108369909 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5883fff640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f588c15d120 0x7f588c0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f588bfff640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780051c0 0x7f588c159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 -- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780051c0 msgr2=0x7f588c159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780051c0 0x7f588c159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 -- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f588c15d120 msgr2=0x7f588c0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f588c15d120 0x7f588c0c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.733+0000 7f5890843640 1 -- 172.21.15.181:0/3108369909 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588c15d5a0 con 0x7f588c0c9cb0 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.734+0000 7f5890843640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f588c0c9cb0 0x7f588c1f20e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f588400e230 tx=0x7f5884009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.734+0000 7f58897fa640 1 -- 172.21.15.181:0/3108369909 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884035030 con 0x7f588c0c9cb0 2024-09-12T02:29:51.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.734+0000 7f58897fa640 1 -- 172.21.15.181:0/3108369909 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884043070 con 0x7f588c0c9cb0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.734+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588c1f2cf0 con 0x7f588c0c9cb0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.734+0000 7f58897fa640 1 -- 172.21.15.181:0/3108369909 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588402d070 con 0x7f588c0c9cb0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.734+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f588c0c7450 con 0x7f588c0c9cb0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.735+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588c15cf10 con 0x7f588c0c9cb0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.735+0000 7f58897fa640 1 -- 172.21.15.181:0/3108369909 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5884005d10 con 0x7f588c0c9cb0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.736+0000 7f58897fa640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586c06be30 0x7f586c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.736+0000 7f58897fa640 1 -- 172.21.15.181:0/3108369909 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f58840abac0 con 0x7f588c0c9cb0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.736+0000 7f588bfff640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586c06be30 0x7f586c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.736+0000 7f588bfff640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586c06be30 0x7f586c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f587c007fd0 tx=0x7f587c0078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.740+0000 7f58897fa640 1 -- 172.21.15.181:0/3108369909 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f588c15d5a0 con 0x7f588c0c9cb0 2024-09-12T02:29:51.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:51.938+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f588c159a30 con 0x7f588c0c9cb0 2024-09-12T02:29:52.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.604+0000 7f58897fa640 1 -- 172.21.15.181:0/3108369909 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v25) ==== 172+0+0 (secure 0 0 0) 0x7f5884079fa0 con 0x7f588c0c9cb0 2024-09-12T02:29:52.605 INFO:teuthology.orchestra.run.smithi181.stderr:new fs with metadata pool 6 and data pool 7 2024-09-12T02:29:52.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.611+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586c06be30 msgr2=0x7f586c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.611+0000 7f58922a6640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586c06be30 0x7f586c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f587c007fd0 tx=0x7f587c0078f0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.611+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f588c0c9cb0 msgr2=0x7f588c1f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.611+0000 7f58922a6640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f588c0c9cb0 0x7f588c1f20e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f588400e230 tx=0x7f5884009750 comp rx=0 tx=0).stop 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.613+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 shutdown_connections 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.613+0000 7f58922a6640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586c06be30 0x7f586c06e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.613+0000 7f58922a6640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f588c15d120 0x7f588c0c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.613+0000 7f58922a6640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f588c0c9cb0 0x7f588c1f20e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.613+0000 7f58922a6640 1 --2- 172.21.15.181:0/3108369909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58780051c0 0x7f588c159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.613+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 >> 172.21.15.181:0/3108369909 conn(0x7f588c0d2570 msgr2=0x7f588c0cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.614+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 shutdown_connections 2024-09-12T02:29:52.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.614+0000 7f58922a6640 1 -- 172.21.15.181:0/3108369909 wait complete. 2024-09-12T02:29:52.646 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:52.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.748+0000 7f68253f6640 1 Processor -- start 2024-09-12T02:29:52.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.748+0000 7f68253f6640 1 -- start start 2024-09-12T02:29:52.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f68253f6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 0x7f68200d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f68253f6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f682015ea20 con 0x7f68200cf6f0 2024-09-12T02:29:52.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f68253f6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68200b1c50 con 0x7f682015e640 2024-09-12T02:29:52.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f68253f6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f68200b3d00 con 0x7f68200cf2b0 2024-09-12T02:29:52.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681f7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f68200cf6f0 0x7f68200d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44372/0 (socket says 172.21.15.181:44372) 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681f7fe640 1 -- 172.21.15.181:0/177403596 learned_addr learned my addr 172.21.15.181:0/177403596 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f68167fc640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 0x7f68200d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363071079 0 0) 0x7f682015ea20 con 0x7f68200cf6f0 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f680c003520 con 0x7f68200cf6f0 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1736860638 0 0) 0x7f68200b1c50 con 0x7f682015e640 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f682015ea20 con 0x7f682015e640 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 526736486 0 0) 0x7f680c003520 con 0x7f68200cf6f0 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 msgr2=0x7f68200d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 0x7f68200d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 >> v1:172.21.15.204:6789/0 conn(0x7f682015e640 legacy=0x7f68200ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68200b1f30 con 0x7f68200cf6f0 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f68180019f0 con 0x7f68200cf6f0 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 >> v1:172.21.15.181:6789/0 conn(0x7f68200cf6f0 legacy=0x7f68200d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f680c003b70 0x7f680c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.749+0000 7f681e7fc640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 0x7f680c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681e7fc640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f680c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f680c00bac0 con 0x7f680c004d40 2024-09-12T02:29:52.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f680c00bc70 con 0x7f680c003b70 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f680c00be70 con 0x7f68200cf2b0 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681f7fe640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f680c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681effd640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f680c003b70 0x7f680c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f68167fc640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 0x7f680c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681f7fe640 1 -- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 msgr2=0x7f680c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681f7fe640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200cf2b0 0x7f680c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681f7fe640 1 -- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f680c003b70 msgr2=0x7f680c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681f7fe640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f680c003b70 0x7f680c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.750+0000 7f681f7fe640 1 -- 172.21.15.181:0/177403596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c003520 con 0x7f680c004d40 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f681f7fe640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f680c0051c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f681800a7c0 tx=0x7f680c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5e0da3ca2daaca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:52.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681800a410 con 0x7f680c004d40 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681802f070 con 0x7f680c004d40 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f681e7fc640 1 -- 172.21.15.181:0/177403596 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681802bc00 con 0x7f680c004d40 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f68253f6640 1 -- 172.21.15.181:0/177403596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 msgr2=0x7f680c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f68253f6640 1 --2- 172.21.15.181:0/177403596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f680c0051c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f681800a7c0 tx=0x7f680c005830 comp rx=0 tx=0).stop 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f681f7fe640 1 -- 172.21.15.181:0/177403596 reap_dead start 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f68253f6640 1 -- 172.21.15.181:0/177403596 shutdown_connections 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f68253f6640 1 -- 172.21.15.181:0/177403596 >> 172.21.15.181:0/177403596 conn(0x7f682009d820 msgr2=0x7f68200d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f68253f6640 1 -- 172.21.15.181:0/177403596 shutdown_connections 2024-09-12T02:29:52.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.751+0000 7f68253f6640 1 -- 172.21.15.181:0/177403596 wait complete. 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.752+0000 7f68253f6640 1 Processor -- start 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f68253f6640 1 -- start start 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f68253f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f68201549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f68253f6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200ca250 0x7f68200ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f68253f6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68201f4520 0x7f68201f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f68253f6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f68200b24f0 con 0x7f680c004d40 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f68253f6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f68200b2860 con 0x7f68201f4520 2024-09-12T02:29:52.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f68253f6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f68200cfe40 con 0x7f68200ca250 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f681effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f68201549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f681effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f68201549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48252/0 (socket says 172.21.15.181:48252) 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.753+0000 7f681effd640 1 -- 172.21.15.181:0/3172498513 learned_addr learned my addr 172.21.15.181:0/3172498513 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f68167fc640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200ca250 0x7f68200ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f681f7fe640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68201f4520 0x7f68201f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f681effd640 1 -- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200ca250 msgr2=0x7f68200ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f681effd640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200ca250 0x7f68200ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f681effd640 1 -- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68201f4520 msgr2=0x7f68201f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f681effd640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68201f4520 0x7f68201f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f681effd640 1 -- 172.21.15.181:0/3172498513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68201f5290 con 0x7f680c004d40 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f681effd640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f68201549f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f681000f850 tx=0x7f681000fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f6817fff640 1 -- 172.21.15.181:0/3172498513 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681000fe40 con 0x7f680c004d40 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f6817fff640 1 -- 172.21.15.181:0/3172498513 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6810018070 con 0x7f680c004d40 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68200cb620 con 0x7f680c004d40 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f6817fff640 1 -- 172.21.15.181:0/3172498513 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681000d730 con 0x7f680c004d40 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.754+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68200cbbe0 con 0x7f680c004d40 2024-09-12T02:29:52.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.755+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6820068eb0 con 0x7f680c004d40 2024-09-12T02:29:52.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.756+0000 7f6817fff640 1 -- 172.21.15.181:0/3172498513 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f681000d8d0 con 0x7f680c004d40 2024-09-12T02:29:52.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.756+0000 7f6817fff640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f680006be60 0x7f680006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.756+0000 7f68167fc640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f680006be60 0x7f680006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.756+0000 7f6817fff640 1 -- 172.21.15.181:0/3172498513 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f681008ab70 con 0x7f680c004d40 2024-09-12T02:29:52.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.757+0000 7f68167fc640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f680006be60 0x7f680006e320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f68200cf260 tx=0x7f6808009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:52.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.760+0000 7f6817fff640 1 -- 172.21.15.181:0/3172498513 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6810059670 con 0x7f680c004d40 2024-09-12T02:29:52.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.927+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68200b6f90 con 0x7f680c004d40 2024-09-12T02:29:52.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.928+0000 7f6817fff640 1 -- 172.21.15.181:0/3172498513 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16758 (secure 0 0 0) 0x7f68200b6f90 con 0x7f680c004d40 2024-09-12T02:29:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:52.929 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":44,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:51.939506+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:29:50.557261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:50.907075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:52.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f680006be60 msgr2=0x7f680006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f680006be60 0x7f680006e320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f68200cf260 tx=0x7f6808009190 comp rx=0 tx=0).stop 2024-09-12T02:29:52.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 msgr2=0x7f68201549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f68201549f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f681000f850 tx=0x7f681000fc50 comp rx=0 tx=0).stop 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 shutdown_connections 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f680006be60 0x7f680006e320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f68201f4520 0x7f68201f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f68200ca250 0x7f68200ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 --2- 172.21.15.181:0/3172498513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f680c004d40 0x7f68201549f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 >> 172.21.15.181:0/3172498513 conn(0x7f682009d820 msgr2=0x7f6820161430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 shutdown_connections 2024-09-12T02:29:52.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:52.930+0000 7f68253f6640 1 -- 172.21.15.181:0/3172498513 wait complete. 2024-09-12T02:29:52.943 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.041+0000 7f3d0cd66640 1 Processor -- start 2024-09-12T02:29:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.041+0000 7f3d0cd66640 1 -- start start 2024-09-12T02:29:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.041+0000 7f3d0cd66640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3d0815fe70 0x7f3d0806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d0cd66640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3d0806c150 0x7f3d080cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d0cd66640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0806e240 con 0x7f3d08156950 2024-09-12T02:29:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d0cd66640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3d08156d30 con 0x7f3d0806c150 2024-09-12T02:29:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d0cd66640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f3d08160380 con 0x7f3d0815fe70 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d06d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3d0806c150 0x7f3d080cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d06d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3d0806c150 0x7f3d080cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48254/0 (socket says 172.21.15.181:48254) 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d06d9d640 1 -- 172.21.15.181:0/1724221419 learned_addr learned my addr 172.21.15.181:0/1724221419 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3cfdd9b640 1 --2- 172.21.15.181:0/1724221419 >> v2:172.21.15.204:3300/0 conn(0x7f3d0815fe70 0x7f3d0806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d06d9d640 1 -- 172.21.15.181:0/1724221419 >> v2:172.21.15.204:3300/0 conn(0x7f3d0815fe70 msgr2=0x7f3d0806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d06d9d640 1 --2- 172.21.15.181:0/1724221419 >> v2:172.21.15.204:3300/0 conn(0x7f3d0815fe70 0x7f3d0806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d06d9d640 1 -- 172.21.15.181:0/1724221419 >> v1:172.21.15.204:6789/0 conn(0x7f3d08156950 legacy=0x7f3d0815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.042+0000 7f3d06d9d640 1 -- 172.21.15.181:0/1724221419 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d08160660 con 0x7f3d0806c150 2024-09-12T02:29:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d06d9d640 1 --2- 172.21.15.181:0/1724221419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0806c150 0x7f3d080cf3e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3d0806ccf0 tx=0x7f3d0002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832c12437818241b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d05d9b640 1 -- 172.21.15.181:0/1724221419 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00036070 con 0x7f3d0806c150 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d05d9b640 1 -- 172.21.15.181:0/1724221419 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d00031600 con 0x7f3d0806c150 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d05d9b640 1 -- 172.21.15.181:0/1724221419 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d000319d0 con 0x7f3d0806c150 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 -- 172.21.15.181:0/1724221419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0806c150 msgr2=0x7f3d080cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/1724221419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0806c150 0x7f3d080cf3e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3d0806ccf0 tx=0x7f3d0002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 -- 172.21.15.181:0/1724221419 shutdown_connections 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/1724221419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0806c150 0x7f3d080cf3e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/1724221419 >> v2:172.21.15.204:3300/0 conn(0x7f3d0815fe70 0x7f3d0806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 -- 172.21.15.181:0/1724221419 >> 172.21.15.181:0/1724221419 conn(0x7f3d08067b30 msgr2=0x7f3d0806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 -- 172.21.15.181:0/1724221419 shutdown_connections 2024-09-12T02:29:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.043+0000 7f3d0cd66640 1 -- 172.21.15.181:0/1724221419 wait complete. 2024-09-12T02:29:53.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.045+0000 7f3d0cd66640 1 Processor -- start 2024-09-12T02:29:53.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.045+0000 7f3d0cd66640 1 -- start start 2024-09-12T02:29:53.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0cd66640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d0806c150 0x7f3d0814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0cd66640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d08156950 0x7f3d08071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0cd66640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0815fe70 0x7f3d081e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0cd66640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3d080cede0 con 0x7f3d0815fe70 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0cd66640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08160c20 con 0x7f3d0806c150 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0cd66640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3d080cef60 con 0x7f3d08156950 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0815fe70 0x7f3d081e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0815fe70 0x7f3d081e5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48266/0 (socket says 172.21.15.181:48266) 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 -- 172.21.15.181:0/607779040 learned_addr learned my addr 172.21.15.181:0/607779040 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0659c640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d0806c150 0x7f3d0814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3cfdd9b640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d08156950 0x7f3d08071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 -- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d08156950 msgr2=0x7f3d08071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d08156950 0x7f3d08071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 -- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d0806c150 msgr2=0x7f3d0814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d0806c150 0x7f3d0814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 -- 172.21.15.181:0/607779040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d080728d0 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3cfdd9b640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d08156950 0x7f3d08071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d06d9d640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0815fe70 0x7f3d081e5c90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3d0002ace0 tx=0x7f3d00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3cff7fe640 1 -- 172.21.15.181:0/607779040 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00036050 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3cff7fe640 1 -- 172.21.15.181:0/607779040 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d00042070 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3cff7fe640 1 -- 172.21.15.181:0/607779040 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00009510 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.046+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d08072bb0 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.047+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d08073170 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.048+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0806bc10 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.048+0000 7f3cff7fe640 1 -- 172.21.15.181:0/607779040 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d00007bd0 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.048+0000 7f3cff7fe640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ce806be30 0x7f3ce806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.048+0000 7f3cff7fe640 1 -- 172.21.15.181:0/607779040 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f3d000abca0 con 0x7f3d0815fe70 2024-09-12T02:29:53.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.049+0000 7f3d0659c640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ce806be30 0x7f3ce806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.049+0000 7f3d0659c640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ce806be30 0x7f3ce806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8004f60 tx=0x7f3cf8007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.053+0000 7f3cff7fe640 1 -- 172.21.15.181:0/607779040 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d0806e240 con 0x7f3d0815fe70 2024-09-12T02:29:53.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.219+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d080b0c60 con 0x7f3d0815fe70 2024-09-12T02:29:53.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.220+0000 7f3cff7fe640 1 -- 172.21.15.181:0/607779040 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16758 (secure 0 0 0) 0x7f3d0007a650 con 0x7f3d0815fe70 2024-09-12T02:29:53.221 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:53.221 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":44,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:51.939506+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:29:50.557261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:50.907075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ce806be30 msgr2=0x7f3ce806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ce806be30 0x7f3ce806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8004f60 tx=0x7f3cf8007e30 comp rx=0 tx=0).stop 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0815fe70 msgr2=0x7f3d081e5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0815fe70 0x7f3d081e5c90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3d0002ace0 tx=0x7f3d00004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 shutdown_connections 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3ce806be30 0x7f3ce806e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d0815fe70 0x7f3d081e5c90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d08156950 0x7f3d08071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 --2- 172.21.15.181:0/607779040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d0806c150 0x7f3d0814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 >> 172.21.15.181:0/607779040 conn(0x7f3d08067b30 msgr2=0x7f3d080b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 shutdown_connections 2024-09-12T02:29:53.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.222+0000 7f3d0cd66640 1 -- 172.21.15.181:0/607779040 wait complete. 2024-09-12T02:29:53.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:29:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.337+0000 7f193490a640 1 Processor -- start 2024-09-12T02:29:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.337+0000 7f193490a640 1 -- start start 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.337+0000 7f193490a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300cef60 0x7f19300b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.337+0000 7f193490a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f19300d4710 0x7f19300d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.337+0000 7f193490a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19300d50c0 con 0x7f193015e640 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.337+0000 7f193490a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f19300b39d0 con 0x7f19300d4710 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.337+0000 7f193490a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f19300cf520 con 0x7f19300cef60 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192ed9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f19300d4710 0x7f19300d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f1927fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300cef60 0x7f19300b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192e59c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f193015e640 0x7f19300d2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:49100/0 (socket says 172.21.15.181:49100) 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192e59c640 1 -- 172.21.15.181:0/4106595871 learned_addr learned my addr 172.21.15.181:0/4106595871 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192ed9d640 1 -- 172.21.15.181:0/4106595871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300cef60 msgr2=0x7f19300b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192ed9d640 1 --2- 172.21.15.181:0/4106595871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300cef60 0x7f19300b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192ed9d640 1 -- 172.21.15.181:0/4106595871 >> v1:172.21.15.204:6789/0 conn(0x7f193015e640 legacy=0x7f19300d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192dd9b640 1 -- 172.21.15.181:0/4106595871 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259380231 0 0) 0x7f19300d50c0 con 0x7f193015e640 2024-09-12T02:29:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.338+0000 7f192ed9d640 1 -- 172.21.15.181:0/4106595871 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19300cf800 con 0x7f19300d4710 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.339+0000 7f192ed9d640 1 --2- 172.21.15.181:0/4106595871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300d4710 0x7f19300d4b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1928009d90 tx=0x7f192802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a19a11558d6a762b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.339+0000 7f192dd9b640 1 -- 172.21.15.181:0/4106595871 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928031600 con 0x7f19300d4710 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.339+0000 7f192dd9b640 1 -- 172.21.15.181:0/4106595871 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19280317a0 con 0x7f19300d4710 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.339+0000 7f192dd9b640 1 -- 172.21.15.181:0/4106595871 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928031b70 con 0x7f19300d4710 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.339+0000 7f193490a640 1 -- 172.21.15.181:0/4106595871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300d4710 msgr2=0x7f19300d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.339+0000 7f193490a640 1 --2- 172.21.15.181:0/4106595871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300d4710 0x7f19300d4b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1928009d90 tx=0x7f192802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.340+0000 7f193490a640 1 -- 172.21.15.181:0/4106595871 shutdown_connections 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.340+0000 7f193490a640 1 --2- 172.21.15.181:0/4106595871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300d4710 0x7f19300d4b80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.340+0000 7f193490a640 1 --2- 172.21.15.181:0/4106595871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300cef60 0x7f19300b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.340+0000 7f193490a640 1 -- 172.21.15.181:0/4106595871 >> 172.21.15.181:0/4106595871 conn(0x7f1930067d70 msgr2=0x7f1930068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.340+0000 7f193490a640 1 -- 172.21.15.181:0/4106595871 shutdown_connections 2024-09-12T02:29:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.340+0000 7f193490a640 1 -- 172.21.15.181:0/4106595871 wait complete. 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.341+0000 7f193490a640 1 Processor -- start 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.341+0000 7f193490a640 1 -- start start 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300cef60 0x7f193015d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300d4710 0x7f19300ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193015e640 0x7f19300ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f193015ea20 con 0x7f193015e640 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f19300d2680 con 0x7f19300cef60 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f19300d3590 con 0x7f19300d4710 2024-09-12T02:29:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192ed9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193015e640 0x7f19300ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300cef60 0x7f193015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f1927fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300d4710 0x7f19300ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300cef60 0x7f193015d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:42412/0 (socket says 172.21.15.181:42412) 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 -- 172.21.15.181:0/4171510293 learned_addr learned my addr 172.21.15.181:0/4171510293 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192ed9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193015e640 0x7f19300ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48282/0 (socket says 172.21.15.181:48282) 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 -- 172.21.15.181:0/4171510293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300d4710 msgr2=0x7f19300ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300d4710 0x7f19300ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 -- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193015e640 msgr2=0x7f19300ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193015e640 0x7f19300ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 -- 172.21.15.181:0/4171510293 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19300cc430 con 0x7f19300cef60 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f192e59c640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300cef60 0x7f193015d610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f192000c430 tx=0x7f192000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f1926ffd640 1 -- 172.21.15.181:0/4171510293 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200074e0 con 0x7f19300cef60 2024-09-12T02:29:53.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f1926ffd640 1 -- 172.21.15.181:0/4171510293 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19200047e0 con 0x7f19300cef60 2024-09-12T02:29:53.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19300cc710 con 0x7f19300cef60 2024-09-12T02:29:53.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f1926ffd640 1 -- 172.21.15.181:0/4171510293 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920004bd0 con 0x7f19300cef60 2024-09-12T02:29:53.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.342+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193015db50 con 0x7f19300cef60 2024-09-12T02:29:53.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.344+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19300b3bf0 con 0x7f19300cef60 2024-09-12T02:29:53.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.344+0000 7f1926ffd640 1 -- 172.21.15.181:0/4171510293 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1920011070 con 0x7f19300cef60 2024-09-12T02:29:53.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.344+0000 7f1926ffd640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f191006be30 0x7f191006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.344+0000 7f1926ffd640 1 -- 172.21.15.181:0/4171510293 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f192008aa20 con 0x7f19300cef60 2024-09-12T02:29:53.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.345+0000 7f1927fff640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f191006be30 0x7f191006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.345+0000 7f1927fff640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f191006be30 0x7f191006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f19300b37b0 tx=0x7f1918009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.349+0000 7f1926ffd640 1 -- 172.21.15.181:0/4171510293 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1920058ce0 con 0x7f19300cef60 2024-09-12T02:29:53.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.549+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f19300ba470 con 0x7f19300cef60 2024-09-12T02:29:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.628+0000 7f1926ffd640 1 -- 172.21.15.181:0/4171510293 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f192005cfe0 con 0x7f19300cef60 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f191006be30 msgr2=0x7f191006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f191006be30 0x7f191006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f19300b37b0 tx=0x7f1918009190 comp rx=0 tx=0).stop 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300cef60 msgr2=0x7f193015d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300cef60 0x7f193015d610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f192000c430 tx=0x7f192000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 shutdown_connections 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f191006be30 0x7f191006e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193015e640 0x7f19300ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19300d4710 0x7f19300ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 --2- 172.21.15.181:0/4171510293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19300cef60 0x7f193015d610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 >> 172.21.15.181:0/4171510293 conn(0x7f1930067d70 msgr2=0x7f19300d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 shutdown_connections 2024-09-12T02:29:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.630+0000 7f193490a640 1 -- 172.21.15.181:0/4171510293 wait complete. 2024-09-12T02:29:53.642 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:29:53.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:29:53.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.742+0000 7fd2b0f23640 1 Processor -- start 2024-09-12T02:29:53.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.742+0000 7fd2b0f23640 1 -- start start 2024-09-12T02:29:53.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2b0f23640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd2ac15b2e0 0x7fd2ac0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2b0f23640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd2ac0b4990 0x7fd2ac0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2b0f23640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac15f9d0 con 0x7fd2ac15edf0 2024-09-12T02:29:53.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2b0f23640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac073fe0 con 0x7fd2ac15b2e0 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2b0f23640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac071060 con 0x7fd2ac0b4990 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2aa59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd2ac15b2e0 0x7fd2ac0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2aa59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd2ac15b2e0 0x7fd2ac0ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48294/0 (socket says 172.21.15.181:48294) 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2aa59c640 1 -- 172.21.15.181:0/1587782681 learned_addr learned my addr 172.21.15.181:0/1587782681 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2a9d9b640 1 --2- 172.21.15.181:0/1587782681 >> v2:172.21.15.204:3300/0 conn(0x7fd2ac0b4990 0x7fd2ac0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2aa59c640 1 -- 172.21.15.181:0/1587782681 >> v2:172.21.15.204:3300/0 conn(0x7fd2ac0b4990 msgr2=0x7fd2ac0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2aa59c640 1 --2- 172.21.15.181:0/1587782681 >> v2:172.21.15.204:3300/0 conn(0x7fd2ac0b4990 0x7fd2ac0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2aa59c640 1 -- 172.21.15.181:0/1587782681 >> v1:172.21.15.204:6789/0 conn(0x7fd2ac15edf0 legacy=0x7fd2ac0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:53.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.743+0000 7fd2aa59c640 1 -- 172.21.15.181:0/1587782681 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac15fcb0 con 0x7fd2ac15b2e0 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.744+0000 7fd2aa59c640 1 --2- 172.21.15.181:0/1587782681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15b2e0 0x7fd2ac0ce980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac06c7e0 tx=0x7fd29c02c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247b21400d9c0538 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.744+0000 7fd2a959a640 1 -- 172.21.15.181:0/1587782681 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c02e040 con 0x7fd2ac15b2e0 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.744+0000 7fd2a959a640 1 -- 172.21.15.181:0/1587782681 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c037070 con 0x7fd2ac15b2e0 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.744+0000 7fd2a959a640 1 -- 172.21.15.181:0/1587782681 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c009600 con 0x7fd2ac15b2e0 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1587782681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15b2e0 msgr2=0x7fd2ac0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1587782681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15b2e0 0x7fd2ac0ce980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac06c7e0 tx=0x7fd29c02c990 comp rx=0 tx=0).stop 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1587782681 shutdown_connections 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1587782681 >> v2:172.21.15.204:3300/0 conn(0x7fd2ac0b4990 0x7fd2ac0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1587782681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15b2e0 0x7fd2ac0ce980 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1587782681 >> 172.21.15.181:0/1587782681 conn(0x7fd2ac06bc10 msgr2=0x7fd2ac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1587782681 shutdown_connections 2024-09-12T02:29:53.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.745+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1587782681 wait complete. 2024-09-12T02:29:53.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.746+0000 7fd2b0f23640 1 Processor -- start 2024-09-12T02:29:53.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.746+0000 7fd2b0f23640 1 -- start start 2024-09-12T02:29:53.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2b0f23640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2ac0b4990 0x7fd2ac147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2b0f23640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2ac15b2e0 0x7fd2ac1f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2b0f23640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15edf0 0x7fd2ac156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2b0f23640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0ce4f0 con 0x7fd2ac15edf0 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2b0f23640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac15b6c0 con 0x7fd2ac15b2e0 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2b0f23640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0b5310 con 0x7fd2ac0b4990 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15edf0 0x7fd2ac156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15edf0 0x7fd2ac156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48298/0 (socket says 172.21.15.181:48298) 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 -- 172.21.15.181:0/1544184051 learned_addr learned my addr 172.21.15.181:0/1544184051 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aa59c640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2ac0b4990 0x7fd2ac147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2a9d9b640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2ac15b2e0 0x7fd2ac1f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 -- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2ac0b4990 msgr2=0x7fd2ac147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2ac0b4990 0x7fd2ac147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 -- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2ac15b2e0 msgr2=0x7fd2ac1f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2ac15b2e0 0x7fd2ac1f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 -- 172.21.15.181:0/1544184051 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac15d170 con 0x7fd2ac15edf0 2024-09-12T02:29:53.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.747+0000 7fd2aad9d640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15edf0 0x7fd2ac156710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400b410 tx=0x7fd2a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.748+0000 7fd29affd640 1 -- 172.21.15.181:0/1544184051 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4015030 con 0x7fd2ac15edf0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.748+0000 7fd29affd640 1 -- 172.21.15.181:0/1544184051 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4004020 con 0x7fd2ac15edf0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.748+0000 7fd29affd640 1 -- 172.21.15.181:0/1544184051 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4004410 con 0x7fd2ac15edf0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.748+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac15d450 con 0x7fd2ac15edf0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.748+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac15da10 con 0x7fd2ac15edf0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.749+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac069170 con 0x7fd2ac15edf0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.749+0000 7fd29affd640 1 -- 172.21.15.181:0/1544184051 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2a4018070 con 0x7fd2ac15edf0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.750+0000 7fd29affd640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd28c06be30 0x7fd28c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.750+0000 7fd2aa59c640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd28c06be30 0x7fd28c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.750+0000 7fd29affd640 1 -- 172.21.15.181:0/1544184051 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a408a770 con 0x7fd2ac15edf0 2024-09-12T02:29:53.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.750+0000 7fd2aa59c640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd28c06be30 0x7fd28c06e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd29c036000 tx=0x7fd29c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.754+0000 7fd29affd640 1 -- 172.21.15.181:0/1544184051 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2a4058b60 con 0x7fd2ac15edf0 2024-09-12T02:29:53.865 INFO:tasks.ceph.mds.a.smithi181.stderr:2024-09-12T02:29:53.864+0000 7f6d3e155640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:29:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:53.952+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd2ac0ce180 con 0x7fd2ac15edf0 2024-09-12T02:29:54.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.633+0000 7fd29affd640 1 -- 172.21.15.181:0/1544184051 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fd2a405ce60 con 0x7fd2ac15edf0 2024-09-12T02:29:54.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.636+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd28c06be30 msgr2=0x7fd28c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.636+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd28c06be30 0x7fd28c06e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd29c036000 tx=0x7fd29c03d040 comp rx=0 tx=0).stop 2024-09-12T02:29:54.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15edf0 msgr2=0x7fd2ac156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15edf0 0x7fd2ac156710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400b410 tx=0x7fd2a400b8d0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 shutdown_connections 2024-09-12T02:29:54.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd28c06be30 0x7fd28c06e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2ac15b2e0 0x7fd2ac1f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2ac15edf0 0x7fd2ac156710 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 --2- 172.21.15.181:0/1544184051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2ac0b4990 0x7fd2ac147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 >> 172.21.15.181:0/1544184051 conn(0x7fd2ac06bc10 msgr2=0x7fd2ac0711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:54.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 shutdown_connections 2024-09-12T02:29:54.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.637+0000 7fd2b0f23640 1 -- 172.21.15.181:0/1544184051 wait complete. 2024-09-12T02:29:54.652 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:29:54.653 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:29:54.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.756+0000 7fc9c0752640 1 Processor -- start 2024-09-12T02:29:54.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.756+0000 7fc9c0752640 1 -- start start 2024-09-12T02:29:54.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9c0752640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 0x7fc9b815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9c0752640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b80b2820 con 0x7fc9b80b3800 2024-09-12T02:29:54.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9c0752640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b80b2b00 con 0x7fc9b80d0510 2024-09-12T02:29:54.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9c0752640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b8141730 con 0x7fc9b80d08f0 2024-09-12T02:29:54.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9bdced640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc9b80b3800 0x7fc9b8072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44378/0 (socket says 172.21.15.181:44378) 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9bdced640 1 -- 172.21.15.181:0/2332729049 learned_addr learned my addr 172.21.15.181:0/2332729049 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125881428 0 0) 0x7fc9b80b2820 con 0x7fc9b80b3800 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9becef640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 0x7fc9b815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.757+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9a4003520 con 0x7fc9b80b3800 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3946722777 0 0) 0x7fc9a4003520 con 0x7fc9b80b3800 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 msgr2=0x7fc9b815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 0x7fc9b815ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 >> v1:172.21.15.204:6789/0 conn(0x7fc9b80d0510 legacy=0x7fc9b80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b8144320 con 0x7fc9b80b3800 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fc9a8001670 con 0x7fc9b80b3800 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 >> v1:172.21.15.181:6789/0 conn(0x7fc9b80b3800 legacy=0x7fc9b8072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 0x7fc9a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9a4004d40 0x7fc9a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8141730 con 0x7fc9a40039e0 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a400bb50 con 0x7fc9a4004d40 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a400bd20 con 0x7fc9b80d08f0 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9be4ee640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9bdced640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 0x7fc9a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9becef640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9a4004d40 0x7fc9a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9be4ee640 1 -- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 msgr2=0x7fc9a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:54.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9be4ee640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b80d08f0 0x7fc9a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9be4ee640 1 -- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9a4004d40 msgr2=0x7fc9a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9be4ee640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9a4004d40 0x7fc9a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.758+0000 7fc9be4ee640 1 -- 172.21.15.181:0/2332729049 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a4003520 con 0x7fc9a40039e0 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9be4ee640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9a4003e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001780 tx=0x7fc9a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5f12cb641a5393 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4001370 con 0x7fc9a40039e0 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b40052d0 con 0x7fc9a40039e0 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9bd4ec640 1 -- 172.21.15.181:0/2332729049 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b402ac00 con 0x7fc9a40039e0 2024-09-12T02:29:54.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9c0752640 1 -- 172.21.15.181:0/2332729049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 msgr2=0x7fc9a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9c0752640 1 --2- 172.21.15.181:0/2332729049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9a4003e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001780 tx=0x7fc9a4005830 comp rx=0 tx=0).stop 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9becef640 1 -- 172.21.15.181:0/2332729049 reap_dead start 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9c0752640 1 -- 172.21.15.181:0/2332729049 shutdown_connections 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.759+0000 7fc9c0752640 1 -- 172.21.15.181:0/2332729049 >> 172.21.15.181:0/2332729049 conn(0x7fc9b806bc10 msgr2=0x7fc9b806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.760+0000 7fc9c0752640 1 -- 172.21.15.181:0/2332729049 shutdown_connections 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.760+0000 7fc9c0752640 1 -- 172.21.15.181:0/2332729049 wait complete. 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 Processor -- start 2024-09-12T02:29:54.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 -- start start 2024-09-12T02:29:54.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9b8071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b815b9d0 0x7fc9b81599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b806d390 0x7fc9b806d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8143bb0 con 0x7fc9a40039e0 2024-09-12T02:29:54.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8142e70 con 0x7fc9b806d390 2024-09-12T02:29:54.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9c0752640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b8143d30 con 0x7fc9b815b9d0 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9be4ee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9b8071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.761+0000 7fc9be4ee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9b8071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48326/0 (socket says 172.21.15.181:48326) 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9be4ee640 1 -- 172.21.15.181:0/3148707688 learned_addr learned my addr 172.21.15.181:0/3148707688 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9bdced640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b815b9d0 0x7fc9b81599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9becef640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b806d390 0x7fc9b806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9be4ee640 1 -- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b815b9d0 msgr2=0x7fc9b81599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9be4ee640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b815b9d0 0x7fc9b81599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9be4ee640 1 -- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b806d390 msgr2=0x7fc9b806d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9be4ee640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b806d390 0x7fc9b806d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9be4ee640 1 -- 172.21.15.181:0/3148707688 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b8072d60 con 0x7fc9a40039e0 2024-09-12T02:29:54.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9be4ee640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9b8071ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4008fd0 tx=0x7fc9b4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9aeffd640 1 -- 172.21.15.181:0/3148707688 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4042070 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9aeffd640 1 -- 172.21.15.181:0/3148707688 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b4005480 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b8070ff0 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9aeffd640 1 -- 172.21.15.181:0/3148707688 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4037040 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.762+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b80715b0 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.763+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b8073b60 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.764+0000 7fc9aeffd640 1 -- 172.21.15.181:0/3148707688 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9b4045070 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.764+0000 7fc9aeffd640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc99c06be80 0x7fc99c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.764+0000 7fc9bdced640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc99c06be80 0x7fc99c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.764+0000 7fc9aeffd640 1 -- 172.21.15.181:0/3148707688 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fc9b40aa4f0 con 0x7fc9a40039e0 2024-09-12T02:29:54.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.765+0000 7fc9bdced640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc99c06be80 0x7fc99c06e340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80737c0 tx=0x7fc9a8000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:54.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.769+0000 7fc9aeffd640 1 -- 172.21.15.181:0/3148707688 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9b8073b60 con 0x7fc9a40039e0 2024-09-12T02:29:54.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.967+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9b815ef90 con 0x7fc9a40039e0 2024-09-12T02:29:54.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.967+0000 7fc9aeffd640 1 -- 172.21.15.181:0/3148707688 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5235 (secure 0 0 0) 0x7fc9b4078930 con 0x7fc9a40039e0 2024-09-12T02:29:54.968 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:54.969 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":27,"btime":"2024-09-12T02:29:54:627732+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:29:53.953929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/1579385817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1579385817},{"type":"v1","addr":"172.21.15.181:6837","nonce":1579385817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":3}]} 2024-09-12T02:29:54.969 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 27 2024-09-12T02:29:54.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc99c06be80 msgr2=0x7fc99c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc99c06be80 0x7fc99c06e340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80737c0 tx=0x7fc9a8000f80 comp rx=0 tx=0).stop 2024-09-12T02:29:54.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 msgr2=0x7fc9b8071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:54.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9b8071ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4008fd0 tx=0x7fc9b4001120 comp rx=0 tx=0).stop 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 shutdown_connections 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc99c06be80 0x7fc99c06e340 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9b806d390 0x7fc9b806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9b815b9d0 0x7fc9b81599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 --2- 172.21.15.181:0/3148707688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a40039e0 0x7fc9b8071ad0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 >> 172.21.15.181:0/3148707688 conn(0x7fc9b806bc10 msgr2=0x7fc9b80b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 shutdown_connections 2024-09-12T02:29:54.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:54.969+0000 7fc9c0752640 1 -- 172.21.15.181:0/3148707688 wait complete. 2024-09-12T02:29:54.982 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:29:55.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.079+0000 7f42b8d3a640 1 Processor -- start 2024-09-12T02:29:55.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.079+0000 7f42b8d3a640 1 -- start start 2024-09-12T02:29:55.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b8d3a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f42b415b2e0 0x7f42b40b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b8d3a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b40ce4f0 con 0x7f42b40b2490 2024-09-12T02:29:55.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b8d3a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b40ce7d0 con 0x7f42b40cdfc0 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b8d3a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f42b415b6c0 con 0x7f42b415b2e0 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b259c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f42b415b2e0 0x7f42b40b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b259c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f42b415b2e0 0x7f42b40b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48338/0 (socket says 172.21.15.181:48338) 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b2d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f42b40b2490 0x7f42b4071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44386/0 (socket says 172.21.15.181:44386) 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b259c640 1 -- 172.21.15.181:0/1433195605 learned_addr learned my addr 172.21.15.181:0/1433195605 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b259c640 1 -- 172.21.15.181:0/1433195605 >> v1:172.21.15.204:6789/0 conn(0x7f42b40cdfc0 legacy=0x7f42b40b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b259c640 1 -- 172.21.15.181:0/1433195605 >> v1:172.21.15.181:6789/0 conn(0x7f42b40b2490 legacy=0x7f42b4071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b259c640 1 -- 172.21.15.181:0/1433195605 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b40ceab0 con 0x7f42b415b2e0 2024-09-12T02:29:55.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.080+0000 7f42b159a640 1 -- 172.21.15.181:0/1433195605 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168538875 0 0) 0x7f42b40ce4f0 con 0x7f42b40b2490 2024-09-12T02:29:55.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.081+0000 7f42b259c640 1 --2- 172.21.15.181:0/1433195605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b415b2e0 0x7f42b40b3d20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009870 tx=0x7f42ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32a96f8759381e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.081+0000 7f42b159a640 1 -- 172.21.15.181:0/1433195605 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac037070 con 0x7f42b415b2e0 2024-09-12T02:29:55.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.081+0000 7f42b159a640 1 -- 172.21.15.181:0/1433195605 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac032440 con 0x7f42b415b2e0 2024-09-12T02:29:55.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.081+0000 7f42b159a640 1 -- 172.21.15.181:0/1433195605 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac032810 con 0x7f42b415b2e0 2024-09-12T02:29:55.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.082+0000 7f42b8d3a640 1 -- 172.21.15.181:0/1433195605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b415b2e0 msgr2=0x7f42b40b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.082+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/1433195605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b415b2e0 0x7f42b40b3d20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009870 tx=0x7f42ac02a270 comp rx=0 tx=0).stop 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.082+0000 7f42b8d3a640 1 -- 172.21.15.181:0/1433195605 shutdown_connections 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.082+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/1433195605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b415b2e0 0x7f42b40b3d20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.082+0000 7f42b8d3a640 1 -- 172.21.15.181:0/1433195605 >> 172.21.15.181:0/1433195605 conn(0x7f42b406bc10 msgr2=0x7f42b406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.082+0000 7f42b8d3a640 1 -- 172.21.15.181:0/1433195605 shutdown_connections 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.082+0000 7f42b8d3a640 1 -- 172.21.15.181:0/1433195605 wait complete. 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.083+0000 7f42b8d3a640 1 Processor -- start 2024-09-12T02:29:55.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.083+0000 7f42b8d3a640 1 -- start start 2024-09-12T02:29:55.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b8d3a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b40b2490 0x7f42b4147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b8d3a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42b40cdfc0 0x7f42b4144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b8d3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42b415b2e0 0x7f42b41f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b8d3a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f42b40712b0 con 0x7f42b40b2490 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b8d3a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4071130 con 0x7f42b40cdfc0 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b8d3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f42b40b4260 con 0x7f42b415b2e0 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b40b2490 0x7f42b4147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b40b2490 0x7f42b4147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48346/0 (socket says 172.21.15.181:48346) 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 -- 172.21.15.181:0/276864880 learned_addr learned my addr 172.21.15.181:0/276864880 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b2d9d640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42b415b2e0 0x7f42b41f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b1d9b640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42b40cdfc0 0x7f42b4144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 -- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42b415b2e0 msgr2=0x7f42b41f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42b415b2e0 0x7f42b41f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 -- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42b40cdfc0 msgr2=0x7f42b4144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42b40cdfc0 0x7f42b4144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b259c640 1 -- 172.21.15.181:0/276864880 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b4147bf0 con 0x7f42b40b2490 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b2d9d640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42b415b2e0 0x7f42b41f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.084+0000 7f42b1d9b640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42b40cdfc0 0x7f42b4144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.085+0000 7f42b259c640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b40b2490 0x7f42b4147610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f42ac000c00 tx=0x7f42ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.085+0000 7f42aaffd640 1 -- 172.21.15.181:0/276864880 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac039800 con 0x7f42b40b2490 2024-09-12T02:29:55.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.085+0000 7f42aaffd640 1 -- 172.21.15.181:0/276864880 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac0399a0 con 0x7f42b40b2490 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.085+0000 7f42aaffd640 1 -- 172.21.15.181:0/276864880 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac039d90 con 0x7f42b40b2490 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.085+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b4147ed0 con 0x7f42b40b2490 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.085+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b4148490 con 0x7f42b40b2490 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.086+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b415a910 con 0x7f42b40b2490 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.086+0000 7f42aaffd640 1 -- 172.21.15.181:0/276864880 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42ac04a060 con 0x7f42b40b2490 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.087+0000 7f42aaffd640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.087+0000 7f42aaffd640 1 -- 172.21.15.181:0/276864880 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f42ac0ad100 con 0x7f42b40b2490 2024-09-12T02:29:55.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.087+0000 7f42b1d9b640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.087+0000 7f42b1d9b640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f429406be30 0x7f429406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f429c007fd0 tx=0x7f429c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.091+0000 7f42aaffd640 1 -- 172.21.15.181:0/276864880 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42ac03e070 con 0x7f42b40b2490 2024-09-12T02:29:55.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.257+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42b40b3ca0 con 0x7f42b40b2490 2024-09-12T02:29:55.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.258+0000 7f42aaffd640 1 -- 172.21.15.181:0/276864880 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16745 (secure 0 0 0) 0x7f42ac04a350 con 0x7f42b40b2490 2024-09-12T02:29:55.259 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:55.259 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":45,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:29:53.605862+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:29:50.557261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:50.907075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:55.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f429406be30 msgr2=0x7f429406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f429406be30 0x7f429406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f429c007fd0 tx=0x7f429c009040 comp rx=0 tx=0).stop 2024-09-12T02:29:55.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b40b2490 msgr2=0x7f42b4147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b40b2490 0x7f42b4147610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f42ac000c00 tx=0x7f42ac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 shutdown_connections 2024-09-12T02:29:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42b40cdfc0 0x7f42b4144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42b415b2e0 0x7f42b41f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 --2- 172.21.15.181:0/276864880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42b40b2490 0x7f42b4147610 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 >> 172.21.15.181:0/276864880 conn(0x7f42b406bc10 msgr2=0x7f42b40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 shutdown_connections 2024-09-12T02:29:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.260+0000 7f42b8d3a640 1 -- 172.21.15.181:0/276864880 wait complete. 2024-09-12T02:29:55.273 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:29:55.273 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.370+0000 7f02fd152640 1 Processor -- start 2024-09-12T02:29:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.370+0000 7f02fd152640 1 -- start start 2024-09-12T02:29:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02fd152640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f02f80d0510 0x7f02f815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02fd152640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02fd152640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f80b2820 con 0x7f02f8143bb0 2024-09-12T02:29:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02fd152640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f02f80b2b00 con 0x7f02f80d0510 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02fd152640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f02f8141730 con 0x7f02f80d08f0 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f02f80d0510 0x7f02f815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f02f80d0510 0x7f02f815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48356/0 (socket says 172.21.15.181:48356) 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f759e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f02f8143bb0 0x7f02f8072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44402/0 (socket says 172.21.15.181:44402) 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f6d9d640 1 -- 172.21.15.181:0/1386824380 learned_addr learned my addr 172.21.15.181:0/1386824380 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f6d9d640 1 -- 172.21.15.181:0/1386824380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 msgr2=0x7f02f80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f659c640 1 --2- 172.21.15.181:0/1386824380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f6d9d640 1 --2- 172.21.15.181:0/1386824380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f5d9b640 1 -- 172.21.15.181:0/1386824380 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895156284 0 0) 0x7f02f80b2820 con 0x7f02f8143bb0 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f6d9d640 1 -- 172.21.15.181:0/1386824380 >> v1:172.21.15.181:6789/0 conn(0x7f02f8143bb0 legacy=0x7f02f8072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f6d9d640 1 -- 172.21.15.181:0/1386824380 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f8144320 con 0x7f02f80d0510 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.371+0000 7f02f659c640 1 --2- 172.21.15.181:0/1386824380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.372+0000 7f02f6d9d640 1 --2- 172.21.15.181:0/1386824380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f815ef90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f02e800d150 tx=0x7f02e802c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2e5488c6a7edb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.372+0000 7f02f5d9b640 1 -- 172.21.15.181:0/1386824380 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8009600 con 0x7f02f80d0510 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.372+0000 7f02f5d9b640 1 -- 172.21.15.181:0/1386824380 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e8037070 con 0x7f02f80d0510 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.372+0000 7f02f5d9b640 1 -- 172.21.15.181:0/1386824380 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e80099c0 con 0x7f02f80d0510 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 -- 172.21.15.181:0/1386824380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 msgr2=0x7f02f815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 --2- 172.21.15.181:0/1386824380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f815ef90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f02e800d150 tx=0x7f02e802c930 comp rx=0 tx=0).stop 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 -- 172.21.15.181:0/1386824380 shutdown_connections 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 --2- 172.21.15.181:0/1386824380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 --2- 172.21.15.181:0/1386824380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f815ef90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 -- 172.21.15.181:0/1386824380 >> 172.21.15.181:0/1386824380 conn(0x7f02f806bc10 msgr2=0x7f02f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 -- 172.21.15.181:0/1386824380 shutdown_connections 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.373+0000 7f02fd152640 1 -- 172.21.15.181:0/1386824380 wait complete. 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.374+0000 7f02fd152640 1 Processor -- start 2024-09-12T02:29:55.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.374+0000 7f02fd152640 1 -- start start 2024-09-12T02:29:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02fd152640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02fd152640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02fd152640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02f8143bb0 0x7f02f81f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02fd152640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f02f80b3a00 con 0x7f02f80d0510 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02fd152640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f02f80b3880 con 0x7f02f8143bb0 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02fd152640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f02f8073580 con 0x7f02f80d08f0 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02f6d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02f6d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f80af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48358/0 (socket says 172.21.15.181:48358) 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3968560040 learned_addr learned my addr 172.21.15.181:0/3968560040 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02f759e640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02f8143bb0 0x7f02f81f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.375+0000 7f02f659c640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 msgr2=0x7f02f80cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02f6d9d640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02f8143bb0 msgr2=0x7f02f81f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02f6d9d640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02f8143bb0 0x7f02f81f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3968560040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f80af850 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02f759e640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02f8143bb0 0x7f02f81f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02f6d9d640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f80af1f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f02e800d150 tx=0x7f02e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02df7fe640 1 -- 172.21.15.181:0/3968560040 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8047480 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02df7fe640 1 -- 172.21.15.181:0/3968560040 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e8047620 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02df7fe640 1 -- 172.21.15.181:0/3968560040 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8047a10 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f80ab4e0 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.376+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f80abaa0 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.377+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f80739c0 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.378+0000 7f02df7fe640 1 -- 172.21.15.181:0/3968560040 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02e8032420 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.378+0000 7f02df7fe640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f02e406be30 0x7f02e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.378+0000 7f02df7fe640 1 -- 172.21.15.181:0/3968560040 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f02e80ae260 con 0x7f02f80d0510 2024-09-12T02:29:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.378+0000 7f02f659c640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f02e406be30 0x7f02e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.378+0000 7f02f659c640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f02e406be30 0x7f02e406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f02f8142b60 tx=0x7f02ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.382+0000 7f02df7fe640 1 -- 172.21.15.181:0/3968560040 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02e807cc10 con 0x7f02f80d0510 2024-09-12T02:29:55.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.543+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02f80b08a0 con 0x7f02e406be30 2024-09-12T02:29:55.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.549+0000 7f02df7fe640 1 -- 172.21.15.181:0/3968560040 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250644 (secure 0 0 0) 0x7f02f80b08a0 con 0x7f02e406be30 2024-09-12T02:29:55.553 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.552+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f02e406be30 msgr2=0x7f02e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.552+0000 7f02fd152640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f02e406be30 0x7f02e406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f02f8142b60 tx=0x7f02ec008040 comp rx=0 tx=0).stop 2024-09-12T02:29:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.552+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 msgr2=0x7f02f80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.552+0000 7f02fd152640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f80af1f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f02e800d150 tx=0x7f02e8004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 shutdown_connections 2024-09-12T02:29:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f02e406be30 0x7f02e406e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f02f8143bb0 0x7f02f81f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f02f80d08f0 0x7f02f80cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 --2- 172.21.15.181:0/3968560040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f80d0510 0x7f02f80af1f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 >> 172.21.15.181:0/3968560040 conn(0x7f02f806bc10 msgr2=0x7f02f8140970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 shutdown_connections 2024-09-12T02:29:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.553+0000 7f02fd152640 1 -- 172.21.15.181:0/3968560040 wait complete. 2024-09-12T02:29:55.565 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-09-12T02:29:53.630596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221276,"kb_used_data":5008,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753444,"statfs":{"total":773094113280,"available":772867526656,"internally_reserved":0,"allocated":5128192,"data_stored":2746954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000579"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.625024+0000","last_change":"2024-09-12T02:29:52.619457+0000","last_active":"2024-09-12T02:29:52.625024+0000","last_peered":"2024-09-12T02:29:52.625024+0000","last_clean":"2024-09-12T02:29:52.625024+0000","last_became_active":"2024-09-12T02:29:52.618250+0000","last_became_peered":"2024-09-12T02:29:52.618250+0000","last_unstale":"2024-09-12T02:29:52.625024+0000","last_undegraded":"2024-09-12T02:29:52.625024+0000","last_fullsized":"2024-09-12T02:29:52.625024+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633756+0000","last_change":"2024-09-12T02:29:52.629942+0000","last_active":"2024-09-12T02:29:52.633756+0000","last_peered":"2024-09-12T02:29:52.633756+0000","last_clean":"2024-09-12T02:29:52.633756+0000","last_became_active":"2024-09-12T02:29:52.629644+0000","last_became_peered":"2024-09-12T02:29:52.629644+0000","last_unstale":"2024-09-12T02:29:52.633756+0000","last_undegraded":"2024-09-12T02:29:52.633756+0000","last_fullsized":"2024-09-12T02:29:52.633756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.617035+0000","last_change":"2024-09-12T02:29:52.615494+0000","last_active":"2024-09-12T02:29:52.617035+0000","last_peered":"2024-09-12T02:29:52.617035+0000","last_clean":"2024-09-12T02:29:52.617035+0000","last_became_active":"2024-09-12T02:29:52.615083+0000","last_became_peered":"2024-09-12T02:29:52.615083+0000","last_unstale":"2024-09-12T02:29:52.617035+0000","last_undegraded":"2024-09-12T02:29:52.617035+0000","last_fullsized":"2024-09-12T02:29:52.617035+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629689+0000","last_change":"2024-09-12T02:29:52.625892+0000","last_active":"2024-09-12T02:29:52.629689+0000","last_peered":"2024-09-12T02:29:52.629689+0000","last_clean":"2024-09-12T02:29:52.629689+0000","last_became_active":"2024-09-12T02:29:52.624192+0000","last_became_peered":"2024-09-12T02:29:52.624192+0000","last_unstale":"2024-09-12T02:29:52.629689+0000","last_undegraded":"2024-09-12T02:29:52.629689+0000","last_fullsized":"2024-09-12T02:29:52.629689+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:01.527513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.628571+0000","last_change":"2024-09-12T02:29:52.624531+0000","last_active":"2024-09-12T02:29:52.628571+0000","last_peered":"2024-09-12T02:29:52.628571+0000","last_clean":"2024-09-12T02:29:52.628571+0000","last_became_active":"2024-09-12T02:29:52.624183+0000","last_became_peered":"2024-09-12T02:29:52.624183+0000","last_unstale":"2024-09-12T02:29:52.628571+0000","last_undegraded":"2024-09-12T02:29:52.628571+0000","last_fullsized":"2024-09-12T02:29:52.628571+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.591953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601065+0000","last_change":"2024-09-12T02:29:51.601065+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601065+0000","last_undegraded":"2024-09-12T02:29:51.601065+0000","last_fullsized":"2024-09-12T02:29:51.601065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627874+0000","last_change":"2024-09-12T02:29:52.623493+0000","last_active":"2024-09-12T02:29:52.627874+0000","last_peered":"2024-09-12T02:29:52.627874+0000","last_clean":"2024-09-12T02:29:52.627874+0000","last_became_active":"2024-09-12T02:29:52.623167+0000","last_became_peered":"2024-09-12T02:29:52.623167+0000","last_unstale":"2024-09-12T02:29:52.627874+0000","last_undegraded":"2024-09-12T02:29:52.627874+0000","last_fullsized":"2024-09-12T02:29:52.627874+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:12.948177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630564+0000","last_change":"2024-09-12T02:29:52.626794+0000","last_active":"2024-09-12T02:29:52.630564+0000","last_peered":"2024-09-12T02:29:52.630564+0000","last_clean":"2024-09-12T02:29:52.630564+0000","last_became_active":"2024-09-12T02:29:52.626539+0000","last_became_peered":"2024-09-12T02:29:52.626539+0000","last_unstale":"2024-09-12T02:29:52.630564+0000","last_undegraded":"2024-09-12T02:29:52.630564+0000","last_fullsized":"2024-09-12T02:29:52.630564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639139+0000","last_change":"2024-09-12T02:29:52.630608+0000","last_active":"2024-09-12T02:29:52.639139+0000","last_peered":"2024-09-12T02:29:52.639139+0000","last_clean":"2024-09-12T02:29:52.639139+0000","last_became_active":"2024-09-12T02:29:52.630375+0000","last_became_peered":"2024-09-12T02:29:52.630375+0000","last_unstale":"2024-09-12T02:29:52.639139+0000","last_undegraded":"2024-09-12T02:29:52.639139+0000","last_fullsized":"2024-09-12T02:29:52.639139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629762+0000","last_change":"2024-09-12T02:29:52.626665+0000","last_active":"2024-09-12T02:29:52.629762+0000","last_peered":"2024-09-12T02:29:52.629762+0000","last_clean":"2024-09-12T02:29:52.629762+0000","last_became_active":"2024-09-12T02:29:52.623946+0000","last_became_peered":"2024-09-12T02:29:52.623946+0000","last_unstale":"2024-09-12T02:29:52.629762+0000","last_undegraded":"2024-09-12T02:29:52.629762+0000","last_fullsized":"2024-09-12T02:29:52.629762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639512+0000","last_change":"2024-09-12T02:29:52.631057+0000","last_active":"2024-09-12T02:29:52.639512+0000","last_peered":"2024-09-12T02:29:52.639512+0000","last_clean":"2024-09-12T02:29:52.639512+0000","last_became_active":"2024-09-12T02:29:52.630774+0000","last_became_peered":"2024-09-12T02:29:52.630774+0000","last_unstale":"2024-09-12T02:29:52.639512+0000","last_undegraded":"2024-09-12T02:29:52.639512+0000","last_fullsized":"2024-09-12T02:29:52.639512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633831+0000","last_change":"2024-09-12T02:29:52.629995+0000","last_active":"2024-09-12T02:29:52.633831+0000","last_peered":"2024-09-12T02:29:52.633831+0000","last_clean":"2024-09-12T02:29:52.633831+0000","last_became_active":"2024-09-12T02:29:52.629259+0000","last_became_peered":"2024-09-12T02:29:52.629259+0000","last_unstale":"2024-09-12T02:29:52.633831+0000","last_undegraded":"2024-09-12T02:29:52.633831+0000","last_fullsized":"2024-09-12T02:29:52.633831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598286+0000","last_change":"2024-09-12T02:29:51.598286+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598286+0000","last_undegraded":"2024-09-12T02:29:51.598286+0000","last_fullsized":"2024-09-12T02:29:51.598286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631568+0000","last_change":"2024-09-12T02:29:52.627901+0000","last_active":"2024-09-12T02:29:52.631568+0000","last_peered":"2024-09-12T02:29:52.631568+0000","last_clean":"2024-09-12T02:29:52.631568+0000","last_became_active":"2024-09-12T02:29:52.627653+0000","last_became_peered":"2024-09-12T02:29:52.627653+0000","last_unstale":"2024-09-12T02:29:52.631568+0000","last_undegraded":"2024-09-12T02:29:52.631568+0000","last_fullsized":"2024-09-12T02:29:52.631568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601418+0000","last_change":"2024-09-12T02:29:51.601418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601418+0000","last_undegraded":"2024-09-12T02:29:51.601418+0000","last_fullsized":"2024-09-12T02:29:51.601418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630467+0000","last_change":"2024-09-12T02:29:52.627443+0000","last_active":"2024-09-12T02:29:52.630467+0000","last_peered":"2024-09-12T02:29:52.630467+0000","last_clean":"2024-09-12T02:29:52.630467+0000","last_became_active":"2024-09-12T02:29:52.627180+0000","last_became_peered":"2024-09-12T02:29:52.627180+0000","last_unstale":"2024-09-12T02:29:52.630467+0000","last_undegraded":"2024-09-12T02:29:52.630467+0000","last_fullsized":"2024-09-12T02:29:52.630467+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:48.076991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627324+0000","last_change":"2024-09-12T02:29:52.621284+0000","last_active":"2024-09-12T02:29:52.627324+0000","last_peered":"2024-09-12T02:29:52.627324+0000","last_clean":"2024-09-12T02:29:52.627324+0000","last_became_active":"2024-09-12T02:29:52.620998+0000","last_became_peered":"2024-09-12T02:29:52.620998+0000","last_unstale":"2024-09-12T02:29:52.627324+0000","last_undegraded":"2024-09-12T02:29:52.627324+0000","last_fullsized":"2024-09-12T02:29:52.627324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633638+0000","last_change":"2024-09-12T02:29:52.629899+0000","last_active":"2024-09-12T02:29:52.633638+0000","last_peered":"2024-09-12T02:29:52.633638+0000","last_clean":"2024-09-12T02:29:52.633638+0000","last_became_active":"2024-09-12T02:29:52.628179+0000","last_became_peered":"2024-09-12T02:29:52.628179+0000","last_unstale":"2024-09-12T02:29:52.633638+0000","last_undegraded":"2024-09-12T02:29:52.633638+0000","last_fullsized":"2024-09-12T02:29:52.633638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630542+0000","last_change":"2024-09-12T02:29:52.626757+0000","last_active":"2024-09-12T02:29:52.630542+0000","last_peered":"2024-09-12T02:29:52.630542+0000","last_clean":"2024-09-12T02:29:52.630542+0000","last_became_active":"2024-09-12T02:29:52.626506+0000","last_became_peered":"2024-09-12T02:29:52.626506+0000","last_unstale":"2024-09-12T02:29:52.630542+0000","last_undegraded":"2024-09-12T02:29:52.630542+0000","last_fullsized":"2024-09-12T02:29:52.630542+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:10.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598639+0000","last_change":"2024-09-12T02:29:51.598639+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598639+0000","last_undegraded":"2024-09-12T02:29:51.598639+0000","last_fullsized":"2024-09-12T02:29:51.598639+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.604028+0000","last_change":"2024-09-12T02:29:51.604028+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.604028+0000","last_undegraded":"2024-09-12T02:29:51.604028+0000","last_fullsized":"2024-09-12T02:29:51.604028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629606+0000","last_change":"2024-09-12T02:29:52.626049+0000","last_active":"2024-09-12T02:29:52.629606+0000","last_peered":"2024-09-12T02:29:52.629606+0000","last_clean":"2024-09-12T02:29:52.629606+0000","last_became_active":"2024-09-12T02:29:52.623834+0000","last_became_peered":"2024-09-12T02:29:52.623834+0000","last_unstale":"2024-09-12T02:29:52.629606+0000","last_undegraded":"2024-09-12T02:29:52.629606+0000","last_fullsized":"2024-09-12T02:29:52.629606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623785+0000","last_change":"2024-09-12T02:29:52.619585+0000","last_active":"2024-09-12T02:29:52.623785+0000","last_peered":"2024-09-12T02:29:52.623785+0000","last_clean":"2024-09-12T02:29:52.623785+0000","last_became_active":"2024-09-12T02:29:52.619083+0000","last_became_peered":"2024-09-12T02:29:52.619083+0000","last_unstale":"2024-09-12T02:29:52.623785+0000","last_undegraded":"2024-09-12T02:29:52.623785+0000","last_fullsized":"2024-09-12T02:29:52.623785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:45.067612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623751+0000","last_change":"2024-09-12T02:29:52.619566+0000","last_active":"2024-09-12T02:29:52.623751+0000","last_peered":"2024-09-12T02:29:52.623751+0000","last_clean":"2024-09-12T02:29:52.623751+0000","last_became_active":"2024-09-12T02:29:52.619287+0000","last_became_peered":"2024-09-12T02:29:52.619287+0000","last_unstale":"2024-09-12T02:29:52.623751+0000","last_undegraded":"2024-09-12T02:29:52.623751+0000","last_fullsized":"2024-09-12T02:29:52.623751+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:46.440930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629858+0000","last_change":"2024-09-12T02:29:52.624234+0000","last_active":"2024-09-12T02:29:52.629858+0000","last_peered":"2024-09-12T02:29:52.629858+0000","last_clean":"2024-09-12T02:29:52.629858+0000","last_became_active":"2024-09-12T02:29:52.623944+0000","last_became_peered":"2024-09-12T02:29:52.623944+0000","last_unstale":"2024-09-12T02:29:52.629858+0000","last_undegraded":"2024-09-12T02:29:52.629858+0000","last_fullsized":"2024-09-12T02:29:52.629858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:07.728093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598877+0000","last_change":"2024-09-12T02:29:51.598877+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598877+0000","last_undegraded":"2024-09-12T02:29:51.598877+0000","last_fullsized":"2024-09-12T02:29:51.598877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627386+0000","last_change":"2024-09-12T02:29:52.621835+0000","last_active":"2024-09-12T02:29:52.627386+0000","last_peered":"2024-09-12T02:29:52.627386+0000","last_clean":"2024-09-12T02:29:52.627386+0000","last_became_active":"2024-09-12T02:29:52.621425+0000","last_became_peered":"2024-09-12T02:29:52.621425+0000","last_unstale":"2024-09-12T02:29:52.627386+0000","last_undegraded":"2024-09-12T02:29:52.627386+0000","last_fullsized":"2024-09-12T02:29:52.627386+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633713+0000","last_change":"2024-09-12T02:29:52.629253+0000","last_active":"2024-09-12T02:29:52.633713+0000","last_peered":"2024-09-12T02:29:52.633713+0000","last_clean":"2024-09-12T02:29:52.633713+0000","last_became_active":"2024-09-12T02:29:52.628886+0000","last_became_peered":"2024-09-12T02:29:52.628886+0000","last_unstale":"2024-09-12T02:29:52.633713+0000","last_undegraded":"2024-09-12T02:29:52.633713+0000","last_fullsized":"2024-09-12T02:29:52.633713+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:00.216010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.632417+0000","last_change":"2024-09-12T02:29:52.630703+0000","last_active":"2024-09-12T02:29:52.632417+0000","last_peered":"2024-09-12T02:29:52.632417+0000","last_clean":"2024-09-12T02:29:52.632417+0000","last_became_active":"2024-09-12T02:29:52.630404+0000","last_became_peered":"2024-09-12T02:29:52.630404+0000","last_unstale":"2024-09-12T02:29:52.632417+0000","last_undegraded":"2024-09-12T02:29:52.632417+0000","last_fullsized":"2024-09-12T02:29:52.632417+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.851862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623095+0000","last_change":"2024-09-12T02:29:52.619356+0000","last_active":"2024-09-12T02:29:52.623095+0000","last_peered":"2024-09-12T02:29:52.623095+0000","last_clean":"2024-09-12T02:29:52.623095+0000","last_became_active":"2024-09-12T02:29:52.618699+0000","last_became_peered":"2024-09-12T02:29:52.618699+0000","last_unstale":"2024-09-12T02:29:52.623095+0000","last_undegraded":"2024-09-12T02:29:52.623095+0000","last_fullsized":"2024-09-12T02:29:52.623095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600822+0000","last_change":"2024-09-12T02:29:51.600822+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600822+0000","last_undegraded":"2024-09-12T02:29:51.600822+0000","last_fullsized":"2024-09-12T02:29:51.600822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.597886+0000","last_change":"2024-09-12T02:29:51.597886+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.597886+0000","last_undegraded":"2024-09-12T02:29:51.597886+0000","last_fullsized":"2024-09-12T02:29:51.597886+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624697+0000","last_change":"2024-09-12T02:29:52.622329+0000","last_active":"2024-09-12T02:29:52.624697+0000","last_peered":"2024-09-12T02:29:52.624697+0000","last_clean":"2024-09-12T02:29:52.624697+0000","last_became_active":"2024-09-12T02:29:52.622085+0000","last_became_peered":"2024-09-12T02:29:52.622085+0000","last_unstale":"2024-09-12T02:29:52.624697+0000","last_undegraded":"2024-09-12T02:29:52.624697+0000","last_fullsized":"2024-09-12T02:29:52.624697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615102+0000","last_change":"2024-09-12T02:29:51.614012+0000","last_active":"2024-09-12T02:29:51.615102+0000","last_peered":"2024-09-12T02:29:51.615102+0000","last_clean":"2024-09-12T02:29:51.615102+0000","last_became_active":"2024-09-12T02:29:51.613643+0000","last_became_peered":"2024-09-12T02:29:51.613643+0000","last_unstale":"2024-09-12T02:29:51.615102+0000","last_undegraded":"2024-09-12T02:29:51.615102+0000","last_fullsized":"2024-09-12T02:29:51.615102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624124+0000","last_change":"2024-09-12T02:29:52.619287+0000","last_active":"2024-09-12T02:29:52.624124+0000","last_peered":"2024-09-12T02:29:52.624124+0000","last_clean":"2024-09-12T02:29:52.624124+0000","last_became_active":"2024-09-12T02:29:52.618727+0000","last_became_peered":"2024-09-12T02:29:52.618727+0000","last_unstale":"2024-09-12T02:29:52.624124+0000","last_undegraded":"2024-09-12T02:29:52.624124+0000","last_fullsized":"2024-09-12T02:29:52.624124+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:52.246079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638727+0000","last_change":"2024-09-12T02:29:51.616177+0000","last_active":"2024-09-12T02:29:52.638727+0000","last_peered":"2024-09-12T02:29:52.638727+0000","last_clean":"2024-09-12T02:29:52.638727+0000","last_became_active":"2024-09-12T02:29:51.615785+0000","last_became_peered":"2024-09-12T02:29:51.615785+0000","last_unstale":"2024-09-12T02:29:52.638727+0000","last_undegraded":"2024-09-12T02:29:52.638727+0000","last_fullsized":"2024-09-12T02:29:52.638727+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:59.369993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639012+0000","last_change":"2024-09-12T02:29:52.635785+0000","last_active":"2024-09-12T02:29:52.639012+0000","last_peered":"2024-09-12T02:29:52.639012+0000","last_clean":"2024-09-12T02:29:52.639012+0000","last_became_active":"2024-09-12T02:29:52.635600+0000","last_became_peered":"2024-09-12T02:29:52.635600+0000","last_unstale":"2024-09-12T02:29:52.639012+0000","last_undegraded":"2024-09-12T02:29:52.639012+0000","last_fullsized":"2024-09-12T02:29:52.639012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634179+0000","last_change":"2024-09-12T02:29:51.609063+0000","last_active":"2024-09-12T02:29:52.634179+0000","last_peered":"2024-09-12T02:29:52.634179+0000","last_clean":"2024-09-12T02:29:52.634179+0000","last_became_active":"2024-09-12T02:29:51.608783+0000","last_became_peered":"2024-09-12T02:29:51.608783+0000","last_unstale":"2024-09-12T02:29:52.634179+0000","last_undegraded":"2024-09-12T02:29:52.634179+0000","last_fullsized":"2024-09-12T02:29:52.634179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:33.174988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624739+0000","last_change":"2024-09-12T02:29:52.623116+0000","last_active":"2024-09-12T02:29:52.624739+0000","last_peered":"2024-09-12T02:29:52.624739+0000","last_clean":"2024-09-12T02:29:52.624739+0000","last_became_active":"2024-09-12T02:29:52.622677+0000","last_became_peered":"2024-09-12T02:29:52.622677+0000","last_unstale":"2024-09-12T02:29:52.624739+0000","last_undegraded":"2024-09-12T02:29:52.624739+0000","last_fullsized":"2024-09-12T02:29:52.624739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634095+0000","last_change":"2024-09-12T02:29:51.612680+0000","last_active":"2024-09-12T02:29:52.634095+0000","last_peered":"2024-09-12T02:29:52.634095+0000","last_clean":"2024-09-12T02:29:52.634095+0000","last_became_active":"2024-09-12T02:29:51.612387+0000","last_became_peered":"2024-09-12T02:29:51.612387+0000","last_unstale":"2024-09-12T02:29:52.634095+0000","last_undegraded":"2024-09-12T02:29:52.634095+0000","last_fullsized":"2024-09-12T02:29:52.634095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623116+0000","last_change":"2024-09-12T02:29:52.620087+0000","last_active":"2024-09-12T02:29:52.623116+0000","last_peered":"2024-09-12T02:29:52.623116+0000","last_clean":"2024-09-12T02:29:52.623116+0000","last_became_active":"2024-09-12T02:29:52.619795+0000","last_became_peered":"2024-09-12T02:29:52.619795+0000","last_unstale":"2024-09-12T02:29:52.623116+0000","last_undegraded":"2024-09-12T02:29:52.623116+0000","last_fullsized":"2024-09-12T02:29:52.623116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.613370+0000","last_change":"2024-09-12T02:29:51.609628+0000","last_active":"2024-09-12T02:29:51.613370+0000","last_peered":"2024-09-12T02:29:51.613370+0000","last_clean":"2024-09-12T02:29:51.613370+0000","last_became_active":"2024-09-12T02:29:51.609346+0000","last_became_peered":"2024-09-12T02:29:51.609346+0000","last_unstale":"2024-09-12T02:29:51.613370+0000","last_undegraded":"2024-09-12T02:29:51.613370+0000","last_fullsized":"2024-09-12T02:29:51.613370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:45.697011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639897+0000","last_change":"2024-09-12T02:29:52.635166+0000","last_active":"2024-09-12T02:29:52.639897+0000","last_peered":"2024-09-12T02:29:52.639897+0000","last_clean":"2024-09-12T02:29:52.639897+0000","last_became_active":"2024-09-12T02:29:52.634883+0000","last_became_peered":"2024-09-12T02:29:52.634883+0000","last_unstale":"2024-09-12T02:29:52.639897+0000","last_undegraded":"2024-09-12T02:29:52.639897+0000","last_fullsized":"2024-09-12T02:29:52.639897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.902749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638620+0000","last_change":"2024-09-12T02:29:51.618885+0000","last_active":"2024-09-12T02:29:52.638620+0000","last_peered":"2024-09-12T02:29:52.638620+0000","last_clean":"2024-09-12T02:29:52.638620+0000","last_became_active":"2024-09-12T02:29:51.618593+0000","last_became_peered":"2024-09-12T02:29:51.618593+0000","last_unstale":"2024-09-12T02:29:52.638620+0000","last_undegraded":"2024-09-12T02:29:52.638620+0000","last_fullsized":"2024-09-12T02:29:52.638620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630538+0000","last_change":"2024-09-12T02:29:52.626277+0000","last_active":"2024-09-12T02:29:52.630538+0000","last_peered":"2024-09-12T02:29:52.630538+0000","last_clean":"2024-09-12T02:29:52.630538+0000","last_became_active":"2024-09-12T02:29:52.624251+0000","last_became_peered":"2024-09-12T02:29:52.624251+0000","last_unstale":"2024-09-12T02:29:52.630538+0000","last_undegraded":"2024-09-12T02:29:52.630538+0000","last_fullsized":"2024-09-12T02:29:52.630538+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616081+0000","last_change":"2024-09-12T02:29:51.607855+0000","last_active":"2024-09-12T02:29:52.616081+0000","last_peered":"2024-09-12T02:29:52.616081+0000","last_clean":"2024-09-12T02:29:52.616081+0000","last_became_active":"2024-09-12T02:29:51.607577+0000","last_became_peered":"2024-09-12T02:29:51.607577+0000","last_unstale":"2024-09-12T02:29:52.616081+0000","last_undegraded":"2024-09-12T02:29:52.616081+0000","last_fullsized":"2024-09-12T02:29:52.616081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.981772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623263+0000","last_change":"2024-09-12T02:29:52.619061+0000","last_active":"2024-09-12T02:29:52.623263+0000","last_peered":"2024-09-12T02:29:52.623263+0000","last_clean":"2024-09-12T02:29:52.623263+0000","last_became_active":"2024-09-12T02:29:52.618591+0000","last_became_peered":"2024-09-12T02:29:52.618591+0000","last_unstale":"2024-09-12T02:29:52.623263+0000","last_undegraded":"2024-09-12T02:29:52.623263+0000","last_fullsized":"2024-09-12T02:29:52.623263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:49.116934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618137+0000","last_change":"2024-09-12T02:29:51.605916+0000","last_active":"2024-09-12T02:29:52.618137+0000","last_peered":"2024-09-12T02:29:52.618137+0000","last_clean":"2024-09-12T02:29:52.618137+0000","last_became_active":"2024-09-12T02:29:51.605679+0000","last_became_peered":"2024-09-12T02:29:51.605679+0000","last_unstale":"2024-09-12T02:29:52.618137+0000","last_undegraded":"2024-09-12T02:29:52.618137+0000","last_fullsized":"2024-09-12T02:29:52.618137+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.070779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630115+0000","last_change":"2024-09-12T02:29:52.625671+0000","last_active":"2024-09-12T02:29:52.630115+0000","last_peered":"2024-09-12T02:29:52.630115+0000","last_clean":"2024-09-12T02:29:52.630115+0000","last_became_active":"2024-09-12T02:29:52.625420+0000","last_became_peered":"2024-09-12T02:29:52.625420+0000","last_unstale":"2024-09-12T02:29:52.630115+0000","last_undegraded":"2024-09-12T02:29:52.630115+0000","last_fullsized":"2024-09-12T02:29:52.630115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611664+0000","last_change":"2024-09-12T02:29:51.613737+0000","last_active":"2024-09-12T02:29:52.611664+0000","last_peered":"2024-09-12T02:29:52.611664+0000","last_clean":"2024-09-12T02:29:52.611664+0000","last_became_active":"2024-09-12T02:29:51.613468+0000","last_became_peered":"2024-09-12T02:29:51.613468+0000","last_unstale":"2024-09-12T02:29:52.611664+0000","last_undegraded":"2024-09-12T02:29:52.611664+0000","last_fullsized":"2024-09-12T02:29:52.611664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627765+0000","last_change":"2024-09-12T02:29:52.621214+0000","last_active":"2024-09-12T02:29:52.627765+0000","last_peered":"2024-09-12T02:29:52.627765+0000","last_clean":"2024-09-12T02:29:52.627765+0000","last_became_active":"2024-09-12T02:29:52.620907+0000","last_became_peered":"2024-09-12T02:29:52.620907+0000","last_unstale":"2024-09-12T02:29:52.627765+0000","last_undegraded":"2024-09-12T02:29:52.627765+0000","last_fullsized":"2024-09-12T02:29:52.627765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618101+0000","last_change":"2024-09-12T02:29:51.609872+0000","last_active":"2024-09-12T02:29:52.618101+0000","last_peered":"2024-09-12T02:29:52.618101+0000","last_clean":"2024-09-12T02:29:52.618101+0000","last_became_active":"2024-09-12T02:29:51.609605+0000","last_became_peered":"2024-09-12T02:29:51.609605+0000","last_unstale":"2024-09-12T02:29:52.618101+0000","last_undegraded":"2024-09-12T02:29:52.618101+0000","last_fullsized":"2024-09-12T02:29:52.618101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:46.757750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.603183+0000","last_change":"2024-09-12T02:29:51.603183+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.603183+0000","last_undegraded":"2024-09-12T02:29:51.603183+0000","last_fullsized":"2024-09-12T02:29:51.603183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631741+0000","last_change":"2024-09-12T02:29:51.614666+0000","last_active":"2024-09-12T02:29:52.631741+0000","last_peered":"2024-09-12T02:29:52.631741+0000","last_clean":"2024-09-12T02:29:52.631741+0000","last_became_active":"2024-09-12T02:29:51.614405+0000","last_became_peered":"2024-09-12T02:29:51.614405+0000","last_unstale":"2024-09-12T02:29:52.631741+0000","last_undegraded":"2024-09-12T02:29:52.631741+0000","last_fullsized":"2024-09-12T02:29:52.631741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.623412+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.623148+0000","last_became_peered":"2024-09-12T02:29:52.623148+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.391061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.617828+0000","last_change":"2024-09-12T02:29:51.613589+0000","last_active":"2024-09-12T02:29:51.617828+0000","last_peered":"2024-09-12T02:29:51.617828+0000","last_clean":"2024-09-12T02:29:51.617828+0000","last_became_active":"2024-09-12T02:29:51.613319+0000","last_became_peered":"2024-09-12T02:29:51.613319+0000","last_unstale":"2024-09-12T02:29:51.617828+0000","last_undegraded":"2024-09-12T02:29:51.617828+0000","last_fullsized":"2024-09-12T02:29:51.617828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:24.270926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630859+0000","last_change":"2024-09-12T02:29:52.625357+0000","last_active":"2024-09-12T02:29:52.630859+0000","last_peered":"2024-09-12T02:29:52.630859+0000","last_clean":"2024-09-12T02:29:52.630859+0000","last_became_active":"2024-09-12T02:29:52.625103+0000","last_became_peered":"2024-09-12T02:29:52.625103+0000","last_unstale":"2024-09-12T02:29:52.630859+0000","last_undegraded":"2024-09-12T02:29:52.630859+0000","last_fullsized":"2024-09-12T02:29:52.630859+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.460761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615064+0000","last_change":"2024-09-12T02:29:51.613802+0000","last_active":"2024-09-12T02:29:51.615064+0000","last_peered":"2024-09-12T02:29:51.615064+0000","last_clean":"2024-09-12T02:29:51.615064+0000","last_became_active":"2024-09-12T02:29:51.613156+0000","last_became_peered":"2024-09-12T02:29:51.613156+0000","last_unstale":"2024-09-12T02:29:51.615064+0000","last_undegraded":"2024-09-12T02:29:51.615064+0000","last_fullsized":"2024-09-12T02:29:51.615064+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:38.552485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629660+0000","last_change":"2024-09-12T02:29:52.622189+0000","last_active":"2024-09-12T02:29:52.629660+0000","last_peered":"2024-09-12T02:29:52.629660+0000","last_clean":"2024-09-12T02:29:52.629660+0000","last_became_active":"2024-09-12T02:29:52.620723+0000","last_became_peered":"2024-09-12T02:29:52.620723+0000","last_unstale":"2024-09-12T02:29:52.629660+0000","last_undegraded":"2024-09-12T02:29:52.629660+0000","last_fullsized":"2024-09-12T02:29:52.629660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612995+0000","last_change":"2024-09-12T02:29:51.611049+0000","last_active":"2024-09-12T02:29:52.612995+0000","last_peered":"2024-09-12T02:29:52.612995+0000","last_clean":"2024-09-12T02:29:52.612995+0000","last_became_active":"2024-09-12T02:29:51.610685+0000","last_became_peered":"2024-09-12T02:29:51.610685+0000","last_unstale":"2024-09-12T02:29:52.612995+0000","last_undegraded":"2024-09-12T02:29:52.612995+0000","last_fullsized":"2024-09-12T02:29:52.612995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.599773+0000","last_change":"2024-09-12T02:29:51.599773+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.599773+0000","last_undegraded":"2024-09-12T02:29:51.599773+0000","last_fullsized":"2024-09-12T02:29:51.599773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612436+0000","last_change":"2024-09-12T02:29:51.607416+0000","last_active":"2024-09-12T02:29:51.612436+0000","last_peered":"2024-09-12T02:29:51.612436+0000","last_clean":"2024-09-12T02:29:51.612436+0000","last_became_active":"2024-09-12T02:29:51.607099+0000","last_became_peered":"2024-09-12T02:29:51.607099+0000","last_unstale":"2024-09-12T02:29:51.612436+0000","last_undegraded":"2024-09-12T02:29:51.612436+0000","last_fullsized":"2024-09-12T02:29:51.612436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.652426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.622184+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.621910+0000","last_became_peered":"2024-09-12T02:29:52.621910+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.644576+0000","last_change":"2024-09-12T02:29:51.609082+0000","last_active":"2024-09-12T02:29:52.644576+0000","last_peered":"2024-09-12T02:29:52.644576+0000","last_clean":"2024-09-12T02:29:52.644576+0000","last_became_active":"2024-09-12T02:29:51.608827+0000","last_became_peered":"2024-09-12T02:29:51.608827+0000","last_unstale":"2024-09-12T02:29:52.644576+0000","last_undegraded":"2024-09-12T02:29:52.644576+0000","last_fullsized":"2024-09-12T02:29:52.644576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598411+0000","last_change":"2024-09-12T02:29:51.598411+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598411+0000","last_undegraded":"2024-09-12T02:29:51.598411+0000","last_fullsized":"2024-09-12T02:29:51.598411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612888+0000","last_change":"2024-09-12T02:29:51.607882+0000","last_active":"2024-09-12T02:29:51.612888+0000","last_peered":"2024-09-12T02:29:51.612888+0000","last_clean":"2024-09-12T02:29:51.612888+0000","last_became_active":"2024-09-12T02:29:51.607629+0000","last_became_peered":"2024-09-12T02:29:51.607629+0000","last_unstale":"2024-09-12T02:29:51.612888+0000","last_undegraded":"2024-09-12T02:29:51.612888+0000","last_fullsized":"2024-09-12T02:29:51.612888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:57.296742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639924+0000","last_change":"2024-09-12T02:29:52.636838+0000","last_active":"2024-09-12T02:29:52.639924+0000","last_peered":"2024-09-12T02:29:52.639924+0000","last_clean":"2024-09-12T02:29:52.639924+0000","last_became_active":"2024-09-12T02:29:52.636501+0000","last_became_peered":"2024-09-12T02:29:52.636501+0000","last_unstale":"2024-09-12T02:29:52.639924+0000","last_undegraded":"2024-09-12T02:29:52.639924+0000","last_fullsized":"2024-09-12T02:29:52.639924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:26.154285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638925+0000","last_change":"2024-09-12T02:29:51.614040+0000","last_active":"2024-09-12T02:29:52.638925+0000","last_peered":"2024-09-12T02:29:52.638925+0000","last_clean":"2024-09-12T02:29:52.638925+0000","last_became_active":"2024-09-12T02:29:51.613358+0000","last_became_peered":"2024-09-12T02:29:51.613358+0000","last_unstale":"2024-09-12T02:29:52.638925+0000","last_undegraded":"2024-09-12T02:29:52.638925+0000","last_fullsized":"2024-09-12T02:29:52.638925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638828+0000","last_change":"2024-09-12T02:29:52.636869+0000","last_active":"2024-09-12T02:29:52.638828+0000","last_peered":"2024-09-12T02:29:52.638828+0000","last_clean":"2024-09-12T02:29:52.638828+0000","last_became_active":"2024-09-12T02:29:52.636670+0000","last_became_peered":"2024-09-12T02:29:52.636670+0000","last_unstale":"2024-09-12T02:29:52.638828+0000","last_undegraded":"2024-09-12T02:29:52.638828+0000","last_fullsized":"2024-09-12T02:29:52.638828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631254+0000","last_change":"2024-09-12T02:29:51.607951+0000","last_active":"2024-09-12T02:29:52.631254+0000","last_peered":"2024-09-12T02:29:52.631254+0000","last_clean":"2024-09-12T02:29:52.631254+0000","last_became_active":"2024-09-12T02:29:51.607630+0000","last_became_peered":"2024-09-12T02:29:51.607630+0000","last_unstale":"2024-09-12T02:29:52.631254+0000","last_undegraded":"2024-09-12T02:29:52.631254+0000","last_fullsized":"2024-09-12T02:29:52.631254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624823+0000","last_change":"2024-09-12T02:29:52.622191+0000","last_active":"2024-09-12T02:29:52.624823+0000","last_peered":"2024-09-12T02:29:52.624823+0000","last_clean":"2024-09-12T02:29:52.624823+0000","last_became_active":"2024-09-12T02:29:52.621584+0000","last_became_peered":"2024-09-12T02:29:52.621584+0000","last_unstale":"2024-09-12T02:29:52.624823+0000","last_undegraded":"2024-09-12T02:29:52.624823+0000","last_fullsized":"2024-09-12T02:29:52.624823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.365214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615558+0000","last_change":"2024-09-12T02:29:51.614595+0000","last_active":"2024-09-12T02:29:51.615558+0000","last_peered":"2024-09-12T02:29:51.615558+0000","last_clean":"2024-09-12T02:29:51.615558+0000","last_became_active":"2024-09-12T02:29:51.614265+0000","last_became_peered":"2024-09-12T02:29:51.614265+0000","last_unstale":"2024-09-12T02:29:51.615558+0000","last_undegraded":"2024-09-12T02:29:51.615558+0000","last_fullsized":"2024-09-12T02:29:51.615558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:20.937452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600616+0000","last_change":"2024-09-12T02:29:51.600616+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600616+0000","last_undegraded":"2024-09-12T02:29:51.600616+0000","last_fullsized":"2024-09-12T02:29:51.600616+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.609795+0000","last_change":"2024-09-12T02:29:51.606261+0000","last_active":"2024-09-12T02:29:51.609795+0000","last_peered":"2024-09-12T02:29:51.609795+0000","last_clean":"2024-09-12T02:29:51.609795+0000","last_became_active":"2024-09-12T02:29:51.605989+0000","last_became_peered":"2024-09-12T02:29:51.605989+0000","last_unstale":"2024-09-12T02:29:51.609795+0000","last_undegraded":"2024-09-12T02:29:51.609795+0000","last_fullsized":"2024-09-12T02:29:51.609795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:46.210505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627339+0000","last_change":"2024-09-12T02:29:52.624877+0000","last_active":"2024-09-12T02:29:52.627339+0000","last_peered":"2024-09-12T02:29:52.627339+0000","last_clean":"2024-09-12T02:29:52.627339+0000","last_became_active":"2024-09-12T02:29:52.624540+0000","last_became_peered":"2024-09-12T02:29:52.624540+0000","last_unstale":"2024-09-12T02:29:52.627339+0000","last_undegraded":"2024-09-12T02:29:52.627339+0000","last_fullsized":"2024-09-12T02:29:52.627339+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616102+0000","last_change":"2024-09-12T02:29:51.603198+0000","last_active":"2024-09-12T02:29:52.616102+0000","last_peered":"2024-09-12T02:29:52.616102+0000","last_clean":"2024-09-12T02:29:52.616102+0000","last_became_active":"2024-09-12T02:29:51.602891+0000","last_became_peered":"2024-09-12T02:29:51.602891+0000","last_unstale":"2024-09-12T02:29:52.616102+0000","last_undegraded":"2024-09-12T02:29:52.616102+0000","last_fullsized":"2024-09-12T02:29:52.616102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598418+0000","last_change":"2024-09-12T02:29:51.598418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598418+0000","last_undegraded":"2024-09-12T02:29:51.598418+0000","last_fullsized":"2024-09-12T02:29:51.598418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.615892+0000","last_change":"2024-09-12T02:29:51.609912+0000","last_active":"2024-09-12T02:29:52.615892+0000","last_peered":"2024-09-12T02:29:52.615892+0000","last_clean":"2024-09-12T02:29:52.615892+0000","last_became_active":"2024-09-12T02:29:51.609646+0000","last_became_peered":"2024-09-12T02:29:51.609646+0000","last_unstale":"2024-09-12T02:29:52.615892+0000","last_undegraded":"2024-09-12T02:29:52.615892+0000","last_fullsized":"2024-09-12T02:29:52.615892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.455790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639646+0000","last_change":"2024-09-12T02:29:52.631060+0000","last_active":"2024-09-12T02:29:52.639646+0000","last_peered":"2024-09-12T02:29:52.639646+0000","last_clean":"2024-09-12T02:29:52.639646+0000","last_became_active":"2024-09-12T02:29:52.630218+0000","last_became_peered":"2024-09-12T02:29:52.630218+0000","last_unstale":"2024-09-12T02:29:52.639646+0000","last_undegraded":"2024-09-12T02:29:52.639646+0000","last_fullsized":"2024-09-12T02:29:52.639646+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:27.285618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614576+0000","last_change":"2024-09-12T02:29:51.613668+0000","last_active":"2024-09-12T02:29:52.614576+0000","last_peered":"2024-09-12T02:29:52.614576+0000","last_clean":"2024-09-12T02:29:52.614576+0000","last_became_active":"2024-09-12T02:29:51.612615+0000","last_became_peered":"2024-09-12T02:29:51.612615+0000","last_unstale":"2024-09-12T02:29:52.614576+0000","last_undegraded":"2024-09-12T02:29:52.614576+0000","last_fullsized":"2024-09-12T02:29:52.614576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:59.211039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630298+0000","last_change":"2024-09-12T02:29:52.626071+0000","last_active":"2024-09-12T02:29:52.630298+0000","last_peered":"2024-09-12T02:29:52.630298+0000","last_clean":"2024-09-12T02:29:52.630298+0000","last_became_active":"2024-09-12T02:29:52.625734+0000","last_became_peered":"2024-09-12T02:29:52.625734+0000","last_unstale":"2024-09-12T02:29:52.630298+0000","last_undegraded":"2024-09-12T02:29:52.630298+0000","last_fullsized":"2024-09-12T02:29:52.630298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.762721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.614269+0000","last_change":"2024-09-12T02:29:51.613594+0000","last_active":"2024-09-12T02:29:51.614269+0000","last_peered":"2024-09-12T02:29:51.614269+0000","last_clean":"2024-09-12T02:29:51.614269+0000","last_became_active":"2024-09-12T02:29:51.613308+0000","last_became_peered":"2024-09-12T02:29:51.613308+0000","last_unstale":"2024-09-12T02:29:51.614269+0000","last_undegraded":"2024-09-12T02:29:51.614269+0000","last_fullsized":"2024-09-12T02:29:51.614269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:57.658906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629833+0000","last_change":"2024-09-12T02:29:52.626950+0000","last_active":"2024-09-12T02:29:52.629833+0000","last_peered":"2024-09-12T02:29:52.629833+0000","last_clean":"2024-09-12T02:29:52.629833+0000","last_became_active":"2024-09-12T02:29:52.624339+0000","last_became_peered":"2024-09-12T02:29:52.624339+0000","last_unstale":"2024-09-12T02:29:52.629833+0000","last_undegraded":"2024-09-12T02:29:52.629833+0000","last_fullsized":"2024-09-12T02:29:52.629833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614224+0000","last_change":"2024-09-12T02:29:51.614143+0000","last_active":"2024-09-12T02:29:52.614224+0000","last_peered":"2024-09-12T02:29:52.614224+0000","last_clean":"2024-09-12T02:29:52.614224+0000","last_became_active":"2024-09-12T02:29:51.613862+0000","last_became_peered":"2024-09-12T02:29:51.613862+0000","last_unstale":"2024-09-12T02:29:52.614224+0000","last_undegraded":"2024-09-12T02:29:52.614224+0000","last_fullsized":"2024-09-12T02:29:52.614224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.971168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633485+0000","last_change":"2024-09-12T02:29:52.628947+0000","last_active":"2024-09-12T02:29:52.633485+0000","last_peered":"2024-09-12T02:29:52.633485+0000","last_clean":"2024-09-12T02:29:52.633485+0000","last_became_active":"2024-09-12T02:29:52.628641+0000","last_became_peered":"2024-09-12T02:29:52.628641+0000","last_unstale":"2024-09-12T02:29:52.633485+0000","last_undegraded":"2024-09-12T02:29:52.633485+0000","last_fullsized":"2024-09-12T02:29:52.633485+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.950748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612520+0000","last_change":"2024-09-12T02:29:51.608188+0000","last_active":"2024-09-12T02:29:52.612520+0000","last_peered":"2024-09-12T02:29:52.612520+0000","last_clean":"2024-09-12T02:29:52.612520+0000","last_became_active":"2024-09-12T02:29:51.607861+0000","last_became_peered":"2024-09-12T02:29:51.607861+0000","last_unstale":"2024-09-12T02:29:52.612520+0000","last_undegraded":"2024-09-12T02:29:52.612520+0000","last_fullsized":"2024-09-12T02:29:52.612520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600158+0000","last_change":"2024-09-12T02:29:51.600158+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600158+0000","last_undegraded":"2024-09-12T02:29:51.600158+0000","last_fullsized":"2024-09-12T02:29:51.600158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614036+0000","last_change":"2024-09-12T02:29:51.614527+0000","last_active":"2024-09-12T02:29:52.614036+0000","last_peered":"2024-09-12T02:29:52.614036+0000","last_clean":"2024-09-12T02:29:52.614036+0000","last_became_active":"2024-09-12T02:29:51.614243+0000","last_became_peered":"2024-09-12T02:29:51.614243+0000","last_unstale":"2024-09-12T02:29:52.614036+0000","last_undegraded":"2024-09-12T02:29:52.614036+0000","last_fullsized":"2024-09-12T02:29:52.614036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:10.586982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600978+0000","last_change":"2024-09-12T02:29:51.600978+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600978+0000","last_undegraded":"2024-09-12T02:29:51.600978+0000","last_fullsized":"2024-09-12T02:29:51.600978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611085+0000","last_change":"2024-09-12T02:29:51.613803+0000","last_active":"2024-09-12T02:29:52.611085+0000","last_peered":"2024-09-12T02:29:52.611085+0000","last_clean":"2024-09-12T02:29:52.611085+0000","last_became_active":"2024-09-12T02:29:51.613523+0000","last_became_peered":"2024-09-12T02:29:51.613523+0000","last_unstale":"2024-09-12T02:29:52.611085+0000","last_undegraded":"2024-09-12T02:29:52.611085+0000","last_fullsized":"2024-09-12T02:29:52.611085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631071+0000","last_change":"2024-09-12T02:29:52.626820+0000","last_active":"2024-09-12T02:29:52.631071+0000","last_peered":"2024-09-12T02:29:52.631071+0000","last_clean":"2024-09-12T02:29:52.631071+0000","last_became_active":"2024-09-12T02:29:52.626379+0000","last_became_peered":"2024-09-12T02:29:52.626379+0000","last_unstale":"2024-09-12T02:29:52.631071+0000","last_undegraded":"2024-09-12T02:29:52.631071+0000","last_fullsized":"2024-09-12T02:29:52.631071+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:17.976139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612756+0000","last_change":"2024-09-12T02:29:51.603977+0000","last_active":"2024-09-12T02:29:52.612756+0000","last_peered":"2024-09-12T02:29:52.612756+0000","last_clean":"2024-09-12T02:29:52.612756+0000","last_became_active":"2024-09-12T02:29:51.603675+0000","last_became_peered":"2024-09-12T02:29:51.603675+0000","last_unstale":"2024-09-12T02:29:52.612756+0000","last_undegraded":"2024-09-12T02:29:52.612756+0000","last_fullsized":"2024-09-12T02:29:52.612756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627440+0000","last_change":"2024-09-12T02:29:52.622743+0000","last_active":"2024-09-12T02:29:52.627440+0000","last_peered":"2024-09-12T02:29:52.627440+0000","last_clean":"2024-09-12T02:29:52.627440+0000","last_became_active":"2024-09-12T02:29:52.622484+0000","last_became_peered":"2024-09-12T02:29:52.622484+0000","last_unstale":"2024-09-12T02:29:52.627440+0000","last_undegraded":"2024-09-12T02:29:52.627440+0000","last_fullsized":"2024-09-12T02:29:52.627440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618359+0000","last_change":"2024-09-12T02:29:51.607832+0000","last_active":"2024-09-12T02:29:52.618359+0000","last_peered":"2024-09-12T02:29:52.618359+0000","last_clean":"2024-09-12T02:29:52.618359+0000","last_became_active":"2024-09-12T02:29:51.607569+0000","last_became_peered":"2024-09-12T02:29:51.607569+0000","last_unstale":"2024-09-12T02:29:52.618359+0000","last_undegraded":"2024-09-12T02:29:52.618359+0000","last_fullsized":"2024-09-12T02:29:52.618359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629714+0000","last_change":"2024-09-12T02:29:52.622767+0000","last_active":"2024-09-12T02:29:52.629714+0000","last_peered":"2024-09-12T02:29:52.629714+0000","last_clean":"2024-09-12T02:29:52.629714+0000","last_became_active":"2024-09-12T02:29:52.622534+0000","last_became_peered":"2024-09-12T02:29:52.622534+0000","last_unstale":"2024-09-12T02:29:52.629714+0000","last_undegraded":"2024-09-12T02:29:52.629714+0000","last_fullsized":"2024-09-12T02:29:52.629714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:36.382720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.635166+0000","last_change":"2024-09-12T02:29:51.608005+0000","last_active":"2024-09-12T02:29:52.635166+0000","last_peered":"2024-09-12T02:29:52.635166+0000","last_clean":"2024-09-12T02:29:52.635166+0000","last_became_active":"2024-09-12T02:29:51.607721+0000","last_became_peered":"2024-09-12T02:29:51.607721+0000","last_unstale":"2024-09-12T02:29:52.635166+0000","last_undegraded":"2024-09-12T02:29:52.635166+0000","last_fullsized":"2024-09-12T02:29:52.635166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614664+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:52.614664+0000","last_peered":"2024-09-12T02:29:52.614664+0000","last_clean":"2024-09-12T02:29:52.614664+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:52.614664+0000","last_undegraded":"2024-09-12T02:29:52.614664+0000","last_fullsized":"2024-09-12T02:29:52.614664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:55.569 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.703+0000 7f2bd5b3a640 1 Processor -- start 2024-09-12T02:29:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.703+0000 7f2bd5b3a640 1 -- start start 2024-09-12T02:29:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bd5b3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 0x7f2bd0165db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bd5b3a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd00ce4f0 con 0x7f2bd00cdfc0 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bd5b3a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd00ce7d0 con 0x7f2bd015b2e0 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bd5b3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd015b6c0 con 0x7f2bd00b2490 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bceffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2bd00cdfc0 0x7f2bd00b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44410/0 (socket says 172.21.15.181:44410) 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bceffd640 1 -- 172.21.15.181:0/279494442 learned_addr learned my addr 172.21.15.181:0/279494442 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652486774 0 0) 0x7f2bd00ce4f0 con 0x7f2bd00cdfc0 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bcffff640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 0x7f2bd0165db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.704+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bb8003520 con 0x7f2bd00cdfc0 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2428060606 0 0) 0x7f2bb8003520 con 0x7f2bd00cdfc0 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 msgr2=0x7f2bd0165db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 0x7f2bd0165db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 >> v1:172.21.15.204:6789/0 conn(0x7f2bd015b2e0 legacy=0x7f2bd00b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd00ceab0 con 0x7f2bd00cdfc0 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f2bc4001670 con 0x7f2bd00cdfc0 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 >> v1:172.21.15.181:6789/0 conn(0x7f2bd00cdfc0 legacy=0x7f2bd00b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bb80039e0 0x7f2bb8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 0x7f2bb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bb8004d40 0x7f2bb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb800ba70 con 0x7f2bb80039e0 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb800bc20 con 0x7f2bb8004d40 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb800be20 con 0x7f2bd00b2490 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bcf7fe640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bb80039e0 0x7f2bb8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bcffff640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bb8004d40 0x7f2bb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bceffd640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 0x7f2bb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bcf7fe640 1 -- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 msgr2=0x7f2bb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bcf7fe640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b2490 0x7f2bb8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bcf7fe640 1 -- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bb8004d40 msgr2=0x7f2bb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bcf7fe640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bb8004d40 0x7f2bb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.705+0000 7f2bcf7fe640 1 -- 172.21.15.181:0/279494442 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb8003520 con 0x7f2bb80039e0 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bcf7fe640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bb80039e0 0x7f2bb8003e00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0001720 tx=0x7f2bb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4640423b30b192b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0001370 con 0x7f2bb80039e0 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc00052d0 con 0x7f2bb80039e0 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bce7fc640 1 -- 172.21.15.181:0/279494442 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc002abc0 con 0x7f2bb80039e0 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/279494442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bb80039e0 msgr2=0x7f2bb8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bd5b3a640 1 --2- 172.21.15.181:0/279494442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bb80039e0 0x7f2bb8003e00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0001720 tx=0x7f2bb8005830 comp rx=0 tx=0).stop 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bcffff640 1 -- 172.21.15.181:0/279494442 reap_dead start 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/279494442 shutdown_connections 2024-09-12T02:29:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/279494442 >> 172.21.15.181:0/279494442 conn(0x7f2bd006bc10 msgr2=0x7f2bd006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.706+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/279494442 shutdown_connections 2024-09-12T02:29:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.707+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/279494442 wait complete. 2024-09-12T02:29:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.708+0000 7f2bd5b3a640 1 Processor -- start 2024-09-12T02:29:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.708+0000 7f2bd5b3a640 1 -- start start 2024-09-12T02:29:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bd5b3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bb80039e0 0x7f2bd01f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bd5b3a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd00c5060 0x7f2bd014d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bd5b3a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd014d810 0x7f2bd00ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bd5b3a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd0071130 con 0x7f2bd014d810 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bd5b3a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd00b4430 con 0x7f2bd00c5060 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bd5b3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd00712b0 con 0x7f2bb80039e0 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd014d810 0x7f2bd00ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd014d810 0x7f2bd00ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48372/0 (socket says 172.21.15.181:48372) 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 -- 172.21.15.181:0/2980536336 learned_addr learned my addr 172.21.15.181:0/2980536336 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcf7fe640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bb80039e0 0x7f2bd01f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bceffd640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd00c5060 0x7f2bd014d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 -- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bb80039e0 msgr2=0x7f2bd01f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bb80039e0 0x7f2bd01f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 -- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd00c5060 msgr2=0x7f2bd014d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd00c5060 0x7f2bd014d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 -- 172.21.15.181:0/2980536336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd00c55b0 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bceffd640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd00c5060 0x7f2bd014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bcffff640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd014d810 0x7f2bd00ae8a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0069630 tx=0x7f2bc80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bb7fff640 1 -- 172.21.15.181:0/2980536336 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8011e10 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bb7fff640 1 -- 172.21.15.181:0/2980536336 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc801b070 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bb7fff640 1 -- 172.21.15.181:0/2980536336 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8003990 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.709+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd01e4c70 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.710+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd01e5230 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.711+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd01e4a60 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.711+0000 7f2bb7fff640 1 -- 172.21.15.181:0/2980536336 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bc8005d10 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.711+0000 7f2bb7fff640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bbc06be30 0x7f2bbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.711+0000 7f2bb7fff640 1 -- 172.21.15.181:0/2980536336 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f2bc808b310 con 0x7f2bd014d810 2024-09-12T02:29:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.711+0000 7f2bcf7fe640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bbc06be30 0x7f2bbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.712+0000 7f2bcf7fe640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bbc06be30 0x7f2bbc06e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0032000 tx=0x7f2bc002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.716+0000 7f2bb7fff640 1 -- 172.21.15.181:0/2980536336 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bc8025020 con 0x7f2bd014d810 2024-09-12T02:29:55.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.878+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2bd01f8610 con 0x7f2bbc06be30 2024-09-12T02:29:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.884+0000 7f2bb7fff640 1 -- 172.21.15.181:0/2980536336 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250644 (secure 0 0 0) 0x7f2bc007f330 con 0x7f2bbc06be30 2024-09-12T02:29:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:55.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bbc06be30 msgr2=0x7f2bbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bbc06be30 0x7f2bbc06e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0032000 tx=0x7f2bc002e000 comp rx=0 tx=0).stop 2024-09-12T02:29:55.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd014d810 msgr2=0x7f2bd00ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd014d810 0x7f2bd00ae8a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0069630 tx=0x7f2bc80115a0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 shutdown_connections 2024-09-12T02:29:55.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bbc06be30 0x7f2bbc06e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd00c5060 0x7f2bd014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd014d810 0x7f2bd00ae8a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 --2- 172.21.15.181:0/2980536336 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bb80039e0 0x7f2bd01f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 >> 172.21.15.181:0/2980536336 conn(0x7f2bd006bc10 msgr2=0x7f2bd00b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 shutdown_connections 2024-09-12T02:29:55.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:55.887+0000 7f2bd5b3a640 1 -- 172.21.15.181:0/2980536336 wait complete. 2024-09-12T02:29:55.899 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-12T02:29:55.630917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221276,"kb_used_data":5008,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753444,"statfs":{"total":773094113280,"available":772867526656,"internally_reserved":0,"allocated":5128192,"data_stored":2746954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040702"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.625024+0000","last_change":"2024-09-12T02:29:52.619457+0000","last_active":"2024-09-12T02:29:52.625024+0000","last_peered":"2024-09-12T02:29:52.625024+0000","last_clean":"2024-09-12T02:29:52.625024+0000","last_became_active":"2024-09-12T02:29:52.618250+0000","last_became_peered":"2024-09-12T02:29:52.618250+0000","last_unstale":"2024-09-12T02:29:52.625024+0000","last_undegraded":"2024-09-12T02:29:52.625024+0000","last_fullsized":"2024-09-12T02:29:52.625024+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633756+0000","last_change":"2024-09-12T02:29:52.629942+0000","last_active":"2024-09-12T02:29:52.633756+0000","last_peered":"2024-09-12T02:29:52.633756+0000","last_clean":"2024-09-12T02:29:52.633756+0000","last_became_active":"2024-09-12T02:29:52.629644+0000","last_became_peered":"2024-09-12T02:29:52.629644+0000","last_unstale":"2024-09-12T02:29:52.633756+0000","last_undegraded":"2024-09-12T02:29:52.633756+0000","last_fullsized":"2024-09-12T02:29:52.633756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.617035+0000","last_change":"2024-09-12T02:29:52.615494+0000","last_active":"2024-09-12T02:29:52.617035+0000","last_peered":"2024-09-12T02:29:52.617035+0000","last_clean":"2024-09-12T02:29:52.617035+0000","last_became_active":"2024-09-12T02:29:52.615083+0000","last_became_peered":"2024-09-12T02:29:52.615083+0000","last_unstale":"2024-09-12T02:29:52.617035+0000","last_undegraded":"2024-09-12T02:29:52.617035+0000","last_fullsized":"2024-09-12T02:29:52.617035+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629689+0000","last_change":"2024-09-12T02:29:52.625892+0000","last_active":"2024-09-12T02:29:52.629689+0000","last_peered":"2024-09-12T02:29:52.629689+0000","last_clean":"2024-09-12T02:29:52.629689+0000","last_became_active":"2024-09-12T02:29:52.624192+0000","last_became_peered":"2024-09-12T02:29:52.624192+0000","last_unstale":"2024-09-12T02:29:52.629689+0000","last_undegraded":"2024-09-12T02:29:52.629689+0000","last_fullsized":"2024-09-12T02:29:52.629689+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:01.527513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.628571+0000","last_change":"2024-09-12T02:29:52.624531+0000","last_active":"2024-09-12T02:29:52.628571+0000","last_peered":"2024-09-12T02:29:52.628571+0000","last_clean":"2024-09-12T02:29:52.628571+0000","last_became_active":"2024-09-12T02:29:52.624183+0000","last_became_peered":"2024-09-12T02:29:52.624183+0000","last_unstale":"2024-09-12T02:29:52.628571+0000","last_undegraded":"2024-09-12T02:29:52.628571+0000","last_fullsized":"2024-09-12T02:29:52.628571+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.591953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601065+0000","last_change":"2024-09-12T02:29:51.601065+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601065+0000","last_undegraded":"2024-09-12T02:29:51.601065+0000","last_fullsized":"2024-09-12T02:29:51.601065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627874+0000","last_change":"2024-09-12T02:29:52.623493+0000","last_active":"2024-09-12T02:29:52.627874+0000","last_peered":"2024-09-12T02:29:52.627874+0000","last_clean":"2024-09-12T02:29:52.627874+0000","last_became_active":"2024-09-12T02:29:52.623167+0000","last_became_peered":"2024-09-12T02:29:52.623167+0000","last_unstale":"2024-09-12T02:29:52.627874+0000","last_undegraded":"2024-09-12T02:29:52.627874+0000","last_fullsized":"2024-09-12T02:29:52.627874+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:12.948177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630564+0000","last_change":"2024-09-12T02:29:52.626794+0000","last_active":"2024-09-12T02:29:52.630564+0000","last_peered":"2024-09-12T02:29:52.630564+0000","last_clean":"2024-09-12T02:29:52.630564+0000","last_became_active":"2024-09-12T02:29:52.626539+0000","last_became_peered":"2024-09-12T02:29:52.626539+0000","last_unstale":"2024-09-12T02:29:52.630564+0000","last_undegraded":"2024-09-12T02:29:52.630564+0000","last_fullsized":"2024-09-12T02:29:52.630564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639139+0000","last_change":"2024-09-12T02:29:52.630608+0000","last_active":"2024-09-12T02:29:52.639139+0000","last_peered":"2024-09-12T02:29:52.639139+0000","last_clean":"2024-09-12T02:29:52.639139+0000","last_became_active":"2024-09-12T02:29:52.630375+0000","last_became_peered":"2024-09-12T02:29:52.630375+0000","last_unstale":"2024-09-12T02:29:52.639139+0000","last_undegraded":"2024-09-12T02:29:52.639139+0000","last_fullsized":"2024-09-12T02:29:52.639139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629762+0000","last_change":"2024-09-12T02:29:52.626665+0000","last_active":"2024-09-12T02:29:52.629762+0000","last_peered":"2024-09-12T02:29:52.629762+0000","last_clean":"2024-09-12T02:29:52.629762+0000","last_became_active":"2024-09-12T02:29:52.623946+0000","last_became_peered":"2024-09-12T02:29:52.623946+0000","last_unstale":"2024-09-12T02:29:52.629762+0000","last_undegraded":"2024-09-12T02:29:52.629762+0000","last_fullsized":"2024-09-12T02:29:52.629762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639512+0000","last_change":"2024-09-12T02:29:52.631057+0000","last_active":"2024-09-12T02:29:52.639512+0000","last_peered":"2024-09-12T02:29:52.639512+0000","last_clean":"2024-09-12T02:29:52.639512+0000","last_became_active":"2024-09-12T02:29:52.630774+0000","last_became_peered":"2024-09-12T02:29:52.630774+0000","last_unstale":"2024-09-12T02:29:52.639512+0000","last_undegraded":"2024-09-12T02:29:52.639512+0000","last_fullsized":"2024-09-12T02:29:52.639512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633831+0000","last_change":"2024-09-12T02:29:52.629995+0000","last_active":"2024-09-12T02:29:52.633831+0000","last_peered":"2024-09-12T02:29:52.633831+0000","last_clean":"2024-09-12T02:29:52.633831+0000","last_became_active":"2024-09-12T02:29:52.629259+0000","last_became_peered":"2024-09-12T02:29:52.629259+0000","last_unstale":"2024-09-12T02:29:52.633831+0000","last_undegraded":"2024-09-12T02:29:52.633831+0000","last_fullsized":"2024-09-12T02:29:52.633831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598286+0000","last_change":"2024-09-12T02:29:51.598286+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598286+0000","last_undegraded":"2024-09-12T02:29:51.598286+0000","last_fullsized":"2024-09-12T02:29:51.598286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631568+0000","last_change":"2024-09-12T02:29:52.627901+0000","last_active":"2024-09-12T02:29:52.631568+0000","last_peered":"2024-09-12T02:29:52.631568+0000","last_clean":"2024-09-12T02:29:52.631568+0000","last_became_active":"2024-09-12T02:29:52.627653+0000","last_became_peered":"2024-09-12T02:29:52.627653+0000","last_unstale":"2024-09-12T02:29:52.631568+0000","last_undegraded":"2024-09-12T02:29:52.631568+0000","last_fullsized":"2024-09-12T02:29:52.631568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601418+0000","last_change":"2024-09-12T02:29:51.601418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601418+0000","last_undegraded":"2024-09-12T02:29:51.601418+0000","last_fullsized":"2024-09-12T02:29:51.601418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630467+0000","last_change":"2024-09-12T02:29:52.627443+0000","last_active":"2024-09-12T02:29:52.630467+0000","last_peered":"2024-09-12T02:29:52.630467+0000","last_clean":"2024-09-12T02:29:52.630467+0000","last_became_active":"2024-09-12T02:29:52.627180+0000","last_became_peered":"2024-09-12T02:29:52.627180+0000","last_unstale":"2024-09-12T02:29:52.630467+0000","last_undegraded":"2024-09-12T02:29:52.630467+0000","last_fullsized":"2024-09-12T02:29:52.630467+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:48.076991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627324+0000","last_change":"2024-09-12T02:29:52.621284+0000","last_active":"2024-09-12T02:29:52.627324+0000","last_peered":"2024-09-12T02:29:52.627324+0000","last_clean":"2024-09-12T02:29:52.627324+0000","last_became_active":"2024-09-12T02:29:52.620998+0000","last_became_peered":"2024-09-12T02:29:52.620998+0000","last_unstale":"2024-09-12T02:29:52.627324+0000","last_undegraded":"2024-09-12T02:29:52.627324+0000","last_fullsized":"2024-09-12T02:29:52.627324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633638+0000","last_change":"2024-09-12T02:29:52.629899+0000","last_active":"2024-09-12T02:29:52.633638+0000","last_peered":"2024-09-12T02:29:52.633638+0000","last_clean":"2024-09-12T02:29:52.633638+0000","last_became_active":"2024-09-12T02:29:52.628179+0000","last_became_peered":"2024-09-12T02:29:52.628179+0000","last_unstale":"2024-09-12T02:29:52.633638+0000","last_undegraded":"2024-09-12T02:29:52.633638+0000","last_fullsized":"2024-09-12T02:29:52.633638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630542+0000","last_change":"2024-09-12T02:29:52.626757+0000","last_active":"2024-09-12T02:29:52.630542+0000","last_peered":"2024-09-12T02:29:52.630542+0000","last_clean":"2024-09-12T02:29:52.630542+0000","last_became_active":"2024-09-12T02:29:52.626506+0000","last_became_peered":"2024-09-12T02:29:52.626506+0000","last_unstale":"2024-09-12T02:29:52.630542+0000","last_undegraded":"2024-09-12T02:29:52.630542+0000","last_fullsized":"2024-09-12T02:29:52.630542+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:10.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598639+0000","last_change":"2024-09-12T02:29:51.598639+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598639+0000","last_undegraded":"2024-09-12T02:29:51.598639+0000","last_fullsized":"2024-09-12T02:29:51.598639+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.604028+0000","last_change":"2024-09-12T02:29:51.604028+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.604028+0000","last_undegraded":"2024-09-12T02:29:51.604028+0000","last_fullsized":"2024-09-12T02:29:51.604028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629606+0000","last_change":"2024-09-12T02:29:52.626049+0000","last_active":"2024-09-12T02:29:52.629606+0000","last_peered":"2024-09-12T02:29:52.629606+0000","last_clean":"2024-09-12T02:29:52.629606+0000","last_became_active":"2024-09-12T02:29:52.623834+0000","last_became_peered":"2024-09-12T02:29:52.623834+0000","last_unstale":"2024-09-12T02:29:52.629606+0000","last_undegraded":"2024-09-12T02:29:52.629606+0000","last_fullsized":"2024-09-12T02:29:52.629606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623785+0000","last_change":"2024-09-12T02:29:52.619585+0000","last_active":"2024-09-12T02:29:52.623785+0000","last_peered":"2024-09-12T02:29:52.623785+0000","last_clean":"2024-09-12T02:29:52.623785+0000","last_became_active":"2024-09-12T02:29:52.619083+0000","last_became_peered":"2024-09-12T02:29:52.619083+0000","last_unstale":"2024-09-12T02:29:52.623785+0000","last_undegraded":"2024-09-12T02:29:52.623785+0000","last_fullsized":"2024-09-12T02:29:52.623785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:45.067612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623751+0000","last_change":"2024-09-12T02:29:52.619566+0000","last_active":"2024-09-12T02:29:52.623751+0000","last_peered":"2024-09-12T02:29:52.623751+0000","last_clean":"2024-09-12T02:29:52.623751+0000","last_became_active":"2024-09-12T02:29:52.619287+0000","last_became_peered":"2024-09-12T02:29:52.619287+0000","last_unstale":"2024-09-12T02:29:52.623751+0000","last_undegraded":"2024-09-12T02:29:52.623751+0000","last_fullsized":"2024-09-12T02:29:52.623751+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:46.440930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629858+0000","last_change":"2024-09-12T02:29:52.624234+0000","last_active":"2024-09-12T02:29:52.629858+0000","last_peered":"2024-09-12T02:29:52.629858+0000","last_clean":"2024-09-12T02:29:52.629858+0000","last_became_active":"2024-09-12T02:29:52.623944+0000","last_became_peered":"2024-09-12T02:29:52.623944+0000","last_unstale":"2024-09-12T02:29:52.629858+0000","last_undegraded":"2024-09-12T02:29:52.629858+0000","last_fullsized":"2024-09-12T02:29:52.629858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:07.728093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598877+0000","last_change":"2024-09-12T02:29:51.598877+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598877+0000","last_undegraded":"2024-09-12T02:29:51.598877+0000","last_fullsized":"2024-09-12T02:29:51.598877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627386+0000","last_change":"2024-09-12T02:29:52.621835+0000","last_active":"2024-09-12T02:29:52.627386+0000","last_peered":"2024-09-12T02:29:52.627386+0000","last_clean":"2024-09-12T02:29:52.627386+0000","last_became_active":"2024-09-12T02:29:52.621425+0000","last_became_peered":"2024-09-12T02:29:52.621425+0000","last_unstale":"2024-09-12T02:29:52.627386+0000","last_undegraded":"2024-09-12T02:29:52.627386+0000","last_fullsized":"2024-09-12T02:29:52.627386+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633713+0000","last_change":"2024-09-12T02:29:52.629253+0000","last_active":"2024-09-12T02:29:52.633713+0000","last_peered":"2024-09-12T02:29:52.633713+0000","last_clean":"2024-09-12T02:29:52.633713+0000","last_became_active":"2024-09-12T02:29:52.628886+0000","last_became_peered":"2024-09-12T02:29:52.628886+0000","last_unstale":"2024-09-12T02:29:52.633713+0000","last_undegraded":"2024-09-12T02:29:52.633713+0000","last_fullsized":"2024-09-12T02:29:52.633713+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:00.216010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.632417+0000","last_change":"2024-09-12T02:29:52.630703+0000","last_active":"2024-09-12T02:29:52.632417+0000","last_peered":"2024-09-12T02:29:52.632417+0000","last_clean":"2024-09-12T02:29:52.632417+0000","last_became_active":"2024-09-12T02:29:52.630404+0000","last_became_peered":"2024-09-12T02:29:52.630404+0000","last_unstale":"2024-09-12T02:29:52.632417+0000","last_undegraded":"2024-09-12T02:29:52.632417+0000","last_fullsized":"2024-09-12T02:29:52.632417+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.851862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623095+0000","last_change":"2024-09-12T02:29:52.619356+0000","last_active":"2024-09-12T02:29:52.623095+0000","last_peered":"2024-09-12T02:29:52.623095+0000","last_clean":"2024-09-12T02:29:52.623095+0000","last_became_active":"2024-09-12T02:29:52.618699+0000","last_became_peered":"2024-09-12T02:29:52.618699+0000","last_unstale":"2024-09-12T02:29:52.623095+0000","last_undegraded":"2024-09-12T02:29:52.623095+0000","last_fullsized":"2024-09-12T02:29:52.623095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600822+0000","last_change":"2024-09-12T02:29:51.600822+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600822+0000","last_undegraded":"2024-09-12T02:29:51.600822+0000","last_fullsized":"2024-09-12T02:29:51.600822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.597886+0000","last_change":"2024-09-12T02:29:51.597886+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.597886+0000","last_undegraded":"2024-09-12T02:29:51.597886+0000","last_fullsized":"2024-09-12T02:29:51.597886+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624697+0000","last_change":"2024-09-12T02:29:52.622329+0000","last_active":"2024-09-12T02:29:52.624697+0000","last_peered":"2024-09-12T02:29:52.624697+0000","last_clean":"2024-09-12T02:29:52.624697+0000","last_became_active":"2024-09-12T02:29:52.622085+0000","last_became_peered":"2024-09-12T02:29:52.622085+0000","last_unstale":"2024-09-12T02:29:52.624697+0000","last_undegraded":"2024-09-12T02:29:52.624697+0000","last_fullsized":"2024-09-12T02:29:52.624697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615102+0000","last_change":"2024-09-12T02:29:51.614012+0000","last_active":"2024-09-12T02:29:51.615102+0000","last_peered":"2024-09-12T02:29:51.615102+0000","last_clean":"2024-09-12T02:29:51.615102+0000","last_became_active":"2024-09-12T02:29:51.613643+0000","last_became_peered":"2024-09-12T02:29:51.613643+0000","last_unstale":"2024-09-12T02:29:51.615102+0000","last_undegraded":"2024-09-12T02:29:51.615102+0000","last_fullsized":"2024-09-12T02:29:51.615102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624124+0000","last_change":"2024-09-12T02:29:52.619287+0000","last_active":"2024-09-12T02:29:52.624124+0000","last_peered":"2024-09-12T02:29:52.624124+0000","last_clean":"2024-09-12T02:29:52.624124+0000","last_became_active":"2024-09-12T02:29:52.618727+0000","last_became_peered":"2024-09-12T02:29:52.618727+0000","last_unstale":"2024-09-12T02:29:52.624124+0000","last_undegraded":"2024-09-12T02:29:52.624124+0000","last_fullsized":"2024-09-12T02:29:52.624124+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:52.246079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638727+0000","last_change":"2024-09-12T02:29:51.616177+0000","last_active":"2024-09-12T02:29:52.638727+0000","last_peered":"2024-09-12T02:29:52.638727+0000","last_clean":"2024-09-12T02:29:52.638727+0000","last_became_active":"2024-09-12T02:29:51.615785+0000","last_became_peered":"2024-09-12T02:29:51.615785+0000","last_unstale":"2024-09-12T02:29:52.638727+0000","last_undegraded":"2024-09-12T02:29:52.638727+0000","last_fullsized":"2024-09-12T02:29:52.638727+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:59.369993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639012+0000","last_change":"2024-09-12T02:29:52.635785+0000","last_active":"2024-09-12T02:29:52.639012+0000","last_peered":"2024-09-12T02:29:52.639012+0000","last_clean":"2024-09-12T02:29:52.639012+0000","last_became_active":"2024-09-12T02:29:52.635600+0000","last_became_peered":"2024-09-12T02:29:52.635600+0000","last_unstale":"2024-09-12T02:29:52.639012+0000","last_undegraded":"2024-09-12T02:29:52.639012+0000","last_fullsized":"2024-09-12T02:29:52.639012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634179+0000","last_change":"2024-09-12T02:29:51.609063+0000","last_active":"2024-09-12T02:29:52.634179+0000","last_peered":"2024-09-12T02:29:52.634179+0000","last_clean":"2024-09-12T02:29:52.634179+0000","last_became_active":"2024-09-12T02:29:51.608783+0000","last_became_peered":"2024-09-12T02:29:51.608783+0000","last_unstale":"2024-09-12T02:29:52.634179+0000","last_undegraded":"2024-09-12T02:29:52.634179+0000","last_fullsized":"2024-09-12T02:29:52.634179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:33.174988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624739+0000","last_change":"2024-09-12T02:29:52.623116+0000","last_active":"2024-09-12T02:29:52.624739+0000","last_peered":"2024-09-12T02:29:52.624739+0000","last_clean":"2024-09-12T02:29:52.624739+0000","last_became_active":"2024-09-12T02:29:52.622677+0000","last_became_peered":"2024-09-12T02:29:52.622677+0000","last_unstale":"2024-09-12T02:29:52.624739+0000","last_undegraded":"2024-09-12T02:29:52.624739+0000","last_fullsized":"2024-09-12T02:29:52.624739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634095+0000","last_change":"2024-09-12T02:29:51.612680+0000","last_active":"2024-09-12T02:29:52.634095+0000","last_peered":"2024-09-12T02:29:52.634095+0000","last_clean":"2024-09-12T02:29:52.634095+0000","last_became_active":"2024-09-12T02:29:51.612387+0000","last_became_peered":"2024-09-12T02:29:51.612387+0000","last_unstale":"2024-09-12T02:29:52.634095+0000","last_undegraded":"2024-09-12T02:29:52.634095+0000","last_fullsized":"2024-09-12T02:29:52.634095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623116+0000","last_change":"2024-09-12T02:29:52.620087+0000","last_active":"2024-09-12T02:29:52.623116+0000","last_peered":"2024-09-12T02:29:52.623116+0000","last_clean":"2024-09-12T02:29:52.623116+0000","last_became_active":"2024-09-12T02:29:52.619795+0000","last_became_peered":"2024-09-12T02:29:52.619795+0000","last_unstale":"2024-09-12T02:29:52.623116+0000","last_undegraded":"2024-09-12T02:29:52.623116+0000","last_fullsized":"2024-09-12T02:29:52.623116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.613370+0000","last_change":"2024-09-12T02:29:51.609628+0000","last_active":"2024-09-12T02:29:51.613370+0000","last_peered":"2024-09-12T02:29:51.613370+0000","last_clean":"2024-09-12T02:29:51.613370+0000","last_became_active":"2024-09-12T02:29:51.609346+0000","last_became_peered":"2024-09-12T02:29:51.609346+0000","last_unstale":"2024-09-12T02:29:51.613370+0000","last_undegraded":"2024-09-12T02:29:51.613370+0000","last_fullsized":"2024-09-12T02:29:51.613370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:45.697011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639897+0000","last_change":"2024-09-12T02:29:52.635166+0000","last_active":"2024-09-12T02:29:52.639897+0000","last_peered":"2024-09-12T02:29:52.639897+0000","last_clean":"2024-09-12T02:29:52.639897+0000","last_became_active":"2024-09-12T02:29:52.634883+0000","last_became_peered":"2024-09-12T02:29:52.634883+0000","last_unstale":"2024-09-12T02:29:52.639897+0000","last_undegraded":"2024-09-12T02:29:52.639897+0000","last_fullsized":"2024-09-12T02:29:52.639897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.902749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638620+0000","last_change":"2024-09-12T02:29:51.618885+0000","last_active":"2024-09-12T02:29:52.638620+0000","last_peered":"2024-09-12T02:29:52.638620+0000","last_clean":"2024-09-12T02:29:52.638620+0000","last_became_active":"2024-09-12T02:29:51.618593+0000","last_became_peered":"2024-09-12T02:29:51.618593+0000","last_unstale":"2024-09-12T02:29:52.638620+0000","last_undegraded":"2024-09-12T02:29:52.638620+0000","last_fullsized":"2024-09-12T02:29:52.638620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630538+0000","last_change":"2024-09-12T02:29:52.626277+0000","last_active":"2024-09-12T02:29:52.630538+0000","last_peered":"2024-09-12T02:29:52.630538+0000","last_clean":"2024-09-12T02:29:52.630538+0000","last_became_active":"2024-09-12T02:29:52.624251+0000","last_became_peered":"2024-09-12T02:29:52.624251+0000","last_unstale":"2024-09-12T02:29:52.630538+0000","last_undegraded":"2024-09-12T02:29:52.630538+0000","last_fullsized":"2024-09-12T02:29:52.630538+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616081+0000","last_change":"2024-09-12T02:29:51.607855+0000","last_active":"2024-09-12T02:29:52.616081+0000","last_peered":"2024-09-12T02:29:52.616081+0000","last_clean":"2024-09-12T02:29:52.616081+0000","last_became_active":"2024-09-12T02:29:51.607577+0000","last_became_peered":"2024-09-12T02:29:51.607577+0000","last_unstale":"2024-09-12T02:29:52.616081+0000","last_undegraded":"2024-09-12T02:29:52.616081+0000","last_fullsized":"2024-09-12T02:29:52.616081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.981772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623263+0000","last_change":"2024-09-12T02:29:52.619061+0000","last_active":"2024-09-12T02:29:52.623263+0000","last_peered":"2024-09-12T02:29:52.623263+0000","last_clean":"2024-09-12T02:29:52.623263+0000","last_became_active":"2024-09-12T02:29:52.618591+0000","last_became_peered":"2024-09-12T02:29:52.618591+0000","last_unstale":"2024-09-12T02:29:52.623263+0000","last_undegraded":"2024-09-12T02:29:52.623263+0000","last_fullsized":"2024-09-12T02:29:52.623263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:49.116934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618137+0000","last_change":"2024-09-12T02:29:51.605916+0000","last_active":"2024-09-12T02:29:52.618137+0000","last_peered":"2024-09-12T02:29:52.618137+0000","last_clean":"2024-09-12T02:29:52.618137+0000","last_became_active":"2024-09-12T02:29:51.605679+0000","last_became_peered":"2024-09-12T02:29:51.605679+0000","last_unstale":"2024-09-12T02:29:52.618137+0000","last_undegraded":"2024-09-12T02:29:52.618137+0000","last_fullsized":"2024-09-12T02:29:52.618137+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.070779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630115+0000","last_change":"2024-09-12T02:29:52.625671+0000","last_active":"2024-09-12T02:29:52.630115+0000","last_peered":"2024-09-12T02:29:52.630115+0000","last_clean":"2024-09-12T02:29:52.630115+0000","last_became_active":"2024-09-12T02:29:52.625420+0000","last_became_peered":"2024-09-12T02:29:52.625420+0000","last_unstale":"2024-09-12T02:29:52.630115+0000","last_undegraded":"2024-09-12T02:29:52.630115+0000","last_fullsized":"2024-09-12T02:29:52.630115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611664+0000","last_change":"2024-09-12T02:29:51.613737+0000","last_active":"2024-09-12T02:29:52.611664+0000","last_peered":"2024-09-12T02:29:52.611664+0000","last_clean":"2024-09-12T02:29:52.611664+0000","last_became_active":"2024-09-12T02:29:51.613468+0000","last_became_peered":"2024-09-12T02:29:51.613468+0000","last_unstale":"2024-09-12T02:29:52.611664+0000","last_undegraded":"2024-09-12T02:29:52.611664+0000","last_fullsized":"2024-09-12T02:29:52.611664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627765+0000","last_change":"2024-09-12T02:29:52.621214+0000","last_active":"2024-09-12T02:29:52.627765+0000","last_peered":"2024-09-12T02:29:52.627765+0000","last_clean":"2024-09-12T02:29:52.627765+0000","last_became_active":"2024-09-12T02:29:52.620907+0000","last_became_peered":"2024-09-12T02:29:52.620907+0000","last_unstale":"2024-09-12T02:29:52.627765+0000","last_undegraded":"2024-09-12T02:29:52.627765+0000","last_fullsized":"2024-09-12T02:29:52.627765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618101+0000","last_change":"2024-09-12T02:29:51.609872+0000","last_active":"2024-09-12T02:29:52.618101+0000","last_peered":"2024-09-12T02:29:52.618101+0000","last_clean":"2024-09-12T02:29:52.618101+0000","last_became_active":"2024-09-12T02:29:51.609605+0000","last_became_peered":"2024-09-12T02:29:51.609605+0000","last_unstale":"2024-09-12T02:29:52.618101+0000","last_undegraded":"2024-09-12T02:29:52.618101+0000","last_fullsized":"2024-09-12T02:29:52.618101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:46.757750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.603183+0000","last_change":"2024-09-12T02:29:51.603183+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.603183+0000","last_undegraded":"2024-09-12T02:29:51.603183+0000","last_fullsized":"2024-09-12T02:29:51.603183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631741+0000","last_change":"2024-09-12T02:29:51.614666+0000","last_active":"2024-09-12T02:29:52.631741+0000","last_peered":"2024-09-12T02:29:52.631741+0000","last_clean":"2024-09-12T02:29:52.631741+0000","last_became_active":"2024-09-12T02:29:51.614405+0000","last_became_peered":"2024-09-12T02:29:51.614405+0000","last_unstale":"2024-09-12T02:29:52.631741+0000","last_undegraded":"2024-09-12T02:29:52.631741+0000","last_fullsized":"2024-09-12T02:29:52.631741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.623412+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.623148+0000","last_became_peered":"2024-09-12T02:29:52.623148+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.391061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.617828+0000","last_change":"2024-09-12T02:29:51.613589+0000","last_active":"2024-09-12T02:29:51.617828+0000","last_peered":"2024-09-12T02:29:51.617828+0000","last_clean":"2024-09-12T02:29:51.617828+0000","last_became_active":"2024-09-12T02:29:51.613319+0000","last_became_peered":"2024-09-12T02:29:51.613319+0000","last_unstale":"2024-09-12T02:29:51.617828+0000","last_undegraded":"2024-09-12T02:29:51.617828+0000","last_fullsized":"2024-09-12T02:29:51.617828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:24.270926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630859+0000","last_change":"2024-09-12T02:29:52.625357+0000","last_active":"2024-09-12T02:29:52.630859+0000","last_peered":"2024-09-12T02:29:52.630859+0000","last_clean":"2024-09-12T02:29:52.630859+0000","last_became_active":"2024-09-12T02:29:52.625103+0000","last_became_peered":"2024-09-12T02:29:52.625103+0000","last_unstale":"2024-09-12T02:29:52.630859+0000","last_undegraded":"2024-09-12T02:29:52.630859+0000","last_fullsized":"2024-09-12T02:29:52.630859+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.460761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615064+0000","last_change":"2024-09-12T02:29:51.613802+0000","last_active":"2024-09-12T02:29:51.615064+0000","last_peered":"2024-09-12T02:29:51.615064+0000","last_clean":"2024-09-12T02:29:51.615064+0000","last_became_active":"2024-09-12T02:29:51.613156+0000","last_became_peered":"2024-09-12T02:29:51.613156+0000","last_unstale":"2024-09-12T02:29:51.615064+0000","last_undegraded":"2024-09-12T02:29:51.615064+0000","last_fullsized":"2024-09-12T02:29:51.615064+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:38.552485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629660+0000","last_change":"2024-09-12T02:29:52.622189+0000","last_active":"2024-09-12T02:29:52.629660+0000","last_peered":"2024-09-12T02:29:52.629660+0000","last_clean":"2024-09-12T02:29:52.629660+0000","last_became_active":"2024-09-12T02:29:52.620723+0000","last_became_peered":"2024-09-12T02:29:52.620723+0000","last_unstale":"2024-09-12T02:29:52.629660+0000","last_undegraded":"2024-09-12T02:29:52.629660+0000","last_fullsized":"2024-09-12T02:29:52.629660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612995+0000","last_change":"2024-09-12T02:29:51.611049+0000","last_active":"2024-09-12T02:29:52.612995+0000","last_peered":"2024-09-12T02:29:52.612995+0000","last_clean":"2024-09-12T02:29:52.612995+0000","last_became_active":"2024-09-12T02:29:51.610685+0000","last_became_peered":"2024-09-12T02:29:51.610685+0000","last_unstale":"2024-09-12T02:29:52.612995+0000","last_undegraded":"2024-09-12T02:29:52.612995+0000","last_fullsized":"2024-09-12T02:29:52.612995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.599773+0000","last_change":"2024-09-12T02:29:51.599773+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.599773+0000","last_undegraded":"2024-09-12T02:29:51.599773+0000","last_fullsized":"2024-09-12T02:29:51.599773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612436+0000","last_change":"2024-09-12T02:29:51.607416+0000","last_active":"2024-09-12T02:29:51.612436+0000","last_peered":"2024-09-12T02:29:51.612436+0000","last_clean":"2024-09-12T02:29:51.612436+0000","last_became_active":"2024-09-12T02:29:51.607099+0000","last_became_peered":"2024-09-12T02:29:51.607099+0000","last_unstale":"2024-09-12T02:29:51.612436+0000","last_undegraded":"2024-09-12T02:29:51.612436+0000","last_fullsized":"2024-09-12T02:29:51.612436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.652426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.622184+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.621910+0000","last_became_peered":"2024-09-12T02:29:52.621910+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.644576+0000","last_change":"2024-09-12T02:29:51.609082+0000","last_active":"2024-09-12T02:29:52.644576+0000","last_peered":"2024-09-12T02:29:52.644576+0000","last_clean":"2024-09-12T02:29:52.644576+0000","last_became_active":"2024-09-12T02:29:51.608827+0000","last_became_peered":"2024-09-12T02:29:51.608827+0000","last_unstale":"2024-09-12T02:29:52.644576+0000","last_undegraded":"2024-09-12T02:29:52.644576+0000","last_fullsized":"2024-09-12T02:29:52.644576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598411+0000","last_change":"2024-09-12T02:29:51.598411+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598411+0000","last_undegraded":"2024-09-12T02:29:51.598411+0000","last_fullsized":"2024-09-12T02:29:51.598411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612888+0000","last_change":"2024-09-12T02:29:51.607882+0000","last_active":"2024-09-12T02:29:51.612888+0000","last_peered":"2024-09-12T02:29:51.612888+0000","last_clean":"2024-09-12T02:29:51.612888+0000","last_became_active":"2024-09-12T02:29:51.607629+0000","last_became_peered":"2024-09-12T02:29:51.607629+0000","last_unstale":"2024-09-12T02:29:51.612888+0000","last_undegraded":"2024-09-12T02:29:51.612888+0000","last_fullsized":"2024-09-12T02:29:51.612888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:57.296742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639924+0000","last_change":"2024-09-12T02:29:52.636838+0000","last_active":"2024-09-12T02:29:52.639924+0000","last_peered":"2024-09-12T02:29:52.639924+0000","last_clean":"2024-09-12T02:29:52.639924+0000","last_became_active":"2024-09-12T02:29:52.636501+0000","last_became_peered":"2024-09-12T02:29:52.636501+0000","last_unstale":"2024-09-12T02:29:52.639924+0000","last_undegraded":"2024-09-12T02:29:52.639924+0000","last_fullsized":"2024-09-12T02:29:52.639924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:26.154285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638925+0000","last_change":"2024-09-12T02:29:51.614040+0000","last_active":"2024-09-12T02:29:52.638925+0000","last_peered":"2024-09-12T02:29:52.638925+0000","last_clean":"2024-09-12T02:29:52.638925+0000","last_became_active":"2024-09-12T02:29:51.613358+0000","last_became_peered":"2024-09-12T02:29:51.613358+0000","last_unstale":"2024-09-12T02:29:52.638925+0000","last_undegraded":"2024-09-12T02:29:52.638925+0000","last_fullsized":"2024-09-12T02:29:52.638925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638828+0000","last_change":"2024-09-12T02:29:52.636869+0000","last_active":"2024-09-12T02:29:52.638828+0000","last_peered":"2024-09-12T02:29:52.638828+0000","last_clean":"2024-09-12T02:29:52.638828+0000","last_became_active":"2024-09-12T02:29:52.636670+0000","last_became_peered":"2024-09-12T02:29:52.636670+0000","last_unstale":"2024-09-12T02:29:52.638828+0000","last_undegraded":"2024-09-12T02:29:52.638828+0000","last_fullsized":"2024-09-12T02:29:52.638828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631254+0000","last_change":"2024-09-12T02:29:51.607951+0000","last_active":"2024-09-12T02:29:52.631254+0000","last_peered":"2024-09-12T02:29:52.631254+0000","last_clean":"2024-09-12T02:29:52.631254+0000","last_became_active":"2024-09-12T02:29:51.607630+0000","last_became_peered":"2024-09-12T02:29:51.607630+0000","last_unstale":"2024-09-12T02:29:52.631254+0000","last_undegraded":"2024-09-12T02:29:52.631254+0000","last_fullsized":"2024-09-12T02:29:52.631254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624823+0000","last_change":"2024-09-12T02:29:52.622191+0000","last_active":"2024-09-12T02:29:52.624823+0000","last_peered":"2024-09-12T02:29:52.624823+0000","last_clean":"2024-09-12T02:29:52.624823+0000","last_became_active":"2024-09-12T02:29:52.621584+0000","last_became_peered":"2024-09-12T02:29:52.621584+0000","last_unstale":"2024-09-12T02:29:52.624823+0000","last_undegraded":"2024-09-12T02:29:52.624823+0000","last_fullsized":"2024-09-12T02:29:52.624823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.365214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615558+0000","last_change":"2024-09-12T02:29:51.614595+0000","last_active":"2024-09-12T02:29:51.615558+0000","last_peered":"2024-09-12T02:29:51.615558+0000","last_clean":"2024-09-12T02:29:51.615558+0000","last_became_active":"2024-09-12T02:29:51.614265+0000","last_became_peered":"2024-09-12T02:29:51.614265+0000","last_unstale":"2024-09-12T02:29:51.615558+0000","last_undegraded":"2024-09-12T02:29:51.615558+0000","last_fullsized":"2024-09-12T02:29:51.615558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:20.937452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600616+0000","last_change":"2024-09-12T02:29:51.600616+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600616+0000","last_undegraded":"2024-09-12T02:29:51.600616+0000","last_fullsized":"2024-09-12T02:29:51.600616+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.609795+0000","last_change":"2024-09-12T02:29:51.606261+0000","last_active":"2024-09-12T02:29:51.609795+0000","last_peered":"2024-09-12T02:29:51.609795+0000","last_clean":"2024-09-12T02:29:51.609795+0000","last_became_active":"2024-09-12T02:29:51.605989+0000","last_became_peered":"2024-09-12T02:29:51.605989+0000","last_unstale":"2024-09-12T02:29:51.609795+0000","last_undegraded":"2024-09-12T02:29:51.609795+0000","last_fullsized":"2024-09-12T02:29:51.609795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:46.210505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627339+0000","last_change":"2024-09-12T02:29:52.624877+0000","last_active":"2024-09-12T02:29:52.627339+0000","last_peered":"2024-09-12T02:29:52.627339+0000","last_clean":"2024-09-12T02:29:52.627339+0000","last_became_active":"2024-09-12T02:29:52.624540+0000","last_became_peered":"2024-09-12T02:29:52.624540+0000","last_unstale":"2024-09-12T02:29:52.627339+0000","last_undegraded":"2024-09-12T02:29:52.627339+0000","last_fullsized":"2024-09-12T02:29:52.627339+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616102+0000","last_change":"2024-09-12T02:29:51.603198+0000","last_active":"2024-09-12T02:29:52.616102+0000","last_peered":"2024-09-12T02:29:52.616102+0000","last_clean":"2024-09-12T02:29:52.616102+0000","last_became_active":"2024-09-12T02:29:51.602891+0000","last_became_peered":"2024-09-12T02:29:51.602891+0000","last_unstale":"2024-09-12T02:29:52.616102+0000","last_undegraded":"2024-09-12T02:29:52.616102+0000","last_fullsized":"2024-09-12T02:29:52.616102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598418+0000","last_change":"2024-09-12T02:29:51.598418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598418+0000","last_undegraded":"2024-09-12T02:29:51.598418+0000","last_fullsized":"2024-09-12T02:29:51.598418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.615892+0000","last_change":"2024-09-12T02:29:51.609912+0000","last_active":"2024-09-12T02:29:52.615892+0000","last_peered":"2024-09-12T02:29:52.615892+0000","last_clean":"2024-09-12T02:29:52.615892+0000","last_became_active":"2024-09-12T02:29:51.609646+0000","last_became_peered":"2024-09-12T02:29:51.609646+0000","last_unstale":"2024-09-12T02:29:52.615892+0000","last_undegraded":"2024-09-12T02:29:52.615892+0000","last_fullsized":"2024-09-12T02:29:52.615892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.455790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639646+0000","last_change":"2024-09-12T02:29:52.631060+0000","last_active":"2024-09-12T02:29:52.639646+0000","last_peered":"2024-09-12T02:29:52.639646+0000","last_clean":"2024-09-12T02:29:52.639646+0000","last_became_active":"2024-09-12T02:29:52.630218+0000","last_became_peered":"2024-09-12T02:29:52.630218+0000","last_unstale":"2024-09-12T02:29:52.639646+0000","last_undegraded":"2024-09-12T02:29:52.639646+0000","last_fullsized":"2024-09-12T02:29:52.639646+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:27.285618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614576+0000","last_change":"2024-09-12T02:29:51.613668+0000","last_active":"2024-09-12T02:29:52.614576+0000","last_peered":"2024-09-12T02:29:52.614576+0000","last_clean":"2024-09-12T02:29:52.614576+0000","last_became_active":"2024-09-12T02:29:51.612615+0000","last_became_peered":"2024-09-12T02:29:51.612615+0000","last_unstale":"2024-09-12T02:29:52.614576+0000","last_undegraded":"2024-09-12T02:29:52.614576+0000","last_fullsized":"2024-09-12T02:29:52.614576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:59.211039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630298+0000","last_change":"2024-09-12T02:29:52.626071+0000","last_active":"2024-09-12T02:29:52.630298+0000","last_peered":"2024-09-12T02:29:52.630298+0000","last_clean":"2024-09-12T02:29:52.630298+0000","last_became_active":"2024-09-12T02:29:52.625734+0000","last_became_peered":"2024-09-12T02:29:52.625734+0000","last_unstale":"2024-09-12T02:29:52.630298+0000","last_undegraded":"2024-09-12T02:29:52.630298+0000","last_fullsized":"2024-09-12T02:29:52.630298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.762721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.614269+0000","last_change":"2024-09-12T02:29:51.613594+0000","last_active":"2024-09-12T02:29:51.614269+0000","last_peered":"2024-09-12T02:29:51.614269+0000","last_clean":"2024-09-12T02:29:51.614269+0000","last_became_active":"2024-09-12T02:29:51.613308+0000","last_became_peered":"2024-09-12T02:29:51.613308+0000","last_unstale":"2024-09-12T02:29:51.614269+0000","last_undegraded":"2024-09-12T02:29:51.614269+0000","last_fullsized":"2024-09-12T02:29:51.614269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:57.658906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629833+0000","last_change":"2024-09-12T02:29:52.626950+0000","last_active":"2024-09-12T02:29:52.629833+0000","last_peered":"2024-09-12T02:29:52.629833+0000","last_clean":"2024-09-12T02:29:52.629833+0000","last_became_active":"2024-09-12T02:29:52.624339+0000","last_became_peered":"2024-09-12T02:29:52.624339+0000","last_unstale":"2024-09-12T02:29:52.629833+0000","last_undegraded":"2024-09-12T02:29:52.629833+0000","last_fullsized":"2024-09-12T02:29:52.629833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614224+0000","last_change":"2024-09-12T02:29:51.614143+0000","last_active":"2024-09-12T02:29:52.614224+0000","last_peered":"2024-09-12T02:29:52.614224+0000","last_clean":"2024-09-12T02:29:52.614224+0000","last_became_active":"2024-09-12T02:29:51.613862+0000","last_became_peered":"2024-09-12T02:29:51.613862+0000","last_unstale":"2024-09-12T02:29:52.614224+0000","last_undegraded":"2024-09-12T02:29:52.614224+0000","last_fullsized":"2024-09-12T02:29:52.614224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.971168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633485+0000","last_change":"2024-09-12T02:29:52.628947+0000","last_active":"2024-09-12T02:29:52.633485+0000","last_peered":"2024-09-12T02:29:52.633485+0000","last_clean":"2024-09-12T02:29:52.633485+0000","last_became_active":"2024-09-12T02:29:52.628641+0000","last_became_peered":"2024-09-12T02:29:52.628641+0000","last_unstale":"2024-09-12T02:29:52.633485+0000","last_undegraded":"2024-09-12T02:29:52.633485+0000","last_fullsized":"2024-09-12T02:29:52.633485+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.950748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612520+0000","last_change":"2024-09-12T02:29:51.608188+0000","last_active":"2024-09-12T02:29:52.612520+0000","last_peered":"2024-09-12T02:29:52.612520+0000","last_clean":"2024-09-12T02:29:52.612520+0000","last_became_active":"2024-09-12T02:29:51.607861+0000","last_became_peered":"2024-09-12T02:29:51.607861+0000","last_unstale":"2024-09-12T02:29:52.612520+0000","last_undegraded":"2024-09-12T02:29:52.612520+0000","last_fullsized":"2024-09-12T02:29:52.612520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600158+0000","last_change":"2024-09-12T02:29:51.600158+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600158+0000","last_undegraded":"2024-09-12T02:29:51.600158+0000","last_fullsized":"2024-09-12T02:29:51.600158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614036+0000","last_change":"2024-09-12T02:29:51.614527+0000","last_active":"2024-09-12T02:29:52.614036+0000","last_peered":"2024-09-12T02:29:52.614036+0000","last_clean":"2024-09-12T02:29:52.614036+0000","last_became_active":"2024-09-12T02:29:51.614243+0000","last_became_peered":"2024-09-12T02:29:51.614243+0000","last_unstale":"2024-09-12T02:29:52.614036+0000","last_undegraded":"2024-09-12T02:29:52.614036+0000","last_fullsized":"2024-09-12T02:29:52.614036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:10.586982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600978+0000","last_change":"2024-09-12T02:29:51.600978+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600978+0000","last_undegraded":"2024-09-12T02:29:51.600978+0000","last_fullsized":"2024-09-12T02:29:51.600978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611085+0000","last_change":"2024-09-12T02:29:51.613803+0000","last_active":"2024-09-12T02:29:52.611085+0000","last_peered":"2024-09-12T02:29:52.611085+0000","last_clean":"2024-09-12T02:29:52.611085+0000","last_became_active":"2024-09-12T02:29:51.613523+0000","last_became_peered":"2024-09-12T02:29:51.613523+0000","last_unstale":"2024-09-12T02:29:52.611085+0000","last_undegraded":"2024-09-12T02:29:52.611085+0000","last_fullsized":"2024-09-12T02:29:52.611085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631071+0000","last_change":"2024-09-12T02:29:52.626820+0000","last_active":"2024-09-12T02:29:52.631071+0000","last_peered":"2024-09-12T02:29:52.631071+0000","last_clean":"2024-09-12T02:29:52.631071+0000","last_became_active":"2024-09-12T02:29:52.626379+0000","last_became_peered":"2024-09-12T02:29:52.626379+0000","last_unstale":"2024-09-12T02:29:52.631071+0000","last_undegraded":"2024-09-12T02:29:52.631071+0000","last_fullsized":"2024-09-12T02:29:52.631071+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:17.976139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612756+0000","last_change":"2024-09-12T02:29:51.603977+0000","last_active":"2024-09-12T02:29:52.612756+0000","last_peered":"2024-09-12T02:29:52.612756+0000","last_clean":"2024-09-12T02:29:52.612756+0000","last_became_active":"2024-09-12T02:29:51.603675+0000","last_became_peered":"2024-09-12T02:29:51.603675+0000","last_unstale":"2024-09-12T02:29:52.612756+0000","last_undegraded":"2024-09-12T02:29:52.612756+0000","last_fullsized":"2024-09-12T02:29:52.612756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627440+0000","last_change":"2024-09-12T02:29:52.622743+0000","last_active":"2024-09-12T02:29:52.627440+0000","last_peered":"2024-09-12T02:29:52.627440+0000","last_clean":"2024-09-12T02:29:52.627440+0000","last_became_active":"2024-09-12T02:29:52.622484+0000","last_became_peered":"2024-09-12T02:29:52.622484+0000","last_unstale":"2024-09-12T02:29:52.627440+0000","last_undegraded":"2024-09-12T02:29:52.627440+0000","last_fullsized":"2024-09-12T02:29:52.627440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618359+0000","last_change":"2024-09-12T02:29:51.607832+0000","last_active":"2024-09-12T02:29:52.618359+0000","last_peered":"2024-09-12T02:29:52.618359+0000","last_clean":"2024-09-12T02:29:52.618359+0000","last_became_active":"2024-09-12T02:29:51.607569+0000","last_became_peered":"2024-09-12T02:29:51.607569+0000","last_unstale":"2024-09-12T02:29:52.618359+0000","last_undegraded":"2024-09-12T02:29:52.618359+0000","last_fullsized":"2024-09-12T02:29:52.618359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629714+0000","last_change":"2024-09-12T02:29:52.622767+0000","last_active":"2024-09-12T02:29:52.629714+0000","last_peered":"2024-09-12T02:29:52.629714+0000","last_clean":"2024-09-12T02:29:52.629714+0000","last_became_active":"2024-09-12T02:29:52.622534+0000","last_became_peered":"2024-09-12T02:29:52.622534+0000","last_unstale":"2024-09-12T02:29:52.629714+0000","last_undegraded":"2024-09-12T02:29:52.629714+0000","last_fullsized":"2024-09-12T02:29:52.629714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:36.382720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.635166+0000","last_change":"2024-09-12T02:29:51.608005+0000","last_active":"2024-09-12T02:29:52.635166+0000","last_peered":"2024-09-12T02:29:52.635166+0000","last_clean":"2024-09-12T02:29:52.635166+0000","last_became_active":"2024-09-12T02:29:51.607721+0000","last_became_peered":"2024-09-12T02:29:51.607721+0000","last_unstale":"2024-09-12T02:29:52.635166+0000","last_undegraded":"2024-09-12T02:29:52.635166+0000","last_fullsized":"2024-09-12T02:29:52.635166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614664+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:52.614664+0000","last_peered":"2024-09-12T02:29:52.614664+0000","last_clean":"2024-09-12T02:29:52.614664+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:52.614664+0000","last_undegraded":"2024-09-12T02:29:52.614664+0000","last_fullsized":"2024-09-12T02:29:52.614664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:55.903 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:56.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.038+0000 7f3b96de8640 1 Processor -- start 2024-09-12T02:29:56.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.038+0000 7f3b96de8640 1 -- start start 2024-09-12T02:29:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b96de8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b900b5320 0x7f3b9015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b96de8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3b90070660 0x7f3b90070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b96de8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b90070f80 con 0x7f3b900d27b0 2024-09-12T02:29:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b96de8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3b900b5790 con 0x7f3b900b5320 2024-09-12T02:29:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b96de8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f3b9015e0c0 con 0x7f3b90070660 2024-09-12T02:29:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b87fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b900b5320 0x7f3b9015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b94b84640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3b900d27b0 0x7f3b9015d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44414/0 (socket says 172.21.15.181:44414) 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b94b84640 1 -- 172.21.15.181:0/2056717612 learned_addr learned my addr 172.21.15.181:0/2056717612 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b95385640 1 --2- 172.21.15.181:0/2056717612 >> v2:172.21.15.204:3300/0 conn(0x7f3b90070660 0x7f3b90070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b87fff640 1 -- 172.21.15.181:0/2056717612 >> v2:172.21.15.204:3300/0 conn(0x7f3b90070660 msgr2=0x7f3b90070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b87fff640 1 --2- 172.21.15.181:0/2056717612 >> v2:172.21.15.204:3300/0 conn(0x7f3b90070660 0x7f3b90070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b87fff640 1 -- 172.21.15.181:0/2056717612 >> v1:172.21.15.181:6789/0 conn(0x7f3b900d27b0 legacy=0x7f3b9015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b87fff640 1 -- 172.21.15.181:0/2056717612 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900b59b0 con 0x7f3b900b5320 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b877fe640 1 -- 172.21.15.181:0/2056717612 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229874271 0 0) 0x7f3b90070f80 con 0x7f3b900d27b0 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.039+0000 7f3b95385640 1 --2- 172.21.15.181:0/2056717612 >> v2:172.21.15.204:3300/0 conn(0x7f3b90070660 0x7f3b90070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.040+0000 7f3b87fff640 1 --2- 172.21.15.181:0/2056717612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b900b5320 0x7f3b9015d2e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b90071750 tx=0x7f3b8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15c1f8348c49c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.040+0000 7f3b877fe640 1 -- 172.21.15.181:0/2056717612 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80037070 con 0x7f3b900b5320 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.040+0000 7f3b877fe640 1 -- 172.21.15.181:0/2056717612 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b80032440 con 0x7f3b900b5320 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.040+0000 7f3b877fe640 1 -- 172.21.15.181:0/2056717612 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80032810 con 0x7f3b900b5320 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 -- 172.21.15.181:0/2056717612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b900b5320 msgr2=0x7f3b9015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 --2- 172.21.15.181:0/2056717612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b900b5320 0x7f3b9015d2e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b90071750 tx=0x7f3b8002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 -- 172.21.15.181:0/2056717612 shutdown_connections 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 --2- 172.21.15.181:0/2056717612 >> v2:172.21.15.204:3300/0 conn(0x7f3b90070660 0x7f3b90070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 --2- 172.21.15.181:0/2056717612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b900b5320 0x7f3b9015d2e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 -- 172.21.15.181:0/2056717612 >> 172.21.15.181:0/2056717612 conn(0x7f3b9006f400 msgr2=0x7f3b9006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 -- 172.21.15.181:0/2056717612 shutdown_connections 2024-09-12T02:29:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.041+0000 7f3b96de8640 1 -- 172.21.15.181:0/2056717612 wait complete. 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.042+0000 7f3b96de8640 1 Processor -- start 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.042+0000 7f3b96de8640 1 -- start start 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b96de8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b90070660 0x7f3b90151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b96de8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b900b5320 0x7f3b9006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b96de8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b900d27b0 0x7f3b900b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b96de8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900b6250 con 0x7f3b90070660 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b96de8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900b5f70 con 0x7f3b900b5320 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b96de8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3b900b6530 con 0x7f3b900d27b0 2024-09-12T02:29:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b90070660 0x7f3b90151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b90070660 0x7f3b90151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48400/0 (socket says 172.21.15.181:48400) 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 -- 172.21.15.181:0/694509350 learned_addr learned my addr 172.21.15.181:0/694509350 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 -- 172.21.15.181:0/694509350 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b900d27b0 msgr2=0x7f3b900b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b900d27b0 0x7f3b900b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 -- 172.21.15.181:0/694509350 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b900b5320 msgr2=0x7f3b9006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b900b5320 0x7f3b9006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 -- 172.21.15.181:0/694509350 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b901537a0 con 0x7f3b90070660 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.043+0000 7f3b94b84640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b90070660 0x7f3b90151750 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c430 tx=0x7f3b8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.044+0000 7f3b857fa640 1 -- 172.21.15.181:0/694509350 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0074e0 con 0x7f3b90070660 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.044+0000 7f3b857fa640 1 -- 172.21.15.181:0/694509350 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c0047e0 con 0x7f3b90070660 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.044+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b90153a80 con 0x7f3b90070660 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.044+0000 7f3b857fa640 1 -- 172.21.15.181:0/694509350 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c004bd0 con 0x7f3b90070660 2024-09-12T02:29:56.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.044+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b90154040 con 0x7f3b90070660 2024-09-12T02:29:56.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.044+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b900cef60 con 0x7f3b90070660 2024-09-12T02:29:56.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.045+0000 7f3b857fa640 1 -- 172.21.15.181:0/694509350 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b8c011070 con 0x7f3b90070660 2024-09-12T02:29:56.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.046+0000 7f3b857fa640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b7c06be30 0x7f3b7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.046+0000 7f3b87fff640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b7c06be30 0x7f3b7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.046+0000 7f3b857fa640 1 -- 172.21.15.181:0/694509350 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3b8c08ab00 con 0x7f3b90070660 2024-09-12T02:29:56.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.046+0000 7f3b87fff640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b7c06be30 0x7f3b7c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b80034000 tx=0x7f3b8002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.050+0000 7f3b857fa640 1 -- 172.21.15.181:0/694509350 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b900cef60 con 0x7f3b90070660 2024-09-12T02:29:56.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.212+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b900b2440 con 0x7f3b7c06be30 2024-09-12T02:29:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.218+0000 7f3b857fa640 1 -- 172.21.15.181:0/694509350 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250644 (secure 0 0 0) 0x7f3b900b2440 con 0x7f3b7c06be30 2024-09-12T02:29:56.221 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b7c06be30 msgr2=0x7f3b7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b7c06be30 0x7f3b7c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b80034000 tx=0x7f3b8002c000 comp rx=0 tx=0).stop 2024-09-12T02:29:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b90070660 msgr2=0x7f3b90151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b90070660 0x7f3b90151750 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c430 tx=0x7f3b8c00c8f0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 shutdown_connections 2024-09-12T02:29:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b7c06be30 0x7f3b7c06e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b900b5320 0x7f3b9006e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b900d27b0 0x7f3b900b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 --2- 172.21.15.181:0/694509350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b90070660 0x7f3b90151750 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 >> 172.21.15.181:0/694509350 conn(0x7f3b9006f400 msgr2=0x7f3b9015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 shutdown_connections 2024-09-12T02:29:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.221+0000 7f3b96de8640 1 -- 172.21.15.181:0/694509350 wait complete. 2024-09-12T02:29:56.233 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-12T02:29:55.630917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221276,"kb_used_data":5008,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753444,"statfs":{"total":773094113280,"available":772867526656,"internally_reserved":0,"allocated":5128192,"data_stored":2746954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040702"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.625024+0000","last_change":"2024-09-12T02:29:52.619457+0000","last_active":"2024-09-12T02:29:52.625024+0000","last_peered":"2024-09-12T02:29:52.625024+0000","last_clean":"2024-09-12T02:29:52.625024+0000","last_became_active":"2024-09-12T02:29:52.618250+0000","last_became_peered":"2024-09-12T02:29:52.618250+0000","last_unstale":"2024-09-12T02:29:52.625024+0000","last_undegraded":"2024-09-12T02:29:52.625024+0000","last_fullsized":"2024-09-12T02:29:52.625024+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633756+0000","last_change":"2024-09-12T02:29:52.629942+0000","last_active":"2024-09-12T02:29:52.633756+0000","last_peered":"2024-09-12T02:29:52.633756+0000","last_clean":"2024-09-12T02:29:52.633756+0000","last_became_active":"2024-09-12T02:29:52.629644+0000","last_became_peered":"2024-09-12T02:29:52.629644+0000","last_unstale":"2024-09-12T02:29:52.633756+0000","last_undegraded":"2024-09-12T02:29:52.633756+0000","last_fullsized":"2024-09-12T02:29:52.633756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.617035+0000","last_change":"2024-09-12T02:29:52.615494+0000","last_active":"2024-09-12T02:29:52.617035+0000","last_peered":"2024-09-12T02:29:52.617035+0000","last_clean":"2024-09-12T02:29:52.617035+0000","last_became_active":"2024-09-12T02:29:52.615083+0000","last_became_peered":"2024-09-12T02:29:52.615083+0000","last_unstale":"2024-09-12T02:29:52.617035+0000","last_undegraded":"2024-09-12T02:29:52.617035+0000","last_fullsized":"2024-09-12T02:29:52.617035+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629689+0000","last_change":"2024-09-12T02:29:52.625892+0000","last_active":"2024-09-12T02:29:52.629689+0000","last_peered":"2024-09-12T02:29:52.629689+0000","last_clean":"2024-09-12T02:29:52.629689+0000","last_became_active":"2024-09-12T02:29:52.624192+0000","last_became_peered":"2024-09-12T02:29:52.624192+0000","last_unstale":"2024-09-12T02:29:52.629689+0000","last_undegraded":"2024-09-12T02:29:52.629689+0000","last_fullsized":"2024-09-12T02:29:52.629689+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:01.527513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.628571+0000","last_change":"2024-09-12T02:29:52.624531+0000","last_active":"2024-09-12T02:29:52.628571+0000","last_peered":"2024-09-12T02:29:52.628571+0000","last_clean":"2024-09-12T02:29:52.628571+0000","last_became_active":"2024-09-12T02:29:52.624183+0000","last_became_peered":"2024-09-12T02:29:52.624183+0000","last_unstale":"2024-09-12T02:29:52.628571+0000","last_undegraded":"2024-09-12T02:29:52.628571+0000","last_fullsized":"2024-09-12T02:29:52.628571+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.591953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601065+0000","last_change":"2024-09-12T02:29:51.601065+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601065+0000","last_undegraded":"2024-09-12T02:29:51.601065+0000","last_fullsized":"2024-09-12T02:29:51.601065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627874+0000","last_change":"2024-09-12T02:29:52.623493+0000","last_active":"2024-09-12T02:29:52.627874+0000","last_peered":"2024-09-12T02:29:52.627874+0000","last_clean":"2024-09-12T02:29:52.627874+0000","last_became_active":"2024-09-12T02:29:52.623167+0000","last_became_peered":"2024-09-12T02:29:52.623167+0000","last_unstale":"2024-09-12T02:29:52.627874+0000","last_undegraded":"2024-09-12T02:29:52.627874+0000","last_fullsized":"2024-09-12T02:29:52.627874+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:12.948177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630564+0000","last_change":"2024-09-12T02:29:52.626794+0000","last_active":"2024-09-12T02:29:52.630564+0000","last_peered":"2024-09-12T02:29:52.630564+0000","last_clean":"2024-09-12T02:29:52.630564+0000","last_became_active":"2024-09-12T02:29:52.626539+0000","last_became_peered":"2024-09-12T02:29:52.626539+0000","last_unstale":"2024-09-12T02:29:52.630564+0000","last_undegraded":"2024-09-12T02:29:52.630564+0000","last_fullsized":"2024-09-12T02:29:52.630564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639139+0000","last_change":"2024-09-12T02:29:52.630608+0000","last_active":"2024-09-12T02:29:52.639139+0000","last_peered":"2024-09-12T02:29:52.639139+0000","last_clean":"2024-09-12T02:29:52.639139+0000","last_became_active":"2024-09-12T02:29:52.630375+0000","last_became_peered":"2024-09-12T02:29:52.630375+0000","last_unstale":"2024-09-12T02:29:52.639139+0000","last_undegraded":"2024-09-12T02:29:52.639139+0000","last_fullsized":"2024-09-12T02:29:52.639139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629762+0000","last_change":"2024-09-12T02:29:52.626665+0000","last_active":"2024-09-12T02:29:52.629762+0000","last_peered":"2024-09-12T02:29:52.629762+0000","last_clean":"2024-09-12T02:29:52.629762+0000","last_became_active":"2024-09-12T02:29:52.623946+0000","last_became_peered":"2024-09-12T02:29:52.623946+0000","last_unstale":"2024-09-12T02:29:52.629762+0000","last_undegraded":"2024-09-12T02:29:52.629762+0000","last_fullsized":"2024-09-12T02:29:52.629762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639512+0000","last_change":"2024-09-12T02:29:52.631057+0000","last_active":"2024-09-12T02:29:52.639512+0000","last_peered":"2024-09-12T02:29:52.639512+0000","last_clean":"2024-09-12T02:29:52.639512+0000","last_became_active":"2024-09-12T02:29:52.630774+0000","last_became_peered":"2024-09-12T02:29:52.630774+0000","last_unstale":"2024-09-12T02:29:52.639512+0000","last_undegraded":"2024-09-12T02:29:52.639512+0000","last_fullsized":"2024-09-12T02:29:52.639512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633831+0000","last_change":"2024-09-12T02:29:52.629995+0000","last_active":"2024-09-12T02:29:52.633831+0000","last_peered":"2024-09-12T02:29:52.633831+0000","last_clean":"2024-09-12T02:29:52.633831+0000","last_became_active":"2024-09-12T02:29:52.629259+0000","last_became_peered":"2024-09-12T02:29:52.629259+0000","last_unstale":"2024-09-12T02:29:52.633831+0000","last_undegraded":"2024-09-12T02:29:52.633831+0000","last_fullsized":"2024-09-12T02:29:52.633831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598286+0000","last_change":"2024-09-12T02:29:51.598286+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598286+0000","last_undegraded":"2024-09-12T02:29:51.598286+0000","last_fullsized":"2024-09-12T02:29:51.598286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631568+0000","last_change":"2024-09-12T02:29:52.627901+0000","last_active":"2024-09-12T02:29:52.631568+0000","last_peered":"2024-09-12T02:29:52.631568+0000","last_clean":"2024-09-12T02:29:52.631568+0000","last_became_active":"2024-09-12T02:29:52.627653+0000","last_became_peered":"2024-09-12T02:29:52.627653+0000","last_unstale":"2024-09-12T02:29:52.631568+0000","last_undegraded":"2024-09-12T02:29:52.631568+0000","last_fullsized":"2024-09-12T02:29:52.631568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601418+0000","last_change":"2024-09-12T02:29:51.601418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601418+0000","last_undegraded":"2024-09-12T02:29:51.601418+0000","last_fullsized":"2024-09-12T02:29:51.601418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630467+0000","last_change":"2024-09-12T02:29:52.627443+0000","last_active":"2024-09-12T02:29:52.630467+0000","last_peered":"2024-09-12T02:29:52.630467+0000","last_clean":"2024-09-12T02:29:52.630467+0000","last_became_active":"2024-09-12T02:29:52.627180+0000","last_became_peered":"2024-09-12T02:29:52.627180+0000","last_unstale":"2024-09-12T02:29:52.630467+0000","last_undegraded":"2024-09-12T02:29:52.630467+0000","last_fullsized":"2024-09-12T02:29:52.630467+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:48.076991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627324+0000","last_change":"2024-09-12T02:29:52.621284+0000","last_active":"2024-09-12T02:29:52.627324+0000","last_peered":"2024-09-12T02:29:52.627324+0000","last_clean":"2024-09-12T02:29:52.627324+0000","last_became_active":"2024-09-12T02:29:52.620998+0000","last_became_peered":"2024-09-12T02:29:52.620998+0000","last_unstale":"2024-09-12T02:29:52.627324+0000","last_undegraded":"2024-09-12T02:29:52.627324+0000","last_fullsized":"2024-09-12T02:29:52.627324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633638+0000","last_change":"2024-09-12T02:29:52.629899+0000","last_active":"2024-09-12T02:29:52.633638+0000","last_peered":"2024-09-12T02:29:52.633638+0000","last_clean":"2024-09-12T02:29:52.633638+0000","last_became_active":"2024-09-12T02:29:52.628179+0000","last_became_peered":"2024-09-12T02:29:52.628179+0000","last_unstale":"2024-09-12T02:29:52.633638+0000","last_undegraded":"2024-09-12T02:29:52.633638+0000","last_fullsized":"2024-09-12T02:29:52.633638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630542+0000","last_change":"2024-09-12T02:29:52.626757+0000","last_active":"2024-09-12T02:29:52.630542+0000","last_peered":"2024-09-12T02:29:52.630542+0000","last_clean":"2024-09-12T02:29:52.630542+0000","last_became_active":"2024-09-12T02:29:52.626506+0000","last_became_peered":"2024-09-12T02:29:52.626506+0000","last_unstale":"2024-09-12T02:29:52.630542+0000","last_undegraded":"2024-09-12T02:29:52.630542+0000","last_fullsized":"2024-09-12T02:29:52.630542+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:10.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598639+0000","last_change":"2024-09-12T02:29:51.598639+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598639+0000","last_undegraded":"2024-09-12T02:29:51.598639+0000","last_fullsized":"2024-09-12T02:29:51.598639+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.604028+0000","last_change":"2024-09-12T02:29:51.604028+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.604028+0000","last_undegraded":"2024-09-12T02:29:51.604028+0000","last_fullsized":"2024-09-12T02:29:51.604028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629606+0000","last_change":"2024-09-12T02:29:52.626049+0000","last_active":"2024-09-12T02:29:52.629606+0000","last_peered":"2024-09-12T02:29:52.629606+0000","last_clean":"2024-09-12T02:29:52.629606+0000","last_became_active":"2024-09-12T02:29:52.623834+0000","last_became_peered":"2024-09-12T02:29:52.623834+0000","last_unstale":"2024-09-12T02:29:52.629606+0000","last_undegraded":"2024-09-12T02:29:52.629606+0000","last_fullsized":"2024-09-12T02:29:52.629606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623785+0000","last_change":"2024-09-12T02:29:52.619585+0000","last_active":"2024-09-12T02:29:52.623785+0000","last_peered":"2024-09-12T02:29:52.623785+0000","last_clean":"2024-09-12T02:29:52.623785+0000","last_became_active":"2024-09-12T02:29:52.619083+0000","last_became_peered":"2024-09-12T02:29:52.619083+0000","last_unstale":"2024-09-12T02:29:52.623785+0000","last_undegraded":"2024-09-12T02:29:52.623785+0000","last_fullsized":"2024-09-12T02:29:52.623785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:45.067612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623751+0000","last_change":"2024-09-12T02:29:52.619566+0000","last_active":"2024-09-12T02:29:52.623751+0000","last_peered":"2024-09-12T02:29:52.623751+0000","last_clean":"2024-09-12T02:29:52.623751+0000","last_became_active":"2024-09-12T02:29:52.619287+0000","last_became_peered":"2024-09-12T02:29:52.619287+0000","last_unstale":"2024-09-12T02:29:52.623751+0000","last_undegraded":"2024-09-12T02:29:52.623751+0000","last_fullsized":"2024-09-12T02:29:52.623751+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:46.440930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629858+0000","last_change":"2024-09-12T02:29:52.624234+0000","last_active":"2024-09-12T02:29:52.629858+0000","last_peered":"2024-09-12T02:29:52.629858+0000","last_clean":"2024-09-12T02:29:52.629858+0000","last_became_active":"2024-09-12T02:29:52.623944+0000","last_became_peered":"2024-09-12T02:29:52.623944+0000","last_unstale":"2024-09-12T02:29:52.629858+0000","last_undegraded":"2024-09-12T02:29:52.629858+0000","last_fullsized":"2024-09-12T02:29:52.629858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:07.728093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598877+0000","last_change":"2024-09-12T02:29:51.598877+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598877+0000","last_undegraded":"2024-09-12T02:29:51.598877+0000","last_fullsized":"2024-09-12T02:29:51.598877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627386+0000","last_change":"2024-09-12T02:29:52.621835+0000","last_active":"2024-09-12T02:29:52.627386+0000","last_peered":"2024-09-12T02:29:52.627386+0000","last_clean":"2024-09-12T02:29:52.627386+0000","last_became_active":"2024-09-12T02:29:52.621425+0000","last_became_peered":"2024-09-12T02:29:52.621425+0000","last_unstale":"2024-09-12T02:29:52.627386+0000","last_undegraded":"2024-09-12T02:29:52.627386+0000","last_fullsized":"2024-09-12T02:29:52.627386+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633713+0000","last_change":"2024-09-12T02:29:52.629253+0000","last_active":"2024-09-12T02:29:52.633713+0000","last_peered":"2024-09-12T02:29:52.633713+0000","last_clean":"2024-09-12T02:29:52.633713+0000","last_became_active":"2024-09-12T02:29:52.628886+0000","last_became_peered":"2024-09-12T02:29:52.628886+0000","last_unstale":"2024-09-12T02:29:52.633713+0000","last_undegraded":"2024-09-12T02:29:52.633713+0000","last_fullsized":"2024-09-12T02:29:52.633713+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:00.216010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.632417+0000","last_change":"2024-09-12T02:29:52.630703+0000","last_active":"2024-09-12T02:29:52.632417+0000","last_peered":"2024-09-12T02:29:52.632417+0000","last_clean":"2024-09-12T02:29:52.632417+0000","last_became_active":"2024-09-12T02:29:52.630404+0000","last_became_peered":"2024-09-12T02:29:52.630404+0000","last_unstale":"2024-09-12T02:29:52.632417+0000","last_undegraded":"2024-09-12T02:29:52.632417+0000","last_fullsized":"2024-09-12T02:29:52.632417+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.851862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623095+0000","last_change":"2024-09-12T02:29:52.619356+0000","last_active":"2024-09-12T02:29:52.623095+0000","last_peered":"2024-09-12T02:29:52.623095+0000","last_clean":"2024-09-12T02:29:52.623095+0000","last_became_active":"2024-09-12T02:29:52.618699+0000","last_became_peered":"2024-09-12T02:29:52.618699+0000","last_unstale":"2024-09-12T02:29:52.623095+0000","last_undegraded":"2024-09-12T02:29:52.623095+0000","last_fullsized":"2024-09-12T02:29:52.623095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600822+0000","last_change":"2024-09-12T02:29:51.600822+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600822+0000","last_undegraded":"2024-09-12T02:29:51.600822+0000","last_fullsized":"2024-09-12T02:29:51.600822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.597886+0000","last_change":"2024-09-12T02:29:51.597886+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.597886+0000","last_undegraded":"2024-09-12T02:29:51.597886+0000","last_fullsized":"2024-09-12T02:29:51.597886+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624697+0000","last_change":"2024-09-12T02:29:52.622329+0000","last_active":"2024-09-12T02:29:52.624697+0000","last_peered":"2024-09-12T02:29:52.624697+0000","last_clean":"2024-09-12T02:29:52.624697+0000","last_became_active":"2024-09-12T02:29:52.622085+0000","last_became_peered":"2024-09-12T02:29:52.622085+0000","last_unstale":"2024-09-12T02:29:52.624697+0000","last_undegraded":"2024-09-12T02:29:52.624697+0000","last_fullsized":"2024-09-12T02:29:52.624697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615102+0000","last_change":"2024-09-12T02:29:51.614012+0000","last_active":"2024-09-12T02:29:51.615102+0000","last_peered":"2024-09-12T02:29:51.615102+0000","last_clean":"2024-09-12T02:29:51.615102+0000","last_became_active":"2024-09-12T02:29:51.613643+0000","last_became_peered":"2024-09-12T02:29:51.613643+0000","last_unstale":"2024-09-12T02:29:51.615102+0000","last_undegraded":"2024-09-12T02:29:51.615102+0000","last_fullsized":"2024-09-12T02:29:51.615102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624124+0000","last_change":"2024-09-12T02:29:52.619287+0000","last_active":"2024-09-12T02:29:52.624124+0000","last_peered":"2024-09-12T02:29:52.624124+0000","last_clean":"2024-09-12T02:29:52.624124+0000","last_became_active":"2024-09-12T02:29:52.618727+0000","last_became_peered":"2024-09-12T02:29:52.618727+0000","last_unstale":"2024-09-12T02:29:52.624124+0000","last_undegraded":"2024-09-12T02:29:52.624124+0000","last_fullsized":"2024-09-12T02:29:52.624124+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:52.246079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638727+0000","last_change":"2024-09-12T02:29:51.616177+0000","last_active":"2024-09-12T02:29:52.638727+0000","last_peered":"2024-09-12T02:29:52.638727+0000","last_clean":"2024-09-12T02:29:52.638727+0000","last_became_active":"2024-09-12T02:29:51.615785+0000","last_became_peered":"2024-09-12T02:29:51.615785+0000","last_unstale":"2024-09-12T02:29:52.638727+0000","last_undegraded":"2024-09-12T02:29:52.638727+0000","last_fullsized":"2024-09-12T02:29:52.638727+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:59.369993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639012+0000","last_change":"2024-09-12T02:29:52.635785+0000","last_active":"2024-09-12T02:29:52.639012+0000","last_peered":"2024-09-12T02:29:52.639012+0000","last_clean":"2024-09-12T02:29:52.639012+0000","last_became_active":"2024-09-12T02:29:52.635600+0000","last_became_peered":"2024-09-12T02:29:52.635600+0000","last_unstale":"2024-09-12T02:29:52.639012+0000","last_undegraded":"2024-09-12T02:29:52.639012+0000","last_fullsized":"2024-09-12T02:29:52.639012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634179+0000","last_change":"2024-09-12T02:29:51.609063+0000","last_active":"2024-09-12T02:29:52.634179+0000","last_peered":"2024-09-12T02:29:52.634179+0000","last_clean":"2024-09-12T02:29:52.634179+0000","last_became_active":"2024-09-12T02:29:51.608783+0000","last_became_peered":"2024-09-12T02:29:51.608783+0000","last_unstale":"2024-09-12T02:29:52.634179+0000","last_undegraded":"2024-09-12T02:29:52.634179+0000","last_fullsized":"2024-09-12T02:29:52.634179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:33.174988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624739+0000","last_change":"2024-09-12T02:29:52.623116+0000","last_active":"2024-09-12T02:29:52.624739+0000","last_peered":"2024-09-12T02:29:52.624739+0000","last_clean":"2024-09-12T02:29:52.624739+0000","last_became_active":"2024-09-12T02:29:52.622677+0000","last_became_peered":"2024-09-12T02:29:52.622677+0000","last_unstale":"2024-09-12T02:29:52.624739+0000","last_undegraded":"2024-09-12T02:29:52.624739+0000","last_fullsized":"2024-09-12T02:29:52.624739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634095+0000","last_change":"2024-09-12T02:29:51.612680+0000","last_active":"2024-09-12T02:29:52.634095+0000","last_peered":"2024-09-12T02:29:52.634095+0000","last_clean":"2024-09-12T02:29:52.634095+0000","last_became_active":"2024-09-12T02:29:51.612387+0000","last_became_peered":"2024-09-12T02:29:51.612387+0000","last_unstale":"2024-09-12T02:29:52.634095+0000","last_undegraded":"2024-09-12T02:29:52.634095+0000","last_fullsized":"2024-09-12T02:29:52.634095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623116+0000","last_change":"2024-09-12T02:29:52.620087+0000","last_active":"2024-09-12T02:29:52.623116+0000","last_peered":"2024-09-12T02:29:52.623116+0000","last_clean":"2024-09-12T02:29:52.623116+0000","last_became_active":"2024-09-12T02:29:52.619795+0000","last_became_peered":"2024-09-12T02:29:52.619795+0000","last_unstale":"2024-09-12T02:29:52.623116+0000","last_undegraded":"2024-09-12T02:29:52.623116+0000","last_fullsized":"2024-09-12T02:29:52.623116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.613370+0000","last_change":"2024-09-12T02:29:51.609628+0000","last_active":"2024-09-12T02:29:51.613370+0000","last_peered":"2024-09-12T02:29:51.613370+0000","last_clean":"2024-09-12T02:29:51.613370+0000","last_became_active":"2024-09-12T02:29:51.609346+0000","last_became_peered":"2024-09-12T02:29:51.609346+0000","last_unstale":"2024-09-12T02:29:51.613370+0000","last_undegraded":"2024-09-12T02:29:51.613370+0000","last_fullsized":"2024-09-12T02:29:51.613370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:45.697011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639897+0000","last_change":"2024-09-12T02:29:52.635166+0000","last_active":"2024-09-12T02:29:52.639897+0000","last_peered":"2024-09-12T02:29:52.639897+0000","last_clean":"2024-09-12T02:29:52.639897+0000","last_became_active":"2024-09-12T02:29:52.634883+0000","last_became_peered":"2024-09-12T02:29:52.634883+0000","last_unstale":"2024-09-12T02:29:52.639897+0000","last_undegraded":"2024-09-12T02:29:52.639897+0000","last_fullsized":"2024-09-12T02:29:52.639897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.902749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638620+0000","last_change":"2024-09-12T02:29:51.618885+0000","last_active":"2024-09-12T02:29:52.638620+0000","last_peered":"2024-09-12T02:29:52.638620+0000","last_clean":"2024-09-12T02:29:52.638620+0000","last_became_active":"2024-09-12T02:29:51.618593+0000","last_became_peered":"2024-09-12T02:29:51.618593+0000","last_unstale":"2024-09-12T02:29:52.638620+0000","last_undegraded":"2024-09-12T02:29:52.638620+0000","last_fullsized":"2024-09-12T02:29:52.638620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630538+0000","last_change":"2024-09-12T02:29:52.626277+0000","last_active":"2024-09-12T02:29:52.630538+0000","last_peered":"2024-09-12T02:29:52.630538+0000","last_clean":"2024-09-12T02:29:52.630538+0000","last_became_active":"2024-09-12T02:29:52.624251+0000","last_became_peered":"2024-09-12T02:29:52.624251+0000","last_unstale":"2024-09-12T02:29:52.630538+0000","last_undegraded":"2024-09-12T02:29:52.630538+0000","last_fullsized":"2024-09-12T02:29:52.630538+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616081+0000","last_change":"2024-09-12T02:29:51.607855+0000","last_active":"2024-09-12T02:29:52.616081+0000","last_peered":"2024-09-12T02:29:52.616081+0000","last_clean":"2024-09-12T02:29:52.616081+0000","last_became_active":"2024-09-12T02:29:51.607577+0000","last_became_peered":"2024-09-12T02:29:51.607577+0000","last_unstale":"2024-09-12T02:29:52.616081+0000","last_undegraded":"2024-09-12T02:29:52.616081+0000","last_fullsized":"2024-09-12T02:29:52.616081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.981772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623263+0000","last_change":"2024-09-12T02:29:52.619061+0000","last_active":"2024-09-12T02:29:52.623263+0000","last_peered":"2024-09-12T02:29:52.623263+0000","last_clean":"2024-09-12T02:29:52.623263+0000","last_became_active":"2024-09-12T02:29:52.618591+0000","last_became_peered":"2024-09-12T02:29:52.618591+0000","last_unstale":"2024-09-12T02:29:52.623263+0000","last_undegraded":"2024-09-12T02:29:52.623263+0000","last_fullsized":"2024-09-12T02:29:52.623263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:49.116934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618137+0000","last_change":"2024-09-12T02:29:51.605916+0000","last_active":"2024-09-12T02:29:52.618137+0000","last_peered":"2024-09-12T02:29:52.618137+0000","last_clean":"2024-09-12T02:29:52.618137+0000","last_became_active":"2024-09-12T02:29:51.605679+0000","last_became_peered":"2024-09-12T02:29:51.605679+0000","last_unstale":"2024-09-12T02:29:52.618137+0000","last_undegraded":"2024-09-12T02:29:52.618137+0000","last_fullsized":"2024-09-12T02:29:52.618137+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.070779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630115+0000","last_change":"2024-09-12T02:29:52.625671+0000","last_active":"2024-09-12T02:29:52.630115+0000","last_peered":"2024-09-12T02:29:52.630115+0000","last_clean":"2024-09-12T02:29:52.630115+0000","last_became_active":"2024-09-12T02:29:52.625420+0000","last_became_peered":"2024-09-12T02:29:52.625420+0000","last_unstale":"2024-09-12T02:29:52.630115+0000","last_undegraded":"2024-09-12T02:29:52.630115+0000","last_fullsized":"2024-09-12T02:29:52.630115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611664+0000","last_change":"2024-09-12T02:29:51.613737+0000","last_active":"2024-09-12T02:29:52.611664+0000","last_peered":"2024-09-12T02:29:52.611664+0000","last_clean":"2024-09-12T02:29:52.611664+0000","last_became_active":"2024-09-12T02:29:51.613468+0000","last_became_peered":"2024-09-12T02:29:51.613468+0000","last_unstale":"2024-09-12T02:29:52.611664+0000","last_undegraded":"2024-09-12T02:29:52.611664+0000","last_fullsized":"2024-09-12T02:29:52.611664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627765+0000","last_change":"2024-09-12T02:29:52.621214+0000","last_active":"2024-09-12T02:29:52.627765+0000","last_peered":"2024-09-12T02:29:52.627765+0000","last_clean":"2024-09-12T02:29:52.627765+0000","last_became_active":"2024-09-12T02:29:52.620907+0000","last_became_peered":"2024-09-12T02:29:52.620907+0000","last_unstale":"2024-09-12T02:29:52.627765+0000","last_undegraded":"2024-09-12T02:29:52.627765+0000","last_fullsized":"2024-09-12T02:29:52.627765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618101+0000","last_change":"2024-09-12T02:29:51.609872+0000","last_active":"2024-09-12T02:29:52.618101+0000","last_peered":"2024-09-12T02:29:52.618101+0000","last_clean":"2024-09-12T02:29:52.618101+0000","last_became_active":"2024-09-12T02:29:51.609605+0000","last_became_peered":"2024-09-12T02:29:51.609605+0000","last_unstale":"2024-09-12T02:29:52.618101+0000","last_undegraded":"2024-09-12T02:29:52.618101+0000","last_fullsized":"2024-09-12T02:29:52.618101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:46.757750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.603183+0000","last_change":"2024-09-12T02:29:51.603183+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.603183+0000","last_undegraded":"2024-09-12T02:29:51.603183+0000","last_fullsized":"2024-09-12T02:29:51.603183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631741+0000","last_change":"2024-09-12T02:29:51.614666+0000","last_active":"2024-09-12T02:29:52.631741+0000","last_peered":"2024-09-12T02:29:52.631741+0000","last_clean":"2024-09-12T02:29:52.631741+0000","last_became_active":"2024-09-12T02:29:51.614405+0000","last_became_peered":"2024-09-12T02:29:51.614405+0000","last_unstale":"2024-09-12T02:29:52.631741+0000","last_undegraded":"2024-09-12T02:29:52.631741+0000","last_fullsized":"2024-09-12T02:29:52.631741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.623412+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.623148+0000","last_became_peered":"2024-09-12T02:29:52.623148+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.391061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.617828+0000","last_change":"2024-09-12T02:29:51.613589+0000","last_active":"2024-09-12T02:29:51.617828+0000","last_peered":"2024-09-12T02:29:51.617828+0000","last_clean":"2024-09-12T02:29:51.617828+0000","last_became_active":"2024-09-12T02:29:51.613319+0000","last_became_peered":"2024-09-12T02:29:51.613319+0000","last_unstale":"2024-09-12T02:29:51.617828+0000","last_undegraded":"2024-09-12T02:29:51.617828+0000","last_fullsized":"2024-09-12T02:29:51.617828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:24.270926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630859+0000","last_change":"2024-09-12T02:29:52.625357+0000","last_active":"2024-09-12T02:29:52.630859+0000","last_peered":"2024-09-12T02:29:52.630859+0000","last_clean":"2024-09-12T02:29:52.630859+0000","last_became_active":"2024-09-12T02:29:52.625103+0000","last_became_peered":"2024-09-12T02:29:52.625103+0000","last_unstale":"2024-09-12T02:29:52.630859+0000","last_undegraded":"2024-09-12T02:29:52.630859+0000","last_fullsized":"2024-09-12T02:29:52.630859+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.460761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615064+0000","last_change":"2024-09-12T02:29:51.613802+0000","last_active":"2024-09-12T02:29:51.615064+0000","last_peered":"2024-09-12T02:29:51.615064+0000","last_clean":"2024-09-12T02:29:51.615064+0000","last_became_active":"2024-09-12T02:29:51.613156+0000","last_became_peered":"2024-09-12T02:29:51.613156+0000","last_unstale":"2024-09-12T02:29:51.615064+0000","last_undegraded":"2024-09-12T02:29:51.615064+0000","last_fullsized":"2024-09-12T02:29:51.615064+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:38.552485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629660+0000","last_change":"2024-09-12T02:29:52.622189+0000","last_active":"2024-09-12T02:29:52.629660+0000","last_peered":"2024-09-12T02:29:52.629660+0000","last_clean":"2024-09-12T02:29:52.629660+0000","last_became_active":"2024-09-12T02:29:52.620723+0000","last_became_peered":"2024-09-12T02:29:52.620723+0000","last_unstale":"2024-09-12T02:29:52.629660+0000","last_undegraded":"2024-09-12T02:29:52.629660+0000","last_fullsized":"2024-09-12T02:29:52.629660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612995+0000","last_change":"2024-09-12T02:29:51.611049+0000","last_active":"2024-09-12T02:29:52.612995+0000","last_peered":"2024-09-12T02:29:52.612995+0000","last_clean":"2024-09-12T02:29:52.612995+0000","last_became_active":"2024-09-12T02:29:51.610685+0000","last_became_peered":"2024-09-12T02:29:51.610685+0000","last_unstale":"2024-09-12T02:29:52.612995+0000","last_undegraded":"2024-09-12T02:29:52.612995+0000","last_fullsized":"2024-09-12T02:29:52.612995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.599773+0000","last_change":"2024-09-12T02:29:51.599773+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.599773+0000","last_undegraded":"2024-09-12T02:29:51.599773+0000","last_fullsized":"2024-09-12T02:29:51.599773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612436+0000","last_change":"2024-09-12T02:29:51.607416+0000","last_active":"2024-09-12T02:29:51.612436+0000","last_peered":"2024-09-12T02:29:51.612436+0000","last_clean":"2024-09-12T02:29:51.612436+0000","last_became_active":"2024-09-12T02:29:51.607099+0000","last_became_peered":"2024-09-12T02:29:51.607099+0000","last_unstale":"2024-09-12T02:29:51.612436+0000","last_undegraded":"2024-09-12T02:29:51.612436+0000","last_fullsized":"2024-09-12T02:29:51.612436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.652426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.622184+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.621910+0000","last_became_peered":"2024-09-12T02:29:52.621910+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.644576+0000","last_change":"2024-09-12T02:29:51.609082+0000","last_active":"2024-09-12T02:29:52.644576+0000","last_peered":"2024-09-12T02:29:52.644576+0000","last_clean":"2024-09-12T02:29:52.644576+0000","last_became_active":"2024-09-12T02:29:51.608827+0000","last_became_peered":"2024-09-12T02:29:51.608827+0000","last_unstale":"2024-09-12T02:29:52.644576+0000","last_undegraded":"2024-09-12T02:29:52.644576+0000","last_fullsized":"2024-09-12T02:29:52.644576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598411+0000","last_change":"2024-09-12T02:29:51.598411+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598411+0000","last_undegraded":"2024-09-12T02:29:51.598411+0000","last_fullsized":"2024-09-12T02:29:51.598411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612888+0000","last_change":"2024-09-12T02:29:51.607882+0000","last_active":"2024-09-12T02:29:51.612888+0000","last_peered":"2024-09-12T02:29:51.612888+0000","last_clean":"2024-09-12T02:29:51.612888+0000","last_became_active":"2024-09-12T02:29:51.607629+0000","last_became_peered":"2024-09-12T02:29:51.607629+0000","last_unstale":"2024-09-12T02:29:51.612888+0000","last_undegraded":"2024-09-12T02:29:51.612888+0000","last_fullsized":"2024-09-12T02:29:51.612888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:57.296742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639924+0000","last_change":"2024-09-12T02:29:52.636838+0000","last_active":"2024-09-12T02:29:52.639924+0000","last_peered":"2024-09-12T02:29:52.639924+0000","last_clean":"2024-09-12T02:29:52.639924+0000","last_became_active":"2024-09-12T02:29:52.636501+0000","last_became_peered":"2024-09-12T02:29:52.636501+0000","last_unstale":"2024-09-12T02:29:52.639924+0000","last_undegraded":"2024-09-12T02:29:52.639924+0000","last_fullsized":"2024-09-12T02:29:52.639924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:26.154285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638925+0000","last_change":"2024-09-12T02:29:51.614040+0000","last_active":"2024-09-12T02:29:52.638925+0000","last_peered":"2024-09-12T02:29:52.638925+0000","last_clean":"2024-09-12T02:29:52.638925+0000","last_became_active":"2024-09-12T02:29:51.613358+0000","last_became_peered":"2024-09-12T02:29:51.613358+0000","last_unstale":"2024-09-12T02:29:52.638925+0000","last_undegraded":"2024-09-12T02:29:52.638925+0000","last_fullsized":"2024-09-12T02:29:52.638925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638828+0000","last_change":"2024-09-12T02:29:52.636869+0000","last_active":"2024-09-12T02:29:52.638828+0000","last_peered":"2024-09-12T02:29:52.638828+0000","last_clean":"2024-09-12T02:29:52.638828+0000","last_became_active":"2024-09-12T02:29:52.636670+0000","last_became_peered":"2024-09-12T02:29:52.636670+0000","last_unstale":"2024-09-12T02:29:52.638828+0000","last_undegraded":"2024-09-12T02:29:52.638828+0000","last_fullsized":"2024-09-12T02:29:52.638828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631254+0000","last_change":"2024-09-12T02:29:51.607951+0000","last_active":"2024-09-12T02:29:52.631254+0000","last_peered":"2024-09-12T02:29:52.631254+0000","last_clean":"2024-09-12T02:29:52.631254+0000","last_became_active":"2024-09-12T02:29:51.607630+0000","last_became_peered":"2024-09-12T02:29:51.607630+0000","last_unstale":"2024-09-12T02:29:52.631254+0000","last_undegraded":"2024-09-12T02:29:52.631254+0000","last_fullsized":"2024-09-12T02:29:52.631254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624823+0000","last_change":"2024-09-12T02:29:52.622191+0000","last_active":"2024-09-12T02:29:52.624823+0000","last_peered":"2024-09-12T02:29:52.624823+0000","last_clean":"2024-09-12T02:29:52.624823+0000","last_became_active":"2024-09-12T02:29:52.621584+0000","last_became_peered":"2024-09-12T02:29:52.621584+0000","last_unstale":"2024-09-12T02:29:52.624823+0000","last_undegraded":"2024-09-12T02:29:52.624823+0000","last_fullsized":"2024-09-12T02:29:52.624823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.365214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615558+0000","last_change":"2024-09-12T02:29:51.614595+0000","last_active":"2024-09-12T02:29:51.615558+0000","last_peered":"2024-09-12T02:29:51.615558+0000","last_clean":"2024-09-12T02:29:51.615558+0000","last_became_active":"2024-09-12T02:29:51.614265+0000","last_became_peered":"2024-09-12T02:29:51.614265+0000","last_unstale":"2024-09-12T02:29:51.615558+0000","last_undegraded":"2024-09-12T02:29:51.615558+0000","last_fullsized":"2024-09-12T02:29:51.615558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:20.937452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600616+0000","last_change":"2024-09-12T02:29:51.600616+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600616+0000","last_undegraded":"2024-09-12T02:29:51.600616+0000","last_fullsized":"2024-09-12T02:29:51.600616+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.609795+0000","last_change":"2024-09-12T02:29:51.606261+0000","last_active":"2024-09-12T02:29:51.609795+0000","last_peered":"2024-09-12T02:29:51.609795+0000","last_clean":"2024-09-12T02:29:51.609795+0000","last_became_active":"2024-09-12T02:29:51.605989+0000","last_became_peered":"2024-09-12T02:29:51.605989+0000","last_unstale":"2024-09-12T02:29:51.609795+0000","last_undegraded":"2024-09-12T02:29:51.609795+0000","last_fullsized":"2024-09-12T02:29:51.609795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:46.210505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627339+0000","last_change":"2024-09-12T02:29:52.624877+0000","last_active":"2024-09-12T02:29:52.627339+0000","last_peered":"2024-09-12T02:29:52.627339+0000","last_clean":"2024-09-12T02:29:52.627339+0000","last_became_active":"2024-09-12T02:29:52.624540+0000","last_became_peered":"2024-09-12T02:29:52.624540+0000","last_unstale":"2024-09-12T02:29:52.627339+0000","last_undegraded":"2024-09-12T02:29:52.627339+0000","last_fullsized":"2024-09-12T02:29:52.627339+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616102+0000","last_change":"2024-09-12T02:29:51.603198+0000","last_active":"2024-09-12T02:29:52.616102+0000","last_peered":"2024-09-12T02:29:52.616102+0000","last_clean":"2024-09-12T02:29:52.616102+0000","last_became_active":"2024-09-12T02:29:51.602891+0000","last_became_peered":"2024-09-12T02:29:51.602891+0000","last_unstale":"2024-09-12T02:29:52.616102+0000","last_undegraded":"2024-09-12T02:29:52.616102+0000","last_fullsized":"2024-09-12T02:29:52.616102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598418+0000","last_change":"2024-09-12T02:29:51.598418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598418+0000","last_undegraded":"2024-09-12T02:29:51.598418+0000","last_fullsized":"2024-09-12T02:29:51.598418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.615892+0000","last_change":"2024-09-12T02:29:51.609912+0000","last_active":"2024-09-12T02:29:52.615892+0000","last_peered":"2024-09-12T02:29:52.615892+0000","last_clean":"2024-09-12T02:29:52.615892+0000","last_became_active":"2024-09-12T02:29:51.609646+0000","last_became_peered":"2024-09-12T02:29:51.609646+0000","last_unstale":"2024-09-12T02:29:52.615892+0000","last_undegraded":"2024-09-12T02:29:52.615892+0000","last_fullsized":"2024-09-12T02:29:52.615892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.455790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639646+0000","last_change":"2024-09-12T02:29:52.631060+0000","last_active":"2024-09-12T02:29:52.639646+0000","last_peered":"2024-09-12T02:29:52.639646+0000","last_clean":"2024-09-12T02:29:52.639646+0000","last_became_active":"2024-09-12T02:29:52.630218+0000","last_became_peered":"2024-09-12T02:29:52.630218+0000","last_unstale":"2024-09-12T02:29:52.639646+0000","last_undegraded":"2024-09-12T02:29:52.639646+0000","last_fullsized":"2024-09-12T02:29:52.639646+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:27.285618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614576+0000","last_change":"2024-09-12T02:29:51.613668+0000","last_active":"2024-09-12T02:29:52.614576+0000","last_peered":"2024-09-12T02:29:52.614576+0000","last_clean":"2024-09-12T02:29:52.614576+0000","last_became_active":"2024-09-12T02:29:51.612615+0000","last_became_peered":"2024-09-12T02:29:51.612615+0000","last_unstale":"2024-09-12T02:29:52.614576+0000","last_undegraded":"2024-09-12T02:29:52.614576+0000","last_fullsized":"2024-09-12T02:29:52.614576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:59.211039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630298+0000","last_change":"2024-09-12T02:29:52.626071+0000","last_active":"2024-09-12T02:29:52.630298+0000","last_peered":"2024-09-12T02:29:52.630298+0000","last_clean":"2024-09-12T02:29:52.630298+0000","last_became_active":"2024-09-12T02:29:52.625734+0000","last_became_peered":"2024-09-12T02:29:52.625734+0000","last_unstale":"2024-09-12T02:29:52.630298+0000","last_undegraded":"2024-09-12T02:29:52.630298+0000","last_fullsized":"2024-09-12T02:29:52.630298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.762721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.614269+0000","last_change":"2024-09-12T02:29:51.613594+0000","last_active":"2024-09-12T02:29:51.614269+0000","last_peered":"2024-09-12T02:29:51.614269+0000","last_clean":"2024-09-12T02:29:51.614269+0000","last_became_active":"2024-09-12T02:29:51.613308+0000","last_became_peered":"2024-09-12T02:29:51.613308+0000","last_unstale":"2024-09-12T02:29:51.614269+0000","last_undegraded":"2024-09-12T02:29:51.614269+0000","last_fullsized":"2024-09-12T02:29:51.614269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:57.658906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629833+0000","last_change":"2024-09-12T02:29:52.626950+0000","last_active":"2024-09-12T02:29:52.629833+0000","last_peered":"2024-09-12T02:29:52.629833+0000","last_clean":"2024-09-12T02:29:52.629833+0000","last_became_active":"2024-09-12T02:29:52.624339+0000","last_became_peered":"2024-09-12T02:29:52.624339+0000","last_unstale":"2024-09-12T02:29:52.629833+0000","last_undegraded":"2024-09-12T02:29:52.629833+0000","last_fullsized":"2024-09-12T02:29:52.629833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614224+0000","last_change":"2024-09-12T02:29:51.614143+0000","last_active":"2024-09-12T02:29:52.614224+0000","last_peered":"2024-09-12T02:29:52.614224+0000","last_clean":"2024-09-12T02:29:52.614224+0000","last_became_active":"2024-09-12T02:29:51.613862+0000","last_became_peered":"2024-09-12T02:29:51.613862+0000","last_unstale":"2024-09-12T02:29:52.614224+0000","last_undegraded":"2024-09-12T02:29:52.614224+0000","last_fullsized":"2024-09-12T02:29:52.614224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.971168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633485+0000","last_change":"2024-09-12T02:29:52.628947+0000","last_active":"2024-09-12T02:29:52.633485+0000","last_peered":"2024-09-12T02:29:52.633485+0000","last_clean":"2024-09-12T02:29:52.633485+0000","last_became_active":"2024-09-12T02:29:52.628641+0000","last_became_peered":"2024-09-12T02:29:52.628641+0000","last_unstale":"2024-09-12T02:29:52.633485+0000","last_undegraded":"2024-09-12T02:29:52.633485+0000","last_fullsized":"2024-09-12T02:29:52.633485+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.950748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612520+0000","last_change":"2024-09-12T02:29:51.608188+0000","last_active":"2024-09-12T02:29:52.612520+0000","last_peered":"2024-09-12T02:29:52.612520+0000","last_clean":"2024-09-12T02:29:52.612520+0000","last_became_active":"2024-09-12T02:29:51.607861+0000","last_became_peered":"2024-09-12T02:29:51.607861+0000","last_unstale":"2024-09-12T02:29:52.612520+0000","last_undegraded":"2024-09-12T02:29:52.612520+0000","last_fullsized":"2024-09-12T02:29:52.612520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600158+0000","last_change":"2024-09-12T02:29:51.600158+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600158+0000","last_undegraded":"2024-09-12T02:29:51.600158+0000","last_fullsized":"2024-09-12T02:29:51.600158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614036+0000","last_change":"2024-09-12T02:29:51.614527+0000","last_active":"2024-09-12T02:29:52.614036+0000","last_peered":"2024-09-12T02:29:52.614036+0000","last_clean":"2024-09-12T02:29:52.614036+0000","last_became_active":"2024-09-12T02:29:51.614243+0000","last_became_peered":"2024-09-12T02:29:51.614243+0000","last_unstale":"2024-09-12T02:29:52.614036+0000","last_undegraded":"2024-09-12T02:29:52.614036+0000","last_fullsized":"2024-09-12T02:29:52.614036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:10.586982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600978+0000","last_change":"2024-09-12T02:29:51.600978+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600978+0000","last_undegraded":"2024-09-12T02:29:51.600978+0000","last_fullsized":"2024-09-12T02:29:51.600978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611085+0000","last_change":"2024-09-12T02:29:51.613803+0000","last_active":"2024-09-12T02:29:52.611085+0000","last_peered":"2024-09-12T02:29:52.611085+0000","last_clean":"2024-09-12T02:29:52.611085+0000","last_became_active":"2024-09-12T02:29:51.613523+0000","last_became_peered":"2024-09-12T02:29:51.613523+0000","last_unstale":"2024-09-12T02:29:52.611085+0000","last_undegraded":"2024-09-12T02:29:52.611085+0000","last_fullsized":"2024-09-12T02:29:52.611085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631071+0000","last_change":"2024-09-12T02:29:52.626820+0000","last_active":"2024-09-12T02:29:52.631071+0000","last_peered":"2024-09-12T02:29:52.631071+0000","last_clean":"2024-09-12T02:29:52.631071+0000","last_became_active":"2024-09-12T02:29:52.626379+0000","last_became_peered":"2024-09-12T02:29:52.626379+0000","last_unstale":"2024-09-12T02:29:52.631071+0000","last_undegraded":"2024-09-12T02:29:52.631071+0000","last_fullsized":"2024-09-12T02:29:52.631071+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:17.976139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612756+0000","last_change":"2024-09-12T02:29:51.603977+0000","last_active":"2024-09-12T02:29:52.612756+0000","last_peered":"2024-09-12T02:29:52.612756+0000","last_clean":"2024-09-12T02:29:52.612756+0000","last_became_active":"2024-09-12T02:29:51.603675+0000","last_became_peered":"2024-09-12T02:29:51.603675+0000","last_unstale":"2024-09-12T02:29:52.612756+0000","last_undegraded":"2024-09-12T02:29:52.612756+0000","last_fullsized":"2024-09-12T02:29:52.612756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627440+0000","last_change":"2024-09-12T02:29:52.622743+0000","last_active":"2024-09-12T02:29:52.627440+0000","last_peered":"2024-09-12T02:29:52.627440+0000","last_clean":"2024-09-12T02:29:52.627440+0000","last_became_active":"2024-09-12T02:29:52.622484+0000","last_became_peered":"2024-09-12T02:29:52.622484+0000","last_unstale":"2024-09-12T02:29:52.627440+0000","last_undegraded":"2024-09-12T02:29:52.627440+0000","last_fullsized":"2024-09-12T02:29:52.627440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618359+0000","last_change":"2024-09-12T02:29:51.607832+0000","last_active":"2024-09-12T02:29:52.618359+0000","last_peered":"2024-09-12T02:29:52.618359+0000","last_clean":"2024-09-12T02:29:52.618359+0000","last_became_active":"2024-09-12T02:29:51.607569+0000","last_became_peered":"2024-09-12T02:29:51.607569+0000","last_unstale":"2024-09-12T02:29:52.618359+0000","last_undegraded":"2024-09-12T02:29:52.618359+0000","last_fullsized":"2024-09-12T02:29:52.618359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629714+0000","last_change":"2024-09-12T02:29:52.622767+0000","last_active":"2024-09-12T02:29:52.629714+0000","last_peered":"2024-09-12T02:29:52.629714+0000","last_clean":"2024-09-12T02:29:52.629714+0000","last_became_active":"2024-09-12T02:29:52.622534+0000","last_became_peered":"2024-09-12T02:29:52.622534+0000","last_unstale":"2024-09-12T02:29:52.629714+0000","last_undegraded":"2024-09-12T02:29:52.629714+0000","last_fullsized":"2024-09-12T02:29:52.629714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:36.382720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.635166+0000","last_change":"2024-09-12T02:29:51.608005+0000","last_active":"2024-09-12T02:29:52.635166+0000","last_peered":"2024-09-12T02:29:52.635166+0000","last_clean":"2024-09-12T02:29:52.635166+0000","last_became_active":"2024-09-12T02:29:51.607721+0000","last_became_peered":"2024-09-12T02:29:51.607721+0000","last_unstale":"2024-09-12T02:29:52.635166+0000","last_undegraded":"2024-09-12T02:29:52.635166+0000","last_fullsized":"2024-09-12T02:29:52.635166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614664+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:52.614664+0000","last_peered":"2024-09-12T02:29:52.614664+0000","last_clean":"2024-09-12T02:29:52.614664+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:52.614664+0000","last_undegraded":"2024-09-12T02:29:52.614664+0000","last_fullsized":"2024-09-12T02:29:52.614664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:56.236 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3a is not active+clean 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.601065+0000', 'last_change': '2024-09-12T02:29:51.601065+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.601065+0000', 'last_undegraded': '2024-09-12T02:29:51.601065+0000', 'last_fullsized': '2024-09-12T02:29:51.601065+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.598286+0000', 'last_change': '2024-09-12T02:29:51.598286+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.598286+0000', 'last_undegraded': '2024-09-12T02:29:51.598286+0000', 'last_fullsized': '2024-09-12T02:29:51.598286+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.601418+0000', 'last_change': '2024-09-12T02:29:51.601418+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.601418+0000', 'last_undegraded': '2024-09-12T02:29:51.601418+0000', 'last_fullsized': '2024-09-12T02:29:51.601418+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.598639+0000', 'last_change': '2024-09-12T02:29:51.598639+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.598639+0000', 'last_undegraded': '2024-09-12T02:29:51.598639+0000', 'last_fullsized': '2024-09-12T02:29:51.598639+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.604028+0000', 'last_change': '2024-09-12T02:29:51.604028+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.604028+0000', 'last_undegraded': '2024-09-12T02:29:51.604028+0000', 'last_fullsized': '2024-09-12T02:29:51.604028+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.237 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.598877+0000', 'last_change': '2024-09-12T02:29:51.598877+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.598877+0000', 'last_undegraded': '2024-09-12T02:29:51.598877+0000', 'last_fullsized': '2024-09-12T02:29:51.598877+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:PG 7.21 is not active+clean 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.600822+0000', 'last_change': '2024-09-12T02:29:51.600822+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.600822+0000', 'last_undegraded': '2024-09-12T02:29:51.600822+0000', 'last_fullsized': '2024-09-12T02:29:51.600822+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.597886+0000', 'last_change': '2024-09-12T02:29:51.597886+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.597886+0000', 'last_undegraded': '2024-09-12T02:29:51.597886+0000', 'last_fullsized': '2024-09-12T02:29:51.597886+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.603183+0000', 'last_change': '2024-09-12T02:29:51.603183+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.603183+0000', 'last_undegraded': '2024-09-12T02:29:51.603183+0000', 'last_fullsized': '2024-09-12T02:29:51.603183+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.599773+0000', 'last_change': '2024-09-12T02:29:51.599773+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.599773+0000', 'last_undegraded': '2024-09-12T02:29:51.599773+0000', 'last_fullsized': '2024-09-12T02:29:51.599773+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-12T02:29:56.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.598411+0000', 'last_change': '2024-09-12T02:29:51.598411+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.598411+0000', 'last_undegraded': '2024-09-12T02:29:51.598411+0000', 'last_fullsized': '2024-09-12T02:29:51.598411+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.600616+0000', 'last_change': '2024-09-12T02:29:51.600616+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.600616+0000', 'last_undegraded': '2024-09-12T02:29:51.600616+0000', 'last_fullsized': '2024-09-12T02:29:51.600616+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.598418+0000', 'last_change': '2024-09-12T02:29:51.598418+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.598418+0000', 'last_undegraded': '2024-09-12T02:29:51.598418+0000', 'last_fullsized': '2024-09-12T02:29:51.598418+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.600158+0000', 'last_change': '2024-09-12T02:29:51.600158+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.600158+0000', 'last_undegraded': '2024-09-12T02:29:51.600158+0000', 'last_fullsized': '2024-09-12T02:29:51.600158+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-12T02:29:56.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:29:51.600978+0000', 'last_change': '2024-09-12T02:29:51.600978+0000', 'last_active': '2024-09-12T02:29:51.589828+0000', 'last_peered': '2024-09-12T02:29:51.589828+0000', 'last_clean': '2024-09-12T02:29:51.589828+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:29:51.600978+0000', 'last_undegraded': '2024-09-12T02:29:51.600978+0000', 'last_fullsized': '2024-09-12T02:29:51.600978+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'last_clean_scrub_stamp': '2024-09-12T02:29:51.589828+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:29:56.240 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:29:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.370+0000 7f50596b7640 1 Processor -- start 2024-09-12T02:29:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.370+0000 7f50596b7640 1 -- start start 2024-09-12T02:29:56.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50596b7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50540b7530 0x7f50540b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50596b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540cf840 0x7f50540b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50596b7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505415e970 con 0x7f505415e590 2024-09-12T02:29:56.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50596b7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f50540d41f0 con 0x7f50540b7530 2024-09-12T02:29:56.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50596b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f50540d2800 con 0x7f50540cf840 2024-09-12T02:29:56.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50537fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540cf840 0x7f50540b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f504bfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50540b7530 0x7f50540b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f5052ffd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f505415e590 0x7f50540d3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:49144/0 (socket says 172.21.15.181:49144) 2024-09-12T02:29:56.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f5052ffd640 1 -- 172.21.15.181:0/2684390622 learned_addr learned my addr 172.21.15.181:0/2684390622 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:29:56.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50537fe640 1 -- 172.21.15.181:0/2684390622 >> v2:172.21.15.204:3300/0 conn(0x7f50540b7530 msgr2=0x7f50540b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:56.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50537fe640 1 --2- 172.21.15.181:0/2684390622 >> v2:172.21.15.204:3300/0 conn(0x7f50540b7530 0x7f50540b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50537fe640 1 -- 172.21.15.181:0/2684390622 >> v1:172.21.15.204:6789/0 conn(0x7f505415e590 legacy=0x7f50540d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.371+0000 7f50537fe640 1 -- 172.21.15.181:0/2684390622 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50540d2ae0 con 0x7f50540cf840 2024-09-12T02:29:56.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.372+0000 7f50537fe640 1 --2- 172.21.15.181:0/2684390622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540cf840 0x7f50540b6460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f504c009d90 tx=0x7f504c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd892245f665e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.372+0000 7f50527fc640 1 -- 172.21.15.181:0/2684390622 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c031600 con 0x7f50540cf840 2024-09-12T02:29:56.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.372+0000 7f50527fc640 1 -- 172.21.15.181:0/2684390622 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504c0317a0 con 0x7f50540cf840 2024-09-12T02:29:56.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.372+0000 7f50527fc640 1 -- 172.21.15.181:0/2684390622 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c031b70 con 0x7f50540cf840 2024-09-12T02:29:56.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 -- 172.21.15.181:0/2684390622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540cf840 msgr2=0x7f50540b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 --2- 172.21.15.181:0/2684390622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540cf840 0x7f50540b6460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f504c009d90 tx=0x7f504c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 -- 172.21.15.181:0/2684390622 shutdown_connections 2024-09-12T02:29:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 --2- 172.21.15.181:0/2684390622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540cf840 0x7f50540b6460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 --2- 172.21.15.181:0/2684390622 >> v2:172.21.15.204:3300/0 conn(0x7f50540b7530 0x7f50540b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 -- 172.21.15.181:0/2684390622 >> 172.21.15.181:0/2684390622 conn(0x7f5054067d70 msgr2=0x7f5054068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 -- 172.21.15.181:0/2684390622 shutdown_connections 2024-09-12T02:29:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.373+0000 7f50596b7640 1 -- 172.21.15.181:0/2684390622 wait complete. 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.374+0000 7f50596b7640 1 Processor -- start 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.374+0000 7f50596b7640 1 -- start start 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50596b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540b7530 0x7f5054158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50596b7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50540cf840 0x7f50541f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50596b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505415e590 0x7f50541f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50596b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5054162070 con 0x7f505415e590 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50596b7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f50540d30a0 con 0x7f50540cf840 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50596b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f50541621f0 con 0x7f50540b7530 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505415e590 0x7f50541f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505415e590 0x7f50541f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48408/0 (socket says 172.21.15.181:48408) 2024-09-12T02:29:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 -- 172.21.15.181:0/2790629236 learned_addr learned my addr 172.21.15.181:0/2790629236 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f5052ffd640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540b7530 0x7f5054158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f504bfff640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50540cf840 0x7f50541f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 -- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540b7530 msgr2=0x7f5054158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540b7530 0x7f5054158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 -- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50540cf840 msgr2=0x7f50541f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50540cf840 0x7f50541f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.375+0000 7f50537fe640 1 -- 172.21.15.181:0/2790629236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50541f50a0 con 0x7f505415e590 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.376+0000 7f50537fe640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505415e590 0x7f50541f52a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f504c009eb0 tx=0x7f504c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.376+0000 7f504b7fe640 1 -- 172.21.15.181:0/2790629236 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c040070 con 0x7f505415e590 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.376+0000 7f504b7fe640 1 -- 172.21.15.181:0/2790629236 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504c030b60 con 0x7f505415e590 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.376+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50540ccbd0 con 0x7f505415e590 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.376+0000 7f504b7fe640 1 -- 172.21.15.181:0/2790629236 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c009450 con 0x7f505415e590 2024-09-12T02:29:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.376+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50540cd410 con 0x7f505415e590 2024-09-12T02:29:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.377+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50540d3930 con 0x7f505415e590 2024-09-12T02:29:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.377+0000 7f504b7fe640 1 -- 172.21.15.181:0/2790629236 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f504c039040 con 0x7f505415e590 2024-09-12T02:29:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.378+0000 7f504b7fe640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503406be60 0x7f503406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.378+0000 7f504b7fe640 1 -- 172.21.15.181:0/2790629236 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f504c0ac380 con 0x7f505415e590 2024-09-12T02:29:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.378+0000 7f5052ffd640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503406be60 0x7f503406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.378+0000 7f5052ffd640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503406be60 0x7f503406e320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5044000f60 tx=0x7f5044007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.382+0000 7f504b7fe640 1 -- 172.21.15.181:0/2790629236 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50540ccbd0 con 0x7f505415e590 2024-09-12T02:29:56.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.609+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f50540cffa0 con 0x7f505415e590 2024-09-12T02:29:56.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.609+0000 7f504b7fe640 1 -- 172.21.15.181:0/2790629236 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1688 (secure 0 0 0) 0x7f50541f50a0 con 0x7f505415e590 2024-09-12T02:29:56.610 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:56.610 INFO:teuthology.orchestra.run.smithi181.stdout:{"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":117,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1726108091,"num_in_osds":8,"osd_in_since":1726108081,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":82},{"state_name":"creating+peering","count":15}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":590528,"bytes_used":226586624,"bytes_avail":772867526656,"bytes_total":773094113280,"inactive_pgs_ratio":0.15463916957378387,"write_bytes_sec":406,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":27,"btime":"2024-09-12T02:29:54:627732+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5373}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-12T02:29:13.622103+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T02:29:56.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503406be60 msgr2=0x7f503406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503406be60 0x7f503406e320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5044000f60 tx=0x7f5044007e80 comp rx=0 tx=0).stop 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505415e590 msgr2=0x7f50541f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505415e590 0x7f50541f52a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f504c009eb0 tx=0x7f504c004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 shutdown_connections 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503406be60 0x7f503406e320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50540cf840 0x7f50541f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505415e590 0x7f50541f52a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 --2- 172.21.15.181:0/2790629236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50540b7530 0x7f5054158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.611+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 >> 172.21.15.181:0/2790629236 conn(0x7f5054067d70 msgr2=0x7f50540b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.612+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 shutdown_connections 2024-09-12T02:29:56.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.612+0000 7f50596b7640 1 -- 172.21.15.181:0/2790629236 wait complete. 2024-09-12T02:29:56.624 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:29:56.624 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:29:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.722+0000 7ff78c8d0640 1 Processor -- start 2024-09-12T02:29:56.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.723+0000 7ff78c8d0640 1 -- start start 2024-09-12T02:29:56.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.723+0000 7ff78c8d0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff78815b2e0 0x7ff7880b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff78c8d0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff7880b2490 0x7ff788071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff78c8d0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7880ce4f0 con 0x7ff7880cdfc0 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff78c8d0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff78815b6c0 con 0x7ff7880b2490 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff78c8d0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff7880ce7d0 con 0x7ff78815b2e0 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff786d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff7880b2490 0x7ff788071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff786d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff7880b2490 0x7ff788071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48420/0 (socket says 172.21.15.181:48420) 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff785d9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff7880cdfc0 0x7ff7880b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:44418/0 (socket says 172.21.15.181:44418) 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff786d9d640 1 -- 172.21.15.181:0/2645088991 learned_addr learned my addr 172.21.15.181:0/2645088991 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff78659c640 1 --2- 172.21.15.181:0/2645088991 >> v2:172.21.15.204:3300/0 conn(0x7ff78815b2e0 0x7ff7880b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff786d9d640 1 -- 172.21.15.181:0/2645088991 >> v2:172.21.15.204:3300/0 conn(0x7ff78815b2e0 msgr2=0x7ff7880b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff786d9d640 1 --2- 172.21.15.181:0/2645088991 >> v2:172.21.15.204:3300/0 conn(0x7ff78815b2e0 0x7ff7880b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff786d9d640 1 -- 172.21.15.181:0/2645088991 >> v1:172.21.15.181:6789/0 conn(0x7ff7880cdfc0 legacy=0x7ff7880b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff78559a640 1 -- 172.21.15.181:0/2645088991 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522856968 0 0) 0x7ff7880ce4f0 con 0x7ff7880cdfc0 2024-09-12T02:29:56.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.724+0000 7ff786d9d640 1 -- 172.21.15.181:0/2645088991 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7880ceab0 con 0x7ff7880b2490 2024-09-12T02:29:56.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.725+0000 7ff786d9d640 1 --2- 172.21.15.181:0/2645088991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7880b2490 0x7ff788071750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff788069550 tx=0x7ff78002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbf2b6a227b7205 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.725+0000 7ff78559a640 1 -- 172.21.15.181:0/2645088991 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780036070 con 0x7ff7880b2490 2024-09-12T02:29:56.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.725+0000 7ff78559a640 1 -- 172.21.15.181:0/2645088991 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff780031600 con 0x7ff7880b2490 2024-09-12T02:29:56.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.725+0000 7ff78559a640 1 -- 172.21.15.181:0/2645088991 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800319d0 con 0x7ff7880b2490 2024-09-12T02:29:56.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.725+0000 7ff78c8d0640 1 -- 172.21.15.181:0/2645088991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7880b2490 msgr2=0x7ff788071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.725+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/2645088991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7880b2490 0x7ff788071750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff788069550 tx=0x7ff78002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.725+0000 7ff78c8d0640 1 -- 172.21.15.181:0/2645088991 shutdown_connections 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.726+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/2645088991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7880b2490 0x7ff788071750 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.726+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/2645088991 >> v2:172.21.15.204:3300/0 conn(0x7ff78815b2e0 0x7ff7880b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.726+0000 7ff78c8d0640 1 -- 172.21.15.181:0/2645088991 >> 172.21.15.181:0/2645088991 conn(0x7ff78806bc10 msgr2=0x7ff78806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.726+0000 7ff78c8d0640 1 -- 172.21.15.181:0/2645088991 shutdown_connections 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.726+0000 7ff78c8d0640 1 -- 172.21.15.181:0/2645088991 wait complete. 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.727+0000 7ff78c8d0640 1 Processor -- start 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.727+0000 7ff78c8d0640 1 -- start start 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7880b2490 0x7ff7880d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7880cdfc0 0x7ff7881516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff78815b2e0 0x7ff788151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff7880712b0 con 0x7ff78815b2e0 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff788071130 con 0x7ff7880b2490 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff7880b4260 con 0x7ff7880cdfc0 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff78815b2e0 0x7ff788151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff78815b2e0 0x7ff788151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48428/0 (socket says 172.21.15.181:48428) 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 -- 172.21.15.181:0/4225027632 learned_addr learned my addr 172.21.15.181:0/4225027632 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff785d9b640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7880cdfc0 0x7ff7881516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78659c640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7880b2490 0x7ff7880d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 -- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7880cdfc0 msgr2=0x7ff7881516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7880cdfc0 0x7ff7881516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 -- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7880b2490 msgr2=0x7ff7880d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7880b2490 0x7ff7880d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 -- 172.21.15.181:0/4225027632 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7880ab0d0 con 0x7ff78815b2e0 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff785d9b640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7880cdfc0 0x7ff7881516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78659c640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7880b2490 0x7ff7880d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff786d9d640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff78815b2e0 0x7ff788151c10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff780009f40 tx=0x7ff780004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff77effd640 1 -- 172.21.15.181:0/4225027632 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780036050 con 0x7ff78815b2e0 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff77effd640 1 -- 172.21.15.181:0/4225027632 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff780042070 con 0x7ff78815b2e0 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff77effd640 1 -- 172.21.15.181:0/4225027632 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780009510 con 0x7ff78815b2e0 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7880ab370 con 0x7ff78815b2e0 2024-09-12T02:29:56.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.728+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7880ab930 con 0x7ff78815b2e0 2024-09-12T02:29:56.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.729+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7880b3d20 con 0x7ff78815b2e0 2024-09-12T02:29:56.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.730+0000 7ff77effd640 1 -- 172.21.15.181:0/4225027632 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff780007bf0 con 0x7ff78815b2e0 2024-09-12T02:29:56.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.730+0000 7ff77effd640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff76806be30 0x7ff76806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:56.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.730+0000 7ff77effd640 1 -- 172.21.15.181:0/4225027632 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff7800abcb0 con 0x7ff78815b2e0 2024-09-12T02:29:56.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.730+0000 7ff78659c640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff76806be30 0x7ff76806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:56.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.731+0000 7ff78659c640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff76806be30 0x7ff76806e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff778009af0 tx=0x7ff778008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:56.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.734+0000 7ff77effd640 1 -- 172.21.15.181:0/4225027632 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff780045360 con 0x7ff78815b2e0 2024-09-12T02:29:56.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.896+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff78815a900 con 0x7ff76806be30 2024-09-12T02:29:56.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.902+0000 7ff77effd640 1 -- 172.21.15.181:0/4225027632 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250644 (secure 0 0 0) 0x7ff78815a900 con 0x7ff76806be30 2024-09-12T02:29:56.906 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:29:56.907 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:29:56.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff76806be30 msgr2=0x7ff76806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff76806be30 0x7ff76806e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff778009af0 tx=0x7ff778008040 comp rx=0 tx=0).stop 2024-09-12T02:29:56.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff78815b2e0 msgr2=0x7ff788151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff78815b2e0 0x7ff788151c10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff780009f40 tx=0x7ff780004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 shutdown_connections 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff76806be30 0x7ff76806e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff78815b2e0 0x7ff788151c10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff7880cdfc0 0x7ff7881516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 --2- 172.21.15.181:0/4225027632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff7880b2490 0x7ff7880d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 >> 172.21.15.181:0/4225027632 conn(0x7ff78806bc10 msgr2=0x7ff788073bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 shutdown_connections 2024-09-12T02:29:56.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:29:56.905+0000 7ff78c8d0640 1 -- 172.21.15.181:0/4225027632 wait complete. 2024-09-12T02:29:56.917 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-12T02:29:55.630917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221276,"kb_used_data":5008,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753444,"statfs":{"total":773094113280,"available":772867526656,"internally_reserved":0,"allocated":5128192,"data_stored":2746954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040702"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.625024+0000","last_change":"2024-09-12T02:29:52.619457+0000","last_active":"2024-09-12T02:29:52.625024+0000","last_peered":"2024-09-12T02:29:52.625024+0000","last_clean":"2024-09-12T02:29:52.625024+0000","last_became_active":"2024-09-12T02:29:52.618250+0000","last_became_peered":"2024-09-12T02:29:52.618250+0000","last_unstale":"2024-09-12T02:29:52.625024+0000","last_undegraded":"2024-09-12T02:29:52.625024+0000","last_fullsized":"2024-09-12T02:29:52.625024+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633756+0000","last_change":"2024-09-12T02:29:52.629942+0000","last_active":"2024-09-12T02:29:52.633756+0000","last_peered":"2024-09-12T02:29:52.633756+0000","last_clean":"2024-09-12T02:29:52.633756+0000","last_became_active":"2024-09-12T02:29:52.629644+0000","last_became_peered":"2024-09-12T02:29:52.629644+0000","last_unstale":"2024-09-12T02:29:52.633756+0000","last_undegraded":"2024-09-12T02:29:52.633756+0000","last_fullsized":"2024-09-12T02:29:52.633756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.617035+0000","last_change":"2024-09-12T02:29:52.615494+0000","last_active":"2024-09-12T02:29:52.617035+0000","last_peered":"2024-09-12T02:29:52.617035+0000","last_clean":"2024-09-12T02:29:52.617035+0000","last_became_active":"2024-09-12T02:29:52.615083+0000","last_became_peered":"2024-09-12T02:29:52.615083+0000","last_unstale":"2024-09-12T02:29:52.617035+0000","last_undegraded":"2024-09-12T02:29:52.617035+0000","last_fullsized":"2024-09-12T02:29:52.617035+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629689+0000","last_change":"2024-09-12T02:29:52.625892+0000","last_active":"2024-09-12T02:29:52.629689+0000","last_peered":"2024-09-12T02:29:52.629689+0000","last_clean":"2024-09-12T02:29:52.629689+0000","last_became_active":"2024-09-12T02:29:52.624192+0000","last_became_peered":"2024-09-12T02:29:52.624192+0000","last_unstale":"2024-09-12T02:29:52.629689+0000","last_undegraded":"2024-09-12T02:29:52.629689+0000","last_fullsized":"2024-09-12T02:29:52.629689+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:01.527513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.628571+0000","last_change":"2024-09-12T02:29:52.624531+0000","last_active":"2024-09-12T02:29:52.628571+0000","last_peered":"2024-09-12T02:29:52.628571+0000","last_clean":"2024-09-12T02:29:52.628571+0000","last_became_active":"2024-09-12T02:29:52.624183+0000","last_became_peered":"2024-09-12T02:29:52.624183+0000","last_unstale":"2024-09-12T02:29:52.628571+0000","last_undegraded":"2024-09-12T02:29:52.628571+0000","last_fullsized":"2024-09-12T02:29:52.628571+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.591953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601065+0000","last_change":"2024-09-12T02:29:51.601065+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601065+0000","last_undegraded":"2024-09-12T02:29:51.601065+0000","last_fullsized":"2024-09-12T02:29:51.601065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627874+0000","last_change":"2024-09-12T02:29:52.623493+0000","last_active":"2024-09-12T02:29:52.627874+0000","last_peered":"2024-09-12T02:29:52.627874+0000","last_clean":"2024-09-12T02:29:52.627874+0000","last_became_active":"2024-09-12T02:29:52.623167+0000","last_became_peered":"2024-09-12T02:29:52.623167+0000","last_unstale":"2024-09-12T02:29:52.627874+0000","last_undegraded":"2024-09-12T02:29:52.627874+0000","last_fullsized":"2024-09-12T02:29:52.627874+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:12.948177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630564+0000","last_change":"2024-09-12T02:29:52.626794+0000","last_active":"2024-09-12T02:29:52.630564+0000","last_peered":"2024-09-12T02:29:52.630564+0000","last_clean":"2024-09-12T02:29:52.630564+0000","last_became_active":"2024-09-12T02:29:52.626539+0000","last_became_peered":"2024-09-12T02:29:52.626539+0000","last_unstale":"2024-09-12T02:29:52.630564+0000","last_undegraded":"2024-09-12T02:29:52.630564+0000","last_fullsized":"2024-09-12T02:29:52.630564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639139+0000","last_change":"2024-09-12T02:29:52.630608+0000","last_active":"2024-09-12T02:29:52.639139+0000","last_peered":"2024-09-12T02:29:52.639139+0000","last_clean":"2024-09-12T02:29:52.639139+0000","last_became_active":"2024-09-12T02:29:52.630375+0000","last_became_peered":"2024-09-12T02:29:52.630375+0000","last_unstale":"2024-09-12T02:29:52.639139+0000","last_undegraded":"2024-09-12T02:29:52.639139+0000","last_fullsized":"2024-09-12T02:29:52.639139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629762+0000","last_change":"2024-09-12T02:29:52.626665+0000","last_active":"2024-09-12T02:29:52.629762+0000","last_peered":"2024-09-12T02:29:52.629762+0000","last_clean":"2024-09-12T02:29:52.629762+0000","last_became_active":"2024-09-12T02:29:52.623946+0000","last_became_peered":"2024-09-12T02:29:52.623946+0000","last_unstale":"2024-09-12T02:29:52.629762+0000","last_undegraded":"2024-09-12T02:29:52.629762+0000","last_fullsized":"2024-09-12T02:29:52.629762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639512+0000","last_change":"2024-09-12T02:29:52.631057+0000","last_active":"2024-09-12T02:29:52.639512+0000","last_peered":"2024-09-12T02:29:52.639512+0000","last_clean":"2024-09-12T02:29:52.639512+0000","last_became_active":"2024-09-12T02:29:52.630774+0000","last_became_peered":"2024-09-12T02:29:52.630774+0000","last_unstale":"2024-09-12T02:29:52.639512+0000","last_undegraded":"2024-09-12T02:29:52.639512+0000","last_fullsized":"2024-09-12T02:29:52.639512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633831+0000","last_change":"2024-09-12T02:29:52.629995+0000","last_active":"2024-09-12T02:29:52.633831+0000","last_peered":"2024-09-12T02:29:52.633831+0000","last_clean":"2024-09-12T02:29:52.633831+0000","last_became_active":"2024-09-12T02:29:52.629259+0000","last_became_peered":"2024-09-12T02:29:52.629259+0000","last_unstale":"2024-09-12T02:29:52.633831+0000","last_undegraded":"2024-09-12T02:29:52.633831+0000","last_fullsized":"2024-09-12T02:29:52.633831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598286+0000","last_change":"2024-09-12T02:29:51.598286+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598286+0000","last_undegraded":"2024-09-12T02:29:51.598286+0000","last_fullsized":"2024-09-12T02:29:51.598286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631568+0000","last_change":"2024-09-12T02:29:52.627901+0000","last_active":"2024-09-12T02:29:52.631568+0000","last_peered":"2024-09-12T02:29:52.631568+0000","last_clean":"2024-09-12T02:29:52.631568+0000","last_became_active":"2024-09-12T02:29:52.627653+0000","last_became_peered":"2024-09-12T02:29:52.627653+0000","last_unstale":"2024-09-12T02:29:52.631568+0000","last_undegraded":"2024-09-12T02:29:52.631568+0000","last_fullsized":"2024-09-12T02:29:52.631568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.601418+0000","last_change":"2024-09-12T02:29:51.601418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.601418+0000","last_undegraded":"2024-09-12T02:29:51.601418+0000","last_fullsized":"2024-09-12T02:29:51.601418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630467+0000","last_change":"2024-09-12T02:29:52.627443+0000","last_active":"2024-09-12T02:29:52.630467+0000","last_peered":"2024-09-12T02:29:52.630467+0000","last_clean":"2024-09-12T02:29:52.630467+0000","last_became_active":"2024-09-12T02:29:52.627180+0000","last_became_peered":"2024-09-12T02:29:52.627180+0000","last_unstale":"2024-09-12T02:29:52.630467+0000","last_undegraded":"2024-09-12T02:29:52.630467+0000","last_fullsized":"2024-09-12T02:29:52.630467+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:48.076991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627324+0000","last_change":"2024-09-12T02:29:52.621284+0000","last_active":"2024-09-12T02:29:52.627324+0000","last_peered":"2024-09-12T02:29:52.627324+0000","last_clean":"2024-09-12T02:29:52.627324+0000","last_became_active":"2024-09-12T02:29:52.620998+0000","last_became_peered":"2024-09-12T02:29:52.620998+0000","last_unstale":"2024-09-12T02:29:52.627324+0000","last_undegraded":"2024-09-12T02:29:52.627324+0000","last_fullsized":"2024-09-12T02:29:52.627324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633638+0000","last_change":"2024-09-12T02:29:52.629899+0000","last_active":"2024-09-12T02:29:52.633638+0000","last_peered":"2024-09-12T02:29:52.633638+0000","last_clean":"2024-09-12T02:29:52.633638+0000","last_became_active":"2024-09-12T02:29:52.628179+0000","last_became_peered":"2024-09-12T02:29:52.628179+0000","last_unstale":"2024-09-12T02:29:52.633638+0000","last_undegraded":"2024-09-12T02:29:52.633638+0000","last_fullsized":"2024-09-12T02:29:52.633638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630542+0000","last_change":"2024-09-12T02:29:52.626757+0000","last_active":"2024-09-12T02:29:52.630542+0000","last_peered":"2024-09-12T02:29:52.630542+0000","last_clean":"2024-09-12T02:29:52.630542+0000","last_became_active":"2024-09-12T02:29:52.626506+0000","last_became_peered":"2024-09-12T02:29:52.626506+0000","last_unstale":"2024-09-12T02:29:52.630542+0000","last_undegraded":"2024-09-12T02:29:52.630542+0000","last_fullsized":"2024-09-12T02:29:52.630542+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:10.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598639+0000","last_change":"2024-09-12T02:29:51.598639+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598639+0000","last_undegraded":"2024-09-12T02:29:51.598639+0000","last_fullsized":"2024-09-12T02:29:51.598639+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.604028+0000","last_change":"2024-09-12T02:29:51.604028+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.604028+0000","last_undegraded":"2024-09-12T02:29:51.604028+0000","last_fullsized":"2024-09-12T02:29:51.604028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629606+0000","last_change":"2024-09-12T02:29:52.626049+0000","last_active":"2024-09-12T02:29:52.629606+0000","last_peered":"2024-09-12T02:29:52.629606+0000","last_clean":"2024-09-12T02:29:52.629606+0000","last_became_active":"2024-09-12T02:29:52.623834+0000","last_became_peered":"2024-09-12T02:29:52.623834+0000","last_unstale":"2024-09-12T02:29:52.629606+0000","last_undegraded":"2024-09-12T02:29:52.629606+0000","last_fullsized":"2024-09-12T02:29:52.629606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623785+0000","last_change":"2024-09-12T02:29:52.619585+0000","last_active":"2024-09-12T02:29:52.623785+0000","last_peered":"2024-09-12T02:29:52.623785+0000","last_clean":"2024-09-12T02:29:52.623785+0000","last_became_active":"2024-09-12T02:29:52.619083+0000","last_became_peered":"2024-09-12T02:29:52.619083+0000","last_unstale":"2024-09-12T02:29:52.623785+0000","last_undegraded":"2024-09-12T02:29:52.623785+0000","last_fullsized":"2024-09-12T02:29:52.623785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:45.067612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623751+0000","last_change":"2024-09-12T02:29:52.619566+0000","last_active":"2024-09-12T02:29:52.623751+0000","last_peered":"2024-09-12T02:29:52.623751+0000","last_clean":"2024-09-12T02:29:52.623751+0000","last_became_active":"2024-09-12T02:29:52.619287+0000","last_became_peered":"2024-09-12T02:29:52.619287+0000","last_unstale":"2024-09-12T02:29:52.623751+0000","last_undegraded":"2024-09-12T02:29:52.623751+0000","last_fullsized":"2024-09-12T02:29:52.623751+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:46.440930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629858+0000","last_change":"2024-09-12T02:29:52.624234+0000","last_active":"2024-09-12T02:29:52.629858+0000","last_peered":"2024-09-12T02:29:52.629858+0000","last_clean":"2024-09-12T02:29:52.629858+0000","last_became_active":"2024-09-12T02:29:52.623944+0000","last_became_peered":"2024-09-12T02:29:52.623944+0000","last_unstale":"2024-09-12T02:29:52.629858+0000","last_undegraded":"2024-09-12T02:29:52.629858+0000","last_fullsized":"2024-09-12T02:29:52.629858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:07.728093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598877+0000","last_change":"2024-09-12T02:29:51.598877+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598877+0000","last_undegraded":"2024-09-12T02:29:51.598877+0000","last_fullsized":"2024-09-12T02:29:51.598877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627386+0000","last_change":"2024-09-12T02:29:52.621835+0000","last_active":"2024-09-12T02:29:52.627386+0000","last_peered":"2024-09-12T02:29:52.627386+0000","last_clean":"2024-09-12T02:29:52.627386+0000","last_became_active":"2024-09-12T02:29:52.621425+0000","last_became_peered":"2024-09-12T02:29:52.621425+0000","last_unstale":"2024-09-12T02:29:52.627386+0000","last_undegraded":"2024-09-12T02:29:52.627386+0000","last_fullsized":"2024-09-12T02:29:52.627386+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633713+0000","last_change":"2024-09-12T02:29:52.629253+0000","last_active":"2024-09-12T02:29:52.633713+0000","last_peered":"2024-09-12T02:29:52.633713+0000","last_clean":"2024-09-12T02:29:52.633713+0000","last_became_active":"2024-09-12T02:29:52.628886+0000","last_became_peered":"2024-09-12T02:29:52.628886+0000","last_unstale":"2024-09-12T02:29:52.633713+0000","last_undegraded":"2024-09-12T02:29:52.633713+0000","last_fullsized":"2024-09-12T02:29:52.633713+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:00.216010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.632417+0000","last_change":"2024-09-12T02:29:52.630703+0000","last_active":"2024-09-12T02:29:52.632417+0000","last_peered":"2024-09-12T02:29:52.632417+0000","last_clean":"2024-09-12T02:29:52.632417+0000","last_became_active":"2024-09-12T02:29:52.630404+0000","last_became_peered":"2024-09-12T02:29:52.630404+0000","last_unstale":"2024-09-12T02:29:52.632417+0000","last_undegraded":"2024-09-12T02:29:52.632417+0000","last_fullsized":"2024-09-12T02:29:52.632417+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.851862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623095+0000","last_change":"2024-09-12T02:29:52.619356+0000","last_active":"2024-09-12T02:29:52.623095+0000","last_peered":"2024-09-12T02:29:52.623095+0000","last_clean":"2024-09-12T02:29:52.623095+0000","last_became_active":"2024-09-12T02:29:52.618699+0000","last_became_peered":"2024-09-12T02:29:52.618699+0000","last_unstale":"2024-09-12T02:29:52.623095+0000","last_undegraded":"2024-09-12T02:29:52.623095+0000","last_fullsized":"2024-09-12T02:29:52.623095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600822+0000","last_change":"2024-09-12T02:29:51.600822+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600822+0000","last_undegraded":"2024-09-12T02:29:51.600822+0000","last_fullsized":"2024-09-12T02:29:51.600822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.597886+0000","last_change":"2024-09-12T02:29:51.597886+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.597886+0000","last_undegraded":"2024-09-12T02:29:51.597886+0000","last_fullsized":"2024-09-12T02:29:51.597886+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624697+0000","last_change":"2024-09-12T02:29:52.622329+0000","last_active":"2024-09-12T02:29:52.624697+0000","last_peered":"2024-09-12T02:29:52.624697+0000","last_clean":"2024-09-12T02:29:52.624697+0000","last_became_active":"2024-09-12T02:29:52.622085+0000","last_became_peered":"2024-09-12T02:29:52.622085+0000","last_unstale":"2024-09-12T02:29:52.624697+0000","last_undegraded":"2024-09-12T02:29:52.624697+0000","last_fullsized":"2024-09-12T02:29:52.624697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615102+0000","last_change":"2024-09-12T02:29:51.614012+0000","last_active":"2024-09-12T02:29:51.615102+0000","last_peered":"2024-09-12T02:29:51.615102+0000","last_clean":"2024-09-12T02:29:51.615102+0000","last_became_active":"2024-09-12T02:29:51.613643+0000","last_became_peered":"2024-09-12T02:29:51.613643+0000","last_unstale":"2024-09-12T02:29:51.615102+0000","last_undegraded":"2024-09-12T02:29:51.615102+0000","last_fullsized":"2024-09-12T02:29:51.615102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624124+0000","last_change":"2024-09-12T02:29:52.619287+0000","last_active":"2024-09-12T02:29:52.624124+0000","last_peered":"2024-09-12T02:29:52.624124+0000","last_clean":"2024-09-12T02:29:52.624124+0000","last_became_active":"2024-09-12T02:29:52.618727+0000","last_became_peered":"2024-09-12T02:29:52.618727+0000","last_unstale":"2024-09-12T02:29:52.624124+0000","last_undegraded":"2024-09-12T02:29:52.624124+0000","last_fullsized":"2024-09-12T02:29:52.624124+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:52.246079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638727+0000","last_change":"2024-09-12T02:29:51.616177+0000","last_active":"2024-09-12T02:29:52.638727+0000","last_peered":"2024-09-12T02:29:52.638727+0000","last_clean":"2024-09-12T02:29:52.638727+0000","last_became_active":"2024-09-12T02:29:51.615785+0000","last_became_peered":"2024-09-12T02:29:51.615785+0000","last_unstale":"2024-09-12T02:29:52.638727+0000","last_undegraded":"2024-09-12T02:29:52.638727+0000","last_fullsized":"2024-09-12T02:29:52.638727+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:59.369993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639012+0000","last_change":"2024-09-12T02:29:52.635785+0000","last_active":"2024-09-12T02:29:52.639012+0000","last_peered":"2024-09-12T02:29:52.639012+0000","last_clean":"2024-09-12T02:29:52.639012+0000","last_became_active":"2024-09-12T02:29:52.635600+0000","last_became_peered":"2024-09-12T02:29:52.635600+0000","last_unstale":"2024-09-12T02:29:52.639012+0000","last_undegraded":"2024-09-12T02:29:52.639012+0000","last_fullsized":"2024-09-12T02:29:52.639012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634179+0000","last_change":"2024-09-12T02:29:51.609063+0000","last_active":"2024-09-12T02:29:52.634179+0000","last_peered":"2024-09-12T02:29:52.634179+0000","last_clean":"2024-09-12T02:29:52.634179+0000","last_became_active":"2024-09-12T02:29:51.608783+0000","last_became_peered":"2024-09-12T02:29:51.608783+0000","last_unstale":"2024-09-12T02:29:52.634179+0000","last_undegraded":"2024-09-12T02:29:52.634179+0000","last_fullsized":"2024-09-12T02:29:52.634179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:33.174988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624739+0000","last_change":"2024-09-12T02:29:52.623116+0000","last_active":"2024-09-12T02:29:52.624739+0000","last_peered":"2024-09-12T02:29:52.624739+0000","last_clean":"2024-09-12T02:29:52.624739+0000","last_became_active":"2024-09-12T02:29:52.622677+0000","last_became_peered":"2024-09-12T02:29:52.622677+0000","last_unstale":"2024-09-12T02:29:52.624739+0000","last_undegraded":"2024-09-12T02:29:52.624739+0000","last_fullsized":"2024-09-12T02:29:52.624739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.634095+0000","last_change":"2024-09-12T02:29:51.612680+0000","last_active":"2024-09-12T02:29:52.634095+0000","last_peered":"2024-09-12T02:29:52.634095+0000","last_clean":"2024-09-12T02:29:52.634095+0000","last_became_active":"2024-09-12T02:29:51.612387+0000","last_became_peered":"2024-09-12T02:29:51.612387+0000","last_unstale":"2024-09-12T02:29:52.634095+0000","last_undegraded":"2024-09-12T02:29:52.634095+0000","last_fullsized":"2024-09-12T02:29:52.634095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623116+0000","last_change":"2024-09-12T02:29:52.620087+0000","last_active":"2024-09-12T02:29:52.623116+0000","last_peered":"2024-09-12T02:29:52.623116+0000","last_clean":"2024-09-12T02:29:52.623116+0000","last_became_active":"2024-09-12T02:29:52.619795+0000","last_became_peered":"2024-09-12T02:29:52.619795+0000","last_unstale":"2024-09-12T02:29:52.623116+0000","last_undegraded":"2024-09-12T02:29:52.623116+0000","last_fullsized":"2024-09-12T02:29:52.623116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.613370+0000","last_change":"2024-09-12T02:29:51.609628+0000","last_active":"2024-09-12T02:29:51.613370+0000","last_peered":"2024-09-12T02:29:51.613370+0000","last_clean":"2024-09-12T02:29:51.613370+0000","last_became_active":"2024-09-12T02:29:51.609346+0000","last_became_peered":"2024-09-12T02:29:51.609346+0000","last_unstale":"2024-09-12T02:29:51.613370+0000","last_undegraded":"2024-09-12T02:29:51.613370+0000","last_fullsized":"2024-09-12T02:29:51.613370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:45.697011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639897+0000","last_change":"2024-09-12T02:29:52.635166+0000","last_active":"2024-09-12T02:29:52.639897+0000","last_peered":"2024-09-12T02:29:52.639897+0000","last_clean":"2024-09-12T02:29:52.639897+0000","last_became_active":"2024-09-12T02:29:52.634883+0000","last_became_peered":"2024-09-12T02:29:52.634883+0000","last_unstale":"2024-09-12T02:29:52.639897+0000","last_undegraded":"2024-09-12T02:29:52.639897+0000","last_fullsized":"2024-09-12T02:29:52.639897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.902749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638620+0000","last_change":"2024-09-12T02:29:51.618885+0000","last_active":"2024-09-12T02:29:52.638620+0000","last_peered":"2024-09-12T02:29:52.638620+0000","last_clean":"2024-09-12T02:29:52.638620+0000","last_became_active":"2024-09-12T02:29:51.618593+0000","last_became_peered":"2024-09-12T02:29:51.618593+0000","last_unstale":"2024-09-12T02:29:52.638620+0000","last_undegraded":"2024-09-12T02:29:52.638620+0000","last_fullsized":"2024-09-12T02:29:52.638620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630538+0000","last_change":"2024-09-12T02:29:52.626277+0000","last_active":"2024-09-12T02:29:52.630538+0000","last_peered":"2024-09-12T02:29:52.630538+0000","last_clean":"2024-09-12T02:29:52.630538+0000","last_became_active":"2024-09-12T02:29:52.624251+0000","last_became_peered":"2024-09-12T02:29:52.624251+0000","last_unstale":"2024-09-12T02:29:52.630538+0000","last_undegraded":"2024-09-12T02:29:52.630538+0000","last_fullsized":"2024-09-12T02:29:52.630538+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616081+0000","last_change":"2024-09-12T02:29:51.607855+0000","last_active":"2024-09-12T02:29:52.616081+0000","last_peered":"2024-09-12T02:29:52.616081+0000","last_clean":"2024-09-12T02:29:52.616081+0000","last_became_active":"2024-09-12T02:29:51.607577+0000","last_became_peered":"2024-09-12T02:29:51.607577+0000","last_unstale":"2024-09-12T02:29:52.616081+0000","last_undegraded":"2024-09-12T02:29:52.616081+0000","last_fullsized":"2024-09-12T02:29:52.616081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.981772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.623263+0000","last_change":"2024-09-12T02:29:52.619061+0000","last_active":"2024-09-12T02:29:52.623263+0000","last_peered":"2024-09-12T02:29:52.623263+0000","last_clean":"2024-09-12T02:29:52.623263+0000","last_became_active":"2024-09-12T02:29:52.618591+0000","last_became_peered":"2024-09-12T02:29:52.618591+0000","last_unstale":"2024-09-12T02:29:52.623263+0000","last_undegraded":"2024-09-12T02:29:52.623263+0000","last_fullsized":"2024-09-12T02:29:52.623263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:49.116934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618137+0000","last_change":"2024-09-12T02:29:51.605916+0000","last_active":"2024-09-12T02:29:52.618137+0000","last_peered":"2024-09-12T02:29:52.618137+0000","last_clean":"2024-09-12T02:29:52.618137+0000","last_became_active":"2024-09-12T02:29:51.605679+0000","last_became_peered":"2024-09-12T02:29:51.605679+0000","last_unstale":"2024-09-12T02:29:52.618137+0000","last_undegraded":"2024-09-12T02:29:52.618137+0000","last_fullsized":"2024-09-12T02:29:52.618137+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.070779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630115+0000","last_change":"2024-09-12T02:29:52.625671+0000","last_active":"2024-09-12T02:29:52.630115+0000","last_peered":"2024-09-12T02:29:52.630115+0000","last_clean":"2024-09-12T02:29:52.630115+0000","last_became_active":"2024-09-12T02:29:52.625420+0000","last_became_peered":"2024-09-12T02:29:52.625420+0000","last_unstale":"2024-09-12T02:29:52.630115+0000","last_undegraded":"2024-09-12T02:29:52.630115+0000","last_fullsized":"2024-09-12T02:29:52.630115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611664+0000","last_change":"2024-09-12T02:29:51.613737+0000","last_active":"2024-09-12T02:29:52.611664+0000","last_peered":"2024-09-12T02:29:52.611664+0000","last_clean":"2024-09-12T02:29:52.611664+0000","last_became_active":"2024-09-12T02:29:51.613468+0000","last_became_peered":"2024-09-12T02:29:51.613468+0000","last_unstale":"2024-09-12T02:29:52.611664+0000","last_undegraded":"2024-09-12T02:29:52.611664+0000","last_fullsized":"2024-09-12T02:29:52.611664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627765+0000","last_change":"2024-09-12T02:29:52.621214+0000","last_active":"2024-09-12T02:29:52.627765+0000","last_peered":"2024-09-12T02:29:52.627765+0000","last_clean":"2024-09-12T02:29:52.627765+0000","last_became_active":"2024-09-12T02:29:52.620907+0000","last_became_peered":"2024-09-12T02:29:52.620907+0000","last_unstale":"2024-09-12T02:29:52.627765+0000","last_undegraded":"2024-09-12T02:29:52.627765+0000","last_fullsized":"2024-09-12T02:29:52.627765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618101+0000","last_change":"2024-09-12T02:29:51.609872+0000","last_active":"2024-09-12T02:29:52.618101+0000","last_peered":"2024-09-12T02:29:52.618101+0000","last_clean":"2024-09-12T02:29:52.618101+0000","last_became_active":"2024-09-12T02:29:51.609605+0000","last_became_peered":"2024-09-12T02:29:51.609605+0000","last_unstale":"2024-09-12T02:29:52.618101+0000","last_undegraded":"2024-09-12T02:29:52.618101+0000","last_fullsized":"2024-09-12T02:29:52.618101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:46.757750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.603183+0000","last_change":"2024-09-12T02:29:51.603183+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.603183+0000","last_undegraded":"2024-09-12T02:29:51.603183+0000","last_fullsized":"2024-09-12T02:29:51.603183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631741+0000","last_change":"2024-09-12T02:29:51.614666+0000","last_active":"2024-09-12T02:29:52.631741+0000","last_peered":"2024-09-12T02:29:52.631741+0000","last_clean":"2024-09-12T02:29:52.631741+0000","last_became_active":"2024-09-12T02:29:51.614405+0000","last_became_peered":"2024-09-12T02:29:51.614405+0000","last_unstale":"2024-09-12T02:29:52.631741+0000","last_undegraded":"2024-09-12T02:29:52.631741+0000","last_fullsized":"2024-09-12T02:29:52.631741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.623412+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.623148+0000","last_became_peered":"2024-09-12T02:29:52.623148+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.391061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.617828+0000","last_change":"2024-09-12T02:29:51.613589+0000","last_active":"2024-09-12T02:29:51.617828+0000","last_peered":"2024-09-12T02:29:51.617828+0000","last_clean":"2024-09-12T02:29:51.617828+0000","last_became_active":"2024-09-12T02:29:51.613319+0000","last_became_peered":"2024-09-12T02:29:51.613319+0000","last_unstale":"2024-09-12T02:29:51.617828+0000","last_undegraded":"2024-09-12T02:29:51.617828+0000","last_fullsized":"2024-09-12T02:29:51.617828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:24.270926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630859+0000","last_change":"2024-09-12T02:29:52.625357+0000","last_active":"2024-09-12T02:29:52.630859+0000","last_peered":"2024-09-12T02:29:52.630859+0000","last_clean":"2024-09-12T02:29:52.630859+0000","last_became_active":"2024-09-12T02:29:52.625103+0000","last_became_peered":"2024-09-12T02:29:52.625103+0000","last_unstale":"2024-09-12T02:29:52.630859+0000","last_undegraded":"2024-09-12T02:29:52.630859+0000","last_fullsized":"2024-09-12T02:29:52.630859+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.460761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615064+0000","last_change":"2024-09-12T02:29:51.613802+0000","last_active":"2024-09-12T02:29:51.615064+0000","last_peered":"2024-09-12T02:29:51.615064+0000","last_clean":"2024-09-12T02:29:51.615064+0000","last_became_active":"2024-09-12T02:29:51.613156+0000","last_became_peered":"2024-09-12T02:29:51.613156+0000","last_unstale":"2024-09-12T02:29:51.615064+0000","last_undegraded":"2024-09-12T02:29:51.615064+0000","last_fullsized":"2024-09-12T02:29:51.615064+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:38.552485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629660+0000","last_change":"2024-09-12T02:29:52.622189+0000","last_active":"2024-09-12T02:29:52.629660+0000","last_peered":"2024-09-12T02:29:52.629660+0000","last_clean":"2024-09-12T02:29:52.629660+0000","last_became_active":"2024-09-12T02:29:52.620723+0000","last_became_peered":"2024-09-12T02:29:52.620723+0000","last_unstale":"2024-09-12T02:29:52.629660+0000","last_undegraded":"2024-09-12T02:29:52.629660+0000","last_fullsized":"2024-09-12T02:29:52.629660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612995+0000","last_change":"2024-09-12T02:29:51.611049+0000","last_active":"2024-09-12T02:29:52.612995+0000","last_peered":"2024-09-12T02:29:52.612995+0000","last_clean":"2024-09-12T02:29:52.612995+0000","last_became_active":"2024-09-12T02:29:51.610685+0000","last_became_peered":"2024-09-12T02:29:51.610685+0000","last_unstale":"2024-09-12T02:29:52.612995+0000","last_undegraded":"2024-09-12T02:29:52.612995+0000","last_fullsized":"2024-09-12T02:29:52.612995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.599773+0000","last_change":"2024-09-12T02:29:51.599773+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.599773+0000","last_undegraded":"2024-09-12T02:29:51.599773+0000","last_fullsized":"2024-09-12T02:29:51.599773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612436+0000","last_change":"2024-09-12T02:29:51.607416+0000","last_active":"2024-09-12T02:29:51.612436+0000","last_peered":"2024-09-12T02:29:51.612436+0000","last_clean":"2024-09-12T02:29:51.612436+0000","last_became_active":"2024-09-12T02:29:51.607099+0000","last_became_peered":"2024-09-12T02:29:51.607099+0000","last_unstale":"2024-09-12T02:29:51.612436+0000","last_undegraded":"2024-09-12T02:29:51.612436+0000","last_fullsized":"2024-09-12T02:29:51.612436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.652426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627819+0000","last_change":"2024-09-12T02:29:52.622184+0000","last_active":"2024-09-12T02:29:52.627819+0000","last_peered":"2024-09-12T02:29:52.627819+0000","last_clean":"2024-09-12T02:29:52.627819+0000","last_became_active":"2024-09-12T02:29:52.621910+0000","last_became_peered":"2024-09-12T02:29:52.621910+0000","last_unstale":"2024-09-12T02:29:52.627819+0000","last_undegraded":"2024-09-12T02:29:52.627819+0000","last_fullsized":"2024-09-12T02:29:52.627819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.644576+0000","last_change":"2024-09-12T02:29:51.609082+0000","last_active":"2024-09-12T02:29:52.644576+0000","last_peered":"2024-09-12T02:29:52.644576+0000","last_clean":"2024-09-12T02:29:52.644576+0000","last_became_active":"2024-09-12T02:29:51.608827+0000","last_became_peered":"2024-09-12T02:29:51.608827+0000","last_unstale":"2024-09-12T02:29:52.644576+0000","last_undegraded":"2024-09-12T02:29:52.644576+0000","last_fullsized":"2024-09-12T02:29:52.644576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598411+0000","last_change":"2024-09-12T02:29:51.598411+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598411+0000","last_undegraded":"2024-09-12T02:29:51.598411+0000","last_fullsized":"2024-09-12T02:29:51.598411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.612888+0000","last_change":"2024-09-12T02:29:51.607882+0000","last_active":"2024-09-12T02:29:51.612888+0000","last_peered":"2024-09-12T02:29:51.612888+0000","last_clean":"2024-09-12T02:29:51.612888+0000","last_became_active":"2024-09-12T02:29:51.607629+0000","last_became_peered":"2024-09-12T02:29:51.607629+0000","last_unstale":"2024-09-12T02:29:51.612888+0000","last_undegraded":"2024-09-12T02:29:51.612888+0000","last_fullsized":"2024-09-12T02:29:51.612888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:57.296742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639924+0000","last_change":"2024-09-12T02:29:52.636838+0000","last_active":"2024-09-12T02:29:52.639924+0000","last_peered":"2024-09-12T02:29:52.639924+0000","last_clean":"2024-09-12T02:29:52.639924+0000","last_became_active":"2024-09-12T02:29:52.636501+0000","last_became_peered":"2024-09-12T02:29:52.636501+0000","last_unstale":"2024-09-12T02:29:52.639924+0000","last_undegraded":"2024-09-12T02:29:52.639924+0000","last_fullsized":"2024-09-12T02:29:52.639924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:26.154285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638925+0000","last_change":"2024-09-12T02:29:51.614040+0000","last_active":"2024-09-12T02:29:52.638925+0000","last_peered":"2024-09-12T02:29:52.638925+0000","last_clean":"2024-09-12T02:29:52.638925+0000","last_became_active":"2024-09-12T02:29:51.613358+0000","last_became_peered":"2024-09-12T02:29:51.613358+0000","last_unstale":"2024-09-12T02:29:52.638925+0000","last_undegraded":"2024-09-12T02:29:52.638925+0000","last_fullsized":"2024-09-12T02:29:52.638925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.638828+0000","last_change":"2024-09-12T02:29:52.636869+0000","last_active":"2024-09-12T02:29:52.638828+0000","last_peered":"2024-09-12T02:29:52.638828+0000","last_clean":"2024-09-12T02:29:52.638828+0000","last_became_active":"2024-09-12T02:29:52.636670+0000","last_became_peered":"2024-09-12T02:29:52.636670+0000","last_unstale":"2024-09-12T02:29:52.638828+0000","last_undegraded":"2024-09-12T02:29:52.638828+0000","last_fullsized":"2024-09-12T02:29:52.638828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.374964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631254+0000","last_change":"2024-09-12T02:29:51.607951+0000","last_active":"2024-09-12T02:29:52.631254+0000","last_peered":"2024-09-12T02:29:52.631254+0000","last_clean":"2024-09-12T02:29:52.631254+0000","last_became_active":"2024-09-12T02:29:51.607630+0000","last_became_peered":"2024-09-12T02:29:51.607630+0000","last_unstale":"2024-09-12T02:29:52.631254+0000","last_undegraded":"2024-09-12T02:29:52.631254+0000","last_fullsized":"2024-09-12T02:29:52.631254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.624823+0000","last_change":"2024-09-12T02:29:52.622191+0000","last_active":"2024-09-12T02:29:52.624823+0000","last_peered":"2024-09-12T02:29:52.624823+0000","last_clean":"2024-09-12T02:29:52.624823+0000","last_became_active":"2024-09-12T02:29:52.621584+0000","last_became_peered":"2024-09-12T02:29:52.621584+0000","last_unstale":"2024-09-12T02:29:52.624823+0000","last_undegraded":"2024-09-12T02:29:52.624823+0000","last_fullsized":"2024-09-12T02:29:52.624823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.365214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.615558+0000","last_change":"2024-09-12T02:29:51.614595+0000","last_active":"2024-09-12T02:29:51.615558+0000","last_peered":"2024-09-12T02:29:51.615558+0000","last_clean":"2024-09-12T02:29:51.615558+0000","last_became_active":"2024-09-12T02:29:51.614265+0000","last_became_peered":"2024-09-12T02:29:51.614265+0000","last_unstale":"2024-09-12T02:29:51.615558+0000","last_undegraded":"2024-09-12T02:29:51.615558+0000","last_fullsized":"2024-09-12T02:29:51.615558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:20.937452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600616+0000","last_change":"2024-09-12T02:29:51.600616+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600616+0000","last_undegraded":"2024-09-12T02:29:51.600616+0000","last_fullsized":"2024-09-12T02:29:51.600616+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.609795+0000","last_change":"2024-09-12T02:29:51.606261+0000","last_active":"2024-09-12T02:29:51.609795+0000","last_peered":"2024-09-12T02:29:51.609795+0000","last_clean":"2024-09-12T02:29:51.609795+0000","last_became_active":"2024-09-12T02:29:51.605989+0000","last_became_peered":"2024-09-12T02:29:51.605989+0000","last_unstale":"2024-09-12T02:29:51.609795+0000","last_undegraded":"2024-09-12T02:29:51.609795+0000","last_fullsized":"2024-09-12T02:29:51.609795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:46.210505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627339+0000","last_change":"2024-09-12T02:29:52.624877+0000","last_active":"2024-09-12T02:29:52.627339+0000","last_peered":"2024-09-12T02:29:52.627339+0000","last_clean":"2024-09-12T02:29:52.627339+0000","last_became_active":"2024-09-12T02:29:52.624540+0000","last_became_peered":"2024-09-12T02:29:52.624540+0000","last_unstale":"2024-09-12T02:29:52.627339+0000","last_undegraded":"2024-09-12T02:29:52.627339+0000","last_fullsized":"2024-09-12T02:29:52.627339+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.616102+0000","last_change":"2024-09-12T02:29:51.603198+0000","last_active":"2024-09-12T02:29:52.616102+0000","last_peered":"2024-09-12T02:29:52.616102+0000","last_clean":"2024-09-12T02:29:52.616102+0000","last_became_active":"2024-09-12T02:29:51.602891+0000","last_became_peered":"2024-09-12T02:29:51.602891+0000","last_unstale":"2024-09-12T02:29:52.616102+0000","last_undegraded":"2024-09-12T02:29:52.616102+0000","last_fullsized":"2024-09-12T02:29:52.616102+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.598418+0000","last_change":"2024-09-12T02:29:51.598418+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.598418+0000","last_undegraded":"2024-09-12T02:29:51.598418+0000","last_fullsized":"2024-09-12T02:29:51.598418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.615892+0000","last_change":"2024-09-12T02:29:51.609912+0000","last_active":"2024-09-12T02:29:52.615892+0000","last_peered":"2024-09-12T02:29:52.615892+0000","last_clean":"2024-09-12T02:29:52.615892+0000","last_became_active":"2024-09-12T02:29:51.609646+0000","last_became_peered":"2024-09-12T02:29:51.609646+0000","last_unstale":"2024-09-12T02:29:52.615892+0000","last_undegraded":"2024-09-12T02:29:52.615892+0000","last_fullsized":"2024-09-12T02:29:52.615892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.455790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.639646+0000","last_change":"2024-09-12T02:29:52.631060+0000","last_active":"2024-09-12T02:29:52.639646+0000","last_peered":"2024-09-12T02:29:52.639646+0000","last_clean":"2024-09-12T02:29:52.639646+0000","last_became_active":"2024-09-12T02:29:52.630218+0000","last_became_peered":"2024-09-12T02:29:52.630218+0000","last_unstale":"2024-09-12T02:29:52.639646+0000","last_undegraded":"2024-09-12T02:29:52.639646+0000","last_fullsized":"2024-09-12T02:29:52.639646+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:27.285618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614576+0000","last_change":"2024-09-12T02:29:51.613668+0000","last_active":"2024-09-12T02:29:52.614576+0000","last_peered":"2024-09-12T02:29:52.614576+0000","last_clean":"2024-09-12T02:29:52.614576+0000","last_became_active":"2024-09-12T02:29:51.612615+0000","last_became_peered":"2024-09-12T02:29:51.612615+0000","last_unstale":"2024-09-12T02:29:52.614576+0000","last_undegraded":"2024-09-12T02:29:52.614576+0000","last_fullsized":"2024-09-12T02:29:52.614576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:59.211039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.630298+0000","last_change":"2024-09-12T02:29:52.626071+0000","last_active":"2024-09-12T02:29:52.630298+0000","last_peered":"2024-09-12T02:29:52.630298+0000","last_clean":"2024-09-12T02:29:52.630298+0000","last_became_active":"2024-09-12T02:29:52.625734+0000","last_became_peered":"2024-09-12T02:29:52.625734+0000","last_unstale":"2024-09-12T02:29:52.630298+0000","last_undegraded":"2024-09-12T02:29:52.630298+0000","last_fullsized":"2024-09-12T02:29:52.630298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.762721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:29:51.614269+0000","last_change":"2024-09-12T02:29:51.613594+0000","last_active":"2024-09-12T02:29:51.614269+0000","last_peered":"2024-09-12T02:29:51.614269+0000","last_clean":"2024-09-12T02:29:51.614269+0000","last_became_active":"2024-09-12T02:29:51.613308+0000","last_became_peered":"2024-09-12T02:29:51.613308+0000","last_unstale":"2024-09-12T02:29:51.614269+0000","last_undegraded":"2024-09-12T02:29:51.614269+0000","last_fullsized":"2024-09-12T02:29:51.614269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:57.658906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629833+0000","last_change":"2024-09-12T02:29:52.626950+0000","last_active":"2024-09-12T02:29:52.629833+0000","last_peered":"2024-09-12T02:29:52.629833+0000","last_clean":"2024-09-12T02:29:52.629833+0000","last_became_active":"2024-09-12T02:29:52.624339+0000","last_became_peered":"2024-09-12T02:29:52.624339+0000","last_unstale":"2024-09-12T02:29:52.629833+0000","last_undegraded":"2024-09-12T02:29:52.629833+0000","last_fullsized":"2024-09-12T02:29:52.629833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614224+0000","last_change":"2024-09-12T02:29:51.614143+0000","last_active":"2024-09-12T02:29:52.614224+0000","last_peered":"2024-09-12T02:29:52.614224+0000","last_clean":"2024-09-12T02:29:52.614224+0000","last_became_active":"2024-09-12T02:29:51.613862+0000","last_became_peered":"2024-09-12T02:29:51.613862+0000","last_unstale":"2024-09-12T02:29:52.614224+0000","last_undegraded":"2024-09-12T02:29:52.614224+0000","last_fullsized":"2024-09-12T02:29:52.614224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.971168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.633485+0000","last_change":"2024-09-12T02:29:52.628947+0000","last_active":"2024-09-12T02:29:52.633485+0000","last_peered":"2024-09-12T02:29:52.633485+0000","last_clean":"2024-09-12T02:29:52.633485+0000","last_became_active":"2024-09-12T02:29:52.628641+0000","last_became_peered":"2024-09-12T02:29:52.628641+0000","last_unstale":"2024-09-12T02:29:52.633485+0000","last_undegraded":"2024-09-12T02:29:52.633485+0000","last_fullsized":"2024-09-12T02:29:52.633485+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.950748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612520+0000","last_change":"2024-09-12T02:29:51.608188+0000","last_active":"2024-09-12T02:29:52.612520+0000","last_peered":"2024-09-12T02:29:52.612520+0000","last_clean":"2024-09-12T02:29:52.612520+0000","last_became_active":"2024-09-12T02:29:51.607861+0000","last_became_peered":"2024-09-12T02:29:51.607861+0000","last_unstale":"2024-09-12T02:29:52.612520+0000","last_undegraded":"2024-09-12T02:29:52.612520+0000","last_fullsized":"2024-09-12T02:29:52.612520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600158+0000","last_change":"2024-09-12T02:29:51.600158+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600158+0000","last_undegraded":"2024-09-12T02:29:51.600158+0000","last_fullsized":"2024-09-12T02:29:51.600158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614036+0000","last_change":"2024-09-12T02:29:51.614527+0000","last_active":"2024-09-12T02:29:52.614036+0000","last_peered":"2024-09-12T02:29:52.614036+0000","last_clean":"2024-09-12T02:29:52.614036+0000","last_became_active":"2024-09-12T02:29:51.614243+0000","last_became_peered":"2024-09-12T02:29:51.614243+0000","last_unstale":"2024-09-12T02:29:52.614036+0000","last_undegraded":"2024-09-12T02:29:52.614036+0000","last_fullsized":"2024-09-12T02:29:52.614036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:10.586982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-12T02:29:51.600978+0000","last_change":"2024-09-12T02:29:51.600978+0000","last_active":"2024-09-12T02:29:51.589828+0000","last_peered":"2024-09-12T02:29:51.589828+0000","last_clean":"2024-09-12T02:29:51.589828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:29:51.600978+0000","last_undegraded":"2024-09-12T02:29:51.600978+0000","last_fullsized":"2024-09-12T02:29:51.600978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.611085+0000","last_change":"2024-09-12T02:29:51.613803+0000","last_active":"2024-09-12T02:29:52.611085+0000","last_peered":"2024-09-12T02:29:52.611085+0000","last_clean":"2024-09-12T02:29:52.611085+0000","last_became_active":"2024-09-12T02:29:51.613523+0000","last_became_peered":"2024-09-12T02:29:51.613523+0000","last_unstale":"2024-09-12T02:29:52.611085+0000","last_undegraded":"2024-09-12T02:29:52.611085+0000","last_fullsized":"2024-09-12T02:29:52.611085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.631071+0000","last_change":"2024-09-12T02:29:52.626820+0000","last_active":"2024-09-12T02:29:52.631071+0000","last_peered":"2024-09-12T02:29:52.631071+0000","last_clean":"2024-09-12T02:29:52.631071+0000","last_became_active":"2024-09-12T02:29:52.626379+0000","last_became_peered":"2024-09-12T02:29:52.626379+0000","last_unstale":"2024-09-12T02:29:52.631071+0000","last_undegraded":"2024-09-12T02:29:52.631071+0000","last_fullsized":"2024-09-12T02:29:52.631071+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:17.976139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.612756+0000","last_change":"2024-09-12T02:29:51.603977+0000","last_active":"2024-09-12T02:29:52.612756+0000","last_peered":"2024-09-12T02:29:52.612756+0000","last_clean":"2024-09-12T02:29:52.612756+0000","last_became_active":"2024-09-12T02:29:51.603675+0000","last_became_peered":"2024-09-12T02:29:51.603675+0000","last_unstale":"2024-09-12T02:29:52.612756+0000","last_undegraded":"2024-09-12T02:29:52.612756+0000","last_fullsized":"2024-09-12T02:29:52.612756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.627440+0000","last_change":"2024-09-12T02:29:52.622743+0000","last_active":"2024-09-12T02:29:52.627440+0000","last_peered":"2024-09-12T02:29:52.627440+0000","last_clean":"2024-09-12T02:29:52.627440+0000","last_became_active":"2024-09-12T02:29:52.622484+0000","last_became_peered":"2024-09-12T02:29:52.622484+0000","last_unstale":"2024-09-12T02:29:52.627440+0000","last_undegraded":"2024-09-12T02:29:52.627440+0000","last_fullsized":"2024-09-12T02:29:52.627440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.618359+0000","last_change":"2024-09-12T02:29:51.607832+0000","last_active":"2024-09-12T02:29:52.618359+0000","last_peered":"2024-09-12T02:29:52.618359+0000","last_clean":"2024-09-12T02:29:52.618359+0000","last_became_active":"2024-09-12T02:29:51.607569+0000","last_became_peered":"2024-09-12T02:29:51.607569+0000","last_unstale":"2024-09-12T02:29:52.618359+0000","last_undegraded":"2024-09-12T02:29:52.618359+0000","last_fullsized":"2024-09-12T02:29:52.618359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.629714+0000","last_change":"2024-09-12T02:29:52.622767+0000","last_active":"2024-09-12T02:29:52.629714+0000","last_peered":"2024-09-12T02:29:52.629714+0000","last_clean":"2024-09-12T02:29:52.629714+0000","last_became_active":"2024-09-12T02:29:52.622534+0000","last_became_peered":"2024-09-12T02:29:52.622534+0000","last_unstale":"2024-09-12T02:29:52.629714+0000","last_undegraded":"2024-09-12T02:29:52.629714+0000","last_fullsized":"2024-09-12T02:29:52.629714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:36.382720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.635166+0000","last_change":"2024-09-12T02:29:51.608005+0000","last_active":"2024-09-12T02:29:52.635166+0000","last_peered":"2024-09-12T02:29:52.635166+0000","last_clean":"2024-09-12T02:29:52.635166+0000","last_became_active":"2024-09-12T02:29:51.607721+0000","last_became_peered":"2024-09-12T02:29:51.607721+0000","last_unstale":"2024-09-12T02:29:52.635166+0000","last_undegraded":"2024-09-12T02:29:52.635166+0000","last_fullsized":"2024-09-12T02:29:52.635166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.614664+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:52.614664+0000","last_peered":"2024-09-12T02:29:52.614664+0000","last_clean":"2024-09-12T02:29:52.614664+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:52.614664+0000","last_undegraded":"2024-09-12T02:29:52.614664+0000","last_fullsized":"2024-09-12T02:29:52.614664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":197344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":787712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":483328,"data_stored":191077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:59.923 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:30:00.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.032+0000 7fa6b385e640 1 Processor -- start 2024-09-12T02:30:00.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.032+0000 7fa6b385e640 1 -- start start 2024-09-12T02:30:00.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6b385e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 0x7fa6ac0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6b385e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ac0ce060 con 0x7fa6ac0b23c0 2024-09-12T02:30:00.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6b385e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ac0ce340 con 0x7fa6ac15c480 2024-09-12T02:30:00.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6b385e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0cf100 con 0x7fa6ac0cf9d0 2024-09-12T02:30:00.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6b1dfb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa6ac0b23c0 0x7fa6ac072270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:59648/0 (socket says 172.21.15.181:59648) 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6b1dfb640 1 -- 172.21.15.181:0/496997050 learned_addr learned my addr 172.21.15.181:0/496997050 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 0x7fa6ac0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996234491 0 0) 0x7fa6ac0ce060 con 0x7fa6ac0b23c0 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.033+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa698003520 con 0x7fa6ac0b23c0 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1036245896 0 0) 0x7fa698003520 con 0x7fa6ac0b23c0 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 msgr2=0x7fa6ac0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 0x7fa6ac0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 >> v1:172.21.15.204:6789/0 conn(0x7fa6ac15c480 legacy=0x7fa6ac0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac0ce620 con 0x7fa6ac0b23c0 2024-09-12T02:30:00.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fa6a4001670 con 0x7fa6ac0b23c0 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 >> v1:172.21.15.181:6789/0 conn(0x7fa6ac0b23c0 legacy=0x7fa6ac072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 0x7fa6980039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa698004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa698004d40 0x7fa6980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0cf100 con 0x7fa698003f60 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa69800baa0 con 0x7fa698004d40 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa69800bca0 con 0x7fa6ac0cf9d0 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa698004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b1dfb640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa698004d40 0x7fa6980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b15fa640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 0x7fa6980039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b0df9640 1 -- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 msgr2=0x7fa6980039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 0x7fa6980039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b0df9640 1 -- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa698004d40 msgr2=0x7fa6980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa698004d40 0x7fa6980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b0df9640 1 -- 172.21.15.181:0/496997050 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa698003520 con 0x7fa698003f60 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.034+0000 7fa6b15fa640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac0cf9d0 0x7fa6980039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.035+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa698004800 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac071740 tx=0x7fa698005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2758b3bfc39f9f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.035+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c036070 con 0x7fa698003f60 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.035+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69c031400 con 0x7fa698003f60 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.035+0000 7fa6a3fff640 1 -- 172.21.15.181:0/496997050 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c009690 con 0x7fa698003f60 2024-09-12T02:30:00.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.036+0000 7fa6b385e640 1 -- 172.21.15.181:0/496997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 msgr2=0x7fa698004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.036+0000 7fa6b385e640 1 --2- 172.21.15.181:0/496997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa698004800 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac071740 tx=0x7fa698005830 comp rx=0 tx=0).stop 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.036+0000 7fa6b1dfb640 1 -- 172.21.15.181:0/496997050 reap_dead start 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.036+0000 7fa6b385e640 1 -- 172.21.15.181:0/496997050 shutdown_connections 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.036+0000 7fa6b385e640 1 -- 172.21.15.181:0/496997050 >> 172.21.15.181:0/496997050 conn(0x7fa6ac06bc10 msgr2=0x7fa6ac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.036+0000 7fa6b385e640 1 -- 172.21.15.181:0/496997050 shutdown_connections 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.036+0000 7fa6b385e640 1 -- 172.21.15.181:0/496997050 wait complete. 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.037+0000 7fa6b385e640 1 Processor -- start 2024-09-12T02:30:00.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.037+0000 7fa6b385e640 1 -- start start 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b385e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa6ac153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b385e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac15eaf0 0x7fa6ac146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b385e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6ac15ef70 0x7fa6ac146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b385e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0b2850 con 0x7fa698003f60 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b385e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0cebe0 con 0x7fa6ac15ef70 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b385e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0b1e80 con 0x7fa6ac15eaf0 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa6ac153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa6ac153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42246/0 (socket says 172.21.15.181:42246) 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 -- 172.21.15.181:0/584892625 learned_addr learned my addr 172.21.15.181:0/584892625 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:00.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac15eaf0 0x7fa6ac146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b1dfb640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6ac15ef70 0x7fa6ac146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 -- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac15eaf0 msgr2=0x7fa6ac146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac15eaf0 0x7fa6ac146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 -- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6ac15ef70 msgr2=0x7fa6ac146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6ac15ef70 0x7fa6ac146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 -- 172.21.15.181:0/584892625 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac15da50 con 0x7fa698003f60 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6b15fa640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa6ac153ca0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800eaf0 tx=0x7fa6a800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.038+0000 7fa6a1ffb640 1 -- 172.21.15.181:0/584892625 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8003b80 con 0x7fa698003f60 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.039+0000 7fa6a1ffb640 1 -- 172.21.15.181:0/584892625 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a8018070 con 0x7fa698003f60 2024-09-12T02:30:00.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.039+0000 7fa6a1ffb640 1 -- 172.21.15.181:0/584892625 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80050d0 con 0x7fa698003f60 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.039+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac15dd30 con 0x7fa698003f60 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.039+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac15e2f0 con 0x7fa698003f60 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.040+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ac0cf2c0 con 0x7fa698003f60 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.040+0000 7fa6a1ffb640 1 -- 172.21.15.181:0/584892625 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6a8005270 con 0x7fa698003f60 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.041+0000 7fa6a1ffb640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa69006be60 0x7fa69006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.041+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa69006be60 0x7fa69006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.041+0000 7fa6a1ffb640 1 -- 172.21.15.181:0/584892625 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa6a808ae00 con 0x7fa698003f60 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.041+0000 7fa6b0df9640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa69006be60 0x7fa69006e320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa69c033000 tx=0x7fa69c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.045+0000 7fa6a1ffb640 1 -- 172.21.15.181:0/584892625 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6a80597b0 con 0x7fa698003f60 2024-09-12T02:30:00.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.208+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6ac073380 con 0x7fa69006be60 2024-09-12T02:30:00.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.214+0000 7fa6a1ffb640 1 -- 172.21.15.181:0/584892625 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251923 (secure 0 0 0) 0x7fa6ac073380 con 0x7fa69006be60 2024-09-12T02:30:00.217 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:30:00.218 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa69006be60 msgr2=0x7fa69006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa69006be60 0x7fa69006e320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa69c033000 tx=0x7fa69c008030 comp rx=0 tx=0).stop 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 msgr2=0x7fa6ac153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa6ac153ca0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800eaf0 tx=0x7fa6a800eef0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 shutdown_connections 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa69006be60 0x7fa69006e320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa6ac15ef70 0x7fa6ac146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa6ac15eaf0 0x7fa6ac146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 --2- 172.21.15.181:0/584892625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698003f60 0x7fa6ac153ca0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 >> 172.21.15.181:0/584892625 conn(0x7fa6ac06bc10 msgr2=0x7fa6ac0cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 shutdown_connections 2024-09-12T02:30:00.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.217+0000 7fa6b385e640 1 -- 172.21.15.181:0/584892625 wait complete. 2024-09-12T02:30:00.229 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-12T02:29:59.631701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225700,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749020,"statfs":{"total":773094113280,"available":772862996480,"internally_reserved":0,"allocated":5414912,"data_stored":2868908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001406"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613323+0000","last_change":"2024-09-12T02:29:52.619457+0000","last_active":"2024-09-12T02:29:53.613323+0000","last_peered":"2024-09-12T02:29:53.613323+0000","last_clean":"2024-09-12T02:29:53.613323+0000","last_became_active":"2024-09-12T02:29:52.618250+0000","last_became_peered":"2024-09-12T02:29:52.618250+0000","last_unstale":"2024-09-12T02:29:53.613323+0000","last_undegraded":"2024-09-12T02:29:53.613323+0000","last_fullsized":"2024-09-12T02:29:53.613323+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:34.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776029+0000","last_change":"2024-09-12T02:29:52.629942+0000","last_active":"2024-09-12T02:29:54.776029+0000","last_peered":"2024-09-12T02:29:54.776029+0000","last_clean":"2024-09-12T02:29:54.776029+0000","last_became_active":"2024-09-12T02:29:52.629644+0000","last_became_peered":"2024-09-12T02:29:52.629644+0000","last_unstale":"2024-09-12T02:29:54.776029+0000","last_undegraded":"2024-09-12T02:29:54.776029+0000","last_fullsized":"2024-09-12T02:29:54.776029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:12.948177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.610777+0000","last_change":"2024-09-12T02:29:52.615494+0000","last_active":"2024-09-12T02:29:53.610777+0000","last_peered":"2024-09-12T02:29:53.610777+0000","last_clean":"2024-09-12T02:29:53.610777+0000","last_became_active":"2024-09-12T02:29:52.615083+0000","last_became_peered":"2024-09-12T02:29:52.615083+0000","last_unstale":"2024-09-12T02:29:53.610777+0000","last_undegraded":"2024-09-12T02:29:53.610777+0000","last_fullsized":"2024-09-12T02:29:53.610777+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:26.154285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106201+0000","last_change":"2024-09-12T02:29:52.625892+0000","last_active":"2024-09-12T02:29:54.106201+0000","last_peered":"2024-09-12T02:29:54.106201+0000","last_clean":"2024-09-12T02:29:54.106201+0000","last_became_active":"2024-09-12T02:29:52.624192+0000","last_became_peered":"2024-09-12T02:29:52.624192+0000","last_unstale":"2024-09-12T02:29:54.106201+0000","last_undegraded":"2024-09-12T02:29:54.106201+0000","last_fullsized":"2024-09-12T02:29:54.106201+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:12.948177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776030+0000","last_change":"2024-09-12T02:29:52.624531+0000","last_active":"2024-09-12T02:29:54.776030+0000","last_peered":"2024-09-12T02:29:54.776030+0000","last_clean":"2024-09-12T02:29:54.776030+0000","last_became_active":"2024-09-12T02:29:52.624183+0000","last_became_peered":"2024-09-12T02:29:52.624183+0000","last_unstale":"2024-09-12T02:29:54.776030+0000","last_undegraded":"2024-09-12T02:29:54.776030+0000","last_fullsized":"2024-09-12T02:29:54.776030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.950748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.612919+0000","last_change":"2024-09-12T02:29:52.633056+0000","last_active":"2024-09-12T02:29:54.612919+0000","last_peered":"2024-09-12T02:29:54.612919+0000","last_clean":"2024-09-12T02:29:54.612919+0000","last_became_active":"2024-09-12T02:29:52.632740+0000","last_became_peered":"2024-09-12T02:29:52.632740+0000","last_unstale":"2024-09-12T02:29:54.612919+0000","last_undegraded":"2024-09-12T02:29:54.612919+0000","last_fullsized":"2024-09-12T02:29:54.612919+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:47.937934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613070+0000","last_change":"2024-09-12T02:29:52.623493+0000","last_active":"2024-09-12T02:29:53.613070+0000","last_peered":"2024-09-12T02:29:53.613070+0000","last_clean":"2024-09-12T02:29:53.613070+0000","last_became_active":"2024-09-12T02:29:52.623167+0000","last_became_peered":"2024-09-12T02:29:52.623167+0000","last_unstale":"2024-09-12T02:29:53.613070+0000","last_undegraded":"2024-09-12T02:29:53.613070+0000","last_fullsized":"2024-09-12T02:29:53.613070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:07.723543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.105939+0000","last_change":"2024-09-12T02:29:52.626794+0000","last_active":"2024-09-12T02:29:54.105939+0000","last_peered":"2024-09-12T02:29:54.105939+0000","last_clean":"2024-09-12T02:29:54.105939+0000","last_became_active":"2024-09-12T02:29:52.626539+0000","last_became_peered":"2024-09-12T02:29:52.626539+0000","last_unstale":"2024-09-12T02:29:54.105939+0000","last_undegraded":"2024-09-12T02:29:54.105939+0000","last_fullsized":"2024-09-12T02:29:54.105939+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:59.099666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106464+0000","last_change":"2024-09-12T02:29:52.630608+0000","last_active":"2024-09-12T02:29:54.106464+0000","last_peered":"2024-09-12T02:29:54.106464+0000","last_clean":"2024-09-12T02:29:54.106464+0000","last_became_active":"2024-09-12T02:29:52.630375+0000","last_became_peered":"2024-09-12T02:29:52.630375+0000","last_unstale":"2024-09-12T02:29:54.106464+0000","last_undegraded":"2024-09-12T02:29:54.106464+0000","last_fullsized":"2024-09-12T02:29:54.106464+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:03.896437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106449+0000","last_change":"2024-09-12T02:29:52.626665+0000","last_active":"2024-09-12T02:29:54.106449+0000","last_peered":"2024-09-12T02:29:54.106449+0000","last_clean":"2024-09-12T02:29:54.106449+0000","last_became_active":"2024-09-12T02:29:52.623946+0000","last_became_peered":"2024-09-12T02:29:52.623946+0000","last_unstale":"2024-09-12T02:29:54.106449+0000","last_undegraded":"2024-09-12T02:29:54.106449+0000","last_fullsized":"2024-09-12T02:29:54.106449+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:34.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106286+0000","last_change":"2024-09-12T02:29:52.631057+0000","last_active":"2024-09-12T02:29:54.106286+0000","last_peered":"2024-09-12T02:29:54.106286+0000","last_clean":"2024-09-12T02:29:54.106286+0000","last_became_active":"2024-09-12T02:29:52.630774+0000","last_became_peered":"2024-09-12T02:29:52.630774+0000","last_unstale":"2024-09-12T02:29:54.106286+0000","last_undegraded":"2024-09-12T02:29:54.106286+0000","last_fullsized":"2024-09-12T02:29:54.106286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:07.723543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776105+0000","last_change":"2024-09-12T02:29:52.629995+0000","last_active":"2024-09-12T02:29:54.776105+0000","last_peered":"2024-09-12T02:29:54.776105+0000","last_clean":"2024-09-12T02:29:54.776105+0000","last_became_active":"2024-09-12T02:29:52.629259+0000","last_became_peered":"2024-09-12T02:29:52.629259+0000","last_unstale":"2024-09-12T02:29:54.776105+0000","last_undegraded":"2024-09-12T02:29:54.776105+0000","last_fullsized":"2024-09-12T02:29:54.776105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:07.723543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510551+0000","last_change":"2024-09-12T02:29:52.633915+0000","last_active":"2024-09-12T02:29:55.510551+0000","last_peered":"2024-09-12T02:29:55.510551+0000","last_clean":"2024-09-12T02:29:55.510551+0000","last_became_active":"2024-09-12T02:29:52.633571+0000","last_became_peered":"2024-09-12T02:29:52.633571+0000","last_unstale":"2024-09-12T02:29:55.510551+0000","last_undegraded":"2024-09-12T02:29:55.510551+0000","last_fullsized":"2024-09-12T02:29:55.510551+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:07.089067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106044+0000","last_change":"2024-09-12T02:29:52.627901+0000","last_active":"2024-09-12T02:29:54.106044+0000","last_peered":"2024-09-12T02:29:54.106044+0000","last_clean":"2024-09-12T02:29:54.106044+0000","last_became_active":"2024-09-12T02:29:52.627653+0000","last_became_peered":"2024-09-12T02:29:52.627653+0000","last_unstale":"2024-09-12T02:29:54.106044+0000","last_undegraded":"2024-09-12T02:29:54.106044+0000","last_fullsized":"2024-09-12T02:29:54.106044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.612798+0000","last_change":"2024-09-12T02:29:52.629819+0000","last_active":"2024-09-12T02:29:54.612798+0000","last_peered":"2024-09-12T02:29:54.612798+0000","last_clean":"2024-09-12T02:29:54.612798+0000","last_became_active":"2024-09-12T02:29:52.629441+0000","last_became_peered":"2024-09-12T02:29:52.629441+0000","last_unstale":"2024-09-12T02:29:54.612798+0000","last_undegraded":"2024-09-12T02:29:54.612798+0000","last_fullsized":"2024-09-12T02:29:54.612798+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:02.313219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611376+0000","last_change":"2024-09-12T02:29:52.627443+0000","last_active":"2024-09-12T02:29:53.611376+0000","last_peered":"2024-09-12T02:29:53.611376+0000","last_clean":"2024-09-12T02:29:53.611376+0000","last_became_active":"2024-09-12T02:29:52.627180+0000","last_became_peered":"2024-09-12T02:29:52.627180+0000","last_unstale":"2024-09-12T02:29:53.611376+0000","last_undegraded":"2024-09-12T02:29:53.611376+0000","last_fullsized":"2024-09-12T02:29:53.611376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:06.216706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611545+0000","last_change":"2024-09-12T02:29:52.621284+0000","last_active":"2024-09-12T02:29:53.611545+0000","last_peered":"2024-09-12T02:29:53.611545+0000","last_clean":"2024-09-12T02:29:53.611545+0000","last_became_active":"2024-09-12T02:29:52.620998+0000","last_became_peered":"2024-09-12T02:29:52.620998+0000","last_unstale":"2024-09-12T02:29:53.611545+0000","last_undegraded":"2024-09-12T02:29:53.611545+0000","last_fullsized":"2024-09-12T02:29:53.611545+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611137+0000","last_change":"2024-09-12T02:29:52.629899+0000","last_active":"2024-09-12T02:29:53.611137+0000","last_peered":"2024-09-12T02:29:53.611137+0000","last_clean":"2024-09-12T02:29:53.611137+0000","last_became_active":"2024-09-12T02:29:52.628179+0000","last_became_peered":"2024-09-12T02:29:52.628179+0000","last_unstale":"2024-09-12T02:29:53.611137+0000","last_undegraded":"2024-09-12T02:29:53.611137+0000","last_fullsized":"2024-09-12T02:29:53.611137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:00.216010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611346+0000","last_change":"2024-09-12T02:29:52.626757+0000","last_active":"2024-09-12T02:29:53.611346+0000","last_peered":"2024-09-12T02:29:53.611346+0000","last_clean":"2024-09-12T02:29:53.611346+0000","last_became_active":"2024-09-12T02:29:52.626506+0000","last_became_peered":"2024-09-12T02:29:52.626506+0000","last_unstale":"2024-09-12T02:29:53.611346+0000","last_undegraded":"2024-09-12T02:29:53.611346+0000","last_fullsized":"2024-09-12T02:29:53.611346+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510729+0000","last_change":"2024-09-12T02:29:52.622848+0000","last_active":"2024-09-12T02:29:55.510729+0000","last_peered":"2024-09-12T02:29:55.510729+0000","last_clean":"2024-09-12T02:29:55.510729+0000","last_became_active":"2024-09-12T02:29:52.622544+0000","last_became_peered":"2024-09-12T02:29:52.622544+0000","last_unstale":"2024-09-12T02:29:55.510729+0000","last_undegraded":"2024-09-12T02:29:55.510729+0000","last_fullsized":"2024-09-12T02:29:55.510729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:53.053524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.612997+0000","last_change":"2024-09-12T02:29:52.634859+0000","last_active":"2024-09-12T02:29:54.612997+0000","last_peered":"2024-09-12T02:29:54.612997+0000","last_clean":"2024-09-12T02:29:54.612997+0000","last_became_active":"2024-09-12T02:29:52.634403+0000","last_became_peered":"2024-09-12T02:29:52.634403+0000","last_unstale":"2024-09-12T02:29:54.612997+0000","last_undegraded":"2024-09-12T02:29:54.612997+0000","last_fullsized":"2024-09-12T02:29:54.612997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:58.983323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106125+0000","last_change":"2024-09-12T02:29:52.626049+0000","last_active":"2024-09-12T02:29:54.106125+0000","last_peered":"2024-09-12T02:29:54.106125+0000","last_clean":"2024-09-12T02:29:54.106125+0000","last_became_active":"2024-09-12T02:29:52.623834+0000","last_became_peered":"2024-09-12T02:29:52.623834+0000","last_unstale":"2024-09-12T02:29:54.106125+0000","last_undegraded":"2024-09-12T02:29:54.106125+0000","last_fullsized":"2024-09-12T02:29:54.106125+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:16.391061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611806+0000","last_change":"2024-09-12T02:29:52.619585+0000","last_active":"2024-09-12T02:29:53.611806+0000","last_peered":"2024-09-12T02:29:53.611806+0000","last_clean":"2024-09-12T02:29:53.611806+0000","last_became_active":"2024-09-12T02:29:52.619083+0000","last_became_peered":"2024-09-12T02:29:52.619083+0000","last_unstale":"2024-09-12T02:29:53.611806+0000","last_undegraded":"2024-09-12T02:29:53.611806+0000","last_fullsized":"2024-09-12T02:29:53.611806+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611265+0000","last_change":"2024-09-12T02:29:52.619566+0000","last_active":"2024-09-12T02:29:53.611265+0000","last_peered":"2024-09-12T02:29:53.611265+0000","last_clean":"2024-09-12T02:29:53.611265+0000","last_became_active":"2024-09-12T02:29:52.619287+0000","last_became_peered":"2024-09-12T02:29:52.619287+0000","last_unstale":"2024-09-12T02:29:53.611265+0000","last_undegraded":"2024-09-12T02:29:53.611265+0000","last_fullsized":"2024-09-12T02:29:53.611265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.521825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611872+0000","last_change":"2024-09-12T02:29:52.624234+0000","last_active":"2024-09-12T02:29:53.611872+0000","last_peered":"2024-09-12T02:29:53.611872+0000","last_clean":"2024-09-12T02:29:53.611872+0000","last_became_active":"2024-09-12T02:29:52.623944+0000","last_became_peered":"2024-09-12T02:29:52.623944+0000","last_unstale":"2024-09-12T02:29:53.611872+0000","last_undegraded":"2024-09-12T02:29:53.611872+0000","last_fullsized":"2024-09-12T02:29:53.611872+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:27.285618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510613+0000","last_change":"2024-09-12T02:29:52.622197+0000","last_active":"2024-09-12T02:29:55.510613+0000","last_peered":"2024-09-12T02:29:55.510613+0000","last_clean":"2024-09-12T02:29:55.510613+0000","last_became_active":"2024-09-12T02:29:52.621761+0000","last_became_peered":"2024-09-12T02:29:52.621761+0000","last_unstale":"2024-09-12T02:29:55.510613+0000","last_undegraded":"2024-09-12T02:29:55.510613+0000","last_fullsized":"2024-09-12T02:29:55.510613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:02.338417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611127+0000","last_change":"2024-09-12T02:29:52.621835+0000","last_active":"2024-09-12T02:29:53.611127+0000","last_peered":"2024-09-12T02:29:53.611127+0000","last_clean":"2024-09-12T02:29:53.611127+0000","last_became_active":"2024-09-12T02:29:52.621425+0000","last_became_peered":"2024-09-12T02:29:52.621425+0000","last_unstale":"2024-09-12T02:29:53.611127+0000","last_undegraded":"2024-09-12T02:29:53.611127+0000","last_fullsized":"2024-09-12T02:29:53.611127+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:17.976139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776270+0000","last_change":"2024-09-12T02:29:52.629253+0000","last_active":"2024-09-12T02:29:54.776270+0000","last_peered":"2024-09-12T02:29:54.776270+0000","last_clean":"2024-09-12T02:29:54.776270+0000","last_became_active":"2024-09-12T02:29:52.628886+0000","last_became_peered":"2024-09-12T02:29:52.628886+0000","last_unstale":"2024-09-12T02:29:54.776270+0000","last_undegraded":"2024-09-12T02:29:54.776270+0000","last_fullsized":"2024-09-12T02:29:54.776270+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:10.089014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611506+0000","last_change":"2024-09-12T02:29:52.630703+0000","last_active":"2024-09-12T02:29:53.611506+0000","last_peered":"2024-09-12T02:29:53.611506+0000","last_clean":"2024-09-12T02:29:53.611506+0000","last_became_active":"2024-09-12T02:29:52.630404+0000","last_became_peered":"2024-09-12T02:29:52.630404+0000","last_unstale":"2024-09-12T02:29:53.611506+0000","last_undegraded":"2024-09-12T02:29:53.611506+0000","last_fullsized":"2024-09-12T02:29:53.611506+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:22.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.610510+0000","last_change":"2024-09-12T02:29:52.619356+0000","last_active":"2024-09-12T02:29:53.610510+0000","last_peered":"2024-09-12T02:29:53.610510+0000","last_clean":"2024-09-12T02:29:53.610510+0000","last_became_active":"2024-09-12T02:29:52.618699+0000","last_became_peered":"2024-09-12T02:29:52.618699+0000","last_unstale":"2024-09-12T02:29:53.610510+0000","last_undegraded":"2024-09-12T02:29:53.610510+0000","last_fullsized":"2024-09-12T02:29:53.610510+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:27.285618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.612884+0000","last_change":"2024-09-12T02:29:52.629075+0000","last_active":"2024-09-12T02:29:54.612884+0000","last_peered":"2024-09-12T02:29:54.612884+0000","last_clean":"2024-09-12T02:29:54.612884+0000","last_became_active":"2024-09-12T02:29:52.628245+0000","last_became_peered":"2024-09-12T02:29:52.628245+0000","last_unstale":"2024-09-12T02:29:54.612884+0000","last_undegraded":"2024-09-12T02:29:54.612884+0000","last_fullsized":"2024-09-12T02:29:54.612884+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:35.627640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510533+0000","last_change":"2024-09-12T02:29:52.623161+0000","last_active":"2024-09-12T02:29:55.510533+0000","last_peered":"2024-09-12T02:29:55.510533+0000","last_clean":"2024-09-12T02:29:55.510533+0000","last_became_active":"2024-09-12T02:29:52.622896+0000","last_became_peered":"2024-09-12T02:29:52.622896+0000","last_unstale":"2024-09-12T02:29:55.510533+0000","last_undegraded":"2024-09-12T02:29:55.510533+0000","last_fullsized":"2024-09-12T02:29:55.510533+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:20.070744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.630620+0000","last_change":"2024-09-12T02:29:52.622329+0000","last_active":"2024-09-12T02:29:54.630620+0000","last_peered":"2024-09-12T02:29:54.630620+0000","last_clean":"2024-09-12T02:29:54.630620+0000","last_became_active":"2024-09-12T02:29:52.622085+0000","last_became_peered":"2024-09-12T02:29:52.622085+0000","last_unstale":"2024-09-12T02:29:54.630620+0000","last_undegraded":"2024-09-12T02:29:54.630620+0000","last_fullsized":"2024-09-12T02:29:54.630620+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613330+0000","last_change":"2024-09-12T02:29:51.614012+0000","last_active":"2024-09-12T02:29:54.613330+0000","last_peered":"2024-09-12T02:29:54.613330+0000","last_clean":"2024-09-12T02:29:54.613330+0000","last_became_active":"2024-09-12T02:29:51.613643+0000","last_became_peered":"2024-09-12T02:29:51.613643+0000","last_unstale":"2024-09-12T02:29:54.613330+0000","last_undegraded":"2024-09-12T02:29:54.613330+0000","last_fullsized":"2024-09-12T02:29:54.613330+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.713615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611800+0000","last_change":"2024-09-12T02:29:52.619287+0000","last_active":"2024-09-12T02:29:53.611800+0000","last_peered":"2024-09-12T02:29:53.611800+0000","last_clean":"2024-09-12T02:29:53.611800+0000","last_became_active":"2024-09-12T02:29:52.618727+0000","last_became_peered":"2024-09-12T02:29:52.618727+0000","last_unstale":"2024-09-12T02:29:53.611800+0000","last_undegraded":"2024-09-12T02:29:53.611800+0000","last_fullsized":"2024-09-12T02:29:53.611800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611473+0000","last_change":"2024-09-12T02:29:51.616177+0000","last_active":"2024-09-12T02:29:53.611473+0000","last_peered":"2024-09-12T02:29:53.611473+0000","last_clean":"2024-09-12T02:29:53.611473+0000","last_became_active":"2024-09-12T02:29:51.615785+0000","last_became_peered":"2024-09-12T02:29:51.615785+0000","last_unstale":"2024-09-12T02:29:53.611473+0000","last_undegraded":"2024-09-12T02:29:53.611473+0000","last_fullsized":"2024-09-12T02:29:53.611473+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:59.369993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776283+0000","last_change":"2024-09-12T02:29:52.635785+0000","last_active":"2024-09-12T02:29:54.776283+0000","last_peered":"2024-09-12T02:29:54.776283+0000","last_clean":"2024-09-12T02:29:54.776283+0000","last_became_active":"2024-09-12T02:29:52.635600+0000","last_became_peered":"2024-09-12T02:29:52.635600+0000","last_unstale":"2024-09-12T02:29:54.776283+0000","last_undegraded":"2024-09-12T02:29:54.776283+0000","last_fullsized":"2024-09-12T02:29:54.776283+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:34.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.630777+0000","last_change":"2024-09-12T02:29:51.609063+0000","last_active":"2024-09-12T02:29:54.630777+0000","last_peered":"2024-09-12T02:29:54.630777+0000","last_clean":"2024-09-12T02:29:54.630777+0000","last_became_active":"2024-09-12T02:29:51.608783+0000","last_became_peered":"2024-09-12T02:29:51.608783+0000","last_unstale":"2024-09-12T02:29:54.630777+0000","last_undegraded":"2024-09-12T02:29:54.630777+0000","last_fullsized":"2024-09-12T02:29:54.630777+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:33.174988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.630773+0000","last_change":"2024-09-12T02:29:52.623116+0000","last_active":"2024-09-12T02:29:54.630773+0000","last_peered":"2024-09-12T02:29:54.630773+0000","last_clean":"2024-09-12T02:29:54.630773+0000","last_became_active":"2024-09-12T02:29:52.622677+0000","last_became_peered":"2024-09-12T02:29:52.622677+0000","last_unstale":"2024-09-12T02:29:54.630773+0000","last_undegraded":"2024-09-12T02:29:54.630773+0000","last_fullsized":"2024-09-12T02:29:54.630773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.986743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613094+0000","last_change":"2024-09-12T02:29:51.612680+0000","last_active":"2024-09-12T02:29:53.613094+0000","last_peered":"2024-09-12T02:29:53.613094+0000","last_clean":"2024-09-12T02:29:53.613094+0000","last_became_active":"2024-09-12T02:29:51.612387+0000","last_became_peered":"2024-09-12T02:29:51.612387+0000","last_unstale":"2024-09-12T02:29:53.613094+0000","last_undegraded":"2024-09-12T02:29:53.613094+0000","last_fullsized":"2024-09-12T02:29:53.613094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.610788+0000","last_change":"2024-09-12T02:29:52.620087+0000","last_active":"2024-09-12T02:29:53.610788+0000","last_peered":"2024-09-12T02:29:53.610788+0000","last_clean":"2024-09-12T02:29:53.610788+0000","last_became_active":"2024-09-12T02:29:52.619795+0000","last_became_peered":"2024-09-12T02:29:52.619795+0000","last_unstale":"2024-09-12T02:29:53.610788+0000","last_undegraded":"2024-09-12T02:29:53.610788+0000","last_fullsized":"2024-09-12T02:29:53.610788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.591953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613150+0000","last_change":"2024-09-12T02:29:51.609628+0000","last_active":"2024-09-12T02:29:54.613150+0000","last_peered":"2024-09-12T02:29:54.613150+0000","last_clean":"2024-09-12T02:29:54.613150+0000","last_became_active":"2024-09-12T02:29:51.609346+0000","last_became_peered":"2024-09-12T02:29:51.609346+0000","last_unstale":"2024-09-12T02:29:54.613150+0000","last_undegraded":"2024-09-12T02:29:54.613150+0000","last_fullsized":"2024-09-12T02:29:54.613150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:20.122760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106242+0000","last_change":"2024-09-12T02:29:52.635166+0000","last_active":"2024-09-12T02:29:54.106242+0000","last_peered":"2024-09-12T02:29:54.106242+0000","last_clean":"2024-09-12T02:29:54.106242+0000","last_became_active":"2024-09-12T02:29:52.634883+0000","last_became_peered":"2024-09-12T02:29:52.634883+0000","last_unstale":"2024-09-12T02:29:54.106242+0000","last_undegraded":"2024-09-12T02:29:54.106242+0000","last_fullsized":"2024-09-12T02:29:54.106242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:09.868865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.610891+0000","last_change":"2024-09-12T02:29:51.618885+0000","last_active":"2024-09-12T02:29:53.610891+0000","last_peered":"2024-09-12T02:29:53.610891+0000","last_clean":"2024-09-12T02:29:53.610891+0000","last_became_active":"2024-09-12T02:29:51.618593+0000","last_became_peered":"2024-09-12T02:29:51.618593+0000","last_unstale":"2024-09-12T02:29:53.610891+0000","last_undegraded":"2024-09-12T02:29:53.610891+0000","last_fullsized":"2024-09-12T02:29:53.610891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106015+0000","last_change":"2024-09-12T02:29:52.626277+0000","last_active":"2024-09-12T02:29:54.106015+0000","last_peered":"2024-09-12T02:29:54.106015+0000","last_clean":"2024-09-12T02:29:54.106015+0000","last_became_active":"2024-09-12T02:29:52.624251+0000","last_became_peered":"2024-09-12T02:29:52.624251+0000","last_unstale":"2024-09-12T02:29:54.106015+0000","last_undegraded":"2024-09-12T02:29:54.106015+0000","last_fullsized":"2024-09-12T02:29:54.106015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.775799+0000","last_change":"2024-09-12T02:29:51.607855+0000","last_active":"2024-09-12T02:29:54.775799+0000","last_peered":"2024-09-12T02:29:54.775799+0000","last_clean":"2024-09-12T02:29:54.775799+0000","last_became_active":"2024-09-12T02:29:51.607577+0000","last_became_peered":"2024-09-12T02:29:51.607577+0000","last_unstale":"2024-09-12T02:29:54.775799+0000","last_undegraded":"2024-09-12T02:29:54.775799+0000","last_fullsized":"2024-09-12T02:29:54.775799+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.981772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.610781+0000","last_change":"2024-09-12T02:29:52.619061+0000","last_active":"2024-09-12T02:29:53.610781+0000","last_peered":"2024-09-12T02:29:53.610781+0000","last_clean":"2024-09-12T02:29:53.610781+0000","last_became_active":"2024-09-12T02:29:52.618591+0000","last_became_peered":"2024-09-12T02:29:52.618591+0000","last_unstale":"2024-09-12T02:29:53.610781+0000","last_undegraded":"2024-09-12T02:29:53.610781+0000","last_fullsized":"2024-09-12T02:29:53.610781+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:01.527513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106109+0000","last_change":"2024-09-12T02:29:51.605916+0000","last_active":"2024-09-12T02:29:54.106109+0000","last_peered":"2024-09-12T02:29:54.106109+0000","last_clean":"2024-09-12T02:29:54.106109+0000","last_became_active":"2024-09-12T02:29:51.605679+0000","last_became_peered":"2024-09-12T02:29:51.605679+0000","last_unstale":"2024-09-12T02:29:54.106109+0000","last_undegraded":"2024-09-12T02:29:54.106109+0000","last_fullsized":"2024-09-12T02:29:54.106109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.070779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611296+0000","last_change":"2024-09-12T02:29:52.625671+0000","last_active":"2024-09-12T02:29:53.611296+0000","last_peered":"2024-09-12T02:29:53.611296+0000","last_clean":"2024-09-12T02:29:53.611296+0000","last_became_active":"2024-09-12T02:29:52.625420+0000","last_became_peered":"2024-09-12T02:29:52.625420+0000","last_unstale":"2024-09-12T02:29:53.611296+0000","last_undegraded":"2024-09-12T02:29:53.611296+0000","last_fullsized":"2024-09-12T02:29:53.611296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:18.863975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611915+0000","last_change":"2024-09-12T02:29:51.613737+0000","last_active":"2024-09-12T02:29:53.611915+0000","last_peered":"2024-09-12T02:29:53.611915+0000","last_clean":"2024-09-12T02:29:53.611915+0000","last_became_active":"2024-09-12T02:29:51.613468+0000","last_became_peered":"2024-09-12T02:29:51.613468+0000","last_unstale":"2024-09-12T02:29:53.611915+0000","last_undegraded":"2024-09-12T02:29:53.611915+0000","last_fullsized":"2024-09-12T02:29:53.611915+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613378+0000","last_change":"2024-09-12T02:29:52.621214+0000","last_active":"2024-09-12T02:29:53.613378+0000","last_peered":"2024-09-12T02:29:53.613378+0000","last_clean":"2024-09-12T02:29:53.613378+0000","last_became_active":"2024-09-12T02:29:52.620907+0000","last_became_peered":"2024-09-12T02:29:52.620907+0000","last_unstale":"2024-09-12T02:29:53.613378+0000","last_undegraded":"2024-09-12T02:29:53.613378+0000","last_fullsized":"2024-09-12T02:29:53.613378+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:28.574936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106498+0000","last_change":"2024-09-12T02:29:51.609872+0000","last_active":"2024-09-12T02:29:54.106498+0000","last_peered":"2024-09-12T02:29:54.106498+0000","last_clean":"2024-09-12T02:29:54.106498+0000","last_became_active":"2024-09-12T02:29:51.609605+0000","last_became_peered":"2024-09-12T02:29:51.609605+0000","last_unstale":"2024-09-12T02:29:54.106498+0000","last_undegraded":"2024-09-12T02:29:54.106498+0000","last_fullsized":"2024-09-12T02:29:54.106498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:46.757750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613280+0000","last_change":"2024-09-12T02:29:52.632698+0000","last_active":"2024-09-12T02:29:54.613280+0000","last_peered":"2024-09-12T02:29:54.613280+0000","last_clean":"2024-09-12T02:29:54.613280+0000","last_became_active":"2024-09-12T02:29:52.632435+0000","last_became_peered":"2024-09-12T02:29:52.632435+0000","last_unstale":"2024-09-12T02:29:54.613280+0000","last_undegraded":"2024-09-12T02:29:54.613280+0000","last_fullsized":"2024-09-12T02:29:54.613280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.050912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613367+0000","last_change":"2024-09-12T02:29:51.614666+0000","last_active":"2024-09-12T02:29:53.613367+0000","last_peered":"2024-09-12T02:29:53.613367+0000","last_clean":"2024-09-12T02:29:53.613367+0000","last_became_active":"2024-09-12T02:29:51.614405+0000","last_became_peered":"2024-09-12T02:29:51.614405+0000","last_unstale":"2024-09-12T02:29:53.613367+0000","last_undegraded":"2024-09-12T02:29:53.613367+0000","last_fullsized":"2024-09-12T02:29:53.613367+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613351+0000","last_change":"2024-09-12T02:29:52.623412+0000","last_active":"2024-09-12T02:29:53.613351+0000","last_peered":"2024-09-12T02:29:53.613351+0000","last_clean":"2024-09-12T02:29:53.613351+0000","last_became_active":"2024-09-12T02:29:52.623148+0000","last_became_peered":"2024-09-12T02:29:52.623148+0000","last_unstale":"2024-09-12T02:29:53.613351+0000","last_undegraded":"2024-09-12T02:29:53.613351+0000","last_fullsized":"2024-09-12T02:29:53.613351+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:03.896437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510724+0000","last_change":"2024-09-12T02:29:51.613589+0000","last_active":"2024-09-12T02:29:55.510724+0000","last_peered":"2024-09-12T02:29:55.510724+0000","last_clean":"2024-09-12T02:29:55.510724+0000","last_became_active":"2024-09-12T02:29:51.613319+0000","last_became_peered":"2024-09-12T02:29:51.613319+0000","last_unstale":"2024-09-12T02:29:55.510724+0000","last_undegraded":"2024-09-12T02:29:55.510724+0000","last_fullsized":"2024-09-12T02:29:55.510724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:02.033237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611033+0000","last_change":"2024-09-12T02:29:52.625357+0000","last_active":"2024-09-12T02:29:53.611033+0000","last_peered":"2024-09-12T02:29:53.611033+0000","last_clean":"2024-09-12T02:29:53.611033+0000","last_became_active":"2024-09-12T02:29:52.625103+0000","last_became_peered":"2024-09-12T02:29:52.625103+0000","last_unstale":"2024-09-12T02:29:53.611033+0000","last_undegraded":"2024-09-12T02:29:53.611033+0000","last_fullsized":"2024-09-12T02:29:53.611033+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:36.382720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613183+0000","last_change":"2024-09-12T02:29:51.613802+0000","last_active":"2024-09-12T02:29:54.613183+0000","last_peered":"2024-09-12T02:29:54.613183+0000","last_clean":"2024-09-12T02:29:54.613183+0000","last_became_active":"2024-09-12T02:29:51.613156+0000","last_became_peered":"2024-09-12T02:29:51.613156+0000","last_unstale":"2024-09-12T02:29:54.613183+0000","last_undegraded":"2024-09-12T02:29:54.613183+0000","last_fullsized":"2024-09-12T02:29:54.613183+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.755689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106205+0000","last_change":"2024-09-12T02:29:52.622189+0000","last_active":"2024-09-12T02:29:54.106205+0000","last_peered":"2024-09-12T02:29:54.106205+0000","last_clean":"2024-09-12T02:29:54.106205+0000","last_became_active":"2024-09-12T02:29:52.620723+0000","last_became_peered":"2024-09-12T02:29:52.620723+0000","last_unstale":"2024-09-12T02:29:54.106205+0000","last_undegraded":"2024-09-12T02:29:54.106205+0000","last_fullsized":"2024-09-12T02:29:54.106205+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:53.950748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613002+0000","last_change":"2024-09-12T02:29:51.611049+0000","last_active":"2024-09-12T02:29:53.613002+0000","last_peered":"2024-09-12T02:29:53.613002+0000","last_clean":"2024-09-12T02:29:53.613002+0000","last_became_active":"2024-09-12T02:29:51.610685+0000","last_became_peered":"2024-09-12T02:29:51.610685+0000","last_unstale":"2024-09-12T02:29:53.613002+0000","last_undegraded":"2024-09-12T02:29:53.613002+0000","last_fullsized":"2024-09-12T02:29:53.613002+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.612804+0000","last_change":"2024-09-12T02:29:52.629902+0000","last_active":"2024-09-12T02:29:54.612804+0000","last_peered":"2024-09-12T02:29:54.612804+0000","last_clean":"2024-09-12T02:29:54.612804+0000","last_became_active":"2024-09-12T02:29:52.628221+0000","last_became_peered":"2024-09-12T02:29:52.628221+0000","last_unstale":"2024-09-12T02:29:54.612804+0000","last_undegraded":"2024-09-12T02:29:54.612804+0000","last_fullsized":"2024-09-12T02:29:54.612804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:40.626879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.612922+0000","last_change":"2024-09-12T02:29:51.607416+0000","last_active":"2024-09-12T02:29:54.612922+0000","last_peered":"2024-09-12T02:29:54.612922+0000","last_clean":"2024-09-12T02:29:54.612922+0000","last_became_active":"2024-09-12T02:29:51.607099+0000","last_became_peered":"2024-09-12T02:29:51.607099+0000","last_unstale":"2024-09-12T02:29:54.612922+0000","last_undegraded":"2024-09-12T02:29:54.612922+0000","last_fullsized":"2024-09-12T02:29:54.612922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:14.274772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613084+0000","last_change":"2024-09-12T02:29:52.622184+0000","last_active":"2024-09-12T02:29:53.613084+0000","last_peered":"2024-09-12T02:29:53.613084+0000","last_clean":"2024-09-12T02:29:53.613084+0000","last_became_active":"2024-09-12T02:29:52.621910+0000","last_became_peered":"2024-09-12T02:29:52.621910+0000","last_unstale":"2024-09-12T02:29:53.613084+0000","last_undegraded":"2024-09-12T02:29:53.613084+0000","last_fullsized":"2024-09-12T02:29:53.613084+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:09.868865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106165+0000","last_change":"2024-09-12T02:29:51.609082+0000","last_active":"2024-09-12T02:29:54.106165+0000","last_peered":"2024-09-12T02:29:54.106165+0000","last_clean":"2024-09-12T02:29:54.106165+0000","last_became_active":"2024-09-12T02:29:51.608827+0000","last_became_peered":"2024-09-12T02:29:51.608827+0000","last_unstale":"2024-09-12T02:29:54.106165+0000","last_undegraded":"2024-09-12T02:29:54.106165+0000","last_fullsized":"2024-09-12T02:29:54.106165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510696+0000","last_change":"2024-09-12T02:29:52.622346+0000","last_active":"2024-09-12T02:29:55.510696+0000","last_peered":"2024-09-12T02:29:55.510696+0000","last_clean":"2024-09-12T02:29:55.510696+0000","last_became_active":"2024-09-12T02:29:52.621980+0000","last_became_peered":"2024-09-12T02:29:52.621980+0000","last_unstale":"2024-09-12T02:29:55.510696+0000","last_undegraded":"2024-09-12T02:29:55.510696+0000","last_fullsized":"2024-09-12T02:29:55.510696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:41.238998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510630+0000","last_change":"2024-09-12T02:29:51.607882+0000","last_active":"2024-09-12T02:29:55.510630+0000","last_peered":"2024-09-12T02:29:55.510630+0000","last_clean":"2024-09-12T02:29:55.510630+0000","last_became_active":"2024-09-12T02:29:51.607629+0000","last_became_peered":"2024-09-12T02:29:51.607629+0000","last_unstale":"2024-09-12T02:29:55.510630+0000","last_undegraded":"2024-09-12T02:29:55.510630+0000","last_fullsized":"2024-09-12T02:29:55.510630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:08.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106470+0000","last_change":"2024-09-12T02:29:52.636838+0000","last_active":"2024-09-12T02:29:54.106470+0000","last_peered":"2024-09-12T02:29:54.106470+0000","last_clean":"2024-09-12T02:29:54.106470+0000","last_became_active":"2024-09-12T02:29:52.636501+0000","last_became_peered":"2024-09-12T02:29:52.636501+0000","last_unstale":"2024-09-12T02:29:54.106470+0000","last_undegraded":"2024-09-12T02:29:54.106470+0000","last_fullsized":"2024-09-12T02:29:54.106470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:28.574936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611594+0000","last_change":"2024-09-12T02:29:51.614040+0000","last_active":"2024-09-12T02:29:53.611594+0000","last_peered":"2024-09-12T02:29:53.611594+0000","last_clean":"2024-09-12T02:29:53.611594+0000","last_became_active":"2024-09-12T02:29:51.613358+0000","last_became_peered":"2024-09-12T02:29:51.613358+0000","last_unstale":"2024-09-12T02:29:53.611594+0000","last_undegraded":"2024-09-12T02:29:53.611594+0000","last_fullsized":"2024-09-12T02:29:53.611594+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611748+0000","last_change":"2024-09-12T02:29:52.636869+0000","last_active":"2024-09-12T02:29:53.611748+0000","last_peered":"2024-09-12T02:29:53.611748+0000","last_clean":"2024-09-12T02:29:53.611748+0000","last_became_active":"2024-09-12T02:29:52.636670+0000","last_became_peered":"2024-09-12T02:29:52.636670+0000","last_unstale":"2024-09-12T02:29:53.611748+0000","last_undegraded":"2024-09-12T02:29:53.611748+0000","last_fullsized":"2024-09-12T02:29:53.611748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:14.345643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776160+0000","last_change":"2024-09-12T02:29:51.607951+0000","last_active":"2024-09-12T02:29:54.776160+0000","last_peered":"2024-09-12T02:29:54.776160+0000","last_clean":"2024-09-12T02:29:54.776160+0000","last_became_active":"2024-09-12T02:29:51.607630+0000","last_became_peered":"2024-09-12T02:29:51.607630+0000","last_unstale":"2024-09-12T02:29:54.776160+0000","last_undegraded":"2024-09-12T02:29:54.776160+0000","last_fullsized":"2024-09-12T02:29:54.776160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:40.897778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611122+0000","last_change":"2024-09-12T02:29:52.622191+0000","last_active":"2024-09-12T02:29:53.611122+0000","last_peered":"2024-09-12T02:29:53.611122+0000","last_clean":"2024-09-12T02:29:53.611122+0000","last_became_active":"2024-09-12T02:29:52.621584+0000","last_became_peered":"2024-09-12T02:29:52.621584+0000","last_unstale":"2024-09-12T02:29:53.611122+0000","last_undegraded":"2024-09-12T02:29:53.611122+0000","last_fullsized":"2024-09-12T02:29:53.611122+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:34.179959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613283+0000","last_change":"2024-09-12T02:29:51.614595+0000","last_active":"2024-09-12T02:29:54.613283+0000","last_peered":"2024-09-12T02:29:54.613283+0000","last_clean":"2024-09-12T02:29:54.613283+0000","last_became_active":"2024-09-12T02:29:51.614265+0000","last_became_peered":"2024-09-12T02:29:51.614265+0000","last_unstale":"2024-09-12T02:29:54.613283+0000","last_undegraded":"2024-09-12T02:29:54.613283+0000","last_fullsized":"2024-09-12T02:29:54.613283+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:45.057499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.612987+0000","last_change":"2024-09-12T02:29:52.631886+0000","last_active":"2024-09-12T02:29:54.612987+0000","last_peered":"2024-09-12T02:29:54.612987+0000","last_clean":"2024-09-12T02:29:54.612987+0000","last_became_active":"2024-09-12T02:29:52.630245+0000","last_became_peered":"2024-09-12T02:29:52.630245+0000","last_unstale":"2024-09-12T02:29:54.612987+0000","last_undegraded":"2024-09-12T02:29:54.612987+0000","last_fullsized":"2024-09-12T02:29:54.612987+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:24.067755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613374+0000","last_change":"2024-09-12T02:29:51.606261+0000","last_active":"2024-09-12T02:29:54.613374+0000","last_peered":"2024-09-12T02:29:54.613374+0000","last_clean":"2024-09-12T02:29:54.613374+0000","last_became_active":"2024-09-12T02:29:51.605989+0000","last_became_peered":"2024-09-12T02:29:51.605989+0000","last_unstale":"2024-09-12T02:29:54.613374+0000","last_undegraded":"2024-09-12T02:29:54.613374+0000","last_fullsized":"2024-09-12T02:29:54.613374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:35.621999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.630642+0000","last_change":"2024-09-12T02:29:52.624877+0000","last_active":"2024-09-12T02:29:54.630642+0000","last_peered":"2024-09-12T02:29:54.630642+0000","last_clean":"2024-09-12T02:29:54.630642+0000","last_became_active":"2024-09-12T02:29:52.624540+0000","last_became_peered":"2024-09-12T02:29:52.624540+0000","last_unstale":"2024-09-12T02:29:54.630642+0000","last_undegraded":"2024-09-12T02:29:54.630642+0000","last_fullsized":"2024-09-12T02:29:54.630642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.291267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.775883+0000","last_change":"2024-09-12T02:29:51.603198+0000","last_active":"2024-09-12T02:29:54.775883+0000","last_peered":"2024-09-12T02:29:54.775883+0000","last_clean":"2024-09-12T02:29:54.775883+0000","last_became_active":"2024-09-12T02:29:51.602891+0000","last_became_peered":"2024-09-12T02:29:51.602891+0000","last_unstale":"2024-09-12T02:29:54.775883+0000","last_undegraded":"2024-09-12T02:29:54.775883+0000","last_fullsized":"2024-09-12T02:29:54.775883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:26.280647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.510483+0000","last_change":"2024-09-12T02:29:52.620983+0000","last_active":"2024-09-12T02:29:55.510483+0000","last_peered":"2024-09-12T02:29:55.510483+0000","last_clean":"2024-09-12T02:29:55.510483+0000","last_became_active":"2024-09-12T02:29:52.619953+0000","last_became_peered":"2024-09-12T02:29:52.619953+0000","last_unstale":"2024-09-12T02:29:55.510483+0000","last_undegraded":"2024-09-12T02:29:55.510483+0000","last_fullsized":"2024-09-12T02:29:55.510483+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:05.728474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.105963+0000","last_change":"2024-09-12T02:29:51.609912+0000","last_active":"2024-09-12T02:29:54.105963+0000","last_peered":"2024-09-12T02:29:54.105963+0000","last_clean":"2024-09-12T02:29:54.105963+0000","last_became_active":"2024-09-12T02:29:51.609646+0000","last_became_peered":"2024-09-12T02:29:51.609646+0000","last_unstale":"2024-09-12T02:29:54.105963+0000","last_undegraded":"2024-09-12T02:29:54.105963+0000","last_fullsized":"2024-09-12T02:29:54.105963+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.455790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.105971+0000","last_change":"2024-09-12T02:29:52.631060+0000","last_active":"2024-09-12T02:29:54.105971+0000","last_peered":"2024-09-12T02:29:54.105971+0000","last_clean":"2024-09-12T02:29:54.105971+0000","last_became_active":"2024-09-12T02:29:52.630218+0000","last_became_peered":"2024-09-12T02:29:52.630218+0000","last_unstale":"2024-09-12T02:29:54.105971+0000","last_undegraded":"2024-09-12T02:29:54.105971+0000","last_fullsized":"2024-09-12T02:29:54.105971+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:00.216010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.612911+0000","last_change":"2024-09-12T02:29:51.613668+0000","last_active":"2024-09-12T02:29:53.612911+0000","last_peered":"2024-09-12T02:29:53.612911+0000","last_clean":"2024-09-12T02:29:53.612911+0000","last_became_active":"2024-09-12T02:29:51.612615+0000","last_became_peered":"2024-09-12T02:29:51.612615+0000","last_unstale":"2024-09-12T02:29:53.612911+0000","last_undegraded":"2024-09-12T02:29:53.612911+0000","last_fullsized":"2024-09-12T02:29:53.612911+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:59.211039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.611958+0000","last_change":"2024-09-12T02:29:52.626071+0000","last_active":"2024-09-12T02:29:53.611958+0000","last_peered":"2024-09-12T02:29:53.611958+0000","last_clean":"2024-09-12T02:29:53.611958+0000","last_became_active":"2024-09-12T02:29:52.625734+0000","last_became_peered":"2024-09-12T02:29:52.625734+0000","last_unstale":"2024-09-12T02:29:53.611958+0000","last_undegraded":"2024-09-12T02:29:53.611958+0000","last_fullsized":"2024-09-12T02:29:53.611958+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.902749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613323+0000","last_change":"2024-09-12T02:29:51.613594+0000","last_active":"2024-09-12T02:29:54.613323+0000","last_peered":"2024-09-12T02:29:54.613323+0000","last_clean":"2024-09-12T02:29:54.613323+0000","last_became_active":"2024-09-12T02:29:51.613308+0000","last_became_peered":"2024-09-12T02:29:51.613308+0000","last_unstale":"2024-09-12T02:29:54.613323+0000","last_undegraded":"2024-09-12T02:29:54.613323+0000","last_fullsized":"2024-09-12T02:29:54.613323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:30.918853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106376+0000","last_change":"2024-09-12T02:29:52.626950+0000","last_active":"2024-09-12T02:29:54.106376+0000","last_peered":"2024-09-12T02:29:54.106376+0000","last_clean":"2024-09-12T02:29:54.106376+0000","last_became_active":"2024-09-12T02:29:52.624339+0000","last_became_peered":"2024-09-12T02:29:52.624339+0000","last_unstale":"2024-09-12T02:29:54.106376+0000","last_undegraded":"2024-09-12T02:29:54.106376+0000","last_fullsized":"2024-09-12T02:29:54.106376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:10.089014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613467+0000","last_change":"2024-09-12T02:29:51.614143+0000","last_active":"2024-09-12T02:29:53.613467+0000","last_peered":"2024-09-12T02:29:53.613467+0000","last_clean":"2024-09-12T02:29:53.613467+0000","last_became_active":"2024-09-12T02:29:51.613862+0000","last_became_peered":"2024-09-12T02:29:51.613862+0000","last_unstale":"2024-09-12T02:29:53.613467+0000","last_undegraded":"2024-09-12T02:29:53.613467+0000","last_fullsized":"2024-09-12T02:29:53.613467+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:16.971168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613237+0000","last_change":"2024-09-12T02:29:52.628947+0000","last_active":"2024-09-12T02:29:53.613237+0000","last_peered":"2024-09-12T02:29:53.613237+0000","last_clean":"2024-09-12T02:29:53.613237+0000","last_became_active":"2024-09-12T02:29:52.628641+0000","last_became_peered":"2024-09-12T02:29:52.628641+0000","last_unstale":"2024-09-12T02:29:53.613237+0000","last_undegraded":"2024-09-12T02:29:53.613237+0000","last_fullsized":"2024-09-12T02:29:53.613237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:10.089014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.630413+0000","last_change":"2024-09-12T02:29:51.608188+0000","last_active":"2024-09-12T02:29:54.630413+0000","last_peered":"2024-09-12T02:29:54.630413+0000","last_clean":"2024-09-12T02:29:54.630413+0000","last_became_active":"2024-09-12T02:29:51.607861+0000","last_became_peered":"2024-09-12T02:29:51.607861+0000","last_unstale":"2024-09-12T02:29:54.630413+0000","last_undegraded":"2024-09-12T02:29:54.630413+0000","last_fullsized":"2024-09-12T02:29:54.630413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:35.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613139+0000","last_change":"2024-09-12T02:29:52.632499+0000","last_active":"2024-09-12T02:29:54.613139+0000","last_peered":"2024-09-12T02:29:54.613139+0000","last_clean":"2024-09-12T02:29:54.613139+0000","last_became_active":"2024-09-12T02:29:52.632218+0000","last_became_peered":"2024-09-12T02:29:52.632218+0000","last_unstale":"2024-09-12T02:29:54.613139+0000","last_undegraded":"2024-09-12T02:29:54.613139+0000","last_fullsized":"2024-09-12T02:29:54.613139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.693424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.613134+0000","last_change":"2024-09-12T02:29:51.614527+0000","last_active":"2024-09-12T02:29:53.613134+0000","last_peered":"2024-09-12T02:29:53.613134+0000","last_clean":"2024-09-12T02:29:53.613134+0000","last_became_active":"2024-09-12T02:29:51.614243+0000","last_became_peered":"2024-09-12T02:29:51.614243+0000","last_unstale":"2024-09-12T02:29:53.613134+0000","last_undegraded":"2024-09-12T02:29:53.613134+0000","last_fullsized":"2024-09-12T02:29:53.613134+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:10.586982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.613049+0000","last_change":"2024-09-12T02:29:52.634651+0000","last_active":"2024-09-12T02:29:54.613049+0000","last_peered":"2024-09-12T02:29:54.613049+0000","last_clean":"2024-09-12T02:29:54.613049+0000","last_became_active":"2024-09-12T02:29:52.634134+0000","last_became_peered":"2024-09-12T02:29:52.634134+0000","last_unstale":"2024-09-12T02:29:54.613049+0000","last_undegraded":"2024-09-12T02:29:54.613049+0000","last_fullsized":"2024-09-12T02:29:54.613049+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:09.364018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.610965+0000","last_change":"2024-09-12T02:29:51.613803+0000","last_active":"2024-09-12T02:29:53.610965+0000","last_peered":"2024-09-12T02:29:53.610965+0000","last_clean":"2024-09-12T02:29:53.610965+0000","last_became_active":"2024-09-12T02:29:51.613523+0000","last_became_peered":"2024-09-12T02:29:51.613523+0000","last_unstale":"2024-09-12T02:29:53.610965+0000","last_undegraded":"2024-09-12T02:29:53.610965+0000","last_fullsized":"2024-09-12T02:29:53.610965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.846891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776093+0000","last_change":"2024-09-12T02:29:52.626820+0000","last_active":"2024-09-12T02:29:54.776093+0000","last_peered":"2024-09-12T02:29:54.776093+0000","last_clean":"2024-09-12T02:29:54.776093+0000","last_became_active":"2024-09-12T02:29:52.626379+0000","last_became_peered":"2024-09-12T02:29:52.626379+0000","last_unstale":"2024-09-12T02:29:54.776093+0000","last_undegraded":"2024-09-12T02:29:54.776093+0000","last_fullsized":"2024-09-12T02:29:54.776093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:09.868865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.630413+0000","last_change":"2024-09-12T02:29:51.603977+0000","last_active":"2024-09-12T02:29:54.630413+0000","last_peered":"2024-09-12T02:29:54.630413+0000","last_clean":"2024-09-12T02:29:54.630413+0000","last_became_active":"2024-09-12T02:29:51.603675+0000","last_became_peered":"2024-09-12T02:29:51.603675+0000","last_unstale":"2024-09-12T02:29:54.630413+0000","last_undegraded":"2024-09-12T02:29:54.630413+0000","last_fullsized":"2024-09-12T02:29:54.630413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.522542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.610602+0000","last_change":"2024-09-12T02:29:52.622743+0000","last_active":"2024-09-12T02:29:53.610602+0000","last_peered":"2024-09-12T02:29:53.610602+0000","last_clean":"2024-09-12T02:29:53.610602+0000","last_became_active":"2024-09-12T02:29:52.622484+0000","last_became_peered":"2024-09-12T02:29:52.622484+0000","last_unstale":"2024-09-12T02:29:53.610602+0000","last_undegraded":"2024-09-12T02:29:53.610602+0000","last_fullsized":"2024-09-12T02:29:53.610602+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.902749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106219+0000","last_change":"2024-09-12T02:29:51.607832+0000","last_active":"2024-09-12T02:29:54.106219+0000","last_peered":"2024-09-12T02:29:54.106219+0000","last_clean":"2024-09-12T02:29:54.106219+0000","last_became_active":"2024-09-12T02:29:51.607569+0000","last_became_peered":"2024-09-12T02:29:51.607569+0000","last_unstale":"2024-09-12T02:29:54.106219+0000","last_undegraded":"2024-09-12T02:29:54.106219+0000","last_fullsized":"2024-09-12T02:29:54.106219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.106500+0000","last_change":"2024-09-12T02:29:52.622767+0000","last_active":"2024-09-12T02:29:54.106500+0000","last_peered":"2024-09-12T02:29:54.106500+0000","last_clean":"2024-09-12T02:29:54.106500+0000","last_became_active":"2024-09-12T02:29:52.622534+0000","last_became_peered":"2024-09-12T02:29:52.622534+0000","last_unstale":"2024-09-12T02:29:54.106500+0000","last_undegraded":"2024-09-12T02:29:54.106500+0000","last_fullsized":"2024-09-12T02:29:54.106500+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:51.589828+0000","last_clean_scrub_stamp":"2024-09-12T02:29:51.589828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:31.226941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.776169+0000","last_change":"2024-09-12T02:29:51.608005+0000","last_active":"2024-09-12T02:29:54.776169+0000","last_peered":"2024-09-12T02:29:54.776169+0000","last_clean":"2024-09-12T02:29:54.776169+0000","last_became_active":"2024-09-12T02:29:51.607721+0000","last_became_peered":"2024-09-12T02:29:51.607721+0000","last_unstale":"2024-09-12T02:29:54.776169+0000","last_undegraded":"2024-09-12T02:29:54.776169+0000","last_fullsized":"2024-09-12T02:29:54.776169+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:29:50.584857+0000","last_clean_scrub_stamp":"2024-09-12T02:29:50.584857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:25.149314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T02:29:53.612929+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:29:53.612929+0000","last_peered":"2024-09-12T02:29:53.612929+0000","last_clean":"2024-09-12T02:29:53.612929+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:29:53.612929+0000","last_undegraded":"2024-09-12T02:29:53.612929+0000","last_fullsized":"2024-09-12T02:29:53.612929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1118208,"data_stored":800877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":211091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":210489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":212031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":524288,"data_stored":210489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":800821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":211057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":212053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:30:00.233 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:30:00.233 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:30:00.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.381+0000 7f49c50ac640 1 Processor -- start 2024-09-12T02:30:00.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.381+0000 7f49c50ac640 1 -- start start 2024-09-12T02:30:00.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.382+0000 7f49c50ac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49c006f9e0 0x7f49c0071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.382+0000 7f49c50ac640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c00d0200 con 0x7f49c0156b90 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.382+0000 7f49c50ac640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c00d04e0 con 0x7f49c015da90 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.382+0000 7f49c50ac640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f49c00cffd0 con 0x7f49c006f9e0 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.382+0000 7f49bf59e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49c006f9e0 0x7f49c0071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.382+0000 7f49bed9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f49c0156b90 0x7f49c015d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:59664/0 (socket says 172.21.15.181:59664) 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.382+0000 7f49bed9d640 1 -- 172.21.15.181:0/3510576032 learned_addr learned my addr 172.21.15.181:0/3510576032 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.383+0000 7f49bdd9b640 1 -- 172.21.15.181:0/3510576032 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211835110 0 0) 0x7f49c00d0200 con 0x7f49c0156b90 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.383+0000 7f49bdd9b640 1 -- 172.21.15.181:0/3510576032 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49ac003520 con 0x7f49c0156b90 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.383+0000 7f49bf59e640 1 -- 172.21.15.181:0/3510576032 >> v1:172.21.15.204:6789/0 conn(0x7f49c015da90 legacy=0x7f49c006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.383+0000 7f49bf59e640 1 -- 172.21.15.181:0/3510576032 >> v1:172.21.15.181:6789/0 conn(0x7f49c0156b90 legacy=0x7f49c015d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.383+0000 7f49bf59e640 1 -- 172.21.15.181:0/3510576032 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c00d07c0 con 0x7f49c006f9e0 2024-09-12T02:30:00.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.383+0000 7f49bf59e640 1 --2- 172.21.15.181:0/3510576032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c006f9e0 0x7f49c0071410 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009d90 tx=0x7f49b802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84522eff4dd065fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49bdd9b640 1 -- 172.21.15.181:0/3510576032 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8031600 con 0x7f49c006f9e0 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49bdd9b640 1 -- 172.21.15.181:0/3510576032 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b80317a0 con 0x7f49c006f9e0 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49bdd9b640 1 -- 172.21.15.181:0/3510576032 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8031b70 con 0x7f49c006f9e0 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49c50ac640 1 -- 172.21.15.181:0/3510576032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c006f9e0 msgr2=0x7f49c0071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49c50ac640 1 --2- 172.21.15.181:0/3510576032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c006f9e0 0x7f49c0071410 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009d90 tx=0x7f49b802a610 comp rx=0 tx=0).stop 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49c50ac640 1 -- 172.21.15.181:0/3510576032 shutdown_connections 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49c50ac640 1 --2- 172.21.15.181:0/3510576032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c006f9e0 0x7f49c0071410 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49c50ac640 1 -- 172.21.15.181:0/3510576032 >> 172.21.15.181:0/3510576032 conn(0x7f49c00b4100 msgr2=0x7f49c00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49c50ac640 1 -- 172.21.15.181:0/3510576032 shutdown_connections 2024-09-12T02:30:00.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.384+0000 7f49c50ac640 1 -- 172.21.15.181:0/3510576032 wait complete. 2024-09-12T02:30:00.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.386+0000 7f49c50ac640 1 Processor -- start 2024-09-12T02:30:00.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.386+0000 7f49c50ac640 1 -- start start 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49c50ac640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49c006f9e0 0x7f49c014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49c50ac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c0156b90 0x7f49c00ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49c50ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49c015da90 0x7f49c01f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49c50ac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00d12a0 con 0x7f49c0156b90 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49c50ac640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00d0d80 con 0x7f49c006f9e0 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49c50ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f49c00d1420 con 0x7f49c015da90 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c0156b90 0x7f49c00ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c0156b90 0x7f49c00ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42258/0 (socket says 172.21.15.181:42258) 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 -- 172.21.15.181:0/1036601774 learned_addr learned my addr 172.21.15.181:0/1036601774 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49bed9d640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49c006f9e0 0x7f49c014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49bf59e640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49c015da90 0x7f49c01f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 -- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49c015da90 msgr2=0x7f49c01f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49c015da90 0x7f49c01f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 -- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49c006f9e0 msgr2=0x7f49c014f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49c006f9e0 0x7f49c014f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 -- 172.21.15.181:0/1036601774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c014f770 con 0x7f49c0156b90 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49bf59e640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49c015da90 0x7f49c01f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49bed9d640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49c006f9e0 0x7f49c014f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.387+0000 7f49be59c640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c0156b90 0x7f49c00ce260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f49a800b3f0 tx=0x7f49a800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.388+0000 7f49b77fe640 1 -- 172.21.15.181:0/1036601774 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8015020 con 0x7f49c0156b90 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.388+0000 7f49b77fe640 1 -- 172.21.15.181:0/1036601774 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a8011830 con 0x7f49c0156b90 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.388+0000 7f49b77fe640 1 -- 172.21.15.181:0/1036601774 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8011c20 con 0x7f49c0156b90 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.388+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c014fa50 con 0x7f49c0156b90 2024-09-12T02:30:00.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.388+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c01f1fc0 con 0x7f49c0156b90 2024-09-12T02:30:00.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.389+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c0071410 con 0x7f49c0156b90 2024-09-12T02:30:00.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.389+0000 7f49b77fe640 1 -- 172.21.15.181:0/1036601774 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49a8018020 con 0x7f49c0156b90 2024-09-12T02:30:00.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.390+0000 7f49b77fe640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f49a006be30 0x7f49a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.390+0000 7f49b77fe640 1 -- 172.21.15.181:0/1036601774 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f49a808ab00 con 0x7f49c0156b90 2024-09-12T02:30:00.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.390+0000 7f49bed9d640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f49a006be30 0x7f49a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.390+0000 7f49bed9d640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f49a006be30 0x7f49a006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49b0007fd0 tx=0x7f49b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.394+0000 7f49b77fe640 1 -- 172.21.15.181:0/1036601774 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49a801f030 con 0x7f49c0156b90 2024-09-12T02:30:00.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.628+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f49c0070780 con 0x7f49c0156b90 2024-09-12T02:30:00.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.630+0000 7f49b77fe640 1 -- 172.21.15.181:0/1036601774 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7f49a80172c0 con 0x7f49c0156b90 2024-09-12T02:30:00.631 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-12T02:30:00.631 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg== 2024-09-12T02:30:00.631 INFO:teuthology.orchestra.run.smithi181.stdout: caps mds = "allow" 2024-09-12T02:30:00.631 INFO:teuthology.orchestra.run.smithi181.stdout: caps mon = "allow r" 2024-09-12T02:30:00.631 INFO:teuthology.orchestra.run.smithi181.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:30:00.631 INFO:teuthology.orchestra.run.smithi181.stderr:updated caps for client.0 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f49a006be30 msgr2=0x7f49a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f49a006be30 0x7f49a006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49b0007fd0 tx=0x7f49b0009040 comp rx=0 tx=0).stop 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c0156b90 msgr2=0x7f49c00ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c0156b90 0x7f49c00ce260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f49a800b3f0 tx=0x7f49a800b8b0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 shutdown_connections 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f49a006be30 0x7f49a006e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49c015da90 0x7f49c01f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49c0156b90 0x7f49c00ce260 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 --2- 172.21.15.181:0/1036601774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49c006f9e0 0x7f49c014f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 >> 172.21.15.181:0/1036601774 conn(0x7f49c00b4100 msgr2=0x7f49c015df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 shutdown_connections 2024-09-12T02:30:00.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.633+0000 7f49c50ac640 1 -- 172.21.15.181:0/1036601774 wait complete. 2024-09-12T02:30:00.646 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:30:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.744+0000 7f4e1865e640 1 Processor -- start 2024-09-12T02:30:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.744+0000 7f4e1865e640 1 -- start start 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e1865e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e100cf2b0 0x7f4e100d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e1865e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf720 0x7f4e100d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e1865e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1015ea20 con 0x7f4e1015e640 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e1865e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4e100b3d00 con 0x7f4e100cf2b0 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e1865e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4e100b2860 con 0x7f4e100cf720 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e15bf9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e100cf2b0 0x7f4e100d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e163fa640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4e1015e640 0x7f4e100ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:59678/0 (socket says 172.21.15.181:59678) 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.745+0000 7f4e163fa640 1 -- 172.21.15.181:0/1127786587 learned_addr learned my addr 172.21.15.181:0/1127786587 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.746+0000 7f4e15bf9640 1 -- 172.21.15.181:0/1127786587 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf720 msgr2=0x7f4e100d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.746+0000 7f4e15bf9640 1 --2- 172.21.15.181:0/1127786587 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf720 0x7f4e100d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.746+0000 7f4e15bf9640 1 -- 172.21.15.181:0/1127786587 >> v1:172.21.15.181:6789/0 conn(0x7f4e1015e640 legacy=0x7f4e100ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.746+0000 7f4e15bf9640 1 -- 172.21.15.181:0/1127786587 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e100b1c50 con 0x7f4e100cf2b0 2024-09-12T02:30:00.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.746+0000 7f4e153f8640 1 -- 172.21.15.181:0/1127786587 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933045938 0 0) 0x7f4e1015ea20 con 0x7f4e1015e640 2024-09-12T02:30:00.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.746+0000 7f4e15bf9640 1 --2- 172.21.15.181:0/1127786587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf2b0 0x7f4e100d2650 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4e040097a0 tx=0x7f4e0402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2d2585e942c717 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e153f8640 1 -- 172.21.15.181:0/1127786587 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037070 con 0x7f4e100cf2b0 2024-09-12T02:30:00.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e153f8640 1 -- 172.21.15.181:0/1127786587 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0402ae50 con 0x7f4e100cf2b0 2024-09-12T02:30:00.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e153f8640 1 -- 172.21.15.181:0/1127786587 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04032660 con 0x7f4e100cf2b0 2024-09-12T02:30:00.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 -- 172.21.15.181:0/1127786587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf2b0 msgr2=0x7f4e100d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 --2- 172.21.15.181:0/1127786587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf2b0 0x7f4e100d2650 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4e040097a0 tx=0x7f4e0402a100 comp rx=0 tx=0).stop 2024-09-12T02:30:00.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 -- 172.21.15.181:0/1127786587 shutdown_connections 2024-09-12T02:30:00.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 --2- 172.21.15.181:0/1127786587 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf720 0x7f4e100d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 --2- 172.21.15.181:0/1127786587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf2b0 0x7f4e100d2650 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 -- 172.21.15.181:0/1127786587 >> 172.21.15.181:0/1127786587 conn(0x7f4e1009d820 msgr2=0x7f4e100d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 -- 172.21.15.181:0/1127786587 shutdown_connections 2024-09-12T02:30:00.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.747+0000 7f4e1865e640 1 -- 172.21.15.181:0/1127786587 wait complete. 2024-09-12T02:30:00.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.748+0000 7f4e1865e640 1 Processor -- start 2024-09-12T02:30:00.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e1865e640 1 -- start start 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e1865e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf2b0 0x7f4e100c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e1865e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf720 0x7f4e100c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e1865e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e1015e640 0x7f4e101f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e1865e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4e100b24f0 con 0x7f4e100cf720 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e1865e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4e100b2210 con 0x7f4e1015e640 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e1865e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4e100cfe40 con 0x7f4e100cf2b0 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e15bf9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf720 0x7f4e100c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e15bf9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf720 0x7f4e100c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42278/0 (socket says 172.21.15.181:42278) 2024-09-12T02:30:00.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.749+0000 7f4e15bf9640 1 -- 172.21.15.181:0/4136399752 learned_addr learned my addr 172.21.15.181:0/4136399752 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e15bf9640 1 -- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf2b0 msgr2=0x7f4e100c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e163fa640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf2b0 0x7f4e100c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e15bf9640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf2b0 0x7f4e100c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e16bfb640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e1015e640 0x7f4e101f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e15bf9640 1 -- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e1015e640 msgr2=0x7f4e101f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e15bf9640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e1015e640 0x7f4e101f76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e15bf9640 1 -- 172.21.15.181:0/4136399752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1014ecd0 con 0x7f4e100cf720 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e16bfb640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e1015e640 0x7f4e101f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e15bf9640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf720 0x7f4e100c87f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e040097a0 tx=0x7f4e040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e0effd640 1 -- 172.21.15.181:0/4136399752 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037040 con 0x7f4e100cf720 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e0effd640 1 -- 172.21.15.181:0/4136399752 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e04004030 con 0x7f4e100cf720 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e0effd640 1 -- 172.21.15.181:0/4136399752 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04006e10 con 0x7f4e100cf720 2024-09-12T02:30:00.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1014efb0 con 0x7f4e100cf720 2024-09-12T02:30:00.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.750+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e100ccb60 con 0x7f4e100cf720 2024-09-12T02:30:00.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.751+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e10068eb0 con 0x7f4e100cf720 2024-09-12T02:30:00.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.752+0000 7f4e0effd640 1 -- 172.21.15.181:0/4136399752 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e0403d650 con 0x7f4e100cf720 2024-09-12T02:30:00.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.752+0000 7f4e0effd640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4dfc06be30 0x7f4dfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.752+0000 7f4e0effd640 1 -- 172.21.15.181:0/4136399752 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4e040ab840 con 0x7f4e100cf720 2024-09-12T02:30:00.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.752+0000 7f4e163fa640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4dfc06be30 0x7f4dfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.752+0000 7f4e163fa640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4dfc06be30 0x7f4dfc06e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4e000012e0 tx=0x7f4e00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.756+0000 7f4e0effd640 1 -- 172.21.15.181:0/4136399752 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e04042020 con 0x7f4e100cf720 2024-09-12T02:30:00.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.956+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e100b73a0 con 0x7f4e100cf720 2024-09-12T02:30:00.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.956+0000 7f4e0effd640 1 -- 172.21.15.181:0/4136399752 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5235 (secure 0 0 0) 0x7f4e0407a310 con 0x7f4e100cf720 2024-09-12T02:30:00.957 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:30:00.958 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":27,"btime":"2024-09-12T02:29:54:627732+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:29:53.953929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6837/1579385817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1579385817},{"type":"v1","addr":"172.21.15.181:6837","nonce":1579385817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5373,"qdb_cluster":[5373]},"id":3}]} 2024-09-12T02:30:00.958 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 27 2024-09-12T02:30:00.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4dfc06be30 msgr2=0x7f4dfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4dfc06be30 0x7f4dfc06e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4e000012e0 tx=0x7f4e00009040 comp rx=0 tx=0).stop 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf720 msgr2=0x7f4e100c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf720 0x7f4e100c87f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e040097a0 tx=0x7f4e040046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 shutdown_connections 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4dfc06be30 0x7f4dfc06e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e1015e640 0x7f4e101f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e100cf720 0x7f4e100c87f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 --2- 172.21.15.181:0/4136399752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e100cf2b0 0x7f4e100c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 >> 172.21.15.181:0/4136399752 conn(0x7f4e1009d820 msgr2=0x7f4e100d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 shutdown_connections 2024-09-12T02:30:00.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:00.958+0000 7f4e1865e640 1 -- 172.21.15.181:0/4136399752 wait complete. 2024-09-12T02:30:01.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:51.939812+0000', 'modified': '2024-09-12T02:29:53.953929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5373}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5373': {'gid': 5373, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.181:6837/1579385817', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 1579385817}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 1579385817}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5373, 'qdb_cluster': [5373]} 2024-09-12T02:30:01.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:30:01.373 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:30:01.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.473+0000 7f5c1a85e640 1 Processor -- start 2024-09-12T02:30:01.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.473+0000 7f5c1a85e640 1 -- start start 2024-09-12T02:30:01.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c1a85e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5c1415e640 0x7f5c140ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c1a85e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5c140cf0e0 0x7f5c140cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c1a85e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b2cf0 0x7f5c140b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c1a85e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5c140b2860 con 0x7f5c1415e640 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c1a85e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1415ea20 con 0x7f5c140cf0e0 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c1a85e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c140b1c50 con 0x7f5c140b2cf0 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c13fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5c1415e640 0x7f5c140ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.474+0000 7f5c13fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5c1415e640 0x7f5c140ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42292/0 (socket says 172.21.15.181:42292) 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.475+0000 7f5c13fff640 1 -- 172.21.15.181:0/2000924819 learned_addr learned my addr 172.21.15.181:0/2000924819 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.475+0000 7f5c13fff640 1 -- 172.21.15.181:0/2000924819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b2cf0 msgr2=0x7f5c140b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.475+0000 7f5c13fff640 1 --2- 172.21.15.181:0/2000924819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b2cf0 0x7f5c140b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.475+0000 7f5c13fff640 1 -- 172.21.15.181:0/2000924819 >> v2:172.21.15.204:3300/0 conn(0x7f5c140cf0e0 msgr2=0x7f5c140cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.475+0000 7f5c13fff640 1 --2- 172.21.15.181:0/2000924819 >> v2:172.21.15.204:3300/0 conn(0x7f5c140cf0e0 0x7f5c140cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.475+0000 7f5c13fff640 1 -- 172.21.15.181:0/2000924819 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c140b1f30 con 0x7f5c1415e640 2024-09-12T02:30:01.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.475+0000 7f5c13fff640 1 --2- 172.21.15.181:0/2000924819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1415e640 0x7f5c140ceba0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5c140cb580 tx=0x7f5c0402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5bb02273a54e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c12ffd640 1 -- 172.21.15.181:0/2000924819 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04037070 con 0x7f5c1415e640 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c12ffd640 1 -- 172.21.15.181:0/2000924819 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c04032440 con 0x7f5c1415e640 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c12ffd640 1 -- 172.21.15.181:0/2000924819 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04032810 con 0x7f5c1415e640 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 -- 172.21.15.181:0/2000924819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1415e640 msgr2=0x7f5c140ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/2000924819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1415e640 0x7f5c140ceba0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5c140cb580 tx=0x7f5c0402a140 comp rx=0 tx=0).stop 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 -- 172.21.15.181:0/2000924819 shutdown_connections 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/2000924819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b2cf0 0x7f5c140b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/2000924819 >> v2:172.21.15.204:3300/0 conn(0x7f5c140cf0e0 0x7f5c140cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/2000924819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1415e640 0x7f5c140ceba0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 -- 172.21.15.181:0/2000924819 >> 172.21.15.181:0/2000924819 conn(0x7f5c1409d820 msgr2=0x7f5c140d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 -- 172.21.15.181:0/2000924819 shutdown_connections 2024-09-12T02:30:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.476+0000 7f5c1a85e640 1 -- 172.21.15.181:0/2000924819 wait complete. 2024-09-12T02:30:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.477+0000 7f5c1a85e640 1 Processor -- start 2024-09-12T02:30:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c1a85e640 1 -- start start 2024-09-12T02:30:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c1a85e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b2cf0 0x7f5c141f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c1a85e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c140cf0e0 0x7f5c140c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c1a85e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415e640 0x7f5c140b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c1a85e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c140cfe40 con 0x7f5c140b2cf0 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c1a85e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5c140b24f0 con 0x7f5c140cf0e0 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c1a85e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c140b73a0 con 0x7f5c1415e640 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c13fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b2cf0 0x7f5c141f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c13fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b2cf0 0x7f5c141f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42298/0 (socket says 172.21.15.181:42298) 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.478+0000 7f5c13fff640 1 -- 172.21.15.181:0/556834543 learned_addr learned my addr 172.21.15.181:0/556834543 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c137fe640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c140cf0e0 0x7f5c140c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415e640 0x7f5c140b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c13fff640 1 -- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415e640 msgr2=0x7f5c140b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c13fff640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415e640 0x7f5c140b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c13fff640 1 -- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c140cf0e0 msgr2=0x7f5c140c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c13fff640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c140cf0e0 0x7f5c140c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c13fff640 1 -- 172.21.15.181:0/556834543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c140c9450 con 0x7f5c140b2cf0 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c13fff640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b2cf0 0x7f5c141f3ce0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5c04000c00 tx=0x7f5c040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c10ff9640 1 -- 172.21.15.181:0/556834543 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04041070 con 0x7f5c140b2cf0 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c10ff9640 1 -- 172.21.15.181:0/556834543 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0403c870 con 0x7f5c140b2cf0 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c140c9730 con 0x7f5c140b2cf0 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c10ff9640 1 -- 172.21.15.181:0/556834543 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04037040 con 0x7f5c140b2cf0 2024-09-12T02:30:01.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.479+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c140b4090 con 0x7f5c140b2cf0 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.481+0000 7f5c10ff9640 1 -- 172.21.15.181:0/556834543 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c04044070 con 0x7f5c140b2cf0 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.481+0000 7f5c10ff9640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c0006be30 0x7f5c0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.481+0000 7f5c10ff9640 1 -- 172.21.15.181:0/556834543 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5c040abb20 con 0x7f5c140b2cf0 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.481+0000 7f5c137fe640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c0006be30 0x7f5c0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.482+0000 7f5c137fe640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c0006be30 0x7f5c0006e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c141511c0 tx=0x7f5c08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.482+0000 7f5c1d5fd740 1 Processor -- start 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.482+0000 7f5c1d5fd740 1 -- start start 2024-09-12T02:30:01.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b44a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98afca80 0x557d98aff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b00a50 0x557d98af98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557d98a61520 con 0x557d98b00a50 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x557d98a093e0 con 0x557d98aff2c0 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x557d98a5d4e0 con 0x557d98afca80 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b00a50 0x557d98af98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b00a50 0x557d98af98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42310/0 (socket says 172.21.15.181:42310) 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 -- 172.21.15.181:0/130838920 learned_addr learned my addr 172.21.15.181:0/130838920 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c13fff640 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b44a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c137fe640 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98afca80 0x557d98aff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 -- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98afca80 msgr2=0x557d98aff6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98afca80 0x557d98aff6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 -- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 msgr2=0x557d98b44a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b44a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 -- 172.21.15.181:0/130838920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d98a242f0 con 0x557d98b00a50 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b00a50 0x557d98af98b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009f80 tx=0x7f5c0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196797255a4a3d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5bf9ffb640 1 -- 172.21.15.181:0/130838920 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c016420 con 0x557d98b00a50 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5bf9ffb640 1 -- 172.21.15.181:0/130838920 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0165c0 con 0x557d98b00a50 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.483+0000 7f5bf9ffb640 1 -- 172.21.15.181:0/130838920 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0169b0 con 0x557d98b00a50 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/130838920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b00a50 msgr2=0x557d98af98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b00a50 0x557d98af98b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009f80 tx=0x7f5c0c00c8b0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/130838920 shutdown_connections 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b00a50 0x557d98af98b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98afca80 0x557d98aff6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/130838920 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b44a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/130838920 >> 172.21.15.181:0/130838920 conn(0x557d98afba80 msgr2=0x557d98b43f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/130838920 shutdown_connections 2024-09-12T02:30:01.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.484+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/130838920 wait complete. 2024-09-12T02:30:01.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.485+0000 7f5c1d5fd740 1 -- start start 2024-09-12T02:30:01.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.485+0000 7f5c1d5fd740 1 Processor -- start 2024-09-12T02:30:01.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b1ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b22660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b22ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557d98afaf20 con 0x557d98b29b20 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x557d989ea450 con 0x557d98aff2c0 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x557d98b45290 con 0x557d98b00a50 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 10 client.0 _ll_register_callbacks cb 0x557d98773ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b22ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b22ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42318/0 (socket says 172.21.15.181:42318) 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 -- 172.21.15.181:0/3846228122 learned_addr learned my addr 172.21.15.181:0/3846228122 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c13fff640 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b1ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c137fe640 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b22660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 -- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 msgr2=0x557d98b22660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b22660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 -- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 msgr2=0x557d98b1ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b1ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 -- 172.21.15.181:0/3846228122 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d987742d0 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b22ba0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00c8f0 tx=0x7f5c0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81877075bfb46fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/3846228122 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c024020 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/3846228122 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5c0c017d40 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.486+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c0c0165c0 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/3846228122 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5c0c02e050 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 10 client.5532 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x557d9883e6b0 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/3846228122 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0165c0 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/3846228122 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f5c0c031020 con 0x557d98b29b20 2024-09-12T02:30:01.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 10 client.5532 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 10 client.5532 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 20 client.5532 populate_metadata read hostname 'smithi181' 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98af88c0 0x557d98af8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 4 client.5532 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 --> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d98a6ec50 con 0x557d98af88c0 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c13fff640 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98af88c0 0x557d98af8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5bf2ffd640 10 client.5532 ms_handle_connect on v2:172.21.15.181:6836/1579385817 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.487+0000 7f5c13fff640 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98af88c0 0x557d98af8ca0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6cd0ab323c16907 server_cookie=ea19a3b4ca3271f0 in_seq=0 out_seq=0 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/3846228122 <== mds.0 v2:172.21.15.181:6836/1579385817 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d98a6ec50 con 0x557d98af88c0 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5bf2ffd640 10 client.5532 handle_command_reply: tid=0 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 client.5532 shutdown 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 msgr2=0x557d98b22ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b22ba0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00c8f0 tx=0x7f5c0c004a40 comp rx=0 tx=0).stop 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 shutdown_connections 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98af88c0 0x557d98af8ca0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b22ba0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b22660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5bf2ffd640 0 client.5532 ms_handle_reset on v2:172.21.15.181:6836/1579385817 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/3846228122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98aff2c0 0x557d98b1ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 >> 172.21.15.181:0/3846228122 conn(0x557d98afca80 msgr2=0x557d98b43470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 shutdown_connections 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/3846228122 wait complete. 2024-09-12T02:30:01.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.488+0000 7f5c1d5fd740 20 client.5532 trim_cache size 0 max 16384 2024-09-12T02:30:01.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.506+0000 7f5c1d5fd740 1 Processor -- start 2024-09-12T02:30:01.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.506+0000 7f5c1d5fd740 1 -- start start 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98aff2c0 0x557d98b22790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b00a50 0x557d98b67cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b68210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141ffd60 con 0x557d98b29b20 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5c14150dd0 con 0x557d98b00a50 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c141e8880 con 0x557d98aff2c0 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b68210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b68210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42330/0 (socket says 172.21.15.181:42330) 2024-09-12T02:30:01.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 -- 172.21.15.181:0/2201874553 learned_addr learned my addr 172.21.15.181:0/2201874553 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 -- 172.21.15.181:0/2201874553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98aff2c0 msgr2=0x557d98b22790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/2201874553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98aff2c0 0x557d98b22790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 -- 172.21.15.181:0/2201874553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b00a50 msgr2=0x557d98b67cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/2201874553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b00a50 0x557d98b67cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 -- 172.21.15.181:0/2201874553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d98b41ac0 con 0x557d98b29b20 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/2201874553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b68210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000f80 tx=0x7f5c0c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866c29dd34b2864f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5bf97fa640 1 -- 172.21.15.181:0/2201874553 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c037070 con 0x557d98b29b20 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5bf97fa640 1 -- 172.21.15.181:0/2201874553 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c017d40 con 0x557d98b29b20 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.507+0000 7f5bf97fa640 1 -- 172.21.15.181:0/2201874553 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c024070 con 0x557d98b29b20 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/2201874553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 msgr2=0x557d98b68210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/2201874553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b68210 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000f80 tx=0x7f5c0c01c000 comp rx=0 tx=0).stop 2024-09-12T02:30:01.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/2201874553 shutdown_connections 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/2201874553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b00a50 0x557d98b67cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/2201874553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98b29b20 0x557d98b68210 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/2201874553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98aff2c0 0x557d98b22790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/2201874553 >> 172.21.15.181:0/2201874553 conn(0x557d98afca80 msgr2=0x557d98b4bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/2201874553 shutdown_connections 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/2201874553 wait complete. 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 -- start start 2024-09-12T02:30:01.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.508+0000 7f5c1d5fd740 1 Processor -- start 2024-09-12T02:30:01.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98aff2c0 0x557d98b4b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b26cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c1d5fd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b29b20 0x557d98bc1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557d98afa450 con 0x557d98aff2c0 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x557d98b1f3d0 con 0x557d98b29b20 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c1d5fd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x557d98b1fbf0 con 0x557d98b00a50 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c1d5fd740 10 client.0 _ll_register_callbacks cb 0x7f5c040094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c13fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98aff2c0 0x557d98b4b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c13fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98aff2c0 0x557d98b4b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42338/0 (socket says 172.21.15.181:42338) 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c13fff640 1 -- 172.21.15.181:0/1591180642 learned_addr learned my addr 172.21.15.181:0/1591180642 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c137fe640 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b26cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.509+0000 7f5c18dfb640 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b29b20 0x557d98bc1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c13fff640 1 -- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 msgr2=0x557d98b26cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c13fff640 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b26cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c13fff640 1 -- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b29b20 msgr2=0x557d98bc1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c13fff640 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b29b20 0x557d98bc1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c13fff640 1 -- 172.21.15.181:0/1591180642 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d98b4c0f0 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c13fff640 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98aff2c0 0x557d98b4b770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5c04035040 tx=0x7f5c0407a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c04b9ef048f365 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/1591180642 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0404b040 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/1591180642 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5c040765f0 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c0c017d40 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/1591180642 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5c04082b60 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 10 client.5538 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x557d98b4bcb0 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/1591180642 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c017d40 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/1591180642 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f5c0407a1e0 con 0x557d98aff2c0 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 10 client.5538 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:01.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 10 client.5538 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 20 client.5538 populate_metadata read hostname 'smithi181' 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98b20f00 0x557d98b212e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 4 client.5538 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 --> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] -- command(tid 0: {"prefix": "status"}) -- 0x557d98a68fa0 con 0x557d98b20f00 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.510+0000 7f5c137fe640 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98b20f00 0x557d98b212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5bf2ffd640 10 client.5538 ms_handle_connect on v2:172.21.15.181:6836/1579385817 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c137fe640 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98b20f00 0x557d98b212e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88b45f9ad11209ed server_cookie=6495e83b492d0179 in_seq=0 out_seq=0 2024-09-12T02:30:01.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5bf2ffd640 1 -- 172.21.15.181:0/1591180642 <== mds.0 v2:172.21.15.181:6836/1579385817 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x557d98a68fa0 con 0x557d98b20f00 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5bf2ffd640 10 client.5538 handle_command_reply: tid=0 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 client.5538 shutdown 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98aff2c0 msgr2=0x557d98b4b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98aff2c0 0x557d98b4b770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5c04035040 tx=0x7f5c0407a040 comp rx=0 tx=0).stop 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 shutdown_connections 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:6836/1579385817,v1:172.21.15.181:6837/1579385817] conn(0x557d98b20f00 0x557d98b212e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557d98b29b20 0x557d98bc1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557d98b00a50 0x557d98b26cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5bf2ffd640 0 client.5538 ms_handle_reset on v2:172.21.15.181:6836/1579385817 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 --2- 172.21.15.181:0/1591180642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d98aff2c0 0x557d98b4b770 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 >> 172.21.15.181:0/1591180642 conn(0x557d98afca80 msgr2=0x557d98b41ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 shutdown_connections 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 1 -- 172.21.15.181:0/1591180642 wait complete. 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.511+0000 7f5c1d5fd740 20 client.5538 trim_cache size 0 max 16384 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:30:01.520 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 5373, 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 8.9056911480000007, 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 45, 2024-09-12T02:30:01.521 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 45, 2024-09-12T02:30:01.522 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 12.971315785 2024-09-12T02:30:01.522 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:30:01.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c0006be30 msgr2=0x7f5c0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c0006be30 0x7f5c0006e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c141511c0 tx=0x7f5c08008040 comp rx=0 tx=0).stop 2024-09-12T02:30:01.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b2cf0 msgr2=0x7f5c141f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b2cf0 0x7f5c141f3ce0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5c04000c00 tx=0x7f5c040046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 shutdown_connections 2024-09-12T02:30:01.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5c0006be30 0x7f5c0006e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c140cf0e0 0x7f5c140c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415e640 0x7f5c140b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 --2- 172.21.15.181:0/556834543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b2cf0 0x7f5c141f3ce0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 >> 172.21.15.181:0/556834543 conn(0x7f5c1409d820 msgr2=0x7f5c140cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 shutdown_connections 2024-09-12T02:30:01.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.512+0000 7f5c1a85e640 1 -- 172.21.15.181:0/556834543 wait complete. 2024-09-12T02:30:01.525 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.623+0000 7f4fa2f4b640 1 Processor -- start 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.623+0000 7f4fa2f4b640 1 -- start start 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa2f4b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4f9c162280 0x7f4f9c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa2f4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c0af940 0x7f4f9c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa2f4b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c0cf870 con 0x7f4f9c162660 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa2f4b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4f9c0b02f0 con 0x7f4f9c162280 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa2f4b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c0cfb50 con 0x7f4f9c0af940 2024-09-12T02:30:01.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa0ce7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4f9c162280 0x7f4f9c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa0ce7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4f9c162280 0x7f4f9c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42344/0 (socket says 172.21.15.181:42344) 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa0ce7640 1 -- 172.21.15.181:0/2745293122 learned_addr learned my addr 172.21.15.181:0/2745293122 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa14e8640 1 --2- 172.21.15.181:0/2745293122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c0af940 0x7f4f9c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa0ce7640 1 -- 172.21.15.181:0/2745293122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c0af940 msgr2=0x7f4f9c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa0ce7640 1 --2- 172.21.15.181:0/2745293122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c0af940 0x7f4f9c0afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa0ce7640 1 -- 172.21.15.181:0/2745293122 >> v1:172.21.15.204:6789/0 conn(0x7f4f9c162660 legacy=0x7f4f9c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa0ce7640 1 -- 172.21.15.181:0/2745293122 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c0cfe30 con 0x7f4f9c162280 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.624+0000 7f4fa14e8640 1 --2- 172.21.15.181:0/2745293122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c0af940 0x7f4f9c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:01.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa0ce7640 1 --2- 172.21.15.181:0/2745293122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c0cf290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392161581876e956 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4f9b7fe640 1 -- 172.21.15.181:0/2745293122 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90037070 con 0x7f4f9c162280 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4f9b7fe640 1 -- 172.21.15.181:0/2745293122 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f90032440 con 0x7f4f9c162280 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4f9b7fe640 1 -- 172.21.15.181:0/2745293122 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90032810 con 0x7f4f9c162280 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/2745293122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 msgr2=0x7f4f9c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/2745293122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c0cf290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9002a210 comp rx=0 tx=0).stop 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/2745293122 shutdown_connections 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/2745293122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c0af940 0x7f4f9c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/2745293122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c0cf290 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/2745293122 >> 172.21.15.181:0/2745293122 conn(0x7f4f9c0b1770 msgr2=0x7f4f9c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/2745293122 shutdown_connections 2024-09-12T02:30:01.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.625+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/2745293122 wait complete. 2024-09-12T02:30:01.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.627+0000 7f4fa2f4b640 1 Processor -- start 2024-09-12T02:30:01.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.627+0000 7f4fa2f4b640 1 -- start start 2024-09-12T02:30:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f9c0af940 0x7f4f9c146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c162660 0x7f4f9c0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c154c50 con 0x7f4f9c162280 2024-09-12T02:30:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c0d03f0 con 0x7f4f9c0af940 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c154dd0 con 0x7f4f9c162660 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42358/0 (socket says 172.21.15.181:42358) 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 -- 172.21.15.181:0/4083128344 learned_addr learned my addr 172.21.15.181:0/4083128344 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa0ce7640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f9c0af940 0x7f4f9c146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa14e8640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c162660 0x7f4f9c0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 -- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c162660 msgr2=0x7f4f9c0acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c162660 0x7f4f9c0acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 -- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f9c0af940 msgr2=0x7f4f9c146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f9c0af940 0x7f4f9c146c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 -- 172.21.15.181:0/4083128344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c147160 con 0x7f4f9c162280 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f9bfff640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c143840 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b3f0 tx=0x7f4f8800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f997fa640 1 -- 172.21.15.181:0/4083128344 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88015020 con 0x7f4f9c162280 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f997fa640 1 -- 172.21.15.181:0/4083128344 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f88011830 con 0x7f4f9c162280 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4f997fa640 1 -- 172.21.15.181:0/4083128344 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88011c20 con 0x7f4f9c162280 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c144390 con 0x7f4f9c162280 2024-09-12T02:30:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.628+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c144950 con 0x7f4f9c162280 2024-09-12T02:30:01.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.629+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c0afdb0 con 0x7f4f9c162280 2024-09-12T02:30:01.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.630+0000 7f4f997fa640 1 -- 172.21.15.181:0/4083128344 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f88018020 con 0x7f4f9c162280 2024-09-12T02:30:01.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.630+0000 7f4f997fa640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f8006be60 0x7f4f8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:01.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.630+0000 7f4f997fa640 1 -- 172.21.15.181:0/4083128344 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4f8808a850 con 0x7f4f9c162280 2024-09-12T02:30:01.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.630+0000 7f4fa0ce7640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f8006be60 0x7f4f8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:01.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.631+0000 7f4fa0ce7640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f8006be60 0x7f4f8006e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f90034000 tx=0x7f4f9002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:01.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.634+0000 7f4f997fa640 1 -- 172.21.15.181:0/4083128344 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f8801f030 con 0x7f4f9c162280 2024-09-12T02:30:01.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.836+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4f9c0b5830 con 0x7f4f9c162280 2024-09-12T02:30:01.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.836+0000 7f4f997fa640 1 -- 172.21.15.181:0/4083128344 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f4f88058c40 con 0x7f4f9c162280 2024-09-12T02:30:01.838 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f8006be60 msgr2=0x7f4f8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f8006be60 0x7f4f8006e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f90034000 tx=0x7f4f9002e000 comp rx=0 tx=0).stop 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 msgr2=0x7f4f9c143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c143840 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b3f0 tx=0x7f4f8800b8b0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 shutdown_connections 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f8006be60 0x7f4f8006e320 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f9c162660 0x7f4f9c0acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c162280 0x7f4f9c143840 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 --2- 172.21.15.181:0/4083128344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f9c0af940 0x7f4f9c146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.838+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 >> 172.21.15.181:0/4083128344 conn(0x7f4f9c0b1770 msgr2=0x7f4f9c0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.839+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 shutdown_connections 2024-09-12T02:30:01.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:01.839+0000 7f4fa2f4b640 1 -- 172.21.15.181:0/4083128344 wait complete. 2024-09-12T02:30:01.850 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:30:01.850 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:30:01.850 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:30:01.850 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:30:01.850 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:01.851 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:30:01.851 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:30:01.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:30:01.851 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:30:01.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:01.851 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:30:01.866 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:30:01.867 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42641sec preferred_lft 42641sec 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:01.868 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:01.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:01.869 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:30:01.930 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:30:01.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:01.931 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:30:01.987 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:30:01.987 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:30:01.987 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:30:01.988 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:30:01.988 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:30:01.988 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:30:01.988 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:30:01.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:30:01.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:30:01.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:30:01.988 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:30:02.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:30:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:02.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:02.113 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:30:02.129 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:30:02.129 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:30:02.129 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:30:02.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:02.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:30:02.194 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:30:02.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:30:02.194 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:02.252 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:30:02.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:30:02.252 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:02.308 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:30:02.372 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:30:02.429 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:30:02.429 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:30:02.429 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:30:02.429 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:30:02.430 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:30:02.431 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:30:02.432 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:30:02.432 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:30:02.432 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:30:02.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:02.432 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:30:02.484 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:30:02.485 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:30:02.527 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:30:02.552 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:30:02.608 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:30:02.609 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:30:02.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:02.611 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:30:02.611 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:30:02.609+0000 7fb2ce590480 -1 init, newargv = 0x55c5fdf73bd0 newargc=15 2024-09-12T02:30:02.611 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[52988]: starting ceph client 2024-09-12T02:30:02.614 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[52988]: starting fuse 2024-09-12T02:30:02.626 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:30:02.626 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:30:02.626 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:30:02.627 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:30:02.628 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:30:02.744 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.52988.asok 2024-09-12T02:30:02.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:02.754 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52988.asok 2024-09-12T02:30:02.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:02.754 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52988.asok status 2024-09-12T02:30:02.887 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:30:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "52988", 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 5006, 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:30:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 5006 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 1839776898 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:30:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 1839776898 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.5006 192.168.0.1:0/1839776898", 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/1839776898", 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 27, 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 45, 2024-09-12T02:30:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:30:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:30:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:30:02.891 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:30:02.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:02.896 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:30:02.896 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:02.912 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:30:02.912 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:02.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:02.913 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:02.978 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:30:02.978 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:30:02.978 DEBUG:teuthology.orchestra.run.smithi181:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:03.033 INFO:teuthology.orchestra.run.smithi181.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:03.033 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T02:30:03.034 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-09-12T02:30:03.034 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:30:03.034 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T02:30:03.034 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T02:30:03.034 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 02:29:52.607422818 +0000 2024-09-12T02:30:03.034 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 02:30:02.976402443 +0000 2024-09-12T02:30:03.034 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-09-12T02:30:03.034 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:03.034 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:30:03.103 INFO:tasks.workunit:timeout=1h 2024-09-12T02:30:03.104 INFO:tasks.workunit:cleanup=True 2024-09-12T02:30:03.104 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:30:03.160 INFO:tasks.workunit.client.0.smithi181.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:30:15.889 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:30:15.892 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:30:46.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:30:46.023 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:02.653 INFO:tasks.workunit.client.0.smithi181.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:31:02.653 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:31:02.653 INFO:tasks.workunit.client.0.smithi181.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:31:02.653 INFO:tasks.workunit.client.0.smithi181.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:31:02.653 INFO:tasks.workunit.client.0.smithi181.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: git switch -c 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr:Or undo this operation with: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: git switch - 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:31:02.654 INFO:tasks.workunit.client.0.smithi181.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:31:02.658 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:31:02.756 INFO:tasks.workunit.client.0.smithi181.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:31:02.758 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:31:02.758 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:31:03.382 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:31:03.447 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:31:03.487 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:31:03.489 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:31:03.489 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:31:03.527 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:31:03.530 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:31:03.530 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:31:03.546 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-12T02:31:03.547 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-12T02:31:03.547 DEBUG:teuthology.orchestra.run.smithi181:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-12T02:31:05.659 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:31:05.659 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:31:05.707 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-12T02:31:05.707 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:31:05.994 DEBUG:teuthology.parallel:result is None 2024-09-12T02:31:05.995 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:31:06.026 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:31:06.027 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:31:06.027 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:31:06.083 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:31:06.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.221+0000 7fedc6cd0640 1 Processor -- start 2024-09-12T02:31:06.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.221+0000 7fedc6cd0640 1 -- start start 2024-09-12T02:31:06.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedc6cd0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fedc00d0510 0x7fedc015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedc6cd0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc00b2820 con 0x7fedc00d08f0 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedc6cd0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc00b2b00 con 0x7fedc00b3800 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedc6cd0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fedc0141730 con 0x7fedc00d0510 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb7fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fedc00d08f0 0x7fedc00b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36862/0 (socket says 172.21.15.181:36862) 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb7fff640 1 -- 172.21.15.181:0/3264070798 learned_addr learned my addr 172.21.15.181:0/3264070798 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedc4a6c640 1 --2- 172.21.15.181:0/3264070798 >> v2:172.21.15.204:3300/0 conn(0x7fedc00d0510 0x7fedc015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963637993 0 0) 0x7fedc00b2820 con 0x7fedc00d08f0 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda8004630 con 0x7fedc00d08f0 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851017827 0 0) 0x7fedc00b2b00 con 0x7fedc00b3800 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc00b2820 con 0x7fedc00b3800 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 583304439 0 0) 0x7feda8004630 con 0x7fedc00d08f0 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 >> v2:172.21.15.204:3300/0 conn(0x7fedc00d0510 msgr2=0x7fedc015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:06.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 --2- 172.21.15.181:0/3264070798 >> v2:172.21.15.204:3300/0 conn(0x7fedc00d0510 0x7fedc015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 >> v1:172.21.15.204:6789/0 conn(0x7fedc00b3800 legacy=0x7fedc0072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc0144320 con 0x7fedc00d08f0 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.222+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fedb0001670 con 0x7fedc00d08f0 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 >> v1:172.21.15.181:6789/0 conn(0x7fedc00d08f0 legacy=0x7fedc00b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb77fe640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feda8004c50 0x7feda8005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb77fe640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7feda8005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb77fe640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feda80062d0 0x7feda800cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0141730 con 0x7feda8005910 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7feda800d150 con 0x7feda80062d0 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7feda800d350 con 0x7feda8004c50 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb7fff640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7feda8005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedc4a6c640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feda8004c50 0x7feda8005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedc526d640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feda80062d0 0x7feda800cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb7fff640 1 -- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feda8004c50 msgr2=0x7feda8005050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb7fff640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feda8004c50 0x7feda8005050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb7fff640 1 -- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feda80062d0 msgr2=0x7feda800cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb7fff640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feda80062d0 0x7feda800cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedc526d640 1 -- 172.21.15.181:0/3264070798 reap_dead start 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.223+0000 7fedb7fff640 1 -- 172.21.15.181:0/3264070798 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda8004630 con 0x7feda8005910 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedb7fff640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7feda8005d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fedb0007fd0 tx=0x7feda8006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2703a55224a9fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0007ce0 con 0x7feda8005910 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb0005ad0 con 0x7feda8005910 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedb77fe640 1 -- 172.21.15.181:0/3264070798 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0007070 con 0x7feda8005910 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedc6cd0640 1 -- 172.21.15.181:0/3264070798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 msgr2=0x7feda8005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7feda8005d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fedb0007fd0 tx=0x7feda8006940 comp rx=0 tx=0).stop 2024-09-12T02:31:06.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedc6cd0640 1 -- 172.21.15.181:0/3264070798 shutdown_connections 2024-09-12T02:31:06.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/3264070798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7feda8005d90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedc6cd0640 1 -- 172.21.15.181:0/3264070798 >> 172.21.15.181:0/3264070798 conn(0x7fedc006bc10 msgr2=0x7fedc006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:06.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedc6cd0640 1 -- 172.21.15.181:0/3264070798 shutdown_connections 2024-09-12T02:31:06.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.224+0000 7fedc6cd0640 1 -- 172.21.15.181:0/3264070798 wait complete. 2024-09-12T02:31:06.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 Processor -- start 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 -- start start 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7fedc0070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedc00b0910 0x7fedc015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedc00b0d70 0x7fedc0071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fedc015ef90 con 0x7feda8005910 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0143dc0 con 0x7fedc00b0d70 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.226+0000 7fedc6cd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fedc015f110 con 0x7fedc00b0910 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7fedc0070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7fedc0070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40912/0 (socket says 172.21.15.181:40912) 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 -- 172.21.15.181:0/1553432230 learned_addr learned my addr 172.21.15.181:0/1553432230 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:31:06.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc526d640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedc00b0d70 0x7fedc0071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedb7fff640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedc00b0910 0x7fedc015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 -- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedc00b0910 msgr2=0x7fedc015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedc00b0910 0x7fedc015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 -- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedc00b0d70 msgr2=0x7fedc0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedc00b0d70 0x7fedc0071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 -- 172.21.15.181:0/1553432230 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc01efef0 con 0x7feda8005910 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc526d640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedc00b0d70 0x7fedc0071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc4a6c640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7fedc0070e50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fedbc011960 tx=0x7fedbc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedb57fa640 1 -- 172.21.15.181:0/1553432230 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc00faf0 con 0x7feda8005910 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedb57fa640 1 -- 172.21.15.181:0/1553432230 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedbc00fc90 con 0x7feda8005910 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc01f3770 con 0x7feda8005910 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedb57fa640 1 -- 172.21.15.181:0/1553432230 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc014440 con 0x7feda8005910 2024-09-12T02:31:06.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.227+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01f3fd0 con 0x7feda8005910 2024-09-12T02:31:06.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.228+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc00b30f0 con 0x7feda8005910 2024-09-12T02:31:06.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.229+0000 7fedb57fa640 1 -- 172.21.15.181:0/1553432230 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedbc012040 con 0x7feda8005910 2024-09-12T02:31:06.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.229+0000 7fedb57fa640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedac06bdd0 0x7fedac06e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.229+0000 7fedb7fff640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedac06bdd0 0x7fedac06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.229+0000 7fedb57fa640 1 -- 172.21.15.181:0/1553432230 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fedbc08b440 con 0x7feda8005910 2024-09-12T02:31:06.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.230+0000 7fedb7fff640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedac06bdd0 0x7fedac06e290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fedb0032000 tx=0x7fedb0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:06.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.234+0000 7fedb57fa640 1 -- 172.21.15.181:0/1553432230 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedbc019030 con 0x7feda8005910 2024-09-12T02:31:06.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.413+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fedc0073bc0 con 0x7feda8005910 2024-09-12T02:31:06.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.413+0000 7fedb57fa640 1 -- 172.21.15.181:0/1553432230 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7fedbc059e40 con 0x7feda8005910 2024-09-12T02:31:06.414 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:31:06.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedac06bdd0 msgr2=0x7fedac06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedac06bdd0 0x7fedac06e290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fedb0032000 tx=0x7fedb0009030 comp rx=0 tx=0).stop 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 msgr2=0x7fedc0070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7fedc0070e50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fedbc011960 tx=0x7fedbc011e20 comp rx=0 tx=0).stop 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 shutdown_connections 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedac06bdd0 0x7fedac06e290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedc00b0d70 0x7fedc0071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedc00b0910 0x7fedc015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 --2- 172.21.15.181:0/1553432230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feda8005910 0x7fedc0070e50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.415+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 >> 172.21.15.181:0/1553432230 conn(0x7fedc006bc10 msgr2=0x7fedc0140fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.416+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 shutdown_connections 2024-09-12T02:31:06.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.416+0000 7fedc6cd0640 1 -- 172.21.15.181:0/1553432230 wait complete. 2024-09-12T02:31:06.427 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:31:06.427 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:31:06.443 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:31:06.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.582+0000 7fdc3256d640 1 Processor -- start 2024-09-12T02:31:06.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.583+0000 7fdc3256d640 1 -- start start 2024-09-12T02:31:06.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.583+0000 7fdc3256d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc2c15c4a0 0x7fdc2c0cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.583+0000 7fdc3256d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdc2c0d2da0 0x7fdc2c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.583+0000 7fdc3256d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2c0d0a30 con 0x7fdc2c0b4090 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.583+0000 7fdc3256d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2c0d0d30 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.583+0000 7fdc3256d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2c0b76f0 con 0x7fdc2c0d2da0 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc2c15c4a0 0x7fdc2c0cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc2c15c4a0 0x7fdc2c0cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40914/0 (socket says 172.21.15.181:40914) 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2bfff640 1 -- 172.21.15.181:0/3996293570 learned_addr learned my addr 172.21.15.181:0/3996293570 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2b7fe640 1 --2- 172.21.15.181:0/3996293570 >> v2:172.21.15.204:3300/0 conn(0x7fdc2c0d2da0 0x7fdc2c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2bfff640 1 -- 172.21.15.181:0/3996293570 >> v2:172.21.15.204:3300/0 conn(0x7fdc2c0d2da0 msgr2=0x7fdc2c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2bfff640 1 --2- 172.21.15.181:0/3996293570 >> v2:172.21.15.204:3300/0 conn(0x7fdc2c0d2da0 0x7fdc2c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2bfff640 1 -- 172.21.15.181:0/3996293570 >> v1:172.21.15.204:6789/0 conn(0x7fdc2c0b4090 legacy=0x7fdc2c165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.584+0000 7fdc2bfff640 1 -- 172.21.15.181:0/3996293570 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c073710 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc2bfff640 1 --2- 172.21.15.181:0/3996293570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c0cff80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c068610 tx=0x7fdc1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e6a05ff6bc396a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc2affd640 1 -- 172.21.15.181:0/3996293570 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c037070 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc2affd640 1 -- 172.21.15.181:0/3996293570 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c032440 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc2affd640 1 -- 172.21.15.181:0/3996293570 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c032810 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 -- 172.21.15.181:0/3996293570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 msgr2=0x7fdc2c0cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 --2- 172.21.15.181:0/3996293570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c0cff80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c068610 tx=0x7fdc1c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 -- 172.21.15.181:0/3996293570 shutdown_connections 2024-09-12T02:31:06.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 --2- 172.21.15.181:0/3996293570 >> v2:172.21.15.204:3300/0 conn(0x7fdc2c0d2da0 0x7fdc2c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 --2- 172.21.15.181:0/3996293570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c0cff80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 -- 172.21.15.181:0/3996293570 >> 172.21.15.181:0/3996293570 conn(0x7fdc2c067950 msgr2=0x7fdc2c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 -- 172.21.15.181:0/3996293570 shutdown_connections 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.585+0000 7fdc3256d640 1 -- 172.21.15.181:0/3996293570 wait complete. 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.587+0000 7fdc3256d640 1 Processor -- start 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.587+0000 7fdc3256d640 1 -- start start 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.587+0000 7fdc3256d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c0b4090 0x7fdc2c140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.587+0000 7fdc3256d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0d2da0 0x7fdc2c140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc3256d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c1e6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc3256d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c0b4520 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc3256d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c0d28e0 con 0x7fdc2c0d2da0 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc3256d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdc2c0b46a0 con 0x7fdc2c0b4090 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c1e6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c1e6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40924/0 (socket says 172.21.15.181:40924) 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 -- 172.21.15.181:0/1075775481 learned_addr learned my addr 172.21.15.181:0/1075775481 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc2b7fe640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0d2da0 0x7fdc2c140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc2bfff640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c0b4090 0x7fdc2c140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 -- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c0b4090 msgr2=0x7fdc2c140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c0b4090 0x7fdc2c140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 -- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0d2da0 msgr2=0x7fdc2c140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0d2da0 0x7fdc2c140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 -- 172.21.15.181:0/1075775481 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c1e2cd0 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc30b0a640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c1e6860 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c7a0 tx=0x7fdc2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc28ff9640 1 -- 172.21.15.181:0/1075775481 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24003b70 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc28ff9640 1 -- 172.21.15.181:0/1075775481 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc24003d30 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc28ff9640 1 -- 172.21.15.181:0/1075775481 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400aa90 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2c1e4050 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.588+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2c1e6da0 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.589+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2c0cff80 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.590+0000 7fdc28ff9640 1 -- 172.21.15.181:0/1075775481 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc2400ac30 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.590+0000 7fdc28ff9640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc1806be30 0x7fdc1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.590+0000 7fdc28ff9640 1 -- 172.21.15.181:0/1075775481 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fdc2408acd0 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.590+0000 7fdc2bfff640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc1806be30 0x7fdc1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.591+0000 7fdc2bfff640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc1806be30 0x7fdc1806e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c034000 tx=0x7fdc1c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.595+0000 7fdc28ff9640 1 -- 172.21.15.181:0/1075775481 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc24058ff0 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.774+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdc2c0b3000 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.774+0000 7fdc28ff9640 1 -- 172.21.15.181:0/1075775481 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7fdc2405d2f0 con 0x7fdc2c15c4a0 2024-09-12T02:31:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:31:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc1806be30 msgr2=0x7fdc1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc1806be30 0x7fdc1806e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c034000 tx=0x7fdc1c02e000 comp rx=0 tx=0).stop 2024-09-12T02:31:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 msgr2=0x7fdc2c1e6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c1e6860 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c7a0 tx=0x7fdc2400cc60 comp rx=0 tx=0).stop 2024-09-12T02:31:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 shutdown_connections 2024-09-12T02:31:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc1806be30 0x7fdc1806e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0d2da0 0x7fdc2c140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c15c4a0 0x7fdc2c1e6860 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 --2- 172.21.15.181:0/1075775481 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c0b4090 0x7fdc2c140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 >> 172.21.15.181:0/1075775481 conn(0x7fdc2c067950 msgr2=0x7fdc2c15b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 shutdown_connections 2024-09-12T02:31:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:06.776+0000 7fdc3256d640 1 -- 172.21.15.181:0/1075775481 wait complete. 2024-09-12T02:31:06.787 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:31:06.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:06.787 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:31:06.811 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[52988]: fuse finished with error 0 and tester_r 0 2024-09-12T02:31:06.812 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:31:06.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:31:06.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:06.876 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:31:06.891 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:31:06.891 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:31:06.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:31:06.908 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi204.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2024-09-12T02:31:06.909 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:31:06.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:06.909 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:31:06.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:31:06.965 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-12T02:31:06.965 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:31:06.965 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:31:06.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:31:06.981 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi181.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2024-09-12T02:31:06.981 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:31:06.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:06.981 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:31:07.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:31:07.036 INFO:teuthology.orchestra.run.smithi181.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T02:31:07.036 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:31:07.036 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:31:07.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:31:07.053 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi204.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2024-09-12T02:31:07.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:31:07.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:07.053 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:31:07.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:31:07.110 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T02:31:07.110 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:31:07.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.208+0000 7fbcfef2c640 1 Processor -- start 2024-09-12T02:31:07.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.208+0000 7fbcfef2c640 1 -- start start 2024-09-12T02:31:07.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbcfef2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf815b1e0 0x7fbcf80b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbcfef2c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbcf80b41d0 0x7fbcf80b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbcfef2c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf80ce480 con 0x7fbcf80cdfc0 2024-09-12T02:31:07.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbcfef2c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf80ce760 con 0x7fbcf80b41d0 2024-09-12T02:31:07.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbcfef2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf80cea40 con 0x7fbcf815b1e0 2024-09-12T02:31:07.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbceffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbcf80b41d0 0x7fbcf80b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbceffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbcf80b41d0 0x7fbcf80b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40932/0 (socket says 172.21.15.181:40932) 2024-09-12T02:31:07.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbceffff640 1 -- 172.21.15.181:0/3120094707 learned_addr learned my addr 172.21.15.181:0/3120094707 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:31:07.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbceffff640 1 -- 172.21.15.181:0/3120094707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf815b1e0 msgr2=0x7fbcf80b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:07.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbceffff640 1 --2- 172.21.15.181:0/3120094707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf815b1e0 0x7fbcf80b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbceffff640 1 -- 172.21.15.181:0/3120094707 >> v1:172.21.15.204:6789/0 conn(0x7fbcf80cdfc0 legacy=0x7fbcf80ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:07.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.209+0000 7fbceffff640 1 -- 172.21.15.181:0/3120094707 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf80ced20 con 0x7fbcf80b41d0 2024-09-12T02:31:07.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.210+0000 7fbceffff640 1 --2- 172.21.15.181:0/3120094707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf80b41d0 0x7fbcf80b1d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009870 tx=0x7fbce802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02297f8fdc6c8c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:07.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.210+0000 7fbcef7fe640 1 -- 172.21.15.181:0/3120094707 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8037070 con 0x7fbcf80b41d0 2024-09-12T02:31:07.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.210+0000 7fbcef7fe640 1 -- 172.21.15.181:0/3120094707 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce8032440 con 0x7fbcf80b41d0 2024-09-12T02:31:07.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.210+0000 7fbcef7fe640 1 -- 172.21.15.181:0/3120094707 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8032810 con 0x7fbcf80b41d0 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.210+0000 7fbcfef2c640 1 -- 172.21.15.181:0/3120094707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf80b41d0 msgr2=0x7fbcf80b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.210+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/3120094707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf80b41d0 0x7fbcf80b1d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009870 tx=0x7fbce802a210 comp rx=0 tx=0).stop 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.211+0000 7fbcfef2c640 1 -- 172.21.15.181:0/3120094707 shutdown_connections 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.211+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/3120094707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf80b41d0 0x7fbcf80b1d80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.211+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/3120094707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf815b1e0 0x7fbcf80b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.211+0000 7fbcfef2c640 1 -- 172.21.15.181:0/3120094707 >> 172.21.15.181:0/3120094707 conn(0x7fbcf806bc10 msgr2=0x7fbcf806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.211+0000 7fbcfef2c640 1 -- 172.21.15.181:0/3120094707 shutdown_connections 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.211+0000 7fbcfef2c640 1 -- 172.21.15.181:0/3120094707 wait complete. 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.212+0000 7fbcfef2c640 1 Processor -- start 2024-09-12T02:31:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.212+0000 7fbcfef2c640 1 -- start start 2024-09-12T02:31:07.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf80b41d0 0x7fbcf814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcf80cdfc0 0x7fbcf81f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf815b1e0 0x7fbcf815b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf80726d0 con 0x7fbcf815b1e0 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8071130 con 0x7fbcf80cdfc0 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf8072850 con 0x7fbcf80b41d0 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf815b1e0 0x7fbcf815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf815b1e0 0x7fbcf815b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40936/0 (socket says 172.21.15.181:40936) 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 -- 172.21.15.181:0/1778376017 learned_addr learned my addr 172.21.15.181:0/1778376017 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfccc8640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf80b41d0 0x7fbcf814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbceffff640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcf80cdfc0 0x7fbcf81f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 -- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf80b41d0 msgr2=0x7fbcf814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf80b41d0 0x7fbcf814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 -- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcf80cdfc0 msgr2=0x7fbcf81f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcf80cdfc0 0x7fbcf81f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 -- 172.21.15.181:0/1778376017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf8151380 con 0x7fbcf815b1e0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfd4c9640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf815b1e0 0x7fbcf815b820 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00048f0 tx=0x7fbcf000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbced7fa640 1 -- 172.21.15.181:0/1778376017 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000a9d0 con 0x7fbcf815b1e0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbced7fa640 1 -- 172.21.15.181:0/1778376017 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf000ab70 con 0x7fbcf815b1e0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf8155620 con 0x7fbcf815b1e0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbced7fa640 1 -- 172.21.15.181:0/1778376017 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000ce30 con 0x7fbcf815b1e0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.213+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf815bd60 con 0x7fbcf815b1e0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.214+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf8069b20 con 0x7fbcf815b1e0 2024-09-12T02:31:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.215+0000 7fbced7fa640 1 -- 172.21.15.181:0/1778376017 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcf001a400 con 0x7fbcf815b1e0 2024-09-12T02:31:07.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.215+0000 7fbced7fa640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbce406be30 0x7fbce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.215+0000 7fbced7fa640 1 -- 172.21.15.181:0/1778376017 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbcf008cfc0 con 0x7fbcf815b1e0 2024-09-12T02:31:07.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.215+0000 7fbcfccc8640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbce406be30 0x7fbce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.216+0000 7fbcfccc8640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbce406be30 0x7fbce406e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbcf814e420 tx=0x7fbcf4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.220+0000 7fbced7fa640 1 -- 172.21.15.181:0/1778376017 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcf8069b20 con 0x7fbcf815b1e0 2024-09-12T02:31:07.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.418+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbcf8155410 con 0x7fbcf815b1e0 2024-09-12T02:31:07.419 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:31:07.419+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:31:07.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.420+0000 7fbced7fa640 1 -- 172.21.15.181:0/1778376017 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7fbcf0016030 con 0x7fbcf815b1e0 2024-09-12T02:31:07.421 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:31:07.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbce406be30 msgr2=0x7fbce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbce406be30 0x7fbce406e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbcf814e420 tx=0x7fbcf4009060 comp rx=0 tx=0).stop 2024-09-12T02:31:07.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf815b1e0 msgr2=0x7fbcf815b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf815b1e0 0x7fbcf815b820 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00048f0 tx=0x7fbcf000cbe0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 shutdown_connections 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbce406be30 0x7fbce406e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbcf80cdfc0 0x7fbcf81f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcf815b1e0 0x7fbcf815b820 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 --2- 172.21.15.181:0/1778376017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbcf80b41d0 0x7fbcf814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.422+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 >> 172.21.15.181:0/1778376017 conn(0x7fbcf806bc10 msgr2=0x7fbcf806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.423+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 shutdown_connections 2024-09-12T02:31:07.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:31:07.423+0000 7fbcfef2c640 1 -- 172.21.15.181:0/1778376017 wait complete. 2024-09-12T02:31:07.427 INFO:tasks.ceph.mds.a.smithi181.stderr: -9235> 2024-09-12T02:29:53.864+0000 7f6d3e155640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:31:07.436 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:31:07.436 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:31:07.436 DEBUG:teuthology.orchestra.run.smithi181:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:31:07.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:31:07.451 INFO:teuthology.orchestra.run.smithi181.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:31:07.451 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:31:07.461 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:31:07.476 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:31:07.476 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T02:31:07.531 INFO:tasks.workunit:timeout=1h 2024-09-12T02:31:07.531 INFO:tasks.workunit:cleanup=True 2024-09-12T02:31:07.532 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:31:07.587 INFO:tasks.workunit.client.0.smithi181.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:31:16.378 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:16.382 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:46.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:46.513 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:03.585 INFO:tasks.workunit.client.0.smithi181.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:32:03.585 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:32:03.585 INFO:tasks.workunit.client.0.smithi181.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:32:03.585 INFO:tasks.workunit.client.0.smithi181.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:32:03.585 INFO:tasks.workunit.client.0.smithi181.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:32:03.585 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:32:03.585 INFO:tasks.workunit.client.0.smithi181.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr: git switch -c 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr:Or undo this operation with: 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr: git switch - 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:32:03.586 INFO:tasks.workunit.client.0.smithi181.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:32:03.590 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:32:03.605 INFO:tasks.workunit.client.0.smithi181.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:32:03.608 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:32:03.608 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:32:03.656 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:32:03.705 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:32:03.745 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:32:03.746 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:32:03.746 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:32:03.786 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:32:03.789 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:32:03.789 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:32:03.860 INFO:tasks.workunit:Running workunits matching suites/cephfs_journal_tool_smoke.sh on client.0... 2024-09-12T02:32:03.861 INFO:tasks.workunit:Running workunit suites/cephfs_journal_tool_smoke.sh... 2024-09-12T02:32:03.862 DEBUG:teuthology.orchestra.run.smithi181:workunit test suites/cephfs_journal_tool_smoke.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/cephfs_journal_tool_smoke.sh 2024-09-12T02:32:03.920 INFO:tasks.workunit.client.0.smithi181.stderr:+ export 'BIN=cephfs-journal-tool --rank=cephfs:0' 2024-09-12T02:32:03.920 INFO:tasks.workunit.client.0.smithi181.stderr:+ BIN='cephfs-journal-tool --rank=cephfs:0' 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ export JOURNAL_FILE=/tmp/journal.bin 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ JOURNAL_FILE=/tmp/journal.bin 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ export JSON_OUTPUT=/tmp/json.tmp 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ JSON_OUTPUT=/tmp/json.tmp 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ export BINARY_OUTPUT=/tmp/binary.tmp 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ BINARY_OUTPUT=/tmp/binary.tmp 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' -d /tmp/binary.tmp ']' 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'Testing that export/import cycle preserves state' 2024-09-12T02:32:03.921 INFO:tasks.workunit.client.0.smithi181.stdout:Testing that export/import cycle preserves state 2024-09-12T02:32:03.922 INFO:tasks.workunit.client.0.smithi181.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-12T02:32:03.948 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.947+0000 7fda9951e280 1 -- start start 2024-09-12T02:32:03.948 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.947+0000 7fda9951e280 1 Processor -- start 2024-09-12T02:32:03.952 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda9951e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b0f274c00 0x562b0f2f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.952 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda9951e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b0f275800 0x562b0f2f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda9951e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b0f275c00 0x562b0f2f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda9951e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562b1005e180 con 0x562b0f274c00 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda9951e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562b1005e300 con 0x562b0f275c00 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda9951e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562b1005e480 con 0x562b0f275800 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b0f274c00 0x562b0f2f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b0f274c00 0x562b0f2f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43492/0 (socket says 172.21.15.181:43492) 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 -- 172.21.15.181:0/3171783553 learned_addr learned my addr 172.21.15.181:0/3171783553 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda979ea640 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b0f275c00 0x562b0f2f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda969e8640 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b0f275800 0x562b0f2f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 -- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b0f275800 msgr2=0x562b0f2f0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b0f275800 0x562b0f2f0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 -- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b0f275c00 msgr2=0x562b0f2f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b0f275c00 0x562b0f2f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda971e9640 1 -- 172.21.15.181:0/3171783553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0f2ac780 con 0x562b0f274c00 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda969e8640 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b0f275800 0x562b0f2f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.948+0000 7fda979ea640 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b0f275c00 0x562b0f2f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda971e9640 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b0f274c00 0x562b0f2f0580 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x562b1009b800 tx=0x562b10015f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf554428f089804d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda949e4640 1 -- 172.21.15.181:0/3171783553 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b0f29a680 con 0x562b0f274c00 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda949e4640 1 -- 172.21.15.181:0/3171783553 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562b0f2a0fc0 con 0x562b0f274c00 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda949e4640 1 -- 172.21.15.181:0/3171783553 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b0f29ab60 con 0x562b0f274c00 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda9951e280 1 -- 172.21.15.181:0/3171783553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b0f2ac3c0 con 0x562b0f274c00 2024-09-12T02:32:03.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda9951e280 1 -- 172.21.15.181:0/3171783553 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562b0f2ad680 con 0x562b0f274c00 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda949e4640 1 -- 172.21.15.181:0/3171783553 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x562b10154600 con 0x562b0f274c00 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.949+0000 7fda949e4640 1 -- 172.21.15.181:0/3171783553 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x562b0f2cf180 con 0x562b0f274c00 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 Processor -- start 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 -- start start 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159400 0x562b0f2f1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159800 0x562b0f2f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159c00 0x562b0f2f2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562b1005e600 con 0x562b10159800 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562b1005e780 con 0x562b10159c00 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda9951e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562b1005e900 con 0x562b10159400 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda971e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159800 0x562b0f2f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda971e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159800 0x562b0f2f1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43508/0 (socket says 172.21.15.181:43508) 2024-09-12T02:32:03.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda971e9640 1 -- 172.21.15.181:0/2117980669 learned_addr learned my addr 172.21.15.181:0/2117980669 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda969e8640 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159c00 0x562b0f2f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.950+0000 7fda979ea640 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159400 0x562b0f2f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda971e9640 1 -- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159400 msgr2=0x562b0f2f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda971e9640 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159400 0x562b0f2f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda971e9640 1 -- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159c00 msgr2=0x562b0f2f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda971e9640 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159c00 0x562b0f2f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda971e9640 1 -- 172.21.15.181:0/2117980669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0f2ad4a0 con 0x562b10159800 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda971e9640 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159800 0x562b0f2f1b80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x562b10170690 tx=0x562b10014b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e7b1938cda7a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda929e0640 1 -- 172.21.15.181:0/2117980669 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b0f29a820 con 0x562b10159800 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda929e0640 1 -- 172.21.15.181:0/2117980669 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562b0f2a0e00 con 0x562b10159800 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda929e0640 1 -- 172.21.15.181:0/2117980669 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b0f29a680 con 0x562b10159800 2024-09-12T02:32:03.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 -- 172.21.15.181:0/2117980669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159800 msgr2=0x562b0f2f1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159800 0x562b0f2f1b80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x562b10170690 tx=0x562b10014b40 comp rx=0 tx=0).stop 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 -- 172.21.15.181:0/2117980669 shutdown_connections 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159c00 0x562b0f2f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159800 0x562b0f2f1b80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 --2- 172.21.15.181:0/2117980669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159400 0x562b0f2f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 -- 172.21.15.181:0/2117980669 >> 172.21.15.181:0/2117980669 conn(0x562b10159000 msgr2=0x562b10001000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 -- 172.21.15.181:0/2117980669 shutdown_connections 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.951+0000 7fda9951e280 1 -- 172.21.15.181:0/2117980669 wait complete. 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 Processor -- start 2024-09-12T02:32:03.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 -- start start 2024-09-12T02:32:03.961 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159400 0x562b0f2f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.961 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159800 0x562b0f2f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159c00 0x562b0f2f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562b1005fc80 con 0x562b10159400 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562b1005ea80 con 0x562b10159800 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda9951e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562b1005fb00 con 0x562b10159c00 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda979ea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159400 0x562b0f2f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda979ea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159400 0x562b0f2f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43512/0 (socket says 172.21.15.181:43512) 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.952+0000 7fda979ea640 1 -- 172.21.15.181:0/1150581063 learned_addr learned my addr 172.21.15.181:0/1150581063 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda969e8640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159c00 0x562b0f2f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda971e9640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159800 0x562b0f2f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda979ea640 1 -- 172.21.15.181:0/1150581063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159c00 msgr2=0x562b0f2f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda979ea640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b10159c00 0x562b0f2f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda979ea640 1 -- 172.21.15.181:0/1150581063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159800 msgr2=0x562b0f2f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda979ea640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b10159800 0x562b0f2f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda979ea640 1 -- 172.21.15.181:0/1150581063 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0f2ac780 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda979ea640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159400 0x562b0f2f3180 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x562b10171980 tx=0x562b10174f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda911dd640 1 -- 172.21.15.181:0/1150581063 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b0f29a820 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda911dd640 1 -- 172.21.15.181:0/1150581063 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562b0f2a0a80 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda911dd640 1 -- 172.21.15.181:0/1150581063 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562b0f29a680 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b0f2ac3c0 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.953+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b0f2ac000 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.954+0000 7fda911dd640 1 -- 172.21.15.181:0/1150581063 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562b10152c00 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda911dd640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562b0f608000 0x562b0f2f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda911dd640 1 -- 172.21.15.181:0/1150581063 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x562b101d8a00 con 0x562b10159400 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda971e9640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562b0f608000 0x562b0f2f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda9951e280 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x562b0f608400 0x562b0f2f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x562b0f608800 con 0x562b0f608400 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda969e8640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x562b0f608400 0x562b0f2f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda971e9640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562b0f608000 0x562b0f2f3700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x562b10170690 tx=0x562b10174cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.955+0000 7fda969e8640 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x562b0f608400 0x562b0f2f2100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda969e8640 1 -- 172.21.15.181:0/1150581063 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x562b1000c000 con 0x562b0f608400 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x562b0f608c00 con 0x562b0f608400 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda969e8640 1 -- 172.21.15.181:0/1150581063 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x562b1000c000 con 0x562b0f608400 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x562b0f608400 msgr2=0x562b0f2f2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x562b0f608400 0x562b0f2f2100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562b0f608000 msgr2=0x562b0f2f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562b0f608000 0x562b0f2f3700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x562b10170690 tx=0x562b10174cc0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159400 msgr2=0x562b0f2f3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 --2- 172.21.15.181:0/1150581063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b10159400 0x562b0f2f3180 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x562b10171980 tx=0x562b10174f00 comp rx=0 tx=0).stop 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda969e8640 1 -- 172.21.15.181:0/1150581063 reap_dead start 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 shutdown_connections 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 >> 172.21.15.181:0/1150581063 conn(0x562b10159000 msgr2=0x562b10001000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 shutdown_connections 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.956+0000 7fda9951e280 1 -- 172.21.15.181:0/1150581063 wait complete. 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 -- 172.21.15.181:0/3171783553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b0f274c00 msgr2=0x562b0f2f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b0f274c00 0x562b0f2f0580 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x562b1009b800 tx=0x562b10015f80 comp rx=0 tx=0).stop 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 -- 172.21.15.181:0/3171783553 shutdown_connections 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562b0f275c00 0x562b0f2f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562b0f275800 0x562b0f2f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 --2- 172.21.15.181:0/3171783553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b0f274c00 0x562b0f2f0580 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 -- 172.21.15.181:0/3171783553 >> 172.21.15.181:0/3171783553 conn(0x562b0f275000 msgr2=0x562b10000800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:03.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 -- 172.21.15.181:0/3171783553 shutdown_connections 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.957+0000 7fda9951e280 1 -- 172.21.15.181:0/3171783553 wait complete. 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr:+ HEADER_STATE='{ 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "magic": "ceph fs volume v011", 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "write_pos": 4200187, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "expire_pos": 4194304, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "trimmed_pos": 4194304, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "stream_format": 1, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "layout": { 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_unit": 4194304, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_count": 1, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "object_size": 4194304, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_id": 6, 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_ns": "" 2024-09-12T02:32:03.966 INFO:tasks.workunit.client.0.smithi181.stderr: } 2024-09-12T02:32:03.967 INFO:tasks.workunit.client.0.smithi181.stderr:}' 2024-09-12T02:32:03.967 INFO:tasks.workunit.client.0.smithi181.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2024-09-12T02:32:03.988 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 -- start start 2024-09-12T02:32:03.989 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 Processor -- start 2024-09-12T02:32:03.995 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a03d6000 0x55989f683080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.995 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55989f607c00 0x55989f682b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.995 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a03d6800 0x55989f683b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.995 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5598a04d2000 con 0x5598a03d6800 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5598a04d2180 con 0x5598a03d6000 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.988+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5598a04d2300 con 0x55989f607c00 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a03d6800 0x55989f683b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a03d6800 0x55989f683b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43520/0 (socket says 172.21.15.181:43520) 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 -- 172.21.15.181:0/1625450685 learned_addr learned my addr 172.21.15.181:0/1625450685 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f79342640 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55989f607c00 0x55989f682b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f79b43640 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a03d6000 0x55989f683080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 -- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55989f607c00 msgr2=0x55989f682b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55989f607c00 0x55989f682b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 -- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a03d6000 msgr2=0x55989f683080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a03d6000 0x55989f683080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 -- 172.21.15.181:0/1625450685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989f63e780 con 0x5598a03d6800 2024-09-12T02:32:03.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7a344640 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a03d6800 0x55989f683b80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5598a042d980 tx=0x5598a03a6660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671e65045c7bf12c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7733e640 1 -- 172.21.15.181:0/1625450685 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55989f62c9c0 con 0x5598a03d6800 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7733e640 1 -- 172.21.15.181:0/1625450685 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55989f632a80 con 0x5598a03d6800 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7733e640 1 -- 172.21.15.181:0/1625450685 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55989f62cb60 con 0x5598a03d6800 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1625450685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989f63f860 con 0x5598a03d6800 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1625450685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55989f63fa40 con 0x5598a03d6800 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7733e640 1 -- 172.21.15.181:0/1625450685 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5598a04f2600 con 0x5598a03d6800 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.989+0000 7f0f7733e640 1 -- 172.21.15.181:0/1625450685 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55989f661180 con 0x5598a03d6800 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.990+0000 7f0f7c00c280 1 Processor -- start 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.990+0000 7f0f7c00c280 1 -- start start 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04eec00 0x55989f683600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04ef000 0x55989f682580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:03.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5598a04d2480 con 0x5598a04ef400 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5598a04d2600 con 0x5598a04eec00 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5598a04d2780 con 0x5598a04ef000 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43524/0 (socket says 172.21.15.181:43524) 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 -- 172.21.15.181:0/4279449488 learned_addr learned my addr 172.21.15.181:0/4279449488 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79b43640 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04ef000 0x55989f682580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04eec00 0x55989f683600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 -- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04ef000 msgr2=0x55989f682580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04ef000 0x55989f682580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 -- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04eec00 msgr2=0x55989f683600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04eec00 0x55989f683600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 -- 172.21.15.181:0/4279449488 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989f63fc20 con 0x5598a04ef400 2024-09-12T02:32:03.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79b43640 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04ef000 0x55989f682580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f79342640 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684100 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5598a042d440 tx=0x5598a03a6540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c348f092c63a43e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7533a640 1 -- 172.21.15.181:0/4279449488 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55989f62c680 con 0x5598a04ef400 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7533a640 1 -- 172.21.15.181:0/4279449488 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55989f632c40 con 0x5598a04ef400 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.991+0000 7f0f7533a640 1 -- 172.21.15.181:0/4279449488 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55989f62c9c0 con 0x5598a04ef400 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 -- 172.21.15.181:0/4279449488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 msgr2=0x55989f684100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684100 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5598a042d440 tx=0x5598a03a6540 comp rx=0 tx=0).stop 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 -- 172.21.15.181:0/4279449488 shutdown_connections 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684100 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04ef000 0x55989f682580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/4279449488 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04eec00 0x55989f683600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 -- 172.21.15.181:0/4279449488 >> 172.21.15.181:0/4279449488 conn(0x5598a03d6400 msgr2=0x5598a0391000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 -- 172.21.15.181:0/4279449488 shutdown_connections 2024-09-12T02:32:03.999 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 -- 172.21.15.181:0/4279449488 wait complete. 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 Processor -- start 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.992+0000 7f0f7c00c280 1 -- start start 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04eec00 0x55989f685180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04ef000 0x55989f684c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f7c00c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5598a04d3e00 con 0x5598a04ef400 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5598a04d2d80 con 0x5598a04ef000 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f7c00c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5598a04d2f00 con 0x5598a04eec00 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43540/0 (socket says 172.21.15.181:43540) 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 -- 172.21.15.181:0/1087147295 learned_addr learned my addr 172.21.15.181:0/1087147295 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04eec00 0x55989f685180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79b43640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04ef000 0x55989f684c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 -- 172.21.15.181:0/1087147295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04eec00 msgr2=0x55989f685180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5598a04eec00 0x55989f685180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 -- 172.21.15.181:0/1087147295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04ef000 msgr2=0x55989f684c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a04ef000 0x55989f684c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 -- 172.21.15.181:0/1087147295 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989f63f680 con 0x5598a04ef400 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.993+0000 7f0f79342640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5598a04da9c0 tx=0x5598a03a7bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.994+0000 7f0f73b37640 1 -- 172.21.15.181:0/1087147295 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55989f62cb60 con 0x5598a04ef400 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.994+0000 7f0f73b37640 1 -- 172.21.15.181:0/1087147295 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55989f6321c0 con 0x5598a04ef400 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.994+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55989f63e3c0 con 0x5598a04ef400 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.994+0000 7f0f73b37640 1 -- 172.21.15.181:0/1087147295 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55989f62c820 con 0x5598a04ef400 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.994+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989f63e000 con 0x5598a04ef400 2024-09-12T02:32:04.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.995+0000 7f0f73b37640 1 -- 172.21.15.181:0/1087147295 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5598a054cc00 con 0x5598a04ef400 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.995+0000 7f0f73b37640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5598a0554400 0x55989f685700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.995+0000 7f0f73b37640 1 -- 172.21.15.181:0/1087147295 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5598a0552600 con 0x5598a04ef400 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.995+0000 7f0f79b43640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5598a0554400 0x55989f685700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.995+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5598a04ef800 0x55989f684100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.995+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5598a04efc00 con 0x5598a04ef800 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.995+0000 7f0f79342640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5598a04ef800 0x55989f684100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.996+0000 7f0f79b43640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5598a0554400 0x55989f685700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5598a0396c90 tx=0x5598a04e4d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.996+0000 7f0f79342640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5598a04ef800 0x55989f684100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.996+0000 7f0f79342640 1 -- 172.21.15.181:0/1087147295 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5598a039e000 con 0x5598a04ef800 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.996+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5598a0555400 con 0x5598a04ef800 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.996+0000 7f0f79342640 1 -- 172.21.15.181:0/1087147295 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5598a039e000 con 0x5598a04ef800 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.996+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5598a0555800 con 0x5598a04ef800 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.997+0000 7f0f79342640 1 -- 172.21.15.181:0/1087147295 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv18 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x5598a039e000 con 0x5598a04ef800 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.997+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5598a0555c00 0x55989f682580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.997+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55989f9a6000 con 0x5598a0555c00 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.997+0000 7f0f7a344640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5598a0555c00 0x55989f682580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.997+0000 7f0f7a344640 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5598a0555c00 0x55989f682580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.997+0000 7f0f7a344640 1 -- 172.21.15.181:0/1087147295 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55989f9a2f00 con 0x5598a0555c00 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5598a04ef800 msgr2=0x55989f684100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5598a04ef800 0x55989f684100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5598a0555c00 msgr2=0x55989f682580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5598a0555c00 0x55989f682580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5598a0554400 msgr2=0x55989f685700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5598a0554400 0x55989f685700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5598a0396c90 tx=0x5598a04e4d80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 msgr2=0x55989f684680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1087147295 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a04ef400 0x55989f684680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5598a04da9c0 tx=0x5598a03a7bc0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f79b43640 1 -- 172.21.15.181:0/1087147295 reap_dead start 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 shutdown_connections 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f79b43640 1 -- 172.21.15.181:0/1087147295 reap_dead start 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 >> 172.21.15.181:0/1087147295 conn(0x5598a03d6400 msgr2=0x5598a0391000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 shutdown_connections 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1087147295 wait complete. 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1625450685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a03d6800 msgr2=0x55989f683b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a03d6800 0x55989f683b80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5598a042d980 tx=0x5598a03a6660 comp rx=0 tx=0).stop 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1625450685 shutdown_connections 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5598a03d6800 0x55989f683b80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.007 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55989f607c00 0x55989f682b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 --2- 172.21.15.181:0/1625450685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5598a03d6000 0x55989f683080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1625450685 >> 172.21.15.181:0/1625450685 conn(0x55989f607000 msgr2=0x5598a0392000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1625450685 shutdown_connections 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:03.998+0000 7f0f7c00c280 1 -- 172.21.15.181:0/1625450685 wait complete. 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:+ EVENT_LIST='0.000000 0x400000 LID: () 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:29:52.609822+0000 0x400030 SUBTREEMAP: () 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.612386+0000 0x4003ac SESSION: () 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.976787+0000 0x400567 UPDATE: (setattr) 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr: / 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:03.100049+0000 0x400896 UPDATE: (mkdir) 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:08.613262+0000 0x401076 UPDATE: (cap update) 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.008 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.604583+0000 0x4016fb UPDATE: (mkdir) 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.615765+0000 0x402219 UPDATE: (mkdir) 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/foo 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.616821+0000 0x402ae9 UPDATE: (openc) 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.698700+0000 0x40328b UPDATE: (unlink_local) 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000002 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp/foo 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700226+0000 0x40448e UPDATE: (unlink_local) 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700557+0000 0x405117 UPDATE: (cap update) 2024-09-12T02:32:04.009 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.705885+0000 0x4058b4 UPDATE: (unlink_local) 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000001 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.025763+0000 0x40651c UPDATE: (unlink_local) 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000000 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814328+0000 0x40707b UPDATE: (scatter_writebehind) 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814891+0000 0x4074ed SESSION: () 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr:0.000000 0x40759a PURGED: ()' 2024-09-12T02:32:04.010 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2024-09-12T02:32:04.030 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.029+0000 7fc1196cf280 1 -- start start 2024-09-12T02:32:04.030 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.029+0000 7fc1196cf280 1 Processor -- start 2024-09-12T02:32:04.032 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aace2ec00 0x563aaceaa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.032 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aace2f800 0x563aaceaab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.032 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aace2fc00 0x563aaceab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.032 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc1196cf280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563aadc18600 con 0x563aace2f800 2024-09-12T02:32:04.032 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563aadc18480 con 0x563aace2fc00 2024-09-12T02:32:04.032 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563aadc18300 con 0x563aace2ec00 2024-09-12T02:32:04.032 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aace2f800 0x563aaceaab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aace2f800 0x563aaceaab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43554/0 (socket says 172.21.15.181:43554) 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 -- 172.21.15.181:0/2933409088 learned_addr learned my addr 172.21.15.181:0/2933409088 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117e74640 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aace2ec00 0x563aaceaa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc118675640 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aace2fc00 0x563aaceab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 -- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aace2ec00 msgr2=0x563aaceaa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aace2ec00 0x563aaceaa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 -- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aace2fc00 msgr2=0x563aaceab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aace2fc00 0x563aaceab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 -- 172.21.15.181:0/2933409088 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aace66780 con 0x563aace2f800 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc117673640 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aace2f800 0x563aaceaab00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x563aadc55860 tx=0x563aadbcff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112edf17f3b61837 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc11566f640 1 -- 172.21.15.181:0/2933409088 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace54680 con 0x563aace2f800 2024-09-12T02:32:04.033 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.030+0000 7fc11566f640 1 -- 172.21.15.181:0/2933409088 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563aace5ae00 con 0x563aace2f800 2024-09-12T02:32:04.034 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.031+0000 7fc11566f640 1 -- 172.21.15.181:0/2933409088 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace54b60 con 0x563aace2f800 2024-09-12T02:32:04.034 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.031+0000 7fc1196cf280 1 -- 172.21.15.181:0/2933409088 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aace663c0 con 0x563aace2f800 2024-09-12T02:32:04.034 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.031+0000 7fc1196cf280 1 -- 172.21.15.181:0/2933409088 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563aace67680 con 0x563aace2f800 2024-09-12T02:32:04.034 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.031+0000 7fc11566f640 1 -- 172.21.15.181:0/2933409088 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x563aadd0c600 con 0x563aace2f800 2024-09-12T02:32:04.034 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.031+0000 7fc11566f640 1 -- 172.21.15.181:0/2933409088 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x563aace89180 con 0x563aace2f800 2024-09-12T02:32:04.034 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.031+0000 7fc1196cf280 1 Processor -- start 2024-09-12T02:32:04.034 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.031+0000 7fc1196cf280 1 -- start start 2024-09-12T02:32:04.043 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19400 0x563aaceab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.043 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19800 0x563aaceabb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.043 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19c00 0x563aaceac100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.043 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc1196cf280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563aadc18180 con 0x563aadd19c00 2024-09-12T02:32:04.043 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563aace90900 con 0x563aadd19400 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563aace90480 con 0x563aadd19800 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19c00 0x563aaceac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19c00 0x563aaceac100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43568/0 (socket says 172.21.15.181:43568) 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 -- 172.21.15.181:0/3723733962 learned_addr learned my addr 172.21.15.181:0/3723733962 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc118675640 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19400 0x563aaceab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117e74640 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19800 0x563aaceabb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 -- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19800 msgr2=0x563aaceabb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19800 0x563aaceabb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 -- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19400 msgr2=0x563aaceab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19400 0x563aaceab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 -- 172.21.15.181:0/3723733962 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aace674a0 con 0x563aadd19c00 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc118675640 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19400 0x563aaceab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.032+0000 7fc117673640 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19c00 0x563aaceac100 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x563aadd08750 tx=0x563aaceeb440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9edf3dfa2973cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.044 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc11366b640 1 -- 172.21.15.181:0/3723733962 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace54820 con 0x563aadd19c00 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc11366b640 1 -- 172.21.15.181:0/3723733962 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563aace5ac40 con 0x563aadd19c00 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc11366b640 1 -- 172.21.15.181:0/3723733962 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace54680 con 0x563aadd19c00 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 -- 172.21.15.181:0/3723733962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19c00 msgr2=0x563aaceac100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19c00 0x563aaceac100 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x563aadd08750 tx=0x563aaceeb440 comp rx=0 tx=0).stop 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 -- 172.21.15.181:0/3723733962 shutdown_connections 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19c00 0x563aaceac100 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19800 0x563aaceabb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3723733962 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19400 0x563aaceab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 -- 172.21.15.181:0/3723733962 >> 172.21.15.181:0/3723733962 conn(0x563aadd19000 msgr2=0x563aadbb8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 -- 172.21.15.181:0/3723733962 shutdown_connections 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 -- 172.21.15.181:0/3723733962 wait complete. 2024-09-12T02:32:04.045 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.033+0000 7fc1196cf280 1 Processor -- start 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc1196cf280 1 -- start start 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19400 0x563aacead180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19800 0x563aaceacc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19c00 0x563aaceac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc1196cf280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563aadc19800 con 0x563aadd19400 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563aadc19980 con 0x563aadd19800 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563aadc18d80 con 0x563aadd19c00 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc118675640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19400 0x563aacead180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc118675640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19400 0x563aacead180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43574/0 (socket says 172.21.15.181:43574) 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc118675640 1 -- 172.21.15.181:0/3847255154 learned_addr learned my addr 172.21.15.181:0/3847255154 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc117673640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19c00 0x563aaceac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc117e74640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19800 0x563aaceacc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc118675640 1 -- 172.21.15.181:0/3847255154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19c00 msgr2=0x563aaceac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.046 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc118675640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd19c00 0x563aaceac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc118675640 1 -- 172.21.15.181:0/3847255154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19800 msgr2=0x563aaceacc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.034+0000 7fc118675640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19800 0x563aaceacc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc118675640 1 -- 172.21.15.181:0/3847255154 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aace66780 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc117e74640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd19800 0x563aaceacc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc118675640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19400 0x563aacead180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x563aadd09bc0 tx=0x563aadd0af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc111e68640 1 -- 172.21.15.181:0/3847255154 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace54820 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc111e68640 1 -- 172.21.15.181:0/3847255154 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563aace5aa80 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aace663c0 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc111e68640 1 -- 172.21.15.181:0/3847255154 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace54680 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.035+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aace66000 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.036+0000 7fc111e68640 1 -- 172.21.15.181:0/3847255154 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x563aadd76c00 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.036+0000 7fc111e68640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563aad1c4000 0x563aacead700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.036+0000 7fc111e68640 1 -- 172.21.15.181:0/3847255154 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x563aadd8aa00 con 0x563aadd19400 2024-09-12T02:32:04.047 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.036+0000 7fc117e74640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563aad1c4000 0x563aacead700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.036+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aad1c4400 0x563aaceac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.036+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563aad1c4800 con 0x563aad1c4400 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.037+0000 7fc117673640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aad1c4400 0x563aaceac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.037+0000 7fc117e74640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563aad1c4000 0x563aacead700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x563aadbbe180 tx=0x563aadbcea20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.037+0000 7fc117673640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aad1c4400 0x563aaceac100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.037+0000 7fc117673640 1 -- 172.21.15.181:0/3847255154 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x563aadbc6000 con 0x563aad1c4400 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.037+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563aad1c4c00 con 0x563aad1c4400 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.037+0000 7fc117673640 1 -- 172.21.15.181:0/3847255154 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x563aadbc6000 con 0x563aad1c4400 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.037+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563aad1c5000 con 0x563aad1c4400 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.038+0000 7fc117673640 1 -- 172.21.15.181:0/3847255154 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv18 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x563aadbc6000 con 0x563aad1c4400 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.038+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad1c5400 0x563aaceabb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.038+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563aad1c4800 con 0x563aad1c5400 2024-09-12T02:32:04.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.038+0000 7fc118675640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad1c5400 0x563aaceabb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.038+0000 7fc118675640 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad1c5400 0x563aaceabb80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.038+0000 7fc118675640 1 -- 172.21.15.181:0/3847255154 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563aad1ccf00 con 0x563aad1c5400 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.039+0000 7fc1196cf280 1 -- start start 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.039+0000 7fc1196cf280 1 Processor -- start 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd84800 0x563aaceab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd84400 0x563aad22c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd84000 0x563aad22c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563aadc19c80 con 0x563aadd84800 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563aadc19e00 con 0x563aadd84000 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563aadc18d80 con 0x563aadd84400 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd84800 0x563aaceab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd84800 0x563aaceab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43586/0 (socket says 172.21.15.181:43586) 2024-09-12T02:32:04.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 -- 172.21.15.181:0/2442565752 learned_addr learned my addr 172.21.15.181:0/2442565752 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 -- 172.21.15.181:0/2442565752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd84400 msgr2=0x563aad22c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc118675640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd84400 0x563aad22c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117e74640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd84000 0x563aad22c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aadd84400 0x563aad22c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 -- 172.21.15.181:0/2442565752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd84000 msgr2=0x563aad22c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aadd84000 0x563aad22c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aace66960 con 0x563aadd84800 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc117673640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd84800 0x563aaceab600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x563aad169d70 tx=0x563aadd0aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71ecc7171889a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc10ee62640 1 -- 172.21.15.181:0/2442565752 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace54b60 con 0x563aadd84800 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc10ee62640 1 -- 172.21.15.181:0/2442565752 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563aace5a1c0 con 0x563aadd84800 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc10ee62640 1 -- 172.21.15.181:0/2442565752 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563aace544e0 con 0x563aadd84800 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aace67680 con 0x563aadd84800 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.040+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563aace674a0 con 0x563aadd84800 2024-09-12T02:32:04.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc10ee62640 1 -- 172.21.15.181:0/2442565752 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x563aad238200 con 0x563aadd84800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc10ee62640 1 -- 172.21.15.181:0/2442565752 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x563aace89500 con 0x563aadd84800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aadd18800 0x563aad22cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563aad250400 con 0x563aadd18800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc118675640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aadd18800 0x563aad22cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc118675640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aadd18800 0x563aad22cb00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=ae3c39182ea288d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc118675640 1 -- 172.21.15.181:0/2442565752 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x563aad1ccf00 con 0x563aadd18800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.041+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563aad250800 con 0x563aadd18800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc118675640 1 -- 172.21.15.181:0/2442565752 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x563aad1ccf00 con 0x563aadd18800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc10d65f640 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x563aad256000 con 0x563aadd18800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc10d65f640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad256400 0x563aad22e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc10d65f640 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x563aad256800 con 0x563aad256400 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc117e74640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad256400 0x563aad22e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc118675640 1 -- 172.21.15.181:0/2442565752 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv18 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x563aad1ccf00 con 0x563aadd18800 2024-09-12T02:32:04.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc117e74640 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad256400 0x563aad22e680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=53353bea4b0dad3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc117e74640 1 -- 172.21.15.181:0/2442565752 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563aad1cd180 con 0x563aad256400 2024-09-12T02:32:04.052 INFO:tasks.workunit.client.0.smithi181.stdout:journal is 4194304~30182 2024-09-12T02:32:04.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.042+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [read 0~30182] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563aad250c00 con 0x563aadd18800 2024-09-12T02:32:04.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc118675640 1 -- 172.21.15.181:0/2442565752 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(5 200.00000001 [read 0~30182 out=30182b] v0'0 uv18 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x563aad1ccf00 con 0x563aadd18800 2024-09-12T02:32:04.053 INFO:tasks.workunit.client.0.smithi181.stdout:wrote 30182 bytes at offset 4194304 to /tmp/journal.bin 2024-09-12T02:32:04.053 INFO:tasks.workunit.client.0.smithi181.stdout:NOTE: this is a _sparse_ file; you can 2024-09-12T02:32:04.053 INFO:tasks.workunit.client.0.smithi181.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2024-09-12T02:32:04.053 INFO:tasks.workunit.client.0.smithi181.stdout: to efficiently compress it while preserving sparseness. 2024-09-12T02:32:04.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aadd18800 msgr2=0x563aad22cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aadd18800 0x563aad22cb00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad256400 msgr2=0x563aad22e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad256400 0x563aad22e680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd84800 msgr2=0x563aaceab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2442565752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd84800 0x563aaceab600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x563aad169d70 tx=0x563aadd0aea0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc117e74640 1 -- 172.21.15.181:0/2442565752 reap_dead start 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 shutdown_connections 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 >> 172.21.15.181:0/2442565752 conn(0x563aadd84c00 msgr2=0x563aadbb8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 shutdown_connections 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/2442565752 wait complete. 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aad1c4400 msgr2=0x563aaceac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563aad1c4400 0x563aaceac100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad1c5400 msgr2=0x563aaceabb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563aad1c5400 0x563aaceabb80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563aad1c4000 msgr2=0x563aacead700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563aad1c4000 0x563aacead700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x563aadbbe180 tx=0x563aadbcea20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.056 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19400 msgr2=0x563aacead180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19400 0x563aacead180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x563aadd09bc0 tx=0x563aadd0af00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc117e74640 1 -- 172.21.15.181:0/3847255154 reap_dead start 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 shutdown_connections 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 --2- 172.21.15.181:0/3847255154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aadd19400 0x563aacead180 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 >> 172.21.15.181:0/3847255154 conn(0x563aadd19000 msgr2=0x563aadbb8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 shutdown_connections 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.043+0000 7fc1196cf280 1 -- 172.21.15.181:0/3847255154 wait complete. 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 -- 172.21.15.181:0/2933409088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aace2f800 msgr2=0x563aaceaab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aace2f800 0x563aaceaab00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x563aadc55860 tx=0x563aadbcff20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 -- 172.21.15.181:0/2933409088 shutdown_connections 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563aace2fc00 0x563aaceab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aace2f800 0x563aaceaab00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 --2- 172.21.15.181:0/2933409088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563aace2ec00 0x563aaceaa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.058 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 -- 172.21.15.181:0/2933409088 >> 172.21.15.181:0/2933409088 conn(0x563aace2f000 msgr2=0x563aadbb9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.058 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 -- 172.21.15.181:0/2933409088 shutdown_connections 2024-09-12T02:32:04.058 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.044+0000 7fc1196cf280 1 -- 172.21.15.181:0/2933409088 wait complete. 2024-09-12T02:32:04.058 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-09-12T02:32:04.075 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 -- start start 2024-09-12T02:32:04.076 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 Processor -- start 2024-09-12T02:32:04.082 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c0f8c00 0x56493c174580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.082 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c0f9800 0x56493c174b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.082 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c0f9c00 0x56493c175080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.082 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56493cece600 con 0x56493c0f9800 2024-09-12T02:32:04.082 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56493cece480 con 0x56493c0f9c00 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.075+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56493cece300 con 0x56493c0f8c00 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c0f9800 0x56493c174b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c0f9800 0x56493c174b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43592/0 (socket says 172.21.15.181:43592) 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 -- 172.21.15.181:0/3437173736 learned_addr learned my addr 172.21.15.181:0/3437173736 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3595c6640 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c0f9c00 0x56493c175080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb358dc5640 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c0f8c00 0x56493c174580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 -- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c0f8c00 msgr2=0x56493c174580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c0f8c00 0x56493c174580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 -- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c0f9c00 msgr2=0x56493c175080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c0f9c00 0x56493c175080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 -- 172.21.15.181:0/3437173736 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493c130780 con 0x56493c0f9800 2024-09-12T02:32:04.083 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3585c4640 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c0f9800 0x56493c174b00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x56493cf13800 tx=0x56493ce98600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14609ed855370aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3565c0640 1 -- 172.21.15.181:0/3437173736 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c11e680 con 0x56493c0f9800 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3565c0640 1 -- 172.21.15.181:0/3437173736 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56493c124e00 con 0x56493c0f9800 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3565c0640 1 -- 172.21.15.181:0/3437173736 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c11e9c0 con 0x56493c0f9800 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb35a620280 1 -- 172.21.15.181:0/3437173736 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493c1314a0 con 0x56493c0f9800 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb35a620280 1 -- 172.21.15.181:0/3437173736 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56493c131860 con 0x56493c0f9800 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3565c0640 1 -- 172.21.15.181:0/3437173736 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x56493cfda400 con 0x56493c0f9800 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.076+0000 7fb3565c0640 1 -- 172.21.15.181:0/3437173736 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x56493c153180 con 0x56493c0f9800 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.077+0000 7fb35a620280 1 Processor -- start 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.077+0000 7fb35a620280 1 -- start start 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1400 0x56493c175600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1800 0x56493c175b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.084 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb35a620280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1c00 0x56493c176100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb35a620280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56493cece180 con 0x56493ced1c00 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56493c15a900 con 0x56493ced1400 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56493c15a480 con 0x56493ced1800 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1c00 0x56493c176100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1c00 0x56493c176100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43600/0 (socket says 172.21.15.181:43600) 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 -- 172.21.15.181:0/350731780 learned_addr learned my addr 172.21.15.181:0/350731780 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3595c6640 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1400 0x56493c175600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb358dc5640 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1800 0x56493c175b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 -- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1800 msgr2=0x56493c175b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1800 0x56493c175b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 -- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1400 msgr2=0x56493c175600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1400 0x56493c175600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.085 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 -- 172.21.15.181:0/350731780 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493c130000 con 0x56493ced1c00 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb358dc5640 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1800 0x56493c175b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3585c4640 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1c00 0x56493c176100 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x56493cfea6f0 tx=0x56493c1b4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4d1da244752791 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3545bc640 1 -- 172.21.15.181:0/350731780 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c11e680 con 0x56493ced1c00 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3545bc640 1 -- 172.21.15.181:0/350731780 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56493c124a80 con 0x56493ced1c00 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.078+0000 7fb3545bc640 1 -- 172.21.15.181:0/350731780 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c11e9c0 con 0x56493ced1c00 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 -- 172.21.15.181:0/350731780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1c00 msgr2=0x56493c176100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1c00 0x56493c176100 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x56493cfea6f0 tx=0x56493c1b4cc0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 -- 172.21.15.181:0/350731780 shutdown_connections 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1c00 0x56493c176100 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1800 0x56493c175b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 --2- 172.21.15.181:0/350731780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1400 0x56493c175600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 -- 172.21.15.181:0/350731780 >> 172.21.15.181:0/350731780 conn(0x56493ced1000 msgr2=0x56493ce82800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.086 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 -- 172.21.15.181:0/350731780 shutdown_connections 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 -- 172.21.15.181:0/350731780 wait complete. 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 Processor -- start 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.079+0000 7fb35a620280 1 -- start start 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1400 0x56493c177180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb35a620280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1800 0x56493c176c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1c00 0x56493c176680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb35a620280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56493cecf800 con 0x56493ced1800 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56493cecf980 con 0x56493ced1c00 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56493ceced80 con 0x56493ced1400 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1800 0x56493c176c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1800 0x56493c176c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43606/0 (socket says 172.21.15.181:43606) 2024-09-12T02:32:04.087 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 -- 172.21.15.181:0/1879761567 learned_addr learned my addr 172.21.15.181:0/1879761567 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb3585c4640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1c00 0x56493c176680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb3595c6640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1400 0x56493c177180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 -- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1400 msgr2=0x56493c177180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1400 0x56493c177180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 -- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1c00 msgr2=0x56493c176680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1c00 0x56493c176680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 -- 172.21.15.181:0/1879761567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493c131680 con 0x56493ced1800 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb3595c6640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1400 0x56493c177180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb358dc5640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1800 0x56493c176c00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56493cfeba70 tx=0x56493cfeee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb352db9640 1 -- 172.21.15.181:0/1879761567 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c11e680 con 0x56493ced1800 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb352db9640 1 -- 172.21.15.181:0/1879761567 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56493c124a80 con 0x56493ced1800 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.080+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56493c130780 con 0x56493ced1800 2024-09-12T02:32:04.088 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.081+0000 7fb352db9640 1 -- 172.21.15.181:0/1879761567 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c11e9c0 con 0x56493ced1800 2024-09-12T02:32:04.089 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.081+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493c1314a0 con 0x56493ced1800 2024-09-12T02:32:04.089 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.082+0000 7fb352db9640 1 -- 172.21.15.181:0/1879761567 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56493cef0c00 con 0x56493ced1800 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.082+0000 7fb352db9640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56493c486000 0x56493c177700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.082+0000 7fb352db9640 1 -- 172.21.15.181:0/1879761567 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x56493cef4a00 con 0x56493ced1800 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.082+0000 7fb3595c6640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56493c486000 0x56493c177700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.082+0000 7fb3595c6640 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56493c486000 0x56493c177700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56493c155ce0 tx=0x56493ce98a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 -- start start 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 Processor -- start 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c486800 0x56493c176100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c486c00 0x56493c175b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c487000 0x56493c175600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56493cecea80 con 0x56493c486c00 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56493cecfb00 con 0x56493c486800 2024-09-12T02:32:04.092 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.083+0000 7fb35a620280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56493cecfc80 con 0x56493c487000 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c486c00 0x56493c175b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c486c00 0x56493c175b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43616/0 (socket says 172.21.15.181:43616) 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 -- 172.21.15.181:0/2038485134 learned_addr learned my addr 172.21.15.181:0/2038485134 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb3595c6640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c486800 0x56493c176100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb3585c4640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c487000 0x56493c175600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 -- 172.21.15.181:0/2038485134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c487000 msgr2=0x56493c175600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c487000 0x56493c175600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 -- 172.21.15.181:0/2038485134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c486800 msgr2=0x56493c176100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c486800 0x56493c176100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493c131860 con 0x56493c486c00 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb358dc5640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c486c00 0x56493c175b80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x56493d079a70 tx=0x56493cfef7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feae8078ea32e55a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb34fdb3640 1 -- 172.21.15.181:0/2038485134 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c418b60 con 0x56493c486c00 2024-09-12T02:32:04.093 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb34fdb3640 1 -- 172.21.15.181:0/2038485134 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56493c124c40 con 0x56493c486c00 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb34fdb3640 1 -- 172.21.15.181:0/2038485134 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56493c418d00 con 0x56493c486c00 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493c131680 con 0x56493c486c00 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56493c130780 con 0x56493c486c00 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb34fdb3640 1 -- 172.21.15.181:0/2038485134 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x56493c4e6200 con 0x56493c486c00 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb34fdb3640 1 -- 172.21.15.181:0/2038485134 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x56493c153500 con 0x56493c486c00 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb35a620280 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56493c487400 0x56493c4fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.084+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x56493c4e9400 con 0x56493c487400 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.085+0000 7fb3595c6640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56493c487400 0x56493c4fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.085+0000 7fb3595c6640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56493c487400 0x56493c4fa000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=3a3debcb058fc8b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.094 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.085+0000 7fb3595c6640 1 -- 172.21.15.181:0/2038485134 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x56493ce94000 con 0x56493c487400 2024-09-12T02:32:04.095 INFO:tasks.workunit.client.0.smithi181.stdout:undump /tmp/journal.bin 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.085+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x56493c4e9800 con 0x56493c487400 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.085+0000 7fb3595c6640 1 -- 172.21.15.181:0/2038485134 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x56493ce94000 con 0x56493c487400 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb34e5b0640 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x56493c4fe000 con 0x56493c487400 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb34e5b0640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56493c4fe400 0x56493c4fc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb34e5b0640 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x56493c4fe800 con 0x56493c4fe400 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb3585c4640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56493c4fe400 0x56493c4fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb3595c6640 1 -- 172.21.15.181:0/2038485134 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv18 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x56493ce94000 con 0x56493c487400 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb3585c4640 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56493c4fe400 0x56493c4fc680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=4270a9525b373273 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.096 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb3585c4640 1 -- 172.21.15.181:0/2038485134 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56493ce94500 con 0x56493c4fe400 2024-09-12T02:32:04.097 INFO:tasks.workunit.client.0.smithi181.stdout:start 4194304 len 30182 write_pos 4200187 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-09-12T02:32:04.097 INFO:tasks.workunit.client.0.smithi181.stdout:writing header 200.00000000 2024-09-12T02:32:04.097 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.086+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56493c4e9c00 con 0x56493c487400 2024-09-12T02:32:04.097 INFO:tasks.workunit.client.0.smithi181.stdout:Purging 2 objects from 1 2024-09-12T02:32:04.098 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.088+0000 7fb3595c6640 1 -- 172.21.15.181:0/2038485134 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v48'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56493ce94000 con 0x56493c487400 2024-09-12T02:32:04.098 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.088+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:6 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56493ced5400 con 0x56493c487400 2024-09-12T02:32:04.098 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.088+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:7 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56493ced5000 con 0x56493c4fe400 2024-09-12T02:32:04.098 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.089+0000 7fb3595c6640 1 -- 172.21.15.181:0/2038485134 <== osd.2 v2:172.21.15.181:6808/3659790931 5 ==== osd_op_reply(6 200.00000001 [delete] v48'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56493ce94000 con 0x56493c487400 2024-09-12T02:32:04.098 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.089+0000 7fb3585c4640 1 -- 172.21.15.181:0/2038485134 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(7 200.00000002 [delete] v48'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56493ce94500 con 0x56493c4fe400 2024-09-12T02:32:04.098 INFO:tasks.workunit.client.0.smithi181.stdout: writing 4194304~30182 2024-09-12T02:32:04.099 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.089+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:8 6.14 6:2e2fa760:::200.00000001:head [write 0~30182 in=30182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56493ceecc00 con 0x56493c487400 2024-09-12T02:32:04.099 INFO:tasks.workunit.client.0.smithi181.stdout:done. 2024-09-12T02:32:04.101 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb3595c6640 1 -- 172.21.15.181:0/2038485134 <== osd.2 v2:172.21.15.181:6808/3659790931 6 ==== osd_op_reply(8 200.00000001 [write 0~30182] v48'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56493ce94000 con 0x56493c487400 2024-09-12T02:32:04.101 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56493c487400 msgr2=0x56493c4fa000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.101 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56493c487400 0x56493c4fa000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.101 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56493c4fe400 msgr2=0x56493c4fc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.101 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56493c4fe400 0x56493c4fc680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c486c00 msgr2=0x56493c175b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 --2- 172.21.15.181:0/2038485134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c486c00 0x56493c175b80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x56493d079a70 tx=0x56493cfef7a0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb3585c4640 1 -- 172.21.15.181:0/2038485134 reap_dead start 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 shutdown_connections 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 >> 172.21.15.181:0/2038485134 conn(0x56493c486400 msgr2=0x56493ce82800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 shutdown_connections 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.090+0000 7fb35a620280 1 -- 172.21.15.181:0/2038485134 wait complete. 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56493c486000 msgr2=0x56493c177700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56493c486000 0x56493c177700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56493c155ce0 tx=0x56493ce98a20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1800 msgr2=0x56493c176c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1800 0x56493c176c00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56493cfeba70 tx=0x56493cfeee40 comp rx=0 tx=0).stop 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 shutdown_connections 2024-09-12T02:32:04.102 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56493c486000 0x56493c177700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493ced1c00 0x56493c176680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493ced1800 0x56493c176c00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/1879761567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493ced1400 0x56493c177180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 >> 172.21.15.181:0/1879761567 conn(0x56493ced1000 msgr2=0x56493ce82000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 shutdown_connections 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/1879761567 wait complete. 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/3437173736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c0f9800 msgr2=0x56493c174b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c0f9800 0x56493c174b00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x56493cf13800 tx=0x56493ce98600 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/3437173736 shutdown_connections 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56493c0f9c00 0x56493c175080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56493c0f9800 0x56493c174b00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 --2- 172.21.15.181:0/3437173736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56493c0f8c00 0x56493c174580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/3437173736 >> 172.21.15.181:0/3437173736 conn(0x56493c0f9000 msgr2=0x56493ce83000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.103 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/3437173736 shutdown_connections 2024-09-12T02:32:04.104 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.091+0000 7fb35a620280 1 -- 172.21.15.181:0/3437173736 wait complete. 2024-09-12T02:32:04.104 INFO:tasks.workunit.client.0.smithi181.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-12T02:32:04.122 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.121+0000 7f0115011280 1 -- start start 2024-09-12T02:32:04.122 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.121+0000 7f0115011280 1 Processor -- start 2024-09-12T02:32:04.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0115011280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec888ac00 0x564ec8906580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0115011280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec888b800 0x564ec8906b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0115011280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec888bc00 0x564ec8907080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0115011280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ec9616180 con 0x564ec888ac00 2024-09-12T02:32:04.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0115011280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x564ec9616300 con 0x564ec888bc00 2024-09-12T02:32:04.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0115011280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x564ec9616480 con 0x564ec888b800 2024-09-12T02:32:04.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec888ac00 0x564ec8906580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec888ac00 0x564ec8906580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43636/0 (socket says 172.21.15.181:43636) 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 -- 172.21.15.181:0/1928223750 learned_addr learned my addr 172.21.15.181:0/1928223750 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112247640 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec888b800 0x564ec8906b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0113249640 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec888bc00 0x564ec8907080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 -- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec888b800 msgr2=0x564ec8906b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec888b800 0x564ec8906b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 -- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec888bc00 msgr2=0x564ec8907080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec888bc00 0x564ec8907080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 -- 172.21.15.181:0/1928223750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec88c2780 con 0x564ec888ac00 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0112a48640 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec888ac00 0x564ec8906580 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x564ec96a9950 tx=0x564ec962a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42283e62b78fba6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0110243640 1 -- 172.21.15.181:0/1928223750 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564ec88b0680 con 0x564ec888ac00 2024-09-12T02:32:04.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0110243640 1 -- 172.21.15.181:0/1928223750 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564ec88b6700 con 0x564ec888ac00 2024-09-12T02:32:04.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0110243640 1 -- 172.21.15.181:0/1928223750 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564ec88b0b60 con 0x564ec888ac00 2024-09-12T02:32:04.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.122+0000 7f0115011280 1 -- 172.21.15.181:0/1928223750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec88c34a0 con 0x564ec888ac00 2024-09-12T02:32:04.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.123+0000 7f0115011280 1 -- 172.21.15.181:0/1928223750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564ec88c2000 con 0x564ec888ac00 2024-09-12T02:32:04.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.123+0000 7f0110243640 1 -- 172.21.15.181:0/1928223750 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x564ec9768600 con 0x564ec888ac00 2024-09-12T02:32:04.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.123+0000 7f0110243640 1 -- 172.21.15.181:0/1928223750 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x564ec88e5180 con 0x564ec888ac00 2024-09-12T02:32:04.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.123+0000 7f0115011280 1 Processor -- start 2024-09-12T02:32:04.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.123+0000 7f0115011280 1 -- start start 2024-09-12T02:32:04.132 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0115011280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d400 0x564ec8907600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0115011280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976d800 0x564ec8907b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0115011280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976dc00 0x564ec8908100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0115011280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ec9616600 con 0x564ec976d400 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0115011280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x564ec9616780 con 0x564ec976d800 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0115011280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x564ec9616900 con 0x564ec976dc00 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d400 0x564ec8907600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d400 0x564ec8907600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43644/0 (socket says 172.21.15.181:43644) 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 -- 172.21.15.181:0/1322955669 learned_addr learned my addr 172.21.15.181:0/1322955669 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0112247640 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976dc00 0x564ec8908100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0112a48640 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976d800 0x564ec8907b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 -- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976dc00 msgr2=0x564ec8908100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.133 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976dc00 0x564ec8908100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 -- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976d800 msgr2=0x564ec8907b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976d800 0x564ec8907b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 -- 172.21.15.181:0/1322955669 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec88c23c0 con 0x564ec976d400 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.124+0000 7f0113249640 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d400 0x564ec8907600 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x564ec977a990 tx=0x564ec977ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aeb7198233a2cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f010e23f640 1 -- 172.21.15.181:0/1322955669 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564ec88b0680 con 0x564ec976d400 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f010e23f640 1 -- 172.21.15.181:0/1322955669 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564ec88b6fc0 con 0x564ec976d400 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f010e23f640 1 -- 172.21.15.181:0/1322955669 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564ec88b0b60 con 0x564ec976d400 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 -- 172.21.15.181:0/1322955669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d400 msgr2=0x564ec8907600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d400 0x564ec8907600 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x564ec977a990 tx=0x564ec977ec00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 -- 172.21.15.181:0/1322955669 shutdown_connections 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976d800 0x564ec8907b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976dc00 0x564ec8908100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 --2- 172.21.15.181:0/1322955669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d400 0x564ec8907600 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 -- 172.21.15.181:0/1322955669 >> 172.21.15.181:0/1322955669 conn(0x564ec976d000 msgr2=0x564ec8981000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 -- 172.21.15.181:0/1322955669 shutdown_connections 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.125+0000 7f0115011280 1 -- 172.21.15.181:0/1322955669 wait complete. 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 Processor -- start 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 -- start start 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976d400 0x564ec8909180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d800 0x564ec8908c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976dc00 0x564ec8908680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ec9616900 con 0x564ec976d800 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x564ec9616a80 con 0x564ec976dc00 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0115011280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x564ec9616780 con 0x564ec976d400 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0112a48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d800 0x564ec8908c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0112a48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d800 0x564ec8908c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43658/0 (socket says 172.21.15.181:43658) 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0112a48640 1 -- 172.21.15.181:0/3654204444 learned_addr learned my addr 172.21.15.181:0/3654204444 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0113249640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976d400 0x564ec8909180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.126+0000 7f0112247640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976dc00 0x564ec8908680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0112a48640 1 -- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976d400 msgr2=0x564ec8909180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0112a48640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976d400 0x564ec8909180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0112a48640 1 -- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976dc00 msgr2=0x564ec8908680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0112a48640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976dc00 0x564ec8908680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0112a48640 1 -- 172.21.15.181:0/3654204444 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec88c2780 con 0x564ec976d800 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0112a48640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d800 0x564ec8908c00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x564ec977a8d0 tx=0x564ec962aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f010ca3c640 1 -- 172.21.15.181:0/3654204444 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564ec88b0820 con 0x564ec976d800 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f010ca3c640 1 -- 172.21.15.181:0/3654204444 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564ec88b6e00 con 0x564ec976d800 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f010ca3c640 1 -- 172.21.15.181:0/3654204444 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564ec88b0680 con 0x564ec976d800 2024-09-12T02:32:04.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ec88c34a0 con 0x564ec976d800 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.127+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec88c2960 con 0x564ec976d800 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.128+0000 7f010ca3c640 1 -- 172.21.15.181:0/3654204444 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x564ec97d8c00 con 0x564ec976d800 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.128+0000 7f010ca3c640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564ec8c06000 0x564ec8909700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f010ca3c640 1 -- 172.21.15.181:0/3654204444 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x564ec97d2c00 con 0x564ec976d800 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0113249640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564ec8c06000 0x564ec8909700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x564ec8c06400 0x564ec8908100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x564ec8c06800 con 0x564ec8c06400 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0112247640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x564ec8c06400 0x564ec8908100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0113249640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564ec8c06000 0x564ec8909700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564ec977a990 tx=0x564ec962be00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0112247640 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x564ec8c06400 0x564ec8908100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0112247640 1 -- 172.21.15.181:0/3654204444 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x564ec8972000 con 0x564ec8c06400 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.129+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x564ec8c06c00 con 0x564ec8c06400 2024-09-12T02:32:04.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0112247640 1 -- 172.21.15.181:0/3654204444 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x564ec8972000 con 0x564ec8c06400 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x564ec8c06400 msgr2=0x564ec8908100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x564ec8c06400 0x564ec8908100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564ec8c06000 msgr2=0x564ec8909700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564ec8c06000 0x564ec8909700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564ec977a990 tx=0x564ec962be00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d800 msgr2=0x564ec8908c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d800 0x564ec8908c00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x564ec977a8d0 tx=0x564ec962aa20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 shutdown_connections 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0112247640 1 -- 172.21.15.181:0/3654204444 reap_dead start 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x564ec8c06400 0x564ec8908100 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564ec8c06000 0x564ec8909700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec976dc00 0x564ec8908680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec976d800 0x564ec8908c00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.138 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/3654204444 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec976d400 0x564ec8909180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 >> 172.21.15.181:0/3654204444 conn(0x564ec976d000 msgr2=0x564ec8981000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 shutdown_connections 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/3654204444 wait complete. 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/1928223750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec888ac00 msgr2=0x564ec8906580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec888ac00 0x564ec8906580 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x564ec96a9950 tx=0x564ec962a540 comp rx=0 tx=0).stop 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/1928223750 shutdown_connections 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564ec888bc00 0x564ec8907080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564ec888b800 0x564ec8906b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 --2- 172.21.15.181:0/1928223750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ec888ac00 0x564ec8906580 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/1928223750 >> 172.21.15.181:0/1928223750 conn(0x564ec888b000 msgr2=0x564ec8980800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/1928223750 shutdown_connections 2024-09-12T02:32:04.139 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.130+0000 7f0115011280 1 -- 172.21.15.181:0/1928223750 wait complete. 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr:+ NEW_HEADER_STATE='{ 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "magic": "ceph fs volume v011", 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "write_pos": 4200187, 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "expire_pos": 4194304, 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "trimmed_pos": 4194304, 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "stream_format": 1, 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "layout": { 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_unit": 4194304, 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_count": 1, 2024-09-12T02:32:04.140 INFO:tasks.workunit.client.0.smithi181.stderr: "object_size": 4194304, 2024-09-12T02:32:04.141 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_id": 6, 2024-09-12T02:32:04.141 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_ns": "" 2024-09-12T02:32:04.141 INFO:tasks.workunit.client.0.smithi181.stderr: } 2024-09-12T02:32:04.141 INFO:tasks.workunit.client.0.smithi181.stderr:}' 2024-09-12T02:32:04.141 INFO:tasks.workunit.client.0.smithi181.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2024-09-12T02:32:04.162 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.161+0000 7f3468d61280 1 -- start start 2024-09-12T02:32:04.162 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.161+0000 7f3468d61280 1 Processor -- start 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cb89ec00 0x55b9cb91a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cb89f800 0x55b9cb91ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cb89fc00 0x55b9cb91b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc682180 con 0x55b9cb89f800 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc682300 con 0x55b9cb89ec00 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b9cc682480 con 0x55b9cb89fc00 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cb89f800 0x55b9cb91ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cb89f800 0x55b9cb91ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43688/0 (socket says 172.21.15.181:43688) 2024-09-12T02:32:04.164 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 -- 172.21.15.181:0/33645856 learned_addr learned my addr 172.21.15.181:0/33645856 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3467508640 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cb89ec00 0x55b9cb91a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3467d09640 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cb89fc00 0x55b9cb91b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 -- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cb89fc00 msgr2=0x55b9cb91b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cb89fc00 0x55b9cb91b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 -- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cb89ec00 msgr2=0x55b9cb91a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cb89ec00 0x55b9cb91a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 -- 172.21.15.181:0/33645856 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cb8d6780 con 0x55b9cb89f800 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3467d09640 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cb89fc00 0x55b9cb91b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3466d07640 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cb89f800 0x55b9cb91ab00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55b9cc6b5800 tx=0x55b9cc63e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3047c987b0e14c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3464d03640 1 -- 172.21.15.181:0/33645856 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b9cb8c4680 con 0x55b9cb89f800 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3464d03640 1 -- 172.21.15.181:0/33645856 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b9cb8cafc0 con 0x55b9cb89f800 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3464d03640 1 -- 172.21.15.181:0/33645856 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b9cb8c4b60 con 0x55b9cb89f800 2024-09-12T02:32:04.165 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 -- 172.21.15.181:0/33645856 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9cb8d74a0 con 0x55b9cb89f800 2024-09-12T02:32:04.166 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.162+0000 7f3468d61280 1 -- 172.21.15.181:0/33645856 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b9cb8d6000 con 0x55b9cb89f800 2024-09-12T02:32:04.166 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.163+0000 7f3464d03640 1 -- 172.21.15.181:0/33645856 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55b9cc774600 con 0x55b9cb89f800 2024-09-12T02:32:04.166 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.163+0000 7f3464d03640 1 -- 172.21.15.181:0/33645856 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55b9cb8f9180 con 0x55b9cb89f800 2024-09-12T02:32:04.166 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.163+0000 7f3468d61280 1 Processor -- start 2024-09-12T02:32:04.166 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.163+0000 7f3468d61280 1 -- start start 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3468d61280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771400 0x55b9cb91b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3468d61280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771800 0x55b9cb91bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3468d61280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3468d61280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc682600 con 0x55b9cc771800 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3468d61280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc682780 con 0x55b9cc771400 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3468d61280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b9cc682900 con 0x55b9cc771c00 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771800 0x55b9cb91bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771800 0x55b9cb91bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43692/0 (socket says 172.21.15.181:43692) 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 -- 172.21.15.181:0/2335713750 learned_addr learned my addr 172.21.15.181:0/2335713750 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467d09640 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771400 0x55b9cb91b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3466d07640 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 -- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 msgr2=0x55b9cb91c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 -- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771400 msgr2=0x55b9cb91b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771400 0x55b9cb91b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 -- 172.21.15.181:0/2335713750 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cb8d63c0 con 0x55b9cc771800 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3466d07640 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.164+0000 7f3467508640 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771800 0x55b9cb91bb80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55b9cc764750 tx=0x55b9cc63ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbdd7b7ca44f84d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3462cff640 1 -- 172.21.15.181:0/2335713750 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b9cb8c49c0 con 0x55b9cc771800 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3462cff640 1 -- 172.21.15.181:0/2335713750 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b9cb8cae00 con 0x55b9cc771800 2024-09-12T02:32:04.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3462cff640 1 -- 172.21.15.181:0/2335713750 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b9cb8c4680 con 0x55b9cc771800 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 -- 172.21.15.181:0/2335713750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771800 msgr2=0x55b9cb91bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771800 0x55b9cb91bb80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55b9cc764750 tx=0x55b9cc63ea20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 -- 172.21.15.181:0/2335713750 shutdown_connections 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771800 0x55b9cb91bb80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 --2- 172.21.15.181:0/2335713750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771400 0x55b9cb91b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 -- 172.21.15.181:0/2335713750 >> 172.21.15.181:0/2335713750 conn(0x55b9cc771000 msgr2=0x55b9cb989000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 -- 172.21.15.181:0/2335713750 shutdown_connections 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.165+0000 7f3468d61280 1 -- 172.21.15.181:0/2335713750 wait complete. 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 Processor -- start 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 -- start start 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771400 0x55b9cb91d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771800 0x55b9cb91cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc682c00 con 0x55b9cc771400 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b9cc682d80 con 0x55b9cc771800 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3468d61280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b9cc682f00 con 0x55b9cc771c00 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3467d09640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771400 0x55b9cb91d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3467d09640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771400 0x55b9cb91d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43698/0 (socket says 172.21.15.181:43698) 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3467d09640 1 -- 172.21.15.181:0/4096504570 learned_addr learned my addr 172.21.15.181:0/4096504570 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3467508640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771800 0x55b9cb91cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.166+0000 7f3466d07640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3467d09640 1 -- 172.21.15.181:0/4096504570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 msgr2=0x55b9cb91c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3467d09640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cc771c00 0x55b9cb91c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3467d09640 1 -- 172.21.15.181:0/4096504570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771800 msgr2=0x55b9cb91cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3467d09640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cc771800 0x55b9cb91cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3467d09640 1 -- 172.21.15.181:0/4096504570 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9cb8d6780 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3467d09640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771400 0x55b9cb91d180 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55b9cc765b90 tx=0x55b9cc768c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f34614fc640 1 -- 172.21.15.181:0/4096504570 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b9cb8c49c0 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f34614fc640 1 -- 172.21.15.181:0/4096504570 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b9cb8caa80 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9cb8d74a0 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f34614fc640 1 -- 172.21.15.181:0/4096504570 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b9cb8c4680 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.167+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9cb8d6960 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.168+0000 7f34614fc640 1 -- 172.21.15.181:0/4096504570 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55b9cc7dec00 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.168+0000 7f34614fc640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b9cc7f1000 0x55b9cb91d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.168+0000 7f34614fc640 1 -- 172.21.15.181:0/4096504570 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55b9cc7f2a00 con 0x55b9cc771400 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3467508640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b9cc7f1000 0x55b9cb91d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3468d61280 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55b9cc7f1400 0x55b9cb91c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55b9cc7f1800 con 0x55b9cc7f1400 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3466d07640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55b9cc7f1400 0x55b9cb91c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3467508640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b9cc7f1000 0x55b9cb91d700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b9cc764750 tx=0x55b9cc63fe60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3466d07640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55b9cc7f1400 0x55b9cb91c100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3466d07640 1 -- 172.21.15.181:0/4096504570 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55b9cc628000 con 0x55b9cc7f1400 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.169+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55b9cc7f1c00 con 0x55b9cc7f1400 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.170+0000 7f3466d07640 1 -- 172.21.15.181:0/4096504570 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55b9cc628000 con 0x55b9cc7f1400 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.170+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55b9cbc32000 con 0x55b9cc7f1400 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.170+0000 7f3466d07640 1 -- 172.21.15.181:0/4096504570 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv21 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x55b9cc628000 con 0x55b9cc7f1400 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.170+0000 7f3468d61280 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55b9cbc32400 0x55b9cb91bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.170+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55b9cbc32800 con 0x55b9cbc32400 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3467d09640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55b9cbc32400 0x55b9cb91bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3467d09640 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55b9cbc32400 0x55b9cb91bb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3467d09640 1 -- 172.21.15.181:0/4096504570 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b9cbc40f00 con 0x55b9cbc32400 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55b9cc7f1400 msgr2=0x55b9cb91c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55b9cc7f1400 0x55b9cb91c100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55b9cbc32400 msgr2=0x55b9cb91bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55b9cbc32400 0x55b9cb91bb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b9cc7f1000 msgr2=0x55b9cb91d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b9cc7f1000 0x55b9cb91d700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b9cc764750 tx=0x55b9cc63fe60 comp rx=0 tx=0).stop 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771400 msgr2=0x55b9cb91d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 --2- 172.21.15.181:0/4096504570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cc771400 0x55b9cb91d180 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55b9cc765b90 tx=0x55b9cc768c00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3467508640 1 -- 172.21.15.181:0/4096504570 reap_dead start 2024-09-12T02:32:04.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3467508640 1 -- 172.21.15.181:0/4096504570 reap_dead start 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 shutdown_connections 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 >> 172.21.15.181:0/4096504570 conn(0x55b9cc771000 msgr2=0x55b9cb989000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 shutdown_connections 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.171+0000 7f3468d61280 1 -- 172.21.15.181:0/4096504570 wait complete. 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 -- 172.21.15.181:0/33645856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cb89f800 msgr2=0x55b9cb91ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cb89f800 0x55b9cb91ab00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55b9cc6b5800 tx=0x55b9cc63e540 comp rx=0 tx=0).stop 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 -- 172.21.15.181:0/33645856 shutdown_connections 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b9cb89fc00 0x55b9cb91b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9cb89f800 0x55b9cb91ab00 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 --2- 172.21.15.181:0/33645856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b9cb89ec00 0x55b9cb91a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 -- 172.21.15.181:0/33645856 >> 172.21.15.181:0/33645856 conn(0x55b9cb89f000 msgr2=0x55b9cb988800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 -- 172.21.15.181:0/33645856 shutdown_connections 2024-09-12T02:32:04.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.172+0000 7f3468d61280 1 -- 172.21.15.181:0/33645856 wait complete. 2024-09-12T02:32:04.181 INFO:tasks.workunit.client.0.smithi181.stderr:+ NEW_EVENT_LIST='0.000000 0x400000 LID: () 2024-09-12T02:32:04.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:29:52.609822+0000 0x400030 SUBTREEMAP: () 2024-09-12T02:32:04.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.612386+0000 0x4003ac SESSION: () 2024-09-12T02:32:04.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.976787+0000 0x400567 UPDATE: (setattr) 2024-09-12T02:32:04.181 INFO:tasks.workunit.client.0.smithi181.stderr: / 2024-09-12T02:32:04.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:03.100049+0000 0x400896 UPDATE: (mkdir) 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:08.613262+0000 0x401076 UPDATE: (cap update) 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.604583+0000 0x4016fb UPDATE: (mkdir) 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.615765+0000 0x402219 UPDATE: (mkdir) 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/foo 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.616821+0000 0x402ae9 UPDATE: (openc) 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.698700+0000 0x40328b UPDATE: (unlink_local) 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000002 2024-09-12T02:32:04.182 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp/foo 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700226+0000 0x40448e UPDATE: (unlink_local) 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700557+0000 0x405117 UPDATE: (cap update) 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.705885+0000 0x4058b4 UPDATE: (unlink_local) 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000001 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.025763+0000 0x40651c UPDATE: (unlink_local) 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000000 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814328+0000 0x40707b UPDATE: (scatter_writebehind) 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814891+0000 0x4074ed SESSION: () 2024-09-12T02:32:04.183 INFO:tasks.workunit.client.0.smithi181.stderr:0.000000 0x40759a PURGED: ()' 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' '!' '{ 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "magic": "ceph fs volume v011", 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "write_pos": 4200187, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "expire_pos": 4194304, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "trimmed_pos": 4194304, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "stream_format": 1, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "layout": { 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_unit": 4194304, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_count": 1, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "object_size": 4194304, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_id": 6, 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_ns": "" 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr: } 2024-09-12T02:32:04.184 INFO:tasks.workunit.client.0.smithi181.stderr:}' = '{ 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "magic": "ceph fs volume v011", 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "write_pos": 4200187, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "expire_pos": 4194304, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "trimmed_pos": 4194304, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "stream_format": 1, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "layout": { 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_unit": 4194304, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "stripe_count": 1, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "object_size": 4194304, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_id": 6, 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: "pool_ns": "" 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr: } 2024-09-12T02:32:04.185 INFO:tasks.workunit.client.0.smithi181.stderr:}' ']' 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' '!' '0.000000 0x400000 LID: () 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:29:52.609822+0000 0x400030 SUBTREEMAP: () 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.612386+0000 0x4003ac SESSION: () 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.976787+0000 0x400567 UPDATE: (setattr) 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr: / 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:03.100049+0000 0x400896 UPDATE: (mkdir) 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:08.613262+0000 0x401076 UPDATE: (cap update) 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.604583+0000 0x4016fb UPDATE: (mkdir) 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.615765+0000 0x402219 UPDATE: (mkdir) 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/foo 2024-09-12T02:32:04.186 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.616821+0000 0x402ae9 UPDATE: (openc) 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.698700+0000 0x40328b UPDATE: (unlink_local) 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000002 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp/foo 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700226+0000 0x40448e UPDATE: (unlink_local) 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700557+0000 0x405117 UPDATE: (cap update) 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.705885+0000 0x4058b4 UPDATE: (unlink_local) 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000001 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.025763+0000 0x40651c UPDATE: (unlink_local) 2024-09-12T02:32:04.187 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000000 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814328+0000 0x40707b UPDATE: (scatter_writebehind) 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814891+0000 0x4074ed SESSION: () 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:0.000000 0x40759a PURGED: ()' = '0.000000 0x400000 LID: () 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:29:52.609822+0000 0x400030 SUBTREEMAP: () 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.612386+0000 0x4003ac SESSION: () 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:02.976787+0000 0x400567 UPDATE: (setattr) 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr: / 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:03.100049+0000 0x400896 UPDATE: (mkdir) 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:30:08.613262+0000 0x401076 UPDATE: (cap update) 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.188 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.604583+0000 0x4016fb UPDATE: (mkdir) 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.615765+0000 0x402219 UPDATE: (mkdir) 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/foo 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:03.616821+0000 0x402ae9 UPDATE: (openc) 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.698700+0000 0x40328b UPDATE: (unlink_local) 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000002 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp/foo 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700226+0000 0x40448e UPDATE: (unlink_local) 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: tmp/bar 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.700557+0000 0x405117 UPDATE: (cap update) 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000003 2024-09-12T02:32:04.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:05.705885+0000 0x4058b4 UPDATE: (unlink_local) 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000001 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr: client.0/tmp 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.025763+0000 0x40651c UPDATE: (unlink_local) 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr: client.0 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr: stray2/10000000000 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814328+0000 0x40707b UPDATE: (scatter_writebehind) 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:31:06.814891+0000 0x4074ed SESSION: () 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr:0.000000 0x40759a PURGED: ()' ']' 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stdout:Testing 'journal' commands... 2024-09-12T02:32:04.190 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'Testing '\''journal'\'' commands...' 2024-09-12T02:32:04.191 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2024-09-12T02:32:04.202 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.202+0000 7f28b2c3d280 1 -- start start 2024-09-12T02:32:04.202 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.202+0000 7f28b2c3d280 1 Processor -- start 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.202+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556675616c00 0x556675692580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.202+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556675617800 0x556675692b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556675617c00 0x556675693080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5566763f2600 con 0x556675617c00 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5566763f2480 con 0x556675616c00 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5566763f2300 con 0x556675617800 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556675617c00 0x556675693080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b13e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556675616c00 0x556675692580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.205 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556675617c00 0x556675693080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43708/0 (socket says 172.21.15.181:43708) 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b0be3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556675617800 0x556675692b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 -- 172.21.15.181:0/3942982498 learned_addr learned my addr 172.21.15.181:0/3942982498 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b13e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556675616c00 0x556675692580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:46314/0 (socket says 172.21.15.181:46314) 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 -- 172.21.15.181:0/3942982498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556675617800 msgr2=0x556675692b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556675617800 0x556675692b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 -- 172.21.15.181:0/3942982498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556675616c00 msgr2=0x556675692580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556675616c00 0x556675692580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 -- 172.21.15.181:0/3942982498 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667564e780 con 0x556675617c00 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b13e4640 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556675616c00 0x556675692580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b1be5640 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556675617c00 0x556675693080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55667642f800 tx=0x5566763b6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45547677c30ab2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28aebdf640 1 -- 172.21.15.181:0/3942982498 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55667563c680 con 0x556675617c00 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28aebdf640 1 -- 172.21.15.181:0/3942982498 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556675642fc0 con 0x556675617c00 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28aebdf640 1 -- 172.21.15.181:0/3942982498 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55667563cb60 con 0x556675617c00 2024-09-12T02:32:04.206 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3942982498 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667564e3c0 con 0x556675617c00 2024-09-12T02:32:04.207 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3942982498 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55667564f680 con 0x556675617c00 2024-09-12T02:32:04.207 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.203+0000 7f28aebdf640 1 -- 172.21.15.181:0/3942982498 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5566764f6a00 con 0x556675617c00 2024-09-12T02:32:04.207 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.204+0000 7f28aebdf640 1 -- 172.21.15.181:0/3942982498 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x556675671180 con 0x556675617c00 2024-09-12T02:32:04.207 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.204+0000 7f28b2c3d280 1 Processor -- start 2024-09-12T02:32:04.207 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.204+0000 7f28b2c3d280 1 -- start start 2024-09-12T02:32:04.213 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55667640dc00 0x556675693600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.213 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676544000 0x556675693b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.213 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556676544400 0x556675694100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.213 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5566763f2180 con 0x55667640dc00 2024-09-12T02:32:04.213 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5566763f2900 con 0x556676544000 2024-09-12T02:32:04.213 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x556675678480 con 0x556676544400 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55667640dc00 0x556675693600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55667640dc00 0x556675693600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43722/0 (socket says 172.21.15.181:43722) 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 -- 172.21.15.181:0/1644595339 learned_addr learned my addr 172.21.15.181:0/1644595339 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b13e4640 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676544000 0x556675693b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556676544400 0x556675694100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 -- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556676544400 msgr2=0x556675694100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556676544400 0x556675694100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 -- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676544000 msgr2=0x556675693b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676544000 0x556675693b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 -- 172.21.15.181:0/1644595339 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667564f4a0 con 0x55667640dc00 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28b0be3640 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55667640dc00 0x556675693600 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5566764ea5d0 tx=0x5566763b6960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273cb987ea7ee4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28acbdb640 1 -- 172.21.15.181:0/1644595339 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55667563c9c0 con 0x55667640dc00 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28acbdb640 1 -- 172.21.15.181:0/1644595339 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556675642e00 con 0x55667640dc00 2024-09-12T02:32:04.214 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.205+0000 7f28acbdb640 1 -- 172.21.15.181:0/1644595339 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55667563c680 con 0x55667640dc00 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 -- 172.21.15.181:0/1644595339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55667640dc00 msgr2=0x556675693600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55667640dc00 0x556675693600 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5566764ea5d0 tx=0x5566763b6960 comp rx=0 tx=0).stop 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 -- 172.21.15.181:0/1644595339 shutdown_connections 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676544000 0x556675693b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556676544400 0x556675694100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/1644595339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55667640dc00 0x556675693600 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 -- 172.21.15.181:0/1644595339 >> 172.21.15.181:0/1644595339 conn(0x55667640d800 msgr2=0x5566763a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 -- 172.21.15.181:0/1644595339 shutdown_connections 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 -- 172.21.15.181:0/1644595339 wait complete. 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 Processor -- start 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.206+0000 7f28b2c3d280 1 -- start start 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55667640d800 0x556675695180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676562000 0x556675694c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.215 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b2c3d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556676562400 0x556675694680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5566763f2180 con 0x556676562400 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5566763f2900 con 0x556676562000 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b2c3d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5566763f3b00 con 0x55667640d800 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556676562400 0x556675694680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556676562400 0x556675694680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43724/0 (socket says 172.21.15.181:43724) 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 -- 172.21.15.181:0/3685742592 learned_addr learned my addr 172.21.15.181:0/3685742592 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b13e4640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676562000 0x556675694c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55667640d800 0x556675695180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 -- 172.21.15.181:0/3685742592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55667640d800 msgr2=0x556675695180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.216 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55667640d800 0x556675695180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 -- 172.21.15.181:0/3685742592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676562000 msgr2=0x556675694c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556676562000 0x556675694c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.207+0000 7f28b0be3640 1 -- 172.21.15.181:0/3685742592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667564e780 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.208+0000 7f28b0be3640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556676562400 0x556675694680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x5566764ea900 tx=0x5566763b7e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.208+0000 7f28ab3d8640 1 -- 172.21.15.181:0/3685742592 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55667563cb60 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.208+0000 7f28ab3d8640 1 -- 172.21.15.181:0/3685742592 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556675642c40 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.208+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55667564e3c0 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.208+0000 7f28ab3d8640 1 -- 172.21.15.181:0/3685742592 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55667563c4e0 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.208+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667564e000 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.209+0000 7f28ab3d8640 1 -- 172.21.15.181:0/3685742592 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x556676544c00 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.209+0000 7f28ab3d8640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55667655c400 0x556675695700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.209+0000 7f28ab3d8640 1 -- 172.21.15.181:0/3685742592 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55667656c600 con 0x556676562400 2024-09-12T02:32:04.217 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.209+0000 7f28b13e4640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55667655c400 0x556675695700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.209+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x556676562800 0x556675694100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.209+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x556676562c00 con 0x556676562800 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.209+0000 7f28b0be3640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x556676562800 0x556675694100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.210+0000 7f28b13e4640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55667655c400 0x556675695700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5566763a6ea0 tx=0x5566764e2d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.210+0000 7f28b0be3640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x556676562800 0x556675694100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.210+0000 7f28b0be3640 1 -- 172.21.15.181:0/3685742592 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5566763b2000 con 0x556676562800 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.210+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x556676563000 con 0x556676562800 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.210+0000 7f28b0be3640 1 -- 172.21.15.181:0/3685742592 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5566763b2000 con 0x556676562800 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.210+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x556676563400 con 0x556676562800 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.210+0000 7f28b0be3640 1 -- 172.21.15.181:0/3685742592 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv21 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x5566763b2000 con 0x556676562800 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x556676563800 0x556675693b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x556676563c00 con 0x556676563800 2024-09-12T02:32:04.218 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b1be5640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x556676563800 0x556675693b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.219 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b1be5640 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x556676563800 0x556675693b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.219 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b1be5640 1 -- 172.21.15.181:0/3685742592 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5566759b2f00 con 0x556676563800 2024-09-12T02:32:04.219 INFO:tasks.workunit.client.0.smithi181.stdout:Overall journal integrity: OK 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x556676562800 msgr2=0x556675694100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x556676562800 0x556675694100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x556676563800 msgr2=0x556675693b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x556676563800 0x556675693b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55667655c400 msgr2=0x556675695700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55667655c400 0x556675695700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5566763a6ea0 tx=0x5566764e2d80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b13e4640 1 -- 172.21.15.181:0/3685742592 reap_dead start 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556676562400 msgr2=0x556675694680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556676562400 0x556675694680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x5566764ea900 tx=0x5566763b7e00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 shutdown_connections 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3685742592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556676562400 0x556675694680 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.221 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 >> 172.21.15.181:0/3685742592 conn(0x55667640dc00 msgr2=0x5566763a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 shutdown_connections 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.211+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3685742592 wait complete. 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3942982498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556675617c00 msgr2=0x556675693080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556675617c00 0x556675693080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55667642f800 tx=0x5566763b6600 comp rx=0 tx=0).stop 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3942982498 shutdown_connections 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556675617c00 0x556675693080 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556675617800 0x556675692b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 --2- 172.21.15.181:0/3942982498 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556675616c00 0x556675692580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3942982498 >> 172.21.15.181:0/3942982498 conn(0x556675617000 msgr2=0x5566763a2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3942982498 shutdown_connections 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.212+0000 7f28b2c3d280 1 -- 172.21.15.181:0/3942982498 wait complete. 2024-09-12T02:32:04.222 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-12T02:32:04.242 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 -- start start 2024-09-12T02:32:04.242 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 Processor -- start 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f43dc0c00 0x555f43e3c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f43dc1800 0x555f43e3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f43dc1c00 0x555f43e3d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555f44b4c180 con 0x555f43dc0c00 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x555f44b4c300 con 0x555f43dc1c00 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.242+0000 7f12ccf31280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x555f44b4c480 con 0x555f43dc1800 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f43dc0c00 0x555f43e3c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f43dc0c00 0x555f43e3c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43744/0 (socket says 172.21.15.181:43744) 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 -- 172.21.15.181:0/2590982104 learned_addr learned my addr 172.21.15.181:0/2590982104 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12caed7640 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f43dc1800 0x555f43e3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cbed9640 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f43dc1c00 0x555f43e3d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.245 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 -- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f43dc1800 msgr2=0x555f43e3cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f43dc1800 0x555f43e3cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 -- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f43dc1c00 msgr2=0x555f43e3d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f43dc1c00 0x555f43e3d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 -- 172.21.15.181:0/2590982104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f43df8780 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f43dc0c00 0x555f43e3c580 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x555f44be5800 tx=0x555f44b60600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30293d6f065c43c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12c8ed3640 1 -- 172.21.15.181:0/2590982104 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555f43de6680 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12c8ed3640 1 -- 172.21.15.181:0/2590982104 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555f43decfc0 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12c8ed3640 1 -- 172.21.15.181:0/2590982104 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555f43de6b60 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12ccf31280 1 -- 172.21.15.181:0/2590982104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f43df94a0 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12ccf31280 1 -- 172.21.15.181:0/2590982104 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x555f43df8000 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12c8ed3640 1 -- 172.21.15.181:0/2590982104 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x555f44cb2600 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.243+0000 7f12c8ed3640 1 -- 172.21.15.181:0/2590982104 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x555f43e1b180 con 0x555f43dc0c00 2024-09-12T02:32:04.246 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.244+0000 7f12ccf31280 1 Processor -- start 2024-09-12T02:32:04.247 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.244+0000 7f12ccf31280 1 -- start start 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97400 0x555f43e3d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97800 0x555f43e3db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97c00 0x555f43e3e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12ccf31280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555f44b4c600 con 0x555f44c97800 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12ccf31280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x555f44b4c780 con 0x555f44c97400 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12ccf31280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x555f44b4c900 con 0x555f44c97c00 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97800 0x555f43e3db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97800 0x555f43e3db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43758/0 (socket says 172.21.15.181:43758) 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 -- 172.21.15.181:0/869301240 learned_addr learned my addr 172.21.15.181:0/869301240 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.252 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cbed9640 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97400 0x555f43e3d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12caed7640 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97c00 0x555f43e3e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 -- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97c00 msgr2=0x555f43e3e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97c00 0x555f43e3e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 -- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97400 msgr2=0x555f43e3d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97400 0x555f43e3d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 -- 172.21.15.181:0/869301240 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f43df83c0 con 0x555f44c97800 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cbed9640 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97400 0x555f43e3d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97800 0x555f43e3db80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x555f44cba6f0 tx=0x555f44b60b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b4f92f49d414b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12c6ecf640 1 -- 172.21.15.181:0/869301240 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555f43de6820 con 0x555f44c97800 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12c6ecf640 1 -- 172.21.15.181:0/869301240 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555f43dece00 con 0x555f44c97800 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.245+0000 7f12c6ecf640 1 -- 172.21.15.181:0/869301240 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555f43de6680 con 0x555f44c97800 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 -- 172.21.15.181:0/869301240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97800 msgr2=0x555f43e3db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.253 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97800 0x555f43e3db80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x555f44cba6f0 tx=0x555f44b60b40 comp rx=0 tx=0).stop 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 -- 172.21.15.181:0/869301240 shutdown_connections 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97c00 0x555f43e3e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97800 0x555f43e3db80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 --2- 172.21.15.181:0/869301240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97400 0x555f43e3d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 -- 172.21.15.181:0/869301240 >> 172.21.15.181:0/869301240 conn(0x555f44c97000 msgr2=0x555f43eb7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 -- 172.21.15.181:0/869301240 shutdown_connections 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 -- 172.21.15.181:0/869301240 wait complete. 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 Processor -- start 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.246+0000 7f12ccf31280 1 -- start start 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97400 0x555f43e3f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97800 0x555f43e3ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12ccf31280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97c00 0x555f43e3e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12ccf31280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555f44b4dc80 con 0x555f44c97c00 2024-09-12T02:32:04.254 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12ccf31280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x555f44b4ca80 con 0x555f44c97800 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12ccf31280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x555f44b4db00 con 0x555f44c97400 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97c00 0x555f43e3e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97c00 0x555f43e3e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43764/0 (socket says 172.21.15.181:43764) 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 -- 172.21.15.181:0/3820666723 learned_addr learned my addr 172.21.15.181:0/3820666723 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97800 0x555f43e3ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12cbed9640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97400 0x555f43e3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 -- 172.21.15.181:0/3820666723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97400 msgr2=0x555f43e3f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f44c97400 0x555f43e3f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 -- 172.21.15.181:0/3820666723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97800 msgr2=0x555f43e3ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f44c97800 0x555f43e3ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 -- 172.21.15.181:0/3820666723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f43df8780 con 0x555f44c97c00 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.247+0000 7f12caed7640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97c00 0x555f43e3e680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x555f44cbb8f0 tx=0x555f44b60ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.255 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.248+0000 7f12c56cc640 1 -- 172.21.15.181:0/3820666723 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555f43de69c0 con 0x555f44c97c00 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.248+0000 7f12c56cc640 1 -- 172.21.15.181:0/3820666723 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555f43dec1c0 con 0x555f44c97c00 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.248+0000 7f12c56cc640 1 -- 172.21.15.181:0/3820666723 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555f43de6820 con 0x555f44c97c00 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.248+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f43df94a0 con 0x555f44c97c00 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.248+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f43df8960 con 0x555f44c97c00 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.249+0000 7f12c56cc640 1 -- 172.21.15.181:0/3820666723 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x555f44d1ac00 con 0x555f44c97c00 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.249+0000 7f12c56cc640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x555f44d19400 0x555f43e3f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.249+0000 7f12c56cc640 1 -- 172.21.15.181:0/3820666723 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x555f44d24600 con 0x555f44c97c00 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.249+0000 7f12cbed9640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x555f44d19400 0x555f43e3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.249+0000 7f12ccf31280 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x555f44d19800 0x555f43e3e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.249+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x555f44d19c00 con 0x555f44d19800 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.249+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x555f44d19800 0x555f43e3e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.256 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12cbed9640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x555f44d19400 0x555f43e3f700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x555f44b50e10 tx=0x555f44cbefc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12cb6d8640 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x555f44d19800 0x555f43e3e100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12cb6d8640 1 -- 172.21.15.181:0/3820666723 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x555f43ea8000 con 0x555f44d19800 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x555f44d18c00 con 0x555f44d19800 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12cb6d8640 1 -- 172.21.15.181:0/3820666723 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x555f43ea8000 con 0x555f44d19800 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stdout:{ 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stdout: "magic": "ceph fs volume v011", 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stdout: "write_pos": 4200187, 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stdout: "expire_pos": 4194304, 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stdout: "trimmed_pos": 4194304, 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stdout: "stream_format": 1, 2024-09-12T02:32:04.257 INFO:tasks.workunit.client.0.smithi181.stdout: "layout": { 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout: "stripe_unit": 4194304, 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout: "stripe_count": 1, 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout: "object_size": 4194304, 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout: "pool_id": 6, 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout: "pool_ns": "" 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout: } 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout:} 2024-09-12T02:32:04.258 INFO:tasks.workunit.client.0.smithi181.stdout: 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x555f44d19800 msgr2=0x555f43e3e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x555f44d19800 0x555f43e3e100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x555f44d19400 msgr2=0x555f43e3f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x555f44d19400 0x555f43e3f700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x555f44b50e10 tx=0x555f44cbefc0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97c00 msgr2=0x555f43e3e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 --2- 172.21.15.181:0/3820666723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f44c97c00 0x555f43e3e680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x555f44cbb8f0 tx=0x555f44b60ae0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12caed7640 1 -- 172.21.15.181:0/3820666723 reap_dead start 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 shutdown_connections 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 >> 172.21.15.181:0/3820666723 conn(0x555f44c97000 msgr2=0x555f43eb7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 shutdown_connections 2024-09-12T02:32:04.260 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.250+0000 7f12ccf31280 1 -- 172.21.15.181:0/3820666723 wait complete. 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 -- 172.21.15.181:0/2590982104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f43dc0c00 msgr2=0x555f43e3c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f43dc0c00 0x555f43e3c580 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x555f44be5800 tx=0x555f44b60600 comp rx=0 tx=0).stop 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 -- 172.21.15.181:0/2590982104 shutdown_connections 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555f43dc1c00 0x555f43e3d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555f43dc1800 0x555f43e3cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 --2- 172.21.15.181:0/2590982104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555f43dc0c00 0x555f43e3c580 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 -- 172.21.15.181:0/2590982104 >> 172.21.15.181:0/2590982104 conn(0x555f43dc1000 msgr2=0x555f43eb6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 -- 172.21.15.181:0/2590982104 shutdown_connections 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.251+0000 7f12ccf31280 1 -- 172.21.15.181:0/2590982104 wait complete. 2024-09-12T02:32:04.261 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2024-09-12T02:32:04.282 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.281+0000 7fbd03956280 1 -- start start 2024-09-12T02:32:04.282 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.281+0000 7fbd03956280 1 Processor -- start 2024-09-12T02:32:04.284 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a35fd30c00 0x55a35fdac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.284 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a35fd31800 0x55a35fdacb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.284 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd03956280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a35fd31c00 0x55a35fdad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.284 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd03956280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a360b1a180 con 0x55a35fd31c00 2024-09-12T02:32:04.284 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a360b1a300 con 0x55a35fd30c00 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a360b1a480 con 0x55a35fd31800 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a35fd31c00 0x55a35fdad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a35fd31c00 0x55a35fdad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43782/0 (socket says 172.21.15.181:43782) 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 -- 172.21.15.181:0/3419481956 learned_addr learned my addr 172.21.15.181:0/3419481956 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd020fb640 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a35fd30c00 0x55a35fdac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd018fa640 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a35fd31800 0x55a35fdacb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 -- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a35fd31800 msgr2=0x55a35fdacb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a35fd31800 0x55a35fdacb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 -- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a35fd30c00 msgr2=0x55a35fdac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a35fd30c00 0x55a35fdac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 -- 172.21.15.181:0/3419481956 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35fd68780 con 0x55a35fd31c00 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.282+0000 7fbd028fc640 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a35fd31c00 0x55a35fdad080 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55a360b5b800 tx=0x55a360ad0540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2965ade07f5ed228 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.285 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbcff8f6640 1 -- 172.21.15.181:0/3419481956 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd56680 con 0x55a35fd31c00 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbcff8f6640 1 -- 172.21.15.181:0/3419481956 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a35fd5cfc0 con 0x55a35fd31c00 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbcff8f6640 1 -- 172.21.15.181:0/3419481956 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd56b60 con 0x55a35fd31c00 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbd03956280 1 -- 172.21.15.181:0/3419481956 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35fd683c0 con 0x55a35fd31c00 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbd03956280 1 -- 172.21.15.181:0/3419481956 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a35fd69680 con 0x55a35fd31c00 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbcff8f6640 1 -- 172.21.15.181:0/3419481956 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a360c0c600 con 0x55a35fd31c00 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbcff8f6640 1 -- 172.21.15.181:0/3419481956 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55a35fd8b180 con 0x55a35fd31c00 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.283+0000 7fbd03956280 1 Processor -- start 2024-09-12T02:32:04.286 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd03956280 1 -- start start 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19400 0x55a35fdad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd03956280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19800 0x55a35fdadb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 0x55a35fdae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd03956280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a360b1a600 con 0x55a360c19800 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a360b1a780 con 0x55a360c19c00 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a360b1a900 con 0x55a360c19400 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19800 0x55a35fdadb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19800 0x55a35fdadb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43784/0 (socket says 172.21.15.181:43784) 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 -- 172.21.15.181:0/3274929585 learned_addr learned my addr 172.21.15.181:0/3274929585 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd018fa640 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19400 0x55a35fdad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.292 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd018fa640 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 0x55a35fdae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 -- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19400 msgr2=0x55a35fdad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19400 0x55a35fdad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 -- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 msgr2=0x55a35fdae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 0x55a35fdae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd020fb640 1 -- 172.21.15.181:0/3274929585 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35fd694a0 con 0x55a360c19800 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.284+0000 7fbd018fa640 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19400 0x55a35fdad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd020fb640 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19800 0x55a35fdadb80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55a360c26660 tx=0x55a360ad1e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f22a3fc5a106b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbcfd8f2640 1 -- 172.21.15.181:0/3274929585 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd569c0 con 0x55a360c19800 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbcfd8f2640 1 -- 172.21.15.181:0/3274929585 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a35fd5ce00 con 0x55a360c19800 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbcfd8f2640 1 -- 172.21.15.181:0/3274929585 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd56680 con 0x55a360c19800 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 -- 172.21.15.181:0/3274929585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19800 msgr2=0x55a35fdadb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19800 0x55a35fdadb80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55a360c26660 tx=0x55a360ad1e60 comp rx=0 tx=0).stop 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 -- 172.21.15.181:0/3274929585 shutdown_connections 2024-09-12T02:32:04.293 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 0x55a35fdae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19800 0x55a35fdadb80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 --2- 172.21.15.181:0/3274929585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19400 0x55a35fdad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 -- 172.21.15.181:0/3274929585 >> 172.21.15.181:0/3274929585 conn(0x55a360c19000 msgr2=0x55a360abd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 -- 172.21.15.181:0/3274929585 shutdown_connections 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.285+0000 7fbd03956280 1 -- 172.21.15.181:0/3274929585 wait complete. 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 Processor -- start 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 -- start start 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19400 0x55a35fdaf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19800 0x55a35fdaec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 0x55a35fdae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a35fd92180 con 0x55a360c19400 2024-09-12T02:32:04.294 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a360b1be00 con 0x55a360c19c00 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a360b1ad80 con 0x55a360c19800 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd018fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19400 0x55a35fdaf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd018fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19400 0x55a35fdaf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43786/0 (socket says 172.21.15.181:43786) 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd018fa640 1 -- 172.21.15.181:0/1468703236 learned_addr learned my addr 172.21.15.181:0/1468703236 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.286+0000 7fbd020fb640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19800 0x55a35fdaec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd018fa640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 0x55a35fdae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd018fa640 1 -- 172.21.15.181:0/1468703236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19800 msgr2=0x55a35fdaec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd018fa640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a360c19800 0x55a35fdaec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd018fa640 1 -- 172.21.15.181:0/1468703236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 msgr2=0x55a35fdae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd018fa640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a360c19c00 0x55a35fdae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd018fa640 1 -- 172.21.15.181:0/1468703236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35fd68780 con 0x55a360c19400 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd018fa640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19400 0x55a35fdaf180 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55a360c27a10 tx=0x55a360c2ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.295 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbcfc0ef640 1 -- 172.21.15.181:0/1468703236 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd569c0 con 0x55a360c19400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbcfc0ef640 1 -- 172.21.15.181:0/1468703236 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a35fd5ca80 con 0x55a360c19400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a35fd683c0 con 0x55a360c19400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbcfc0ef640 1 -- 172.21.15.181:0/1468703236 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd56680 con 0x55a360c19400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.287+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35fd68000 con 0x55a360c19400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.288+0000 7fbcfc0ef640 1 -- 172.21.15.181:0/1468703236 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a360c7ec00 con 0x55a360c19400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.288+0000 7fbcfc0ef640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a360b3b000 0x55a35fdaf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.288+0000 7fbcfc0ef640 1 -- 172.21.15.181:0/1468703236 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a360b40a00 con 0x55a360c19400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.288+0000 7fbd020fb640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a360b3b000 0x55a35fdaf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd03956280 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a360b3b400 0x55a35fdae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a360b3b800 con 0x55a360b3b400 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd018fa640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a360b3b400 0x55a35fdae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd020fb640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a360b3b000 0x55a35fdaf700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55a360c26660 tx=0x55a360ad0ae0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd018fa640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a360b3b400 0x55a35fdae100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.296 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd018fa640 1 -- 172.21.15.181:0/1468703236 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55a360ac8000 con 0x55a360b3b400 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a360b3bc00 con 0x55a360b3b400 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.289+0000 7fbd018fa640 1 -- 172.21.15.181:0/1468703236 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55a360ac8000 con 0x55a360b3b400 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.290+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a3600c2000 con 0x55a360b3b400 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.290+0000 7fbd018fa640 1 -- 172.21.15.181:0/1468703236 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv21 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x55a360ac8000 con 0x55a360b3b400 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.290+0000 7fbd03956280 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2400 0x55a35fdadb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.290+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a3600c2800 con 0x55a3600c2400 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.290+0000 7fbd028fc640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2400 0x55a35fdadb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.290+0000 7fbd028fc640 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2400 0x55a35fdadb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.290+0000 7fbd028fc640 1 -- 172.21.15.181:0/1468703236 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a3600d0f00 con 0x55a3600c2400 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.291+0000 7fbd03956280 1 -- start start 2024-09-12T02:32:04.297 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.291+0000 7fbd03956280 1 Processor -- start 2024-09-12T02:32:04.300 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a3600c3000 0x55a35fdad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.300 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a3600c3400 0x55a36012e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.300 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3600c3800 0x55a36012e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a360b1bc80 con 0x55a3600c3800 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a360b1a780 con 0x55a3600c3400 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a360b1aa80 con 0x55a3600c3000 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3600c3800 0x55a36012e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3600c3800 0x55a36012e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43800/0 (socket says 172.21.15.181:43800) 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 -- 172.21.15.181:0/51107397 learned_addr learned my addr 172.21.15.181:0/51107397 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd028fc640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a3600c3400 0x55a36012e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd018fa640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a3600c3000 0x55a35fdad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 -- 172.21.15.181:0/51107397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a3600c3000 msgr2=0x55a35fdad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a3600c3000 0x55a35fdad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 -- 172.21.15.181:0/51107397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a3600c3400 msgr2=0x55a36012e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a3600c3400 0x55a36012e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.301 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35fd68960 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd028fc640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a3600c3400 0x55a36012e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd020fb640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3600c3800 0x55a36012e580 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55a360059e60 tx=0x55a360ad1ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1982f283622e383 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbcf90e9640 1 -- 172.21.15.181:0/51107397 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd56b60 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbcf90e9640 1 -- 172.21.15.181:0/51107397 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a35fd5cc40 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbcf90e9640 1 -- 172.21.15.181:0/51107397 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a35fd564e0 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35fd68780 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.292+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a35fd683c0 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbcf90e9640 1 -- 172.21.15.181:0/51107397 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a360136200 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbcf90e9640 1 -- 172.21.15.181:0/51107397 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55a35fd8b500 con 0x55a3600c3800 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbd03956280 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a3600c3c00 0x55a36012eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a360139400 con 0x55a3600c3c00 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbd018fa640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a3600c3c00 0x55a36012eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.302 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbd018fa640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a3600c3c00 0x55a36012eb00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=a6ff820c856ab59a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbd018fa640 1 -- 172.21.15.181:0/51107397 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55a360ac8000 con 0x55a3600c3c00 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.293+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a360139800 con 0x55a3600c3c00 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbd018fa640 1 -- 172.21.15.181:0/51107397 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55a360ac8000 con 0x55a3600c3c00 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbcf78e6640 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x55a360b3b800 con 0x55a3600c3c00 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbcf78e6640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2000 0x55a360130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbcf78e6640 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x55a360b3bc00 con 0x55a3600c2000 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbd028fc640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2000 0x55a360130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbd018fa640 1 -- 172.21.15.181:0/51107397 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv21 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55a360ac8000 con 0x55a3600c3c00 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbd028fc640 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2000 0x55a360130680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=f92617a1831e4ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.303 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbd028fc640 1 -- 172.21.15.181:0/51107397 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a3600d0f00 con 0x55a3600c2000 2024-09-12T02:32:04.304 INFO:tasks.workunit.client.0.smithi181.stdout:journal is 4194304~30182 2024-09-12T02:32:04.304 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.294+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [read 0~30182] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a360139c00 con 0x55a3600c3c00 2024-09-12T02:32:04.304 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd018fa640 1 -- 172.21.15.181:0/51107397 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(5 200.00000001 [read 0~30182 out=30182b] v0'0 uv21 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x55a360ac8000 con 0x55a3600c3c00 2024-09-12T02:32:04.304 INFO:tasks.workunit.client.0.smithi181.stdout:wrote 30182 bytes at offset 4194304 to /tmp/journal.bin 2024-09-12T02:32:04.304 INFO:tasks.workunit.client.0.smithi181.stdout:NOTE: this is a _sparse_ file; you can 2024-09-12T02:32:04.304 INFO:tasks.workunit.client.0.smithi181.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2024-09-12T02:32:04.305 INFO:tasks.workunit.client.0.smithi181.stdout: to efficiently compress it while preserving sparseness. 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a3600c3c00 msgr2=0x55a36012eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a3600c3c00 0x55a36012eb00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2000 msgr2=0x55a360130680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2000 0x55a360130680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3600c3800 msgr2=0x55a36012e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/51107397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3600c3800 0x55a36012e580 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55a360059e60 tx=0x55a360ad1ec0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd020fb640 1 -- 172.21.15.181:0/51107397 reap_dead start 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 shutdown_connections 2024-09-12T02:32:04.307 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 >> 172.21.15.181:0/51107397 conn(0x55a3600c2c00 msgr2=0x55a360abd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 shutdown_connections 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/51107397 wait complete. 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a360b3b400 msgr2=0x55a35fdae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a360b3b400 0x55a35fdae100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2400 msgr2=0x55a35fdadb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a3600c2400 0x55a35fdadb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a360b3b000 msgr2=0x55a35fdaf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a360b3b000 0x55a35fdaf700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55a360c26660 tx=0x55a360ad0ae0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19400 msgr2=0x55a35fdaf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd020fb640 1 -- 172.21.15.181:0/1468703236 reap_dead start 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19400 0x55a35fdaf180 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55a360c27a10 tx=0x55a360c2ac60 comp rx=0 tx=0).stop 2024-09-12T02:32:04.308 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 shutdown_connections 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 --2- 172.21.15.181:0/1468703236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a360c19400 0x55a35fdaf180 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 >> 172.21.15.181:0/1468703236 conn(0x55a360c19000 msgr2=0x55a360abd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 shutdown_connections 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.295+0000 7fbd03956280 1 -- 172.21.15.181:0/1468703236 wait complete. 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 -- 172.21.15.181:0/3419481956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a35fd31c00 msgr2=0x55a35fdad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a35fd31c00 0x55a35fdad080 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55a360b5b800 tx=0x55a360ad0540 comp rx=0 tx=0).stop 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 -- 172.21.15.181:0/3419481956 shutdown_connections 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a35fd31c00 0x55a35fdad080 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a35fd31800 0x55a35fdacb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 --2- 172.21.15.181:0/3419481956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a35fd30c00 0x55a35fdac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 -- 172.21.15.181:0/3419481956 >> 172.21.15.181:0/3419481956 conn(0x55a35fd31000 msgr2=0x55a360abc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 -- 172.21.15.181:0/3419481956 shutdown_connections 2024-09-12T02:32:04.309 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.296+0000 7fbd03956280 1 -- 172.21.15.181:0/3419481956 wait complete. 2024-09-12T02:32:04.310 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' '!' -s /tmp/journal.bin ']' 2024-09-12T02:32:04.310 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-12T02:32:04.327 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.326+0000 7fd53c1b5280 1 -- start start 2024-09-12T02:32:04.327 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.326+0000 7fd53c1b5280 1 Processor -- start 2024-09-12T02:32:04.329 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97cdb0c00 0x55a97ce2c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.329 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97cdb1800 0x55a97ce2cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.329 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97cdb1c00 0x55a97ce2d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.329 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92180 con 0x55a97cdb1c00 2024-09-12T02:32:04.329 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92300 con 0x55a97cdb0c00 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a97db92480 con 0x55a97cdb1800 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97cdb1c00 0x55a97ce2d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97cdb1c00 0x55a97ce2d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43828/0 (socket says 172.21.15.181:43828) 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 -- 172.21.15.181:0/1589502438 learned_addr learned my addr 172.21.15.181:0/1589502438 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 -- 172.21.15.181:0/1589502438 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97cdb1800 msgr2=0x55a97ce2cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 --2- 172.21.15.181:0/1589502438 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97cdb1800 0x55a97ce2cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 -- 172.21.15.181:0/1589502438 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97cdb0c00 msgr2=0x55a97ce2c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 --2- 172.21.15.181:0/1589502438 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97cdb0c00 0x55a97ce2c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.327+0000 7fd53b15b640 1 -- 172.21.15.181:0/1589502438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97cde8780 con 0x55a97cdb1c00 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd53b15b640 1 --2- 172.21.15.181:0/1589502438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97cdb1c00 0x55a97ce2d080 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55a97dbcd950 tx=0x55a97db50240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd560c29431c967e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd538155640 1 -- 172.21.15.181:0/1589502438 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97cdd6680 con 0x55a97cdb1c00 2024-09-12T02:32:04.330 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd538155640 1 -- 172.21.15.181:0/1589502438 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a97cddc700 con 0x55a97cdb1c00 2024-09-12T02:32:04.331 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd538155640 1 -- 172.21.15.181:0/1589502438 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97cdd6b60 con 0x55a97cdb1c00 2024-09-12T02:32:04.331 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1589502438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97cde94a0 con 0x55a97cdb1c00 2024-09-12T02:32:04.331 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1589502438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a97cde8000 con 0x55a97cdb1c00 2024-09-12T02:32:04.331 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd538155640 1 -- 172.21.15.181:0/1589502438 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a97dc84600 con 0x55a97cdb1c00 2024-09-12T02:32:04.331 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.328+0000 7fd538155640 1 -- 172.21.15.181:0/1589502438 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55a97ce0b180 con 0x55a97cdb1c00 2024-09-12T02:32:04.331 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 Processor -- start 2024-09-12T02:32:04.331 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 -- start start 2024-09-12T02:32:04.338 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89400 0x55a97ce2d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.338 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89c00 0x55a97ce2e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92600 con 0x55a97dc89800 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92780 con 0x55a97dc89c00 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a97db92900 con 0x55a97dc89400 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53a95a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53a95a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43836/0 (socket says 172.21.15.181:43836) 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53a95a640 1 -- 172.21.15.181:0/1085646565 learned_addr learned my addr 172.21.15.181:0/1085646565 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.329+0000 7fd53a159640 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89c00 0x55a97ce2e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a159640 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89400 0x55a97ce2d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a95a640 1 -- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89400 msgr2=0x55a97ce2d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a95a640 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89400 0x55a97ce2d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.339 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a95a640 1 -- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89c00 msgr2=0x55a97ce2e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a95a640 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89c00 0x55a97ce2e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a95a640 1 -- 172.21.15.181:0/1085646565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97cde83c0 con 0x55a97dc89800 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a159640 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89400 0x55a97ce2d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53a95a640 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2db80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55a97dc9a7e0 tx=0x55a97dca3020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c31ee1a534713cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd536151640 1 -- 172.21.15.181:0/1085646565 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97cdd6680 con 0x55a97dc89800 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd536151640 1 -- 172.21.15.181:0/1085646565 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a97cddcfc0 con 0x55a97dc89800 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd536151640 1 -- 172.21.15.181:0/1085646565 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97cdd6b60 con 0x55a97dc89800 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1085646565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 msgr2=0x55a97ce2db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2db80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55a97dc9a7e0 tx=0x55a97dca3020 comp rx=0 tx=0).stop 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1085646565 shutdown_connections 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89c00 0x55a97ce2e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2db80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.340 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1085646565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89400 0x55a97ce2d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1085646565 >> 172.21.15.181:0/1085646565 conn(0x55a97dc89000 msgr2=0x55a97cea7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1085646565 shutdown_connections 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.330+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1085646565 wait complete. 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 Processor -- start 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 -- start start 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89400 0x55a97ce2f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89c00 0x55a97ce2e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92d80 con 0x55a97dc89800 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92f00 con 0x55a97dc89400 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.331+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a97db93080 con 0x55a97dc89c00 2024-09-12T02:32:04.341 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43842/0 (socket says 172.21.15.181:43842) 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 -- 172.21.15.181:0/3827502378 learned_addr learned my addr 172.21.15.181:0/3827502378 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a159640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89400 0x55a97ce2f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a159640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89c00 0x55a97ce2e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 -- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89c00 msgr2=0x55a97ce2e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89c00 0x55a97ce2e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 -- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89400 msgr2=0x55a97ce2f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89400 0x55a97ce2f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 -- 172.21.15.181:0/3827502378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97cde8780 con 0x55a97dc89800 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2ec00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55a97dc9baa0 tx=0x55a97dca2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53494e640 1 -- 172.21.15.181:0/3827502378 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97cdd64e0 con 0x55a97dc89800 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53494e640 1 -- 172.21.15.181:0/3827502378 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a97cddce00 con 0x55a97dc89800 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a97cde94a0 con 0x55a97dc89800 2024-09-12T02:32:04.342 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53494e640 1 -- 172.21.15.181:0/3827502378 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97cdd6680 con 0x55a97dc89800 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.332+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97cde8960 con 0x55a97dc89800 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.333+0000 7fd53494e640 1 -- 172.21.15.181:0/3827502378 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a97dcfcc00 con 0x55a97dc89800 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.334+0000 7fd53494e640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a97dcff000 0x55a97ce2f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.334+0000 7fd53494e640 1 -- 172.21.15.181:0/3827502378 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a97dcfaa00 con 0x55a97dc89800 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.334+0000 7fd53a159640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a97dcff000 0x55a97ce2f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.334+0000 7fd53a159640 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a97dcff000 0x55a97ce2f700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a97ce98c30 tx=0x55a97dca2ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.334+0000 7fd53c1b5280 1 -- start start 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.334+0000 7fd53c1b5280 1 Processor -- start 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dcff800 0x55a97ce2e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dcffc00 0x55a97ce2db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53c1b5280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97d198000 0x55a97ce2d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92600 con 0x55a97dcffc00 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a97db92780 con 0x55a97d198000 2024-09-12T02:32:04.343 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53c1b5280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a97db92a80 con 0x55a97dcff800 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dcffc00 0x55a97ce2db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dcffc00 0x55a97ce2db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43852/0 (socket says 172.21.15.181:43852) 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 -- 172.21.15.181:0/3143233155 learned_addr learned my addr 172.21.15.181:0/3143233155 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a159640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97d198000 0x55a97ce2d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53b15b640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dcff800 0x55a97ce2e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 -- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dcff800 msgr2=0x55a97ce2e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dcff800 0x55a97ce2e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 -- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97d198000 msgr2=0x55a97ce2d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97d198000 0x55a97ce2d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.335+0000 7fd53a95a640 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97cde9680 con 0x55a97dcffc00 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dcffc00 0x55a97ce2db80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55a97d0e9770 tx=0x55a97dca3980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd59ebc0ffbcf40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd531948640 1 -- 172.21.15.181:0/3143233155 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97d0d2d00 con 0x55a97dcffc00 2024-09-12T02:32:04.344 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd531948640 1 -- 172.21.15.181:0/3143233155 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a97cddcc40 con 0x55a97dcffc00 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd531948640 1 -- 172.21.15.181:0/3143233155 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a97d0d2ea0 con 0x55a97dcffc00 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97cde94a0 con 0x55a97dcffc00 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a97cde8960 con 0x55a97dcffc00 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd531948640 1 -- 172.21.15.181:0/3143233155 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a97d19e600 con 0x55a97dcffc00 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd531948640 1 -- 172.21.15.181:0/3143233155 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55a97ce0b500 con 0x55a97dcffc00 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a97d198400 0x55a97d1b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a97d198800 con 0x55a97d198400 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd53b15b640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a97d198400 0x55a97d1b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.336+0000 7fd53b15b640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a97d198400 0x55a97d1b6000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=405ee578aadc46f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd53b15b640 1 -- 172.21.15.181:0/3143233155 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55a97ce9a000 con 0x55a97d198400 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a97d198c00 con 0x55a97d198400 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd53b15b640 1 -- 172.21.15.181:0/3143233155 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55a97ce9a000 con 0x55a97d198400 2024-09-12T02:32:04.345 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd530145640 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x55a97d1a1400 con 0x55a97d198400 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd530145640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a97d1a1800 0x55a97d1b8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd530145640 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x55a97d1a1c00 con 0x55a97d1a1800 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd53a159640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a97d1a1800 0x55a97d1b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd53b15b640 1 -- 172.21.15.181:0/3143233155 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv21 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55a97ce9a000 con 0x55a97d198400 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.337+0000 7fd53a159640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a97d1a1800 0x55a97d1b8680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=d57200c8895e3ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.338+0000 7fd53a159640 1 -- 172.21.15.181:0/3143233155 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a500 con 0x55a97d1a1800 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stdout:old journal was 4194304~30182 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stdout:new journal start will be 8388608 (4164122 bytes past old end) 2024-09-12T02:32:04.346 INFO:tasks.workunit.client.0.smithi181.stdout:writing journal head 2024-09-12T02:32:04.347 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.338+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97d199000 con 0x55a97d198400 2024-09-12T02:32:04.347 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53b15b640 1 -- 172.21.15.181:0/3143233155 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v48'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a000 con 0x55a97d198400 2024-09-12T02:32:04.347 INFO:tasks.workunit.client.0.smithi181.stdout:writing EResetJournal entry 2024-09-12T02:32:04.349 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97d199400 con 0x55a97d1a1800 2024-09-12T02:32:04.349 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:7 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97d198800 con 0x55a97d1a1800 2024-09-12T02:32:04.349 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:8 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97d198c00 con 0x55a97d1a1800 2024-09-12T02:32:04.349 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a97d199000 0x55a97d1b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.349 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97d1a1400 con 0x55a97d199000 2024-09-12T02:32:04.349 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:10 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97dc88800 con 0x55a97d199000 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a97d199400 0x55a97d1b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:11 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97d198800 con 0x55a97d199400 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a97d199400 0x55a97d1b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53b15b640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a97d199000 0x55a97d1b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.340+0000 7fd53a95a640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a97d199400 0x55a97d1b6b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=b1ef6fcaf56df563 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.341+0000 7fd53b15b640 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a97d199000 0x55a97d1b6580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=bdd3dd85c99c6aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.341+0000 7fd53a159640 1 -- 172.21.15.181:0/3143233155 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(6 200.00000002 [delete] v48'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a500 con 0x55a97d1a1800 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.341+0000 7fd53a159640 1 -- 172.21.15.181:0/3143233155 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(8 200.00000004 [delete] v48'5 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a500 con 0x55a97d1a1800 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.341+0000 7fd53a159640 1 -- 172.21.15.181:0/3143233155 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(7 200.00000003 [delete] v48'3 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a500 con 0x55a97d1a1800 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.341+0000 7fd530145640 1 -- 172.21.15.181:0/3143233155 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:12 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a97d1d0000 con 0x55a97d1a1800 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.342+0000 7fd53a95a640 1 -- 172.21.15.181:0/3143233155 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(11 200.00000007 [delete] v48'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a780 con 0x55a97d199400 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53b15b640 1 -- 172.21.15.181:0/3143233155 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(10 200.00000006 [delete] v48'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a000 con 0x55a97d199000 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53b15b640 1 -- 172.21.15.181:0/3143233155 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(9 200.00000005 [delete] v48'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a000 con 0x55a97d199000 2024-09-12T02:32:04.350 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53a159640 1 -- 172.21.15.181:0/3143233155 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v48'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a97ce9a500 con 0x55a97d1a1800 2024-09-12T02:32:04.351 INFO:tasks.workunit.client.0.smithi181.stdout:done 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a97d199400 msgr2=0x55a97d1b6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55a97d199400 0x55a97d1b6b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a97d198400 msgr2=0x55a97d1b6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a97d198400 0x55a97d1b6000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a97d1a1800 msgr2=0x55a97d1b8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55a97d1a1800 0x55a97d1b8680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a97d199000 msgr2=0x55a97d1b6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a97d199000 0x55a97d1b6580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53a159640 1 -- 172.21.15.181:0/3143233155 reap_dead start 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dcffc00 msgr2=0x55a97ce2db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.353 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dcffc00 0x55a97ce2db80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55a97d0e9770 tx=0x55a97dca3980 comp rx=0 tx=0).stop 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 shutdown_connections 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3143233155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dcffc00 0x55a97ce2db80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 >> 172.21.15.181:0/3143233155 conn(0x55a97dcff400 msgr2=0x55a97cea7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53a159640 1 -- 172.21.15.181:0/3143233155 reap_dead start 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 shutdown_connections 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.344+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3143233155 wait complete. 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a97dcff000 msgr2=0x55a97ce2f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a97dcff000 0x55a97ce2f700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a97ce98c30 tx=0x55a97dca2ea0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 msgr2=0x55a97ce2ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2ec00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55a97dc9baa0 tx=0x55a97dca2c00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 shutdown_connections 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a97dcff000 0x55a97ce2f700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97dc89c00 0x55a97ce2e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.354 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97dc89800 0x55a97ce2ec00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/3827502378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97dc89400 0x55a97ce2f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 >> 172.21.15.181:0/3827502378 conn(0x55a97dc89000 msgr2=0x55a97cea7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 shutdown_connections 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/3827502378 wait complete. 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1589502438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97cdb1c00 msgr2=0x55a97ce2d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1589502438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97cdb1c00 0x55a97ce2d080 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55a97dbcd950 tx=0x55a97db50240 comp rx=0 tx=0).stop 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1589502438 shutdown_connections 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1589502438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a97cdb1c00 0x55a97ce2d080 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1589502438 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a97cdb1800 0x55a97ce2cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 --2- 172.21.15.181:0/1589502438 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a97cdb0c00 0x55a97ce2c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1589502438 >> 172.21.15.181:0/1589502438 conn(0x55a97cdb1000 msgr2=0x55a97cea6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1589502438 shutdown_connections 2024-09-12T02:32:04.355 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.345+0000 7fd53c1b5280 1 -- 172.21.15.181:0/1589502438 wait complete. 2024-09-12T02:32:04.356 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2024-09-12T02:32:04.375 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 -- start start 2024-09-12T02:32:04.376 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 Processor -- start 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564464ad0c00 0x564464b4c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564464ad1800 0x564464b4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564464ad1c00 0x564464b4d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564464c4c180 con 0x564464ad1800 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x564464c4c300 con 0x564464ad1c00 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f1760b88280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x564464c4c480 con 0x564464ad0c00 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f175eb2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564464ad1800 0x564464b4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f175eb2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564464ad1800 0x564464b4cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43868/0 (socket says 172.21.15.181:43868) 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.375+0000 7f175eb2c640 1 -- 172.21.15.181:0/475216449 learned_addr learned my addr 172.21.15.181:0/475216449 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.384 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175f32d640 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564464ad0c00 0x564464b4c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175fb2e640 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564464ad1c00 0x564464b4d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175eb2c640 1 -- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564464ad0c00 msgr2=0x564464b4c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175eb2c640 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564464ad0c00 0x564464b4c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175eb2c640 1 -- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564464ad1c00 msgr2=0x564464b4d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175eb2c640 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564464ad1c00 0x564464b4d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175eb2c640 1 -- 172.21.15.181:0/475216449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564464b08780 con 0x564464ad1800 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175fb2e640 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564464ad1c00 0x564464b4d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175eb2c640 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564464ad1800 0x564464b4cb00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x5644658df770 tx=0x564465870ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6c44a55e6f56ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175cb28640 1 -- 172.21.15.181:0/475216449 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564464af69c0 con 0x564464ad1800 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175cb28640 1 -- 172.21.15.181:0/475216449 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564464afcfc0 con 0x564464ad1800 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175cb28640 1 -- 172.21.15.181:0/475216449 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564464af6680 con 0x564464ad1800 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f1760b88280 1 -- 172.21.15.181:0/475216449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564464b083c0 con 0x564464ad1800 2024-09-12T02:32:04.385 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f1760b88280 1 -- 172.21.15.181:0/475216449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564464b09680 con 0x564464ad1800 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175cb28640 1 -- 172.21.15.181:0/475216449 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5644659a8200 con 0x564464ad1800 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.376+0000 7f175cb28640 1 -- 172.21.15.181:0/475216449 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x564464b2b180 con 0x564464ad1800 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.377+0000 7f1760b88280 1 Processor -- start 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.377+0000 7f1760b88280 1 -- start start 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.377+0000 7f1760b88280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec000 0x564464b4d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.377+0000 7f1760b88280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec400 0x564464b4db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.377+0000 7f1760b88280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec800 0x564464b4e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f1760b88280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564464c4c600 con 0x5644659ec000 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f1760b88280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x564464c4c780 con 0x5644659ec400 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f1760b88280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x564464c4c900 con 0x5644659ec800 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec000 0x564464b4d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec000 0x564464b4d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43882/0 (socket says 172.21.15.181:43882) 2024-09-12T02:32:04.386 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 -- 172.21.15.181:0/1176421466 learned_addr learned my addr 172.21.15.181:0/1176421466 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175f32d640 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec400 0x564464b4db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175eb2c640 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec800 0x564464b4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 -- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec800 msgr2=0x564464b4e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec800 0x564464b4e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 -- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec400 msgr2=0x564464b4db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec400 0x564464b4db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 -- 172.21.15.181:0/1176421466 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564464b094a0 con 0x5644659ec000 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec000 0x564464b4d600 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x5644659aa7e0 tx=0x5644659aec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842f3f0162e80c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175ab24640 1 -- 172.21.15.181:0/1176421466 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564464af69c0 con 0x5644659ec000 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175ab24640 1 -- 172.21.15.181:0/1176421466 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564464afcc40 con 0x5644659ec000 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.378+0000 7f175ab24640 1 -- 172.21.15.181:0/1176421466 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564464af6680 con 0x5644659ec000 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 -- 172.21.15.181:0/1176421466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec000 msgr2=0x564464b4d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.387 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec000 0x564464b4d600 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x5644659aa7e0 tx=0x5644659aec00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 -- 172.21.15.181:0/1176421466 shutdown_connections 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec400 0x564464b4db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec800 0x564464b4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 --2- 172.21.15.181:0/1176421466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec000 0x564464b4d600 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 -- 172.21.15.181:0/1176421466 >> 172.21.15.181:0/1176421466 conn(0x56446586fc00 msgr2=0x564464bc7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 -- 172.21.15.181:0/1176421466 shutdown_connections 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 -- 172.21.15.181:0/1176421466 wait complete. 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 Processor -- start 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.379+0000 7f1760b88280 1 -- start start 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec000 0x564464b4f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec400 0x564464b4ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec800 0x564464b4e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.388 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564464c4d980 con 0x5644659ec800 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x564464c4c300 con 0x5644659ec000 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x564464c4cc00 con 0x5644659ec400 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec800 0x564464b4e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec800 0x564464b4e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43892/0 (socket says 172.21.15.181:43892) 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 -- 172.21.15.181:0/1597348810 learned_addr learned my addr 172.21.15.181:0/1597348810 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175f32d640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec400 0x564464b4ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec000 0x564464b4f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 -- 172.21.15.181:0/1597348810 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec400 msgr2=0x564464b4ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5644659ec400 0x564464b4ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 -- 172.21.15.181:0/1597348810 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec000 msgr2=0x564464b4f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5644659ec000 0x564464b4f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 -- 172.21.15.181:0/1597348810 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564464b08000 con 0x5644659ec800 2024-09-12T02:32:04.389 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f175eb2c640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec800 0x564464b4e680 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x5644658dfdd0 tx=0x564464b8d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1759321640 1 -- 172.21.15.181:0/1597348810 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564464af6b60 con 0x5644659ec800 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1759321640 1 -- 172.21.15.181:0/1597348810 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564464afce00 con 0x5644659ec800 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564464b08960 con 0x5644659ec800 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1759321640 1 -- 172.21.15.181:0/1597348810 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564464af6820 con 0x5644659ec800 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.380+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564464b09860 con 0x5644659ec800 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f1759321640 1 -- 172.21.15.181:0/1597348810 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5644659fcc00 con 0x5644659ec800 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f1759321640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564465a19400 0x564464b4f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f1759321640 1 -- 172.21.15.181:0/1597348810 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5644659f3200 con 0x5644659ec800 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564465a19400 0x564464b4f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f1760b88280 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5644659ecc00 0x564464b4e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5644659ed000 con 0x5644659ecc00 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f175f32d640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5644659ecc00 0x564464b4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.390 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564465a19400 0x564464b4f700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5644659aa7e0 tx=0x564465871e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.382+0000 7f175f32d640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5644659ecc00 0x564464b4e100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.383+0000 7f175f32d640 1 -- 172.21.15.181:0/1597348810 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x564464bdc000 con 0x5644659ecc00 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.383+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x564465a19800 con 0x5644659ecc00 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.383+0000 7f175f32d640 1 -- 172.21.15.181:0/1597348810 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x564464bdc000 con 0x5644659ecc00 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.383+0000 7f1760b88280 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x564465a19c00 0x564464b4db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.383+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:3 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x564465a19800 con 0x564465a19c00 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.383+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x564465a19c00 0x564464b4db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.391 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.383+0000 7f175fb2e640 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x564465a19c00 0x564464b4db80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.392 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f175fb2e640 1 -- 172.21.15.181:0/1597348810 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(3 200.00000002 [read 0~48 out=48b] v0'0 uv4 ondisk = 0) ==== 156+0+48 (crc 0 0 0) 0x564464bdc500 con 0x564465a19c00 2024-09-12T02:32:04.392 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.b 6:d5c7a900:::200.00000003:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5644659ed000 con 0x564465a19c00 2024-09-12T02:32:04.392 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f175fb2e640 1 -- 172.21.15.181:0/1597348810 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(4 200.00000003 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564464bdc500 con 0x564465a19c00 2024-09-12T02:32:04.392 INFO:tasks.workunit.client.0.smithi181.stdout:Overall journal integrity: OK 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5644659ecc00 msgr2=0x564464b4e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5644659ecc00 0x564464b4e100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x564465a19c00 msgr2=0x564464b4db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x564465a19c00 0x564464b4db80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564465a19400 msgr2=0x564464b4f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564465a19400 0x564464b4f700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5644659aa7e0 tx=0x564465871e00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec800 msgr2=0x564464b4e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec800 0x564464b4e680 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x5644658dfdd0 tx=0x564464b8d4a0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f175f32d640 1 -- 172.21.15.181:0/1597348810 reap_dead start 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 shutdown_connections 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 --2- 172.21.15.181:0/1597348810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644659ec800 0x564464b4e680 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.394 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 >> 172.21.15.181:0/1597348810 conn(0x56446586fc00 msgr2=0x564464bc7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 shutdown_connections 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.384+0000 7f1760b88280 1 -- 172.21.15.181:0/1597348810 wait complete. 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 -- 172.21.15.181:0/475216449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564464ad1800 msgr2=0x564464b4cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564464ad1800 0x564464b4cb00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x5644658df770 tx=0x564465870ae0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 -- 172.21.15.181:0/475216449 shutdown_connections 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564464ad1c00 0x564464b4d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564464ad1800 0x564464b4cb00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 --2- 172.21.15.181:0/475216449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564464ad0c00 0x564464b4c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 -- 172.21.15.181:0/475216449 >> 172.21.15.181:0/475216449 conn(0x564464ad1000 msgr2=0x564464bc6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 -- 172.21.15.181:0/475216449 shutdown_connections 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.385+0000 7f1760b88280 1 -- 172.21.15.181:0/475216449 wait complete. 2024-09-12T02:32:04.395 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-12T02:32:04.415 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 -- start start 2024-09-12T02:32:04.416 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 Processor -- start 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb2fa6cc00 0x55fb2fae8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb2fa6d800 0x55fb2fae8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb2fa6dc00 0x55fb2fae9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fb30850600 con 0x55fb2fa6cc00 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55fb30850480 con 0x55fb2fa6d800 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268d34e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55fb30850300 con 0x55fb2fa6dc00 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.415+0000 7f268baf3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb2fa6cc00 0x55fb2fae8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb2fa6cc00 0x55fb2fae8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43908/0 (socket says 172.21.15.181:43908) 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 -- 172.21.15.181:0/3991740479 learned_addr learned my addr 172.21.15.181:0/3991740479 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.418 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268b2f2640 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb2fa6d800 0x55fb2fae8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268c2f4640 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb2fa6dc00 0x55fb2fae9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 -- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb2fa6dc00 msgr2=0x55fb2fae9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb2fa6dc00 0x55fb2fae9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 -- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb2fa6d800 msgr2=0x55fb2fae8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb2fa6d800 0x55fb2fae8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 -- 172.21.15.181:0/3991740479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2faa4780 con 0x55fb2fa6cc00 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268c2f4640 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb2fa6dc00 0x55fb2fae9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268b2f2640 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb2fa6d800 0x55fb2fae8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268baf3640 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb2fa6cc00 0x55fb2fae8580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55fb30891830 tx=0x55fb3080c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05450e27dc5b8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f26892ee640 1 -- 172.21.15.181:0/3991740479 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fb2fa92680 con 0x55fb2fa6cc00 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f26892ee640 1 -- 172.21.15.181:0/3991740479 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fb2fa98a80 con 0x55fb2fa6cc00 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f26892ee640 1 -- 172.21.15.181:0/3991740479 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fb2fa92b60 con 0x55fb2fa6cc00 2024-09-12T02:32:04.419 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268d34e280 1 -- 172.21.15.181:0/3991740479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2faa43c0 con 0x55fb2fa6cc00 2024-09-12T02:32:04.420 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f268d34e280 1 -- 172.21.15.181:0/3991740479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55fb2faa5680 con 0x55fb2fa6cc00 2024-09-12T02:32:04.420 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f26892ee640 1 -- 172.21.15.181:0/3991740479 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55fb30952600 con 0x55fb2fa6cc00 2024-09-12T02:32:04.420 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.416+0000 7f26892ee640 1 -- 172.21.15.181:0/3991740479 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55fb2fac7180 con 0x55fb2fa6cc00 2024-09-12T02:32:04.420 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.417+0000 7f268d34e280 1 Processor -- start 2024-09-12T02:32:04.420 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.417+0000 7f268d34e280 1 -- start start 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268d34e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957400 0x55fb2fae9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268d34e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2fae9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268d34e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957c00 0x55fb2faea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268d34e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fb30850180 con 0x55fb30957c00 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268d34e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55fb2face900 con 0x55fb30957400 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268d34e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55fb2face480 con 0x55fb30957800 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957c00 0x55fb2faea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268c2f4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957400 0x55fb2fae9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957c00 0x55fb2faea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43922/0 (socket says 172.21.15.181:43922) 2024-09-12T02:32:04.425 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 -- 172.21.15.181:0/997536243 learned_addr learned my addr 172.21.15.181:0/997536243 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268baf3640 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2fae9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 -- 172.21.15.181:0/997536243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 msgr2=0x55fb2fae9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2fae9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 -- 172.21.15.181:0/997536243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957400 msgr2=0x55fb2fae9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957400 0x55fb2fae9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 -- 172.21.15.181:0/997536243 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2faa54a0 con 0x55fb30957c00 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f268b2f2640 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957c00 0x55fb2faea100 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55fb30942690 tx=0x55fb30966c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88bd077841ac73e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f26872ea640 1 -- 172.21.15.181:0/997536243 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fb2fa92680 con 0x55fb30957c00 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f26872ea640 1 -- 172.21.15.181:0/997536243 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fb2fa98700 con 0x55fb30957c00 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.418+0000 7f26872ea640 1 -- 172.21.15.181:0/997536243 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fb2fa92b60 con 0x55fb30957c00 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 -- 172.21.15.181:0/997536243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957c00 msgr2=0x55fb2faea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957c00 0x55fb2faea100 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55fb30942690 tx=0x55fb30966c00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 -- 172.21.15.181:0/997536243 shutdown_connections 2024-09-12T02:32:04.426 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957c00 0x55fb2faea100 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2fae9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 --2- 172.21.15.181:0/997536243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957400 0x55fb2fae9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 -- 172.21.15.181:0/997536243 >> 172.21.15.181:0/997536243 conn(0x55fb30957000 msgr2=0x55fb307f6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 -- 172.21.15.181:0/997536243 shutdown_connections 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 -- 172.21.15.181:0/997536243 wait complete. 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 Processor -- start 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.419+0000 7f268d34e280 1 -- start start 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957400 0x55fb2faeb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2faeac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957c00 0x55fb2faea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fb30851800 con 0x55fb30957400 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55fb30850180 con 0x55fb30957c00 2024-09-12T02:32:04.427 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55fb30850d80 con 0x55fb30957800 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957400 0x55fb2faeb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957400 0x55fb2faeb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43926/0 (socket says 172.21.15.181:43926) 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 -- 172.21.15.181:0/721747476 learned_addr learned my addr 172.21.15.181:0/721747476 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268baf3640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2faeac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268b2f2640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957c00 0x55fb2faea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 -- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 msgr2=0x55fb2faeac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2faeac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 -- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957c00 msgr2=0x55fb2faea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957c00 0x55fb2faea680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 -- 172.21.15.181:0/721747476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2faa4780 con 0x55fb30957400 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268b2f2640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb30957c00 0x55fb2faea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268baf3640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb30957800 0x55fb2faeac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.428 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268c2f4640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957400 0x55fb2faeb180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55fb308910b0 tx=0x55fb3080df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f2685ae7640 1 -- 172.21.15.181:0/721747476 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fb2fa929c0 con 0x55fb30957400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f2685ae7640 1 -- 172.21.15.181:0/721747476 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fb2fa98c40 con 0x55fb30957400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb2faa43c0 con 0x55fb30957400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f2685ae7640 1 -- 172.21.15.181:0/721747476 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fb2fa92680 con 0x55fb30957400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.420+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2faa5680 con 0x55fb30957400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f2685ae7640 1 -- 172.21.15.181:0/721747476 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55fb309ccc00 con 0x55fb30957400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f2685ae7640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55fb309c5000 0x55fb2faeb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f2685ae7640 1 -- 172.21.15.181:0/721747476 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55fb309cac00 con 0x55fb30957400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f268baf3640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55fb309c5000 0x55fb2faeb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f268d34e280 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55fb309c5400 0x55fb2faea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55fb309c5800 con 0x55fb309c5400 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f268b2f2640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55fb309c5400 0x55fb2faea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.429 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.422+0000 7f268baf3640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55fb309c5000 0x55fb2faeb700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55fb30891d70 tx=0x55fb2fb29440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268b2f2640 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55fb309c5400 0x55fb2faea100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268b2f2640 1 -- 172.21.15.181:0/721747476 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55fb30806000 con 0x55fb309c5400 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55fb309c5c00 con 0x55fb309c5400 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268b2f2640 1 -- 172.21.15.181:0/721747476 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55fb30806000 con 0x55fb309c5400 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stdout:{ 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stdout: "magic": "ceph fs volume v011", 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stdout: "write_pos": 8388608, 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stdout: "expire_pos": 8388608, 2024-09-12T02:32:04.430 INFO:tasks.workunit.client.0.smithi181.stdout: "trimmed_pos": 8388608, 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: "stream_format": 1, 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: "layout": { 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: "stripe_unit": 4194304, 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: "stripe_count": 1, 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: "object_size": 4194304, 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: "pool_id": 6, 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: "pool_ns": "" 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: } 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout:} 2024-09-12T02:32:04.431 INFO:tasks.workunit.client.0.smithi181.stdout: 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55fb309c5400 msgr2=0x55fb2faea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55fb309c5400 0x55fb2faea100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55fb309c5000 msgr2=0x55fb2faeb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55fb309c5000 0x55fb2faeb700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55fb30891d70 tx=0x55fb2fb29440 comp rx=0 tx=0).stop 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957400 msgr2=0x55fb2faeb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 --2- 172.21.15.181:0/721747476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb30957400 0x55fb2faeb180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55fb308910b0 tx=0x55fb3080df80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268b2f2640 1 -- 172.21.15.181:0/721747476 reap_dead start 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 shutdown_connections 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 >> 172.21.15.181:0/721747476 conn(0x55fb30957000 msgr2=0x55fb307f6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 shutdown_connections 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.423+0000 7f268d34e280 1 -- 172.21.15.181:0/721747476 wait complete. 2024-09-12T02:32:04.433 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 -- 172.21.15.181:0/3991740479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb2fa6cc00 msgr2=0x55fb2fae8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb2fa6cc00 0x55fb2fae8580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55fb30891830 tx=0x55fb3080c600 comp rx=0 tx=0).stop 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 -- 172.21.15.181:0/3991740479 shutdown_connections 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fb2fa6d800 0x55fb2fae8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fb2fa6dc00 0x55fb2fae9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 --2- 172.21.15.181:0/3991740479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fb2fa6cc00 0x55fb2fae8580 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 -- 172.21.15.181:0/3991740479 >> 172.21.15.181:0/3991740479 conn(0x55fb2fa6d000 msgr2=0x55fb307f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 -- 172.21.15.181:0/3991740479 shutdown_connections 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.424+0000 7f268d34e280 1 -- 172.21.15.181:0/3991740479 wait complete. 2024-09-12T02:32:04.434 INFO:tasks.workunit.client.0.smithi181.stdout:Rolling back journal to original state... 2024-09-12T02:32:04.435 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'Rolling back journal to original state...' 2024-09-12T02:32:04.435 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-09-12T02:32:04.455 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.454+0000 7f1f86c0b280 1 -- start start 2024-09-12T02:32:04.455 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.454+0000 7f1f86c0b280 1 Processor -- start 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4d7acc00 0x561b4d828580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4d7ad800 0x561b4d828b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4d7adc00 0x561b4d829080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b4e596600 con 0x561b4d7adc00 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561b4e596480 con 0x561b4d7acc00 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561b4e596300 con 0x561b4d7ad800 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f84e2f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4d7adc00 0x561b4d829080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.462 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f84e2f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4d7adc00 0x561b4d829080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43950/0 (socket says 172.21.15.181:43950) 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f84e2f640 1 -- 172.21.15.181:0/4145520632 learned_addr learned my addr 172.21.15.181:0/4145520632 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f8462e640 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4d7acc00 0x561b4d828580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4d7ad800 0x561b4d828b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f84e2f640 1 -- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4d7ad800 msgr2=0x561b4d828b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f84e2f640 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4d7ad800 0x561b4d828b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f84e2f640 1 -- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4d7acc00 msgr2=0x561b4d828580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.455+0000 7f1f84e2f640 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4d7acc00 0x561b4d828580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f84e2f640 1 -- 172.21.15.181:0/4145520632 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4d7e4780 con 0x561b4d7adc00 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f8462e640 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4d7acc00 0x561b4d828580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f84e2f640 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4d7adc00 0x561b4d829080 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x561b4e5cd8c0 tx=0x561b4e54c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6642fbd3d7b73f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f81e29640 1 -- 172.21.15.181:0/4145520632 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4d7d2680 con 0x561b4d7adc00 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f81e29640 1 -- 172.21.15.181:0/4145520632 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b4d7d8a80 con 0x561b4d7adc00 2024-09-12T02:32:04.463 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f81e29640 1 -- 172.21.15.181:0/4145520632 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4d7d2b60 con 0x561b4d7adc00 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f86c0b280 1 -- 172.21.15.181:0/4145520632 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4d7e54a0 con 0x561b4d7adc00 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f86c0b280 1 -- 172.21.15.181:0/4145520632 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561b4d7e4000 con 0x561b4d7adc00 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f81e29640 1 -- 172.21.15.181:0/4145520632 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x561b4e694600 con 0x561b4d7adc00 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.456+0000 7f1f81e29640 1 -- 172.21.15.181:0/4145520632 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x561b4d807180 con 0x561b4d7adc00 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 Processor -- start 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 -- start start 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d829600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d829b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b4e596180 con 0x561b4e699400 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561b4d80e900 con 0x561b4e699c00 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561b4d80e480 con 0x561b4e699800 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.457+0000 7f1f83e2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d829600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.464 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d829600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43956/0 (socket says 172.21.15.181:43956) 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 -- 172.21.15.181:0/3310779417 learned_addr learned my addr 172.21.15.181:0/3310779417 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f8462e640 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d829b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 -- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 msgr2=0x561b4d829b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d829b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 -- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 msgr2=0x561b4d82a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 -- 172.21.15.181:0/3310779417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4d7e43c0 con 0x561b4e699400 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f8462e640 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d829b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d829600 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x561b4e6a8840 tx=0x561b4e6accc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1511cb283250a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f7fe25640 1 -- 172.21.15.181:0/3310779417 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4d7d2680 con 0x561b4e699400 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f7fe25640 1 -- 172.21.15.181:0/3310779417 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b4d7d8e00 con 0x561b4e699400 2024-09-12T02:32:04.465 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.458+0000 7f1f7fe25640 1 -- 172.21.15.181:0/3310779417 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4d7d2b60 con 0x561b4e699400 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 -- 172.21.15.181:0/3310779417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 msgr2=0x561b4d829600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d829600 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x561b4e6a8840 tx=0x561b4e6accc0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 -- 172.21.15.181:0/3310779417 shutdown_connections 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d829b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/3310779417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d829600 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 -- 172.21.15.181:0/3310779417 >> 172.21.15.181:0/3310779417 conn(0x561b4e699000 msgr2=0x561b4e536800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 -- 172.21.15.181:0/3310779417 shutdown_connections 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 -- 172.21.15.181:0/3310779417 wait complete. 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 Processor -- start 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.459+0000 7f1f86c0b280 1 -- start start 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d82b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d82ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.466 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b4e596a80 con 0x561b4e699400 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561b4e596c00 con 0x561b4e699c00 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561b4e596d80 con 0x561b4e699800 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d82b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d82b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43968/0 (socket says 172.21.15.181:43968) 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 -- 172.21.15.181:0/1787035617 learned_addr learned my addr 172.21.15.181:0/1787035617 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d82ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 -- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 msgr2=0x561b4d82ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d82ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 -- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 msgr2=0x561b4d82a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.467 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 -- 172.21.15.181:0/1787035617 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4d7e4780 con 0x561b4e699400 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d82ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d82b180 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x561b4e6a9b00 tx=0x561b4e6acc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f7e622640 1 -- 172.21.15.181:0/1787035617 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4d7d24e0 con 0x561b4e699400 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f7e622640 1 -- 172.21.15.181:0/1787035617 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b4d7d8c40 con 0x561b4e699400 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b4d7e54a0 con 0x561b4e699400 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f7e622640 1 -- 172.21.15.181:0/1787035617 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4d7d2680 con 0x561b4e699400 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.460+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4d7e4960 con 0x561b4e699400 2024-09-12T02:32:04.468 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.462+0000 7f1f7e622640 1 -- 172.21.15.181:0/1787035617 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x561b4e70cc00 con 0x561b4e699400 2024-09-12T02:32:04.471 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.462+0000 7f1f7e622640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b4e70b000 0x561b4d82b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.471 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.462+0000 7f1f7e622640 1 -- 172.21.15.181:0/1787035617 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x561b4e6faa00 con 0x561b4e699400 2024-09-12T02:32:04.471 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.462+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b4e70b000 0x561b4d82b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.462+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b4e70b000 0x561b4d82b700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x561b4e53c180 tx=0x561b4e54ca20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 -- start start 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 Processor -- start 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e70b800 0x561b4d82a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e70bc00 0x561b4d829b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4db9e000 0x561b4d829600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b4e597800 con 0x561b4e70b800 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561b4e597980 con 0x561b4db9e000 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f86c0b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561b4d80e900 con 0x561b4e70bc00 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f84e2f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e70b800 0x561b4d82a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f84e2f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e70b800 0x561b4d82a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43972/0 (socket says 172.21.15.181:43972) 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.463+0000 7f1f84e2f640 1 -- 172.21.15.181:0/1291135408 learned_addr learned my addr 172.21.15.181:0/1291135408 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.472 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4db9e000 0x561b4d829600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e70bc00 0x561b4d829b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f84e2f640 1 -- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e70bc00 msgr2=0x561b4d829b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f84e2f640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e70bc00 0x561b4d829b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f84e2f640 1 -- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4db9e000 msgr2=0x561b4d829600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f84e2f640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4db9e000 0x561b4d829600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f84e2f640 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4d7e5680 con 0x561b4e70b800 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4db9e000 0x561b4d829600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e70bc00 0x561b4d829b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f84e2f640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e70b800 0x561b4d82a100 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x561b4e734a80 tx=0x561b4d869440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b58018530388143 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f7b61c640 1 -- 172.21.15.181:0/1291135408 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4d7d2820 con 0x561b4e70b800 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f7b61c640 1 -- 172.21.15.181:0/1291135408 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b4d7d88c0 con 0x561b4e70b800 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f7b61c640 1 -- 172.21.15.181:0/1291135408 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b4e745ba0 con 0x561b4e70b800 2024-09-12T02:32:04.473 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4d7e43c0 con 0x561b4e70b800 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561b4d7e4780 con 0x561b4e70b800 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f7b61c640 1 -- 172.21.15.181:0/1291135408 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x561b4dba4200 con 0x561b4e70b800 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f7b61c640 1 -- 172.21.15.181:0/1291135408 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x561b4d807500 con 0x561b4e70b800 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b4db9e400 0x561b4dbba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561b4db9e800 con 0x561b4db9e400 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.464+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b4db9e400 0x561b4dbba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.465+0000 7f1f8462e640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b4db9e400 0x561b4dbba000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=5c9150b39e4ed595 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.465+0000 7f1f8462e640 1 -- 172.21.15.181:0/1291135408 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x561b4e544000 con 0x561b4db9e400 2024-09-12T02:32:04.474 INFO:tasks.workunit.client.0.smithi181.stdout:undump /tmp/journal.bin 2024-09-12T02:32:04.475 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.465+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561b4db9ec00 con 0x561b4db9e400 2024-09-12T02:32:04.475 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.465+0000 7f1f8462e640 1 -- 172.21.15.181:0/1291135408 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x561b4e544000 con 0x561b4db9e400 2024-09-12T02:32:04.475 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.465+0000 7f1f79e19640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b4dbb1800 0x561b4dbbc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.475 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.465+0000 7f1f79e19640 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:3 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x561b4dbb1c00 con 0x561b4dbb1800 2024-09-12T02:32:04.476 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.465+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b4dbb1800 0x561b4dbbc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.476 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.466+0000 7f1f83e2d640 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b4dbb1800 0x561b4dbbc680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=2bbb7c5094cfd0ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.476 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.466+0000 7f1f83e2d640 1 -- 172.21.15.181:0/1291135408 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(3 200.00000002 [stat out=16b] v0'0 uv4 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x561b4e544500 con 0x561b4dbb1800 2024-09-12T02:32:04.476 INFO:tasks.workunit.client.0.smithi181.stdout:start 4194304 len 30182 write_pos 4200187 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-09-12T02:32:04.476 INFO:tasks.workunit.client.0.smithi181.stdout:writing header 200.00000000 2024-09-12T02:32:04.476 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.466+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:4 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561b4db9f000 con 0x561b4db9e400 2024-09-12T02:32:04.477 INFO:tasks.workunit.client.0.smithi181.stdout:Purging 2 objects from 1 2024-09-12T02:32:04.477 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.467+0000 7f1f8462e640 1 -- 172.21.15.181:0/1291135408 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(4 200.00000000 [writefull 0~90] v48'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561b4e544000 con 0x561b4db9e400 2024-09-12T02:32:04.477 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.467+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561b4db9f400 con 0x561b4db9e400 2024-09-12T02:32:04.478 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.467+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561b4db9e800 con 0x561b4dbb1800 2024-09-12T02:32:04.478 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.468+0000 7f1f83e2d640 1 -- 172.21.15.181:0/1291135408 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(6 200.00000002 [delete] v48'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561b4e544500 con 0x561b4dbb1800 2024-09-12T02:32:04.478 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.469+0000 7f1f8462e640 1 -- 172.21.15.181:0/1291135408 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(5 200.00000001 [delete] v48'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561b4e544000 con 0x561b4db9e400 2024-09-12T02:32:04.478 INFO:tasks.workunit.client.0.smithi181.stdout: writing 4194304~30182 2024-09-12T02:32:04.480 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.469+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [write 0~30182 in=30182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561b4db9ec00 con 0x561b4db9e400 2024-09-12T02:32:04.480 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f8462e640 1 -- 172.21.15.181:0/1291135408 <== osd.2 v2:172.21.15.181:6808/3659790931 5 ==== osd_op_reply(7 200.00000001 [write 0~30182] v48'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561b4e544000 con 0x561b4db9e400 2024-09-12T02:32:04.480 INFO:tasks.workunit.client.0.smithi181.stdout:done. 2024-09-12T02:32:04.482 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b4db9e400 msgr2=0x561b4dbba000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b4db9e400 0x561b4dbba000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b4dbb1800 msgr2=0x561b4dbbc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b4dbb1800 0x561b4dbbc680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e70b800 msgr2=0x561b4d82a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1291135408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e70b800 0x561b4d82a100 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x561b4e734a80 tx=0x561b4d869440 comp rx=0 tx=0).stop 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f83e2d640 1 -- 172.21.15.181:0/1291135408 reap_dead start 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 shutdown_connections 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 >> 172.21.15.181:0/1291135408 conn(0x561b4e70b400 msgr2=0x561b4e536000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 shutdown_connections 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1291135408 wait complete. 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b4e70b000 msgr2=0x561b4d82b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b4e70b000 0x561b4d82b700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x561b4e53c180 tx=0x561b4e54ca20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.483 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 msgr2=0x561b4d82b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d82b180 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x561b4e6a9b00 tx=0x561b4e6acc00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 shutdown_connections 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b4e70b000 0x561b4d82b700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4e699c00 0x561b4d82a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4e699800 0x561b4d82ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.470+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/1787035617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4e699400 0x561b4d82b180 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 >> 172.21.15.181:0/1787035617 conn(0x561b4e699000 msgr2=0x561b4e536800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 shutdown_connections 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/1787035617 wait complete. 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/4145520632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4d7adc00 msgr2=0x561b4d829080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4d7adc00 0x561b4d829080 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x561b4e5cd8c0 tx=0x561b4e54c600 comp rx=0 tx=0).stop 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/4145520632 shutdown_connections 2024-09-12T02:32:04.484 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b4d7adc00 0x561b4d829080 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.485 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b4d7ad800 0x561b4d828b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.485 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 --2- 172.21.15.181:0/4145520632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b4d7acc00 0x561b4d828580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.485 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/4145520632 >> 172.21.15.181:0/4145520632 conn(0x561b4d7ad000 msgr2=0x561b4e537000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.485 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/4145520632 shutdown_connections 2024-09-12T02:32:04.485 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.471+0000 7f1f86c0b280 1 -- 172.21.15.181:0/4145520632 wait complete. 2024-09-12T02:32:04.485 INFO:tasks.workunit.client.0.smithi181.stdout:Testing 'header' commands... 2024-09-12T02:32:04.485 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'Testing '\''header'\'' commands...' 2024-09-12T02:32:04.486 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-12T02:32:04.503 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.502+0000 7f4584d1e280 1 -- start start 2024-09-12T02:32:04.503 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.502+0000 7f4584d1e280 1 Processor -- start 2024-09-12T02:32:04.505 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8b8d6c00 0x559b8b952580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.505 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8b8d7800 0x559b8b952b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8b8d7c00 0x559b8b953080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4584d1e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b8c6b8600 con 0x559b8b8d6c00 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4584d1e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559b8c6b8480 con 0x559b8b8d7c00 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4584d1e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559b8c6b8300 con 0x559b8b8d7800 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8b8d6c00 0x559b8b952580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8b8d6c00 0x559b8b952580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43982/0 (socket says 172.21.15.181:43982) 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 -- 172.21.15.181:0/2726711277 learned_addr learned my addr 172.21.15.181:0/2726711277 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4583241640 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8b8d7c00 0x559b8b953080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f458223f640 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8b8d7800 0x559b8b952b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 -- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8b8d7800 msgr2=0x559b8b952b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8b8d7800 0x559b8b952b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.506 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 -- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8b8d7c00 msgr2=0x559b8b953080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8b8d7c00 0x559b8b953080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.503+0000 7f4582a40640 1 -- 172.21.15.181:0/2726711277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8b90e780 con 0x559b8b8d6c00 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f4582a40640 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8b8d6c00 0x559b8b952580 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x559b8c6f98f0 tx=0x559b8c676540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338f7c525418df89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f458023b640 1 -- 172.21.15.181:0/2726711277 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b8b8fc680 con 0x559b8b8d6c00 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f458023b640 1 -- 172.21.15.181:0/2726711277 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b8b902700 con 0x559b8b8d6c00 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f458023b640 1 -- 172.21.15.181:0/2726711277 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b8b8fc9c0 con 0x559b8b8d6c00 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f4584d1e280 1 -- 172.21.15.181:0/2726711277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8b90e3c0 con 0x559b8b8d6c00 2024-09-12T02:32:04.507 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f4584d1e280 1 -- 172.21.15.181:0/2726711277 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559b8b90f4a0 con 0x559b8b8d6c00 2024-09-12T02:32:04.508 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f458023b640 1 -- 172.21.15.181:0/2726711277 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x559b8c7b8600 con 0x559b8b8d6c00 2024-09-12T02:32:04.508 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.504+0000 7f458023b640 1 -- 172.21.15.181:0/2726711277 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x559b8b931180 con 0x559b8b8d6c00 2024-09-12T02:32:04.508 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 Processor -- start 2024-09-12T02:32:04.508 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 -- start start 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9400 0x559b8b953600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9800 0x559b8b953b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 0x559b8b954100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b8c6b8180 con 0x559b8c6a9800 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559b8b938900 con 0x559b8c6a9400 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4584d1e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559b8b938480 con 0x559b8c6a9c00 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4582a40640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9800 0x559b8b953b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.513 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4582a40640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9800 0x559b8b953b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43996/0 (socket says 172.21.15.181:43996) 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4582a40640 1 -- 172.21.15.181:0/1505768808 learned_addr learned my addr 172.21.15.181:0/1505768808 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f4583241640 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9400 0x559b8b953600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.505+0000 7f458223f640 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 0x559b8b954100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4582a40640 1 -- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 msgr2=0x559b8b954100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4582a40640 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 0x559b8b954100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4582a40640 1 -- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9400 msgr2=0x559b8b953600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4582a40640 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9400 0x559b8b953600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4582a40640 1 -- 172.21.15.181:0/1505768808 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8b90e960 con 0x559b8c6a9800 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4583241640 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9400 0x559b8b953600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4582a40640 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9800 0x559b8b953b80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x559b8c7ac5d0 tx=0x559b8b992cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26492a4501c83184 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f457e237640 1 -- 172.21.15.181:0/1505768808 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b8b8fcb60 con 0x559b8c6a9800 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f457e237640 1 -- 172.21.15.181:0/1505768808 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b8b902e00 con 0x559b8c6a9800 2024-09-12T02:32:04.514 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f457e237640 1 -- 172.21.15.181:0/1505768808 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b8b8fc680 con 0x559b8c6a9800 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 -- 172.21.15.181:0/1505768808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9800 msgr2=0x559b8b953b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9800 0x559b8b953b80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x559b8c7ac5d0 tx=0x559b8b992cc0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 -- 172.21.15.181:0/1505768808 shutdown_connections 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 0x559b8b954100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9800 0x559b8b953b80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 --2- 172.21.15.181:0/1505768808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9400 0x559b8b953600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 -- 172.21.15.181:0/1505768808 >> 172.21.15.181:0/1505768808 conn(0x559b8c6a9000 msgr2=0x559b8c660800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 -- 172.21.15.181:0/1505768808 shutdown_connections 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.506+0000 7f4584d1e280 1 -- 172.21.15.181:0/1505768808 wait complete. 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 Processor -- start 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 -- start start 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9400 0x559b8b955180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9800 0x559b8b954c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.515 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 0x559b8b954680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b8c6b9800 con 0x559b8c6a9400 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559b8c6b9980 con 0x559b8c6a9800 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4584d1e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559b8c6b8d80 con 0x559b8c6a9c00 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4583241640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9400 0x559b8b955180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.507+0000 7f4583241640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9400 0x559b8b955180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44004/0 (socket says 172.21.15.181:44004) 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4583241640 1 -- 172.21.15.181:0/2213698895 learned_addr learned my addr 172.21.15.181:0/2213698895 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f458223f640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 0x559b8b954680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4582a40640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9800 0x559b8b954c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4583241640 1 -- 172.21.15.181:0/2213698895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 msgr2=0x559b8b954680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4583241640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8c6a9c00 0x559b8b954680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4583241640 1 -- 172.21.15.181:0/2213698895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9800 msgr2=0x559b8b954c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4583241640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8c6a9800 0x559b8b954c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.516 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4583241640 1 -- 172.21.15.181:0/2213698895 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8b90e780 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4583241640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9400 0x559b8b955180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x559b8c7ad950 tx=0x559b8c6769c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f457ca34640 1 -- 172.21.15.181:0/2213698895 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b8b8fcb60 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f457ca34640 1 -- 172.21.15.181:0/2213698895 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b8b902c40 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b8b90e3c0 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f457ca34640 1 -- 172.21.15.181:0/2213698895 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b8b8fc680 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.508+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8b90f4a0 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.509+0000 7f457ca34640 1 -- 172.21.15.181:0/2213698895 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x559b8c6d2c00 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.509+0000 7f457ca34640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b8c827400 0x559b8b955700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f457ca34640 1 -- 172.21.15.181:0/2213698895 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x559b8c6d6800 con 0x559b8c6a9400 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f4582a40640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b8c827400 0x559b8b955700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x559b8c827800 0x559b8b954100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x559b8c827c00 con 0x559b8c827800 2024-09-12T02:32:04.517 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f458223f640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x559b8c827800 0x559b8b954100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f4582a40640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b8c827400 0x559b8b955700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x559b8c7ac5d0 tx=0x559b8c7c8c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f458223f640 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x559b8c827800 0x559b8b954100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f458223f640 1 -- 172.21.15.181:0/2213698895 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x559b8c670000 con 0x559b8c827800 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.510+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x559b8bc68000 con 0x559b8c827800 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f458223f640 1 -- 172.21.15.181:0/2213698895 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x559b8c670000 con 0x559b8c827800 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stdout:{ 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stdout: "magic": "ceph fs volume v011", 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stdout: "write_pos": 4200187, 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stdout: "expire_pos": 4194304, 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stdout: "trimmed_pos": 4194304, 2024-09-12T02:32:04.518 INFO:tasks.workunit.client.0.smithi181.stdout: "stream_format": 1, 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: "layout": { 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: "stripe_unit": 4194304, 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: "stripe_count": 1, 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: "object_size": 4194304, 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: "pool_id": 6, 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: "pool_ns": "" 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: } 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout:} 2024-09-12T02:32:04.519 INFO:tasks.workunit.client.0.smithi181.stdout: 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x559b8c827800 msgr2=0x559b8b954100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x559b8c827800 0x559b8b954100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b8c827400 msgr2=0x559b8b955700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b8c827400 0x559b8b955700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x559b8c7ac5d0 tx=0x559b8c7c8c00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9400 msgr2=0x559b8b955180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2213698895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8c6a9400 0x559b8b955180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x559b8c7ad950 tx=0x559b8c6769c0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f458223f640 1 -- 172.21.15.181:0/2213698895 reap_dead start 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 shutdown_connections 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 >> 172.21.15.181:0/2213698895 conn(0x559b8c6a9000 msgr2=0x559b8c660800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 shutdown_connections 2024-09-12T02:32:04.521 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2213698895 wait complete. 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2726711277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8b8d6c00 msgr2=0x559b8b952580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8b8d6c00 0x559b8b952580 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x559b8c6f98f0 tx=0x559b8c676540 comp rx=0 tx=0).stop 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2726711277 shutdown_connections 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b8b8d7c00 0x559b8b953080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b8b8d7800 0x559b8b952b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 --2- 172.21.15.181:0/2726711277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b8b8d6c00 0x559b8b952580 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2726711277 >> 172.21.15.181:0/2726711277 conn(0x559b8b8d7000 msgr2=0x559b8c661000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2726711277 shutdown_connections 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.511+0000 7f4584d1e280 1 -- 172.21.15.181:0/2726711277 wait complete. 2024-09-12T02:32:04.522 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set write_pos 123 2024-09-12T02:32:04.543 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 -- start start 2024-09-12T02:32:04.543 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 Processor -- start 2024-09-12T02:32:04.549 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cc7f4c00 0x55a6cc870580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.549 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cc7f5800 0x55a6cc870b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cc7f5c00 0x55a6cc871080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd580600 con 0x55a6cc7f4c00 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd580480 con 0x55a6cc7f5c00 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddd799280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a6cd580300 con 0x55a6cc7f5800 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddbf3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cc7f4c00 0x55a6cc870580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddbf3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cc7f4c00 0x55a6cc870580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44030/0 (socket says 172.21.15.181:44030) 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.543+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/42601514 learned_addr learned my addr 172.21.15.181:0/42601514 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cc7f5c00 0x55a6cc871080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddb73d640 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cc7f5800 0x55a6cc870b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cc7f5800 msgr2=0x55a6cc870b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddbf3e640 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cc7f5800 0x55a6cc870b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.550 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cc7f5c00 msgr2=0x55a6cc871080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddbf3e640 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cc7f5c00 0x55a6cc871080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/42601514 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc82c780 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cc7f5c00 0x55a6cc871080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddbf3e640 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cc7f4c00 0x55a6cc870580 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x55a6cd617590 tx=0x55a6cd596f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e367afe3cb03a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6dd9739640 1 -- 172.21.15.181:0/42601514 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6cc81a680 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6dd9739640 1 -- 172.21.15.181:0/42601514 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a6cc820a80 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6dd9739640 1 -- 172.21.15.181:0/42601514 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6cc81ab60 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddd799280 1 -- 172.21.15.181:0/42601514 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cc82c3c0 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6ddd799280 1 -- 172.21.15.181:0/42601514 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a6cc82d680 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6dd9739640 1 -- 172.21.15.181:0/42601514 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a6cd6daa00 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.544+0000 7f6dd9739640 1 -- 172.21.15.181:0/42601514 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55a6cc84f180 con 0x55a6cc7f4c00 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 Processor -- start 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 -- start start 2024-09-12T02:32:04.551 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7400 0x55a6cc871600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7800 0x55a6cc871b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7c00 0x55a6cc872100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd580180 con 0x55a6cd6c7400 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a6cc856900 con 0x55a6cd6c7800 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddd799280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a6cc856480 con 0x55a6cd6c7c00 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddc73f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7400 0x55a6cc871600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddc73f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7400 0x55a6cc871600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44038/0 (socket says 172.21.15.181:44038) 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.545+0000 7f6ddc73f640 1 -- 172.21.15.181:0/2578602971 learned_addr learned my addr 172.21.15.181:0/2578602971 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddbf3e640 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7800 0x55a6cc871b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddb73d640 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7c00 0x55a6cc872100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddc73f640 1 -- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7c00 msgr2=0x55a6cc872100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.552 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7c00 0x55a6cc872100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddc73f640 1 -- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7800 msgr2=0x55a6cc871b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7800 0x55a6cc871b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddc73f640 1 -- 172.21.15.181:0/2578602971 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc82d4a0 con 0x55a6cd6c7400 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddb73d640 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7c00 0x55a6cc872100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7400 0x55a6cc871600 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55a6cd616f30 tx=0x55a6cd596c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f04b86a01bc402b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6dd7735640 1 -- 172.21.15.181:0/2578602971 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6cc81a9c0 con 0x55a6cd6c7400 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6dd7735640 1 -- 172.21.15.181:0/2578602971 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a6cc820c40 con 0x55a6cd6c7400 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6dd7735640 1 -- 172.21.15.181:0/2578602971 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6cc81a680 con 0x55a6cd6c7400 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 -- 172.21.15.181:0/2578602971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7400 msgr2=0x55a6cc871600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7400 0x55a6cc871600 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55a6cd616f30 tx=0x55a6cd596c00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 -- 172.21.15.181:0/2578602971 shutdown_connections 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7800 0x55a6cc871b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7c00 0x55a6cc872100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.553 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 --2- 172.21.15.181:0/2578602971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7400 0x55a6cc871600 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 -- 172.21.15.181:0/2578602971 >> 172.21.15.181:0/2578602971 conn(0x55a6cd6c7000 msgr2=0x55a6cc8e9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 -- 172.21.15.181:0/2578602971 shutdown_connections 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.546+0000 7f6ddd799280 1 -- 172.21.15.181:0/2578602971 wait complete. 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.547+0000 7f6ddd799280 1 Processor -- start 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.547+0000 7f6ddd799280 1 -- start start 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7400 0x55a6cc873180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7800 0x55a6cc872c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7c00 0x55a6cc872680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd581980 con 0x55a6cd6c7800 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a6cd580180 con 0x55a6cd6c7c00 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a6cd581800 con 0x55a6cd6c7400 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7800 0x55a6cc872c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.554 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7800 0x55a6cc872c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44054/0 (socket says 172.21.15.181:44054) 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/867296453 learned_addr learned my addr 172.21.15.181:0/867296453 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7400 0x55a6cc873180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddb73d640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7c00 0x55a6cc872680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/867296453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7400 msgr2=0x55a6cc873180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cd6c7400 0x55a6cc873180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/867296453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7c00 msgr2=0x55a6cc872680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cd6c7c00 0x55a6cc872680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 -- 172.21.15.181:0/867296453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc82c780 con 0x55a6cd6c7800 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddbf3e640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7800 0x55a6cc872c00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x55a6cd5fdc50 tx=0x55a6cd594600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6dd5f32640 1 -- 172.21.15.181:0/867296453 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6cc81a820 con 0x55a6cd6c7800 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6dd5f32640 1 -- 172.21.15.181:0/867296453 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a6cc8208c0 con 0x55a6cd6c7800 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6cc82c3c0 con 0x55a6cd6c7800 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6dd5f32640 1 -- 172.21.15.181:0/867296453 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6cc81a9c0 con 0x55a6cd6c7800 2024-09-12T02:32:04.555 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.548+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cc82d680 con 0x55a6cd6c7800 2024-09-12T02:32:04.557 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.549+0000 7f6dd5f32640 1 -- 172.21.15.181:0/867296453 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a6cd740c00 con 0x55a6cd6c7800 2024-09-12T02:32:04.557 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6dd5f32640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6cd747400 0x55a6cc873700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.557 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6dd5f32640 1 -- 172.21.15.181:0/867296453 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a6cd74e200 con 0x55a6cd6c7800 2024-09-12T02:32:04.557 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6cd747400 0x55a6cc873700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.557 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6ddd799280 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6cd747800 0x55a6cc872100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.557 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a6cd747c00 con 0x55a6cd747800 2024-09-12T02:32:04.557 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6ddb73d640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6cd747800 0x55a6cc872100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.558 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6ddc73f640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6cd747400 0x55a6cc873700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a6cd616f30 tx=0x55a6cd5960c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.558 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.550+0000 7f6ddb73d640 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6cd747800 0x55a6cc872100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.558 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.551+0000 7f6ddb73d640 1 -- 172.21.15.181:0/867296453 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55a6cc8dc000 con 0x55a6cd747800 2024-09-12T02:32:04.558 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.551+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a6ccb84000 con 0x55a6cd747800 2024-09-12T02:32:04.558 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.551+0000 7f6ddb73d640 1 -- 172.21.15.181:0/867296453 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55a6cc8dc000 con 0x55a6cd747800 2024-09-12T02:32:04.558 INFO:tasks.workunit.client.0.smithi181.stdout:Updating write_pos 0x4016fb -> 0x7b 2024-09-12T02:32:04.558 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.551+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a6ccb84400 con 0x55a6cd747800 2024-09-12T02:32:04.559 INFO:tasks.workunit.client.0.smithi181.stdout:Successfully updated header. 2024-09-12T02:32:04.560 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddb73d640 1 -- 172.21.15.181:0/867296453 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v48'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a6cc8dc000 con 0x55a6cd747800 2024-09-12T02:32:04.560 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6cd747800 msgr2=0x55a6cc872100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.560 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6cd747800 0x55a6cc872100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6cd747400 msgr2=0x55a6cc873700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6cd747400 0x55a6cc873700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a6cd616f30 tx=0x55a6cd5960c0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7800 msgr2=0x55a6cc872c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 --2- 172.21.15.181:0/867296453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cd6c7800 0x55a6cc872c00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x55a6cd5fdc50 tx=0x55a6cd594600 comp rx=0 tx=0).stop 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddb73d640 1 -- 172.21.15.181:0/867296453 reap_dead start 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 shutdown_connections 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 >> 172.21.15.181:0/867296453 conn(0x55a6cd6c7000 msgr2=0x55a6cc8e9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 shutdown_connections 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.552+0000 7f6ddd799280 1 -- 172.21.15.181:0/867296453 wait complete. 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 -- 172.21.15.181:0/42601514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cc7f4c00 msgr2=0x55a6cc870580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cc7f4c00 0x55a6cc870580 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x55a6cd617590 tx=0x55a6cd596f60 comp rx=0 tx=0).stop 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 -- 172.21.15.181:0/42601514 shutdown_connections 2024-09-12T02:32:04.561 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6cc7f5c00 0x55a6cc871080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.562 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6cc7f5800 0x55a6cc870b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.562 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 --2- 172.21.15.181:0/42601514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6cc7f4c00 0x55a6cc870580 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.562 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 -- 172.21.15.181:0/42601514 >> 172.21.15.181:0/42601514 conn(0x55a6cc7f5000 msgr2=0x55a6cc8e9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.562 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 -- 172.21.15.181:0/42601514 shutdown_connections 2024-09-12T02:32:04.562 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.553+0000 7f6ddd799280 1 -- 172.21.15.181:0/42601514 wait complete. 2024-09-12T02:32:04.562 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set expire_pos 123 2024-09-12T02:32:04.585 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.584+0000 7f7410294280 1 -- start start 2024-09-12T02:32:04.585 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.584+0000 7f7410294280 1 Processor -- start 2024-09-12T02:32:04.587 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f7410294280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a1da4c00 0x55a6a1e20580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f7410294280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a1da5800 0x55a6a1e20b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f7410294280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a1da5c00 0x55a6a1e21080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f7410294280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a6a2b30180 con 0x55a6a1da5800 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f7410294280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a6a2b30300 con 0x55a6a1da4c00 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f7410294280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a6a2b30480 con 0x55a6a1da5c00 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f740e23a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a1da5800 0x55a6a1e20b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f740e23a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a1da5800 0x55a6a1e20b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44064/0 (socket says 172.21.15.181:44064) 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f740e23a640 1 -- 172.21.15.181:0/527005192 learned_addr learned my addr 172.21.15.181:0/527005192 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f740f23c640 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a1da5c00 0x55a6a1e21080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.585+0000 7f740ea3b640 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a1da4c00 0x55a6a1e20580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740e23a640 1 -- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a1da5c00 msgr2=0x55a6a1e21080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.588 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740e23a640 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a1da5c00 0x55a6a1e21080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740e23a640 1 -- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a1da4c00 msgr2=0x55a6a1e20580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740e23a640 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a1da4c00 0x55a6a1e20580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740e23a640 1 -- 172.21.15.181:0/527005192 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6a1ddc780 con 0x55a6a1da5800 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740ea3b640 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a1da4c00 0x55a6a1e20580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740f23c640 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a1da5c00 0x55a6a1e21080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740e23a640 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a1da5800 0x55a6a1e20b00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55a6a2bc5800 tx=0x55a6a2b44840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cfefbc57cb2420 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740c236640 1 -- 172.21.15.181:0/527005192 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6a1dca680 con 0x55a6a1da5800 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740c236640 1 -- 172.21.15.181:0/527005192 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a6a1dd0fc0 con 0x55a6a1da5800 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740c236640 1 -- 172.21.15.181:0/527005192 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6a1dcab60 con 0x55a6a1da5800 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f7410294280 1 -- 172.21.15.181:0/527005192 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6a1ddc3c0 con 0x55a6a1da5800 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f7410294280 1 -- 172.21.15.181:0/527005192 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a6a1ddd680 con 0x55a6a1da5800 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740c236640 1 -- 172.21.15.181:0/527005192 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a6a2c7ea00 con 0x55a6a1da5800 2024-09-12T02:32:04.589 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.586+0000 7f740c236640 1 -- 172.21.15.181:0/527005192 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x55a6a1dff180 con 0x55a6a1da5800 2024-09-12T02:32:04.590 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 Processor -- start 2024-09-12T02:32:04.590 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 -- start start 2024-09-12T02:32:04.595 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83400 0x55a6a1e21600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.595 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e21b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.595 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83c00 0x55a6a1e22100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.595 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a6a2b30600 con 0x55a6a2c83800 2024-09-12T02:32:04.595 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a6a2b30780 con 0x55a6a2c83400 2024-09-12T02:32:04.595 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f7410294280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a6a2b30900 con 0x55a6a2c83c00 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f740ea3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e21b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f740ea3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e21b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44068/0 (socket says 172.21.15.181:44068) 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f740ea3b640 1 -- 172.21.15.181:0/2933427048 learned_addr learned my addr 172.21.15.181:0/2933427048 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f740e23a640 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83c00 0x55a6a1e22100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.587+0000 7f740f23c640 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83400 0x55a6a1e21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740ea3b640 1 -- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83c00 msgr2=0x55a6a1e22100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740ea3b640 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83c00 0x55a6a1e22100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740ea3b640 1 -- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83400 msgr2=0x55a6a1e21600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740ea3b640 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83400 0x55a6a1e21600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740ea3b640 1 -- 172.21.15.181:0/2933427048 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6a1ddd4a0 con 0x55a6a2c83800 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740ea3b640 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e21b80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x55a6a2c96840 tx=0x55a6a2c98cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22647293d7ab3fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740a232640 1 -- 172.21.15.181:0/2933427048 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6a1dca680 con 0x55a6a2c83800 2024-09-12T02:32:04.596 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740a232640 1 -- 172.21.15.181:0/2933427048 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a6a1dd0a80 con 0x55a6a2c83800 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f740a232640 1 -- 172.21.15.181:0/2933427048 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6a1dcab60 con 0x55a6a2c83800 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 -- 172.21.15.181:0/2933427048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 msgr2=0x55a6a1e21b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e21b80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x55a6a2c96840 tx=0x55a6a2c98cc0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 -- 172.21.15.181:0/2933427048 shutdown_connections 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83c00 0x55a6a1e22100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e21b80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 --2- 172.21.15.181:0/2933427048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83400 0x55a6a1e21600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 -- 172.21.15.181:0/2933427048 >> 172.21.15.181:0/2933427048 conn(0x55a6a2c83000 msgr2=0x55a6a1e9b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 -- 172.21.15.181:0/2933427048 shutdown_connections 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.588+0000 7f7410294280 1 -- 172.21.15.181:0/2933427048 wait complete. 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.589+0000 7f7410294280 1 Processor -- start 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.589+0000 7f7410294280 1 -- start start 2024-09-12T02:32:04.597 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83400 0x55a6a1e23180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e22c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83c00 0x55a6a1e22680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a6a2b30900 con 0x55a6a2c83800 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a6a2b30a80 con 0x55a6a2c83c00 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a6a2b30780 con 0x55a6a2c83400 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e22c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e22c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44070/0 (socket says 172.21.15.181:44070) 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 -- 172.21.15.181:0/3687753220 learned_addr learned my addr 172.21.15.181:0/3687753220 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740f23c640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83400 0x55a6a1e23180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740e23a640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83c00 0x55a6a1e22680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 -- 172.21.15.181:0/3687753220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83400 msgr2=0x55a6a1e23180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a2c83400 0x55a6a1e23180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 -- 172.21.15.181:0/3687753220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83c00 msgr2=0x55a6a1e22680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.598 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a2c83c00 0x55a6a1e22680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 -- 172.21.15.181:0/3687753220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6a1ddc780 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f740ea3b640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e22c00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55a6a2c97b00 tx=0x55a6a2c98c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7408a2f640 1 -- 172.21.15.181:0/3687753220 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6a1dca4e0 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7408a2f640 1 -- 172.21.15.181:0/3687753220 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a6a1dd0e00 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6a1ddc3c0 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7408a2f640 1 -- 172.21.15.181:0/3687753220 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a6a1dca680 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.590+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6a1ddc000 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.591+0000 7f7408a2f640 1 -- 172.21.15.181:0/3687753220 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a6a2ceac00 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f7408a2f640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6a2cf9000 0x55a6a1e23700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f7408a2f640 1 -- 172.21.15.181:0/3687753220 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x55a6a2cfaa00 con 0x55a6a2c83800 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f740f23c640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6a2cf9000 0x55a6a1e23700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f7410294280 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6a2cf9400 0x55a6a1e22100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a6a2cf9800 con 0x55a6a2cf9400 2024-09-12T02:32:04.599 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f740e23a640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6a2cf9400 0x55a6a1e22100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.600 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f740f23c640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6a2cf9000 0x55a6a1e23700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55a6a2b34030 tx=0x55a6a2b44b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.600 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.592+0000 7f740e23a640 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6a2cf9400 0x55a6a1e22100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.600 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.593+0000 7f740e23a640 1 -- 172.21.15.181:0/3687753220 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55a6a1e8c000 con 0x55a6a2cf9400 2024-09-12T02:32:04.600 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.593+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55a6a2cf9c00 con 0x55a6a2cf9400 2024-09-12T02:32:04.600 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.593+0000 7f740e23a640 1 -- 172.21.15.181:0/3687753220 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv26 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55a6a1e8c000 con 0x55a6a2cf9400 2024-09-12T02:32:04.600 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.593+0000 7f7410294280 -1 Header is invalid (inconsistent offsets) 2024-09-12T02:32:04.600 INFO:tasks.workunit.client.0.smithi181.stdout:Updating expire_pos 0x400000 -> 0x7b 2024-09-12T02:32:04.601 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.593+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x55a6a212e000 con 0x55a6a2cf9400 2024-09-12T02:32:04.601 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f740e23a640 1 -- 172.21.15.181:0/3687753220 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v48'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a6a1e8c000 con 0x55a6a2cf9400 2024-09-12T02:32:04.601 INFO:tasks.workunit.client.0.smithi181.stdout:Successfully updated header. 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6a2cf9400 msgr2=0x55a6a1e22100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x55a6a2cf9400 0x55a6a1e22100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6a2cf9000 msgr2=0x55a6a1e23700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a6a2cf9000 0x55a6a1e23700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55a6a2b34030 tx=0x55a6a2b44b40 comp rx=0 tx=0).stop 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 msgr2=0x55a6a1e22c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 --2- 172.21.15.181:0/3687753220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a2c83800 0x55a6a1e22c00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55a6a2c97b00 tx=0x55a6a2c98c00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f740ea3b640 1 -- 172.21.15.181:0/3687753220 reap_dead start 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 shutdown_connections 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 >> 172.21.15.181:0/3687753220 conn(0x55a6a2c83000 msgr2=0x55a6a1e9b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.603 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 shutdown_connections 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.594+0000 7f7410294280 1 -- 172.21.15.181:0/3687753220 wait complete. 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 -- 172.21.15.181:0/527005192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a1da5800 msgr2=0x55a6a1e20b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a1da5800 0x55a6a1e20b00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55a6a2bc5800 tx=0x55a6a2b44840 comp rx=0 tx=0).stop 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 -- 172.21.15.181:0/527005192 shutdown_connections 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a6a1da5c00 0x55a6a1e21080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a6a1da5800 0x55a6a1e20b00 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 --2- 172.21.15.181:0/527005192 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a6a1da4c00 0x55a6a1e20580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 -- 172.21.15.181:0/527005192 >> 172.21.15.181:0/527005192 conn(0x55a6a1da5000 msgr2=0x55a6a1e9a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 -- 172.21.15.181:0/527005192 shutdown_connections 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.595+0000 7f7410294280 1 -- 172.21.15.181:0/527005192 wait complete. 2024-09-12T02:32:04.604 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set trimmed_pos 123 2024-09-12T02:32:04.627 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 -- start start 2024-09-12T02:32:04.627 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 Processor -- start 2024-09-12T02:32:04.629 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d6e86c00 0x5645d6f02580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d6e87800 0x5645d6f02b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d6e87c00 0x5645d6f03080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5645d7c78780 con 0x5645d6e87800 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5645d7c78600 con 0x5645d6e86c00 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acf51f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5645d7c78480 con 0x5645d6e87c00 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acc9f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d6e87800 0x5645d6f02b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acc9f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d6e87800 0x5645d6f02b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44076/0 (socket says 172.21.15.181:44076) 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1683662859 learned_addr learned my addr 172.21.15.181:0/1683662859 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acd1f7640 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d6e86c00 0x5645d6f02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.627+0000 7f5acd9f8640 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d6e87c00 0x5645d6f03080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.630 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d6e87c00 msgr2=0x5645d6f03080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d6e87c00 0x5645d6f03080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d6e86c00 msgr2=0x5645d6f02580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d6e86c00 0x5645d6f02580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1683662859 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645d6ebe780 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d6e87800 0x5645d6f02b00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x5645d7cb1800 tx=0x5645d7c264e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2297366ce08fe7a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5aca9f2640 1 -- 172.21.15.181:0/1683662859 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5645d6eac680 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5aca9f2640 1 -- 172.21.15.181:0/1683662859 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5645d6eb2fc0 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5aca9f2640 1 -- 172.21.15.181:0/1683662859 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5645d6eacb60 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acf51f280 1 -- 172.21.15.181:0/1683662859 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645d6ebe3c0 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5acf51f280 1 -- 172.21.15.181:0/1683662859 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5645d6ebf680 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5aca9f2640 1 -- 172.21.15.181:0/1683662859 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5645d7d70600 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.628+0000 7f5aca9f2640 1 -- 172.21.15.181:0/1683662859 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x5645d6ee1180 con 0x5645d6e87800 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.629+0000 7f5acf51f280 1 Processor -- start 2024-09-12T02:32:04.631 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.629+0000 7f5acf51f280 1 -- start start 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 0x5645d6f03600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55800 0x5645d6f03b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55c00 0x5645d6f04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acf51f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5645d7c78300 con 0x5645d7d55c00 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acf51f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5645d7c78000 con 0x5645d7d55800 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acf51f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5645d6ee8480 con 0x5645d7d55400 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55c00 0x5645d6f04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55c00 0x5645d6f04100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44080/0 (socket says 172.21.15.181:44080) 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1521333179 learned_addr learned my addr 172.21.15.181:0/1521333179 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acd1f7640 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55800 0x5645d6f03b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.637 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acd9f8640 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 0x5645d6f03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 msgr2=0x5645d6f03600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 0x5645d6f03600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55800 msgr2=0x5645d6f03b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55800 0x5645d6f03b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 -- 172.21.15.181:0/1521333179 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645d6ebf4a0 con 0x5645d7d55c00 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55c00 0x5645d6f04100 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x5645d7cb1a40 tx=0x5645d7c26900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f360d7e9e87ef36c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5ac89ee640 1 -- 172.21.15.181:0/1521333179 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5645d6eac820 con 0x5645d7d55c00 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5ac89ee640 1 -- 172.21.15.181:0/1521333179 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5645d6eb2e00 con 0x5645d7d55c00 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.630+0000 7f5ac89ee640 1 -- 172.21.15.181:0/1521333179 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5645d6eac680 con 0x5645d7d55c00 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 -- 172.21.15.181:0/1521333179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55c00 msgr2=0x5645d6f04100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55c00 0x5645d6f04100 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x5645d7cb1a40 tx=0x5645d7c26900 comp rx=0 tx=0).stop 2024-09-12T02:32:04.638 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 -- 172.21.15.181:0/1521333179 shutdown_connections 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55800 0x5645d6f03b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55c00 0x5645d6f04100 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1521333179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 0x5645d6f03600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 -- 172.21.15.181:0/1521333179 >> 172.21.15.181:0/1521333179 conn(0x5645d7d55000 msgr2=0x5645d7c13000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 -- 172.21.15.181:0/1521333179 shutdown_connections 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 -- 172.21.15.181:0/1521333179 wait complete. 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 Processor -- start 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.631+0000 7f5acf51f280 1 -- start start 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 0x5645d6f05180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55800 0x5645d6f04c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55c00 0x5645d6f04680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.639 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5645d7c79b00 con 0x5645d7d55800 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5645d7c79c80 con 0x5645d7d55c00 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5645d7c78f00 con 0x5645d7d55400 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55800 0x5645d6f04c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55800 0x5645d6f04c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44084/0 (socket says 172.21.15.181:44084) 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 -- 172.21.15.181:0/4066837234 learned_addr learned my addr 172.21.15.181:0/4066837234 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd9f8640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 0x5645d6f05180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55c00 0x5645d6f04680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 -- 172.21.15.181:0/4066837234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 msgr2=0x5645d6f05180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d7d55400 0x5645d6f05180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 -- 172.21.15.181:0/4066837234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55c00 msgr2=0x5645d6f04680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d7d55c00 0x5645d6f04680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 -- 172.21.15.181:0/4066837234 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645d6ebe780 con 0x5645d7d55800 2024-09-12T02:32:04.640 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acd1f7640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55800 0x5645d6f04c00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5645d7d61680 tx=0x5645d7c26b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5ac71eb640 1 -- 172.21.15.181:0/4066837234 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5645d6eac9c0 con 0x5645d7d55800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5ac71eb640 1 -- 172.21.15.181:0/4066837234 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5645d6eb21c0 con 0x5645d7d55800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5ac71eb640 1 -- 172.21.15.181:0/4066837234 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5645d6eac820 con 0x5645d7d55800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645d6ebe3c0 con 0x5645d7d55800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.632+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645d6ebe000 con 0x5645d7d55800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5ac71eb640 1 -- 172.21.15.181:0/4066837234 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5645d7ddcc00 con 0x5645d7d55800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5ac71eb640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5645d7dd7400 0x5645d6f05700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5ac71eb640 1 -- 172.21.15.181:0/4066837234 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5645d7dea600 con 0x5645d7d55800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5acd9f8640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5645d7dd7400 0x5645d6f05700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5acf51f280 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5645d7dd7800 0x5645d6f04100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5645d7dd7c00 con 0x5645d7dd7800 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5645d7dd7800 0x5645d6f04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.641 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5acd9f8640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5645d7dd7400 0x5645d6f05700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5645d7c16e70 tx=0x5645d7d80fc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.642 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.634+0000 7f5acc9f6640 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5645d7dd7800 0x5645d6f04100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.642 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.635+0000 7f5acc9f6640 1 -- 172.21.15.181:0/4066837234 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5645d7c1e000 con 0x5645d7dd7800 2024-09-12T02:32:04.642 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.635+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5645d7dd6c00 con 0x5645d7dd7800 2024-09-12T02:32:04.642 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.635+0000 7f5acc9f6640 1 -- 172.21.15.181:0/4066837234 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv27 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5645d7c1e000 con 0x5645d7dd7800 2024-09-12T02:32:04.642 INFO:tasks.workunit.client.0.smithi181.stdout:Updating trimmed_pos 0x400000 -> 0x7b 2024-09-12T02:32:04.642 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.635+0000 7f5acf51f280 -1 Header is invalid (inconsistent offsets) 2024-09-12T02:32:04.643 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.635+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5645d7dd6800 con 0x5645d7dd7800 2024-09-12T02:32:04.643 INFO:tasks.workunit.client.0.smithi181.stdout:Successfully updated header. 2024-09-12T02:32:04.644 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acc9f6640 1 -- 172.21.15.181:0/4066837234 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v48'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5645d7c1e000 con 0x5645d7dd7800 2024-09-12T02:32:04.644 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5645d7dd7800 msgr2=0x5645d6f04100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.644 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5645d7dd7800 0x5645d6f04100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.644 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5645d7dd7400 msgr2=0x5645d6f05700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5645d7dd7400 0x5645d6f05700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5645d7c16e70 tx=0x5645d7d80fc0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55800 msgr2=0x5645d6f04c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 --2- 172.21.15.181:0/4066837234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d7d55800 0x5645d6f04c00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5645d7d61680 tx=0x5645d7c26b40 comp rx=0 tx=0).stop 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acd1f7640 1 -- 172.21.15.181:0/4066837234 reap_dead start 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 shutdown_connections 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 >> 172.21.15.181:0/4066837234 conn(0x5645d7d55000 msgr2=0x5645d7c13000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 shutdown_connections 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/4066837234 wait complete. 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/1683662859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d6e87800 msgr2=0x5645d6f02b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d6e87800 0x5645d6f02b00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x5645d7cb1800 tx=0x5645d7c264e0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/1683662859 shutdown_connections 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5645d6e87c00 0x5645d6f03080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.645 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645d6e87800 0x5645d6f02b00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.646 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 --2- 172.21.15.181:0/1683662859 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5645d6e86c00 0x5645d6f02580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.646 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/1683662859 >> 172.21.15.181:0/1683662859 conn(0x5645d6e87000 msgr2=0x5645d7c12800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.646 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/1683662859 shutdown_connections 2024-09-12T02:32:04.646 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.637+0000 7f5acf51f280 1 -- 172.21.15.181:0/1683662859 wait complete. 2024-09-12T02:32:04.646 INFO:tasks.workunit.client.0.smithi181.stdout:Rolling back journal to original state... 2024-09-12T02:32:04.646 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'Rolling back journal to original state...' 2024-09-12T02:32:04.646 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-09-12T02:32:04.668 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 -- start start 2024-09-12T02:32:04.669 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 Processor -- start 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008bddec00 0x56008be5a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008bddf800 0x56008be5ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008bddfc00 0x56008be5b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6a180 con 0x56008bddf800 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6a300 con 0x56008bddfc00 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.668+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56008cb6a480 con 0x56008bddec00 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008bddf800 0x56008be5ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008bddf800 0x56008be5ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44094/0 (socket says 172.21.15.181:44094) 2024-09-12T02:32:04.671 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 -- 172.21.15.181:0/1489296785 learned_addr learned my addr 172.21.15.181:0/1489296785 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f6570b41640 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008bddfc00 0x56008be5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f6570340640 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008bddec00 0x56008be5a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 -- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008bddec00 msgr2=0x56008be5a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008bddec00 0x56008be5a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 -- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008bddfc00 msgr2=0x56008be5b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008bddfc00 0x56008be5b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 -- 172.21.15.181:0/1489296785 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008be16780 con 0x56008bddf800 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f6570b41640 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008bddfc00 0x56008be5b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f6570340640 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008bddec00 0x56008be5a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656fb3f640 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008bddf800 0x56008be5ab00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56008cbfd800 tx=0x56008cb7e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3fa0372561131f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.672 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656db3b640 1 -- 172.21.15.181:0/1489296785 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008be04680 con 0x56008bddf800 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656db3b640 1 -- 172.21.15.181:0/1489296785 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56008be0afc0 con 0x56008bddf800 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656db3b640 1 -- 172.21.15.181:0/1489296785 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008be04b60 con 0x56008bddf800 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f6571b99280 1 -- 172.21.15.181:0/1489296785 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008be174a0 con 0x56008bddf800 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f6571b99280 1 -- 172.21.15.181:0/1489296785 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56008be16000 con 0x56008bddf800 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656db3b640 1 -- 172.21.15.181:0/1489296785 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x56008ccb4600 con 0x56008bddf800 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.669+0000 7f656db3b640 1 -- 172.21.15.181:0/1489296785 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x56008be39180 con 0x56008bddf800 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.670+0000 7f6571b99280 1 Processor -- start 2024-09-12T02:32:04.673 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.670+0000 7f6571b99280 1 -- start start 2024-09-12T02:32:04.679 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9400 0x56008be5b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9800 0x56008be5bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6571b99280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6571b99280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6a600 con 0x56008ccb9c00 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6a780 con 0x56008ccb9800 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56008cb6a900 con 0x56008ccb9400 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44098/0 (socket says 172.21.15.181:44098) 2024-09-12T02:32:04.680 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 -- 172.21.15.181:0/2782978871 learned_addr learned my addr 172.21.15.181:0/2782978871 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6570b41640 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9400 0x56008be5b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6570340640 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9800 0x56008be5bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 -- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9400 msgr2=0x56008be5b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9400 0x56008be5b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 -- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9800 msgr2=0x56008be5bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9800 0x56008be5bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 -- 172.21.15.181:0/2782978871 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008be163c0 con 0x56008ccb9c00 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f6570b41640 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9400 0x56008be5b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656fb3f640 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c100 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56008ccca4b0 tx=0x56008cb7ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7342e9e68f4028d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656bb37640 1 -- 172.21.15.181:0/2782978871 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008be04820 con 0x56008ccb9c00 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656bb37640 1 -- 172.21.15.181:0/2782978871 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56008be0ae00 con 0x56008ccb9c00 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.671+0000 7f656bb37640 1 -- 172.21.15.181:0/2782978871 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008be04680 con 0x56008ccb9c00 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 -- 172.21.15.181:0/2782978871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 msgr2=0x56008be5c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.681 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c100 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56008ccca4b0 tx=0x56008cb7ea20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 -- 172.21.15.181:0/2782978871 shutdown_connections 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9800 0x56008be5bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c100 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 --2- 172.21.15.181:0/2782978871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9400 0x56008be5b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 -- 172.21.15.181:0/2782978871 >> 172.21.15.181:0/2782978871 conn(0x56008ccb9000 msgr2=0x56008bed5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 -- 172.21.15.181:0/2782978871 shutdown_connections 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 -- 172.21.15.181:0/2782978871 wait complete. 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 Processor -- start 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.672+0000 7f6571b99280 1 -- start start 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9400 0x56008be5d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9800 0x56008be5cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6571b99280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6571b99280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6bc80 con 0x56008ccb9c00 2024-09-12T02:32:04.682 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6aa80 con 0x56008ccb9400 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56008cb6bb00 con 0x56008ccb9800 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44100/0 (socket says 172.21.15.181:44100) 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 -- 172.21.15.181:0/458594393 learned_addr learned my addr 172.21.15.181:0/458594393 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6570b41640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9400 0x56008be5d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6570340640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9800 0x56008be5cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 -- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9800 msgr2=0x56008be5cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9800 0x56008be5cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 -- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9400 msgr2=0x56008be5d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9400 0x56008be5d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 -- 172.21.15.181:0/458594393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008be16780 con 0x56008ccb9c00 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656fb3f640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c680 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x56008cccb770 tx=0x56008cccec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.683 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656a334640 1 -- 172.21.15.181:0/458594393 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008be04b60 con 0x56008ccb9c00 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f656a334640 1 -- 172.21.15.181:0/458594393 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56008be0ac40 con 0x56008ccb9c00 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.673+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56008be174a0 con 0x56008ccb9c00 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.674+0000 7f656a334640 1 -- 172.21.15.181:0/458594393 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008be044e0 con 0x56008ccb9c00 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.674+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008be16960 con 0x56008ccb9c00 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.675+0000 7f656a334640 1 -- 172.21.15.181:0/458594393 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56008cd32c00 con 0x56008ccb9c00 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.675+0000 7f656a334640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56008cd2d400 0x56008be5d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.675+0000 7f656a334640 1 -- 172.21.15.181:0/458594393 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x56008cd48600 con 0x56008ccb9c00 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.675+0000 7f6570b41640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56008cd2d400 0x56008be5d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.675+0000 7f6570b41640 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56008cd2d400 0x56008be5d700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x56008cb6e060 tx=0x56008cb7ff80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 -- start start 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 Processor -- start 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008cd2dc00 0x56008be5c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.684 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008c1c2000 0x56008be5bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008c1c2400 0x56008be5b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6af00 con 0x56008c1c2000 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56008cb6ad80 con 0x56008c1c2400 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6571b99280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56008cb6be00 con 0x56008cd2dc00 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6570340640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008c1c2000 0x56008be5bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6570340640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008c1c2000 0x56008be5bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44104/0 (socket says 172.21.15.181:44104) 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6570340640 1 -- 172.21.15.181:0/2698810360 learned_addr learned my addr 172.21.15.181:0/2698810360 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f6570b41640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008cd2dc00 0x56008be5c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.676+0000 7f656fb3f640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008c1c2400 0x56008be5b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6570340640 1 -- 172.21.15.181:0/2698810360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008cd2dc00 msgr2=0x56008be5c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6570340640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008cd2dc00 0x56008be5c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6570340640 1 -- 172.21.15.181:0/2698810360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008c1c2400 msgr2=0x56008be5b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6570340640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008c1c2400 0x56008be5b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.685 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6570340640 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008be17680 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6570340640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008c1c2000 0x56008be5bb80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x56008c11b890 tx=0x56008c173c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5757f76ac30aa61f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f656732e640 1 -- 172.21.15.181:0/2698810360 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008cd69a00 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f656732e640 1 -- 172.21.15.181:0/2698810360 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56008be0aa80 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f656732e640 1 -- 172.21.15.181:0/2698810360 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56008cd6da00 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008be16000 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56008be163c0 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f656732e640 1 -- 172.21.15.181:0/2698810360 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x56008c1c8a00 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f656732e640 1 -- 172.21.15.181:0/2698810360 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x56008be39500 con 0x56008c1c2000 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6571b99280 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56008c1c2800 0x56008c1e8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x56008c1c2c00 con 0x56008c1c2800 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.677+0000 7f6570b41640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56008c1c2800 0x56008c1e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.678+0000 7f6570b41640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56008c1c2800 0x56008c1e8000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=23b87d46bb6ff1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.686 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.678+0000 7f6570b41640 1 -- 172.21.15.181:0/2698810360 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x56008bec6000 con 0x56008c1c2800 2024-09-12T02:32:04.687 INFO:tasks.workunit.client.0.smithi181.stdout:undump /tmp/journal.bin 2024-09-12T02:32:04.688 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.678+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x56008c1c3000 con 0x56008c1c2800 2024-09-12T02:32:04.688 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.678+0000 7f6570b41640 1 -- 172.21.15.181:0/2698810360 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv28 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x56008bec6000 con 0x56008c1c2800 2024-09-12T02:32:04.688 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.678+0000 7f6565b2b640 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x56008c1cb000 con 0x56008c1c2800 2024-09-12T02:32:04.688 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.678+0000 7f6565b2b640 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:4 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x56008c1cb400 con 0x56008c1c2800 2024-09-12T02:32:04.688 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f6570b41640 1 -- 172.21.15.181:0/2698810360 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000000 [stat out=16b] v0'0 uv28 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x56008bec6000 con 0x56008c1c2800 2024-09-12T02:32:04.688 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f6570b41640 1 -- 172.21.15.181:0/2698810360 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(4 200.00000001 [stat out=16b] v0'0 uv25 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x56008bec6000 con 0x56008c1c2800 2024-09-12T02:32:04.688 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f6565b2b640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56008c1cb800 0x56008c1ea680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.689 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f6565b2b640 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:5 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x56008c1c2c00 con 0x56008c1cb800 2024-09-12T02:32:04.689 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f656fb3f640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56008c1cb800 0x56008c1ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.689 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f656fb3f640 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56008c1cb800 0x56008c1ea680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=b30a321df89a9b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.689 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f656fb3f640 1 -- 172.21.15.181:0/2698810360 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(5 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56008bec6500 con 0x56008c1cb800 2024-09-12T02:32:04.689 INFO:tasks.workunit.client.0.smithi181.stdout:start 4194304 len 30182 write_pos 4200187 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-09-12T02:32:04.689 INFO:tasks.workunit.client.0.smithi181.stdout:writing header 200.00000000 2024-09-12T02:32:04.689 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.679+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:6 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56008c1c3400 con 0x56008c1c2800 2024-09-12T02:32:04.690 INFO:tasks.workunit.client.0.smithi181.stdout:Purging 2 objects from 1 2024-09-12T02:32:04.690 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.681+0000 7f6570b41640 1 -- 172.21.15.181:0/2698810360 <== osd.2 v2:172.21.15.181:6808/3659790931 5 ==== osd_op_reply(6 200.00000000 [writefull 0~90] v48'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56008bec6000 con 0x56008c1c2800 2024-09-12T02:32:04.690 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.681+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56008c1cb000 con 0x56008c1c2800 2024-09-12T02:32:04.690 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.681+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:8 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56008c1cbc00 con 0x56008c1cb800 2024-09-12T02:32:04.691 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.682+0000 7f656fb3f640 1 -- 172.21.15.181:0/2698810360 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(8 200.00000002 [delete] v48'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56008bec6500 con 0x56008c1cb800 2024-09-12T02:32:04.691 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.682+0000 7f6570b41640 1 -- 172.21.15.181:0/2698810360 <== osd.2 v2:172.21.15.181:6808/3659790931 6 ==== osd_op_reply(7 200.00000001 [delete] v48'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56008bec6000 con 0x56008c1c2800 2024-09-12T02:32:04.691 INFO:tasks.workunit.client.0.smithi181.stdout: writing 4194304~30182 2024-09-12T02:32:04.691 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.682+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:9 6.14 6:2e2fa760:::200.00000001:head [write 0~30182 in=30182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x56008c1c3000 con 0x56008c1c2800 2024-09-12T02:32:04.691 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6570b41640 1 -- 172.21.15.181:0/2698810360 <== osd.2 v2:172.21.15.181:6808/3659790931 7 ==== osd_op_reply(9 200.00000001 [write 0~30182] v48'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56008bec6000 con 0x56008c1c2800 2024-09-12T02:32:04.692 INFO:tasks.workunit.client.0.smithi181.stdout:done. 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56008c1c2800 msgr2=0x56008c1e8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x56008c1c2800 0x56008c1e8000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56008c1cb800 msgr2=0x56008c1ea680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x56008c1cb800 0x56008c1ea680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008c1c2000 msgr2=0x56008be5bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/2698810360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008c1c2000 0x56008be5bb80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x56008c11b890 tx=0x56008c173c80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6570340640 1 -- 172.21.15.181:0/2698810360 reap_dead start 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 shutdown_connections 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 >> 172.21.15.181:0/2698810360 conn(0x56008cd2d800 msgr2=0x56008bed5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 shutdown_connections 2024-09-12T02:32:04.694 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/2698810360 wait complete. 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56008cd2d400 msgr2=0x56008be5d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56008cd2d400 0x56008be5d700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x56008cb6e060 tx=0x56008cb7ff80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 msgr2=0x56008be5c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c680 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x56008cccb770 tx=0x56008cccec00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 shutdown_connections 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56008cd2d400 0x56008be5d700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008ccb9c00 0x56008be5c680 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008ccb9800 0x56008be5cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.683+0000 7f6571b99280 1 --2- 172.21.15.181:0/458594393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008ccb9400 0x56008be5d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 >> 172.21.15.181:0/458594393 conn(0x56008ccb9000 msgr2=0x56008bed5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 shutdown_connections 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/458594393 wait complete. 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/1489296785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008bddf800 msgr2=0x56008be5ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.695 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008bddf800 0x56008be5ab00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56008cbfd800 tx=0x56008cb7e540 comp rx=0 tx=0).stop 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/1489296785 shutdown_connections 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56008bddfc00 0x56008be5b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008bddf800 0x56008be5ab00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 --2- 172.21.15.181:0/1489296785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56008bddec00 0x56008be5a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/1489296785 >> 172.21.15.181:0/1489296785 conn(0x56008bddf000 msgr2=0x56008bed4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/1489296785 shutdown_connections 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.684+0000 7f6571b99280 1 -- 172.21.15.181:0/1489296785 wait complete. 2024-09-12T02:32:04.696 INFO:tasks.workunit.client.0.smithi181.stdout:Testing 'event' commands... 2024-09-12T02:32:04.697 INFO:tasks.workunit.client.0.smithi181.stderr:+ echo 'Testing '\''event'\'' commands...' 2024-09-12T02:32:04.697 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get summary 2024-09-12T02:32:04.715 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.714+0000 7fb707a36280 1 -- start start 2024-09-12T02:32:04.715 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.714+0000 7fb707a36280 1 Processor -- start 2024-09-12T02:32:04.717 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb707a36280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b10d4cc00 0x561b10dc8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb707a36280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b10d4d800 0x561b10dc8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb707a36280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b10d4dc00 0x561b10dc9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb707a36280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b11ad8180 con 0x561b10d4cc00 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb707a36280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561b11ad8300 con 0x561b10d4d800 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb707a36280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561b11ad8480 con 0x561b10d4dc00 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb7061db640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b10d4cc00 0x561b10dc8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb7061db640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b10d4cc00 0x561b10dc8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44122/0 (socket says 172.21.15.181:44122) 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb7061db640 1 -- 172.21.15.181:0/581515710 learned_addr learned my addr 172.21.15.181:0/581515710 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb7069dc640 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b10d4dc00 0x561b10dc9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.715+0000 7fb7059da640 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b10d4d800 0x561b10dc8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7061db640 1 -- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b10d4dc00 msgr2=0x561b10dc9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7061db640 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b10d4dc00 0x561b10dc9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.718 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7061db640 1 -- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b10d4d800 msgr2=0x561b10dc8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7061db640 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b10d4d800 0x561b10dc8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7061db640 1 -- 172.21.15.181:0/581515710 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b10d84780 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7069dc640 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b10d4dc00 0x561b10dc9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7061db640 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b10d4cc00 0x561b10dc8580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x561b11b69830 tx=0x561b11aec540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6705bebfb846d3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7039d6640 1 -- 172.21.15.181:0/581515710 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b10d72680 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7039d6640 1 -- 172.21.15.181:0/581515710 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b10d78a80 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7039d6640 1 -- 172.21.15.181:0/581515710 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b10d72b60 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb707a36280 1 -- 172.21.15.181:0/581515710 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b10d843c0 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb707a36280 1 -- 172.21.15.181:0/581515710 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561b10d85680 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7039d6640 1 -- 172.21.15.181:0/581515710 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x561b11c2a600 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.716+0000 7fb7039d6640 1 -- 172.21.15.181:0/581515710 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x561b10da7180 con 0x561b10d4cc00 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 Processor -- start 2024-09-12T02:32:04.719 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 -- start start 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1f400 0x561b10dc9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 0x561b10dc9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1fc00 0x561b10dca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b11ad8600 con 0x561b11c1f400 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561b11ad8780 con 0x561b11c1f800 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb707a36280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561b11ad8900 con 0x561b11c1fc00 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb7069dc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1f400 0x561b10dc9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb7069dc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1f400 0x561b10dc9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44126/0 (socket says 172.21.15.181:44126) 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb7069dc640 1 -- 172.21.15.181:0/1370087913 learned_addr learned my addr 172.21.15.181:0/1370087913 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.717+0000 7fb7061db640 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 0x561b10dc9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7059da640 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1fc00 0x561b10dca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.726 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7069dc640 1 -- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1fc00 msgr2=0x561b10dca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1fc00 0x561b10dca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7069dc640 1 -- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 msgr2=0x561b10dc9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 0x561b10dc9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7069dc640 1 -- 172.21.15.181:0/1370087913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b10d854a0 con 0x561b11c1f400 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7059da640 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1fc00 0x561b10dca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1f400 0x561b10dc9600 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x561b11c165d0 tx=0x561b11aecae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05f91eae34f37a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7019d2640 1 -- 172.21.15.181:0/1370087913 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b10d729c0 con 0x561b11c1f400 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7019d2640 1 -- 172.21.15.181:0/1370087913 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b10d78fc0 con 0x561b11c1f400 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb7019d2640 1 -- 172.21.15.181:0/1370087913 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b10d72680 con 0x561b11c1f400 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 -- 172.21.15.181:0/1370087913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1f400 msgr2=0x561b10dc9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1f400 0x561b10dc9600 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x561b11c165d0 tx=0x561b11aecae0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 -- 172.21.15.181:0/1370087913 shutdown_connections 2024-09-12T02:32:04.727 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 0x561b10dc9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1fc00 0x561b10dca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 --2- 172.21.15.181:0/1370087913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1f400 0x561b10dc9600 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 -- 172.21.15.181:0/1370087913 >> 172.21.15.181:0/1370087913 conn(0x561b11c1f000 msgr2=0x561b10e43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 -- 172.21.15.181:0/1370087913 shutdown_connections 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.718+0000 7fb707a36280 1 -- 172.21.15.181:0/1370087913 wait complete. 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.719+0000 7fb707a36280 1 Processor -- start 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.719+0000 7fb707a36280 1 -- start start 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.719+0000 7fb707a36280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1f400 0x561b10dcb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.719+0000 7fb707a36280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 0x561b10dcac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.719+0000 7fb707a36280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1fc00 0x561b10dca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb707a36280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b10dae180 con 0x561b11c1fc00 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb707a36280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561b11ad9e00 con 0x561b11c1f800 2024-09-12T02:32:04.728 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb707a36280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561b11ad8d80 con 0x561b11c1f400 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7059da640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1fc00 0x561b10dca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7069dc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1f400 0x561b10dcb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7059da640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1fc00 0x561b10dca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44130/0 (socket says 172.21.15.181:44130) 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7059da640 1 -- 172.21.15.181:0/1296663128 learned_addr learned my addr 172.21.15.181:0/1296663128 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7061db640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 0x561b10dcac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7069dc640 1 -- 172.21.15.181:0/1296663128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 msgr2=0x561b10dcac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b11c1f800 0x561b10dcac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7069dc640 1 -- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1fc00 msgr2=0x561b10dca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1fc00 0x561b10dca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7069dc640 1 -- 172.21.15.181:0/1296663128 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b10d84780 con 0x561b11c1f400 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7059da640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b11c1fc00 0x561b10dca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:04.729 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1f400 0x561b10dcb180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561b11c16840 tx=0x561b11aeca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7001cf640 1 -- 172.21.15.181:0/1296663128 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b10d72b60 con 0x561b11c1f400 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7001cf640 1 -- 172.21.15.181:0/1296663128 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b10d78e00 con 0x561b11c1f400 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b10d843c0 con 0x561b11c1f400 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb7001cf640 1 -- 172.21.15.181:0/1296663128 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b10d724e0 con 0x561b11c1f400 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.720+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x561b10d85680 con 0x561b11c1f400 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb7001cf640 1 -- 172.21.15.181:0/1296663128 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x561b11b46c00 con 0x561b11c1f400 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb7001cf640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b11b4c800 0x561b10dcb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb7001cf640 1 -- 172.21.15.181:0/1296663128 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x561b11c98600 con 0x561b11c1f400 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb7061db640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b11b4c800 0x561b10dcb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb707a36280 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b11b4cc00 0x561b10dca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561b11b4d000 con 0x561b11b4cc00 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb7059da640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b11b4cc00 0x561b10dca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.730 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb7061db640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b11b4c800 0x561b10dcb700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561b10da9b30 tx=0x561b10e09440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.722+0000 7fb7059da640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b11b4cc00 0x561b10dca100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.723+0000 7fb7059da640 1 -- 172.21.15.181:0/1296663128 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x561b10e34000 con 0x561b11b4cc00 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.723+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561b11b4d400 con 0x561b11b4cc00 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.723+0000 7fb7059da640 1 -- 172.21.15.181:0/1296663128 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x561b10e34000 con 0x561b11b4cc00 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.723+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561b11b4d800 con 0x561b11b4cc00 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.724+0000 7fb7059da640 1 -- 172.21.15.181:0/1296663128 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv31 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x561b10e34000 con 0x561b11b4cc00 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b11b4dc00 0x561b10dc9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561b110d5000 con 0x561b11b4dc00 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b11b4dc00 0x561b10dc9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb7069dc640 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b11b4dc00 0x561b10dc9b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.731 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb7069dc640 1 -- 172.21.15.181:0/1296663128 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561b110e4f00 con 0x561b11b4dc00 2024-09-12T02:32:04.732 INFO:tasks.workunit.client.0.smithi181.stdout:Events by type: 2024-09-12T02:32:04.732 INFO:tasks.workunit.client.0.smithi181.stdout: LID: 1 2024-09-12T02:32:04.732 INFO:tasks.workunit.client.0.smithi181.stdout: PURGED: 1 2024-09-12T02:32:04.732 INFO:tasks.workunit.client.0.smithi181.stdout: SESSION: 2 2024-09-12T02:32:04.732 INFO:tasks.workunit.client.0.smithi181.stdout: SUBTREEMAP: 1 2024-09-12T02:32:04.732 INFO:tasks.workunit.client.0.smithi181.stdout: UPDATE: 12 2024-09-12T02:32:04.732 INFO:tasks.workunit.client.0.smithi181.stdout:Errors: 0 2024-09-12T02:32:04.734 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b11b4cc00 msgr2=0x561b10dca100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.734 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561b11b4cc00 0x561b10dca100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.734 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b11b4dc00 msgr2=0x561b10dc9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.734 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561b11b4dc00 0x561b10dc9b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.734 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b11b4c800 msgr2=0x561b10dcb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.734 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561b11b4c800 0x561b10dcb700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561b10da9b30 tx=0x561b10e09440 comp rx=0 tx=0).stop 2024-09-12T02:32:04.734 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1f400 msgr2=0x561b10dcb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 --2- 172.21.15.181:0/1296663128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b11c1f400 0x561b10dcb180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561b11c16840 tx=0x561b11aeca80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb7059da640 1 -- 172.21.15.181:0/1296663128 reap_dead start 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb7059da640 1 -- 172.21.15.181:0/1296663128 reap_dead start 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 shutdown_connections 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 >> 172.21.15.181:0/1296663128 conn(0x561b11c1f000 msgr2=0x561b10e43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 shutdown_connections 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.725+0000 7fb707a36280 1 -- 172.21.15.181:0/1296663128 wait complete. 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 -- 172.21.15.181:0/581515710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b10d4cc00 msgr2=0x561b10dc8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b10d4cc00 0x561b10dc8580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x561b11b69830 tx=0x561b11aec540 comp rx=0 tx=0).stop 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 -- 172.21.15.181:0/581515710 shutdown_connections 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561b10d4d800 0x561b10dc8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561b10d4dc00 0x561b10dc9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 --2- 172.21.15.181:0/581515710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b10d4cc00 0x561b10dc8580 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.735 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 -- 172.21.15.181:0/581515710 >> 172.21.15.181:0/581515710 conn(0x561b10d4d000 msgr2=0x561b10e42800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.736 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 -- 172.21.15.181:0/581515710 shutdown_connections 2024-09-12T02:32:04.736 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.726+0000 7fb707a36280 1 -- 172.21.15.181:0/581515710 wait complete. 2024-09-12T02:32:04.736 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get --type=UPDATE --path=/ --inode=0 --frag=0x100 summary 2024-09-12T02:32:04.761 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.760+0000 7ff3afa3d280 1 -- start start 2024-09-12T02:32:04.761 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3afa3d280 1 Processor -- start 2024-09-12T02:32:04.767 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b5a16c00 0x5596b5a93b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b5a17800 0x5596b5a93600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b5a17c00 0x5596b5a93080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5596b67f4180 con 0x5596b5a17800 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5596b5a78480 con 0x5596b5a16c00 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5596b5a78900 con 0x5596b5a17c00 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ad9e3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b5a17800 0x5596b5a93600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ad9e3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b5a17800 0x5596b5a93600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44150/0 (socket says 172.21.15.181:44150) 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/3089169168 learned_addr learned my addr 172.21.15.181:0/3089169168 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ae1e4640 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b5a16c00 0x5596b5a93b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b5a17c00 0x5596b5a93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b5a17c00 msgr2=0x5596b5a93080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b5a17c00 0x5596b5a93080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.768 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.761+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b5a16c00 msgr2=0x5596b5a93b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b5a16c00 0x5596b5a93b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/3089169168 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b5a4e780 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b5a17c00 0x5596b5a93080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b5a17800 0x5596b5a93600 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5596b68317a0 tx=0x5596b67b7f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8edbfc21dddc733 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ab9df640 1 -- 172.21.15.181:0/3089169168 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b5a3c9c0 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ab9df640 1 -- 172.21.15.181:0/3089169168 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5596b5a42700 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ab9df640 1 -- 172.21.15.181:0/3089169168 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b5a3c680 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3afa3d280 1 -- 172.21.15.181:0/3089169168 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b5a4f4a0 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3afa3d280 1 -- 172.21.15.181:0/3089169168 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5596b5a4e000 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ab9df640 1 -- 172.21.15.181:0/3089169168 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5596b68da200 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.762+0000 7ff3ab9df640 1 -- 172.21.15.181:0/3089169168 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x5596b5a71180 con 0x5596b5a17800 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 Processor -- start 2024-09-12T02:32:04.769 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 -- start start 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e000 0x5596b5a92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e400 0x5596b5a92580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5596b5a78180 con 0x5596b692e000 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5596b67f5500 con 0x5596b692e800 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5596b67f5380 con 0x5596b692e400 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3ae9e5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e000 0x5596b5a92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3ae9e5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e000 0x5596b5a92b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44158/0 (socket says 172.21.15.181:44158) 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3ae9e5640 1 -- 172.21.15.181:0/2603535030 learned_addr learned my addr 172.21.15.181:0/2603535030 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3ae1e4640 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e400 0x5596b5a92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.763+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3ae9e5640 1 -- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e400 msgr2=0x5596b5a92580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.770 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e400 0x5596b5a92580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3ae9e5640 1 -- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e800 msgr2=0x5596b5a94100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3ae9e5640 1 -- 172.21.15.181:0/2603535030 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b5a4e3c0 con 0x5596b692e000 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e000 0x5596b5a92b00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x5596b68e87e0 tx=0x5596b68ecc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b523f7e5c467085 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3a99db640 1 -- 172.21.15.181:0/2603535030 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b5a3c9c0 con 0x5596b692e000 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3a99db640 1 -- 172.21.15.181:0/2603535030 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5596b5a42e00 con 0x5596b692e000 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3a99db640 1 -- 172.21.15.181:0/2603535030 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b5a3c680 con 0x5596b692e000 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 -- 172.21.15.181:0/2603535030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e000 msgr2=0x5596b5a92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e000 0x5596b5a92b00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x5596b68e87e0 tx=0x5596b68ecc00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 -- 172.21.15.181:0/2603535030 shutdown_connections 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.771 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e400 0x5596b5a92580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/2603535030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e000 0x5596b5a92b00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 -- 172.21.15.181:0/2603535030 >> 172.21.15.181:0/2603535030 conn(0x5596b67f7c00 msgr2=0x5596b67a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 -- 172.21.15.181:0/2603535030 shutdown_connections 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.764+0000 7ff3afa3d280 1 -- 172.21.15.181:0/2603535030 wait complete. 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.765+0000 7ff3afa3d280 1 Processor -- start 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.765+0000 7ff3afa3d280 1 -- start start 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.765+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e000 0x5596b5a92b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.765+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e400 0x5596b5a92580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.765+0000 7ff3afa3d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.765+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5596b67f5680 con 0x5596b692e800 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.765+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5596b67f4900 con 0x5596b692e400 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3afa3d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5596b5a78900 con 0x5596b692e000 2024-09-12T02:32:04.772 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ae9e5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e000 0x5596b5a92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44164/0 (socket says 172.21.15.181:44164) 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ae1e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e400 0x5596b5a92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/1805190662 learned_addr learned my addr 172.21.15.181:0/1805190662 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/1805190662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e000 msgr2=0x5596b5a92b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b692e000 0x5596b5a92b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/1805190662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e400 msgr2=0x5596b5a92580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b692e400 0x5596b5a92580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 -- 172.21.15.181:0/1805190662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b5a4e960 con 0x5596b692e800 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3ad9e3640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e800 0x5596b5a94100 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5596b6831e00 tx=0x5596b5ad34a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3a81d8640 1 -- 172.21.15.181:0/1805190662 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b5a3cb60 con 0x5596b692e800 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3a81d8640 1 -- 172.21.15.181:0/1805190662 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5596b5a42fc0 con 0x5596b692e800 2024-09-12T02:32:04.773 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596b5a4f680 con 0x5596b692e800 2024-09-12T02:32:04.774 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3a81d8640 1 -- 172.21.15.181:0/1805190662 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b5a3c820 con 0x5596b692e800 2024-09-12T02:32:04.774 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.766+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b5a4f860 con 0x5596b692e800 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.767+0000 7ff3a81d8640 1 -- 172.21.15.181:0/1805190662 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5596b694ec00 con 0x5596b692e800 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3a81d8640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5596b695d400 0x5596b5d94000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3a81d8640 1 -- 172.21.15.181:0/1805190662 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5596b6935200 con 0x5596b692e800 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5596b695d400 0x5596b5d94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5596b692ec00 0x5596b5a94680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5596b692f000 con 0x5596b692ec00 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3ae1e4640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5596b692ec00 0x5596b5a94680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5596b695d400 0x5596b5d94000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5596b68e87e0 tx=0x5596b67b7e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.768+0000 7ff3ae1e4640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5596b692ec00 0x5596b5a94680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3ae1e4640 1 -- 172.21.15.181:0/1805190662 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5596b67b2000 con 0x5596b692ec00 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5596b695d800 con 0x5596b692ec00 2024-09-12T02:32:04.776 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3ae1e4640 1 -- 172.21.15.181:0/1805190662 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5596b67b2000 con 0x5596b692ec00 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5596b695dc00 con 0x5596b692ec00 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3ae1e4640 1 -- 172.21.15.181:0/1805190662 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv31 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x5596b67b2000 con 0x5596b692ec00 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5596b695d800 0x5596b5a94c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5596b692f000 con 0x5596b695d800 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.769+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5596b695d800 0x5596b5a94c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3ae9e5640 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5596b695d800 0x5596b5a94c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3ae9e5640 1 -- 172.21.15.181:0/1805190662 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5596b67b3680 con 0x5596b695d800 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stdout:Events by type: 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stdout: UPDATE: 5 2024-09-12T02:32:04.777 INFO:tasks.workunit.client.0.smithi181.stdout:Errors: 0 2024-09-12T02:32:04.779 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5596b692ec00 msgr2=0x5596b5a94680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.779 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5596b692ec00 0x5596b5a94680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.779 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5596b695d800 msgr2=0x5596b5a94c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.779 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5596b695d800 0x5596b5a94c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.779 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5596b695d400 msgr2=0x5596b5d94000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.779 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5596b695d400 0x5596b5d94000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5596b68e87e0 tx=0x5596b67b7e00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.779 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3ae1e4640 1 -- 172.21.15.181:0/1805190662 reap_dead start 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e800 msgr2=0x5596b5a94100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e800 0x5596b5a94100 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5596b6831e00 tx=0x5596b5ad34a0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 shutdown_connections 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/1805190662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b692e800 0x5596b5a94100 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 >> 172.21.15.181:0/1805190662 conn(0x5596b67f7c00 msgr2=0x5596b67a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 shutdown_connections 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/1805190662 wait complete. 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/3089169168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b5a17800 msgr2=0x5596b5a93600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b5a17800 0x5596b5a93600 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5596b68317a0 tx=0x5596b67b7f80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/3089169168 shutdown_connections 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5596b5a17c00 0x5596b5a93080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5596b5a17800 0x5596b5a93600 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.780 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 --2- 172.21.15.181:0/3089169168 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5596b5a16c00 0x5596b5a93b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.781 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/3089169168 >> 172.21.15.181:0/3089169168 conn(0x5596b5a17000 msgr2=0x5596b67a2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.781 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/3089169168 shutdown_connections 2024-09-12T02:32:04.781 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.770+0000 7ff3afa3d280 1 -- 172.21.15.181:0/3089169168 wait complete. 2024-09-12T02:32:04.781 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get json --path /tmp/json.tmp 2024-09-12T02:32:04.804 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.803+0000 7f9b9e3d4280 1 -- start start 2024-09-12T02:32:04.804 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.803+0000 7f9b9e3d4280 1 Processor -- start 2024-09-12T02:32:04.810 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558cdf492c00 0x558cdf50e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.810 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cdf493800 0x558cdf50eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.810 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558cdf493c00 0x558cdf50f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.810 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558cdf60e180 con 0x558cdf493800 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558cdf60e300 con 0x558cdf493c00 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558cdf60e480 con 0x558cdf492c00 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cdf493800 0x558cdf50eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cdf493800 0x558cdf50eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44186/0 (socket says 172.21.15.181:44186) 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 -- 172.21.15.181:0/344846106 learned_addr learned my addr 172.21.15.181:0/344846106 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9cb79640 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558cdf492c00 0x558cdf50e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558cdf493c00 0x558cdf50f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 -- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558cdf492c00 msgr2=0x558cdf50e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558cdf492c00 0x558cdf50e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 -- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558cdf493c00 msgr2=0x558cdf50f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558cdf493c00 0x558cdf50f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 -- 172.21.15.181:0/344846106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cdf4ca780 con 0x558cdf493800 2024-09-12T02:32:04.811 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.804+0000 7f9b9c378640 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cdf493800 0x558cdf50eb00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x558ce02a7830 tx=0x558ce0232540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0baef8a1eb725a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9a374640 1 -- 172.21.15.181:0/344846106 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558cdf4b8680 con 0x558cdf493800 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9a374640 1 -- 172.21.15.181:0/344846106 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558cdf4bea80 con 0x558cdf493800 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9a374640 1 -- 172.21.15.181:0/344846106 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558cdf4b8b60 con 0x558cdf493800 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/344846106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cdf4cb4a0 con 0x558cdf493800 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/344846106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x558cdf4ca000 con 0x558cdf493800 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9a374640 1 -- 172.21.15.181:0/344846106 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x558ce037a600 con 0x558cdf493800 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9a374640 1 -- 172.21.15.181:0/344846106 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x558cdf4ed180 con 0x558cdf493800 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.805+0000 7f9b9e3d4280 1 Processor -- start 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9e3d4280 1 -- start start 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf50f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 0x558cdf50fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 0x558cdf510100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.812 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558cdf60e600 con 0x558ce037d400 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558cdf60e780 con 0x558ce037d800 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558cdf60e900 con 0x558ce037dc00 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf50f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf50f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44194/0 (socket says 172.21.15.181:44194) 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 -- 172.21.15.181:0/2596229125 learned_addr learned my addr 172.21.15.181:0/2596229125 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9cb79640 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 0x558cdf50fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9c378640 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 0x558cdf510100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 -- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 msgr2=0x558cdf510100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 0x558cdf510100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 -- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 msgr2=0x558cdf50fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 0x558cdf50fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.813 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.806+0000 7f9b9d37a640 1 -- 172.21.15.181:0/2596229125 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cdf4ca3c0 con 0x558ce037d400 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf50f600 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x558ce0360720 tx=0x558ce0232ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2fe852a9bbff8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b98370640 1 -- 172.21.15.181:0/2596229125 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558cdf4b89c0 con 0x558ce037d400 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b98370640 1 -- 172.21.15.181:0/2596229125 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558cdf4befc0 con 0x558ce037d400 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b98370640 1 -- 172.21.15.181:0/2596229125 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558cdf4b8680 con 0x558ce037d400 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/2596229125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 msgr2=0x558cdf50f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf50f600 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x558ce0360720 tx=0x558ce0232ae0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/2596229125 shutdown_connections 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 0x558cdf50fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 0x558cdf510100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/2596229125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf50f600 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/2596229125 >> 172.21.15.181:0/2596229125 conn(0x558ce037d000 msgr2=0x558cdf589000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/2596229125 shutdown_connections 2024-09-12T02:32:04.814 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.807+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/2596229125 wait complete. 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 Processor -- start 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 -- start start 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf511180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 0x558cdf510c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 0x558cdf510680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558cdf4f4180 con 0x558ce037d400 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558cdf60fe00 con 0x558ce037d800 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9e3d4280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558cdf60ed80 con 0x558ce037dc00 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9d37a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf511180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9d37a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf511180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44206/0 (socket says 172.21.15.181:44206) 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9d37a640 1 -- 172.21.15.181:0/4148296254 learned_addr learned my addr 172.21.15.181:0/4148296254 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9cb79640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 0x558cdf510c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.815 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.808+0000 7f9b9c378640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 0x558cdf510680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9d37a640 1 -- 172.21.15.181:0/4148296254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 msgr2=0x558cdf510680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ce037dc00 0x558cdf510680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9d37a640 1 -- 172.21.15.181:0/4148296254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 msgr2=0x558cdf510c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ce037d800 0x558cdf510c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9d37a640 1 -- 172.21.15.181:0/4148296254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cdf4ca780 con 0x558ce037d400 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf511180 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x558ce0360a50 tx=0x558ce0233f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b96b6d640 1 -- 172.21.15.181:0/4148296254 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558cdf4b8b60 con 0x558ce037d400 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b96b6d640 1 -- 172.21.15.181:0/4148296254 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558cdf4bee00 con 0x558ce037d400 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cdf4cb4a0 con 0x558ce037d400 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b96b6d640 1 -- 172.21.15.181:0/4148296254 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558cdf4b84e0 con 0x558ce037d400 2024-09-12T02:32:04.816 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.809+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cdf4ca960 con 0x558ce037d400 2024-09-12T02:32:04.820 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.810+0000 7f9b96b6d640 1 -- 172.21.15.181:0/4148296254 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x558ce0284c00 con 0x558ce037d400 2024-09-12T02:32:04.820 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b96b6d640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558ce03ec400 0x558cdf511700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.820 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b96b6d640 1 -- 172.21.15.181:0/4148296254 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x558ce03e0600 con 0x558ce037d400 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9cb79640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558ce03ec400 0x558cdf511700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558ce03ec800 0x558cdf510100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x558ce03ecc00 con 0x558ce03ec800 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9c378640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558ce03ec800 0x558cdf510100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9cb79640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558ce03ec400 0x558cdf511700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558ce0222cf0 tx=0x558ce0386d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9c378640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558ce03ec800 0x558cdf510100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9c378640 1 -- 172.21.15.181:0/4148296254 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x558cdf59e000 con 0x558ce03ec800 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.811+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x558ce03ed000 con 0x558ce03ec800 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.812+0000 7f9b9c378640 1 -- 172.21.15.181:0/4148296254 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x558cdf59e000 con 0x558ce03ec800 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.812+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x558ce03ed400 con 0x558ce03ec800 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.812+0000 7f9b9c378640 1 -- 172.21.15.181:0/4148296254 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv31 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x558cdf59e000 con 0x558ce03ec800 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.812+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558ce03ed800 0x558cdf50fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.821 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.812+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x558cdf822800 con 0x558ce03ed800 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.812+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558ce03ed800 0x558cdf50fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.812+0000 7f9b9d37a640 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558ce03ed800 0x558cdf50fb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.813+0000 7f9b9d37a640 1 -- 172.21.15.181:0/4148296254 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x558cdf832f00 con 0x558ce03ed800 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:Wrote output to JSON file '/tmp/json.tmp' 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558ce03ec800 msgr2=0x558cdf510100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558ce03ec800 0x558cdf510100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558ce03ed800 msgr2=0x558cdf50fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558ce03ed800 0x558cdf50fb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558ce03ec400 msgr2=0x558cdf511700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558ce03ec400 0x558cdf511700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558ce0222cf0 tx=0x558ce0386d80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 msgr2=0x558cdf511180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/4148296254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ce037d400 0x558cdf511180 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x558ce0360a50 tx=0x558ce0233f80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.822 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9cb79640 1 -- 172.21.15.181:0/4148296254 reap_dead start 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9cb79640 1 -- 172.21.15.181:0/4148296254 reap_dead start 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 shutdown_connections 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.815+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 >> 172.21.15.181:0/4148296254 conn(0x558ce037d000 msgr2=0x558cdf589000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 shutdown_connections 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/4148296254 wait complete. 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/344846106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cdf493800 msgr2=0x558cdf50eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cdf493800 0x558cdf50eb00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x558ce02a7830 tx=0x558ce0232540 comp rx=0 tx=0).stop 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/344846106 shutdown_connections 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558cdf493c00 0x558cdf50f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cdf493800 0x558cdf50eb00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 --2- 172.21.15.181:0/344846106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558cdf492c00 0x558cdf50e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/344846106 >> 172.21.15.181:0/344846106 conn(0x558cdf493000 msgr2=0x558cdf588800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/344846106 shutdown_connections 2024-09-12T02:32:04.823 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.816+0000 7f9b9e3d4280 1 -- 172.21.15.181:0/344846106 wait complete. 2024-09-12T02:32:04.824 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' '!' -s /tmp/json.tmp ']' 2024-09-12T02:32:04.824 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get binary --path /tmp/binary.tmp 2024-09-12T02:32:04.849 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.848+0000 7f152f711280 1 -- start start 2024-09-12T02:32:04.849 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.848+0000 7f152f711280 1 Processor -- start 2024-09-12T02:32:04.855 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152f711280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563096d50c00 0x563096dcc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.855 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152f711280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563096d51800 0x563096dccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.855 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152f711280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563096d51c00 0x563096dcd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152f711280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563097b3a600 con 0x563096d51c00 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152f711280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563097b3a480 con 0x563096d51800 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152f711280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563097b3a300 con 0x563096d50c00 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563096d51c00 0x563096dcd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563096d51c00 0x563096dcd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44212/0 (socket says 172.21.15.181:44212) 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 -- 172.21.15.181:0/1310068017 learned_addr learned my addr 172.21.15.181:0/1310068017 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152d6b7640 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563096d51800 0x563096dccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152deb8640 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563096d50c00 0x563096dcc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 -- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563096d50c00 msgr2=0x563096dcc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563096d50c00 0x563096dcc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 -- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563096d51800 msgr2=0x563096dccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563096d51800 0x563096dccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.856 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 -- 172.21.15.181:0/1310068017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563096d88780 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152e6b9640 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563096d51c00 0x563096dcd080 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x563097b77830 tx=0x563097af0600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32e7dded5dce892 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.849+0000 7f152b6b3640 1 -- 172.21.15.181:0/1310068017 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563096d76680 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152b6b3640 1 -- 172.21.15.181:0/1310068017 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563096d7ca80 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152b6b3640 1 -- 172.21.15.181:0/1310068017 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563096d76b60 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152f711280 1 -- 172.21.15.181:0/1310068017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563096d883c0 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152f711280 1 -- 172.21.15.181:0/1310068017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563096d89680 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152b6b3640 1 -- 172.21.15.181:0/1310068017 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x563097c40600 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152b6b3640 1 -- 172.21.15.181:0/1310068017 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x563096dab180 con 0x563096d51c00 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152f711280 1 Processor -- start 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.850+0000 7f152f711280 1 -- start start 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152f711280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27400 0x563096dcd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152f711280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.857 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152f711280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27c00 0x563096dce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152f711280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563097b3a180 con 0x563097c27800 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152f711280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563096db2900 con 0x563097c27c00 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152f711280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563096db2480 con 0x563097c27400 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44222/0 (socket says 172.21.15.181:44222) 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 -- 172.21.15.181:0/1752083175 learned_addr learned my addr 172.21.15.181:0/1752083175 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152d6b7640 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27c00 0x563096dce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 -- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27400 msgr2=0x563096dcd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27400 0x563096dcd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 -- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27c00 msgr2=0x563096dce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27c00 0x563096dce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 -- 172.21.15.181:0/1752083175 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563096d894a0 con 0x563097c27800 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152d6b7640 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27c00 0x563096dce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:04.858 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.851+0000 7f152deb8640 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcdb80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x563097b770b0 tx=0x563097af1f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a58430be7d33434 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f15296af640 1 -- 172.21.15.181:0/1752083175 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563096d769c0 con 0x563097c27800 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f15296af640 1 -- 172.21.15.181:0/1752083175 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563096d7cc40 con 0x563097c27800 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f15296af640 1 -- 172.21.15.181:0/1752083175 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563096d76680 con 0x563097c27800 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 -- 172.21.15.181:0/1752083175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 msgr2=0x563096dcdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcdb80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x563097b770b0 tx=0x563097af1f80 comp rx=0 tx=0).stop 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 -- 172.21.15.181:0/1752083175 shutdown_connections 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27c00 0x563096dce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcdb80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 --2- 172.21.15.181:0/1752083175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27400 0x563096dcd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 -- 172.21.15.181:0/1752083175 >> 172.21.15.181:0/1752083175 conn(0x563097c27000 msgr2=0x563097ada800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 -- 172.21.15.181:0/1752083175 shutdown_connections 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 -- 172.21.15.181:0/1752083175 wait complete. 2024-09-12T02:32:04.859 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.852+0000 7f152f711280 1 Processor -- start 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152f711280 1 -- start start 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152f711280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27400 0x563096dcf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152f711280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152f711280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27c00 0x563096dce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152f711280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563097b3b980 con 0x563097c27800 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152f711280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563097b3a180 con 0x563097c27400 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152f711280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563097b3b800 con 0x563097c27c00 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152deb8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152deb8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44228/0 (socket says 172.21.15.181:44228) 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152deb8640 1 -- 172.21.15.181:0/815823188 learned_addr learned my addr 172.21.15.181:0/815823188 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152d6b7640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27c00 0x563096dce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.853+0000 7f152d6b7640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27400 0x563096dcf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.860 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152deb8640 1 -- 172.21.15.181:0/815823188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27c00 msgr2=0x563096dce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152deb8640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27c00 0x563096dce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152deb8640 1 -- 172.21.15.181:0/815823188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27400 msgr2=0x563096dcf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152deb8640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563097c27400 0x563096dcf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152deb8640 1 -- 172.21.15.181:0/815823188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563096d88780 con 0x563097c27800 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152d6b7640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563097c27c00 0x563096dce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152deb8640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcec00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x563097c2c930 tx=0x563097af0a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f1527eac640 1 -- 172.21.15.181:0/815823188 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563096d76b60 con 0x563097c27800 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f1527eac640 1 -- 172.21.15.181:0/815823188 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563096d7c1c0 con 0x563097c27800 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f1527eac640 1 -- 172.21.15.181:0/815823188 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563096d764e0 con 0x563097c27800 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563096d883c0 con 0x563097c27800 2024-09-12T02:32:04.861 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.854+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563096d89680 con 0x563097c27800 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.855+0000 7f1527eac640 1 -- 172.21.15.181:0/815823188 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x563097b54c00 con 0x563097c27800 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.855+0000 7f1527eac640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563097cb0400 0x563096dcf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.855+0000 7f1527eac640 1 -- 172.21.15.181:0/815823188 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x563097caa600 con 0x563097c27800 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152d6b7640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563097cb0400 0x563096dcf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152f711280 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563097cb0800 0x563096dce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563097cb0c00 con 0x563097cb0800 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152d6b7640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563097cb0800 0x563096dce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.865 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152d6b7640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563097cb0400 0x563096dcf700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x563097c2d920 tx=0x563097c37c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152d6b7640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563097cb0800 0x563096dce100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152d6b7640 1 -- 172.21.15.181:0/815823188 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x563097ae8000 con 0x563097cb0800 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.856+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563097cb1000 con 0x563097cb0800 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.857+0000 7f152d6b7640 1 -- 172.21.15.181:0/815823188 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x563097ae8000 con 0x563097cb0800 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.857+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x563097cb1400 con 0x563097cb0800 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.857+0000 7f152d6b7640 1 -- 172.21.15.181:0/815823188 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv31 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x563097ae8000 con 0x563097cb0800 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.857+0000 7f152f711280 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563097cb1800 0x563096dcdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.857+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5630970f8400 con 0x563097cb1800 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.857+0000 7f152e6b9640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563097cb1800 0x563096dcdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.857+0000 7f152e6b9640 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563097cb1800 0x563096dcdb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152e6b9640 1 -- 172.21.15.181:0/815823188 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563097108f00 con 0x563097cb1800 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:Wrote output to binary files in directory '/tmp/binary.tmp' 2024-09-12T02:32:04.866 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563097cb0800 msgr2=0x563096dce100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x563097cb0800 0x563096dce100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563097cb1800 msgr2=0x563096dcdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x563097cb1800 0x563096dcdb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563097cb0400 msgr2=0x563096dcf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x563097cb0400 0x563096dcf700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x563097c2d920 tx=0x563097c37c20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 msgr2=0x563096dcec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152deb8640 1 -- 172.21.15.181:0/815823188 reap_dead start 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcec00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x563097c2c930 tx=0x563097af0a20 comp rx=0 tx=0).stop 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 shutdown_connections 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 --2- 172.21.15.181:0/815823188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563097c27800 0x563096dcec00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 >> 172.21.15.181:0/815823188 conn(0x563097c27000 msgr2=0x563097ada800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 shutdown_connections 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.858+0000 7f152f711280 1 -- 172.21.15.181:0/815823188 wait complete. 2024-09-12T02:32:04.867 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 -- 172.21.15.181:0/1310068017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563096d51c00 msgr2=0x563096dcd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563096d51c00 0x563096dcd080 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x563097b77830 tx=0x563097af0600 comp rx=0 tx=0).stop 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 -- 172.21.15.181:0/1310068017 shutdown_connections 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563096d51800 0x563096dccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563096d51c00 0x563096dcd080 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 --2- 172.21.15.181:0/1310068017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563096d50c00 0x563096dcc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 -- 172.21.15.181:0/1310068017 >> 172.21.15.181:0/1310068017 conn(0x563096d51000 msgr2=0x563097adb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 -- 172.21.15.181:0/1310068017 shutdown_connections 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.859+0000 7f152f711280 1 -- 172.21.15.181:0/1310068017 wait complete. 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:+ '[' '!' -s /tmp/binary.tmp ']' 2024-09-12T02:32:04.868 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 event recover_dentries summary 2024-09-12T02:32:04.890 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.889+0000 7f6822a0d280 1 -- start start 2024-09-12T02:32:04.890 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.889+0000 7f6822a0d280 1 Processor -- start 2024-09-12T02:32:04.896 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e413a2c00 0x561e4141e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.896 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e413a3800 0x561e4141eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.896 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e413a3c00 0x561e4141f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.896 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6822a0d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561e4218c600 con 0x561e413a3c00 2024-09-12T02:32:04.896 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6822a0d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561e4218c480 con 0x561e413a3800 2024-09-12T02:32:04.896 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6822a0d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561e4218c300 con 0x561e413a2c00 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e413a3c00 0x561e4141f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e413a3c00 0x561e4141f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44238/0 (socket says 172.21.15.181:44238) 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 -- 172.21.15.181:0/1847416048 learned_addr learned my addr 172.21.15.181:0/1847416048 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f681fd64640 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e413a3800 0x561e4141eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820565640 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e413a2c00 0x561e4141e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 -- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e413a2c00 msgr2=0x561e4141e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e413a2c00 0x561e4141e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 -- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e413a3800 msgr2=0x561e4141eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e413a3800 0x561e4141eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 -- 172.21.15.181:0/1847416048 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e413da780 con 0x561e413a3c00 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f6820d66640 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e413a3c00 0x561e4141f080 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x561e421c9800 tx=0x561e42142600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd9f6e80a5b6d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.890+0000 7f681dd60640 1 -- 172.21.15.181:0/1847416048 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561e413c8680 con 0x561e413a3c00 2024-09-12T02:32:04.897 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f681dd60640 1 -- 172.21.15.181:0/1847416048 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561e413ce700 con 0x561e413a3c00 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f681dd60640 1 -- 172.21.15.181:0/1847416048 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561e413c8b60 con 0x561e413a3c00 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f6822a0d280 1 -- 172.21.15.181:0/1847416048 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e413da3c0 con 0x561e413a3c00 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f6822a0d280 1 -- 172.21.15.181:0/1847416048 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561e413db680 con 0x561e413a3c00 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f681dd60640 1 -- 172.21.15.181:0/1847416048 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x561e4227c600 con 0x561e413a3c00 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f681dd60640 1 -- 172.21.15.181:0/1847416048 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x561e413fd180 con 0x561e413a3c00 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f6822a0d280 1 Processor -- start 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.891+0000 7f6822a0d280 1 -- start start 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281400 0x561e4141f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 0x561e4141fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281c00 0x561e41420100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f6822a0d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561e4218c180 con 0x561e42281400 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f6822a0d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561e41404900 con 0x561e42281c00 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f6822a0d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561e41404480 con 0x561e42281800 2024-09-12T02:32:04.898 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281400 0x561e4141f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281400 0x561e4141f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44250/0 (socket says 172.21.15.181:44250) 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 -- 172.21.15.181:0/3213057564 learned_addr learned my addr 172.21.15.181:0/3213057564 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f6820565640 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 0x561e4141fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281c00 0x561e41420100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 -- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 msgr2=0x561e4141fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 0x561e4141fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 -- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281c00 msgr2=0x561e41420100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281c00 0x561e41420100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.892+0000 7f681fd64640 1 -- 172.21.15.181:0/3213057564 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e413db860 con 0x561e42281400 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f681fd64640 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281400 0x561e4141f600 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x561e422926c0 tx=0x561e42294c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c51b8a3213979c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f681bd5c640 1 -- 172.21.15.181:0/3213057564 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561e413c8680 con 0x561e42281400 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f681bd5c640 1 -- 172.21.15.181:0/3213057564 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561e413cee00 con 0x561e42281400 2024-09-12T02:32:04.899 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f681bd5c640 1 -- 172.21.15.181:0/3213057564 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561e413c8b60 con 0x561e42281400 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 -- 172.21.15.181:0/3213057564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281400 msgr2=0x561e4141f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281400 0x561e4141f600 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x561e422926c0 tx=0x561e42294c60 comp rx=0 tx=0).stop 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 -- 172.21.15.181:0/3213057564 shutdown_connections 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281c00 0x561e41420100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 0x561e4141fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 --2- 172.21.15.181:0/3213057564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281400 0x561e4141f600 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 -- 172.21.15.181:0/3213057564 >> 172.21.15.181:0/3213057564 conn(0x561e42281000 msgr2=0x561e4212c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 -- 172.21.15.181:0/3213057564 shutdown_connections 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.893+0000 7f6822a0d280 1 -- 172.21.15.181:0/3213057564 wait complete. 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 Processor -- start 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 -- start start 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281400 0x561e41421180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.900 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 0x561e41420c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281c00 0x561e41420680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561e4218d800 con 0x561e42281c00 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x561e4218c180 con 0x561e42281400 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6822a0d280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561e4218cd80 con 0x561e42281800 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f681fd64640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281c00 0x561e41420680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f681fd64640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281c00 0x561e41420680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44254/0 (socket says 172.21.15.181:44254) 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 learned_addr learned my addr 172.21.15.181:0/2487031940 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281400 0x561e41421180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.894+0000 7f6820565640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 0x561e41420c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 msgr2=0x561e41420c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e42281800 0x561e41420c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.901 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281400 msgr2=0x561e41421180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e42281400 0x561e41421180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e413da780 con 0x561e42281c00 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281c00 0x561e41420680 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x561e42293980 tx=0x561e42294c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681a559640 1 -- 172.21.15.181:0/2487031940 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561e413c84e0 con 0x561e42281c00 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681a559640 1 -- 172.21.15.181:0/2487031940 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561e413cec40 con 0x561e42281c00 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e413da3c0 con 0x561e42281c00 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f681a559640 1 -- 172.21.15.181:0/2487031940 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561e413c8680 con 0x561e42281c00 2024-09-12T02:32:04.902 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.895+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e413db680 con 0x561e42281c00 2024-09-12T02:32:04.907 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.896+0000 7f681a559640 1 -- 172.21.15.181:0/2487031940 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x561e422e8c00 con 0x561e42281c00 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.896+0000 7f681a559640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561e422f7000 0x561e41421700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.896+0000 7f681a559640 1 -- 172.21.15.181:0/2487031940 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x561e422e6a00 con 0x561e42281c00 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.896+0000 7f6820565640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561e422f7000 0x561e41421700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.896+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561e422f7400 0x561e41420100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.896+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7800 con 0x561e422f7400 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.897+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561e422f7400 0x561e41420100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.897+0000 7f6820565640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561e422f7000 0x561e41421700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x561e413ffce0 tx=0x561e42143e60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.897+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561e422f7400 0x561e41420100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.897+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.897+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7c00 con 0x561e422f7400 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.897+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.908 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.897+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173e000 con 0x561e422f7400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.898+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv31 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.898+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561e4173e400 0x561e4141fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.898+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173e800 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.898+0000 7f6820d66640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561e4173e400 0x561e4141fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.898+0000 7f6820d66640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561e4173e400 0x561e4141fb80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.898+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.898+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:5 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:6 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:7 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.909 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:8 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173e800 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.899+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:9 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e422f7400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.900+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.900+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:10 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e422f7400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.901+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 5 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v48'32 uv32 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.901+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:11 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.901+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 6 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.901+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:12 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.902+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 7 ==== osd_op_reply(12 1.00000000 [omap-set-header] v48'6 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.902+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:13 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.902+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 8 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.902+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:14 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e42280800 con 0x561e4173e400 2024-09-12T02:32:04.910 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.903+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 9 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v48'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.903+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x561e4173e000 0x561e4141f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.903+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:15 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e000 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.903+0000 7f6820565640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x561e4173e000 0x561e4141f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.904+0000 7f6820565640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x561e4173e000 0x561e4141f600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.904+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.904+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:16 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7800 con 0x561e4173e000 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.905+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v48'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.905+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:17 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7c00 con 0x561e4173e000 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.905+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(17 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.905+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:18 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7800 con 0x561e422f7400 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.905+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 6 ==== osd_op_reply(18 1.00000000.inode [read 0~582 out=582b] v0'0 uv32 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.906+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:19 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7c00 con 0x561e422f7400 2024-09-12T02:32:04.911 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.907+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 7 ==== osd_op_reply(19 1.00000000.inode [writefull 0~582] v48'33 uv33 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.912 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.907+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:20 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e400 2024-09-12T02:32:04.912 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.907+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 10 ==== osd_op_reply(20 1.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.912 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.907+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:21 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f400 con 0x561e4173e400 2024-09-12T02:32:04.913 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.908+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 11 ==== osd_op_reply(21 1.00000000 [omap-set-header] v48'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.908+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:22 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f000 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.908+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 12 ==== osd_op_reply(22 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv8 ondisk = 0) ==== 154+0+525 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.908+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:23 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173e800 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.909+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 13 ==== osd_op_reply(23 1.00000000 [omap-set-vals] v48'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174cf00 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.909+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:24 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e422f7400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.909+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 8 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv33 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.909+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:25 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e422f7400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.911+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 9 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v48'34 uv34 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.911+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:26 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.911+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 14 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.911+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:27 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e400 2024-09-12T02:32:04.914 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.912+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 15 ==== osd_op_reply(27 1.00000000 [omap-set-header] v48'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.915 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.912+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:28 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e42280800 con 0x561e4173e400 2024-09-12T02:32:04.915 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.912+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 16 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv10 ondisk = 0) ==== 154+0+525 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.915 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.912+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:29 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e400 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.914+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 17 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v48'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.914+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:30 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e000 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.914+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(30 10000000000.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.914+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:31 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e4173e000 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.915+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(31 10000000000.00000000 [omap-set-header] v48'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.915+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:32 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7800 con 0x561e4173e000 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.915+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(32 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.916 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.915+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:33 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7c00 con 0x561e4173e000 2024-09-12T02:32:04.918 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.918+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 7 ==== osd_op_reply(33 10000000000.00000000 [omap-set-vals] v48'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.919 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.918+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x561e4173e800 0x561e41764000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.919 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.918+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:34 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e800 2024-09-12T02:32:04.919 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.918+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x561e4173e800 0x561e41764000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.919 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.918+0000 7f681fd64640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x561e4173e800 0x561e41764000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.919 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.919+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== osd_op_reply(34 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.919 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.919+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:35 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e800 2024-09-12T02:32:04.921 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.920+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== osd_op_reply(35 10000000001.00000000 [omap-set-header] v48'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.921 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.920+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:36 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e800 2024-09-12T02:32:04.921 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.921+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 3 ==== osd_op_reply(36 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.922 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.921+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:37 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e42280800 con 0x561e422f7400 2024-09-12T02:32:04.922 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.921+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 10 ==== osd_op_reply(37 1.00000000.inode [read 0~582 out=582b] v0'0 uv34 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.922 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.921+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:38 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f400 con 0x561e422f7400 2024-09-12T02:32:04.923 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.922+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 11 ==== osd_op_reply(38 1.00000000.inode [writefull 0~582] v48'35 uv35 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.923 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.922+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:39 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f000 con 0x561e4173e000 2024-09-12T02:32:04.923 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.922+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 8 ==== osd_op_reply(39 10000000000.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.923 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.922+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:40 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a000 con 0x561e4173e000 2024-09-12T02:32:04.924 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.924+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 9 ==== osd_op_reply(40 10000000000.00000000 [omap-set-header] v48'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.925 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.924+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:41 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a400 con 0x561e4173e000 2024-09-12T02:32:04.925 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.924+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 10 ==== osd_op_reply(41 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv12 ondisk = 0) ==== 164+0+520 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.925 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.924+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:42 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a800 con 0x561e4173e000 2024-09-12T02:32:04.927 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.926+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 11 ==== osd_op_reply(42 10000000000.00000000 [omap-set-vals] v48'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e000 2024-09-12T02:32:04.927 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.926+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:43 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176ac00 con 0x561e4173e800 2024-09-12T02:32:04.927 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.926+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 4 ==== osd_op_reply(43 10000000001.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.927 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.926+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:44 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b000 con 0x561e4173e800 2024-09-12T02:32:04.929 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.929+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 5 ==== osd_op_reply(44 10000000001.00000000 [omap-set-header] v48'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.930 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.929+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:45 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b400 con 0x561e4173e800 2024-09-12T02:32:04.930 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.929+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 6 ==== osd_op_reply(45 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.930 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.929+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:46 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b800 con 0x561e4173e800 2024-09-12T02:32:04.932 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.931+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 7 ==== osd_op_reply(46 10000000001.00000000 [omap-set-vals] v48'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.932 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.931+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x561e4176bc00 0x561e41764580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.932 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.931+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:47 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176ac00 con 0x561e4176bc00 2024-09-12T02:32:04.933 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.932+0000 7f6820d66640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x561e4176bc00 0x561e41764580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.933 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.932+0000 7f6820d66640 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x561e4176bc00 0x561e41764580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.933 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.932+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(47 10000000002.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x561e4174c500 con 0x561e4176bc00 2024-09-12T02:32:04.933 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.932+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:48 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a000 con 0x561e4176bc00 2024-09-12T02:32:04.934 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.933+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== osd_op_reply(48 10000000002.00000000 [omap-set-header] v48'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174c500 con 0x561e4176bc00 2024-09-12T02:32:04.934 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.933+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:49 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f400 con 0x561e4176bc00 2024-09-12T02:32:04.934 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.933+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.7 v2:172.21.15.204:6808/3631554107 3 ==== osd_op_reply(49 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x561e4174c500 con 0x561e4176bc00 2024-09-12T02:32:04.934 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.934+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:50 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f000 con 0x561e4173e000 2024-09-12T02:32:04.935 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.934+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 12 ==== osd_op_reply(50 10000000000.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.935 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.934+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:51 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7800 con 0x561e4173e000 2024-09-12T02:32:04.935 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.935+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 13 ==== osd_op_reply(51 10000000000.00000000 [omap-set-header] v48'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.936 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.935+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:52 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7c00 con 0x561e4173e000 2024-09-12T02:32:04.936 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.935+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 14 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv14 ondisk = 0) ==== 164+0+520 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.936 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.935+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:53 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e000 2024-09-12T02:32:04.938 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.938+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 15 ==== osd_op_reply(53 10000000000.00000000 [omap-set-vals] v48'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.939 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.938+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:54 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e800 2024-09-12T02:32:04.939 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.938+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 8 ==== osd_op_reply(54 10000000001.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.939 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.938+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:55 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e800 2024-09-12T02:32:04.941 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.940+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 9 ==== osd_op_reply(55 10000000001.00000000 [omap-set-header] v48'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.941 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.940+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:56 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e800 2024-09-12T02:32:04.941 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.940+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 10 ==== osd_op_reply(56 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.941 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.940+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:57 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=558b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e4173e800 2024-09-12T02:32:04.943 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.943+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 11 ==== osd_op_reply(57 10000000001.00000000 [omap-set-vals] v48'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.944 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.943+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:58 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e42280800 con 0x561e4173e400 2024-09-12T02:32:04.944 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.943+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 18 ==== osd_op_reply(58 1.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.944 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.943+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:59 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e400 2024-09-12T02:32:04.944 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.944+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 19 ==== osd_op_reply(59 1.00000000 [omap-set-header] v48'12 uv12 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.945 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.944+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:60 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e400 2024-09-12T02:32:04.945 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.944+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 20 ==== osd_op_reply(60 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv12 ondisk = 0) ==== 154+0+525 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.945 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.944+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:61 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e400 2024-09-12T02:32:04.946 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.945+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 21 ==== osd_op_reply(61 1.00000000 [omap-set-vals] v48'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174c500 con 0x561e4173e400 2024-09-12T02:32:04.946 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.945+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:62 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e4173e000 2024-09-12T02:32:04.946 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.945+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 16 ==== osd_op_reply(62 10000000000.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.946 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.945+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:63 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b000 con 0x561e4173e000 2024-09-12T02:32:04.950 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.949+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 17 ==== osd_op_reply(63 10000000000.00000000 [omap-set-header] v48'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.950 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.949+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:64 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b400 con 0x561e4173e000 2024-09-12T02:32:04.950 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.949+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 18 ==== osd_op_reply(64 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv16 ondisk = 0) ==== 164+0+520 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.950 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.949+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:65 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b800 con 0x561e4173e000 2024-09-12T02:32:04.951 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.950+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 19 ==== osd_op_reply(65 10000000000.00000000 [omap-set-vals] v48'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.951 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.950+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:66 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e400 2024-09-12T02:32:04.951 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.950+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 22 ==== osd_op_reply(66 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.951 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.950+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:67 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e4173e400 2024-09-12T02:32:04.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.952+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 23 ==== osd_op_reply(67 100.00000000 [omap-set-header] v48'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.952+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:68 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7800 con 0x561e4173e400 2024-09-12T02:32:04.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.952+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 24 ==== osd_op_reply(68 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.953 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.952+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:69 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7c00 con 0x561e4173e400 2024-09-12T02:32:04.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.953+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 25 ==== osd_op_reply(69 100.00000000 [omap-set-vals] v48'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.953+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:70 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f000 con 0x561e4173e000 2024-09-12T02:32:04.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.953+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 20 ==== osd_op_reply(70 602.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.954 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.953+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:71 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a400 con 0x561e4173e000 2024-09-12T02:32:04.955 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.955+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 21 ==== osd_op_reply(71 602.00000000 [omap-set-header] v48'18 uv18 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.955+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:72 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a800 con 0x561e4173e000 2024-09-12T02:32:04.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.955+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 22 ==== osd_op_reply(72 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.956 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.955+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:73 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=545b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e000 2024-09-12T02:32:04.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.956+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 23 ==== osd_op_reply(73 602.00000000 [omap-set-vals] v48'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.956+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:74 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e800 2024-09-12T02:32:04.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.957+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 12 ==== osd_op_reply(74 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.957 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.957+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:75 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e800 2024-09-12T02:32:04.959 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.958+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 13 ==== osd_op_reply(75 10000000001.00000000 [omap-set-header] v48'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.959 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.958+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:76 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e800 2024-09-12T02:32:04.959 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.958+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 14 ==== osd_op_reply(76 10000000001.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv8 ondisk = 0) ==== 164+0+520 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.959 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.958+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:77 6.7 6:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e42280800 con 0x561e4173e800 2024-09-12T02:32:04.960 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.959+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 15 ==== osd_op_reply(77 10000000001.00000000 [omap-rm-keys] v48'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.960 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.959+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:78 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f400 con 0x561e422f7400 2024-09-12T02:32:04.960 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.959+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 12 ==== osd_op_reply(78 1.00000000.inode [read 0~582 out=582b] v0'0 uv35 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.960 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.959+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:79 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176ac00 con 0x561e422f7400 2024-09-12T02:32:04.961 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.960+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 13 ==== osd_op_reply(79 1.00000000.inode [writefull 0~582] v48'36 uv36 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:04.961 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.960+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:80 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a000 con 0x561e4173e000 2024-09-12T02:32:04.961 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.961+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 24 ==== osd_op_reply(80 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.961 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.961+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:81 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b000 con 0x561e4173e000 2024-09-12T02:32:04.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.961+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 25 ==== osd_op_reply(81 10000000000.00000000 [omap-set-header] v48'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.962+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:82 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b400 con 0x561e4173e000 2024-09-12T02:32:04.962 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.962+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 26 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv20 ondisk = 0) ==== 164+0+520 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.963 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.962+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:83 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b800 con 0x561e4173e000 2024-09-12T02:32:04.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.963+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 27 ==== osd_op_reply(83 10000000000.00000000 [omap-set-vals] v48'21 uv21 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.963+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:84 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a400 con 0x561e4173e400 2024-09-12T02:32:04.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.963+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 26 ==== osd_op_reply(84 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.964 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.963+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:85 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a800 con 0x561e4173e400 2024-09-12T02:32:04.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.964+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 27 ==== osd_op_reply(85 100.00000000 [omap-set-header] v48'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.964+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:86 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a000 con 0x561e4173e400 2024-09-12T02:32:04.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.964+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 28 ==== osd_op_reply(86 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv5 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.965 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.964+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:87 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e400 2024-09-12T02:32:04.966 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.965+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 29 ==== osd_op_reply(87 100.00000000 [omap-set-vals] v48'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174d180 con 0x561e4173e400 2024-09-12T02:32:04.966 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.965+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:88 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f000 con 0x561e4173e000 2024-09-12T02:32:04.966 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.965+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 28 ==== osd_op_reply(88 602.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.966 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.965+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:89 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.967 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.967+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 29 ==== osd_op_reply(89 602.00000000 [omap-set-header] v48'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.968 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.967+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:90 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41780400 con 0x561e4173e000 2024-09-12T02:32:04.968 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.967+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 30 ==== osd_op_reply(90 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.968 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.967+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:91 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=583b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780800 con 0x561e4173e000 2024-09-12T02:32:04.969 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.968+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 31 ==== osd_op_reply(91 602.00000000 [omap-set-vals] v48'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.969 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.968+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:92 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41780c00 con 0x561e4173e800 2024-09-12T02:32:04.969 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.968+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 16 ==== osd_op_reply(92 10000000001.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.969 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.968+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:93 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41781000 con 0x561e4173e800 2024-09-12T02:32:04.971 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.971+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 17 ==== osd_op_reply(93 10000000001.00000000 [omap-set-header] v48'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.972 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.971+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:94 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41781400 con 0x561e4173e800 2024-09-12T02:32:04.972 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.971+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 18 ==== osd_op_reply(94 10000000001.00000000 [omap-get-vals-by-keys out=558b] v0'0 uv10 ondisk = 0) ==== 164+0+558 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.972 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.971+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:95 6.7 6:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41781800 con 0x561e4173e800 2024-09-12T02:32:04.973 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.972+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.5 v2:172.21.15.204:6824/2921904049 19 ==== osd_op_reply(95 10000000001.00000000 [omap-rm-keys] v48'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e4173e800 2024-09-12T02:32:04.973 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.972+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:96 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41781c00 con 0x561e4173e400 2024-09-12T02:32:04.973 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.972+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 30 ==== osd_op_reply(96 100.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.973 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.972+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:97 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780c00 con 0x561e4173e400 2024-09-12T02:32:04.974 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.973+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 31 ==== osd_op_reply(97 100.00000000 [omap-set-header] v48'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.974 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.973+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:98 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41781000 con 0x561e4173e400 2024-09-12T02:32:04.974 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.973+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 32 ==== osd_op_reply(98 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv7 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.974 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.973+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:99 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176ac00 con 0x561e4173e400 2024-09-12T02:32:04.975 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.974+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 33 ==== osd_op_reply(99 100.00000000 [omap-set-vals] v48'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.975 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.974+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:100 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f400 con 0x561e4173e000 2024-09-12T02:32:04.975 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.975+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 32 ==== osd_op_reply(100 602.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.975 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.975+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:101 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e42280800 con 0x561e4173e000 2024-09-12T02:32:04.976 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.976+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 33 ==== osd_op_reply(101 602.00000000 [omap-set-header] v48'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.976 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.976+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:102 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e000 2024-09-12T02:32:04.977 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.976+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 34 ==== osd_op_reply(102 602.00000000 [omap-get-vals-by-keys out=583b] v0'0 uv24 ondisk = 0) ==== 156+0+583 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.977 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.976+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:103 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=545b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e000 2024-09-12T02:32:04.978 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.977+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 35 ==== osd_op_reply(103 602.00000000 [omap-set-vals] v48'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.978 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.977+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:104 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e400 2024-09-12T02:32:04.978 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.977+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 34 ==== osd_op_reply(104 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.978 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.977+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:105 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780000 con 0x561e4173e400 2024-09-12T02:32:04.979 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.978+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 35 ==== osd_op_reply(105 1.00000000 [omap-set-header] v48'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.979 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.978+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:106 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41780400 con 0x561e4173e400 2024-09-12T02:32:04.979 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.978+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 36 ==== osd_op_reply(106 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv14 ondisk = 0) ==== 154+0+525 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.979 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.978+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:107 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780800 con 0x561e4173e400 2024-09-12T02:32:04.980 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.979+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 37 ==== osd_op_reply(107 1.00000000 [omap-set-vals] v48'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.980 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.979+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:108 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41781c00 con 0x561e4173e400 2024-09-12T02:32:04.980 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.980+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 38 ==== osd_op_reply(108 100.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.980 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.980+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:109 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780c00 con 0x561e4173e400 2024-09-12T02:32:04.981 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.980+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 39 ==== osd_op_reply(109 100.00000000 [omap-set-header] v48'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.981 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.980+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:110 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e4173e400 2024-09-12T02:32:04.982 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.981+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 40 ==== osd_op_reply(110 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv9 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.982 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.981+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:111 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e400 2024-09-12T02:32:04.982 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.982+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 41 ==== osd_op_reply(111 100.00000000 [omap-set-vals] v48'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.983 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.982+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:112 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b000 con 0x561e4173e000 2024-09-12T02:32:04.983 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.982+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 36 ==== osd_op_reply(112 602.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.983 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.982+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:113 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b400 con 0x561e4173e000 2024-09-12T02:32:04.984 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.983+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 37 ==== osd_op_reply(113 602.00000000 [omap-set-header] v48'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.984 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.983+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:114 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b800 con 0x561e4173e000 2024-09-12T02:32:04.984 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.983+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 38 ==== osd_op_reply(114 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.984 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.983+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:115 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=541b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a400 con 0x561e4173e000 2024-09-12T02:32:04.985 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.984+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 39 ==== osd_op_reply(115 602.00000000 [omap-set-vals] v48'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174cc80 con 0x561e4173e000 2024-09-12T02:32:04.985 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.984+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:116 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a800 con 0x561e4173e000 2024-09-12T02:32:04.985 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.985+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 40 ==== osd_op_reply(116 10000000000.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:04.985 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.985+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:117 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a000 con 0x561e4173e000 2024-09-12T02:32:04.988 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.987+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 41 ==== osd_op_reply(117 10000000000.00000000 [omap-set-header] v48'28 uv28 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:04.988 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.987+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:118 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7800 con 0x561e4173e000 2024-09-12T02:32:04.988 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.987+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 42 ==== osd_op_reply(118 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv28 ondisk = 0) ==== 164+0+520 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:04.988 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.987+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:119 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e422f7c00 con 0x561e4173e000 2024-09-12T02:32:04.991 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.990+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 43 ==== osd_op_reply(119 10000000000.00000000 [omap-rm-keys] v48'29 uv29 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:04.991 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.990+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:120 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e42280800 con 0x561e4173e400 2024-09-12T02:32:04.991 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.990+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 42 ==== osd_op_reply(120 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.991 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.990+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:121 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f000 con 0x561e4173e400 2024-09-12T02:32:04.992 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.991+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 43 ==== osd_op_reply(121 1.00000000 [omap-set-header] v48'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.992 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.991+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:122 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4218f400 con 0x561e4173e400 2024-09-12T02:32:04.992 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.991+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 44 ==== osd_op_reply(122 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv16 ondisk = 0) ==== 154+0+525 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.992 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.992+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:123 6.1f 6:ff5b34d6:::1.00000000:head [omap-rm-keys in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f000 con 0x561e4173e400 2024-09-12T02:32:04.993 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.992+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 45 ==== osd_op_reply(123 1.00000000 [omap-rm-keys] v48'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.993 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.993+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:124 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f400 con 0x561e4173e400 2024-09-12T02:32:04.993 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.993+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 46 ==== osd_op_reply(124 100.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.993 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.993+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:125 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173fc00 con 0x561e4173e400 2024-09-12T02:32:04.994 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.994+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 47 ==== osd_op_reply(125 100.00000000 [omap-set-header] v48'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.994 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.994+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:126 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4173f800 con 0x561e4173e400 2024-09-12T02:32:04.995 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.994+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 48 ==== osd_op_reply(126 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv11 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.995 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.994+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:127 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4173ec00 con 0x561e4173e400 2024-09-12T02:32:04.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.995+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 49 ==== osd_op_reply(127 100.00000000 [omap-set-vals] v48'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:04.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.995+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:128 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41781000 con 0x561e4173e000 2024-09-12T02:32:04.996 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.996+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 44 ==== osd_op_reply(128 602.00000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:04.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.996+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:129 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780000 con 0x561e4173e000 2024-09-12T02:32:04.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.997+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 45 ==== osd_op_reply(129 602.00000000 [omap-set-header] v48'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:04.997 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.997+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:130 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41780400 con 0x561e4173e000 2024-09-12T02:32:04.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.997+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 46 ==== osd_op_reply(130 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:04.998 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:04.997+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:131 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=537b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780800 con 0x561e4173e000 2024-09-12T02:32:05.000 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.000+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 <== osd.0 v2:172.21.15.181:6816/2346029807 47 ==== osd_op_reply(131 602.00000000 [omap-set-vals] v48'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561e4178e280 con 0x561e4173e000 2024-09-12T02:32:05.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.000+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:132 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e41781c00 con 0x561e422f7400 2024-09-12T02:32:05.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.000+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 14 ==== osd_op_reply(132 1.00000000.inode [read 0~582 out=582b] v0'0 uv36 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:05.001 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.000+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:133 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e41780c00 con 0x561e422f7400 2024-09-12T02:32:05.002 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.001+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 15 ==== osd_op_reply(133 1.00000000.inode [writefull 0~582] v48'37 uv37 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:05.002 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.001+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:134 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b000 con 0x561e4173e400 2024-09-12T02:32:05.002 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.001+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 50 ==== osd_op_reply(134 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:05.002 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.001+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:135 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b400 con 0x561e4173e400 2024-09-12T02:32:05.004 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.003+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 51 ==== osd_op_reply(135 1.00000000 [omap-set-header] v48'18 uv18 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:05.004 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.003+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:136 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176b800 con 0x561e4173e400 2024-09-12T02:32:05.004 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.003+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 52 ==== osd_op_reply(136 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:05.004 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.003+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:137 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a400 con 0x561e422f7400 2024-09-12T02:32:05.004 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.003+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 16 ==== osd_op_reply(137 1.00000000.inode [read 0~582 out=582b] v0'0 uv37 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:05.004 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.003+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:138 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a800 con 0x561e422f7400 2024-09-12T02:32:05.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.004+0000 7f681fd64640 1 -- 172.21.15.181:0/2487031940 <== osd.2 v2:172.21.15.181:6808/3659790931 17 ==== osd_op_reply(138 1.00000000.inode [writefull 0~582] v48'38 uv38 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x561e4213a000 con 0x561e422f7400 2024-09-12T02:32:05.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.004+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:139 6.13 6:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x561e4176a000 con 0x561e4173e400 2024-09-12T02:32:05.005 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.005+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 53 ==== osd_op_reply(139 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:05.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.005+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:140 6.13 6:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x561e4176ac00 con 0x561e4173e400 2024-09-12T02:32:05.006 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6820d66640 1 -- 172.21.15.181:0/2487031940 <== osd.3 v2:172.21.15.181:6800/1415662156 54 ==== osd_op_reply(140 mds0_inotable [writefull 0~34] v48'13 uv13 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x561e4174ca00 con 0x561e4173e400 2024-09-12T02:32:05.007 INFO:tasks.workunit.client.0.smithi181.stdout:Events by type: 2024-09-12T02:32:05.007 INFO:tasks.workunit.client.0.smithi181.stdout: LID: 1 2024-09-12T02:32:05.007 INFO:tasks.workunit.client.0.smithi181.stdout: PURGED: 1 2024-09-12T02:32:05.007 INFO:tasks.workunit.client.0.smithi181.stdout: SESSION: 2 2024-09-12T02:32:05.007 INFO:tasks.workunit.client.0.smithi181.stdout: SUBTREEMAP: 1 2024-09-12T02:32:05.007 INFO:tasks.workunit.client.0.smithi181.stdout: UPDATE: 12 2024-09-12T02:32:05.007 INFO:tasks.workunit.client.0.smithi181.stdout:Errors: 0 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x561e4173e000 msgr2=0x561e4141f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x561e4173e000 0x561e4141f600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561e422f7400 msgr2=0x561e41420100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x561e422f7400 0x561e41420100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561e4173e400 msgr2=0x561e4141fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x561e4173e400 0x561e4141fb80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x561e4173e800 msgr2=0x561e41764000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x561e4173e800 0x561e41764000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.009 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 reap_dead start 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x561e4176bc00 msgr2=0x561e41764580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x561e4176bc00 0x561e41764580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6820565640 1 -- 172.21.15.181:0/2487031940 reap_dead start 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561e422f7000 msgr2=0x561e41421700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561e422f7000 0x561e41421700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x561e413ffce0 tx=0x561e42143e60 comp rx=0 tx=0).stop 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281c00 msgr2=0x561e41420680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281c00 0x561e41420680 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x561e42293980 tx=0x561e42294c00 comp rx=0 tx=0).stop 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 shutdown_connections 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x561e422f7000 0x561e41421700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 --2- 172.21.15.181:0/2487031940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e42281c00 0x561e41420680 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 >> 172.21.15.181:0/2487031940 conn(0x561e42281000 msgr2=0x561e4212c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 shutdown_connections 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.006+0000 7f6822a0d280 1 -- 172.21.15.181:0/2487031940 wait complete. 2024-09-12T02:32:05.010 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 -- 172.21.15.181:0/1847416048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e413a3c00 msgr2=0x561e4141f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e413a3c00 0x561e4141f080 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x561e421c9800 tx=0x561e42142600 comp rx=0 tx=0).stop 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 -- 172.21.15.181:0/1847416048 shutdown_connections 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561e413a3800 0x561e4141eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e413a3c00 0x561e4141f080 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 --2- 172.21.15.181:0/1847416048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561e413a2c00 0x561e4141e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 -- 172.21.15.181:0/1847416048 >> 172.21.15.181:0/1847416048 conn(0x561e413a3000 msgr2=0x561e4212d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 -- 172.21.15.181:0/1847416048 shutdown_connections 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.007+0000 7f6822a0d280 1 -- 172.21.15.181:0/1847416048 wait complete. 2024-09-12T02:32:05.011 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 event splice summary 2024-09-12T02:32:05.038 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.037+0000 7f6a03327280 1 -- start start 2024-09-12T02:32:05.038 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.037+0000 7f6a03327280 1 Processor -- start 2024-09-12T02:32:05.040 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a03327280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559ce24ac00 0x5559ce2c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.040 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a03327280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559ce24b800 0x5559ce2c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.040 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a03327280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559ce24bc00 0x5559ce2c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.040 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a03327280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559ce3c6180 con 0x5559ce24bc00 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a03327280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5559ce2ac480 con 0x5559ce24b800 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a03327280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5559ce2ac900 con 0x5559ce24ac00 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559ce24bc00 0x5559ce2c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559ce24bc00 0x5559ce2c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44270/0 (socket says 172.21.15.181:44270) 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 -- 172.21.15.181:0/2208372114 learned_addr learned my addr 172.21.15.181:0/2208372114 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01087640 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559ce24ac00 0x5559ce2c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a00886640 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559ce24b800 0x5559ce2c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 -- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559ce24ac00 msgr2=0x5559ce2c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559ce24ac00 0x5559ce2c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 -- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559ce24b800 msgr2=0x5559ce2c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559ce24b800 0x5559ce2c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.041 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a01888640 1 -- 172.21.15.181:0/2208372114 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ce282780 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.038+0000 7f6a00886640 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559ce24b800 0x5559ce2c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f6a01888640 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559ce24bc00 0x5559ce2c7080 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x5559cf0717a0 tx=0x5559cefeab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d692b5501933c5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f69fe882640 1 -- 172.21.15.181:0/2208372114 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559ce2709c0 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f69fe882640 1 -- 172.21.15.181:0/2208372114 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5559ce276700 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f69fe882640 1 -- 172.21.15.181:0/2208372114 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559ce270680 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f6a03327280 1 -- 172.21.15.181:0/2208372114 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ce2834a0 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f6a03327280 1 -- 172.21.15.181:0/2208372114 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5559ce282000 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f69fe882640 1 -- 172.21.15.181:0/2208372114 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5559cf116200 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.039+0000 7f69fe882640 1 -- 172.21.15.181:0/2208372114 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x5559ce2a5180 con 0x5559ce24bc00 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 Processor -- start 2024-09-12T02:32:05.042 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 -- start start 2024-09-12T02:32:05.048 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182000 0x5559ce2c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559ce2ac180 con 0x5559cf182400 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5559ce3c7500 con 0x5559cf182000 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a03327280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5559ce3c7380 con 0x5559cf182800 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a01087640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a01087640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44284/0 (socket says 172.21.15.181:44284) 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a01087640 1 -- 172.21.15.181:0/1922235616 learned_addr learned my addr 172.21.15.181:0/1922235616 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a00886640 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.040+0000 7f6a00886640 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182000 0x5559ce2c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a01087640 1 -- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182800 msgr2=0x5559ce2c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a01087640 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.049 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a01087640 1 -- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182000 msgr2=0x5559ce2c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a01087640 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182000 0x5559ce2c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a01087640 1 -- 172.21.15.181:0/1922235616 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ce2823c0 con 0x5559cf182400 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a01087640 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x5559cf12c660 tx=0x5559cf132ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebee4f0ba5597ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f69fc87e640 1 -- 172.21.15.181:0/1922235616 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559ce2709c0 con 0x5559cf182400 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f69fc87e640 1 -- 172.21.15.181:0/1922235616 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5559ce276e00 con 0x5559cf182400 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f69fc87e640 1 -- 172.21.15.181:0/1922235616 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559ce270680 con 0x5559cf182400 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 -- 172.21.15.181:0/1922235616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 msgr2=0x5559ce2c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x5559cf12c660 tx=0x5559cf132ea0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 -- 172.21.15.181:0/1922235616 shutdown_connections 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 --2- 172.21.15.181:0/1922235616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182000 0x5559ce2c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 -- 172.21.15.181:0/1922235616 >> 172.21.15.181:0/1922235616 conn(0x5559cf02dc00 msgr2=0x5559ce359000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 -- 172.21.15.181:0/1922235616 shutdown_connections 2024-09-12T02:32:05.050 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.041+0000 7f6a03327280 1 -- 172.21.15.181:0/1922235616 wait complete. 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 Processor -- start 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 -- start start 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182000 0x5559ce2c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5559ce3c7680 con 0x5559cf182400 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5559ce3c6900 con 0x5559cf182800 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a03327280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5559ce2ac900 con 0x5559cf182000 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a01087640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.042+0000 7f6a01087640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44290/0 (socket says 172.21.15.181:44290) 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a01087640 1 -- 172.21.15.181:0/3020210162 learned_addr learned my addr 172.21.15.181:0/3020210162 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a00886640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182000 0x5559ce2c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.051 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a00886640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a01087640 1 -- 172.21.15.181:0/3020210162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182000 msgr2=0x5559ce2c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a01087640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559cf182000 0x5559ce2c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a01087640 1 -- 172.21.15.181:0/3020210162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182800 msgr2=0x5559ce2c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a01087640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a01087640 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ce282960 con 0x5559cf182400 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a00886640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559cf182800 0x5559ce2c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a01087640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x5559cf12d920 tx=0x5559cf132c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f69fb07b640 1 -- 172.21.15.181:0/3020210162 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559ce2704e0 con 0x5559cf182400 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f69fb07b640 1 -- 172.21.15.181:0/3020210162 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5559ce276a80 con 0x5559cf182400 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559ce283680 con 0x5559cf182400 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f69fb07b640 1 -- 172.21.15.181:0/3020210162 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559ce2709c0 con 0x5559cf182400 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.043+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ce283860 con 0x5559cf182400 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.044+0000 7f69fb07b640 1 -- 172.21.15.181:0/3020210162 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5559cf19ec00 con 0x5559cf182400 2024-09-12T02:32:05.052 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.044+0000 7f69fb07b640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5559cf18c400 0x5559ce5c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f69fb07b640 1 -- 172.21.15.181:0/3020210162 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5559cf19ca00 con 0x5559cf182400 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a00886640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5559cf18c400 0x5559ce5c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a03327280 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5559cf182c00 0x5559ce2c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5559cf183000 con 0x5559cf182c00 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a00886640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5559cf182c00 0x5559ce2c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a00886640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5559cf18c400 0x5559ce5c8000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5559ce32ed20 tx=0x5559cf132d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a00886640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5559cf182c00 0x5559ce2c8680 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.045+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5559cf18d400 con 0x5559cf182c00 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.046+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.046+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5559cf18d800 con 0x5559cf182c00 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.046+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [read 0~30182 out=30182b] v0'0 uv31 ondisk = 0) ==== 156+0+30182 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.053 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.046+0000 7f6a03327280 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5559cf18dc00 0x5559ce2c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.054 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.046+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x5559cf18d000 con 0x5559cf18dc00 2024-09-12T02:32:05.054 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.046+0000 7f6a01888640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5559cf18dc00 0x5559ce2c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.054 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.046+0000 7f6a01888640 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5559cf18dc00 0x5559ce2c8c00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.054 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.047+0000 7f6a01888640 1 -- 172.21.15.181:0/3020210162 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5559ce5f6f00 con 0x5559cf18dc00 2024-09-12T02:32:05.054 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.047+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf18d400 con 0x5559cf182c00 2024-09-12T02:32:05.054 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.048+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(5 200.00000001 [write 0~48] v48'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.054 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.048+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:6 6.14 6:2e2fa760:::200.00000001:head [write 48~892 in=892b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf18d800 con 0x5559cf182c00 2024-09-12T02:32:05.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.053+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 5 ==== osd_op_reply(6 200.00000001 [write 48~892] v48'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.053+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [write 940~443 in=443b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf183000 con 0x5559cf182c00 2024-09-12T02:32:05.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.054+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 6 ==== osd_op_reply(7 200.00000001 [write 940~443] v48'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.055 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.054+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:8 6.14 6:2e2fa760:::200.00000001:head [write 1383~815 in=815b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf052000 con 0x5559cf182c00 2024-09-12T02:32:05.057 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.057+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 7 ==== osd_op_reply(8 200.00000001 [write 1383~815] v48'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.058 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.057+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:9 6.14 6:2e2fa760:::200.00000001:head [write 2198~2016 in=2016b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf052400 con 0x5559cf182c00 2024-09-12T02:32:05.059 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.058+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 8 ==== osd_op_reply(9 200.00000001 [write 2198~2016] v48'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.059 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.058+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:10 6.14 6:2e2fa760:::200.00000001:head [write 4214~1669 in=1669b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf052800 con 0x5559cf182c00 2024-09-12T02:32:05.060 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.060+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 9 ==== osd_op_reply(10 200.00000001 [write 4214~1669] v48'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.061 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.060+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:11 6.14 6:2e2fa760:::200.00000001:head [write 5883~2846 in=2846b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf052c00 con 0x5559cf182c00 2024-09-12T02:32:05.062 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.061+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 10 ==== osd_op_reply(11 200.00000001 [write 5883~2846] v48'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.062 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.061+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:12 6.14 6:2e2fa760:::200.00000001:head [write 8729~2256 in=2256b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf053000 con 0x5559cf182c00 2024-09-12T02:32:05.062 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.062+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 11 ==== osd_op_reply(12 200.00000001 [write 8729~2256] v48'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.063 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.062+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:13 6.14 6:2e2fa760:::200.00000001:head [write 10985~1954 in=1954b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf053400 con 0x5559cf182c00 2024-09-12T02:32:05.064 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.063+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 12 ==== osd_op_reply(13 200.00000001 [write 10985~1954] v48'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.064 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.063+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:14 6.14 6:2e2fa760:::200.00000001:head [write 12939~4611 in=4611b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf053800 con 0x5559cf182c00 2024-09-12T02:32:05.066 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.065+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 13 ==== osd_op_reply(14 200.00000001 [write 12939~4611] v48'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.066 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.065+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:15 6.14 6:2e2fa760:::200.00000001:head [write 17550~3209 in=3209b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf053c00 con 0x5559cf182c00 2024-09-12T02:32:05.067 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.066+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 14 ==== osd_op_reply(15 200.00000001 [write 17550~3209] v48'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.067 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.067+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:16 6.14 6:2e2fa760:::200.00000001:head [write 20759~1949 in=1949b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf183000 con 0x5559cf182c00 2024-09-12T02:32:05.068 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.068+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 15 ==== osd_op_reply(16 200.00000001 [write 20759~1949] v48'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.069 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.068+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:17 6.14 6:2e2fa760:::200.00000001:head [write 22708~3176 in=3176b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf18d400 con 0x5559cf182c00 2024-09-12T02:32:05.069 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.069+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 16 ==== osd_op_reply(17 200.00000001 [write 22708~3176] v48'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.070 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.069+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:18 6.14 6:2e2fa760:::200.00000001:head [write 25884~2911 in=2911b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf18d800 con 0x5559cf182c00 2024-09-12T02:32:05.071 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.071+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 17 ==== osd_op_reply(18 200.00000001 [write 25884~2911] v48'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.072 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.071+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:19 6.14 6:2e2fa760:::200.00000001:head [write 28795~1138 in=1138b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf052000 con 0x5559cf182c00 2024-09-12T02:32:05.073 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.072+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 18 ==== osd_op_reply(19 200.00000001 [write 28795~1138] v48'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.073 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.072+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:20 6.14 6:2e2fa760:::200.00000001:head [write 29933~173 in=173b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf052400 con 0x5559cf182c00 2024-09-12T02:32:05.074 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.073+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 19 ==== osd_op_reply(20 200.00000001 [write 29933~173] v48'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.074 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.073+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:21 6.14 6:2e2fa760:::200.00000001:head [write 30106~76 in=76b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5559cf052800 con 0x5559cf182c00 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a00886640 1 -- 172.21.15.181:0/3020210162 <== osd.2 v2:172.21.15.181:6808/3659790931 20 ==== osd_op_reply(21 200.00000001 [write 30106~76] v48'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5559ce330000 con 0x5559cf182c00 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stdout:Events by type: 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stdout: LID: 1 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stdout: PURGED: 1 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stdout: SESSION: 2 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stdout: SUBTREEMAP: 1 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stdout: UPDATE: 12 2024-09-12T02:32:05.075 INFO:tasks.workunit.client.0.smithi181.stdout:Errors: 0 2024-09-12T02:32:05.077 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5559cf182c00 msgr2=0x5559ce2c8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.077 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x5559cf182c00 0x5559ce2c8680 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.077 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5559cf18dc00 msgr2=0x5559ce2c8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.077 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5559cf18dc00 0x5559ce2c8c00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.077 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5559cf18c400 msgr2=0x5559ce5c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5559cf18c400 0x5559ce5c8000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5559ce32ed20 tx=0x5559cf132d80 comp rx=0 tx=0).stop 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 msgr2=0x5559ce2c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 --2- 172.21.15.181:0/3020210162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559cf182400 0x5559ce2c6580 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x5559cf12d920 tx=0x5559cf132c00 comp rx=0 tx=0).stop 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a01087640 1 -- 172.21.15.181:0/3020210162 reap_dead start 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a01087640 1 -- 172.21.15.181:0/3020210162 reap_dead start 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 shutdown_connections 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 >> 172.21.15.181:0/3020210162 conn(0x5559cf02dc00 msgr2=0x5559ce359000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 shutdown_connections 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.074+0000 7f6a03327280 1 -- 172.21.15.181:0/3020210162 wait complete. 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 -- 172.21.15.181:0/2208372114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559ce24bc00 msgr2=0x5559ce2c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559ce24bc00 0x5559ce2c7080 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x5559cf0717a0 tx=0x5559cefeab40 comp rx=0 tx=0).stop 2024-09-12T02:32:05.078 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 -- 172.21.15.181:0/2208372114 shutdown_connections 2024-09-12T02:32:05.079 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5559ce24b800 0x5559ce2c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.079 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5559ce24bc00 0x5559ce2c7080 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.079 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 --2- 172.21.15.181:0/2208372114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5559ce24ac00 0x5559ce2c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.079 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 -- 172.21.15.181:0/2208372114 >> 172.21.15.181:0/2208372114 conn(0x5559ce24b000 msgr2=0x5559ce358800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.079 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 -- 172.21.15.181:0/2208372114 shutdown_connections 2024-09-12T02:32:05.079 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.075+0000 7f6a03327280 1 -- 172.21.15.181:0/2208372114 wait complete. 2024-09-12T02:32:05.079 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-12T02:32:05.106 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.105+0000 7fb57dd1c280 1 -- start start 2024-09-12T02:32:05.106 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.105+0000 7fb57dd1c280 1 Processor -- start 2024-09-12T02:32:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558062b3ac00 0x558062bb6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558062b3b800 0x558062bb6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062b3bc00 0x558062bb7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558063928180 con 0x558062b3b800 2024-09-12T02:32:05.112 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558063928300 con 0x558062b3ac00 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558063928480 con 0x558062b3bc00 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57b3c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558062b3b800 0x558062bb6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57b3c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558062b3b800 0x558062bb6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44302/0 (socket says 172.21.15.181:44302) 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57b3c9640 1 -- 172.21.15.181:0/128988635 learned_addr learned my addr 172.21.15.181:0/128988635 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57bbca640 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558062b3ac00 0x558062bb6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062b3bc00 0x558062bb7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57b3c9640 1 -- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062b3bc00 msgr2=0x558062bb7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062b3bc00 0x558062bb7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57b3c9640 1 -- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558062b3ac00 msgr2=0x558062bb6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.106+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558062b3ac00 0x558062bb6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb57b3c9640 1 -- 172.21.15.181:0/128988635 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558062b72780 con 0x558062b3b800 2024-09-12T02:32:05.113 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb57bbca640 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558062b3ac00 0x558062bb6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062b3bc00 0x558062bb7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558062b3b800 0x558062bb6b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x558063961800 tx=0x5580638da4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e536f8f56370b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb5793c5640 1 -- 172.21.15.181:0/128988635 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b60680 con 0x558062b3b800 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb5793c5640 1 -- 172.21.15.181:0/128988635 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558062b66fc0 con 0x558062b3b800 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb5793c5640 1 -- 172.21.15.181:0/128988635 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b60b60 con 0x558062b3b800 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb57dd1c280 1 -- 172.21.15.181:0/128988635 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558062b723c0 con 0x558062b3b800 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb57dd1c280 1 -- 172.21.15.181:0/128988635 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x558062b73680 con 0x558062b3b800 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb5793c5640 1 -- 172.21.15.181:0/128988635 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x558063a22600 con 0x558062b3b800 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.107+0000 7fb5793c5640 1 -- 172.21.15.181:0/128988635 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x558062b95180 con 0x558062b3b800 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 Processor -- start 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 -- start start 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27400 0x558062bb7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27800 0x558062bb7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.114 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558063928600 con 0x558063a27400 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558063928780 con 0x558063a27800 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558063928900 con 0x558063a27c00 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57c3cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27400 0x558062bb7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57c3cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27400 0x558062bb7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44312/0 (socket says 172.21.15.181:44312) 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57c3cb640 1 -- 172.21.15.181:0/3286075247 learned_addr learned my addr 172.21.15.181:0/3286075247 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57bbca640 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27800 0x558062bb7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.108+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57c3cb640 1 -- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 msgr2=0x558062bb8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57c3cb640 1 -- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27800 msgr2=0x558062bb7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27800 0x558062bb7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.115 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57c3cb640 1 -- 172.21.15.181:0/3286075247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558062b734a0 con 0x558063a27400 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27400 0x558062bb7600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x558063a12720 tx=0x5580638daa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eed0dd83e9d320d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb5773c1640 1 -- 172.21.15.181:0/3286075247 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b609c0 con 0x558063a27400 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb5773c1640 1 -- 172.21.15.181:0/3286075247 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558062b66e00 con 0x558063a27400 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb5773c1640 1 -- 172.21.15.181:0/3286075247 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b60680 con 0x558063a27400 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3286075247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27400 msgr2=0x558062bb7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27400 0x558062bb7600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x558063a12720 tx=0x5580638daa20 comp rx=0 tx=0).stop 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3286075247 shutdown_connections 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27800 0x558062bb7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3286075247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27400 0x558062bb7600 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3286075247 >> 172.21.15.181:0/3286075247 conn(0x558063a27000 msgr2=0x5580638c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3286075247 shutdown_connections 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.109+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3286075247 wait complete. 2024-09-12T02:32:05.116 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 Processor -- start 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 -- start start 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27400 0x558062bb9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27800 0x558062bb8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558062b9c180 con 0x558063a27800 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558063929e00 con 0x558063a27400 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.110+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558063928d80 con 0x558063a27c00 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27800 0x558062bb8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27800 0x558062bb8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44328/0 (socket says 172.21.15.181:44328) 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 -- 172.21.15.181:0/3220672341 learned_addr learned my addr 172.21.15.181:0/3220672341 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27400 0x558062bb9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.117 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 -- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 msgr2=0x558062bb8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 -- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27400 msgr2=0x558062bb9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27400 0x558062bb9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 -- 172.21.15.181:0/3220672341 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558062b72780 con 0x558063a27800 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57bbca640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27800 0x558062bb8c00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x558063a13b90 tx=0x558063a3cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb575bbe640 1 -- 172.21.15.181:0/3220672341 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b609c0 con 0x558063a27800 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb575bbe640 1 -- 172.21.15.181:0/3220672341 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558062b66a80 con 0x558063a27800 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb575bbe640 1 -- 172.21.15.181:0/3220672341 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b60680 con 0x558063a27800 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558062b723c0 con 0x558063a27800 2024-09-12T02:32:05.118 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.111+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558062b72000 con 0x558063a27800 2024-09-12T02:32:05.122 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.112+0000 7fb575bbe640 1 -- 172.21.15.181:0/3220672341 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x558063a8ec00 con 0x558063a27800 2024-09-12T02:32:05.122 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.113+0000 7fb575bbe640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558063941000 0x558062bb9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.113+0000 7fb575bbe640 1 -- 172.21.15.181:0/3220672341 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x558063942a00 con 0x558063a27800 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.113+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558063941000 0x558062bb9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.113+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558063941000 0x558062bb9700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x558063a12720 tx=0x5580638daae0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.113+0000 7fb57dd1c280 1 -- start start 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.113+0000 7fb57dd1c280 1 Processor -- start 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063941800 0x558062bb8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063941c00 0x558062bb7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57dd1c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062f1e000 0x558062bb7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558063929080 con 0x558063941800 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558063929b00 con 0x558063941c00 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57dd1c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558063929c80 con 0x558062f1e000 2024-09-12T02:32:05.123 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063941800 0x558062bb8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063941800 0x558062bb8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44334/0 (socket says 172.21.15.181:44334) 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 -- 172.21.15.181:0/1372501811 learned_addr learned my addr 172.21.15.181:0/1372501811 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062f1e000 0x558062bb7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57bbca640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063941c00 0x558062bb7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 -- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062f1e000 msgr2=0x558062bb7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062f1e000 0x558062bb7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 -- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063941c00 msgr2=0x558062bb7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063941c00 0x558062bb7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558062b72960 con 0x558063941800 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.114+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063941800 0x558062bb8100 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x558062e697a0 tx=0x5580638dbec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b78dc10698dc4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb572bb8640 1 -- 172.21.15.181:0/1372501811 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b60b60 con 0x558063941800 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb572bb8640 1 -- 172.21.15.181:0/1372501811 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558062b66c40 con 0x558063941800 2024-09-12T02:32:05.124 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb572bb8640 1 -- 172.21.15.181:0/1372501811 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558062b604e0 con 0x558063941800 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558062b72780 con 0x558063941800 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x558062b723c0 con 0x558063941800 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb572bb8640 1 -- 172.21.15.181:0/1372501811 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x558062f24600 con 0x558063941800 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb572bb8640 1 -- 172.21.15.181:0/1372501811 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x558062b95500 con 0x558063941800 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558062f1e400 0x558062f3e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x558062f1e800 con 0x558062f1e400 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb57bbca640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558062f1e400 0x558062f3e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.115+0000 7fb57bbca640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558062f1e400 0x558062f3e000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=5e07520e6d1c8abd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb57bbca640 1 -- 172.21.15.181:0/1372501811 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5580638d2000 con 0x558062f1e400 2024-09-12T02:32:05.125 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x558062f1ec00 con 0x558062f1e400 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb57bbca640 1 -- 172.21.15.181:0/1372501811 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5580638d2000 con 0x558062f1e400 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb5713b5640 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x558062f3c400 con 0x558062f1e400 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb5713b5640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558062f3c800 0x558062f40680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb5713b5640 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48) -- 0x558062f3cc00 con 0x558062f3c800 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558062f3c800 0x558062f40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.116+0000 7fb57bbca640 1 -- 172.21.15.181:0/1372501811 <== osd.2 v2:172.21.15.181:6808/3659790931 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv55 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5580638d2000 con 0x558062f1e400 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.117+0000 7fb57b3c9640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558062f3c800 0x558062f40680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=690ae723716faec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.126 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.117+0000 7fb57b3c9640 1 -- 172.21.15.181:0/1372501811 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5580638d2500 con 0x558062f3c800 2024-09-12T02:32:05.127 INFO:tasks.workunit.client.0.smithi181.stdout:old journal was 4194304~30182 2024-09-12T02:32:05.127 INFO:tasks.workunit.client.0.smithi181.stdout:new journal start will be 8388608 (4164122 bytes past old end) 2024-09-12T02:32:05.127 INFO:tasks.workunit.client.0.smithi181.stdout:writing journal head 2024-09-12T02:32:05.128 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.117+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f1f000 con 0x558062f1e400 2024-09-12T02:32:05.128 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57bbca640 1 -- 172.21.15.181:0/1372501811 <== osd.2 v2:172.21.15.181:6808/3659790931 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v48'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5580638d2000 con 0x558062f1e400 2024-09-12T02:32:05.128 INFO:tasks.workunit.client.0.smithi181.stdout:writing EResetJournal entry 2024-09-12T02:32:05.130 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f1f400 con 0x558062f3c800 2024-09-12T02:32:05.130 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:7 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f3c400 con 0x558062f3c800 2024-09-12T02:32:05.130 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:8 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f3d000 con 0x558062f3c800 2024-09-12T02:32:05.130 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x558062f3d400 0x558062f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f3d800 con 0x558062f3d400 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:10 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f1e800 con 0x558062f3d400 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x558062f1ec00 0x558062f3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:11 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f1f000 con 0x558062f1ec00 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x558062f3d400 0x558062f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.118+0000 7fb57bbca640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x558062f1ec00 0x558062f3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.119+0000 7fb57bbca640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x558062f1ec00 0x558062f3eb00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=802f90f5e4efd67e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.119+0000 7fb57c3cb640 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x558062f3d400 0x558062f3e580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=10192d148958d797 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.119+0000 7fb57b3c9640 1 -- 172.21.15.181:0/1372501811 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(6 200.00000002 [delete] v48'7 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5580638d2500 con 0x558062f3c800 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.119+0000 7fb57b3c9640 1 -- 172.21.15.181:0/1372501811 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(8 200.00000004 [delete] v48'19 uv18 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5580638d2500 con 0x558062f3c800 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.119+0000 7fb57b3c9640 1 -- 172.21.15.181:0/1372501811 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(7 200.00000003 [delete] v48'4 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5580638d2500 con 0x558062f3c800 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.119+0000 7fb5713b5640 1 -- 172.21.15.181:0/1372501811 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:12 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x558062f3cc00 con 0x558062f3c800 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.120+0000 7fb57c3cb640 1 -- 172.21.15.181:0/1372501811 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(10 200.00000006 [delete] v48'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5580638d2780 con 0x558062f3d400 2024-09-12T02:32:05.131 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.120+0000 7fb57c3cb640 1 -- 172.21.15.181:0/1372501811 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(9 200.00000005 [delete] v48'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5580638d2780 con 0x558062f3d400 2024-09-12T02:32:05.132 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.120+0000 7fb57bbca640 1 -- 172.21.15.181:0/1372501811 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(11 200.00000007 [delete] v48'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5580638d2000 con 0x558062f1ec00 2024-09-12T02:32:05.132 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.120+0000 7fb57b3c9640 1 -- 172.21.15.181:0/1372501811 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v48'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5580638d2500 con 0x558062f3c800 2024-09-12T02:32:05.132 INFO:tasks.workunit.client.0.smithi181.stdout:done 2024-09-12T02:32:05.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x558062f1ec00 msgr2=0x558062f3eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.134 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x558062f1ec00 0x558062f3eb00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558062f1e400 msgr2=0x558062f3e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x558062f1e400 0x558062f3e000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558062f3c800 msgr2=0x558062f40680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x558062f3c800 0x558062f40680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x558062f3d400 msgr2=0x558062f3e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x558062f3d400 0x558062f3e580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57b3c9640 1 -- 172.21.15.181:0/1372501811 reap_dead start 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063941800 msgr2=0x558062bb8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57b3c9640 1 -- 172.21.15.181:0/1372501811 reap_dead start 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063941800 0x558062bb8100 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x558062e697a0 tx=0x5580638dbec0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 shutdown_connections 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/1372501811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063941800 0x558062bb8100 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.135 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 >> 172.21.15.181:0/1372501811 conn(0x558063941400 msgr2=0x5580638c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 shutdown_connections 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/1372501811 wait complete. 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558063941000 msgr2=0x558062bb9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558063941000 0x558062bb9700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x558063a12720 tx=0x5580638daae0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27800 msgr2=0x558062bb8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27800 0x558062bb8c00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x558063a13b90 tx=0x558063a3cc00 comp rx=0 tx=0).stop 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 shutdown_connections 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558063941000 0x558062bb9700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558063a27c00 0x558062bb8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558063a27800 0x558062bb8c00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/3220672341 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558063a27400 0x558062bb9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 >> 172.21.15.181:0/3220672341 conn(0x558063a27000 msgr2=0x5580638c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.136 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 shutdown_connections 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/3220672341 wait complete. 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/128988635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558062b3b800 msgr2=0x558062bb6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558062b3b800 0x558062bb6b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x558063961800 tx=0x5580638da4e0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/128988635 shutdown_connections 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558062b3bc00 0x558062bb7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558062b3b800 0x558062bb6b00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 --2- 172.21.15.181:0/128988635 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558062b3ac00 0x558062bb6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/128988635 >> 172.21.15.181:0/128988635 conn(0x558062b3b000 msgr2=0x5580638c6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/128988635 shutdown_connections 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.121+0000 7fb57dd1c280 1 -- 172.21.15.181:0/128988635 wait complete. 2024-09-12T02:32:05.137 INFO:tasks.workunit.client.0.smithi181.stderr:+ cephfs-table-tool all reset session 2024-09-12T02:32:05.167 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.151+0000 7f552ab28280 1 -- start start 2024-09-12T02:32:05.167 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.151+0000 7f552ab28280 1 Processor -- start 2024-09-12T02:32:05.167 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f552ab28280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fac78c00 0x5605facf4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.168 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f552ab28280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fac79800 0x5605facf4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.168 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f552ab28280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fac79c00 0x5605facf5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.168 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f552ab28280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5605fb9e4180 con 0x5605fac79c00 2024-09-12T02:32:05.168 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f552ab28280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5605fb9e4300 con 0x5605fac79800 2024-09-12T02:32:05.168 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f552ab28280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5605fb9e4480 con 0x5605fac78c00 2024-09-12T02:32:05.168 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fac79c00 0x5605facf5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.169 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fac79c00 0x5605facf5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44354/0 (socket says 172.21.15.181:44354) 2024-09-12T02:32:05.169 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 -- 172.21.15.181:0/691875982 learned_addr learned my addr 172.21.15.181:0/691875982 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.169 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55281b3640 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fac79800 0x5605facf4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.169 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55289b4640 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fac78c00 0x5605facf4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.169 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 -- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fac78c00 msgr2=0x5605facf4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.170 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fac78c00 0x5605facf4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.170 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 -- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fac79800 msgr2=0x5605facf4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.170 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fac79800 0x5605facf4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.170 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.152+0000 7f55291b5640 1 -- 172.21.15.181:0/691875982 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605facb0780 con 0x5605fac79c00 2024-09-12T02:32:05.170 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f55291b5640 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fac79c00 0x5605facf5080 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x5605fbaaf2f0 tx=0x5605fba18540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5344c3a04603ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.170 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f55261af640 1 -- 172.21.15.181:0/691875982 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5605fac9e680 con 0x5605fac79c00 2024-09-12T02:32:05.171 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f55261af640 1 -- 172.21.15.181:0/691875982 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5605faca4fc0 con 0x5605fac79c00 2024-09-12T02:32:05.171 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f55261af640 1 -- 172.21.15.181:0/691875982 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5605fac9eb60 con 0x5605fac79c00 2024-09-12T02:32:05.171 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f552ab28280 1 -- 172.21.15.181:0/691875982 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605facb03c0 con 0x5605fac79c00 2024-09-12T02:32:05.171 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f552ab28280 1 -- 172.21.15.181:0/691875982 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5605facb1680 con 0x5605fac79c00 2024-09-12T02:32:05.171 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f55261af640 1 -- 172.21.15.181:0/691875982 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5605fbb58600 con 0x5605fac79c00 2024-09-12T02:32:05.171 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.153+0000 7f55261af640 1 -- 172.21.15.181:0/691875982 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 3498+0+0 (secure 0 0 0) 0x5605facd3180 con 0x5605fac79c00 2024-09-12T02:32:05.172 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 Processor -- start 2024-09-12T02:32:05.172 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 -- start start 2024-09-12T02:32:05.172 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81400 0x5605facf5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.172 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 0x5605facf5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.172 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81c00 0x5605facf6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.172 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5605fb9e4600 con 0x5605fba81c00 2024-09-12T02:32:05.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5605fb9e4780 con 0x5605fba81400 2024-09-12T02:32:05.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f552ab28280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5605fb9e4900 con 0x5605fba81800 2024-09-12T02:32:05.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81c00 0x5605facf6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81c00 0x5605facf6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44360/0 (socket says 172.21.15.181:44360) 2024-09-12T02:32:05.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 -- 172.21.15.181:0/4216949242 learned_addr learned my addr 172.21.15.181:0/4216949242 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.173 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81400 0x5605facf5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55289b4640 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 0x5605facf5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 -- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 msgr2=0x5605facf5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 0x5605facf5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 -- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81400 msgr2=0x5605facf5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.174 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.154+0000 7f55281b3640 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81400 0x5605facf5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f55281b3640 1 -- 172.21.15.181:0/4216949242 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605facb14a0 con 0x5605fba81c00 2024-09-12T02:32:05.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f55281b3640 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81c00 0x5605facf6100 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x5605fbb72600 tx=0x5605fad356e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b14bec571c58da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f55241ab640 1 -- 172.21.15.181:0/4216949242 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5605fac9e9c0 con 0x5605fba81c00 2024-09-12T02:32:05.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f55241ab640 1 -- 172.21.15.181:0/4216949242 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5605faca4e00 con 0x5605fba81c00 2024-09-12T02:32:05.175 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f55241ab640 1 -- 172.21.15.181:0/4216949242 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5605fac9e680 con 0x5605fba81c00 2024-09-12T02:32:05.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 -- 172.21.15.181:0/4216949242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81c00 msgr2=0x5605facf6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81c00 0x5605facf6100 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x5605fbb72600 tx=0x5605fad356e0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 -- 172.21.15.181:0/4216949242 shutdown_connections 2024-09-12T02:32:05.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81c00 0x5605facf6100 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 0x5605facf5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.176 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 --2- 172.21.15.181:0/4216949242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81400 0x5605facf5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 -- 172.21.15.181:0/4216949242 >> 172.21.15.181:0/4216949242 conn(0x5605fba81000 msgr2=0x5605fad85000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 -- 172.21.15.181:0/4216949242 shutdown_connections 2024-09-12T02:32:05.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.155+0000 7f552ab28280 1 -- 172.21.15.181:0/4216949242 wait complete. 2024-09-12T02:32:05.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 Processor -- start 2024-09-12T02:32:05.177 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 -- start start 2024-09-12T02:32:05.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81400 0x5605facf7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 0x5605facf6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81c00 0x5605facf6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5605fb9e4c00 con 0x5605fba81400 2024-09-12T02:32:05.178 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5605fb9e4d80 con 0x5605fba81c00 2024-09-12T02:32:05.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f552ab28280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5605fb9e4f00 con 0x5605fba81800 2024-09-12T02:32:05.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f55281b3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81400 0x5605facf7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f55281b3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81400 0x5605facf7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44376/0 (socket says 172.21.15.181:44376) 2024-09-12T02:32:05.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f55281b3640 1 -- 172.21.15.181:0/3418420294 learned_addr learned my addr 172.21.15.181:0/3418420294 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.179 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f55289b4640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 0x5605facf6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.156+0000 7f55281b3640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81c00 0x5605facf6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55281b3640 1 -- 172.21.15.181:0/3418420294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 msgr2=0x5605facf6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55281b3640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fba81800 0x5605facf6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55281b3640 1 -- 172.21.15.181:0/3418420294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81c00 msgr2=0x5605facf6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55281b3640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fba81c00 0x5605facf6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.180 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55281b3640 1 -- 172.21.15.181:0/3418420294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605facb0780 con 0x5605fba81400 2024-09-12T02:32:05.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55281b3640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81400 0x5605facf7180 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x5605fbb72930 tx=0x5605fba185a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55229a8640 1 -- 172.21.15.181:0/3418420294 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5605fac9eb60 con 0x5605fba81400 2024-09-12T02:32:05.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55229a8640 1 -- 172.21.15.181:0/3418420294 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5605faca4c40 con 0x5605fba81400 2024-09-12T02:32:05.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605facb03c0 con 0x5605fba81400 2024-09-12T02:32:05.181 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f55229a8640 1 -- 172.21.15.181:0/3418420294 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5605fac9e4e0 con 0x5605fba81400 2024-09-12T02:32:05.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.157+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605facb0000 con 0x5605fba81400 2024-09-12T02:32:05.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.158+0000 7f55229a8640 1 -- 172.21.15.181:0/3418420294 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5605fbb48c00 con 0x5605fba81400 2024-09-12T02:32:05.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.158+0000 7f55229a8640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5605fbbd4400 0x5605facf7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.159+0000 7f55229a8640 1 -- 172.21.15.181:0/3418420294 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x5605fbbd2600 con 0x5605fba81400 2024-09-12T02:32:05.182 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.159+0000 7f55289b4640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5605fbbd4400 0x5605facf7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.159+0000 7f552ab28280 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5605fbbd4800 0x5605facf6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.159+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 6.b 6:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) -- 0x5605fbbd4c00 con 0x5605fbbd4800 2024-09-12T02:32:05.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.159+0000 7f55281b3640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5605fbbd4800 0x5605facf6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.159+0000 7f55289b4640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5605fbbd4400 0x5605facf7700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5605fad608a0 tx=0x5605fbb74d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.183 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.159+0000 7f55281b3640 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5605fbbd4800 0x5605facf6100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.184 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f55281b3640 1 -- 172.21.15.181:0/3418420294 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v48'5 uv5 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x5605fba08000 con 0x5605fbbd4800 2024-09-12T02:32:05.184 INFO:tasks.workunit.client.0.smithi181.stdout:{ 2024-09-12T02:32:05.184 INFO:tasks.workunit.client.0.smithi181.stdout: "0": { 2024-09-12T02:32:05.184 INFO:tasks.workunit.client.0.smithi181.stdout: "data": {}, 2024-09-12T02:32:05.185 INFO:tasks.workunit.client.0.smithi181.stdout: "result": 0 2024-09-12T02:32:05.185 INFO:tasks.workunit.client.0.smithi181.stdout: } 2024-09-12T02:32:05.185 INFO:tasks.workunit.client.0.smithi181.stdout:} 2024-09-12T02:32:05.185 INFO:tasks.workunit.client.0.smithi181.stdout: 2024-09-12T02:32:05.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5605fbbd4800 msgr2=0x5605facf6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5605fbbd4800 0x5605facf6100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5605fbbd4400 msgr2=0x5605facf7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.189 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5605fbbd4400 0x5605facf7700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5605fad608a0 tx=0x5605fbb74d80 comp rx=0 tx=0).stop 2024-09-12T02:32:05.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81400 msgr2=0x5605facf7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 --2- 172.21.15.181:0/3418420294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fba81400 0x5605facf7180 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x5605fbb72930 tx=0x5605fba185a0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f55289b4640 1 -- 172.21.15.181:0/3418420294 reap_dead start 2024-09-12T02:32:05.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 shutdown_connections 2024-09-12T02:32:05.190 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 >> 172.21.15.181:0/3418420294 conn(0x5605fba81000 msgr2=0x5605fad85000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.191 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 shutdown_connections 2024-09-12T02:32:05.191 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.160+0000 7f552ab28280 1 -- 172.21.15.181:0/3418420294 wait complete. 2024-09-12T02:32:05.191 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 -- 172.21.15.181:0/691875982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fac79c00 msgr2=0x5605facf5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.191 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fac79c00 0x5605facf5080 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x5605fbaaf2f0 tx=0x5605fba18540 comp rx=0 tx=0).stop 2024-09-12T02:32:05.191 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 -- 172.21.15.181:0/691875982 shutdown_connections 2024-09-12T02:32:05.191 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5605fac79800 0x5605facf4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.192 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5605fac79c00 0x5605facf5080 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.192 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 --2- 172.21.15.181:0/691875982 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5605fac78c00 0x5605facf4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.192 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 -- 172.21.15.181:0/691875982 >> 172.21.15.181:0/691875982 conn(0x5605fac79000 msgr2=0x5605fad84800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.192 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 -- 172.21.15.181:0/691875982 shutdown_connections 2024-09-12T02:32:05.192 INFO:tasks.workunit.client.0.smithi181.stderr:2024-09-12T02:32:05.161+0000 7f552ab28280 1 -- 172.21.15.181:0/691875982 wait complete. 2024-09-12T02:32:05.193 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:32:05.193 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:32:05.255 INFO:tasks.workunit:Stopping ['suites/cephfs_journal_tool_smoke.sh'] on client.0... 2024-09-12T02:32:05.255 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:32:05.555 DEBUG:teuthology.parallel:result is None 2024-09-12T02:32:05.555 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:32:05.580 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:32:05.580 DEBUG:teuthology.orchestra.run.smithi181:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:05.636 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:32:05.636 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:32:05.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.777+0000 7f43dd280640 1 Processor -- start 2024-09-12T02:32:05.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.777+0000 7f43dd280640 1 -- start start 2024-09-12T02:32:05.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43dd280640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f43d815e640 0x7f43d80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43dd280640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d80d4710 0x7f43d80d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43dd280640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d80b39d0 con 0x7f43d80cef60 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43dd280640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f43d80cf520 con 0x7f43d815e640 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43dd280640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f43d80cf800 con 0x7f43d80d4710 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d6ffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f43d815e640 0x7f43d80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d67fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f43d80cef60 0x7f43d80d2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53526/0 (socket says 172.21.15.181:53526) 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d67fc640 1 -- 172.21.15.181:0/3223780362 learned_addr learned my addr 172.21.15.181:0/3223780362 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d77fe640 1 --2- 172.21.15.181:0/3223780362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d80d4710 0x7f43d80d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d6ffd640 1 -- 172.21.15.181:0/3223780362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d80d4710 msgr2=0x7f43d80d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d6ffd640 1 --2- 172.21.15.181:0/3223780362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d80d4710 0x7f43d80d4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d6ffd640 1 -- 172.21.15.181:0/3223780362 >> v1:172.21.15.181:6789/0 conn(0x7f43d80cef60 legacy=0x7f43d80d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d6ffd640 1 -- 172.21.15.181:0/3223780362 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d80cfae0 con 0x7f43d815e640 2024-09-12T02:32:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.778+0000 7f43d5ffb640 1 -- 172.21.15.181:0/3223780362 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706567260 0 0) 0x7f43cc001110 con 0x7f43d80cef60 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.779+0000 7f43d6ffd640 1 --2- 172.21.15.181:0/3223780362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d815e640 0x7f43d80b3bf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097a0 tx=0x7f43c802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadec9ed45be5826 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.779+0000 7f43d5ffb640 1 -- 172.21.15.181:0/3223780362 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8037070 con 0x7f43d815e640 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.779+0000 7f43d5ffb640 1 -- 172.21.15.181:0/3223780362 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c802ae50 con 0x7f43d815e640 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.779+0000 7f43d5ffb640 1 -- 172.21.15.181:0/3223780362 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8032660 con 0x7f43d815e640 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 -- 172.21.15.181:0/3223780362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d815e640 msgr2=0x7f43d80b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 --2- 172.21.15.181:0/3223780362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d815e640 0x7f43d80b3bf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097a0 tx=0x7f43c802a100 comp rx=0 tx=0).stop 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 -- 172.21.15.181:0/3223780362 shutdown_connections 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 --2- 172.21.15.181:0/3223780362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d80d4710 0x7f43d80d4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 --2- 172.21.15.181:0/3223780362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d815e640 0x7f43d80b3bf0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 -- 172.21.15.181:0/3223780362 >> 172.21.15.181:0/3223780362 conn(0x7f43d8067d70 msgr2=0x7f43d8068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 -- 172.21.15.181:0/3223780362 shutdown_connections 2024-09-12T02:32:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.780+0000 7f43dd280640 1 -- 172.21.15.181:0/3223780362 wait complete. 2024-09-12T02:32:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.781+0000 7f43dd280640 1 Processor -- start 2024-09-12T02:32:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.781+0000 7f43dd280640 1 -- start start 2024-09-12T02:32:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43dd280640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43d80cef60 0x7f43d8153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43dd280640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d80d4710 0x7f43d80ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43dd280640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d815e640 0x7f43d80adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43dd280640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f43d815ea20 con 0x7f43d80d4710 2024-09-12T02:32:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43dd280640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f43d80d5050 con 0x7f43d80cef60 2024-09-12T02:32:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43dd280640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f43d80d3590 con 0x7f43d815e640 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d80d4710 0x7f43d80ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d80d4710 0x7f43d80ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44392/0 (socket says 172.21.15.181:44392) 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 -- 172.21.15.181:0/3444177683 learned_addr learned my addr 172.21.15.181:0/3444177683 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d6ffd640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43d80cef60 0x7f43d8153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d77fe640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d815e640 0x7f43d80adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 -- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d815e640 msgr2=0x7f43d80adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d815e640 0x7f43d80adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 -- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43d80cef60 msgr2=0x7f43d8153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43d80cef60 0x7f43d8153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 -- 172.21.15.181:0/3444177683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d80cd4d0 con 0x7f43d80d4710 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d77fe640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d815e640 0x7f43d80adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.782+0000 7f43d67fc640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d80d4710 0x7f43d80ccb60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00c400 tx=0x7f43cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.783+0000 7f43bf7fe640 1 -- 172.21.15.181:0/3444177683 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc017070 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.783+0000 7f43bf7fe640 1 -- 172.21.15.181:0/3444177683 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43cc005ce0 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.783+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d80cd7b0 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.783+0000 7f43bf7fe640 1 -- 172.21.15.181:0/3444177683 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc007310 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.783+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d80ab1a0 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.784+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d80d4b10 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.784+0000 7f43bf7fe640 1 -- 172.21.15.181:0/3444177683 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43cc01a070 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.785+0000 7f43bf7fe640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f43c406be30 0x7f43c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.785+0000 7f43bf7fe640 1 -- 172.21.15.181:0/3444177683 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f43cc08a270 con 0x7f43d80d4710 2024-09-12T02:32:05.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.785+0000 7f43d6ffd640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f43c406be30 0x7f43c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.785+0000 7f43d6ffd640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f43c406be30 0x7f43c406e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f43c8034000 tx=0x7f43c802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.789+0000 7f43bf7fe640 1 -- 172.21.15.181:0/3444177683 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43d80b39d0 con 0x7f43d80d4710 2024-09-12T02:32:05.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:05.990+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f43d80d4370 con 0x7f43d80d4710 2024-09-12T02:32:06.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.504+0000 7f43bf7fe640 1 -- 172.21.15.181:0/3444177683 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v30) ==== 162+0+0 (secure 0 0 0) 0x7f43cc058540 con 0x7f43d80d4710 2024-09-12T02:32:06.505 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f43c406be30 msgr2=0x7f43c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f43c406be30 0x7f43c406e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f43c8034000 tx=0x7f43c802e000 comp rx=0 tx=0).stop 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d80d4710 msgr2=0x7f43d80ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d80d4710 0x7f43d80ccb60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00c400 tx=0x7f43cc00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 shutdown_connections 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f43c406be30 0x7f43c406e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43d815e640 0x7f43d80adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f43d80d4710 0x7f43d80ccb60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 --2- 172.21.15.181:0/3444177683 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43d80cef60 0x7f43d8153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 >> 172.21.15.181:0/3444177683 conn(0x7f43d8067d70 msgr2=0x7f43d80d3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:06.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 shutdown_connections 2024-09-12T02:32:06.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.507+0000 7f43dd280640 1 -- 172.21.15.181:0/3444177683 wait complete. 2024-09-12T02:32:06.524 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:32:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.621+0000 7f85880a6640 1 Processor -- start 2024-09-12T02:32:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.621+0000 7f85880a6640 1 -- start start 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f85880a6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f858015c4a0 0x7f85800cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f85880a6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f85800d2da0 0x7f858015c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f85880a6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85800d0a30 con 0x7f85800b4090 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f85880a6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f85800d0d30 con 0x7f858015c4a0 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f85880a6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f85800b76f0 con 0x7f85800d2da0 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f8585e42640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f858015c4a0 0x7f85800cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f8586643640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f85800b4090 0x7f8580165020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53532/0 (socket says 172.21.15.181:53532) 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.622+0000 7f8586643640 1 -- 172.21.15.181:0/1614453448 learned_addr learned my addr 172.21.15.181:0/1614453448 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.623+0000 7f8585641640 1 --2- 172.21.15.181:0/1614453448 >> v2:172.21.15.204:3300/0 conn(0x7f85800d2da0 0x7f858015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.623+0000 7f8585e42640 1 -- 172.21.15.181:0/1614453448 >> v2:172.21.15.204:3300/0 conn(0x7f85800d2da0 msgr2=0x7f858015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.623+0000 7f8585e42640 1 --2- 172.21.15.181:0/1614453448 >> v2:172.21.15.204:3300/0 conn(0x7f85800d2da0 0x7f858015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.623+0000 7f8585e42640 1 -- 172.21.15.181:0/1614453448 >> v1:172.21.15.181:6789/0 conn(0x7f85800b4090 legacy=0x7f8580165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.623+0000 7f8585e42640 1 -- 172.21.15.181:0/1614453448 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8580073710 con 0x7f858015c4a0 2024-09-12T02:32:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.623+0000 7f8585e42640 1 --2- 172.21.15.181:0/1614453448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f85800cff80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8580068610 tx=0x7f857c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba34f5256cc3d988 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f8584e40640 1 -- 172.21.15.181:0/1614453448 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c037070 con 0x7f858015c4a0 2024-09-12T02:32:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f8584e40640 1 -- 172.21.15.181:0/1614453448 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c032440 con 0x7f858015c4a0 2024-09-12T02:32:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f8584e40640 1 -- 172.21.15.181:0/1614453448 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c02ae60 con 0x7f858015c4a0 2024-09-12T02:32:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 -- 172.21.15.181:0/1614453448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 msgr2=0x7f85800cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 --2- 172.21.15.181:0/1614453448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f85800cff80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8580068610 tx=0x7f857c02a110 comp rx=0 tx=0).stop 2024-09-12T02:32:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 -- 172.21.15.181:0/1614453448 shutdown_connections 2024-09-12T02:32:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 --2- 172.21.15.181:0/1614453448 >> v2:172.21.15.204:3300/0 conn(0x7f85800d2da0 0x7f858015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 --2- 172.21.15.181:0/1614453448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f85800cff80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 -- 172.21.15.181:0/1614453448 >> 172.21.15.181:0/1614453448 conn(0x7f8580067950 msgr2=0x7f8580067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 -- 172.21.15.181:0/1614453448 shutdown_connections 2024-09-12T02:32:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.624+0000 7f85880a6640 1 -- 172.21.15.181:0/1614453448 wait complete. 2024-09-12T02:32:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.625+0000 7f85880a6640 1 Processor -- start 2024-09-12T02:32:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.625+0000 7f85880a6640 1 -- start start 2024-09-12T02:32:06.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f85880a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85800b4090 0x7f8580155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:06.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f85880a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85800d2da0 0x7f8580156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f85880a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f858014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f85880a6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f85800b4520 con 0x7f858015c4a0 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f85880a6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f85800d28e0 con 0x7f85800b4090 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f85880a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f85800b46a0 con 0x7f85800d2da0 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f858014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f858014cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44410/0 (socket says 172.21.15.181:44410) 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 -- 172.21.15.181:0/357443966 learned_addr learned my addr 172.21.15.181:0/357443966 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8585641640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85800d2da0 0x7f8580156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8585e42640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85800b4090 0x7f8580155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 -- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85800d2da0 msgr2=0x7f8580156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85800d2da0 0x7f8580156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 -- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85800b4090 msgr2=0x7f8580155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85800b4090 0x7f8580155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8586643640 1 -- 172.21.15.181:0/357443966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8580157340 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.626+0000 7f8585e42640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85800b4090 0x7f8580155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.627+0000 7f8586643640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f858014cef0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f857800caa0 tx=0x7f857800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.627+0000 7f85767fc640 1 -- 172.21.15.181:0/357443966 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578017070 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.627+0000 7f85767fc640 1 -- 172.21.15.181:0/357443966 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857800ac00 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.627+0000 7f85767fc640 1 -- 172.21.15.181:0/357443966 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578012400 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.627+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8580157620 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.627+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8580157be0 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.628+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85800cff80 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.628+0000 7f85767fc640 1 -- 172.21.15.181:0/357443966 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f857801a070 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.629+0000 7f85767fc640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856406be30 0x7f856406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.629+0000 7f85767fc640 1 -- 172.21.15.181:0/357443966 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f857808ac30 con 0x7f858015c4a0 2024-09-12T02:32:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.629+0000 7f8585e42640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856406be30 0x7f856406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.629+0000 7f8585e42640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856406be30 0x7f856406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f857c034000 tx=0x7f857c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:06.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.633+0000 7f85767fc640 1 -- 172.21.15.181:0/357443966 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8578059550 con 0x7f858015c4a0 2024-09-12T02:32:06.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.834+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85800b3bc0 con 0x7f858015c4a0 2024-09-12T02:32:06.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.834+0000 7f85767fc640 1 -- 172.21.15.181:0/357443966 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5229 (secure 0 0 0) 0x7f8578058e50 con 0x7f858015c4a0 2024-09-12T02:32:06.835 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:32:06.835 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":31,"btime":"2024-09-12T02:32:06:507624+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:32:06.507611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.181:6837/3622686732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3622686732},{"type":"v1","addr":"172.21.15.181:6837","nonce":3622686732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T02:32:06.836 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 31 2024-09-12T02:32:06.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.836+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856406be30 msgr2=0x7f856406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.836+0000 7f85880a6640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856406be30 0x7f856406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f857c034000 tx=0x7f857c02e000 comp rx=0 tx=0).stop 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.836+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 msgr2=0x7f858014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.836+0000 7f85880a6640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f858014cef0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f857800caa0 tx=0x7f857800cf60 comp rx=0 tx=0).stop 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 shutdown_connections 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856406be30 0x7f856406e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f858015c4a0 0x7f858014cef0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85800d2da0 0x7f8580156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 --2- 172.21.15.181:0/357443966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85800b4090 0x7f8580155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 >> 172.21.15.181:0/357443966 conn(0x7f8580067950 msgr2=0x7f85800b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 shutdown_connections 2024-09-12T02:32:06.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:06.837+0000 7f85880a6640 1 -- 172.21.15.181:0/357443966 wait complete. 2024-09-12T02:32:07.250 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:51.939812+0000', 'modified': '2024-09-12T02:32:06.507611+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 48, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5571': {'gid': 5571, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/3622686732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3622686732}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3622686732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:32:07.251 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5571:up:replay 2024-09-12T02:32:08.252 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:32:08.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.354+0000 7f1544531640 1 Processor -- start 2024-09-12T02:32:08.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.354+0000 7f1544531640 1 -- start start 2024-09-12T02:32:08.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.355+0000 7f1544531640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f153c15b1e0 0x7f153c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.355+0000 7f1544531640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153c0ce480 con 0x7f153c0b2490 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.355+0000 7f1544531640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153c0ce760 con 0x7f153c0b41d0 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.355+0000 7f1544531640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f153c0cea40 con 0x7f153c15b1e0 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.355+0000 7f15422cd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f153c15b1e0 0x7f153c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.355+0000 7f1542ace640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f153c0b2490 0x7f153c0716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53536/0 (socket says 172.21.15.181:53536) 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.355+0000 7f1542ace640 1 -- 172.21.15.181:0/2071978227 learned_addr learned my addr 172.21.15.181:0/2071978227 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15422cd640 1 -- 172.21.15.181:0/2071978227 >> v1:172.21.15.204:6789/0 conn(0x7f153c0b41d0 legacy=0x7f153c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15422cd640 1 -- 172.21.15.181:0/2071978227 >> v1:172.21.15.181:6789/0 conn(0x7f153c0b2490 legacy=0x7f153c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:08.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15422cd640 1 -- 172.21.15.181:0/2071978227 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153c0ced20 con 0x7f153c15b1e0 2024-09-12T02:32:08.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15412cb640 1 -- 172.21.15.181:0/2071978227 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455630939 0 0) 0x7f153c0ce480 con 0x7f153c0b2490 2024-09-12T02:32:08.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15422cd640 1 --2- 172.21.15.181:0/2071978227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c15b1e0 0x7f153c0b3c90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f153802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dab7ed7357d0c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15412cb640 1 -- 172.21.15.181:0/2071978227 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538037070 con 0x7f153c15b1e0 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15412cb640 1 -- 172.21.15.181:0/2071978227 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1538032440 con 0x7f153c15b1e0 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.356+0000 7f15412cb640 1 -- 172.21.15.181:0/2071978227 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538032810 con 0x7f153c15b1e0 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.357+0000 7f1544531640 1 -- 172.21.15.181:0/2071978227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c15b1e0 msgr2=0x7f153c0b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.357+0000 7f1544531640 1 --2- 172.21.15.181:0/2071978227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c15b1e0 0x7f153c0b3c90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f15380097a0 tx=0x7f153802a230 comp rx=0 tx=0).stop 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.357+0000 7f1544531640 1 -- 172.21.15.181:0/2071978227 shutdown_connections 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.357+0000 7f1544531640 1 --2- 172.21.15.181:0/2071978227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c15b1e0 0x7f153c0b3c90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.357+0000 7f1544531640 1 -- 172.21.15.181:0/2071978227 >> 172.21.15.181:0/2071978227 conn(0x7f153c06bc10 msgr2=0x7f153c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.357+0000 7f1544531640 1 -- 172.21.15.181:0/2071978227 shutdown_connections 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.357+0000 7f1544531640 1 -- 172.21.15.181:0/2071978227 wait complete. 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.358+0000 7f1544531640 1 Processor -- start 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.358+0000 7f1544531640 1 -- start start 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1544531640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c0b2490 0x7f153c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1544531640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f153c0b41d0 0x7f153c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1544531640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f153c15b1e0 0x7f153c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1544531640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f153c0cdfc0 con 0x7f153c0b2490 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1544531640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f153c071130 con 0x7f153c0b41d0 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1544531640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f153c0ce140 con 0x7f153c15b1e0 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c0b2490 0x7f153c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c0b2490 0x7f153c159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44420/0 (socket says 172.21.15.181:44420) 2024-09-12T02:32:08.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 -- 172.21.15.181:0/509759950 learned_addr learned my addr 172.21.15.181:0/509759950 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1542ace640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f153c15b1e0 0x7f153c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f1541acc640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f153c0b41d0 0x7f153c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 -- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f153c15b1e0 msgr2=0x7f153c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f153c15b1e0 0x7f153c0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 -- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f153c0b41d0 msgr2=0x7f153c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f153c0b41d0 0x7f153c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 -- 172.21.15.181:0/509759950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153c154820 con 0x7f153c0b2490 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.359+0000 7f15422cd640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c0b2490 0x7f153c159330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f15380098c0 tx=0x7f15380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.360+0000 7f1532ffd640 1 -- 172.21.15.181:0/509759950 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538037040 con 0x7f153c0b2490 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.360+0000 7f1532ffd640 1 -- 172.21.15.181:0/509759950 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1538042070 con 0x7f153c0b2490 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.360+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153c154b00 con 0x7f153c0b2490 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.360+0000 7f1532ffd640 1 -- 172.21.15.181:0/509759950 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538030a70 con 0x7f153c0b2490 2024-09-12T02:32:08.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.360+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f153c159910 con 0x7f153c0b2490 2024-09-12T02:32:08.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.361+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f153c0b30f0 con 0x7f153c0b2490 2024-09-12T02:32:08.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.361+0000 7f1532ffd640 1 -- 172.21.15.181:0/509759950 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1538030c10 con 0x7f153c0b2490 2024-09-12T02:32:08.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.362+0000 7f1532ffd640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f152006be30 0x7f152006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:08.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.362+0000 7f1541acc640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f152006be30 0x7f152006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:08.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.362+0000 7f1532ffd640 1 -- 172.21.15.181:0/509759950 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f15380ab9f0 con 0x7f153c0b2490 2024-09-12T02:32:08.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.362+0000 7f1541acc640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f152006be30 0x7f152006e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f153c15e500 tx=0x7f152c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:08.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.366+0000 7f1532ffd640 1 -- 172.21.15.181:0/509759950 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f153c0b30f0 con 0x7f153c0b2490 2024-09-12T02:32:08.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.567+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f153c158900 con 0x7f153c0b2490 2024-09-12T02:32:08.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.567+0000 7f1532ffd640 1 -- 172.21.15.181:0/509759950 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5230 (secure 0 0 0) 0x7f153807a310 con 0x7f153c0b2490 2024-09-12T02:32:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:32:08.569 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":33,"btime":"2024-09-12T02:32:08:511621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:32:07.512666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.181:6837/3622686732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3622686732},{"type":"v1","addr":"172.21.15.181:6837","nonce":3622686732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-12T02:32:08.569 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 33 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f152006be30 msgr2=0x7f152006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f152006be30 0x7f152006e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f153c15e500 tx=0x7f152c009040 comp rx=0 tx=0).stop 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c0b2490 msgr2=0x7f153c159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c0b2490 0x7f153c159330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f15380098c0 tx=0x7f15380046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 shutdown_connections 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f152006be30 0x7f152006e2f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f153c0b41d0 0x7f153c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f153c15b1e0 0x7f153c0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 --2- 172.21.15.181:0/509759950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f153c0b2490 0x7f153c159330 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 >> 172.21.15.181:0/509759950 conn(0x7f153c06bc10 msgr2=0x7f153c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 shutdown_connections 2024-09-12T02:32:08.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:08.570+0000 7f1544531640 1 -- 172.21.15.181:0/509759950 wait complete. 2024-09-12T02:32:08.984 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:51.939812+0000', 'modified': '2024-09-12T02:32:07.512666+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 48, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5571': {'gid': 5571, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:rejoin', 'state_seq': 17, 'addr': '172.21.15.181:6837/3622686732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3622686732}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3622686732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:32:08.984 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5571:up:rejoin 2024-09-12T02:32:09.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:32:10.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.095+0000 7ff4fb74b640 1 Processor -- start 2024-09-12T02:32:10.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.096+0000 7ff4fb74b640 1 -- start start 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.096+0000 7ff4fb74b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff4f415e640 0x7ff4f40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.096+0000 7ff4fb74b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4f40cf0e0 0x7ff4f40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.096+0000 7ff4fb74b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40b2cf0 0x7ff4f40b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.096+0000 7ff4fb74b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f40b2860 con 0x7ff4f40cf0e0 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.096+0000 7ff4fb74b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f415ea20 con 0x7ff4f415e640 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.096+0000 7ff4fb74b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f40b1c50 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4f40cf0e0 0x7ff4f40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4f40cf0e0 0x7ff4f40cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49090/0 (socket says 172.21.15.181:49090) 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 -- 172.21.15.181:0/2175202559 learned_addr learned my addr 172.21.15.181:0/2175202559 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f94e7640 1 --2- 172.21.15.181:0/2175202559 >> v2:172.21.15.204:3300/0 conn(0x7ff4f415e640 0x7ff4f40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f9ce8640 1 --2- 172.21.15.181:0/2175202559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40b2cf0 0x7ff4f40b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 -- 172.21.15.181:0/2175202559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40b2cf0 msgr2=0x7ff4f40b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 --2- 172.21.15.181:0/2175202559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40b2cf0 0x7ff4f40b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 -- 172.21.15.181:0/2175202559 >> v2:172.21.15.204:3300/0 conn(0x7ff4f415e640 msgr2=0x7ff4f40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 --2- 172.21.15.181:0/2175202559 >> v2:172.21.15.204:3300/0 conn(0x7ff4f415e640 0x7ff4f40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.097+0000 7ff4f8ce6640 1 -- 172.21.15.181:0/2175202559 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f40b1f30 con 0x7ff4f40cf0e0 2024-09-12T02:32:10.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4f8ce6640 1 --2- 172.21.15.181:0/2175202559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40cf0e0 0x7ff4f40cf550 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff4f408d4c0 tx=0x7ff4e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d16e2d0dee4ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4ebfff640 1 -- 172.21.15.181:0/2175202559 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4037070 con 0x7ff4f40cf0e0 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4ebfff640 1 -- 172.21.15.181:0/2175202559 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e4032440 con 0x7ff4f40cf0e0 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4ebfff640 1 -- 172.21.15.181:0/2175202559 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4032810 con 0x7ff4f40cf0e0 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4fb74b640 1 -- 172.21.15.181:0/2175202559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40cf0e0 msgr2=0x7ff4f40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/2175202559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40cf0e0 0x7ff4f40cf550 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff4f408d4c0 tx=0x7ff4e402a140 comp rx=0 tx=0).stop 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4fb74b640 1 -- 172.21.15.181:0/2175202559 shutdown_connections 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/2175202559 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40b2cf0 0x7ff4f40b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/2175202559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40cf0e0 0x7ff4f40cf550 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/2175202559 >> v2:172.21.15.204:3300/0 conn(0x7ff4f415e640 0x7ff4f40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.098+0000 7ff4fb74b640 1 -- 172.21.15.181:0/2175202559 >> 172.21.15.181:0/2175202559 conn(0x7ff4f409d820 msgr2=0x7ff4f40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.099+0000 7ff4fb74b640 1 -- 172.21.15.181:0/2175202559 shutdown_connections 2024-09-12T02:32:10.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.099+0000 7ff4fb74b640 1 -- 172.21.15.181:0/2175202559 wait complete. 2024-09-12T02:32:10.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 Processor -- start 2024-09-12T02:32:10.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 -- start start 2024-09-12T02:32:10.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40b2cf0 0x7ff4f40c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40cf0e0 0x7ff4f4150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4f415e640 0x7ff4f40b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40cfe40 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40b24f0 con 0x7ff4f415e640 2024-09-12T02:32:10.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.100+0000 7ff4fb74b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f40b73a0 con 0x7ff4f40cf0e0 2024-09-12T02:32:10.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40b2cf0 0x7ff4f40c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40b2cf0 0x7ff4f40c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49096/0 (socket says 172.21.15.181:49096) 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 -- 172.21.15.181:0/307988923 learned_addr learned my addr 172.21.15.181:0/307988923 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f9ce8640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4f415e640 0x7ff4f40b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f8ce6640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40cf0e0 0x7ff4f4150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 -- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40cf0e0 msgr2=0x7ff4f4150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40cf0e0 0x7ff4f4150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 -- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4f415e640 msgr2=0x7ff4f40b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4f415e640 0x7ff4f40b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 -- 172.21.15.181:0/307988923 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f4150dc0 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4f94e7640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40b2cf0 0x7ff4f40c8d30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e870 tx=0x7ff4f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4e9ffb640 1 -- 172.21.15.181:0/307988923 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0017070 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4e9ffb640 1 -- 172.21.15.181:0/307988923 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f000c940 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f40b5d70 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4e9ffb640 1 -- 172.21.15.181:0/307988923 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000cd30 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.101+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f40b3220 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.102+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f4068eb0 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.103+0000 7ff4e9ffb640 1 -- 172.21.15.181:0/307988923 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4f001a070 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.103+0000 7ff4e9ffb640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.103+0000 7ff4e9ffb640 1 -- 172.21.15.181:0/307988923 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7ff4f008acf0 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.103+0000 7ff4f8ce6640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.104+0000 7ff4f8ce6640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff4d806be30 0x7ff4d806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4034000 tx=0x7ff4e402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.108+0000 7ff4e9ffb640 1 -- 172.21.15.181:0/307988923 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4f008f070 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.306+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4f40d3150 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.306+0000 7ff4e9ffb640 1 -- 172.21.15.181:0/307988923 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5237 (secure 0 0 0) 0x7ff4f0058fc0 con 0x7ff4f40b2cf0 2024-09-12T02:32:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:32:10.307 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":34,"btime":"2024-09-12T02:32:09:515654+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:32:09.515645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":18,"addr":"172.21.15.181:6837/3622686732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3622686732},{"type":"v1","addr":"172.21.15.181:6837","nonce":3622686732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5571,"qdb_cluster":[5571]},"id":3}]} 2024-09-12T02:32:10.308 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 34 2024-09-12T02:32:10.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff4d806be30 msgr2=0x7ff4d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff4d806be30 0x7ff4d806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4034000 tx=0x7ff4e402e000 comp rx=0 tx=0).stop 2024-09-12T02:32:10.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40b2cf0 msgr2=0x7ff4f40c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40b2cf0 0x7ff4f40c8d30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e870 tx=0x7ff4f000ed30 comp rx=0 tx=0).stop 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 shutdown_connections 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff4f415e640 0x7ff4f40b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff4f40cf0e0 0x7ff4f4150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 --2- 172.21.15.181:0/307988923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4f40b2cf0 0x7ff4f40c8d30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 >> 172.21.15.181:0/307988923 conn(0x7ff4f409d820 msgr2=0x7ff4f40b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 shutdown_connections 2024-09-12T02:32:10.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.308+0000 7ff4fb74b640 1 -- 172.21.15.181:0/307988923 wait complete. 2024-09-12T02:32:10.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:29:51.939812+0000', 'modified': '2024-09-12T02:32:09.515645+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 48, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5571': {'gid': 5571, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.181:6837/3622686732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3622686732}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3622686732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5571, 'qdb_cluster': [5571]} 2024-09-12T02:32:10.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:32:10.723 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:32:10.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.823+0000 7f505ef4b640 1 Processor -- start 2024-09-12T02:32:10.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.823+0000 7f505ef4b640 1 -- start start 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.824+0000 7f505ef4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5058156990 0x7f50580cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.824+0000 7f505ef4b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50580cd6b0 0x7f50580b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.824+0000 7f505ef4b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50580ce160 con 0x7f50580b22c0 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.824+0000 7f505ef4b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5058156d70 con 0x7f50580cd6b0 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.824+0000 7f505ef4b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f50580cdb10 con 0x7f5058156990 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f505cce7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5058156990 0x7f50580cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f5057fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50580cd6b0 0x7f50580b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f505d4e8640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f50580b22c0 0x7f505815fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:49314/0 (socket says 172.21.15.181:49314) 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f505d4e8640 1 -- 172.21.15.181:0/665173859 learned_addr learned my addr 172.21.15.181:0/665173859 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:32:10.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f50577fe640 1 -- 172.21.15.181:0/665173859 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874698247 0 0) 0x7f50580ce160 con 0x7f50580b22c0 2024-09-12T02:32:10.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f50577fe640 1 -- 172.21.15.181:0/665173859 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5044003520 con 0x7f50580b22c0 2024-09-12T02:32:10.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f505cce7640 1 -- 172.21.15.181:0/665173859 >> v2:172.21.15.204:3300/0 conn(0x7f50580cd6b0 msgr2=0x7f50580b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f505cce7640 1 --2- 172.21.15.181:0/665173859 >> v2:172.21.15.204:3300/0 conn(0x7f50580cd6b0 0x7f50580b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f505cce7640 1 -- 172.21.15.181:0/665173859 >> v1:172.21.15.204:6789/0 conn(0x7f50580b22c0 legacy=0x7f505815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f505cce7640 1 -- 172.21.15.181:0/665173859 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50580731f0 con 0x7f5058156990 2024-09-12T02:32:10.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.825+0000 7f5057fff640 1 --2- 172.21.15.181:0/665173859 >> v2:172.21.15.204:3300/0 conn(0x7f50580cd6b0 0x7f50580b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:10.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505cce7640 1 --2- 172.21.15.181:0/665173859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5058156990 0x7f50580cd170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5048009d90 tx=0x7f504802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f763d7859a332ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f50577fe640 1 -- 172.21.15.181:0/665173859 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048031600 con 0x7f5058156990 2024-09-12T02:32:10.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f50577fe640 1 -- 172.21.15.181:0/665173859 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50480317a0 con 0x7f5058156990 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f50577fe640 1 -- 172.21.15.181:0/665173859 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048031b50 con 0x7f5058156990 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 -- 172.21.15.181:0/665173859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5058156990 msgr2=0x7f50580cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 --2- 172.21.15.181:0/665173859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5058156990 0x7f50580cd170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5048009d90 tx=0x7f504802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 -- 172.21.15.181:0/665173859 shutdown_connections 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 --2- 172.21.15.181:0/665173859 >> v2:172.21.15.204:3300/0 conn(0x7f50580cd6b0 0x7f50580b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 --2- 172.21.15.181:0/665173859 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5058156990 0x7f50580cd170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 -- 172.21.15.181:0/665173859 >> 172.21.15.181:0/665173859 conn(0x7f505806bc10 msgr2=0x7f505806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 -- 172.21.15.181:0/665173859 shutdown_connections 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.826+0000 7f505ef4b640 1 -- 172.21.15.181:0/665173859 wait complete. 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 Processor -- start 2024-09-12T02:32:10.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 -- start start 2024-09-12T02:32:10.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50580b22c0 0x7f50580cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580cd6b0 0x7f50580c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5058156990 0x7f50580c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f50580ce720 con 0x7f50580b22c0 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f50580cea90 con 0x7f5058156990 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.828+0000 7f505ef4b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f50580b26f0 con 0x7f50580cd6b0 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50580b22c0 0x7f50580cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50580b22c0 0x7f50580cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49112/0 (socket says 172.21.15.181:49112) 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 -- 172.21.15.181:0/3246515686 learned_addr learned my addr 172.21.15.181:0/3246515686 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f5057fff640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580cd6b0 0x7f50580c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505d4e8640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5058156990 0x7f50580c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 -- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580cd6b0 msgr2=0x7f50580c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580cd6b0 0x7f50580c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 -- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5058156990 msgr2=0x7f50580c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5058156990 0x7f50580c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 -- 172.21.15.181:0/3246515686 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50580c76a0 con 0x7f50580b22c0 2024-09-12T02:32:10.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505cce7640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50580b22c0 0x7f50580cbd60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f504802abc0 tx=0x7f5048004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f50557fa640 1 -- 172.21.15.181:0/3246515686 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504803f070 con 0x7f50580b22c0 2024-09-12T02:32:10.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f50557fa640 1 -- 172.21.15.181:0/3246515686 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048030830 con 0x7f50580b22c0 2024-09-12T02:32:10.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f50557fa640 1 -- 172.21.15.181:0/3246515686 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048030c00 con 0x7f50580b22c0 2024-09-12T02:32:10.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50580c7980 con 0x7f50580b22c0 2024-09-12T02:32:10.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.829+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50580c7f40 con 0x7f50580b22c0 2024-09-12T02:32:10.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.831+0000 7f50557fa640 1 -- 172.21.15.181:0/3246515686 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f504803b410 con 0x7f50580b22c0 2024-09-12T02:32:10.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.831+0000 7f50557fa640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503806be60 0x7f503806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.831+0000 7f50557fa640 1 -- 172.21.15.181:0/3246515686 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f50480ac220 con 0x7f50580b22c0 2024-09-12T02:32:10.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.831+0000 7f5057fff640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503806be60 0x7f503806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.832+0000 7f5057fff640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503806be60 0x7f503806e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5040009560 tx=0x7f5040009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.832+0000 7f5061dc7740 1 Processor -- start 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.832+0000 7f5061dc7740 1 -- start start 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 0x556c112efa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112a7a80 0x556c112aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aba50 0x556c112a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f5061dc7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556c1120c520 con 0x556c112aba50 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x556c111b43e0 con 0x556c112a7a80 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x556c112084e0 con 0x556c112aa2c0 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aba50 0x556c112a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aba50 0x556c112a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49124/0 (socket says 172.21.15.181:49124) 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 -- 172.21.15.181:0/1960373111 learned_addr learned my addr 172.21.15.181:0/1960373111 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 -- 172.21.15.181:0/1960373111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 msgr2=0x556c112efa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 0x556c112efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 -- 172.21.15.181:0/1960373111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112a7a80 msgr2=0x556c112aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f5057fff640 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112a7a80 0x556c112aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112a7a80 0x556c112aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.833+0000 7f505d4e8640 1 -- 172.21.15.181:0/1960373111 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c111cf2f0 con 0x556c112aba50 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f505d4e8640 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aba50 0x556c112a48b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f50500018b0 tx=0x7f5050000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1774c2438752138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f504e7fc640 1 -- 172.21.15.181:0/1960373111 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050005ac0 con 0x556c112aba50 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f504e7fc640 1 -- 172.21.15.181:0/1960373111 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5050018070 con 0x556c112aba50 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f504e7fc640 1 -- 172.21.15.181:0/1960373111 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050005e60 con 0x556c112aba50 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 -- 172.21.15.181:0/1960373111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aba50 msgr2=0x556c112a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aba50 0x556c112a48b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f50500018b0 tx=0x7f5050000bc0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 -- 172.21.15.181:0/1960373111 shutdown_connections 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112a7a80 0x556c112aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aba50 0x556c112a48b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 --2- 172.21.15.181:0/1960373111 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 0x556c112efa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 -- 172.21.15.181:0/1960373111 >> 172.21.15.181:0/1960373111 conn(0x556c112a6a80 msgr2=0x556c112eef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 -- 172.21.15.181:0/1960373111 shutdown_connections 2024-09-12T02:32:10.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.834+0000 7f5061dc7740 1 -- 172.21.15.181:0/1960373111 wait complete. 2024-09-12T02:32:10.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.835+0000 7f5061dc7740 1 -- start start 2024-09-12T02:32:10.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.835+0000 7f5061dc7740 1 Processor -- start 2024-09-12T02:32:10.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 0x556c112d4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 0x556c112d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112ffdf0 0x556c112d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5061dc7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556c112a5f20 con 0x556c112ffdf0 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x556c11195450 con 0x556c112aba50 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x556c112f0290 con 0x556c112aa2c0 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5061dc7740 10 client.0 _ll_register_callbacks cb 0x556c10f1eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112ffdf0 0x556c112d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112ffdf0 0x556c112d3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49132/0 (socket says 172.21.15.181:49132) 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 -- 172.21.15.181:0/3328822950 learned_addr learned my addr 172.21.15.181:0/3328822950 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f5057fff640 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 0x556c112d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505cce7640 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 0x556c112d4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 -- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 msgr2=0x556c112d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 0x556c112d4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 -- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 msgr2=0x556c112d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 0x556c112d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.836+0000 7f505d4e8640 1 -- 172.21.15.181:0/3328822950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c10f1f2d0 con 0x556c112ffdf0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f505d4e8640 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112ffdf0 0x556c112d3170 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f505000f5a0 tx=0x7f50500010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48584d79992ce26d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f50377fe640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f50377fe640 1 -- 172.21.15.181:0/3328822950 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050010e60 con 0x556c112ffdf0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f50377fe640 1 -- 172.21.15.181:0/3328822950 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f5050028b70 con 0x556c112ffdf0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5050018070 con 0x556c112ffdf0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f50377fe640 1 -- 172.21.15.181:0/3328822950 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f505002f050 con 0x556c112ffdf0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 10 client.5976 fetch_fsmap learned FSMap version 34 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x556c10fe96b0 con 0x556c112ffdf0 2024-09-12T02:32:10.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f50377fe640 1 -- 172.21.15.181:0/3328822950 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5050018070 con 0x556c112ffdf0 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f50377fe640 1 -- 172.21.15.181:0/3328822950 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f5050032020 con 0x556c112ffdf0 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 10 client.5976 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 10 client.5976 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 20 client.5976 populate_metadata read hostname 'smithi181' 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112d6980 0x556c11302720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 4 client.5976 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 --> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c11219c50 con 0x556c112d6980 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f505cce7640 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112d6980 0x556c11302720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f50377fe640 10 client.5976 ms_handle_connect on v2:172.21.15.181:6836/3622686732 2024-09-12T02:32:10.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.837+0000 7f505cce7640 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112d6980 0x556c11302720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd77c15bac931a32 server_cookie=c21bba1d4c43fafa in_seq=0 out_seq=0 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f50377fe640 1 -- 172.21.15.181:0/3328822950 <== mds.0 v2:172.21.15.181:6836/3622686732 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c11219c50 con 0x556c112d6980 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f50377fe640 10 client.5976 handle_command_reply: tid=0 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 client.5976 shutdown 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112ffdf0 msgr2=0x556c112d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112ffdf0 0x556c112d3170 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f505000f5a0 tx=0x7f50500010a0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 shutdown_connections 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112d6980 0x556c11302720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 0x556c112d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112ffdf0 0x556c112d3170 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f50377fe640 0 client.5976 ms_handle_reset on v2:172.21.15.181:6836/3622686732 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 --2- 172.21.15.181:0/3328822950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aa2c0 0x556c112d4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 >> 172.21.15.181:0/3328822950 conn(0x556c112a7a80 msgr2=0x556c112f2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 shutdown_connections 2024-09-12T02:32:10.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.838+0000 7f5061dc7740 1 -- 172.21.15.181:0/3328822950 wait complete. 2024-09-12T02:32:10.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.839+0000 7f5061dc7740 20 client.5976 trim_cache size 0 max 16384 2024-09-12T02:32:10.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.856+0000 7f5061dc7740 1 Processor -- start 2024-09-12T02:32:10.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.856+0000 7f5061dc7740 1 -- start start 2024-09-12T02:32:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c11313030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 0x556c112f2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112ffdf0 0x556c112f2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f5061dc7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f50581fd9f0 con 0x556c112aa2c0 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f50580c5e30 con 0x556c112aba50 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f50580c9460 con 0x556c112ffdf0 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c11313030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c11313030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49146/0 (socket says 172.21.15.181:49146) 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 -- 172.21.15.181:0/2954365694 learned_addr learned my addr 172.21.15.181:0/2954365694 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 -- 172.21.15.181:0/2954365694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112ffdf0 msgr2=0x556c112f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 --2- 172.21.15.181:0/2954365694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112ffdf0 0x556c112f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 -- 172.21.15.181:0/2954365694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 msgr2=0x556c112f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 --2- 172.21.15.181:0/2954365694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 0x556c112f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 -- 172.21.15.181:0/2954365694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c112d0020 con 0x556c112aa2c0 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.857+0000 7f505cce7640 1 --2- 172.21.15.181:0/2954365694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c11313030 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5048009810 tx=0x7f504803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b737f2dc9a4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f504dffb640 1 -- 172.21.15.181:0/2954365694 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048092070 con 0x556c112aa2c0 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f504dffb640 1 -- 172.21.15.181:0/2954365694 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048031730 con 0x556c112aa2c0 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f504dffb640 1 -- 172.21.15.181:0/2954365694 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048030da0 con 0x556c112aa2c0 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 -- 172.21.15.181:0/2954365694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 msgr2=0x556c11313030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2954365694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c11313030 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5048009810 tx=0x7f504803e000 comp rx=0 tx=0).stop 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 -- 172.21.15.181:0/2954365694 shutdown_connections 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2954365694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112aba50 0x556c112f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2954365694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112ffdf0 0x556c112f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2954365694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c11313030 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 -- 172.21.15.181:0/2954365694 >> 172.21.15.181:0/2954365694 conn(0x556c112a7a80 msgr2=0x556c112ab2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 -- 172.21.15.181:0/2954365694 shutdown_connections 2024-09-12T02:32:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.858+0000 7f5061dc7740 1 -- 172.21.15.181:0/2954365694 wait complete. 2024-09-12T02:32:10.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.859+0000 7f5061dc7740 1 -- start start 2024-09-12T02:32:10.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.859+0000 7f5061dc7740 1 Processor -- start 2024-09-12T02:32:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c112ed930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aba50 0x556c11354650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112ffdf0 0x556c113751b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556c112d36b0 con 0x556c112aa2c0 2024-09-12T02:32:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x556c112d5d10 con 0x556c112ffdf0 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x556c112d7210 con 0x556c112aba50 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 10 client.0 _ll_register_callbacks cb 0x7f5050001720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c112ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c112ed930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49156/0 (socket says 172.21.15.181:49156) 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 -- 172.21.15.181:0/2210961289 learned_addr learned my addr 172.21.15.181:0/2210961289 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5057fff640 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aba50 0x556c11354650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 -- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aba50 msgr2=0x556c11354650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aba50 0x556c11354650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505d4e8640 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112ffdf0 0x556c113751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 -- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112ffdf0 msgr2=0x556c113751b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112ffdf0 0x556c113751b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 -- 172.21.15.181:0/2210961289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c112d1430 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f505cce7640 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c112ed930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f504807d040 tx=0x7f5050012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f6c0b549f46159 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f50377fe640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f50377fe640 1 -- 172.21.15.181:0/2210961289 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504809e060 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f50377fe640 1 -- 172.21.15.181:0/2210961289 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f5048078880 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5048031730 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.860+0000 7f50377fe640 1 -- 172.21.15.181:0/2210961289 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5048092040 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 10 client.5982 fetch_fsmap learned FSMap version 34 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x556c112ed130 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f50377fe640 1 -- 172.21.15.181:0/2210961289 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048031730 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f50377fe640 1 -- 172.21.15.181:0/2210961289 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f5048076bf0 con 0x556c112aa2c0 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 10 client.5982 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T02:32:10.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 10 client.5982 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 20 client.5982 populate_metadata read hostname 'smithi181' 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112f0ca0 0x556c112f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 4 client.5982 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 --> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] -- command(tid 0: {"prefix": "status"}) -- 0x556c11213fa0 con 0x556c112f0ca0 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5057fff640 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112f0ca0 0x556c112f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f50377fe640 10 client.5982 ms_handle_connect on v2:172.21.15.181:6836/3622686732 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5057fff640 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112f0ca0 0x556c112f1080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe94506bfc0a5a7d server_cookie=4b88f42c6a8aae71 in_seq=0 out_seq=0 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f50377fe640 1 -- 172.21.15.181:0/2210961289 <== mds.0 v2:172.21.15.181:6836/3622686732 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556c11213fa0 con 0x556c112f0ca0 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f50377fe640 10 client.5982 handle_command_reply: tid=0 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.861+0000 7f5061dc7740 1 client.5982 shutdown 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 msgr2=0x556c112ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c112ed930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f504807d040 tx=0x7f5050012000 comp rx=0 tx=0).stop 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 shutdown_connections 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:6836/3622686732,v1:172.21.15.181:6837/3622686732] conn(0x556c112f0ca0 0x556c112f1080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x556c112ffdf0 0x556c113751b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x556c112aba50 0x556c11354650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 --2- 172.21.15.181:0/2210961289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c112aa2c0 0x556c112ed930 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f50377fe640 0 client.5982 ms_handle_reset on v2:172.21.15.181:6836/3622686732 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 >> 172.21.15.181:0/2210961289 conn(0x556c112a7a80 msgr2=0x556c1129fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 shutdown_connections 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 1 -- 172.21.15.181:0/2210961289 wait complete. 2024-09-12T02:32:10.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f5061dc7740 20 client.5982 trim_cache size 0 max 16384 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 5571, 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 4.3537715759999998, 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 34, 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 48, 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 48, 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 63.399182631999999 2024-09-12T02:32:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:32:10.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503806be60 msgr2=0x7f503806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503806be60 0x7f503806e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5040009560 tx=0x7f5040009190 comp rx=0 tx=0).stop 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50580b22c0 msgr2=0x7f50580cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50580b22c0 0x7f50580cbd60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f504802abc0 tx=0x7f5048004a40 comp rx=0 tx=0).stop 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 shutdown_connections 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f503806be60 0x7f503806e320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5058156990 0x7f50580c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580cd6b0 0x7f50580c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 --2- 172.21.15.181:0/3246515686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50580b22c0 0x7f50580cbd60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 >> 172.21.15.181:0/3246515686 conn(0x7f505806bc10 msgr2=0x7f505806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 shutdown_connections 2024-09-12T02:32:10.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.862+0000 7f505ef4b640 1 -- 172.21.15.181:0/3246515686 wait complete. 2024-09-12T02:32:10.874 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:32:10.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.971+0000 7fe609653640 1 Processor -- start 2024-09-12T02:32:10.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.971+0000 7fe609653640 1 -- start start 2024-09-12T02:32:10.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe609653640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe6040cf2b0 0x7fe6040d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe609653640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf720 0x7fe6040d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe609653640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60415ea20 con 0x7fe60415e640 2024-09-12T02:32:10.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe609653640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe6040b3d00 con 0x7fe6040cf2b0 2024-09-12T02:32:10.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe609653640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040b2860 con 0x7fe6040cf720 2024-09-12T02:32:10.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe5fa7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe6040cf2b0 0x7fe6040d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe5fa7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe6040cf2b0 0x7fe6040d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49166/0 (socket says 172.21.15.181:49166) 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.972+0000 7fe5fa7fc640 1 -- 172.21.15.181:0/571405286 learned_addr learned my addr 172.21.15.181:0/571405286 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe6037fe640 1 --2- 172.21.15.181:0/571405286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf720 0x7fe6040d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe5fa7fc640 1 -- 172.21.15.181:0/571405286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf720 msgr2=0x7fe6040d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe5fa7fc640 1 --2- 172.21.15.181:0/571405286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf720 0x7fe6040d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe5fa7fc640 1 -- 172.21.15.181:0/571405286 >> v1:172.21.15.204:6789/0 conn(0x7fe60415e640 legacy=0x7fe6040ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe5fa7fc640 1 -- 172.21.15.181:0/571405286 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6040b1c50 con 0x7fe6040cf2b0 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe5fa7fc640 1 --2- 172.21.15.181:0/571405286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cf2b0 0x7fe6040d2650 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009870 tx=0x7fe5ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea016f136044d84e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe6027fc640 1 -- 172.21.15.181:0/571405286 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec037070 con 0x7fe6040cf2b0 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe6027fc640 1 -- 172.21.15.181:0/571405286 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5ec032440 con 0x7fe6040cf2b0 2024-09-12T02:32:10.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.973+0000 7fe6027fc640 1 -- 172.21.15.181:0/571405286 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec032810 con 0x7fe6040cf2b0 2024-09-12T02:32:10.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 -- 172.21.15.181:0/571405286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cf2b0 msgr2=0x7fe6040d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 --2- 172.21.15.181:0/571405286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cf2b0 0x7fe6040d2650 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009870 tx=0x7fe5ec02a180 comp rx=0 tx=0).stop 2024-09-12T02:32:10.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 -- 172.21.15.181:0/571405286 shutdown_connections 2024-09-12T02:32:10.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 --2- 172.21.15.181:0/571405286 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf720 0x7fe6040d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 --2- 172.21.15.181:0/571405286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cf2b0 0x7fe6040d2650 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 -- 172.21.15.181:0/571405286 >> 172.21.15.181:0/571405286 conn(0x7fe60409d820 msgr2=0x7fe6040d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 -- 172.21.15.181:0/571405286 shutdown_connections 2024-09-12T02:32:10.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.974+0000 7fe609653640 1 -- 172.21.15.181:0/571405286 wait complete. 2024-09-12T02:32:10.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.975+0000 7fe609653640 1 Processor -- start 2024-09-12T02:32:10.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.975+0000 7fe609653640 1 -- start start 2024-09-12T02:32:10.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe609653640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf2b0 0x7fe60414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe609653640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6040cf720 0x7fe604160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe609653640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe60415e640 0x7fe604160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe609653640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040b24f0 con 0x7fe60415e640 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe609653640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040b2210 con 0x7fe6040cf720 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe609653640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040cfe40 con 0x7fe6040cf2b0 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe6037fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe60415e640 0x7fe604160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe6037fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe60415e640 0x7fe604160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49170/0 (socket says 172.21.15.181:49170) 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe6037fe640 1 -- 172.21.15.181:0/3074181275 learned_addr learned my addr 172.21.15.181:0/3074181275 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe5fa7fc640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6040cf720 0x7fe604160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe602ffd640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf2b0 0x7fe60414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.976+0000 7fe6037fe640 1 -- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf2b0 msgr2=0x7fe60414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe6037fe640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf2b0 0x7fe60414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe6037fe640 1 -- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6040cf720 msgr2=0x7fe604160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe6037fe640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6040cf720 0x7fe604160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe6037fe640 1 -- 172.21.15.181:0/3074181275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe604161060 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe602ffd640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf2b0 0x7fe60414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe6037fe640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe60415e640 0x7fe604160a50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00cc60 tx=0x7fe5fc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe5fbfff640 1 -- 172.21.15.181:0/3074181275 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc003990 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe5fbfff640 1 -- 172.21.15.181:0/3074181275 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5fc003b30 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe5fbfff640 1 -- 172.21.15.181:0/3074181275 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc004020 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe604161340 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.977+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe604161900 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.978+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe604068eb0 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.978+0000 7fe5fbfff640 1 -- 172.21.15.181:0/3074181275 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5fc0041c0 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.979+0000 7fe5fbfff640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5e406be30 0x7fe5e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.979+0000 7fe5fbfff640 1 -- 172.21.15.181:0/3074181275 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7fe5fc08b350 con 0x7fe60415e640 2024-09-12T02:32:10.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.979+0000 7fe602ffd640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5e406be30 0x7fe5e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.979+0000 7fe602ffd640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5e406be30 0x7fe5e406e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4003eb0 tx=0x7fe5f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:10.983+0000 7fe5fbfff640 1 -- 172.21.15.181:0/3074181275 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5fc014030 con 0x7fe60415e640 2024-09-12T02:32:11.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.182+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe60406be60 con 0x7fe60415e640 2024-09-12T02:32:11.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.182+0000 7fe5fbfff640 1 -- 172.21.15.181:0/3074181275 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7fe5fc059ca0 con 0x7fe60415e640 2024-09-12T02:32:11.183 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:32:11.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5e406be30 msgr2=0x7fe5e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:11.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5e406be30 0x7fe5e406e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4003eb0 tx=0x7fe5f4009040 comp rx=0 tx=0).stop 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe60415e640 msgr2=0x7fe604160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe60415e640 0x7fe604160a50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00cc60 tx=0x7fe5fc00a5c0 comp rx=0 tx=0).stop 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 shutdown_connections 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5e406be30 0x7fe5e406e2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6040cf720 0x7fe604160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe60415e640 0x7fe604160a50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 --2- 172.21.15.181:0/3074181275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040cf2b0 0x7fe60414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 >> 172.21.15.181:0/3074181275 conn(0x7fe60409d820 msgr2=0x7fe6040ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 shutdown_connections 2024-09-12T02:32:11.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11.184+0000 7fe609653640 1 -- 172.21.15.181:0/3074181275 wait complete. 2024-09-12T02:32:11.196 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:32:11.196 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:32:11.196 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:32:11.197 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:32:11.197 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:11.197 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:32:11.197 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:32:11.197 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:32:11.197 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:32:11.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:11.197 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:32:11.213 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:32:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:32:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:32:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:32:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:32:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42512sec preferred_lft 42512sec 2024-09-12T02:32:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:32:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:32:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:32:11.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:11.216 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:32:11.276 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:32:11.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:11.278 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:32:11.335 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:32:11.335 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:32:11.335 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:32:11.335 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:32:11.335 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:32:11.336 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:32:11.336 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:32:11.336 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:32:11.336 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:32:11.336 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:32:11.336 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:32:11.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:32:11.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:32:11.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:11.462 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:32:11.478 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:32:11.478 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:32:11.478 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:32:11.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:11.479 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:32:11.543 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:32:11.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:32:11.544 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:11.599 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:32:11.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:32:11.599 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:11.655 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:32:11.721 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:32:11.777 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:32:11.778 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:32:11.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:11.780 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:32:11.831 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:32:11.832 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:32:11.874 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:32:11.898 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:32:11.954 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:32:11.955 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:32:11.956 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:32:11.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:11.957 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:32:11.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:32:11.955+0000 7f3b8195d480 -1 init, newargv = 0x55c541d5aae0 newargc=15 2024-09-12T02:32:11.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[55219]: starting ceph client 2024-09-12T02:32:11.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[55219]: starting fuse 2024-09-12T02:32:11.972 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:32:11.973 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:32:11.973 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:32:11.974 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:32:11.975 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:32:11.975 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:32:11.975 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:32:11.975 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:32:12.090 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.55219.asok 2024-09-12T02:32:12.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:32:12.100 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55219.asok 2024-09-12T02:32:12.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:12.100 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55219.asok status 2024-09-12T02:32:12.233 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:32:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:32:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:32:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:32:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:32:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "55219", 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 5994, 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 5994 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:32:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3488982808 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3488982808 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.5994 192.168.0.1:0/3488982808", 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/3488982808", 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 34, 2024-09-12T02:32:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 48, 2024-09-12T02:32:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:32:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:32:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:32:12.236 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:32:12.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:12.242 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:32:12.242 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:12.258 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:32:12.258 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:12.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:32:12.258 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:12.323 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:32:12.323 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:32:12.323 DEBUG:teuthology.orchestra.run.smithi181:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:12.379 INFO:teuthology.orchestra.run.smithi181.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:12.379 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T02:32:12.379 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-09-12T02:32:12.379 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:32:12.379 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T02:32:12.379 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T02:32:12.380 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 02:31:06.024019493 +0000 2024-09-12T02:32:12.380 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 02:31:06.024019493 +0000 2024-09-12T02:32:12.380 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-09-12T02:32:12.380 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:32:12.380 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:32:12.449 INFO:tasks.workunit:timeout=1h 2024-09-12T02:32:12.450 INFO:tasks.workunit:cleanup=True 2024-09-12T02:32:12.450 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:32:12.505 INFO:tasks.workunit.client.0.smithi181.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:32:13.434 INFO:tasks.ceph.mds.a.smithi181.stderr:2024-09-12T02:32:13.434+0000 7f6f2d45c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:32:16.604 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:16.607 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:46.668 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:46.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:33:08.178 INFO:tasks.workunit.client.0.smithi181.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr: git switch -c 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr:Or undo this operation with: 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr: git switch - 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr: 2024-09-12T02:33:08.179 INFO:tasks.workunit.client.0.smithi181.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:33:08.183 DEBUG:teuthology.orchestra.run.smithi181:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:33:08.198 INFO:tasks.workunit.client.0.smithi181.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:33:08.201 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:33:08.201 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:33:08.249 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:33:08.296 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:33:08.336 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:33:08.337 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:33:08.337 INFO:tasks.workunit.client.0.smithi181.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:33:08.375 INFO:tasks.workunit.client.0.smithi181.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:33:08.378 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:33:08.378 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:33:08.435 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-12T02:33:08.436 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-12T02:33:08.437 DEBUG:teuthology.orchestra.run.smithi181:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-12T02:33:10.632 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:33:10.632 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:33:10.681 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-12T02:33:10.681 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:33:10.973 DEBUG:teuthology.parallel:result is None 2024-09-12T02:33:10.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:33:11.004 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:33:11.004 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:33:11.005 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:33:11.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:33:11.136 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:33:11.136 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:33:11.137 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:33:11.137 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:11.153 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:33:11.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.290+0000 7f80e2df6640 1 Processor -- start 2024-09-12T02:33:11.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.291+0000 7f80e2df6640 1 -- start start 2024-09-12T02:33:11.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.291+0000 7f80e2df6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f80dc15e610 0x7f80dc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.291+0000 7f80e2df6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 0x7f80dc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.291+0000 7f80e2df6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80dc0cb940 con 0x7f80dc06e4d0 2024-09-12T02:33:11.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.291+0000 7f80e2df6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f80dc06f820 con 0x7f80dc15e610 2024-09-12T02:33:11.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.291+0000 7f80e2df6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f80dc06fb00 con 0x7f80dc0cce30 2024-09-12T02:33:11.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80dbfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f80dc06e4d0 0x7f80dc0ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47974/0 (socket says 172.21.15.181:47974) 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80dbfff640 1 -- 172.21.15.181:0/618669117 learned_addr learned my addr 172.21.15.181:0/618669117 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80e1393640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 0x7f80dc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80e0b92640 1 --2- 172.21.15.181:0/618669117 >> v2:172.21.15.204:3300/0 conn(0x7f80dc15e610 0x7f80dc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256333300 0 0) 0x7f80dc0cb940 con 0x7f80dc06e4d0 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80c8003520 con 0x7f80dc06e4d0 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 102906841 0 0) 0x7f80c8003520 con 0x7f80dc06e4d0 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 msgr2=0x7f80dc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 0x7f80dc06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 >> v2:172.21.15.204:3300/0 conn(0x7f80dc15e610 msgr2=0x7f80dc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 --2- 172.21.15.181:0/618669117 >> v2:172.21.15.204:3300/0 conn(0x7f80dc15e610 0x7f80dc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc06fde0 con 0x7f80dc06e4d0 2024-09-12T02:33:11.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f80c4001670 con 0x7f80dc06e4d0 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 >> v1:172.21.15.181:6789/0 conn(0x7f80dc06e4d0 legacy=0x7f80dc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c80039b0 0x7f80c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80c8004800 0x7f80c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 0x7f80c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc06f820 con 0x7f80c8004800 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc06fb00 con 0x7f80c80039b0 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f80c800b9c0 con 0x7f80dc0cce30 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80dbfff640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80c8004800 0x7f80c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80e0b92640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c80039b0 0x7f80c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.292+0000 7f80e1393640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 0x7f80c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80dbfff640 1 -- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 msgr2=0x7f80c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80dbfff640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc0cce30 0x7f80c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80dbfff640 1 -- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c80039b0 msgr2=0x7f80c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80dbfff640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c80039b0 0x7f80c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80dbfff640 1 -- 172.21.15.181:0/618669117 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c8003520 con 0x7f80c8004800 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80dbfff640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80c8004800 0x7f80c8004c80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f80c4007fd0 tx=0x7f80c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4128f99a4d933df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4007d50 con 0x7f80c8004800 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c4005ad0 con 0x7f80c8004800 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.293+0000 7f80db7fe640 1 -- 172.21.15.181:0/618669117 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4007070 con 0x7f80c8004800 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.294+0000 7f80e2df6640 1 -- 172.21.15.181:0/618669117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80c8004800 msgr2=0x7f80c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.294+0000 7f80e2df6640 1 --2- 172.21.15.181:0/618669117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80c8004800 0x7f80c8004c80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f80c4007fd0 tx=0x7f80c8005830 comp rx=0 tx=0).stop 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.294+0000 7f80e1393640 1 -- 172.21.15.181:0/618669117 reap_dead start 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.294+0000 7f80e2df6640 1 -- 172.21.15.181:0/618669117 shutdown_connections 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.294+0000 7f80e2df6640 1 -- 172.21.15.181:0/618669117 >> 172.21.15.181:0/618669117 conn(0x7f80dc0d11b0 msgr2=0x7f80dc0d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.294+0000 7f80e2df6640 1 -- 172.21.15.181:0/618669117 shutdown_connections 2024-09-12T02:33:11.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.294+0000 7f80e2df6640 1 -- 172.21.15.181:0/618669117 wait complete. 2024-09-12T02:33:11.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.295+0000 7f80e2df6640 1 Processor -- start 2024-09-12T02:33:11.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.295+0000 7f80e2df6640 1 -- start start 2024-09-12T02:33:11.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e2df6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c8004800 0x7f80dc1f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e2df6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80dc1610a0 0x7f80dc15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e2df6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc15cd90 0x7f80dc15d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e2df6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc06f5e0 con 0x7f80dc1610a0 2024-09-12T02:33:11.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e2df6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc06f460 con 0x7f80c8004800 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e2df6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f80dc06eb60 con 0x7f80dc15cd90 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80dc1610a0 0x7f80dc15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80dc1610a0 0x7f80dc15fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57418/0 (socket says 172.21.15.181:57418) 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 -- 172.21.15.181:0/1561857106 learned_addr learned my addr 172.21.15.181:0/1561857106 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e1393640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc15cd90 0x7f80dc15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e0b92640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c8004800 0x7f80dc1f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 -- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc15cd90 msgr2=0x7f80dc15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc15cd90 0x7f80dc15d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 -- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c8004800 msgr2=0x7f80dc1f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c8004800 0x7f80dc1f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80dbfff640 1 -- 172.21.15.181:0/1561857106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc1e81d0 con 0x7f80dc1610a0 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.296+0000 7f80e0b92640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c8004800 0x7f80dc1f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.297+0000 7f80dbfff640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80dc1610a0 0x7f80dc15fb10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f80c4000c00 tx=0x7f80dc0703a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:11.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.297+0000 7f80d97fa640 1 -- 172.21.15.181:0/1561857106 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4040020 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.297+0000 7f80d97fa640 1 -- 172.21.15.181:0/1561857106 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c40049f0 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.297+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc1e84b0 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.297+0000 7f80d97fa640 1 -- 172.21.15.181:0/1561857106 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4004dc0 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.297+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc1e8a70 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.298+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80dc06bc10 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.298+0000 7f80d97fa640 1 -- 172.21.15.181:0/1561857106 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80c4043020 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.299+0000 7f80d97fa640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f80bc06be60 0x7f80bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.299+0000 7f80d97fa640 1 -- 172.21.15.181:0/1561857106 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f80c40aa9a0 con 0x7f80dc1610a0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.299+0000 7f80e0b92640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f80bc06be60 0x7f80bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.299+0000 7f80e0b92640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f80bc06be60 0x7f80bc06e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f80dc1ea550 tx=0x7f80cc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:11.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.303+0000 7f80d97fa640 1 -- 172.21.15.181:0/1561857106 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80c40792c0 con 0x7f80dc1610a0 2024-09-12T02:33:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.478+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f80dc06e030 con 0x7f80dc1610a0 2024-09-12T02:33:11.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.478+0000 7f80d97fa640 1 -- 172.21.15.181:0/1561857106 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v48) ==== 80+0+124 (secure 0 0 0) 0x7f80c4078bc0 con 0x7f80dc1610a0 2024-09-12T02:33:11.479 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181:6837/1579385817 2024-09-13T02:31:07.419830+0000 2024-09-12T02:33:11.480 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181:6836/1579385817 2024-09-13T02:31:07.419830+0000 2024-09-12T02:33:11.480 INFO:teuthology.orchestra.run.smithi181.stderr:listed 2 entries 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.480+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f80bc06be60 msgr2=0x7f80bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.480+0000 7f80e2df6640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f80bc06be60 0x7f80bc06e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f80dc1ea550 tx=0x7f80cc00b040 comp rx=0 tx=0).stop 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.480+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80dc1610a0 msgr2=0x7f80dc15fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.480+0000 7f80e2df6640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80dc1610a0 0x7f80dc15fb10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f80c4000c00 tx=0x7f80dc0703a0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 shutdown_connections 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f80bc06be60 0x7f80bc06e320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80dc15cd90 0x7f80dc15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80dc1610a0 0x7f80dc15fb10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 --2- 172.21.15.181:0/1561857106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80c8004800 0x7f80dc1f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 >> 172.21.15.181:0/1561857106 conn(0x7f80dc0d11b0 msgr2=0x7f80dc0d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 shutdown_connections 2024-09-12T02:33:11.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.481+0000 7f80e2df6640 1 -- 172.21.15.181:0/1561857106 wait complete. 2024-09-12T02:33:11.492 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:33:11.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:11.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:33:11.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[55219]: fuse finished with error 0 and tester_r 0 2024-09-12T02:33:11.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:33:11.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:11.518 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:33:11.615 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:33:11.615 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:33:11.615 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:11.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:33:11.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:33:11.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:11.632 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:33:11.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:33:11.688 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-12T02:33:11.689 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:33:11.689 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:33:11.689 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:11.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:33:11.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:33:11.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:11.705 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:33:11.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:33:11.761 INFO:teuthology.orchestra.run.smithi181.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T02:33:11.761 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:33:11.762 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:33:11.762 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:11.778 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:33:11.778 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:33:11.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:11.779 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:33:11.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:33:11.834 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T02:33:11.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:11.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.932+0000 7f588b342640 1 Processor -- start 2024-09-12T02:33:11.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.932+0000 7f588b342640 1 -- start start 2024-09-12T02:33:11.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f588b342640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f58840d0510 0x7f588415ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f588b342640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58840b2820 con 0x7f58840b3800 2024-09-12T02:33:11.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f588b342640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58840b2b00 con 0x7f58840d08f0 2024-09-12T02:33:11.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f588b342640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5884141730 con 0x7f58840d0510 2024-09-12T02:33:11.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f58898df640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f58840b3800 0x7f5884072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47982/0 (socket says 172.21.15.181:47982) 2024-09-12T02:33:11.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f58898df640 1 -- 172.21.15.181:0/2144915777 learned_addr learned my addr 172.21.15.181:0/2144915777 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:11.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f58890de640 1 --2- 172.21.15.181:0/2144915777 >> v2:172.21.15.204:3300/0 conn(0x7f58840d0510 0x7f588415ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f587bfff640 1 -- 172.21.15.181:0/2144915777 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759588495 0 0) 0x7f58840b2820 con 0x7f58840b3800 2024-09-12T02:33:11.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f587bfff640 1 -- 172.21.15.181:0/2144915777 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5870003520 con 0x7f58840b3800 2024-09-12T02:33:11.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f587bfff640 1 -- 172.21.15.181:0/2144915777 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653121439 0 0) 0x7f5870003520 con 0x7f58840b3800 2024-09-12T02:33:11.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f58890de640 1 -- 172.21.15.181:0/2144915777 >> v1:172.21.15.204:6789/0 conn(0x7f58840d08f0 legacy=0x7f58840b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f58890de640 1 -- 172.21.15.181:0/2144915777 >> v1:172.21.15.181:6789/0 conn(0x7f58840b3800 legacy=0x7f5884072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.933+0000 7f58890de640 1 -- 172.21.15.181:0/2144915777 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5884144320 con 0x7f58840d0510 2024-09-12T02:33:11.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.934+0000 7f58890de640 1 --2- 172.21.15.181:0/2144915777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d0510 0x7f588415ef90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f58800097a0 tx=0x7f588002a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ba258947064c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:11.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.934+0000 7f587bfff640 1 -- 172.21.15.181:0/2144915777 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880037070 con 0x7f58840d0510 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.934+0000 7f587bfff640 1 -- 172.21.15.181:0/2144915777 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588002ab60 con 0x7f58840d0510 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.934+0000 7f587bfff640 1 -- 172.21.15.181:0/2144915777 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c0019f0 con 0x7f58840d0510 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.935+0000 7f588b342640 1 -- 172.21.15.181:0/2144915777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d0510 msgr2=0x7f588415ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.935+0000 7f588b342640 1 --2- 172.21.15.181:0/2144915777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d0510 0x7f588415ef90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f58800097a0 tx=0x7f588002a0d0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.935+0000 7f588b342640 1 -- 172.21.15.181:0/2144915777 shutdown_connections 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.935+0000 7f588b342640 1 --2- 172.21.15.181:0/2144915777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d0510 0x7f588415ef90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.935+0000 7f588b342640 1 -- 172.21.15.181:0/2144915777 >> 172.21.15.181:0/2144915777 conn(0x7f588406bc10 msgr2=0x7f588406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.935+0000 7f588b342640 1 -- 172.21.15.181:0/2144915777 shutdown_connections 2024-09-12T02:33:11.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.935+0000 7f588b342640 1 -- 172.21.15.181:0/2144915777 wait complete. 2024-09-12T02:33:11.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.936+0000 7f588b342640 1 Processor -- start 2024-09-12T02:33:11.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.936+0000 7f588b342640 1 -- start start 2024-09-12T02:33:11.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f588b342640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58840b3800 0x7f588415c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f588b342640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58840d0510 0x7f5884139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f588b342640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d08f0 0x7f588415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f588b342640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5884143bb0 con 0x7f58840d0510 2024-09-12T02:33:11.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f588b342640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5884142e70 con 0x7f58840d08f0 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f588b342640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5884143d30 con 0x7f58840b3800 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58840d0510 0x7f5884139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58840d0510 0x7f5884139110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57426/0 (socket says 172.21.15.181:57426) 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 -- 172.21.15.181:0/3209369385 learned_addr learned my addr 172.21.15.181:0/3209369385 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58890de640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58840b3800 0x7f588415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58898df640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d08f0 0x7f588415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 -- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58840b3800 msgr2=0x7f588415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58840b3800 0x7f588415c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 -- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d08f0 msgr2=0x7f588415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d08f0 0x7f588415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.937+0000 7f58888dd640 1 -- 172.21.15.181:0/3209369385 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588415cef0 con 0x7f58840d0510 2024-09-12T02:33:11.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.938+0000 7f58888dd640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58840d0510 0x7f5884139110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f587400c4d0 tx=0x7f587400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.938+0000 7f5879ffb640 1 -- 172.21.15.181:0/3209369385 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874017070 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.938+0000 7f5879ffb640 1 -- 172.21.15.181:0/3209369385 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5874005480 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.938+0000 7f5879ffb640 1 -- 172.21.15.181:0/3209369385 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874003830 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.938+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588415d1d0 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.938+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f588415d790 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.939+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588415ef90 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.939+0000 7f5879ffb640 1 -- 172.21.15.181:0/3209369385 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f587401a070 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.940+0000 7f5879ffb640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586806be60 0x7f586806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.940+0000 7f5879ffb640 1 -- 172.21.15.181:0/3209369385 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f587408a210 con 0x7f58840d0510 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.940+0000 7f58890de640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586806be60 0x7f586806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:11.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.940+0000 7f58890de640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586806be60 0x7f586806e320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5880034000 tx=0x7f588002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:11.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:11.944+0000 7f5879ffb640 1 -- 172.21.15.181:0/3209369385 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5874058460 con 0x7f58840d0510 2024-09-12T02:33:12.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.141+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f588406d6b0 con 0x7f58840d0510 2024-09-12T02:33:12.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.142+0000 7f5879ffb640 1 -- 172.21.15.181:0/3209369385 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5237 (secure 0 0 0) 0x7f587405c760 con 0x7f58840d0510 2024-09-12T02:33:12.143 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:12.143 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":34,"btime":"2024-09-12T02:32:09:515654+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:32:09.515645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":18,"addr":"172.21.15.181:6837/3622686732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3622686732},{"type":"v1","addr":"172.21.15.181:6837","nonce":3622686732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5571,"qdb_cluster":[5571]},"id":3}]} 2024-09-12T02:33:12.143 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 34 2024-09-12T02:33:12.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586806be60 msgr2=0x7f586806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586806be60 0x7f586806e320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5880034000 tx=0x7f588002e000 comp rx=0 tx=0).stop 2024-09-12T02:33:12.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58840d0510 msgr2=0x7f5884139110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58840d0510 0x7f5884139110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f587400c4d0 tx=0x7f587400c990 comp rx=0 tx=0).stop 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 shutdown_connections 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f586806be60 0x7f586806e320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58840d08f0 0x7f588415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58840d0510 0x7f5884139110 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 --2- 172.21.15.181:0/3209369385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58840b3800 0x7f588415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 >> 172.21.15.181:0/3209369385 conn(0x7f588406bc10 msgr2=0x7f588406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 shutdown_connections 2024-09-12T02:33:12.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.144+0000 7f588b342640 1 -- 172.21.15.181:0/3209369385 wait complete. 2024-09-12T02:33:12.157 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:12.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.254+0000 7f4f40a47640 1 Processor -- start 2024-09-12T02:33:12.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.254+0000 7f4f40a47640 1 -- start start 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.254+0000 7f4f40a47640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4f3c0d0510 0x7f4f3c15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f40a47640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f40a47640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3c0b2820 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f40a47640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f4f3c0b2b00 con 0x7f4f3c0d0510 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f40a47640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4f3c141730 con 0x7f4f3c0b3800 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3a59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4f3c0d0510 0x7f4f3c15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3ad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f33fff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f4f3c0d08f0 0x7f4f3c0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:52266/0 (socket says 172.21.15.181:52266) 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3a59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4f3c0d0510 0x7f4f3c15ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:39556/0 (socket says 172.21.15.181:39556) 2024-09-12T02:33:12.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f33fff640 1 -- 172.21.15.181:0/1740994631 learned_addr learned my addr 172.21.15.181:0/1740994631 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:12.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3ad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c072e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:35842/0 (socket says 172.21.15.181:35842) 2024-09-12T02:33:12.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3a59c640 1 -- 172.21.15.181:0/1740994631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 msgr2=0x7f4f3c072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:12.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3a59c640 1 --2- 172.21.15.181:0/1740994631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3a59c640 1 -- 172.21.15.181:0/1740994631 >> v1:172.21.15.204:6789/0 conn(0x7f4f3c0d08f0 legacy=0x7f4f3c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f3a59c640 1 -- 172.21.15.181:0/1740994631 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3c144320 con 0x7f4f3c0d0510 2024-09-12T02:33:12.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.255+0000 7f4f39d9b640 1 -- 172.21.15.181:0/1740994631 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280849277 0 0) 0x7f4f3c0b2820 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.256+0000 7f4f3a59c640 1 --2- 172.21.15.181:0/1740994631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c15ef90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00a940 tx=0x7f4f2c02b550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8feb4473fe0b84b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.256+0000 7f4f39d9b640 1 -- 172.21.15.181:0/1740994631 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00b040 con 0x7f4f3c0d0510 2024-09-12T02:33:12.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.256+0000 7f4f39d9b640 1 -- 172.21.15.181:0/1740994631 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c030710 con 0x7f4f3c0d0510 2024-09-12T02:33:12.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.256+0000 7f4f39d9b640 1 -- 172.21.15.181:0/1740994631 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c030ae0 con 0x7f4f3c0d0510 2024-09-12T02:33:12.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 -- 172.21.15.181:0/1740994631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 msgr2=0x7f4f3c15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1740994631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c15ef90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00a940 tx=0x7f4f2c02b550 comp rx=0 tx=0).stop 2024-09-12T02:33:12.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 -- 172.21.15.181:0/1740994631 shutdown_connections 2024-09-12T02:33:12.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1740994631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1740994631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c15ef90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 -- 172.21.15.181:0/1740994631 >> 172.21.15.181:0/1740994631 conn(0x7f4f3c06bc10 msgr2=0x7f4f3c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:12.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 -- 172.21.15.181:0/1740994631 shutdown_connections 2024-09-12T02:33:12.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.257+0000 7f4f40a47640 1 -- 172.21.15.181:0/1740994631 wait complete. 2024-09-12T02:33:12.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.258+0000 7f4f40a47640 1 Processor -- start 2024-09-12T02:33:12.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.258+0000 7f4f40a47640 1 -- start start 2024-09-12T02:33:12.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f40a47640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f40a47640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c1f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f40a47640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3c0d08f0 0x7f4f3c1f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f40a47640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c0b1df0 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f40a47640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c143dc0 con 0x7f4f3c0d0510 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f40a47640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4f3c0b1f70 con 0x7f4f3c0b3800 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3c0d08f0 0x7f4f3c1f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3c0d08f0 0x7f4f3c1f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57440/0 (socket says 172.21.15.181:57440) 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 -- 172.21.15.181:0/1160768091 learned_addr learned my addr 172.21.15.181:0/1160768091 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f33fff640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c1f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3a59c640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 -- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 msgr2=0x7f4f3c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 -- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 msgr2=0x7f4f3c1f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c1f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 -- 172.21.15.181:0/1160768091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3c0c5ba0 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f33fff640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c1f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:12.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.259+0000 7f4f3ad9d640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3c0d08f0 0x7f4f3c1f4d60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400efc0 tx=0x7f4f3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.260+0000 7f4f32ffd640 1 -- 172.21.15.181:0/1160768091 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34018020 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.260+0000 7f4f32ffd640 1 -- 172.21.15.181:0/1160768091 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f34014480 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.260+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3c0c5e80 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.260+0000 7f4f32ffd640 1 -- 172.21.15.181:0/1160768091 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34014870 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.260+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f3c0c6440 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.260+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f3c0b2400 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.261+0000 7f4f32ffd640 1 -- 172.21.15.181:0/1160768091 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f34005d10 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.261+0000 7f4f32ffd640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.261+0000 7f4f32ffd640 1 -- 172.21.15.181:0/1160768091 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f4f3408b990 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.261+0000 7f4f3a59c640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.262+0000 7f4f3a59c640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c035000 tx=0x7f4f2c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.266+0000 7f4f32ffd640 1 -- 172.21.15.181:0/1160768091 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f34022070 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.465+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f3c0afff0 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.465+0000 7f4f32ffd640 1 -- 172.21.15.181:0/1160768091 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5237 (secure 0 0 0) 0x7f4f34010040 con 0x7f4f3c0d08f0 2024-09-12T02:33:12.466 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:12.466 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":34,"btime":"2024-09-12T02:32:09:515654+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:32:09.515645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":18,"addr":"172.21.15.181:6837/3622686732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3622686732},{"type":"v1","addr":"172.21.15.181:6837","nonce":3622686732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5571,"qdb_cluster":[5571]},"id":3}]} 2024-09-12T02:33:12.466 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 34 2024-09-12T02:33:12.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f1c06be30 msgr2=0x7f4f1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c035000 tx=0x7f4f2c00c040 comp rx=0 tx=0).stop 2024-09-12T02:33:12.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3c0d08f0 msgr2=0x7f4f3c1f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3c0d08f0 0x7f4f3c1f4d60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400efc0 tx=0x7f4f3400c490 comp rx=0 tx=0).stop 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 shutdown_connections 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4f1c06be30 0x7f4f1c06e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f3c0d0510 0x7f4f3c1f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3c0d08f0 0x7f4f3c1f4d60 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 --2- 172.21.15.181:0/1160768091 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f3c0b3800 0x7f4f3c142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 >> 172.21.15.181:0/1160768091 conn(0x7f4f3c06bc10 msgr2=0x7f4f3c0b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 shutdown_connections 2024-09-12T02:33:12.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.467+0000 7f4f40a47640 1 -- 172.21.15.181:0/1160768091 wait complete. 2024-09-12T02:33:12.480 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:12.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.580+0000 7fdc31be8640 1 Processor -- start 2024-09-12T02:33:12.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.580+0000 7fdc31be8640 1 -- start start 2024-09-12T02:33:12.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.580+0000 7fdc31be8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc2c0cf2b0 0x7fdc2c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.580+0000 7fdc31be8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2c15ea20 con 0x7fdc2c0cf720 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.580+0000 7fdc31be8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2c0b1c50 con 0x7fdc2c15e640 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.580+0000 7fdc31be8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2c0b3d00 con 0x7fdc2c0cf2b0 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc2c0cf2b0 0x7fdc2c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc2c0cf2b0 0x7fdc2c0d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57448/0 (socket says 172.21.15.181:57448) 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdc2c0cf720 0x7fdc2c0d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47992/0 (socket says 172.21.15.181:47992) 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2affd640 1 -- 172.21.15.181:0/1058479460 learned_addr learned my addr 172.21.15.181:0/1058479460 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2affd640 1 -- 172.21.15.181:0/1058479460 >> v1:172.21.15.204:6789/0 conn(0x7fdc2c15e640 legacy=0x7fdc2c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2affd640 1 -- 172.21.15.181:0/1058479460 >> v1:172.21.15.181:6789/0 conn(0x7fdc2c0cf720 legacy=0x7fdc2c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2affd640 1 -- 172.21.15.181:0/1058479460 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c0b1f30 con 0x7fdc2c0cf2b0 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.581+0000 7fdc2a7fc640 1 -- 172.21.15.181:0/1058479460 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868425671 0 0) 0x7fdc2c15ea20 con 0x7fdc2c0cf720 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc2affd640 1 --2- 172.21.15.181:0/1058479460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf2b0 0x7fdc2c0d2650 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0cb580 tx=0x7fdc1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c13b6a0d432200 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc2a7fc640 1 -- 172.21.15.181:0/1058479460 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c037070 con 0x7fdc2c0cf2b0 2024-09-12T02:33:12.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc2a7fc640 1 -- 172.21.15.181:0/1058479460 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c032440 con 0x7fdc2c0cf2b0 2024-09-12T02:33:12.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc2a7fc640 1 -- 172.21.15.181:0/1058479460 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c032810 con 0x7fdc2c0cf2b0 2024-09-12T02:33:12.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc31be8640 1 -- 172.21.15.181:0/1058479460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf2b0 msgr2=0x7fdc2c0d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1058479460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf2b0 0x7fdc2c0d2650 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0cb580 tx=0x7fdc1c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc31be8640 1 -- 172.21.15.181:0/1058479460 shutdown_connections 2024-09-12T02:33:12.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1058479460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf2b0 0x7fdc2c0d2650 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc31be8640 1 -- 172.21.15.181:0/1058479460 >> 172.21.15.181:0/1058479460 conn(0x7fdc2c09d820 msgr2=0x7fdc2c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:12.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc31be8640 1 -- 172.21.15.181:0/1058479460 shutdown_connections 2024-09-12T02:33:12.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.582+0000 7fdc31be8640 1 -- 172.21.15.181:0/1058479460 wait complete. 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 Processor -- start 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 -- start start 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0cf2b0 0x7fdc2c0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf720 0x7fdc2c0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c15e640 0x7fdc2c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c0b24f0 con 0x7fdc2c0cf720 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c0b2860 con 0x7fdc2c0cf2b0 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.584+0000 7fdc31be8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdc2c0cfe40 con 0x7fdc2c15e640 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf720 0x7fdc2c0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf720 0x7fdc2c0c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57458/0 (socket says 172.21.15.181:57458) 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 -- 172.21.15.181:0/1261121792 learned_addr learned my addr 172.21.15.181:0/1261121792 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2b7fe640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0cf2b0 0x7fdc2c0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2bfff640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c15e640 0x7fdc2c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 -- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c15e640 msgr2=0x7fdc2c151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c15e640 0x7fdc2c151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 -- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0cf2b0 msgr2=0x7fdc2c0c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0cf2b0 0x7fdc2c0c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 -- 172.21.15.181:0/1261121792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c0c9190 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc2affd640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf720 0x7fdc2c0c8a90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c035040 tx=0x7fdc1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc23fff640 1 -- 172.21.15.181:0/1261121792 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c037040 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc23fff640 1 -- 172.21.15.181:0/1261121792 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c004230 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2c160620 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc23fff640 1 -- 172.21.15.181:0/1261121792 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c03c670 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.585+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2c160be0 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.586+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2c068eb0 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.587+0000 7fdc23fff640 1 -- 172.21.15.181:0/1261121792 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc1c03a070 con 0x7fdc2c0cf720 2024-09-12T02:33:12.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.587+0000 7fdc23fff640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc0c06be30 0x7fdc0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.587+0000 7fdc23fff640 1 -- 172.21.15.181:0/1261121792 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7fdc1c0ab6a0 con 0x7fdc2c0cf720 2024-09-12T02:33:12.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.587+0000 7fdc2b7fe640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc0c06be30 0x7fdc0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.588+0000 7fdc2b7fe640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc0c06be30 0x7fdc0c06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc14004f60 tx=0x7fdc14007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.591+0000 7fdc23fff640 1 -- 172.21.15.181:0/1261121792 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc1c041020 con 0x7fdc2c0cf720 2024-09-12T02:33:12.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.767+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc2c0b73a0 con 0x7fdc2c0cf720 2024-09-12T02:33:12.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.768+0000 7fdc23fff640 1 -- 172.21.15.181:0/1261121792 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16967 (secure 0 0 0) 0x7fdc1c079b20 con 0x7fdc2c0cf720 2024-09-12T02:33:12.769 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":48,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:31:07.419859+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:29:50.557261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:50.907075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6837/1579385817":"2024-09-13T02:31:07.419830+0000","172.21.15.181:6836/1579385817":"2024-09-13T02:31:07.419830+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:12.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc0c06be30 msgr2=0x7fdc0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc0c06be30 0x7fdc0c06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc14004f60 tx=0x7fdc14007e30 comp rx=0 tx=0).stop 2024-09-12T02:33:12.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf720 msgr2=0x7fdc2c0c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf720 0x7fdc2c0c8a90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c035040 tx=0x7fdc1c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 shutdown_connections 2024-09-12T02:33:12.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc0c06be30 0x7fdc0c06e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc2c15e640 0x7fdc2c151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2c0cf720 0x7fdc2c0c8a90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 --2- 172.21.15.181:0/1261121792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc2c0cf2b0 0x7fdc2c0c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 >> 172.21.15.181:0/1261121792 conn(0x7fdc2c09d820 msgr2=0x7fdc2c1e8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:12.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 shutdown_connections 2024-09-12T02:33:12.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.770+0000 7fdc31be8640 1 -- 172.21.15.181:0/1261121792 wait complete. 2024-09-12T02:33:12.783 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:33:12.783 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:12.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.880+0000 7f93a905a640 1 Processor -- start 2024-09-12T02:33:12.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.881+0000 7f93a905a640 1 -- start start 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.881+0000 7f93a905a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f93a4158ab0 0x7f93a40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.881+0000 7f93a905a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 0x7f93a415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.881+0000 7f93a905a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a40cfd50 con 0x7f93a40b1d80 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.881+0000 7f93a905a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f93a415f610 con 0x7f93a4158ab0 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.881+0000 7f93a905a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f93a415f8f0 con 0x7f93a415eae0 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a359e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f93a40b1d80 0x7f93a40b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48002/0 (socket says 172.21.15.181:48002) 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a359e640 1 -- 172.21.15.181:0/1918452453 learned_addr learned my addr 172.21.15.181:0/1918452453 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/1918452453 >> v2:172.21.15.204:3300/0 conn(0x7f93a4158ab0 0x7f93a40d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a259c640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 0x7f93a415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619838034 0 0) 0x7f93a40cfd50 con 0x7f93a40b1d80 2024-09-12T02:33:12.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9390003520 con 0x7f93a40b1d80 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2890473752 0 0) 0x7f9390003520 con 0x7f93a40b1d80 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 msgr2=0x7f93a415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 0x7f93a415ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 >> v2:172.21.15.204:3300/0 conn(0x7f93a4158ab0 msgr2=0x7f93a40d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 --2- 172.21.15.181:0/1918452453 >> v2:172.21.15.204:3300/0 conn(0x7f93a4158ab0 0x7f93a40d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a40d0000 con 0x7f93a40b1d80 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f9394001670 con 0x7f93a40b1d80 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 >> v1:172.21.15.181:6789/0 conn(0x7f93a40b1d80 legacy=0x7f93a40b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93900039b0 0x7f9390003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 0x7f9390004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9390004d40 0x7f93900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f93a415f610 con 0x7f93900039b0 2024-09-12T02:33:12.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f93a415f8f0 con 0x7f9390004d40 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f939000b9c0 con 0x7f93a415eae0 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93900039b0 0x7f9390003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a259c640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 0x7f9390004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a359e640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9390004d40 0x7f93900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a2d9d640 1 -- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 msgr2=0x7f9390004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93a415eae0 0x7f9390004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a2d9d640 1 -- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9390004d40 msgr2=0x7f93900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9390004d40 0x7f93900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a2d9d640 1 -- 172.21.15.181:0/1918452453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9390003520 con 0x7f93900039b0 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.882+0000 7f93a359e640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9390004d40 0x7f93900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.883+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93900039b0 0x7f9390003dd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f939c00e170 tx=0x7f9390005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cb5f32fe8354ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.883+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c034020 con 0x7f93900039b0 2024-09-12T02:33:12.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.883+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c030430 con 0x7f93900039b0 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.883+0000 7f93a1d9b640 1 -- 172.21.15.181:0/1918452453 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c009c10 con 0x7f93900039b0 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.884+0000 7f93a905a640 1 -- 172.21.15.181:0/1918452453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93900039b0 msgr2=0x7f9390003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.884+0000 7f93a905a640 1 --2- 172.21.15.181:0/1918452453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93900039b0 0x7f9390003dd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f939c00e170 tx=0x7f9390005830 comp rx=0 tx=0).stop 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.884+0000 7f93a359e640 1 -- 172.21.15.181:0/1918452453 reap_dead start 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.884+0000 7f93a905a640 1 -- 172.21.15.181:0/1918452453 shutdown_connections 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.884+0000 7f93a905a640 1 -- 172.21.15.181:0/1918452453 >> 172.21.15.181:0/1918452453 conn(0x7f93a406bc10 msgr2=0x7f93a406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.884+0000 7f93a905a640 1 -- 172.21.15.181:0/1918452453 shutdown_connections 2024-09-12T02:33:12.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.884+0000 7f93a905a640 1 -- 172.21.15.181:0/1918452453 wait complete. 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.885+0000 7f93a905a640 1 Processor -- start 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a905a640 1 -- start start 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a905a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93900039b0 0x7f93a4146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a905a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93a41591a0 0x7f93a4143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a905a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93a4072dc0 0x7f93a4073240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a905a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4158e90 con 0x7f93a41591a0 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a905a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f93a40ccc90 con 0x7f93a4072dc0 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a905a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f93a4072040 con 0x7f93900039b0 2024-09-12T02:33:12.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93a41591a0 0x7f93a4143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93a41591a0 0x7f93a4143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57474/0 (socket says 172.21.15.181:57474) 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a259c640 1 -- 172.21.15.181:0/4065417846 learned_addr learned my addr 172.21.15.181:0/4065417846 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.886+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93900039b0 0x7f93a4146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a359e640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93a4072dc0 0x7f93a4073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a259c640 1 -- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93900039b0 msgr2=0x7f93a4146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a259c640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93900039b0 0x7f93a4146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a259c640 1 -- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93a4072dc0 msgr2=0x7f93a4073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a259c640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93a4072dc0 0x7f93a4073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a259c640 1 -- 172.21.15.181:0/4065417846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a4159760 con 0x7f93a41591a0 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a259c640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93a41591a0 0x7f93a4143830 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f938c0119a0 tx=0x7f938c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f939b7fe640 1 -- 172.21.15.181:0/4065417846 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00faf0 con 0x7f93a41591a0 2024-09-12T02:33:12.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f939b7fe640 1 -- 172.21.15.181:0/4065417846 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c00fc90 con 0x7f93a41591a0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a41467d0 con 0x7f93a41591a0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f939b7fe640 1 -- 172.21.15.181:0/4065417846 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c014440 con 0x7f93a41591a0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.887+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a40725c0 con 0x7f93a41591a0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.888+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a4069b20 con 0x7f93a41591a0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.888+0000 7f939b7fe640 1 -- 172.21.15.181:0/4065417846 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f938c012040 con 0x7f93a41591a0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.889+0000 7f939b7fe640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f938406be60 0x7f938406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.889+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f938406be60 0x7f938406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.889+0000 7f939b7fe640 1 -- 172.21.15.181:0/4065417846 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f938c08b530 con 0x7f93a41591a0 2024-09-12T02:33:12.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.889+0000 7f93a2d9d640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f938406be60 0x7f938406e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f939c035000 tx=0x7f939c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:12.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:12.893+0000 7f939b7fe640 1 -- 172.21.15.181:0/4065417846 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f938c019030 con 0x7f93a41591a0 2024-09-12T02:33:13.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.092+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93a40d0eb0 con 0x7f93a41591a0 2024-09-12T02:33:13.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.092+0000 7f939b7fe640 1 -- 172.21.15.181:0/4065417846 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5237 (secure 0 0 0) 0x7f938c059800 con 0x7f93a41591a0 2024-09-12T02:33:13.093 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:13.093 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":34,"btime":"2024-09-12T02:32:09:515654+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:32:09.515645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":18,"addr":"172.21.15.181:6837/3622686732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3622686732},{"type":"v1","addr":"172.21.15.181:6837","nonce":3622686732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5571,"qdb_cluster":[5571]},"id":3}]} 2024-09-12T02:33:13.094 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 34 2024-09-12T02:33:13.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f938406be60 msgr2=0x7f938406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f938406be60 0x7f938406e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f939c035000 tx=0x7f939c02f000 comp rx=0 tx=0).stop 2024-09-12T02:33:13.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93a41591a0 msgr2=0x7f93a4143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93a41591a0 0x7f93a4143830 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f938c0119a0 tx=0x7f938c011e60 comp rx=0 tx=0).stop 2024-09-12T02:33:13.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 shutdown_connections 2024-09-12T02:33:13.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f938406be60 0x7f938406e320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f93a4072dc0 0x7f93a4073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93a41591a0 0x7f93a4143830 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 --2- 172.21.15.181:0/4065417846 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93900039b0 0x7f93a4146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 >> 172.21.15.181:0/4065417846 conn(0x7f93a406bc10 msgr2=0x7f93a40b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 shutdown_connections 2024-09-12T02:33:13.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.094+0000 7f93a905a640 1 -- 172.21.15.181:0/4065417846 wait complete. 2024-09-12T02:33:13.106 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.204+0000 7f0760227640 1 Processor -- start 2024-09-12T02:33:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.204+0000 7f0760227640 1 -- start start 2024-09-12T02:33:13.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f0760227640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f07580b3800 0x7f075815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f0760227640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f07580d08f0 0x7f0758072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f0760227640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07580b2820 con 0x7f07580d0510 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f0760227640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f07580b2b00 con 0x7f07580b3800 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f0760227640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f0758141730 con 0x7f07580d08f0 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f075d7c2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f07580b3800 0x7f075815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f075d7c2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f07580b3800 0x7f075815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57480/0 (socket says 172.21.15.181:57480) 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f075d7c2640 1 -- 172.21.15.181:0/1979921353 learned_addr learned my addr 172.21.15.181:0/1979921353 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f075e7c4640 1 --2- 172.21.15.181:0/1979921353 >> v2:172.21.15.204:3300/0 conn(0x7f07580d08f0 0x7f0758072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.205+0000 7f075d7c2640 1 -- 172.21.15.181:0/1979921353 >> v2:172.21.15.204:3300/0 conn(0x7f07580d08f0 msgr2=0x7f0758072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075d7c2640 1 --2- 172.21.15.181:0/1979921353 >> v2:172.21.15.204:3300/0 conn(0x7f07580d08f0 0x7f0758072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075d7c2640 1 -- 172.21.15.181:0/1979921353 >> v1:172.21.15.204:6789/0 conn(0x7f07580d0510 legacy=0x7f07580b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075d7c2640 1 -- 172.21.15.181:0/1979921353 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758144320 con 0x7f07580b3800 2024-09-12T02:33:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075e7c4640 1 --2- 172.21.15.181:0/1979921353 >> v2:172.21.15.204:3300/0 conn(0x7f07580d08f0 0x7f0758072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075d7c2640 1 --2- 172.21.15.181:0/1979921353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580b3800 0x7f075815ef90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f07580b45a0 tx=0x7f074802b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f26301d4bbb354 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075cfc1640 1 -- 172.21.15.181:0/1979921353 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748038070 con 0x7f07580b3800 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075cfc1640 1 -- 172.21.15.181:0/1979921353 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0748033640 con 0x7f07580b3800 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.206+0000 7f075cfc1640 1 -- 172.21.15.181:0/1979921353 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748033a10 con 0x7f07580b3800 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 -- 172.21.15.181:0/1979921353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580b3800 msgr2=0x7f075815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 --2- 172.21.15.181:0/1979921353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580b3800 0x7f075815ef90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f07580b45a0 tx=0x7f074802b380 comp rx=0 tx=0).stop 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 -- 172.21.15.181:0/1979921353 shutdown_connections 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 --2- 172.21.15.181:0/1979921353 >> v2:172.21.15.204:3300/0 conn(0x7f07580d08f0 0x7f0758072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 --2- 172.21.15.181:0/1979921353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580b3800 0x7f075815ef90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 -- 172.21.15.181:0/1979921353 >> 172.21.15.181:0/1979921353 conn(0x7f075806bc10 msgr2=0x7f075806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 -- 172.21.15.181:0/1979921353 shutdown_connections 2024-09-12T02:33:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.207+0000 7f0760227640 1 -- 172.21.15.181:0/1979921353 wait complete. 2024-09-12T02:33:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.208+0000 7f0760227640 1 Processor -- start 2024-09-12T02:33:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.208+0000 7f0760227640 1 -- start start 2024-09-12T02:33:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f0760227640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580b3800 0x7f075815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f0760227640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580d0510 0x7f07580cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f0760227640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580d08f0 0x7f07580cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f0760227640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f07580b1df0 con 0x7f07580d0510 2024-09-12T02:33:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f0760227640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0758143dc0 con 0x7f07580d08f0 2024-09-12T02:33:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f0760227640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f07580b1f70 con 0x7f07580b3800 2024-09-12T02:33:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580d0510 0x7f07580cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580d0510 0x7f07580cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57490/0 (socket says 172.21.15.181:57490) 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 -- 172.21.15.181:0/2836308752 learned_addr learned my addr 172.21.15.181:0/2836308752 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075dfc3640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580b3800 0x7f075815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075e7c4640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580d08f0 0x7f07580cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 -- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580b3800 msgr2=0x7f075815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580b3800 0x7f075815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 -- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580d08f0 msgr2=0x7f07580cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580d08f0 0x7f07580cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 -- 172.21.15.181:0/2836308752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07580ab1c0 con 0x7f07580d0510 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.209+0000 7f075d7c2640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580d0510 0x7f07580cedb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0748000c00 tx=0x7f07480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.210+0000 7f074e7fc640 1 -- 172.21.15.181:0/2836308752 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748043070 con 0x7f07580d0510 2024-09-12T02:33:13.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.210+0000 7f074e7fc640 1 -- 172.21.15.181:0/2836308752 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0748031770 con 0x7f07580d0510 2024-09-12T02:33:13.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.210+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07580ab4a0 con 0x7f07580d0510 2024-09-12T02:33:13.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.210+0000 7f074e7fc640 1 -- 172.21.15.181:0/2836308752 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748038040 con 0x7f07580d0510 2024-09-12T02:33:13.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.210+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07580aa490 con 0x7f07580d0510 2024-09-12T02:33:13.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.211+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07580b2330 con 0x7f07580d0510 2024-09-12T02:33:13.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.211+0000 7f074e7fc640 1 -- 172.21.15.181:0/2836308752 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0748046070 con 0x7f07580d0510 2024-09-12T02:33:13.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.212+0000 7f074e7fc640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f073c06be30 0x7f073c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.212+0000 7f074e7fc640 1 -- 172.21.15.181:0/2836308752 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f07480aac70 con 0x7f07580d0510 2024-09-12T02:33:13.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.212+0000 7f075dfc3640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f073c06be30 0x7f073c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.212+0000 7f075dfc3640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f073c06be30 0x7f073c06e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0754001780 tx=0x7f0754009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.216+0000 7f074e7fc640 1 -- 172.21.15.181:0/2836308752 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0748078fd0 con 0x7f07580d0510 2024-09-12T02:33:13.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.414+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07580b4fb0 con 0x7f07580d0510 2024-09-12T02:33:13.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.414+0000 7f074e7fc640 1 -- 172.21.15.181:0/2836308752 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5237 (secure 0 0 0) 0x7f074807d2d0 con 0x7f07580d0510 2024-09-12T02:33:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:13.415 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":34,"btime":"2024-09-12T02:32:09:515654+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:29:51.939812+0000","modified":"2024-09-12T02:32:09.515645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":18,"addr":"172.21.15.181:6837/3622686732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3622686732},{"type":"v1","addr":"172.21.15.181:6837","nonce":3622686732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5571,"qdb_cluster":[5571]},"id":3}]} 2024-09-12T02:33:13.416 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 34 2024-09-12T02:33:13.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f073c06be30 msgr2=0x7f073c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f073c06be30 0x7f073c06e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0754001780 tx=0x7f0754009040 comp rx=0 tx=0).stop 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580d0510 msgr2=0x7f07580cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580d0510 0x7f07580cedb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0748000c00 tx=0x7f07480046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 shutdown_connections 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f073c06be30 0x7f073c06e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07580d08f0 0x7f07580cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07580d0510 0x7f07580cedb0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 --2- 172.21.15.181:0/2836308752 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07580b3800 0x7f075815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 >> 172.21.15.181:0/2836308752 conn(0x7f075806bc10 msgr2=0x7f0758073640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 shutdown_connections 2024-09-12T02:33:13.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.416+0000 7f0760227640 1 -- 172.21.15.181:0/2836308752 wait complete. 2024-09-12T02:33:13.428 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:13.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.525+0000 7f8eb88d9640 1 Processor -- start 2024-09-12T02:33:13.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.525+0000 7f8eb88d9640 1 -- start start 2024-09-12T02:33:13.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.526+0000 7f8eb88d9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8eb415c4a0 0x7f8eb40cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.526+0000 7f8eb88d9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8eb40d2da0 0x7f8eb415c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.526+0000 7f8eb88d9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb40d0a30 con 0x7f8eb40b4090 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.526+0000 7f8eb88d9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb40d0d30 con 0x7f8eb415c4a0 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.526+0000 7f8eb88d9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb40b76f0 con 0x7f8eb40d2da0 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb259c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8eb415c4a0 0x7f8eb40cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb259c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8eb415c4a0 0x7f8eb40cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57492/0 (socket says 172.21.15.181:57492) 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb259c640 1 -- 172.21.15.181:0/2079731769 learned_addr learned my addr 172.21.15.181:0/2079731769 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb1d9b640 1 --2- 172.21.15.181:0/2079731769 >> v2:172.21.15.204:3300/0 conn(0x7f8eb40d2da0 0x7f8eb415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb259c640 1 -- 172.21.15.181:0/2079731769 >> v2:172.21.15.204:3300/0 conn(0x7f8eb40d2da0 msgr2=0x7f8eb415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb259c640 1 --2- 172.21.15.181:0/2079731769 >> v2:172.21.15.204:3300/0 conn(0x7f8eb40d2da0 0x7f8eb415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb259c640 1 -- 172.21.15.181:0/2079731769 >> v1:172.21.15.204:6789/0 conn(0x7f8eb40b4090 legacy=0x7f8eb4165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.527+0000 7f8eb259c640 1 -- 172.21.15.181:0/2079731769 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb4073710 con 0x7f8eb415c4a0 2024-09-12T02:33:13.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb259c640 1 --2- 172.21.15.181:0/2079731769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb415c4a0 0x7f8eb40cff80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4068610 tx=0x7f8ea802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5561572b815d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb159a640 1 -- 172.21.15.181:0/2079731769 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8037070 con 0x7f8eb415c4a0 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb159a640 1 -- 172.21.15.181:0/2079731769 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8032440 con 0x7f8eb415c4a0 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb159a640 1 -- 172.21.15.181:0/2079731769 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8032810 con 0x7f8eb415c4a0 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 -- 172.21.15.181:0/2079731769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb415c4a0 msgr2=0x7f8eb40cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/2079731769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb415c4a0 0x7f8eb40cff80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4068610 tx=0x7f8ea802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 -- 172.21.15.181:0/2079731769 shutdown_connections 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/2079731769 >> v2:172.21.15.204:3300/0 conn(0x7f8eb40d2da0 0x7f8eb415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/2079731769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb415c4a0 0x7f8eb40cff80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 -- 172.21.15.181:0/2079731769 >> 172.21.15.181:0/2079731769 conn(0x7f8eb4067950 msgr2=0x7f8eb4067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 -- 172.21.15.181:0/2079731769 shutdown_connections 2024-09-12T02:33:13.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.528+0000 7f8eb88d9640 1 -- 172.21.15.181:0/2079731769 wait complete. 2024-09-12T02:33:13.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 Processor -- start 2024-09-12T02:33:13.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 -- start start 2024-09-12T02:33:13.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40b4090 0x7f8eb41e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8eb40d2da0 0x7f8eb41e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8eb415c4a0 0x7f8eb41504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40b4520 con 0x7f8eb40b4090 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40d28e0 con 0x7f8eb415c4a0 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb88d9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb40b46a0 con 0x7f8eb40d2da0 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40b4090 0x7f8eb41e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.530+0000 7f8eb259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40b4090 0x7f8eb41e5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57498/0 (socket says 172.21.15.181:57498) 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb259c640 1 -- 172.21.15.181:0/274180946 learned_addr learned my addr 172.21.15.181:0/274180946 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb1d9b640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8eb40d2da0 0x7f8eb41e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb2d9d640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8eb415c4a0 0x7f8eb41504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb259c640 1 -- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8eb40d2da0 msgr2=0x7f8eb41e4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb259c640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8eb40d2da0 0x7f8eb41e4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb259c640 1 -- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8eb415c4a0 msgr2=0x7f8eb41504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb259c640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8eb415c4a0 0x7f8eb41504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb259c640 1 -- 172.21.15.181:0/274180946 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb4150a30 con 0x7f8eb40b4090 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb2d9d640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8eb415c4a0 0x7f8eb41504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb259c640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40b4090 0x7f8eb41e5dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8ea802a220 tx=0x7f8ea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8ea2ffd640 1 -- 172.21.15.181:0/274180946 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8037040 con 0x7f8eb40b4090 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8ea2ffd640 1 -- 172.21.15.181:0/274180946 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8042070 con 0x7f8eb40b4090 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb41e4d30 con 0x7f8eb40b4090 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8ea2ffd640 1 -- 172.21.15.181:0/274180946 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8030880 con 0x7f8eb40b4090 2024-09-12T02:33:13.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.531+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb41e52f0 con 0x7f8eb40b4090 2024-09-12T02:33:13.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.532+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb40cff80 con 0x7f8eb40b4090 2024-09-12T02:33:13.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.532+0000 7f8ea2ffd640 1 -- 172.21.15.181:0/274180946 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ea8030a20 con 0x7f8eb40b4090 2024-09-12T02:33:13.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.533+0000 7f8ea2ffd640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e9406be60 0x7f8e9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.533+0000 7f8ea2ffd640 1 -- 172.21.15.181:0/274180946 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f8ea80ab5c0 con 0x7f8eb40b4090 2024-09-12T02:33:13.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.533+0000 7f8eb1d9b640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e9406be60 0x7f8e9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.533+0000 7f8eb1d9b640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e9406be60 0x7f8e9406e320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41f56f0 tx=0x7f8ea4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.537+0000 7f8ea2ffd640 1 -- 172.21.15.181:0/274180946 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ea8079f70 con 0x7f8eb40b4090 2024-09-12T02:33:13.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.709+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8eb40b36b0 con 0x7f8eb40b4090 2024-09-12T02:33:13.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.710+0000 7f8ea2ffd640 1 -- 172.21.15.181:0/274180946 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16967 (secure 0 0 0) 0x7f8ea8079870 con 0x7f8eb40b4090 2024-09-12T02:33:13.711 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:13.711 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":48,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:31:07.419859+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:29:50.557261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:29:50.907075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6837/1579385817":"2024-09-13T02:31:07.419830+0000","172.21.15.181:6836/1579385817":"2024-09-13T02:31:07.419830+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:13.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e9406be60 msgr2=0x7f8e9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e9406be60 0x7f8e9406e320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41f56f0 tx=0x7f8ea4009190 comp rx=0 tx=0).stop 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40b4090 msgr2=0x7f8eb41e5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40b4090 0x7f8eb41e5dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8ea802a220 tx=0x7f8ea80046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 shutdown_connections 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e9406be60 0x7f8e9406e320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8eb415c4a0 0x7f8eb41504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8eb40d2da0 0x7f8eb41e4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 --2- 172.21.15.181:0/274180946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8eb40b4090 0x7f8eb41e5dd0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 >> 172.21.15.181:0/274180946 conn(0x7f8eb4067950 msgr2=0x7f8eb415b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 shutdown_connections 2024-09-12T02:33:13.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.712+0000 7f8eb88d9640 1 -- 172.21.15.181:0/274180946 wait complete. 2024-09-12T02:33:13.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:33:13.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.825+0000 7fe05dc94640 1 Processor -- start 2024-09-12T02:33:13.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.825+0000 7fe05dc94640 1 -- start start 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.826+0000 7fe05dc94640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe05806c320 0x7fe0580b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.826+0000 7fe05dc94640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 0x7fe05815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.826+0000 7fe05dc94640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe05806e3c0 con 0x7fe058158c90 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.826+0000 7fe05dc94640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe05806e170 con 0x7fe05806c320 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.826+0000 7fe05dc94640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe05806e6a0 con 0x7fe0580b0610 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.826+0000 7fe0577fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe058158c90 0x7fe05806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48004/0 (socket says 172.21.15.181:48004) 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.826+0000 7fe0577fe640 1 -- 172.21.15.181:0/1676633670 learned_addr learned my addr 172.21.15.181:0/1676633670 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe057fff640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 0x7fe05815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891878498 0 0) 0x7fe05806e3c0 con 0x7fe058158c90 2024-09-12T02:33:13.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe056ffd640 1 --2- 172.21.15.181:0/1676633670 >> v2:172.21.15.204:3300/0 conn(0x7fe05806c320 0x7fe0580b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe040003520 con 0x7fe058158c90 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2515026752 0 0) 0x7fe040003520 con 0x7fe058158c90 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 msgr2=0x7fe05815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 0x7fe05815eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 >> v2:172.21.15.204:3300/0 conn(0x7fe05806c320 msgr2=0x7fe0580b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 --2- 172.21.15.181:0/1676633670 >> v2:172.21.15.204:3300/0 conn(0x7fe05806c320 0x7fe0580b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05806e980 con 0x7fe058158c90 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fe048001670 con 0x7fe058158c90 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 >> v1:172.21.15.181:6789/0 conn(0x7fe058158c90 legacy=0x7fe05806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0400039b0 0x7fe040003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe040004800 0x7fe040004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 0x7fe0400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe05806e170 con 0x7fe040004800 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe05806e6a0 con 0x7fe0400039b0 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe04000b9c0 con 0x7fe0580b0610 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe056ffd640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe040004800 0x7fe040004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe057fff640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 0x7fe0400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0577fe640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0400039b0 0x7fe040003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe056ffd640 1 -- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 msgr2=0x7fe0400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe056ffd640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0580b0610 0x7fe0400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe056ffd640 1 -- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0400039b0 msgr2=0x7fe040003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe056ffd640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0400039b0 0x7fe040003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe056ffd640 1 -- 172.21.15.181:0/1676633670 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe040003520 con 0x7fe040004800 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.827+0000 7fe0577fe640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe0400039b0 0x7fe040003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.828+0000 7fe056ffd640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe040004800 0x7fe040004c80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ac0 tx=0x7fe040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c03a748f7d4ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.828+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c036070 con 0x7fe040004800 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.828+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c031400 con 0x7fe040004800 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.828+0000 7fe0567fc640 1 -- 172.21.15.181:0/1676633670 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c009690 con 0x7fe040004800 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.829+0000 7fe05dc94640 1 -- 172.21.15.181:0/1676633670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe040004800 msgr2=0x7fe040004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.829+0000 7fe05dc94640 1 --2- 172.21.15.181:0/1676633670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe040004800 0x7fe040004c80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ac0 tx=0x7fe040005830 comp rx=0 tx=0).stop 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.829+0000 7fe057fff640 1 -- 172.21.15.181:0/1676633670 reap_dead start 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.829+0000 7fe05dc94640 1 -- 172.21.15.181:0/1676633670 shutdown_connections 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.829+0000 7fe05dc94640 1 -- 172.21.15.181:0/1676633670 >> 172.21.15.181:0/1676633670 conn(0x7fe058067b30 msgr2=0x7fe05806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.829+0000 7fe05dc94640 1 -- 172.21.15.181:0/1676633670 shutdown_connections 2024-09-12T02:33:13.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.829+0000 7fe05dc94640 1 -- 172.21.15.181:0/1676633670 wait complete. 2024-09-12T02:33:13.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.830+0000 7fe05dc94640 1 Processor -- start 2024-09-12T02:33:13.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.830+0000 7fe05dc94640 1 -- start start 2024-09-12T02:33:13.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe05dc94640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe040004800 0x7fe058152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe05dc94640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0581597f0 0x7fe058159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe05dc94640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0581e6e10 0x7fe0581e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe05dc94640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0580b4210 con 0x7fe0581597f0 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe05dc94640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe0580b0aa0 con 0x7fe040004800 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe05dc94640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe0580b4390 con 0x7fe0581e6e10 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0581597f0 0x7fe058159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0581597f0 0x7fe058159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57510/0 (socket says 172.21.15.181:57510) 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 -- 172.21.15.181:0/3961928031 learned_addr learned my addr 172.21.15.181:0/3961928031 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe0577fe640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe040004800 0x7fe058152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe057fff640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0581e6e10 0x7fe0581e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 -- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0581e6e10 msgr2=0x7fe0581e7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0581e6e10 0x7fe0581e7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 -- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe040004800 msgr2=0x7fe058152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe040004800 0x7fe058152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 -- 172.21.15.181:0/3961928031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0581e7e60 con 0x7fe0581597f0 2024-09-12T02:33:13.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe056ffd640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0581597f0 0x7fe058159c70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009be0 tx=0x7fe04c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe03ffff640 1 -- 172.21.15.181:0/3961928031 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c040020 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.831+0000 7fe03ffff640 1 -- 172.21.15.181:0/3961928031 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c0038d0 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.832+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0581f4450 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.832+0000 7fe03ffff640 1 -- 172.21.15.181:0/3961928031 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c036040 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.832+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0581f46f0 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.832+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0580d12c0 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.833+0000 7fe03ffff640 1 -- 172.21.15.181:0/3961928031 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe04c043020 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.833+0000 7fe03ffff640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe04406be30 0x7fe04406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.834+0000 7fe03ffff640 1 -- 172.21.15.181:0/3961928031 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7fe04c0ab030 con 0x7fe0581597f0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.834+0000 7fe0577fe640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe04406be30 0x7fe04406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.834+0000 7fe0577fe640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe04406be30 0x7fe04406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe048001050 tx=0x7fe048009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:13.838+0000 7fe03ffff640 1 -- 172.21.15.181:0/3961928031 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe04c04a070 con 0x7fe0581597f0 2024-09-12T02:33:14.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.037+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe058161a70 con 0x7fe0581597f0 2024-09-12T02:33:14.039 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:33:14.038+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:33:14.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.040+0000 7fe03ffff640 1 -- 172.21.15.181:0/3961928031 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7fe04c079950 con 0x7fe0581597f0 2024-09-12T02:33:14.040 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:33:14.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe04406be30 msgr2=0x7fe04406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe04406be30 0x7fe04406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe048001050 tx=0x7fe048009040 comp rx=0 tx=0).stop 2024-09-12T02:33:14.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0581597f0 msgr2=0x7fe058159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0581597f0 0x7fe058159c70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009be0 tx=0x7fe04c004730 comp rx=0 tx=0).stop 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 shutdown_connections 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe04406be30 0x7fe04406e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe0581e6e10 0x7fe0581e7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0581597f0 0x7fe058159c70 secure :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009be0 tx=0x7fe04c004730 comp rx=0 tx=0).stop 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 --2- 172.21.15.181:0/3961928031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe040004800 0x7fe058152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.042+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 >> 172.21.15.181:0/3961928031 conn(0x7fe058067b30 msgr2=0x7fe0580d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.043+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 shutdown_connections 2024-09-12T02:33:14.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.043+0000 7fe05dc94640 1 -- 172.21.15.181:0/3961928031 wait complete. 2024-09-12T02:33:14.047 INFO:tasks.ceph.mds.a.smithi181.stderr: -8379> 2024-09-12T02:32:13.434+0000 7f6f2d45c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:33:14.055 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:33:14.080 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:33:14.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.154+0000 7f88be32c640 1 Processor -- start 2024-09-12T02:33:14.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.154+0000 7f88be32c640 1 -- start start 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88be32c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b80b2530 0x7f88b80af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88be32c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88b8145700 0x7f88b80cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88be32c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b81454f0 con 0x7f88b8145110 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88be32c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f88b8073b60 con 0x7f88b8145700 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88be32c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f88b8072f50 con 0x7f88b80b2530 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88bc8c9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88b8145700 0x7f88b80cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88bc8c9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88b8145700 0x7f88b80cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57558/0 (socket says 172.21.15.181:57558) 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88bc8c9640 1 -- 172.21.15.181:0/1420987538 learned_addr learned my addr 172.21.15.181:0/1420987538 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88bc8c9640 1 -- 172.21.15.181:0/1420987538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b80b2530 msgr2=0x7f88b80af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:14.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88bc8c9640 1 --2- 172.21.15.181:0/1420987538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b80b2530 0x7f88b80af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88bc8c9640 1 -- 172.21.15.181:0/1420987538 >> v1:172.21.15.204:6789/0 conn(0x7f88b8145110 legacy=0x7f88b80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:14.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.155+0000 7f88bc8c9640 1 -- 172.21.15.181:0/1420987538 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b8073230 con 0x7f88b8145700 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.156+0000 7f88bc8c9640 1 --2- 172.21.15.181:0/1420987538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145700 0x7f88b80cf730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009e50 tx=0x7f88b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c131d464586f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.156+0000 7f88b6ffd640 1 -- 172.21.15.181:0/1420987538 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0036070 con 0x7f88b8145700 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.156+0000 7f88b6ffd640 1 -- 172.21.15.181:0/1420987538 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b0031600 con 0x7f88b8145700 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.156+0000 7f88b6ffd640 1 -- 172.21.15.181:0/1420987538 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b00319d0 con 0x7f88b8145700 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.156+0000 7f88be32c640 1 -- 172.21.15.181:0/1420987538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145700 msgr2=0x7f88b80cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.156+0000 7f88be32c640 1 --2- 172.21.15.181:0/1420987538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145700 0x7f88b80cf730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009e50 tx=0x7f88b002a660 comp rx=0 tx=0).stop 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.157+0000 7f88be32c640 1 -- 172.21.15.181:0/1420987538 shutdown_connections 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.157+0000 7f88be32c640 1 --2- 172.21.15.181:0/1420987538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145700 0x7f88b80cf730 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.157+0000 7f88be32c640 1 --2- 172.21.15.181:0/1420987538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b80b2530 0x7f88b80af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.157+0000 7f88be32c640 1 -- 172.21.15.181:0/1420987538 >> 172.21.15.181:0/1420987538 conn(0x7f88b806bc10 msgr2=0x7f88b806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:14.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.157+0000 7f88be32c640 1 -- 172.21.15.181:0/1420987538 shutdown_connections 2024-09-12T02:33:14.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.157+0000 7f88be32c640 1 -- 172.21.15.181:0/1420987538 wait complete. 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.158+0000 7f88be32c640 1 Processor -- start 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.158+0000 7f88be32c640 1 -- start start 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88b80b2530 0x7f88b80b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145110 0x7f88b815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b8145700 0x7f88b81e5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f88b80cfc70 con 0x7f88b8145110 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f88b80737f0 con 0x7f88b80b2530 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f88b80cfdf0 con 0x7f88b8145700 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145110 0x7f88b815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145110 0x7f88b815bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57568/0 (socket says 172.21.15.181:57568) 2024-09-12T02:33:14.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 -- 172.21.15.181:0/1567688197 learned_addr learned my addr 172.21.15.181:0/1567688197 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b7fff640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88b80b2530 0x7f88b80b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88bc8c9640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b8145700 0x7f88b81e5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 -- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b8145700 msgr2=0x7f88b81e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b8145700 0x7f88b81e5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 -- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88b80b2530 msgr2=0x7f88b80b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88b80b2530 0x7f88b80b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 -- 172.21.15.181:0/1567688197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b80b3f80 con 0x7f88b8145110 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b77fe640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145110 0x7f88b815bf50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f88ac006fd0 tx=0x7f88ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b4ff9640 1 -- 172.21.15.181:0/1567688197 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011830 con 0x7f88b8145110 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b4ff9640 1 -- 172.21.15.181:0/1567688197 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac016070 con 0x7f88b8145110 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b80b4260 con 0x7f88b8145110 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88b4ff9640 1 -- 172.21.15.181:0/1567688197 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011c30 con 0x7f88b8145110 2024-09-12T02:33:14.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.159+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b80b4820 con 0x7f88b8145110 2024-09-12T02:33:14.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.160+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b8069170 con 0x7f88b8145110 2024-09-12T02:33:14.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.161+0000 7f88b4ff9640 1 -- 172.21.15.181:0/1567688197 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88ac01b460 con 0x7f88b8145110 2024-09-12T02:33:14.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.161+0000 7f88b4ff9640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f88a406be30 0x7f88a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.161+0000 7f88b4ff9640 1 -- 172.21.15.181:0/1567688197 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5939+0+0 (secure 0 0 0) 0x7f88ac08abe0 con 0x7f88b8145110 2024-09-12T02:33:14.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.161+0000 7f88b7fff640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f88a406be30 0x7f88a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.162+0000 7f88b7fff640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f88a406be30 0x7f88a406e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88a80017f0 tx=0x7f88a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:14.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.166+0000 7f88b4ff9640 1 -- 172.21.15.181:0/1567688197 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88ac058dc0 con 0x7f88b8145110 2024-09-12T02:33:14.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:14.366+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f88b80af6f0 con 0x7f88b8145110 2024-09-12T02:33:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.041+0000 7f88b4ff9640 1 -- 172.21.15.181:0/1567688197 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7f88ac05d0c0 con 0x7f88b8145110 2024-09-12T02:33:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f88a406be30 msgr2=0x7f88a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f88a406be30 0x7f88a406e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88a80017f0 tx=0x7f88a8009040 comp rx=0 tx=0).stop 2024-09-12T02:33:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145110 msgr2=0x7f88b815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145110 0x7f88b815bf50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f88ac006fd0 tx=0x7f88ac00b8e0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 shutdown_connections 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f88a406be30 0x7f88a406e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f88b8145700 0x7f88b81e5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88b8145110 0x7f88b815bf50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 --2- 172.21.15.181:0/1567688197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f88b80b2530 0x7f88b80b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 >> 172.21.15.181:0/1567688197 conn(0x7f88b806bc10 msgr2=0x7f88b80afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 shutdown_connections 2024-09-12T02:33:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.043+0000 7f88be32c640 1 -- 172.21.15.181:0/1567688197 wait complete. 2024-09-12T02:33:15.057 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:33:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.202+0000 7f060d60e640 1 Processor -- start 2024-09-12T02:33:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.202+0000 7f060d60e640 1 -- start start 2024-09-12T02:33:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f060d60e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f06080d33d0 0x7f06080d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f060d60e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f060d60e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06080d3a40 con 0x7f060815e8a0 2024-09-12T02:33:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f060d60e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f06080d37f0 con 0x7f06080d33d0 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f060d60e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f06080d3d20 con 0x7f06080d4bf0 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f0606ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f060815e8a0 0x7f06080cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48012/0 (socket says 172.21.15.181:48012) 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f0606ffd640 1 -- 172.21.15.181:0/1996570105 learned_addr learned my addr 172.21.15.181:0/1996570105 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f06077fe640 1 --2- 172.21.15.181:0/1996570105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f05fffff640 1 --2- 172.21.15.181:0/1996570105 >> v2:172.21.15.204:3300/0 conn(0x7f06080d33d0 0x7f06080d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f06067fc640 1 -- 172.21.15.181:0/1996570105 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061123371 0 0) 0x7f06080d3a40 con 0x7f060815e8a0 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f06067fc640 1 -- 172.21.15.181:0/1996570105 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f4003520 con 0x7f060815e8a0 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f06077fe640 1 -- 172.21.15.181:0/1996570105 >> v2:172.21.15.204:3300/0 conn(0x7f06080d33d0 msgr2=0x7f06080d46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f06077fe640 1 --2- 172.21.15.181:0/1996570105 >> v2:172.21.15.204:3300/0 conn(0x7f06080d33d0 0x7f06080d46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f06077fe640 1 -- 172.21.15.181:0/1996570105 >> v1:172.21.15.181:6789/0 conn(0x7f060815e8a0 legacy=0x7f06080cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.203+0000 7f06077fe640 1 -- 172.21.15.181:0/1996570105 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06080d4000 con 0x7f06080d4bf0 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.204+0000 7f06077fe640 1 --2- 172.21.15.181:0/1996570105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080b7e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0600009d90 tx=0x7f060002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26434f1e00f1e338 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.204+0000 7f06067fc640 1 -- 172.21.15.181:0/1996570105 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600007740 con 0x7f06080d4bf0 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.204+0000 7f06067fc640 1 -- 172.21.15.181:0/1996570105 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06000078e0 con 0x7f06080d4bf0 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.204+0000 7f06067fc640 1 -- 172.21.15.181:0/1996570105 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600007c90 con 0x7f06080d4bf0 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 -- 172.21.15.181:0/1996570105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 msgr2=0x7f06080b7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 --2- 172.21.15.181:0/1996570105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080b7e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0600009d90 tx=0x7f060002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 -- 172.21.15.181:0/1996570105 shutdown_connections 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 --2- 172.21.15.181:0/1996570105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080b7e50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 --2- 172.21.15.181:0/1996570105 >> v2:172.21.15.204:3300/0 conn(0x7f06080d33d0 0x7f06080d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 -- 172.21.15.181:0/1996570105 >> 172.21.15.181:0/1996570105 conn(0x7f06080b6270 msgr2=0x7f06080b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 -- 172.21.15.181:0/1996570105 shutdown_connections 2024-09-12T02:33:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.205+0000 7f060d60e640 1 -- 172.21.15.181:0/1996570105 wait complete. 2024-09-12T02:33:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.206+0000 7f060d60e640 1 Processor -- start 2024-09-12T02:33:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.206+0000 7f060d60e640 1 -- start start 2024-09-12T02:33:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f060d60e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06080d33d0 0x7f06080cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f060d60e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f060d60e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f060815e8a0 0x7f0608152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f060d60e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06080b8390 con 0x7f060815e8a0 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f060d60e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f06080b78c0 con 0x7f06080d33d0 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f060d60e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f06080b8510 con 0x7f06080d4bf0 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f060815e8a0 0x7f0608152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f060815e8a0 0x7f0608152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57578/0 (socket says 172.21.15.181:57578) 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 -- 172.21.15.181:0/4069528355 learned_addr learned my addr 172.21.15.181:0/4069528355 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f0606ffd640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06080d33d0 0x7f06080cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 -- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 msgr2=0x7f06080ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f05fffff640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 -- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06080d33d0 msgr2=0x7f06080cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06080d33d0 0x7f06080cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 -- 172.21.15.181:0/4069528355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06081f4110 con 0x7f060815e8a0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f06077fe640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f060815e8a0 0x7f0608152b30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0600009eb0 tx=0x7f0600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.207+0000 7f05ff7fe640 1 -- 172.21.15.181:0/4069528355 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600040070 con 0x7f060815e8a0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.208+0000 7f05ff7fe640 1 -- 172.21.15.181:0/4069528355 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0600031c60 con 0x7f060815e8a0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.208+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06081f43f0 con 0x7f060815e8a0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.208+0000 7f05ff7fe640 1 -- 172.21.15.181:0/4069528355 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600009450 con 0x7f060815e8a0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.208+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081f49b0 con 0x7f060815e8a0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.208+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0608075a50 con 0x7f060815e8a0 2024-09-12T02:33:15.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.209+0000 7f05ff7fe640 1 -- 172.21.15.181:0/4069528355 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0600039040 con 0x7f060815e8a0 2024-09-12T02:33:15.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.209+0000 7f05ff7fe640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05e806be30 0x7f05e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.210+0000 7f05ff7fe640 1 -- 172.21.15.181:0/4069528355 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5939+0+0 (secure 0 0 0) 0x7f06000abee0 con 0x7f060815e8a0 2024-09-12T02:33:15.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.210+0000 7f0606ffd640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05e806be30 0x7f05e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.210+0000 7f0606ffd640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05e806be30 0x7f05e806e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0608161360 tx=0x7f05f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.214+0000 7f05ff7fe640 1 -- 172.21.15.181:0/4069528355 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f060007a7b0 con 0x7f060815e8a0 2024-09-12T02:33:15.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:15.379+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f06080b3dd0 con 0x7f060815e8a0 2024-09-12T02:33:16.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.047+0000 7f05ff7fe640 1 -- 172.21.15.181:0/4069528355 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7f060007a0b0 con 0x7f060815e8a0 2024-09-12T02:33:16.049 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.050+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05e806be30 msgr2=0x7f05e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05e806be30 0x7f05e806e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0608161360 tx=0x7f05f8009040 comp rx=0 tx=0).stop 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f060815e8a0 msgr2=0x7f0608152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f060815e8a0 0x7f0608152b30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0600009eb0 tx=0x7f0600004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 shutdown_connections 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f05e806be30 0x7f05e806e2f0 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0608161360 tx=0x7f05f8009040 comp rx=0 tx=0).stop 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f060815e8a0 0x7f0608152b30 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06080d4bf0 0x7f06080ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 --2- 172.21.15.181:0/4069528355 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06080d33d0 0x7f06080cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 >> 172.21.15.181:0/4069528355 conn(0x7f06080b6270 msgr2=0x7f06080b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 shutdown_connections 2024-09-12T02:33:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.051+0000 7f060d60e640 1 -- 172.21.15.181:0/4069528355 wait complete. 2024-09-12T02:33:16.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:33:16.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.169+0000 7f6921884640 1 Processor -- start 2024-09-12T02:33:16.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.169+0000 7f6921884640 1 -- start start 2024-09-12T02:33:16.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f6921884640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f691c15e8a0 0x7f691c0d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f6921884640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f691c0cf920 0x7f691c0d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f6921884640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691c0d3a40 con 0x7f691c0d4bf0 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f6921884640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f691c0d3d20 con 0x7f691c15e8a0 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f6921884640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f691c0d4000 con 0x7f691c0cf920 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f691c15e8a0 0x7f691c0d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691b7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f691c0d4bf0 0x7f691c0d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48018/0 (socket says 172.21.15.181:48018) 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f691c15e8a0 0x7f691c0d33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57582/0 (socket says 172.21.15.181:57582) 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691b7fe640 1 -- 172.21.15.181:0/2704938647 learned_addr learned my addr 172.21.15.181:0/2704938647 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691affd640 1 -- 172.21.15.181:0/2704938647 >> v2:172.21.15.204:3300/0 conn(0x7f691c0cf920 msgr2=0x7f691c0d46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f69127fc640 1 --2- 172.21.15.181:0/2704938647 >> v2:172.21.15.204:3300/0 conn(0x7f691c0cf920 0x7f691c0d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:16.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691affd640 1 --2- 172.21.15.181:0/2704938647 >> v2:172.21.15.204:3300/0 conn(0x7f691c0cf920 0x7f691c0d46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691a7fc640 1 -- 172.21.15.181:0/2704938647 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099584796 0 0) 0x7f691c0d3a40 con 0x7f691c0d4bf0 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691affd640 1 -- 172.21.15.181:0/2704938647 >> v1:172.21.15.181:6789/0 conn(0x7f691c0d4bf0 legacy=0x7f691c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f691affd640 1 -- 172.21.15.181:0/2704938647 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c0d42e0 con 0x7f691c15e8a0 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.170+0000 7f69127fc640 1 --2- 172.21.15.181:0/2704938647 >> v2:172.21.15.204:3300/0 conn(0x7f691c0cf920 0x7f691c0d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.171+0000 7f691affd640 1 --2- 172.21.15.181:0/2704938647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0d33d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f691c0b76b0 tx=0x7f690c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787b8e320d7c7448 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.171+0000 7f691a7fc640 1 -- 172.21.15.181:0/2704938647 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c037070 con 0x7f691c15e8a0 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.171+0000 7f691a7fc640 1 -- 172.21.15.181:0/2704938647 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c032440 con 0x7f691c15e8a0 2024-09-12T02:33:16.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.171+0000 7f691a7fc640 1 -- 172.21.15.181:0/2704938647 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c032810 con 0x7f691c15e8a0 2024-09-12T02:33:16.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.171+0000 7f6921884640 1 -- 172.21.15.181:0/2704938647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 msgr2=0x7f691c0d33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:16.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.171+0000 7f6921884640 1 --2- 172.21.15.181:0/2704938647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0d33d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f691c0b76b0 tx=0x7f690c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.172+0000 7f6921884640 1 -- 172.21.15.181:0/2704938647 shutdown_connections 2024-09-12T02:33:16.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.172+0000 7f6921884640 1 --2- 172.21.15.181:0/2704938647 >> v2:172.21.15.204:3300/0 conn(0x7f691c0cf920 0x7f691c0d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.172+0000 7f6921884640 1 --2- 172.21.15.181:0/2704938647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0d33d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.172+0000 7f6921884640 1 -- 172.21.15.181:0/2704938647 >> 172.21.15.181:0/2704938647 conn(0x7f691c0b6270 msgr2=0x7f691c0b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:16.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.172+0000 7f6921884640 1 -- 172.21.15.181:0/2704938647 shutdown_connections 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.172+0000 7f6921884640 1 -- 172.21.15.181:0/2704938647 wait complete. 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.173+0000 7f6921884640 1 Processor -- start 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.173+0000 7f6921884640 1 -- start start 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6921884640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f691c0cf920 0x7f691c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6921884640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f691c0d4bf0 0x7f691c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6921884640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6921884640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f691c0cfee0 con 0x7f691c15e8a0 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6921884640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f691c0cfd60 con 0x7f691c0cf920 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6921884640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f691c0b8e60 con 0x7f691c0d4bf0 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57590/0 (socket says 172.21.15.181:57590) 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 -- 172.21.15.181:0/704759106 learned_addr learned my addr 172.21.15.181:0/704759106 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:16.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f69127fc640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f691c0d4bf0 0x7f691c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691affd640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f691c0cf920 0x7f691c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 -- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f691c0d4bf0 msgr2=0x7f691c152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f691c0d4bf0 0x7f691c152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 -- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f691c0cf920 msgr2=0x7f691c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f691c0cf920 0x7f691c0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 -- 172.21.15.181:0/704759106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c15feb0 con 0x7f691c15e8a0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f691b7fe640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0cd740 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f691400c800 tx=0x7f691400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6918ff9640 1 -- 172.21.15.181:0/704759106 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6914018070 con 0x7f691c15e8a0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6918ff9640 1 -- 172.21.15.181:0/704759106 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6914004d80 con 0x7f691c15e8a0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6918ff9640 1 -- 172.21.15.181:0/704759106 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691400a880 con 0x7f691c15e8a0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.174+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c0ccc60 con 0x7f691c15e8a0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.175+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c0cd220 con 0x7f691c15e8a0 2024-09-12T02:33:16.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.175+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691c0cd420 con 0x7f691c15e8a0 2024-09-12T02:33:16.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.176+0000 7f6918ff9640 1 -- 172.21.15.181:0/704759106 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f691401b070 con 0x7f691c15e8a0 2024-09-12T02:33:16.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.176+0000 7f6918ff9640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68fc06be30 0x7f68fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:16.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.176+0000 7f6918ff9640 1 -- 172.21.15.181:0/704759106 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5501+0+0 (secure 0 0 0) 0x7f691408a2a0 con 0x7f691c15e8a0 2024-09-12T02:33:16.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.176+0000 7f691affd640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68fc06be30 0x7f68fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:16.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.177+0000 7f691affd640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68fc06be30 0x7f68fc06e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f690c034000 tx=0x7f690c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:16.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.181+0000 7f6918ff9640 1 -- 172.21.15.181:0/704759106 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6914058e70 con 0x7f691c15e8a0 2024-09-12T02:33:16.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:16.344+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f691c153310 con 0x7f691c15e8a0 2024-09-12T02:33:16.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:16.736 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:17.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.049+0000 7f6918ff9640 1 -- 172.21.15.181:0/704759106 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7f691408a0c0 con 0x7f691c15e8a0 2024-09-12T02:33:17.050 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' removed 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.052+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68fc06be30 msgr2=0x7f68fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.052+0000 7f6921884640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68fc06be30 0x7f68fc06e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f690c034000 tx=0x7f690c02e000 comp rx=0 tx=0).stop 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.052+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 msgr2=0x7f691c0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.052+0000 7f6921884640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0cd740 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f691400c800 tx=0x7f691400ccc0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 shutdown_connections 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f68fc06be30 0x7f68fc06e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f691c15e8a0 0x7f691c0cd740 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f691c0d4bf0 0x7f691c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 --2- 172.21.15.181:0/704759106 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f691c0cf920 0x7f691c0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 >> 172.21.15.181:0/704759106 conn(0x7f691c0b6270 msgr2=0x7f691c0b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:17.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 shutdown_connections 2024-09-12T02:33:17.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.053+0000 7f6921884640 1 -- 172.21.15.181:0/704759106 wait complete. 2024-09-12T02:33:17.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:33:17.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.175+0000 7f1097f42640 1 Processor -- start 2024-09-12T02:33:17.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.175+0000 7f1097f42640 1 -- start start 2024-09-12T02:33:17.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1097f42640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 0x7f109015ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1097f42640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1090067ba0 con 0x7f10900cffa0 2024-09-12T02:33:17.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1097f42640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1090067e80 con 0x7f10900b5a50 2024-09-12T02:33:17.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1097f42640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1090067950 con 0x7f109015e660 2024-09-12T02:33:17.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f10964df640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f10900cffa0 0x7f10900b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48024/0 (socket says 172.21.15.181:48024) 2024-09-12T02:33:17.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f10964df640 1 -- 172.21.15.181:0/540051854 learned_addr learned my addr 172.21.15.181:0/540051854 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040578142 0 0) 0x7f1090067ba0 con 0x7f10900cffa0 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f107c003520 con 0x7f10900cffa0 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1095cde640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 0x7f109015ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4293931752 0 0) 0x7f107c003520 con 0x7f10900cffa0 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 msgr2=0x7f109015ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 0x7f109015ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 >> v1:172.21.15.204:6789/0 conn(0x7f10900b5a50 legacy=0x7f10900cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10900b3be0 con 0x7f10900cffa0 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f10880019f0 con 0x7f10900cffa0 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 >> v1:172.21.15.181:6789/0 conn(0x7f10900cffa0 legacy=0x7f10900b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f107c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f107c004800 0x7f107c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.176+0000 7f1094cdc640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 0x7f107c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1090067950 con 0x7f107c0039e0 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f107c00bb00 con 0x7f107c004800 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f107c00bd00 con 0x7f109015e660 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1095cde640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f107c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f10954dd640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f107c004800 0x7f107c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f10964df640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 0x7f107c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1095cde640 1 -- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 msgr2=0x7f107c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1095cde640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015e660 0x7f107c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1095cde640 1 -- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f107c004800 msgr2=0x7f107c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1095cde640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f107c004800 0x7f107c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f1095cde640 1 -- 172.21.15.181:0/540051854 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c003520 con 0x7f107c0039e0 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.177+0000 7f10954dd640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f107c004800 0x7f107c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:17.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1095cde640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f107c003e00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f108c009a90 tx=0x7f107c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9b5805e0f44edf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c036070 con 0x7f107c0039e0 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c031400 con 0x7f107c0039e0 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1094cdc640 1 -- 172.21.15.181:0/540051854 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c009690 con 0x7f107c0039e0 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1097f42640 1 -- 172.21.15.181:0/540051854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 msgr2=0x7f107c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1097f42640 1 --2- 172.21.15.181:0/540051854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f107c003e00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f108c009a90 tx=0x7f107c005830 comp rx=0 tx=0).stop 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f10964df640 1 -- 172.21.15.181:0/540051854 reap_dead start 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1097f42640 1 -- 172.21.15.181:0/540051854 shutdown_connections 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1097f42640 1 -- 172.21.15.181:0/540051854 >> 172.21.15.181:0/540051854 conn(0x7f10900cd400 msgr2=0x7f10900cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1097f42640 1 -- 172.21.15.181:0/540051854 shutdown_connections 2024-09-12T02:33:17.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.178+0000 7f1097f42640 1 -- 172.21.15.181:0/540051854 wait complete. 2024-09-12T02:33:17.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.179+0000 7f1097f42640 1 Processor -- start 2024-09-12T02:33:17.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.179+0000 7f1097f42640 1 -- start start 2024-09-12T02:33:17.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1097f42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f1090145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1097f42640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1090153200 0x7f10901519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1097f42640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015f250 0x7f109013ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1097f42640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f109015ea40 con 0x7f107c0039e0 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1097f42640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f10900b3990 con 0x7f1090153200 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1097f42640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f109015ebc0 con 0x7f109015f250 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1095cde640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f1090145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1095cde640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f1090145c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57600/0 (socket says 172.21.15.181:57600) 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f1095cde640 1 -- 172.21.15.181:0/1883083493 learned_addr learned my addr 172.21.15.181:0/1883083493 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f10964df640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015f250 0x7f109013ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.180+0000 7f10954dd640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1090153200 0x7f10901519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1095cde640 1 -- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015f250 msgr2=0x7f109013ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1095cde640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015f250 0x7f109013ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1095cde640 1 -- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1090153200 msgr2=0x7f10901519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1095cde640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1090153200 0x7f10901519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1095cde640 1 -- 172.21.15.181:0/1883083493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1090152160 con 0x7f107c0039e0 2024-09-12T02:33:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f10954dd640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1090153200 0x7f10901519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1095cde640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f1090145c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f108c009bb0 tx=0x7f108c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f10867fc640 1 -- 172.21.15.181:0/1883083493 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c040020 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f10867fc640 1 -- 172.21.15.181:0/1883083493 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c003bc0 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1090152440 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f10867fc640 1 -- 172.21.15.181:0/1883083493 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c036040 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.181+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1090152a00 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.182+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1090069170 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.182+0000 7f10867fc640 1 -- 172.21.15.181:0/1883083493 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f108c043020 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.183+0000 7f10867fc640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f107406be60 0x7f107406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.183+0000 7f10954dd640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f107406be60 0x7f107406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.183+0000 7f10867fc640 1 -- 172.21.15.181:0/1883083493 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7f108c0aae80 con 0x7f107c0039e0 2024-09-12T02:33:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.183+0000 7f10954dd640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f107406be60 0x7f107406e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f10900b1d40 tx=0x7f1080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:17.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.187+0000 7f10867fc640 1 -- 172.21.15.181:0/1883083493 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f108c04a030 con 0x7f107c0039e0 2024-09-12T02:33:17.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.350+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f10900cf870 con 0x7f107c0039e0 2024-09-12T02:33:17.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.354+0000 7f10867fc640 1 -- 172.21.15.181:0/1883083493 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f108c0044e0 con 0x7f107c0039e0 2024-09-12T02:33:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f107406be60 msgr2=0x7f107406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f107406be60 0x7f107406e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f10900b1d40 tx=0x7f1080009040 comp rx=0 tx=0).stop 2024-09-12T02:33:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 msgr2=0x7f1090145c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f1090145c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f108c009bb0 tx=0x7f108c004730 comp rx=0 tx=0).stop 2024-09-12T02:33:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 shutdown_connections 2024-09-12T02:33:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f107406be60 0x7f107406e320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1090153200 0x7f10901519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109015f250 0x7f109013ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 --2- 172.21.15.181:0/1883083493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f107c0039e0 0x7f1090145c80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 >> 172.21.15.181:0/1883083493 conn(0x7f10900cd400 msgr2=0x7f109015cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 shutdown_connections 2024-09-12T02:33:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.356+0000 7f1097f42640 1 -- 172.21.15.181:0/1883083493 wait complete. 2024-09-12T02:33:17.367 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2024-09-12T02:33:17.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.464+0000 7f2f63f1a640 1 Processor -- start 2024-09-12T02:33:17.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.464+0000 7f2f63f1a640 1 -- start start 2024-09-12T02:33:17.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f63f1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0cdae0 0x7f2f5c0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f63f1a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f5c0b4cd0 0x7f2f5c0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f63f1a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c15c370 con 0x7f2f5c15bf90 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f63f1a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c0ce480 con 0x7f2f5c0b4cd0 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f63f1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c0d0240 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f624b7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f5c0b4cd0 0x7f2f5c0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f624b7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f5c0b4cd0 0x7f2f5c0b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57616/0 (socket says 172.21.15.181:57616) 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.465+0000 7f2f624b7640 1 -- 172.21.15.181:0/2399885876 learned_addr learned my addr 172.21.15.181:0/2399885876 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.466+0000 7f2f614b5640 1 --2- 172.21.15.181:0/2399885876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0cdae0 0x7f2f5c0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.466+0000 7f2f624b7640 1 -- 172.21.15.181:0/2399885876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0cdae0 msgr2=0x7f2f5c0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.466+0000 7f2f624b7640 1 --2- 172.21.15.181:0/2399885876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0cdae0 0x7f2f5c0cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.466+0000 7f2f624b7640 1 -- 172.21.15.181:0/2399885876 >> v1:172.21.15.204:6789/0 conn(0x7f2f5c15bf90 legacy=0x7f2f5c15f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:17.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.466+0000 7f2f624b7640 1 -- 172.21.15.181:0/2399885876 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c0cf630 con 0x7f2f5c0b4cd0 2024-09-12T02:33:17.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.466+0000 7f2f624b7640 1 --2- 172.21.15.181:0/2399885876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0b5100 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009870 tx=0x7f2f5402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a366c9ead528891 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:17.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.466+0000 7f2f60cb4640 1 -- 172.21.15.181:0/2399885876 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54037070 con 0x7f2f5c0b4cd0 2024-09-12T02:33:17.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f60cb4640 1 -- 172.21.15.181:0/2399885876 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54032440 con 0x7f2f5c0b4cd0 2024-09-12T02:33:17.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f60cb4640 1 -- 172.21.15.181:0/2399885876 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54032810 con 0x7f2f5c0b4cd0 2024-09-12T02:33:17.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 -- 172.21.15.181:0/2399885876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0b4cd0 msgr2=0x7f2f5c0b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/2399885876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0b5100 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009870 tx=0x7f2f5402a210 comp rx=0 tx=0).stop 2024-09-12T02:33:17.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 -- 172.21.15.181:0/2399885876 shutdown_connections 2024-09-12T02:33:17.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/2399885876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0b5100 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/2399885876 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0cdae0 0x7f2f5c0cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 -- 172.21.15.181:0/2399885876 >> 172.21.15.181:0/2399885876 conn(0x7f2f5c0b1770 msgr2=0x7f2f5c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:17.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 -- 172.21.15.181:0/2399885876 shutdown_connections 2024-09-12T02:33:17.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.467+0000 7f2f63f1a640 1 -- 172.21.15.181:0/2399885876 wait complete. 2024-09-12T02:33:17.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.468+0000 7f2f63f1a640 1 Processor -- start 2024-09-12T02:33:17.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.468+0000 7f2f63f1a640 1 -- start start 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f63f1a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f63f1a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0cdae0 0x7f2f5c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f63f1a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f5c15bf90 0x7f2f5c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f63f1a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0cfed0 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f63f1a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0cfbf0 con 0x7f2f5c15bf90 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f63f1a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c0ce830 con 0x7f2f5c0b4cd0 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0cdae0 0x7f2f5c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0cdae0 0x7f2f5c156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57620/0 (socket says 172.21.15.181:57620) 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 -- 172.21.15.181:0/4151797416 learned_addr learned my addr 172.21.15.181:0/4151797416 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f61cb6640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f624b7640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f5c15bf90 0x7f2f5c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 -- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0b4cd0 msgr2=0x7f2f5c0ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 -- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f5c15bf90 msgr2=0x7f2f5c0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f5c15bf90 0x7f2f5c0acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f614b5640 1 -- 172.21.15.181:0/4151797416 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c15f920 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.469+0000 7f2f61cb6640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.470+0000 7f2f614b5640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0cdae0 0x7f2f5c156ec0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c7f0 tx=0x7f2f4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.470+0000 7f2f527fc640 1 -- 172.21.15.181:0/4151797416 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c015070 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.470+0000 7f2f527fc640 1 -- 172.21.15.181:0/4151797416 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c004240 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.470+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c15fc00 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.470+0000 7f2f527fc640 1 -- 172.21.15.181:0/4151797416 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c007620 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.470+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1604a0 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.471+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c15fdd0 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.471+0000 7f2f527fc640 1 -- 172.21.15.181:0/4151797416 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f4c0077c0 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.472+0000 7f2f527fc640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4006be30 0x7f2f4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:17.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.472+0000 7f2f527fc640 1 -- 172.21.15.181:0/4151797416 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7f2f4c08ae70 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.472+0000 7f2f61cb6640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4006be30 0x7f2f4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:17.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.472+0000 7f2f61cb6640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4006be30 0x7f2f4006e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c1f77e0 tx=0x7f2f58009570 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:17.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.476+0000 7f2f527fc640 1 -- 172.21.15.181:0/4151797416 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f4c059ac0 con 0x7f2f5c0cdae0 2024-09-12T02:33:17.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:17.706+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) -- 0x7f2f5c0cf290 con 0x7f2f5c0cdae0 2024-09-12T02:33:18.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.056+0000 7f2f527fc640 1 -- 172.21.15.181:0/4151797416 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v216) ==== 148+0+0 (secure 0 0 0) 0x7f2f4c0593c0 con 0x7f2f5c0cdae0 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4006be30 msgr2=0x7f2f4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4006be30 0x7f2f4006e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c1f77e0 tx=0x7f2f58009570 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0cdae0 msgr2=0x7f2f5c156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0cdae0 0x7f2f5c156ec0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c7f0 tx=0x7f2f4c00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 shutdown_connections 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2f4006be30 0x7f2f4006e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f5c15bf90 0x7f2f5c0acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f5c0cdae0 0x7f2f5c156ec0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 --2- 172.21.15.181:0/4151797416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f5c0b4cd0 0x7f2f5c0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 >> 172.21.15.181:0/4151797416 conn(0x7f2f5c0b1770 msgr2=0x7f2f5c15dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 shutdown_connections 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.059+0000 7f2f63f1a640 1 -- 172.21.15.181:0/4151797416 wait complete. 2024-09-12T02:33:18.071 INFO:tasks.cephfs_test_runner:test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-09-12T02:33:18.071 INFO:tasks.cephfs_test_runner:Starting test: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) That after forcibly modifying the backing store, we can get back into 2024-09-12T02:33:18.071 INFO:tasks.cephfs_test_runner:test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-12T02:33:18.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:18.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.169+0000 7f00aa12c640 1 Processor -- start 2024-09-12T02:33:18.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.169+0000 7f00aa12c640 1 -- start start 2024-09-12T02:33:18.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00aa12c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40cf200 0x7f00a40cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00aa12c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f00a40ce020 0x7f00a4154c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00aa12c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a40ce430 con 0x7f00a40afc70 2024-09-12T02:33:18.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00aa12c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f00a40cf780 con 0x7f00a40ce020 2024-09-12T02:33:18.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00aa12c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f00a40cfa60 con 0x7f00a40cf200 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a37fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f00a40afc70 0x7f00a415f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48028/0 (socket says 172.21.15.181:48028) 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a3fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f00a40ce020 0x7f00a4154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a37fe640 1 -- 172.21.15.181:0/1130502212 learned_addr learned my addr 172.21.15.181:0/1130502212 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a2ffd640 1 --2- 172.21.15.181:0/1130502212 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40cf200 0x7f00a40cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a3fff640 1 -- 172.21.15.181:0/1130502212 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40cf200 msgr2=0x7f00a40cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a3fff640 1 --2- 172.21.15.181:0/1130502212 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40cf200 0x7f00a40cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a3fff640 1 -- 172.21.15.181:0/1130502212 >> v1:172.21.15.181:6789/0 conn(0x7f00a40afc70 legacy=0x7f00a415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.170+0000 7f00a3fff640 1 -- 172.21.15.181:0/1130502212 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a40cfd40 con 0x7f00a40ce020 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.171+0000 7f00a3fff640 1 --2- 172.21.15.181:0/1130502212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40ce020 0x7f00a4154c50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f009c009d90 tx=0x7f009c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c1f1d032cfabe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.171+0000 7f00a27fc640 1 -- 172.21.15.181:0/1130502212 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c007740 con 0x7f00a40ce020 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.171+0000 7f00a27fc640 1 -- 172.21.15.181:0/1130502212 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c0078e0 con 0x7f00a40ce020 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.171+0000 7f00a27fc640 1 -- 172.21.15.181:0/1130502212 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c007cb0 con 0x7f00a40ce020 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 -- 172.21.15.181:0/1130502212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40ce020 msgr2=0x7f00a4154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 --2- 172.21.15.181:0/1130502212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40ce020 0x7f00a4154c50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f009c009d90 tx=0x7f009c02a560 comp rx=0 tx=0).stop 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 -- 172.21.15.181:0/1130502212 shutdown_connections 2024-09-12T02:33:18.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 --2- 172.21.15.181:0/1130502212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40ce020 0x7f00a4154c50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 --2- 172.21.15.181:0/1130502212 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40cf200 0x7f00a40cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 -- 172.21.15.181:0/1130502212 >> 172.21.15.181:0/1130502212 conn(0x7f00a40b1770 msgr2=0x7f00a40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 -- 172.21.15.181:0/1130502212 shutdown_connections 2024-09-12T02:33:18.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.172+0000 7f00aa12c640 1 -- 172.21.15.181:0/1130502212 wait complete. 2024-09-12T02:33:18.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.173+0000 7f00aa12c640 1 Processor -- start 2024-09-12T02:33:18.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.173+0000 7f00aa12c640 1 -- start start 2024-09-12T02:33:18.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00aa12c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40afc70 0x7f00a4143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00aa12c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40ce020 0x7f00a4146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00aa12c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cf200 0x7f00a4146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00aa12c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40b0050 con 0x7f00a40afc70 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00aa12c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40d0300 con 0x7f00a40cf200 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00aa12c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f00a40b01d0 con 0x7f00a40ce020 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40afc70 0x7f00a4143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40afc70 0x7f00a4143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57630/0 (socket says 172.21.15.181:57630) 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 -- 172.21.15.181:0/3498781543 learned_addr learned my addr 172.21.15.181:0/3498781543 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a2ffd640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40ce020 0x7f00a4146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a3fff640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cf200 0x7f00a4146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 -- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40ce020 msgr2=0x7f00a4146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40ce020 0x7f00a4146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 -- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cf200 msgr2=0x7f00a4146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cf200 0x7f00a4146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 -- 172.21.15.181:0/3498781543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a40abf00 con 0x7f00a40afc70 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a2ffd640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40ce020 0x7f00a4146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00a37fe640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40afc70 0x7f00a4143b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f009400c7f0 tx=0x7f009400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f008bfff640 1 -- 172.21.15.181:0/3498781543 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094018070 con 0x7f00a40afc70 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f008bfff640 1 -- 172.21.15.181:0/3498781543 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0094007500 con 0x7f00a40afc70 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a40ac1e0 con 0x7f00a40afc70 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.174+0000 7f008bfff640 1 -- 172.21.15.181:0/3498781543 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094004a20 con 0x7f00a40afc70 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.175+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a40ac7a0 con 0x7f00a40afc70 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.176+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a415f870 con 0x7f00a40afc70 2024-09-12T02:33:18.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.176+0000 7f008bfff640 1 -- 172.21.15.181:0/3498781543 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f009401b070 con 0x7f00a40afc70 2024-09-12T02:33:18.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.176+0000 7f008bfff640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f009006be30 0x7f009006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.176+0000 7f008bfff640 1 -- 172.21.15.181:0/3498781543 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7f009408a1b0 con 0x7f00a40afc70 2024-09-12T02:33:18.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.176+0000 7f00a2ffd640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f009006be30 0x7f009006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.177+0000 7f00a2ffd640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f009006be30 0x7f009006e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0098006fd0 tx=0x7f0098008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.181+0000 7f008bfff640 1 -- 172.21.15.181:0/3498781543 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00a415f870 con 0x7f00a40afc70 2024-09-12T02:33:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.346+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00a415ec30 con 0x7f00a40afc70 2024-09-12T02:33:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.347+0000 7f008bfff640 1 -- 172.21.15.181:0/3498781543 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+13238 (secure 0 0 0) 0x7f00a40ce430 con 0x7f00a40afc70 2024-09-12T02:33:18.348 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:18.348 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":51,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:33:17.048704+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6837/3622686732":"2024-09-13T02:33:14.039222+0000","172.21.15.181:6836/3622686732":"2024-09-13T02:33:14.039222+0000","172.21.15.181:6837/1579385817":"2024-09-13T02:31:07.419830+0000","172.21.15.181:6836/1579385817":"2024-09-13T02:31:07.419830+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f009006be30 msgr2=0x7f009006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f009006be30 0x7f009006e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0098006fd0 tx=0x7f0098008040 comp rx=0 tx=0).stop 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40afc70 msgr2=0x7f00a4143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40afc70 0x7f00a4143b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f009400c7f0 tx=0x7f009400ccb0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 shutdown_connections 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f009006be30 0x7f009006e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40cf200 0x7f00a4146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a40ce020 0x7f00a4146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 --2- 172.21.15.181:0/3498781543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40afc70 0x7f00a4143b40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 >> 172.21.15.181:0/3498781543 conn(0x7f00a40b1770 msgr2=0x7f00a4072020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 shutdown_connections 2024-09-12T02:33:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.349+0000 7f00aa12c640 1 -- 172.21.15.181:0/3498781543 wait complete. 2024-09-12T02:33:18.361 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:28:11.641634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:33:18.362 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:33:18.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.462+0000 7f4987dd8640 1 Processor -- start 2024-09-12T02:33:18.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.462+0000 7f4987dd8640 1 -- start start 2024-09-12T02:33:18.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4987dd8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49800b0990 0x7f49800aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4987dd8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f498006c320 0x7f49800b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4987dd8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498015fae0 con 0x7f49800b5030 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4987dd8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f498015ef60 con 0x7f49800b0990 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4987dd8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f498015f240 con 0x7f498006c320 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4985b74640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49800b0990 0x7f49800aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4985b74640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49800b0990 0x7f49800aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57642/0 (socket says 172.21.15.181:57642) 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4985b74640 1 -- 172.21.15.181:0/3595879361 learned_addr learned my addr 172.21.15.181:0/3595879361 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4985373640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f49800b5030 0x7f498006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48044/0 (socket says 172.21.15.181:48044) 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.463+0000 7f4986375640 1 --2- 172.21.15.181:0/3595879361 >> v2:172.21.15.204:3300/0 conn(0x7f498006c320 0x7f49800b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4985b74640 1 -- 172.21.15.181:0/3595879361 >> v2:172.21.15.204:3300/0 conn(0x7f498006c320 msgr2=0x7f49800b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4985b74640 1 --2- 172.21.15.181:0/3595879361 >> v2:172.21.15.204:3300/0 conn(0x7f498006c320 0x7f49800b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4985b74640 1 -- 172.21.15.181:0/3595879361 >> v1:172.21.15.181:6789/0 conn(0x7f49800b5030 legacy=0x7f498006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4985b74640 1 -- 172.21.15.181:0/3595879361 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498015f520 con 0x7f49800b0990 2024-09-12T02:33:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4984b72640 1 -- 172.21.15.181:0/3595879361 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858449654 0 0) 0x7f498015fae0 con 0x7f49800b5030 2024-09-12T02:33:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4985b74640 1 --2- 172.21.15.181:0/3595879361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b0990 0x7f49800aea80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f49800d12c0 tx=0x7f497c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d04d1fa9ad9ec0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4984b72640 1 -- 172.21.15.181:0/3595879361 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c037070 con 0x7f49800b0990 2024-09-12T02:33:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4984b72640 1 -- 172.21.15.181:0/3595879361 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c032440 con 0x7f49800b0990 2024-09-12T02:33:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.464+0000 7f4984b72640 1 -- 172.21.15.181:0/3595879361 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c032810 con 0x7f49800b0990 2024-09-12T02:33:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 -- 172.21.15.181:0/3595879361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b0990 msgr2=0x7f49800aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 --2- 172.21.15.181:0/3595879361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b0990 0x7f49800aea80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f49800d12c0 tx=0x7f497c02a150 comp rx=0 tx=0).stop 2024-09-12T02:33:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 -- 172.21.15.181:0/3595879361 shutdown_connections 2024-09-12T02:33:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 --2- 172.21.15.181:0/3595879361 >> v2:172.21.15.204:3300/0 conn(0x7f498006c320 0x7f49800b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 --2- 172.21.15.181:0/3595879361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b0990 0x7f49800aea80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 -- 172.21.15.181:0/3595879361 >> 172.21.15.181:0/3595879361 conn(0x7f49800b30f0 msgr2=0x7f49800b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 -- 172.21.15.181:0/3595879361 shutdown_connections 2024-09-12T02:33:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.465+0000 7f4987dd8640 1 -- 172.21.15.181:0/3595879361 wait complete. 2024-09-12T02:33:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.466+0000 7f4987dd8640 1 Processor -- start 2024-09-12T02:33:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.466+0000 7f4987dd8640 1 -- start start 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4987dd8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498006c320 0x7f49800cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4987dd8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49800b0990 0x7f498015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4987dd8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b5030 0x7f49801579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4987dd8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49800b0d70 con 0x7f49800b5030 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4987dd8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f49800aefc0 con 0x7f49800b0990 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4987dd8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f498015eb30 con 0x7f498006c320 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b5030 0x7f49801579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b5030 0x7f49801579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57650/0 (socket says 172.21.15.181:57650) 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 -- 172.21.15.181:0/1736874834 learned_addr learned my addr 172.21.15.181:0/1736874834 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4985b74640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498006c320 0x7f49800cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4985373640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49800b0990 0x7f498015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 -- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498006c320 msgr2=0x7f49800cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498006c320 0x7f49800cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 -- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49800b0990 msgr2=0x7f498015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49800b0990 0x7f498015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.467+0000 7f4986375640 1 -- 172.21.15.181:0/1736874834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49800d0630 con 0x7f49800b5030 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.468+0000 7f4986375640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b5030 0x7f49801579d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4978007e30 tx=0x7f497800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.468+0000 7f49767fc640 1 -- 172.21.15.181:0/1736874834 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978014620 con 0x7f49800b5030 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.468+0000 7f49767fc640 1 -- 172.21.15.181:0/1736874834 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978019070 con 0x7f49800b5030 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.468+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49800cf590 con 0x7f49800b5030 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.468+0000 7f49767fc640 1 -- 172.21.15.181:0/1736874834 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978014a00 con 0x7f49800b5030 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.468+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49800cfe30 con 0x7f49800b5030 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.469+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49800cf980 con 0x7f49800b5030 2024-09-12T02:33:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.469+0000 7f49767fc640 1 -- 172.21.15.181:0/1736874834 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4978014ba0 con 0x7f49800b5030 2024-09-12T02:33:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.469+0000 7f49767fc640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f496406be30 0x7f496406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.470+0000 7f49767fc640 1 -- 172.21.15.181:0/1736874834 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7f497808b4e0 con 0x7f49800b5030 2024-09-12T02:33:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.470+0000 7f4985b74640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f496406be30 0x7f496406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.470+0000 7f4985b74640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f496406be30 0x7f496406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f497c034000 tx=0x7f497c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.474+0000 7f49767fc640 1 -- 172.21.15.181:0/1736874834 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49800d0630 con 0x7f49800b5030 2024-09-12T02:33:18.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.637+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49800b54a0 con 0x7f49800b5030 2024-09-12T02:33:18.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.638+0000 7f49767fc640 1 -- 172.21.15.181:0/1736874834 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f497805a130 con 0x7f49800b5030 2024-09-12T02:33:18.639 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 1 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f496406be30 msgr2=0x7f496406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f496406be30 0x7f496406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f497c034000 tx=0x7f497c02e000 comp rx=0 tx=0).stop 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b5030 msgr2=0x7f49801579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b5030 0x7f49801579d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4978007e30 tx=0x7f497800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 shutdown_connections 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f496406be30 0x7f496406e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49800b0990 0x7f498015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49800b5030 0x7f49801579d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 --2- 172.21.15.181:0/1736874834 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498006c320 0x7f49800cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 >> 172.21.15.181:0/1736874834 conn(0x7f49800b30f0 msgr2=0x7f498006cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 shutdown_connections 2024-09-12T02:33:18.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.640+0000 7f4987dd8640 1 -- 172.21.15.181:0/1736874834 wait complete. 2024-09-12T02:33:18.652 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset' 2024-09-12T02:33:18.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.750+0000 7f328d077640 1 Processor -- start 2024-09-12T02:33:18.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.750+0000 7f328d077640 1 -- start start 2024-09-12T02:33:18.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328d077640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3288156990 0x7f32880cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328d077640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f32880cd6b0 0x7f32880b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328d077640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32880ce160 con 0x7f32880b22c0 2024-09-12T02:33:18.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328d077640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3288156d70 con 0x7f32880cd6b0 2024-09-12T02:33:18.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328d077640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32880cdb10 con 0x7f3288156990 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328659c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f32880cd6b0 0x7f32880b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328759e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f32880b22c0 0x7f328815fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:48050/0 (socket says 172.21.15.181:48050) 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328759e640 1 -- 172.21.15.181:0/3813635484 learned_addr learned my addr 172.21.15.181:0/3813635484 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328659c640 1 -- 172.21.15.181:0/3813635484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3288156990 msgr2=0x7f32880cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f3286d9d640 1 --2- 172.21.15.181:0/3813635484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3288156990 0x7f32880cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328659c640 1 --2- 172.21.15.181:0/3813635484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3288156990 0x7f32880cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328659c640 1 -- 172.21.15.181:0/3813635484 >> v1:172.21.15.181:6789/0 conn(0x7f32880b22c0 legacy=0x7f328815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f3285d9b640 1 -- 172.21.15.181:0/3813635484 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903454124 0 0) 0x7f32880ce160 con 0x7f32880b22c0 2024-09-12T02:33:18.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.751+0000 7f328659c640 1 -- 172.21.15.181:0/3813635484 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32880731f0 con 0x7f32880cd6b0 2024-09-12T02:33:18.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.752+0000 7f328659c640 1 --2- 172.21.15.181:0/3813635484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880cd6b0 0x7f32880b1d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e774dfe7b9d193 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.752+0000 7f3285d9b640 1 -- 172.21.15.181:0/3813635484 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c037070 con 0x7f32880cd6b0 2024-09-12T02:33:18.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.752+0000 7f3285d9b640 1 -- 172.21.15.181:0/3813635484 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c02ae50 con 0x7f32880cd6b0 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.752+0000 7f3285d9b640 1 -- 172.21.15.181:0/3813635484 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c032660 con 0x7f32880cd6b0 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 -- 172.21.15.181:0/3813635484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880cd6b0 msgr2=0x7f32880b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 --2- 172.21.15.181:0/3813635484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880cd6b0 0x7f32880b1d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c02a100 comp rx=0 tx=0).stop 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 -- 172.21.15.181:0/3813635484 shutdown_connections 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 --2- 172.21.15.181:0/3813635484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880cd6b0 0x7f32880b1d80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 --2- 172.21.15.181:0/3813635484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3288156990 0x7f32880cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 -- 172.21.15.181:0/3813635484 >> 172.21.15.181:0/3813635484 conn(0x7f328806bc10 msgr2=0x7f328806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 -- 172.21.15.181:0/3813635484 shutdown_connections 2024-09-12T02:33:18.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.753+0000 7f328d077640 1 -- 172.21.15.181:0/3813635484 wait complete. 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.754+0000 7f328d077640 1 Processor -- start 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.754+0000 7f328d077640 1 -- start start 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f328d077640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880b22c0 0x7f3288159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f328d077640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32880cd6b0 0x7f328815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f328d077640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3288156990 0x7f32881f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f328d077640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32880ce720 con 0x7f32880b22c0 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f328d077640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f32880cea90 con 0x7f3288156990 2024-09-12T02:33:18.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f328d077640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32880b26f0 con 0x7f32880cd6b0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880b22c0 0x7f3288159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880b22c0 0x7f3288159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57658/0 (socket says 172.21.15.181:57658) 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 -- 172.21.15.181:0/715099662 learned_addr learned my addr 172.21.15.181:0/715099662 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f328759e640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3288156990 0x7f32881f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 -- 172.21.15.181:0/715099662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32880cd6b0 msgr2=0x7f328815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32880cd6b0 0x7f328815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 -- 172.21.15.181:0/715099662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3288156990 msgr2=0x7f32881f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3288156990 0x7f32881f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.755+0000 7f3286d9d640 1 -- 172.21.15.181:0/715099662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328815de90 con 0x7f32880b22c0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.756+0000 7f3286d9d640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880b22c0 0x7f3288159ba0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f327800ccd0 tx=0x7f327800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.756+0000 7f326f7fe640 1 -- 172.21.15.181:0/715099662 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278003990 con 0x7f32880b22c0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.756+0000 7f326f7fe640 1 -- 172.21.15.181:0/715099662 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3278003b30 con 0x7f32880b22c0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.756+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328815e170 con 0x7f32880b22c0 2024-09-12T02:33:18.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.756+0000 7f326f7fe640 1 -- 172.21.15.181:0/715099662 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278004020 con 0x7f32880b22c0 2024-09-12T02:33:18.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.756+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328815e730 con 0x7f32880b22c0 2024-09-12T02:33:18.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.757+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328806f7b0 con 0x7f32880b22c0 2024-09-12T02:33:18.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.757+0000 7f326f7fe640 1 -- 172.21.15.181:0/715099662 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32780041c0 con 0x7f32880b22c0 2024-09-12T02:33:18.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.758+0000 7f326f7fe640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f327406be30 0x7f327406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.758+0000 7f326f7fe640 1 -- 172.21.15.181:0/715099662 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7f327808b100 con 0x7f32880b22c0 2024-09-12T02:33:18.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.758+0000 7f328659c640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f327406be30 0x7f327406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.758+0000 7f328659c640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f327406be30 0x7f327406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f327c034000 tx=0x7f327c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.762+0000 7f326f7fe640 1 -- 172.21.15.181:0/715099662 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f328806f7b0 con 0x7f32880b22c0 2024-09-12T02:33:18.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:18.990+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]} v 0) -- 0x7f32880cd490 con 0x7f32880b22c0 2024-09-12T02:33:19.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.057+0000 7f326f7fe640 1 -- 172.21.15.181:0/715099662 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]}]=0 v217) ==== 143+0+0 (secure 0 0 0) 0x7f3278014030 con 0x7f32880b22c0 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f327406be30 msgr2=0x7f327406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f327406be30 0x7f327406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f327c034000 tx=0x7f327c02c000 comp rx=0 tx=0).stop 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880b22c0 msgr2=0x7f3288159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880b22c0 0x7f3288159ba0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f327800ccd0 tx=0x7f327800a5c0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 shutdown_connections 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f327406be30 0x7f327406e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3288156990 0x7f32881f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32880cd6b0 0x7f328815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 --2- 172.21.15.181:0/715099662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32880b22c0 0x7f3288159ba0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 >> 172.21.15.181:0/715099662 conn(0x7f328806bc10 msgr2=0x7f328815a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:19.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 shutdown_connections 2024-09-12T02:33:19.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.060+0000 7f328d077640 1 -- 172.21.15.181:0/715099662 wait complete. 2024-09-12T02:33:19.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:33:19.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.172+0000 7fd619c1e640 1 Processor -- start 2024-09-12T02:33:19.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.172+0000 7fd619c1e640 1 -- start start 2024-09-12T02:33:19.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd619c1e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 0x7fd6140b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd619c1e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd6140cfae0 0x7fd6140b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd619c1e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd6140b4cb0 0x7fd61415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd619c1e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd6140b5120 con 0x7fd6140b4cb0 2024-09-12T02:33:19.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd619c1e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd6140d0350 con 0x7fd6140cfae0 2024-09-12T02:33:19.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd619c1e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd6140d0630 con 0x7fd61415ab40 2024-09-12T02:33:19.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd6140b4cb0 0x7fd61415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd6140b4cb0 0x7fd61415af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57660/0 (socket says 172.21.15.181:57660) 2024-09-12T02:33:19.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 -- 172.21.15.181:0/839091359 learned_addr learned my addr 172.21.15.181:0/839091359 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:19.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 -- 172.21.15.181:0/839091359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 msgr2=0x7fd6140b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:19.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 --2- 172.21.15.181:0/839091359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 0x7fd6140b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 -- 172.21.15.181:0/839091359 >> v2:172.21.15.204:3300/0 conn(0x7fd6140cfae0 msgr2=0x7fd6140b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:19.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 --2- 172.21.15.181:0/839091359 >> v2:172.21.15.204:3300/0 conn(0x7fd6140cfae0 0x7fd6140b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.173+0000 7fd613fff640 1 -- 172.21.15.181:0/839091359 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6140d0910 con 0x7fd6140b4cb0 2024-09-12T02:33:19.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.174+0000 7fd613fff640 1 --2- 172.21.15.181:0/839091359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140b4cb0 0x7fd61415af20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd61406f0d0 tx=0x7fd60c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1311c3299a00fbb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.174+0000 7fd6127fc640 1 -- 172.21.15.181:0/839091359 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c036070 con 0x7fd6140b4cb0 2024-09-12T02:33:19.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.174+0000 7fd6127fc640 1 -- 172.21.15.181:0/839091359 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c031600 con 0x7fd6140b4cb0 2024-09-12T02:33:19.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.174+0000 7fd6127fc640 1 -- 172.21.15.181:0/839091359 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0319d0 con 0x7fd6140b4cb0 2024-09-12T02:33:19.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 -- 172.21.15.181:0/839091359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140b4cb0 msgr2=0x7fd61415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 --2- 172.21.15.181:0/839091359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140b4cb0 0x7fd61415af20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd61406f0d0 tx=0x7fd60c02a610 comp rx=0 tx=0).stop 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 -- 172.21.15.181:0/839091359 shutdown_connections 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 --2- 172.21.15.181:0/839091359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140b4cb0 0x7fd61415af20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 --2- 172.21.15.181:0/839091359 >> v2:172.21.15.204:3300/0 conn(0x7fd6140cfae0 0x7fd6140b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 --2- 172.21.15.181:0/839091359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 0x7fd6140b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 -- 172.21.15.181:0/839091359 >> 172.21.15.181:0/839091359 conn(0x7fd61406bc10 msgr2=0x7fd61406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 -- 172.21.15.181:0/839091359 shutdown_connections 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.175+0000 7fd619c1e640 1 -- 172.21.15.181:0/839091359 wait complete. 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.176+0000 7fd619c1e640 1 Processor -- start 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.176+0000 7fd619c1e640 1 -- start start 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd619c1e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6140b4cb0 0x7fd61414f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd619c1e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140cfae0 0x7fd614151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd619c1e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 0x7fd614151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd619c1e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd6140d00a0 con 0x7fd6140cfae0 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd619c1e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd6140cff20 con 0x7fd6140b4cb0 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd619c1e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd6140b1e90 con 0x7fd61415ab40 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140cfae0 0x7fd614151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140cfae0 0x7fd614151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57662/0 (socket says 172.21.15.181:57662) 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 -- 172.21.15.181:0/1863619369 learned_addr learned my addr 172.21.15.181:0/1863619369 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd6137fe640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6140b4cb0 0x7fd61414f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd613fff640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 0x7fd614151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 -- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 msgr2=0x7fd614151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 0x7fd614151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 -- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6140b4cb0 msgr2=0x7fd61414f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6140b4cb0 0x7fd61414f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd612ffd640 1 -- 172.21.15.181:0/1863619369 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd614148590 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.177+0000 7fd6137fe640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6140b4cb0 0x7fd61414f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.178+0000 7fd612ffd640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140cfae0 0x7fd614151420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd60800b450 tx=0x7fd60800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.178+0000 7fd5fbfff640 1 -- 172.21.15.181:0/1863619369 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608015020 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.178+0000 7fd5fbfff640 1 -- 172.21.15.181:0/1863619369 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd608011890 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.178+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61414f8c0 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.178+0000 7fd5fbfff640 1 -- 172.21.15.181:0/1863619369 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608011c80 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.178+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd614148830 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.179+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd614069170 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.179+0000 7fd5fbfff640 1 -- 172.21.15.181:0/1863619369 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd608018020 con 0x7fd6140cfae0 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.180+0000 7fd5fbfff640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd60006be60 0x7fd60006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.180+0000 7fd5fbfff640 1 -- 172.21.15.181:0/1863619369 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7fd60808ac40 con 0x7fd6140cfae0 2024-09-12T02:33:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.180+0000 7fd6137fe640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd60006be60 0x7fd60006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.180+0000 7fd6137fe640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd60006be60 0x7fd60006e320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6140cf310 tx=0x7fd604008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.184+0000 7fd5fbfff640 1 -- 172.21.15.181:0/1863619369 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd60801f020 con 0x7fd6140cfae0 2024-09-12T02:33:19.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.348+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd61414f630 con 0x7fd6140cfae0 2024-09-12T02:33:19.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.352+0000 7fd5fbfff640 1 -- 172.21.15.181:0/1863619369 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fd60800d040 con 0x7fd6140cfae0 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd60006be60 msgr2=0x7fd60006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd60006be60 0x7fd60006e320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6140cf310 tx=0x7fd604008040 comp rx=0 tx=0).stop 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140cfae0 msgr2=0x7fd614151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140cfae0 0x7fd614151420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd60800b450 tx=0x7fd60800b910 comp rx=0 tx=0).stop 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 shutdown_connections 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd60006be60 0x7fd60006e320 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd61415ab40 0x7fd614151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6140cfae0 0x7fd614151420 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 --2- 172.21.15.181:0/1863619369 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6140b4cb0 0x7fd61414f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 >> 172.21.15.181:0/1863619369 conn(0x7fd61406bc10 msgr2=0x7fd6140b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:19.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 shutdown_connections 2024-09-12T02:33:19.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.354+0000 7fd619c1e640 1 -- 172.21.15.181:0/1863619369 wait complete. 2024-09-12T02:33:19.366 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:33:19.366 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:33:19.405 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:33:19.453 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:33:19.502 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:33:19.502 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:19.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:33:19.541 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:33:19.541 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:19.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:33:19.560 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:33:19.560 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:19.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:33:19.597 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:33:19.597 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:19.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:33:19.619 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:33:19.620 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.736+0000 7f150b2a4640 1 Processor -- start 2024-09-12T02:33:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.736+0000 7f150b2a4640 1 -- start start 2024-09-12T02:33:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f150b2a4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1504156990 0x7f15040cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f150b2a4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15040cd6b0 0x7f15040b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f150b2a4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15040ce160 con 0x7f15040b22c0 2024-09-12T02:33:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f150b2a4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1504156d70 con 0x7f1504156990 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f150b2a4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f15040cdb10 con 0x7f15040cd6b0 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f1509040640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1504156990 0x7f15040cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f1509040640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1504156990 0x7f15040cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51894/0 (socket says 172.21.15.181:51894) 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f1509040640 1 -- 172.21.15.181:0/2168545437 learned_addr learned my addr 172.21.15.181:0/2168545437 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f1509040640 1 -- 172.21.15.181:0/2168545437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15040cd6b0 msgr2=0x7f15040b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f150883f640 1 --2- 172.21.15.181:0/2168545437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15040cd6b0 0x7f15040b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f1509040640 1 --2- 172.21.15.181:0/2168545437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15040cd6b0 0x7f15040b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f1509040640 1 -- 172.21.15.181:0/2168545437 >> v1:172.21.15.204:6789/0 conn(0x7f15040b22c0 legacy=0x7f150415fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:19.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f1509040640 1 -- 172.21.15.181:0/2168545437 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15040731f0 con 0x7f1504156990 2024-09-12T02:33:19.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.737+0000 7f150883f640 1 --2- 172.21.15.181:0/2168545437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15040cd6b0 0x7f15040b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:19.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.738+0000 7f1509040640 1 --2- 172.21.15.181:0/2168545437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1504156990 0x7f15040cd170 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f150002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e5ebd8de28fc6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.738+0000 7f14fbfff640 1 -- 172.21.15.181:0/2168545437 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500037070 con 0x7f1504156990 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.738+0000 7f14fbfff640 1 -- 172.21.15.181:0/2168545437 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500032440 con 0x7f1504156990 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.738+0000 7f14fbfff640 1 -- 172.21.15.181:0/2168545437 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500032810 con 0x7f1504156990 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 -- 172.21.15.181:0/2168545437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1504156990 msgr2=0x7f15040cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2168545437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1504156990 0x7f15040cd170 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f150002a180 comp rx=0 tx=0).stop 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 -- 172.21.15.181:0/2168545437 shutdown_connections 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2168545437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f15040cd6b0 0x7f15040b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2168545437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1504156990 0x7f15040cd170 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 -- 172.21.15.181:0/2168545437 >> 172.21.15.181:0/2168545437 conn(0x7f150406bc10 msgr2=0x7f150406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 -- 172.21.15.181:0/2168545437 shutdown_connections 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.739+0000 7f150b2a4640 1 -- 172.21.15.181:0/2168545437 wait complete. 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.740+0000 7f150b2a4640 1 Processor -- start 2024-09-12T02:33:19.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.740+0000 7f150b2a4640 1 -- start start 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150b2a4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15040b22c0 0x7f150415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150b2a4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15040cd6b0 0x7f1504144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150b2a4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1504156990 0x7f150415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150b2a4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15040ce720 con 0x7f15040b22c0 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150b2a4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f15040cea90 con 0x7f15040cd6b0 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150b2a4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f15040b26f0 con 0x7f1504156990 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15040b22c0 0x7f150415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15040b22c0 0x7f150415f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51908/0 (socket says 172.21.15.181:51908) 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 -- 172.21.15.181:0/2234412972 learned_addr learned my addr 172.21.15.181:0/2234412972 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:19.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 -- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1504156990 msgr2=0x7f150415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509841640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1504156990 0x7f150415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150883f640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15040cd6b0 0x7f1504144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1504156990 0x7f150415fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 -- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15040cd6b0 msgr2=0x7f1504144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15040cd6b0 0x7f1504144ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 -- 172.21.15.181:0/2234412972 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15041572e0 con 0x7f15040b22c0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f1509040640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15040b22c0 0x7f150415f4b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f15000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f14f9ffb640 1 -- 172.21.15.181:0/2234412972 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500041020 con 0x7f15040b22c0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f14f9ffb640 1 -- 172.21.15.181:0/2234412972 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500030970 con 0x7f15040b22c0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15041575c0 con 0x7f15040b22c0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.741+0000 7f14f9ffb640 1 -- 172.21.15.181:0/2234412972 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500037040 con 0x7f15040b22c0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.742+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1504157b80 con 0x7f15040b22c0 2024-09-12T02:33:19.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.743+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15040cf6e0 con 0x7f15040b22c0 2024-09-12T02:33:19.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.743+0000 7f14f9ffb640 1 -- 172.21.15.181:0/2234412972 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1500044020 con 0x7f15040b22c0 2024-09-12T02:33:19.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.744+0000 7f14f9ffb640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f14e806be30 0x7f14e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.744+0000 7f150883f640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f14e806be30 0x7f14e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.744+0000 7f14f9ffb640 1 -- 172.21.15.181:0/2234412972 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7f15000ab580 con 0x7f15040b22c0 2024-09-12T02:33:19.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.744+0000 7f150883f640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f14e806be30 0x7f14e806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f150415f9f0 tx=0x7f14f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.748+0000 7f14f9ffb640 1 -- 172.21.15.181:0/2234412972 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f150004b030 con 0x7f15040b22c0 2024-09-12T02:33:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.946+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f150406da90 con 0x7f15040b22c0 2024-09-12T02:33:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.946+0000 7f14f9ffb640 1 -- 172.21.15.181:0/2234412972 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3923 (secure 0 0 0) 0x7f150007a1d0 con 0x7f15040b22c0 2024-09-12T02:33:19.948 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:19.948 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":36,"btime":"2024-09-12T02:33:15:041038+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1325222346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1325222346},{"type":"v1","addr":"172.21.15.204:6834","nonce":1325222346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3516476112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3516476112},{"type":"v1","addr":"172.21.15.204:6835","nonce":3516476112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3335895251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3335895251},{"type":"v1","addr":"172.21.15.181:6835","nonce":3335895251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":6048,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3838597137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3838597137},{"type":"v1","addr":"172.21.15.181:6837","nonce":3838597137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[]} 2024-09-12T02:33:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 36 2024-09-12T02:33:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f14e806be30 msgr2=0x7f14e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f14e806be30 0x7f14e806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f150415f9f0 tx=0x7f14f4008040 comp rx=0 tx=0).stop 2024-09-12T02:33:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15040b22c0 msgr2=0x7f150415f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15040b22c0 0x7f150415f4b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f15000046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 shutdown_connections 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f14e806be30 0x7f14e806e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f15040cd6b0 0x7f1504144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1504156990 0x7f150415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 --2- 172.21.15.181:0/2234412972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15040b22c0 0x7f150415f4b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 >> 172.21.15.181:0/2234412972 conn(0x7f150406bc10 msgr2=0x7f150415bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 shutdown_connections 2024-09-12T02:33:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:19.948+0000 7f150b2a4640 1 -- 172.21.15.181:0/2234412972 wait complete. 2024-09-12T02:33:19.961 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:33:19.961 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:33:19.961 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:33:19.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:33:19.962 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:33:19.962 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:33:19.962 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:33:19.962 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:33:19.962 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:33:19.963 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:33:19.963 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:33:19.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:33:19.963 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:33:19.963 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:33:19.964 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:33:19.964 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:33:19.971 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:33:19.971 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:33:19.972 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:33:19.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:33:19.974 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:33:19.975 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:33:19.975 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:33:19.976 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:33:20.014 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:33:20.015 DEBUG:teuthology.parallel:result is None 2024-09-12T02:33:20.015 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:33:20.015 DEBUG:teuthology.parallel:result is None 2024-09-12T02:33:20.018 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:33:20.018 DEBUG:teuthology.parallel:result is None 2024-09-12T02:33:20.018 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:33:20.019 DEBUG:teuthology.parallel:result is None 2024-09-12T02:33:20.019 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:33:20.091 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:33:20.091 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:33:20.101 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:33:20.101 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:33:20.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.122+0000 7f36897a6640 1 Processor -- start 2024-09-12T02:33:20.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.122+0000 7f36897a6640 1 -- start start 2024-09-12T02:33:20.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.123+0000 7f36897a6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f36840d1670 0x7f368415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.123+0000 7f36897a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f3684162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.123+0000 7f36897a6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36840afa20 con 0x7f36840d1a50 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.123+0000 7f36897a6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f368415eef0 con 0x7f36840d1670 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.123+0000 7f36897a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f368415f170 con 0x7f3684162660 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.123+0000 7f367bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f36840d1a50 0x7f36840cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38898/0 (socket says 172.21.15.181:38898) 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.123+0000 7f367bfff640 1 -- 172.21.15.181:0/2451389225 learned_addr learned my addr 172.21.15.181:0/2451389225 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f36837fe640 1 --2- 172.21.15.181:0/2451389225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f3684162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f3682ffd640 1 --2- 172.21.15.181:0/2451389225 >> v2:172.21.15.204:3300/0 conn(0x7f36840d1670 0x7f368415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f36827fc640 1 -- 172.21.15.181:0/2451389225 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991975790 0 0) 0x7f366c001110 con 0x7f36840d1a50 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f36827fc640 1 -- 172.21.15.181:0/2451389225 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3670003520 con 0x7f36840d1a50 2024-09-12T02:33:20.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f36837fe640 1 -- 172.21.15.181:0/2451389225 >> v2:172.21.15.204:3300/0 conn(0x7f36840d1670 msgr2=0x7f368415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f36837fe640 1 --2- 172.21.15.181:0/2451389225 >> v2:172.21.15.204:3300/0 conn(0x7f36840d1670 0x7f368415e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f36837fe640 1 -- 172.21.15.181:0/2451389225 >> v1:172.21.15.181:6789/0 conn(0x7f36840d1a50 legacy=0x7f36840cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f36837fe640 1 -- 172.21.15.181:0/2451389225 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368415f450 con 0x7f3684162660 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.124+0000 7f3682ffd640 1 --2- 172.21.15.181:0/2451389225 >> v2:172.21.15.204:3300/0 conn(0x7f36840d1670 0x7f368415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36837fe640 1 --2- 172.21.15.181:0/2451389225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f3684162af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f367c009d90 tx=0x7f367c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5c99dec18256a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36827fc640 1 -- 172.21.15.181:0/2451389225 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c007740 con 0x7f3684162660 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36827fc640 1 -- 172.21.15.181:0/2451389225 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367c0078e0 con 0x7f3684162660 2024-09-12T02:33:20.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36827fc640 1 -- 172.21.15.181:0/2451389225 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c007c90 con 0x7f3684162660 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 -- 172.21.15.181:0/2451389225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 msgr2=0x7f3684162af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 --2- 172.21.15.181:0/2451389225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f3684162af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f367c009d90 tx=0x7f367c02a660 comp rx=0 tx=0).stop 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 -- 172.21.15.181:0/2451389225 shutdown_connections 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 --2- 172.21.15.181:0/2451389225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f3684162af0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 --2- 172.21.15.181:0/2451389225 >> v2:172.21.15.204:3300/0 conn(0x7f36840d1670 0x7f368415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 -- 172.21.15.181:0/2451389225 >> 172.21.15.181:0/2451389225 conn(0x7f368406d110 msgr2=0x7f368406d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 -- 172.21.15.181:0/2451389225 shutdown_connections 2024-09-12T02:33:20.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.125+0000 7f36897a6640 1 -- 172.21.15.181:0/2451389225 wait complete. 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 Processor -- start 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 -- start start 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36840d1670 0x7f36841578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36840d1a50 0x7f3684154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f368415a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f36840d1eb0 con 0x7f36840d1670 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f36840cf4e0 con 0x7f36840d1a50 2024-09-12T02:33:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36897a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f36840b01c0 con 0x7f3684162660 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f3682ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36840d1670 0x7f36841578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f3682ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36840d1670 0x7f36841578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51938/0 (socket says 172.21.15.181:51938) 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f3682ffd640 1 -- 172.21.15.181:0/3967428733 learned_addr learned my addr 172.21.15.181:0/3967428733 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f367bfff640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36840d1a50 0x7f3684154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.127+0000 7f36837fe640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f368415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f3682ffd640 1 -- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 msgr2=0x7f368415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f3682ffd640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f368415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f3682ffd640 1 -- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36840d1a50 msgr2=0x7f3684154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f3682ffd640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36840d1a50 0x7f3684154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f3682ffd640 1 -- 172.21.15.181:0/3967428733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3684157e30 con 0x7f36840d1670 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f367bfff640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36840d1a50 0x7f3684154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f3682ffd640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36840d1670 0x7f36841578f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f367400eca0 tx=0x7f367400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f367b7fe640 1 -- 172.21.15.181:0/3967428733 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674017070 con 0x7f36840d1670 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f367b7fe640 1 -- 172.21.15.181:0/3967428733 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367400cc30 con 0x7f36840d1670 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f36897a6640 1 -- 172.21.15.181:0/3967428733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36840b10b0 con 0x7f36840d1670 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f367b7fe640 1 -- 172.21.15.181:0/3967428733 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674013470 con 0x7f36840d1670 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.128+0000 7f36897a6640 1 -- 172.21.15.181:0/3967428733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36840b1670 con 0x7f36840d1670 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.129+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368415e9b0 con 0x7f36840d1670 2024-09-12T02:33:20.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.130+0000 7f367b7fe640 1 -- 172.21.15.181:0/3967428733 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f367401a070 con 0x7f36840d1670 2024-09-12T02:33:20.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.130+0000 7f367b7fe640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f366406be30 0x7f366406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.130+0000 7f367b7fe640 1 -- 172.21.15.181:0/3967428733 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5029+0+0 (secure 0 0 0) 0x7f367408aac0 con 0x7f36840d1670 2024-09-12T02:33:20.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.130+0000 7f367bfff640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f366406be30 0x7f366406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.130+0000 7f367bfff640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f366406be30 0x7f366406e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36841557f0 tx=0x7f366c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.134+0000 7f367b7fe640 1 -- 172.21.15.181:0/3967428733 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3684157e30 con 0x7f36840d1670 2024-09-12T02:33:20.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-12T02:33:20.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-12T02:33:20.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-12T02:33:20.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:20.310+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f368406e410 con 0x7f36840d1670 2024-09-12T02:33:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.364+0000 7f367b7fe640 1 -- 172.21.15.181:0/3967428733 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7f36740590c0 con 0x7f36840d1670 2024-09-12T02:33:21.365 INFO:teuthology.orchestra.run.smithi181.stderr: removed all blocklist entries 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.366+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f366406be30 msgr2=0x7f366406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.366+0000 7f36797fa640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f366406be30 0x7f366406e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36841557f0 tx=0x7f366c009040 comp rx=0 tx=0).stop 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.366+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36840d1670 msgr2=0x7f36841578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.366+0000 7f36797fa640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36840d1670 0x7f36841578f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f367400eca0 tx=0x7f367400c520 comp rx=0 tx=0).stop 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 shutdown_connections 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f366406be30 0x7f366406e2f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36840d1a50 0x7f3684154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3684162660 0x7f368415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 --2- 172.21.15.181:0/3967428733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36840d1670 0x7f36841578f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 >> 172.21.15.181:0/3967428733 conn(0x7f368406d110 msgr2=0x7f3684071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:21.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 shutdown_connections 2024-09-12T02:33:21.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.367+0000 7f36797fa640 1 -- 172.21.15.181:0/3967428733 wait complete. 2024-09-12T02:33:21.381 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:33:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.481+0000 7f31debfd640 1 Processor -- start 2024-09-12T02:33:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.481+0000 7f31debfd640 1 -- start start 2024-09-12T02:33:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31debfd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f31d80d08f0 0x7f31d815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31debfd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d80b2820 con 0x7f31d80b3800 2024-09-12T02:33:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31debfd640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d80b2b00 con 0x7f31d80d0510 2024-09-12T02:33:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31debfd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f31d8141730 con 0x7f31d80d08f0 2024-09-12T02:33:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f31d80b3800 0x7f31d8072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38906/0 (socket says 172.21.15.181:38906) 2024-09-12T02:33:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cffff640 1 -- 172.21.15.181:0/26934031 learned_addr learned my addr 172.21.15.181:0/26934031 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31dd19a640 1 --2- 172.21.15.181:0/26934031 >> v2:172.21.15.204:3300/0 conn(0x7f31d80d08f0 0x7f31d815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380751782 0 0) 0x7f31d80b2820 con 0x7f31d80b3800 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c0003520 con 0x7f31d80b3800 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3692644172 0 0) 0x7f31c0003520 con 0x7f31d80b3800 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 >> v2:172.21.15.204:3300/0 conn(0x7f31d80d08f0 msgr2=0x7f31d815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 --2- 172.21.15.181:0/26934031 >> v2:172.21.15.204:3300/0 conn(0x7f31d80d08f0 0x7f31d815ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 >> v1:172.21.15.204:6789/0 conn(0x7f31d80d0510 legacy=0x7f31d80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d8144320 con 0x7f31d80b3800 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f31c8001670 con 0x7f31d80b3800 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 >> v1:172.21.15.181:6789/0 conn(0x7f31d80b3800 legacy=0x7f31d8072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c00039b0 0x7f31c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c0004800 0x7f31c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31c00051c0 0x7f31c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8141730 con 0x7f31c0004800 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f31c000c060 con 0x7f31c00039b0 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.482+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f31c000c260 con 0x7f31c00051c0 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31cffff640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c0004800 0x7f31c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31dc999640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c00039b0 0x7f31c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31dd19a640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31c00051c0 0x7f31c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31cffff640 1 -- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31c00051c0 msgr2=0x7f31c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31cffff640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31c00051c0 0x7f31c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31cffff640 1 -- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c00039b0 msgr2=0x7f31c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31cffff640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c00039b0 0x7f31c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31cffff640 1 -- 172.21.15.181:0/26934031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c0003520 con 0x7f31c0004800 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31dd19a640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31c00051c0 0x7f31c000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.483+0000 7f31dd19a640 1 -- 172.21.15.181:0/26934031 reap_dead start 2024-09-12T02:33:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31cffff640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c0004800 0x7f31c0004c80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f31d80afd10 tx=0x7f31c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcfbc45ab6814b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8007d30 con 0x7f31c0004800 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c8005af0 con 0x7f31c0004800 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31cf7fe640 1 -- 172.21.15.181:0/26934031 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8007070 con 0x7f31c0004800 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31debfd640 1 -- 172.21.15.181:0/26934031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c0004800 msgr2=0x7f31c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31debfd640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c0004800 0x7f31c0004c80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f31d80afd10 tx=0x7f31c0005830 comp rx=0 tx=0).stop 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31debfd640 1 -- 172.21.15.181:0/26934031 shutdown_connections 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31debfd640 1 --2- 172.21.15.181:0/26934031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c0004800 0x7f31c0004c80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31debfd640 1 -- 172.21.15.181:0/26934031 >> 172.21.15.181:0/26934031 conn(0x7f31d806bc10 msgr2=0x7f31d806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31debfd640 1 -- 172.21.15.181:0/26934031 shutdown_connections 2024-09-12T02:33:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.484+0000 7f31debfd640 1 -- 172.21.15.181:0/26934031 wait complete. 2024-09-12T02:33:21.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.485+0000 7f31debfd640 1 Processor -- start 2024-09-12T02:33:21.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.485+0000 7f31debfd640 1 -- start start 2024-09-12T02:33:21.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31debfd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c0004800 0x7f31d80abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31debfd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d80aa490 0x7f31d80ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31debfd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31d8156d00 0x7f31d81f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31debfd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f31d815ef90 con 0x7f31d8156d00 2024-09-12T02:33:21.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31debfd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8143dc0 con 0x7f31c0004800 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31debfd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f31d815f110 con 0x7f31d80aa490 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31dd19a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31d8156d00 0x7f31d81f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31dd19a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31d8156d00 0x7f31d81f7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51956/0 (socket says 172.21.15.181:51956) 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.486+0000 7f31dd19a640 1 -- 172.21.15.181:0/3041181936 learned_addr learned my addr 172.21.15.181:0/3041181936 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31dc999640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c0004800 0x7f31d80abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31cffff640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d80aa490 0x7f31d80ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31dd19a640 1 -- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d80aa490 msgr2=0x7f31d80ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31dd19a640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d80aa490 0x7f31d80ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31dd19a640 1 -- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c0004800 msgr2=0x7f31d80abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31dd19a640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c0004800 0x7f31d80abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31dd19a640 1 -- 172.21.15.181:0/3041181936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d80aa9e0 con 0x7f31d8156d00 2024-09-12T02:33:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31dd19a640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31d8156d00 0x7f31d81f7880 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f31d80d0d00 tx=0x7f31d0010580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31cd7fa640 1 -- 172.21.15.181:0/3041181936 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d000a2e0 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31cd7fa640 1 -- 172.21.15.181:0/3041181936 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d0007e80 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d80aacc0 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31cd7fa640 1 -- 172.21.15.181:0/3041181936 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0010dc0 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.487+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d80ab280 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.488+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d80b30f0 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.488+0000 7f31cd7fa640 1 -- 172.21.15.181:0/3041181936 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31d001d020 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.489+0000 7f31cd7fa640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f31c406be60 0x7f31c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.489+0000 7f31cd7fa640 1 -- 172.21.15.181:0/3041181936 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f31d008a870 con 0x7f31d8156d00 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.489+0000 7f31dc999640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f31c406be60 0x7f31c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.489+0000 7f31dc999640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f31c406be60 0x7f31c406e320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c00 tx=0x7f31d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.493+0000 7f31cd7fa640 1 -- 172.21.15.181:0/3041181936 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31d0024020 con 0x7f31d8156d00 2024-09-12T02:33:21.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.723+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f31d80b5260 con 0x7f31d8156d00 2024-09-12T02:33:21.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.724+0000 7f31cd7fa640 1 -- 172.21.15.181:0/3041181936 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7f31d0011040 con 0x7f31d8156d00 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "auth_dump": [ 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.a", 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmgqStABAAuR5/mEmoQ93BJ/aXTfZ3Vg==", 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.b", 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmHB1xDBAA9v9urEvVrgq4ujbl1dq0ow==", 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.c", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmA6uoBxAAsY99fp7CzedZ/yS6xKV3Ww==", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.d", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmSVuPExAA2lIlASsgadRjRVyKwAD+ig==", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.0", 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCJUeJmXm6kMxAAhxzDDmGdbM/mLqwsr2z0qw==", 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.1", 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCNUeJm3UvvNBAAiZKHPj471Ql3u3MDU+vYrg==", 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.2", 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCRUeJm6pZuJxAABApQFY9e5yj6ehNZsZcerA==", 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.3", 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCVUeJm5e9GKBAA0ZoeZyPDkw7vRVjKLRZIZQ==", 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.4", 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCcUeJmd20TMhAA0MSq5FoRha+jFQ6aJbfs/A==", 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.5", 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCgUeJmcgSVMxAAFDsp8jmrJ2uco7rmn4q9XQ==", 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.731 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.6", 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCkUeJmTwSWNBAApWkWkCbc9Mpk7VGR27a4+Q==", 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.732 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.7", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCoUeJmVts/NRAAQ3JpiLZSmnd2VbHLmZyXJQ==", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.0", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg==", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow r", 2024-09-12T02:33:21.733 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.1", 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm8f6AIBAA96HxvzttXuXOClAGiYwh7g==", 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.734 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.2", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm/+dGHRAAw3bdTqnuOcV2umDd/1577Q==", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.3", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmCFcdJhAAEpU/Swkitc8CXjG0SKzeLQ==", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:33:21.735 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.admin", 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmD708IBAAP+FE49F+D1d43sRbMVLBlQ==", 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.x", 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmmPEKORAAtnB+3V0qg1BS1zEVF5qImQ==", 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.y", 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmMrTWNBAAVU9k50mu969QuqrLSsdtGw==", 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:33:21.737 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:33:21.738 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:33:21.738 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.738 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:21.738 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:33:21.738 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:33:21.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f31c406be60 msgr2=0x7f31c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f31c406be60 0x7f31c406e320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c00 tx=0x7f31d4009040 comp rx=0 tx=0).stop 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31d8156d00 msgr2=0x7f31d81f7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31d8156d00 0x7f31d81f7880 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f31d80d0d00 tx=0x7f31d0010580 comp rx=0 tx=0).stop 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 shutdown_connections 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f31c406be60 0x7f31c406e320 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31d8156d00 0x7f31d81f7880 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f31d80aa490 0x7f31d80ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 --2- 172.21.15.181:0/3041181936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31c0004800 0x7f31d80abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 >> 172.21.15.181:0/3041181936 conn(0x7f31d806bc10 msgr2=0x7f31d80cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 shutdown_connections 2024-09-12T02:33:21.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.726+0000 7f31debfd640 1 -- 172.21.15.181:0/3041181936 wait complete. 2024-09-12T02:33:21.741 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:33:21.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.839+0000 7f979145e640 1 Processor -- start 2024-09-12T02:33:21.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.839+0000 7f979145e640 1 -- start start 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f979145e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f978c0cf2b0 0x7f978c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f979145e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c0cf720 0x7f978c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f979145e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978c15ea20 con 0x7f978c15e640 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f979145e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f978c0b3d00 con 0x7f978c0cf2b0 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f979145e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f978c0b2860 con 0x7f978c0cf720 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f978c0cf2b0 0x7f978c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f978c0cf2b0 0x7f978c0d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51970/0 (socket says 172.21.15.181:51970) 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f978c15e640 0x7f978c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38920/0 (socket says 172.21.15.181:38920) 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978a7fc640 1 -- 172.21.15.181:0/572488739 learned_addr learned my addr 172.21.15.181:0/572488739 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978b7fe640 1 --2- 172.21.15.181:0/572488739 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c0cf720 0x7f978c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978a7fc640 1 -- 172.21.15.181:0/572488739 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c0cf720 msgr2=0x7f978c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978a7fc640 1 --2- 172.21.15.181:0/572488739 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c0cf720 0x7f978c0d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978a7fc640 1 -- 172.21.15.181:0/572488739 >> v1:172.21.15.181:6789/0 conn(0x7f978c15e640 legacy=0x7f978c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f978a7fc640 1 -- 172.21.15.181:0/572488739 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c0b1c50 con 0x7f978c0cf2b0 2024-09-12T02:33:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.840+0000 7f9789ffb640 1 -- 172.21.15.181:0/572488739 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120184680 0 0) 0x7f978c15ea20 con 0x7f978c15e640 2024-09-12T02:33:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.841+0000 7f978a7fc640 1 --2- 172.21.15.181:0/572488739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf2b0 0x7f978c0d2650 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9780009870 tx=0x7f978002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c49e4b33d65be1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.841+0000 7f9789ffb640 1 -- 172.21.15.181:0/572488739 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780037070 con 0x7f978c0cf2b0 2024-09-12T02:33:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.841+0000 7f9789ffb640 1 -- 172.21.15.181:0/572488739 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9780032440 con 0x7f978c0cf2b0 2024-09-12T02:33:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.841+0000 7f9789ffb640 1 -- 172.21.15.181:0/572488739 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780032810 con 0x7f978c0cf2b0 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 -- 172.21.15.181:0/572488739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf2b0 msgr2=0x7f978c0d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 --2- 172.21.15.181:0/572488739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf2b0 0x7f978c0d2650 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9780009870 tx=0x7f978002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 -- 172.21.15.181:0/572488739 shutdown_connections 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 --2- 172.21.15.181:0/572488739 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c0cf720 0x7f978c0d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 --2- 172.21.15.181:0/572488739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf2b0 0x7f978c0d2650 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 -- 172.21.15.181:0/572488739 >> 172.21.15.181:0/572488739 conn(0x7f978c09d820 msgr2=0x7f978c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 -- 172.21.15.181:0/572488739 shutdown_connections 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.842+0000 7f979145e640 1 -- 172.21.15.181:0/572488739 wait complete. 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.843+0000 7f979145e640 1 Processor -- start 2024-09-12T02:33:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.843+0000 7f979145e640 1 -- start start 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f979145e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f978c0cf2b0 0x7f978c14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f979145e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf720 0x7f978c0b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f979145e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c15e640 0x7f978c0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f979145e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f978c0b24f0 con 0x7f978c0cf720 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f979145e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f978c0b2210 con 0x7f978c0cf2b0 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f979145e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f978c0cfe40 con 0x7f978c15e640 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf720 0x7f978c0b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf720 0x7f978c0b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51978/0 (socket says 172.21.15.181:51978) 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 -- 172.21.15.181:0/3152216208 learned_addr learned my addr 172.21.15.181:0/3152216208 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978b7fe640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c15e640 0x7f978c0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978affd640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f978c0cf2b0 0x7f978c14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 -- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c15e640 msgr2=0x7f978c0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c15e640 0x7f978c0b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 -- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f978c0cf2b0 msgr2=0x7f978c14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f978c0cf2b0 0x7f978c14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 -- 172.21.15.181:0/3152216208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c0ce4a0 con 0x7f978c0cf720 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978affd640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f978c0cf2b0 0x7f978c14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f978a7fc640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf720 0x7f978c0b5480 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9780000c00 tx=0x7f97800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.844+0000 7f97737fe640 1 -- 172.21.15.181:0/3152216208 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780041020 con 0x7f978c0cf720 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.845+0000 7f97737fe640 1 -- 172.21.15.181:0/3152216208 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97800306c0 con 0x7f978c0cf720 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.845+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c0cd6e0 con 0x7f978c0cf720 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.845+0000 7f97737fe640 1 -- 172.21.15.181:0/3152216208 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780037040 con 0x7f978c0cf720 2024-09-12T02:33:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.845+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c0cdf80 con 0x7f978c0cf720 2024-09-12T02:33:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.846+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978c0cdad0 con 0x7f978c0cf720 2024-09-12T02:33:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.846+0000 7f97737fe640 1 -- 172.21.15.181:0/3152216208 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9780044020 con 0x7f978c0cf720 2024-09-12T02:33:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.847+0000 7f97737fe640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.847+0000 7f97737fe640 1 -- 172.21.15.181:0/3152216208 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f97800ab2b0 con 0x7f978c0cf720 2024-09-12T02:33:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.847+0000 7f978affd640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.847+0000 7f978affd640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f977806be30 0x7f977806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f977c000f60 tx=0x7f977c007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:21.851+0000 7f97737fe640 1 -- 172.21.15.181:0/3152216208 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f978004b030 con 0x7f978c0cf720 2024-09-12T02:33:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.019+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f978c068eb0 con 0x7f978c0cf720 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.019+0000 7f97737fe640 1 -- 172.21.15.181:0/3152216208 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) ==== 84+0+65 (secure 0 0 0) 0x7f9780079fb0 con 0x7f978c0cf720 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stdout:[ 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stdout: "poolnum": 1, 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stdout: "poolname": ".mgr" 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:22.020 INFO:teuthology.orchestra.run.smithi181.stdout:] 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f977806be30 msgr2=0x7f977806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f977806be30 0x7f977806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f977c000f60 tx=0x7f977c007c10 comp rx=0 tx=0).stop 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf720 msgr2=0x7f978c0b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf720 0x7f978c0b5480 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9780000c00 tx=0x7f97800046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 shutdown_connections 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f978c15e640 0x7f978c0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978c0cf720 0x7f978c0b5480 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 --2- 172.21.15.181:0/3152216208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f978c0cf2b0 0x7f978c14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 >> 172.21.15.181:0/3152216208 conn(0x7f978c09d820 msgr2=0x7f978c0d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 shutdown_connections 2024-09-12T02:33:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.021+0000 7f979145e640 1 -- 172.21.15.181:0/3152216208 wait complete. 2024-09-12T02:33:22.033 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:33:22.033 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:33:22.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.135+0000 7fd6d3b4b640 1 Processor -- start 2024-09-12T02:33:22.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.135+0000 7fd6d3b4b640 1 -- start start 2024-09-12T02:33:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d3b4b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd6cc15b230 0x7fd6cc0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d3b4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d3b4b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd6cc15f3b0 0x7fd6cc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d3b4b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd6cc0718b0 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d3b4b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd6cc070fc0 con 0x7fd6cc15b230 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d3b4b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc15fb80 con 0x7fd6cc0b3ff0 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd6cc15f3b0 0x7fd6cc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd6cc15f3b0 0x7fd6cc06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51986/0 (socket says 172.21.15.181:51986) 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 -- 172.21.15.181:0/283241282 learned_addr learned my addr 172.21.15.181:0/283241282 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 -- 172.21.15.181:0/283241282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 msgr2=0x7fd6cc15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d18e7640 1 --2- 172.21.15.181:0/283241282 >> v2:172.21.15.204:3300/0 conn(0x7fd6cc15b230 0x7fd6cc0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d10e6640 1 --2- 172.21.15.181:0/283241282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 --2- 172.21.15.181:0/283241282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc15ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 -- 172.21.15.181:0/283241282 >> v2:172.21.15.204:3300/0 conn(0x7fd6cc15b230 msgr2=0x7fd6cc0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 --2- 172.21.15.181:0/283241282 >> v2:172.21.15.204:3300/0 conn(0x7fd6cc15b230 0x7fd6cc0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d20e8640 1 -- 172.21.15.181:0/283241282 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc071260 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.136+0000 7fd6d18e7640 1 --2- 172.21.15.181:0/283241282 >> v2:172.21.15.204:3300/0 conn(0x7fd6cc15b230 0x7fd6cc0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:22.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.137+0000 7fd6d20e8640 1 --2- 172.21.15.181:0/283241282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc06cd20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009e50 tx=0x7fd6c402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf6d4b48e353c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:22.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.137+0000 7fd6d08e5640 1 -- 172.21.15.181:0/283241282 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4036070 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.137+0000 7fd6d08e5640 1 -- 172.21.15.181:0/283241282 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c4031600 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.137+0000 7fd6d08e5640 1 -- 172.21.15.181:0/283241282 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40319d0 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/283241282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 msgr2=0x7fd6cc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/283241282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc06cd20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009e50 tx=0x7fd6c402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/283241282 shutdown_connections 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/283241282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc06cd20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/283241282 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/283241282 >> v2:172.21.15.204:3300/0 conn(0x7fd6cc15b230 0x7fd6cc0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/283241282 >> 172.21.15.181:0/283241282 conn(0x7fd6cc06bc10 msgr2=0x7fd6cc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/283241282 shutdown_connections 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.138+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/283241282 wait complete. 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.139+0000 7fd6d3b4b640 1 Processor -- start 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.139+0000 7fd6d3b4b640 1 -- start start 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.139+0000 7fd6d3b4b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:22.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.139+0000 7fd6d3b4b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6cc15b230 0x7fd6cc0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.139+0000 7fd6d3b4b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d3b4b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc15f860 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d3b4b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc0b4410 con 0x7fd6cc15b230 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d3b4b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc15b610 con 0x7fd6cc0b3ff0 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51992/0 (socket says 172.21.15.181:51992) 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 -- 172.21.15.181:0/738941328 learned_addr learned my addr 172.21.15.181:0/738941328 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d18e7640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d10e6640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6cc15b230 0x7fd6cc0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 -- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 msgr2=0x7fd6cc14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 -- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6cc15b230 msgr2=0x7fd6cc0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:22.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6cc15b230 0x7fd6cc0b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 -- 172.21.15.181:0/738941328 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc0afd70 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d20e8640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc151150 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4034040 tx=0x7fd6c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6c27fc640 1 -- 172.21.15.181:0/738941328 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4036050 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6c27fc640 1 -- 172.21.15.181:0/738941328 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c4042070 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6c27fc640 1 -- 172.21.15.181:0/738941328 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4009510 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc0b0050 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.140+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc14bb80 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.141+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6cc069170 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.142+0000 7fd6c27fc640 1 -- 172.21.15.181:0/738941328 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6c4007bd0 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.142+0000 7fd6c27fc640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd6b006be30 0x7fd6b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:22.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.142+0000 7fd6d18e7640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd6b006be30 0x7fd6b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:22.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.142+0000 7fd6c27fc640 1 -- 172.21.15.181:0/738941328 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7fd6c40ab890 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.143+0000 7fd6d18e7640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd6b006be30 0x7fd6b006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800ab60 tx=0x7fd6c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:22.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.147+0000 7fd6c27fc640 1 -- 172.21.15.181:0/738941328 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6c4079fd0 con 0x7fd6cc15f3b0 2024-09-12T02:33:22.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:22.313+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd6cc0cdf80 con 0x7fd6cc15f3b0 2024-09-12T02:33:23.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.072+0000 7fd6c27fc640 1 -- 172.21.15.181:0/738941328 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) ==== 138+0+0 (secure 0 0 0) 0x7fd6c407e2d0 con 0x7fd6cc15f3b0 2024-09-12T02:33:23.073 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' created 2024-09-12T02:33:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd6b006be30 msgr2=0x7fd6b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd6b006be30 0x7fd6b006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800ab60 tx=0x7fd6c8008040 comp rx=0 tx=0).stop 2024-09-12T02:33:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 msgr2=0x7fd6cc151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc151150 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4034040 tx=0x7fd6c4004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 shutdown_connections 2024-09-12T02:33:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd6b006be30 0x7fd6b006e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6cc15b230 0x7fd6cc0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6cc15f3b0 0x7fd6cc151150 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 --2- 172.21.15.181:0/738941328 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd6cc0b3ff0 0x7fd6cc14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 >> 172.21.15.181:0/738941328 conn(0x7fd6cc06bc10 msgr2=0x7fd6cc0ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:23.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 shutdown_connections 2024-09-12T02:33:23.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.074+0000 7fd6d3b4b640 1 -- 172.21.15.181:0/738941328 wait complete. 2024-09-12T02:33:23.091 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:33:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.198+0000 7fd3e65e4640 1 Processor -- start 2024-09-12T02:33:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.198+0000 7fd3e65e4640 1 -- start start 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3e65e4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd3e015e250 0x7fd3e015e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3e65e4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e00b7730 con 0x7fd3e006f970 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3e65e4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e00d20a0 con 0x7fd3e00d1560 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3e65e4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e006cdc0 con 0x7fd3e015e250 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3e4b81640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd3e006f970 0x7fd3e006db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38934/0 (socket says 172.21.15.181:38934) 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3e4b81640 1 -- 172.21.15.181:0/294613567 learned_addr learned my addr 172.21.15.181:0/294613567 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619557435 0 0) 0x7fd3e00b7730 con 0x7fd3e006f970 2024-09-12T02:33:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3dffff640 1 --2- 172.21.15.181:0/294613567 >> v2:172.21.15.204:3300/0 conn(0x7fd3e015e250 0x7fd3e015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c8003520 con 0x7fd3e006f970 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4252387731 0 0) 0x7fd3c8003520 con 0x7fd3e006f970 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 >> v2:172.21.15.204:3300/0 conn(0x7fd3e015e250 msgr2=0x7fd3e015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 --2- 172.21.15.181:0/294613567 >> v2:172.21.15.204:3300/0 conn(0x7fd3e015e250 0x7fd3e015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 >> v1:172.21.15.204:6789/0 conn(0x7fd3e00d1560 legacy=0x7fd3e006f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e006d0a0 con 0x7fd3e006f970 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fd3d80019f0 con 0x7fd3e006f970 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 >> v1:172.21.15.181:6789/0 conn(0x7fd3e006f970 legacy=0x7fd3e006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3c80039b0 0x7fd3c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c8004800 0x7fd3c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c80051c0 0x7fd3c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e006cdc0 con 0x7fd3c80051c0 2024-09-12T02:33:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c800c060 con 0x7fd3c80039b0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.199+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c800c260 con 0x7fd3c8004800 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3e4b81640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c80051c0 0x7fd3c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3dffff640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3c80039b0 0x7fd3c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3df7fe640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c8004800 0x7fd3c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3e4b81640 1 -- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c8004800 msgr2=0x7fd3c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3e4b81640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c8004800 0x7fd3c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3e4b81640 1 -- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3c80039b0 msgr2=0x7fd3c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3e4b81640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3c80039b0 0x7fd3c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3e4b81640 1 -- 172.21.15.181:0/294613567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c8003520 con 0x7fd3c80051c0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.200+0000 7fd3e4b81640 1 -- 172.21.15.181:0/294613567 reap_dead start 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e4b81640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c80051c0 0x7fd3c800b9c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800a830 tx=0x7fd3c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf07ffb2d02b53e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800a480 con 0x7fd3c80051c0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d802f070 con 0x7fd3c80051c0 2024-09-12T02:33:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3deffd640 1 -- 172.21.15.181:0/294613567 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d802bcb0 con 0x7fd3c80051c0 2024-09-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e65e4640 1 -- 172.21.15.181:0/294613567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c80051c0 msgr2=0x7fd3c800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c80051c0 0x7fd3c800b9c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800a830 tx=0x7fd3c8005830 comp rx=0 tx=0).stop 2024-09-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e65e4640 1 -- 172.21.15.181:0/294613567 shutdown_connections 2024-09-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/294613567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c80051c0 0x7fd3c800b9c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e65e4640 1 -- 172.21.15.181:0/294613567 >> 172.21.15.181:0/294613567 conn(0x7fd3e0068220 msgr2=0x7fd3e00b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e65e4640 1 -- 172.21.15.181:0/294613567 shutdown_connections 2024-09-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.201+0000 7fd3e65e4640 1 -- 172.21.15.181:0/294613567 wait complete. 2024-09-12T02:33:23.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.202+0000 7fd3e65e4640 1 Processor -- start 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e65e4640 1 -- start start 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e65e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c80051c0 0x7fd3e0157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e65e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3e01f73d0 0x7fd3e01f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e65e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e01f3de0 0x7fd3e01f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e65e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e015e630 con 0x7fd3e01f3de0 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e65e4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e006d660 con 0x7fd3e01f73d0 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e65e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e015e7b0 con 0x7fd3c80051c0 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e4b81640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e01f3de0 0x7fd3e01f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e4b81640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e01f3de0 0x7fd3e01f4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52012/0 (socket says 172.21.15.181:52012) 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.203+0000 7fd3e4b81640 1 -- 172.21.15.181:0/1369210879 learned_addr learned my addr 172.21.15.181:0/1369210879 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3df7fe640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3e01f73d0 0x7fd3e01f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3dffff640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c80051c0 0x7fd3e0157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e4b81640 1 -- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c80051c0 msgr2=0x7fd3e0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e4b81640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c80051c0 0x7fd3e0157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e4b81640 1 -- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3e01f73d0 msgr2=0x7fd3e01f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e4b81640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3e01f73d0 0x7fd3e01f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e4b81640 1 -- 172.21.15.181:0/1369210879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e00cbb40 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3df7fe640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3e01f73d0 0x7fd3e01f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e4b81640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e01f3de0 0x7fd3e01f4290 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8000f80 tx=0x7fd3d8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3dcff9640 1 -- 172.21.15.181:0/1369210879 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d802b850 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3dcff9640 1 -- 172.21.15.181:0/1369210879 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d802b9f0 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e01566b0 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3dcff9640 1 -- 172.21.15.181:0/1369210879 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d802bda0 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.204+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e0156c70 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.205+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e00b33c0 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.206+0000 7fd3dcff9640 1 -- 172.21.15.181:0/1369210879 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3d8034470 con 0x7fd3e01f3de0 2024-09-12T02:33:23.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.206+0000 7fd3dcff9640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd3cc06be60 0x7fd3cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:23.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.206+0000 7fd3dcff9640 1 -- 172.21.15.181:0/1369210879 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5227+0+0 (secure 0 0 0) 0x7fd3d80aac20 con 0x7fd3e01f3de0 2024-09-12T02:33:23.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.206+0000 7fd3dffff640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd3cc06be60 0x7fd3cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:23.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.206+0000 7fd3dffff640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd3cc06be60 0x7fd3cc06e320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009a80 tx=0x7fd3d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:23.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.211+0000 7fd3dcff9640 1 -- 172.21.15.181:0/1369210879 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3d80797b0 con 0x7fd3e01f3de0 2024-09-12T02:33:23.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:23.376+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd3e00d1970 con 0x7fd3e01f3de0 2024-09-12T02:33:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.080+0000 7fd3dcff9640 1 -- 172.21.15.181:0/1369210879 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) ==== 170+0+0 (secure 0 0 0) 0x7fd3d80790b0 con 0x7fd3e01f3de0 2024-09-12T02:33:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' created 2024-09-12T02:33:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd3cc06be60 msgr2=0x7fd3cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd3cc06be60 0x7fd3cc06e320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009a80 tx=0x7fd3d0008040 comp rx=0 tx=0).stop 2024-09-12T02:33:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e01f3de0 msgr2=0x7fd3e01f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e01f3de0 0x7fd3e01f4290 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8000f80 tx=0x7fd3d8001360 comp rx=0 tx=0).stop 2024-09-12T02:33:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 shutdown_connections 2024-09-12T02:33:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd3cc06be60 0x7fd3cc06e320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3e01f73d0 0x7fd3e01f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e01f3de0 0x7fd3e01f4290 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 --2- 172.21.15.181:0/1369210879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3c80051c0 0x7fd3e0157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 >> 172.21.15.181:0/1369210879 conn(0x7fd3e0068220 msgr2=0x7fd3e006f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 shutdown_connections 2024-09-12T02:33:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.083+0000 7fd3e65e4640 1 -- 172.21.15.181:0/1369210879 wait complete. 2024-09-12T02:33:24.108 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:33:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.214+0000 7f217ee8c640 1 Processor -- start 2024-09-12T02:33:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.214+0000 7f217ee8c640 1 -- start start 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.214+0000 7f217ee8c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f21780cef60 0x7f21780b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.214+0000 7f217ee8c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21780b39d0 con 0x7f21780d4710 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.214+0000 7f217ee8c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21780cf520 con 0x7f217815e640 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.214+0000 7f217ee8c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f21780cf800 con 0x7f21780cef60 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f217d429640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f21780d4710 0x7f21780d4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38940/0 (socket says 172.21.15.181:38940) 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f217d429640 1 -- 172.21.15.181:0/739844933 learned_addr learned my addr 172.21.15.181:0/739844933 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f2177fff640 1 --2- 172.21.15.181:0/739844933 >> v2:172.21.15.204:3300/0 conn(0x7f21780cef60 0x7f21780b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631646476 0 0) 0x7f2170001110 con 0x7f21780d4710 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2160003520 con 0x7f21780d4710 2024-09-12T02:33:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1502158376 0 0) 0x7f2160003520 con 0x7f21780d4710 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 >> v2:172.21.15.204:3300/0 conn(0x7f21780cef60 msgr2=0x7f21780b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 --2- 172.21.15.181:0/739844933 >> v2:172.21.15.204:3300/0 conn(0x7f21780cef60 0x7f21780b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 >> v1:172.21.15.204:6789/0 conn(0x7f217815e640 legacy=0x7f21780d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21780cfae0 con 0x7f21780d4710 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f2170001840 con 0x7f21780d4710 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 >> v1:172.21.15.181:6789/0 conn(0x7f21780d4710 legacy=0x7f21780d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2160003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2160004800 0x7f2160004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f21780cf800 con 0x7f21600039b0 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f216000c160 con 0x7f21600051c0 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f216000c360 con 0x7f2160004800 2024-09-12T02:33:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f217cc28640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2160003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f2177fff640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2160004800 0x7f2160004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.215+0000 7f217d429640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f217cc28640 1 -- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2160004800 msgr2=0x7f2160004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f217cc28640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2160004800 0x7f2160004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f217cc28640 1 -- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21600051c0 msgr2=0x7f216000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f217cc28640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f217cc28640 1 -- 172.21.15.181:0/739844933 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2160003520 con 0x7f21600039b0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f217d429640 1 -- 172.21.15.181:0/739844933 reap_dead start 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f217cc28640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2160003dd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2168001750 tx=0x7f2160005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10239ba4e2f0bee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168001370 con 0x7f21600039b0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21680052d0 con 0x7f21600039b0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.216+0000 7f21777fe640 1 -- 172.21.15.181:0/739844933 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216802abc0 con 0x7f21600039b0 2024-09-12T02:33:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.217+0000 7f217ee8c640 1 -- 172.21.15.181:0/739844933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 msgr2=0x7f2160003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.217+0000 7f217ee8c640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2160003dd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2168001750 tx=0x7f2160005830 comp rx=0 tx=0).stop 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.217+0000 7f217ee8c640 1 -- 172.21.15.181:0/739844933 shutdown_connections 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.217+0000 7f217ee8c640 1 --2- 172.21.15.181:0/739844933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2160003dd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.217+0000 7f217ee8c640 1 -- 172.21.15.181:0/739844933 >> 172.21.15.181:0/739844933 conn(0x7f2178067d70 msgr2=0x7f2178068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.217+0000 7f217ee8c640 1 -- 172.21.15.181:0/739844933 shutdown_connections 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.217+0000 7f217ee8c640 1 -- 172.21.15.181:0/739844933 wait complete. 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.218+0000 7f217ee8c640 1 Processor -- start 2024-09-12T02:33:24.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.218+0000 7f217ee8c640 1 -- start start 2024-09-12T02:33:24.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217ee8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2178157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217ee8c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f217815a7a0 0x7f217815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217ee8c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21781586e0 0x7f2178158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217ee8c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f21780b3bf0 con 0x7f21600039b0 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217ee8c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f217815ea20 con 0x7f217815a7a0 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217ee8c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f21780b3d70 con 0x7f21781586e0 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2178157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2178157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52030/0 (socket says 172.21.15.181:52030) 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 -- 172.21.15.181:0/2567963443 learned_addr learned my addr 172.21.15.181:0/2567963443 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217d429640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21781586e0 0x7f2178158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f2177fff640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f217815a7a0 0x7f217815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 -- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21781586e0 msgr2=0x7f2178158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21781586e0 0x7f2178158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 -- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f217815a7a0 msgr2=0x7f217815ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f217815a7a0 0x7f217815ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f217cc28640 1 -- 172.21.15.181:0/2567963443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2178159450 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.219+0000 7f2177fff640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f217815a7a0 0x7f217815ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.220+0000 7f217cc28640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2178157590 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2168000c00 tx=0x7f2168001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.220+0000 7f21757fa640 1 -- 172.21.15.181:0/2567963443 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216803f030 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.220+0000 7f21757fa640 1 -- 172.21.15.181:0/2567963443 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2168005480 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.220+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2178159730 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.220+0000 7f21757fa640 1 -- 172.21.15.181:0/2567963443 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168037040 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.220+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2178159cf0 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.221+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21780d4b10 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.221+0000 7f21757fa640 1 -- 172.21.15.181:0/2567963443 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2168042070 con 0x7f21600039b0 2024-09-12T02:33:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.222+0000 7f21757fa640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f216406be60 0x7f216406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.222+0000 7f21757fa640 1 -- 172.21.15.181:0/2567963443 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5609+0+0 (secure 0 0 0) 0x7f21680aa7f0 con 0x7f21600039b0 2024-09-12T02:33:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.222+0000 7f2177fff640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f216406be60 0x7f216406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.222+0000 7f2177fff640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f216406be60 0x7f216406e320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f217815ccd0 tx=0x7f216c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.226+0000 7f21757fa640 1 -- 172.21.15.181:0/2567963443 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2168079200 con 0x7f21600039b0 2024-09-12T02:33:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:24.426+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f217815ca20 con 0x7f21600039b0 2024-09-12T02:33:25.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.081+0000 7f21757fa640 1 -- 172.21.15.181:0/2567963443 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v38) ==== 172+0+0 (secure 0 0 0) 0x7f2168078b00 con 0x7f21600039b0 2024-09-12T02:33:25.082 INFO:teuthology.orchestra.run.smithi181.stderr:new fs with metadata pool 8 and data pool 9 2024-09-12T02:33:25.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.084+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f216406be60 msgr2=0x7f216406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.084+0000 7f217ee8c640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f216406be60 0x7f216406e320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f217815ccd0 tx=0x7f216c00b040 comp rx=0 tx=0).stop 2024-09-12T02:33:25.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.084+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 msgr2=0x7f2178157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.084+0000 7f217ee8c640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2178157590 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2168000c00 tx=0x7f2168001120 comp rx=0 tx=0).stop 2024-09-12T02:33:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.085+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 shutdown_connections 2024-09-12T02:33:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.085+0000 7f217ee8c640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f216406be60 0x7f216406e320 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.085+0000 7f217ee8c640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f217815a7a0 0x7f217815ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.085+0000 7f217ee8c640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21781586e0 0x7f2178158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.085+0000 7f217ee8c640 1 --2- 172.21.15.181:0/2567963443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21600039b0 0x7f2178157590 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.085+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 >> 172.21.15.181:0/2567963443 conn(0x7f2178067d70 msgr2=0x7f217815d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:25.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.086+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 shutdown_connections 2024-09-12T02:33:25.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.086+0000 7f217ee8c640 1 -- 172.21.15.181:0/2567963443 wait complete. 2024-09-12T02:33:25.118 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:25.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.217+0000 7f6945d91640 1 Processor -- start 2024-09-12T02:33:25.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.217+0000 7f6945d91640 1 -- start start 2024-09-12T02:33:25.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f6945d91640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f694006c320 0x7f69400b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f6945d91640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694006e3c0 con 0x7f69400b0610 2024-09-12T02:33:25.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f6945d91640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694006e6a0 con 0x7f6940158c90 2024-09-12T02:33:25.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f6945d91640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f694006e170 con 0x7f694006c320 2024-09-12T02:33:25.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693effd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f694006c320 0x7f69400b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693effd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f694006c320 0x7f69400b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52032/0 (socket says 172.21.15.181:52032) 2024-09-12T02:33:25.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693ffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f69400b0610 0x7f694015eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38946/0 (socket says 172.21.15.181:38946) 2024-09-12T02:33:25.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693effd640 1 -- 172.21.15.181:0/1317473163 learned_addr learned my addr 172.21.15.181:0/1317473163 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:25.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693effd640 1 -- 172.21.15.181:0/1317473163 >> v1:172.21.15.204:6789/0 conn(0x7f6940158c90 legacy=0x7f694006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:25.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693effd640 1 -- 172.21.15.181:0/1317473163 >> v1:172.21.15.181:6789/0 conn(0x7f69400b0610 legacy=0x7f694015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693e7fc640 1 -- 172.21.15.181:0/1317473163 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934586354 0 0) 0x7f694006e3c0 con 0x7f69400b0610 2024-09-12T02:33:25.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.218+0000 7f693effd640 1 -- 172.21.15.181:0/1317473163 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694006e980 con 0x7f694006c320 2024-09-12T02:33:25.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.219+0000 7f693effd640 1 --2- 172.21.15.181:0/1317473163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694006c320 0x7f69400b00d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a48827453b8c6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.219+0000 7f693e7fc640 1 -- 172.21.15.181:0/1317473163 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934037070 con 0x7f694006c320 2024-09-12T02:33:25.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.219+0000 7f693e7fc640 1 -- 172.21.15.181:0/1317473163 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693402ae50 con 0x7f694006c320 2024-09-12T02:33:25.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.219+0000 7f693e7fc640 1 -- 172.21.15.181:0/1317473163 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032860 con 0x7f694006c320 2024-09-12T02:33:25.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.220+0000 7f6945d91640 1 -- 172.21.15.181:0/1317473163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694006c320 msgr2=0x7f69400b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.220+0000 7f6945d91640 1 --2- 172.21.15.181:0/1317473163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694006c320 0x7f69400b00d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402a300 comp rx=0 tx=0).stop 2024-09-12T02:33:25.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.220+0000 7f6945d91640 1 -- 172.21.15.181:0/1317473163 shutdown_connections 2024-09-12T02:33:25.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.220+0000 7f6945d91640 1 --2- 172.21.15.181:0/1317473163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694006c320 0x7f69400b00d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.220+0000 7f6945d91640 1 -- 172.21.15.181:0/1317473163 >> 172.21.15.181:0/1317473163 conn(0x7f6940067b30 msgr2=0x7f694006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:25.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.220+0000 7f6945d91640 1 -- 172.21.15.181:0/1317473163 shutdown_connections 2024-09-12T02:33:25.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.220+0000 7f6945d91640 1 -- 172.21.15.181:0/1317473163 wait complete. 2024-09-12T02:33:25.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.221+0000 7f6945d91640 1 Processor -- start 2024-09-12T02:33:25.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.221+0000 7f6945d91640 1 -- start start 2024-09-12T02:33:25.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f6945d91640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694006c320 0x7f6940145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f6945d91640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69400b0610 0x7f69401e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f6945d91640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6940158c90 0x7f69401ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f6945d91640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f69400b4210 con 0x7f69400b0610 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f6945d91640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f69400b0a80 con 0x7f6940158c90 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f6945d91640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f69400b4390 con 0x7f694006c320 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69400b0610 0x7f69401e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69400b0610 0x7f69401e9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52036/0 (socket says 172.21.15.181:52036) 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 -- 172.21.15.181:0/2696963097 learned_addr learned my addr 172.21.15.181:0/2696963097 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693ffff640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6940158c90 0x7f69401ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 -- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694006c320 msgr2=0x7f6940145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694006c320 0x7f6940145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 -- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6940158c90 msgr2=0x7f69401ea420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6940158c90 0x7f69401ea420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 -- 172.21.15.181:0/2696963097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6940155b90 con 0x7f69400b0610 2024-09-12T02:33:25.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693ffff640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6940158c90 0x7f69401ea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:25.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.222+0000 7f693effd640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69400b0610 0x7f69401e9ee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f69340090b0 tx=0x7f69340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.223+0000 7f6927fff640 1 -- 172.21.15.181:0/2696963097 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934037040 con 0x7f69400b0610 2024-09-12T02:33:25.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.223+0000 7f6927fff640 1 -- 172.21.15.181:0/2696963097 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934004230 con 0x7f69400b0610 2024-09-12T02:33:25.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.223+0000 7f6927fff640 1 -- 172.21.15.181:0/2696963097 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032e40 con 0x7f69400b0610 2024-09-12T02:33:25.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.223+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6940155e70 con 0x7f69400b0610 2024-09-12T02:33:25.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.223+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6940156430 con 0x7f69400b0610 2024-09-12T02:33:25.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.224+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69400b00d0 con 0x7f69400b0610 2024-09-12T02:33:25.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.224+0000 7f6927fff640 1 -- 172.21.15.181:0/2696963097 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f693403a070 con 0x7f69400b0610 2024-09-12T02:33:25.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.225+0000 7f6927fff640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f692c06be60 0x7f692c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.225+0000 7f6927fff640 1 -- 172.21.15.181:0/2696963097 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f69340ab3c0 con 0x7f69400b0610 2024-09-12T02:33:25.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.225+0000 7f693f7fe640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f692c06be60 0x7f692c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.225+0000 7f693f7fe640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f692c06be60 0x7f692c06e320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f60 tx=0x7f69300079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.229+0000 7f6927fff640 1 -- 172.21.15.181:0/2696963097 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6934041020 con 0x7f69400b0610 2024-09-12T02:33:25.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.394+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6940072ee0 con 0x7f69400b0610 2024-09-12T02:33:25.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.395+0000 7f6927fff640 1 -- 172.21.15.181:0/2696963097 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16810 (secure 0 0 0) 0x7f6934079d70 con 0x7f69400b0610 2024-09-12T02:33:25.396 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:25.396 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":59,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:33:24.427975+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:22.332817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:23.395647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:25.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f692c06be60 msgr2=0x7f692c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f692c06be60 0x7f692c06e320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f60 tx=0x7f69300079b0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69400b0610 msgr2=0x7f69401e9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69400b0610 0x7f69401e9ee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f69340090b0 tx=0x7f69340046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 shutdown_connections 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f692c06be60 0x7f692c06e320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6940158c90 0x7f69401ea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69400b0610 0x7f69401e9ee0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 --2- 172.21.15.181:0/2696963097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694006c320 0x7f6940145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.397+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 >> 172.21.15.181:0/2696963097 conn(0x7f6940067b30 msgr2=0x7f69400d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.398+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 shutdown_connections 2024-09-12T02:33:25.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.398+0000 7f6945d91640 1 -- 172.21.15.181:0/2696963097 wait complete. 2024-09-12T02:33:25.410 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:25.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.507+0000 7fca8ff42640 1 Processor -- start 2024-09-12T02:33:25.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.507+0000 7fca8ff42640 1 -- start start 2024-09-12T02:33:25.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8ff42640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca8815bf90 0x7fca8815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8ff42640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fca880cdae0 0x7fca880cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8ff42640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca8815f910 con 0x7fca88161f40 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8ff42640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fca880d0240 con 0x7fca880cdae0 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8ff42640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fca8815c370 con 0x7fca8815bf90 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8d4dd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fca880cdae0 0x7fca880cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8d4dd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fca880cdae0 0x7fca880cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52038/0 (socket says 172.21.15.181:52038) 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8e4df640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fca88161f40 0x7fca88162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38950/0 (socket says 172.21.15.181:38950) 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8d4dd640 1 -- 172.21.15.181:0/2194853660 learned_addr learned my addr 172.21.15.181:0/2194853660 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8dcde640 1 --2- 172.21.15.181:0/2194853660 >> v2:172.21.15.204:3300/0 conn(0x7fca8815bf90 0x7fca8815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8d4dd640 1 -- 172.21.15.181:0/2194853660 >> v2:172.21.15.204:3300/0 conn(0x7fca8815bf90 msgr2=0x7fca8815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8d4dd640 1 --2- 172.21.15.181:0/2194853660 >> v2:172.21.15.204:3300/0 conn(0x7fca8815bf90 0x7fca8815f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.508+0000 7fca8d4dd640 1 -- 172.21.15.181:0/2194853660 >> v1:172.21.15.181:6789/0 conn(0x7fca88161f40 legacy=0x7fca88162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.509+0000 7fca8d4dd640 1 -- 172.21.15.181:0/2194853660 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca880cf630 con 0x7fca880cdae0 2024-09-12T02:33:25.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.509+0000 7fca8ccdc640 1 -- 172.21.15.181:0/2194853660 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73886160 0 0) 0x7fca80001490 con 0x7fca88161f40 2024-09-12T02:33:25.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.509+0000 7fca8d4dd640 1 --2- 172.21.15.181:0/2194853660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca880cdae0 0x7fca880cdf70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fca88070020 tx=0x7fca7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142668ecfacbf1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.509+0000 7fca8ccdc640 1 -- 172.21.15.181:0/2194853660 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78037070 con 0x7fca880cdae0 2024-09-12T02:33:25.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.509+0000 7fca8ccdc640 1 -- 172.21.15.181:0/2194853660 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca78032440 con 0x7fca880cdae0 2024-09-12T02:33:25.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.509+0000 7fca8ccdc640 1 -- 172.21.15.181:0/2194853660 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78032810 con 0x7fca880cdae0 2024-09-12T02:33:25.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 -- 172.21.15.181:0/2194853660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca880cdae0 msgr2=0x7fca880cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 --2- 172.21.15.181:0/2194853660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca880cdae0 0x7fca880cdf70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fca88070020 tx=0x7fca7802a270 comp rx=0 tx=0).stop 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 -- 172.21.15.181:0/2194853660 shutdown_connections 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 --2- 172.21.15.181:0/2194853660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca880cdae0 0x7fca880cdf70 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 --2- 172.21.15.181:0/2194853660 >> v2:172.21.15.204:3300/0 conn(0x7fca8815bf90 0x7fca8815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 -- 172.21.15.181:0/2194853660 >> 172.21.15.181:0/2194853660 conn(0x7fca880b1770 msgr2=0x7fca880b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 -- 172.21.15.181:0/2194853660 shutdown_connections 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.510+0000 7fca8ff42640 1 -- 172.21.15.181:0/2194853660 wait complete. 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.511+0000 7fca8ff42640 1 Processor -- start 2024-09-12T02:33:25.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.511+0000 7fca8ff42640 1 -- start start 2024-09-12T02:33:25.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8ff42640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca880cdae0 0x7fca881f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8ff42640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca8815bf90 0x7fca8815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8ff42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca88161f40 0x7fca8815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8ff42640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fca880cfed0 con 0x7fca88161f40 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8ff42640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fca880cfbf0 con 0x7fca8815bf90 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8ff42640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fca880ce830 con 0x7fca880cdae0 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca88161f40 0x7fca8815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca88161f40 0x7fca8815aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52052/0 (socket says 172.21.15.181:52052) 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 -- 172.21.15.181:0/3486631634 learned_addr learned my addr 172.21.15.181:0/3486631634 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8d4dd640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca8815bf90 0x7fca8815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8dcde640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca880cdae0 0x7fca881f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 -- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca880cdae0 msgr2=0x7fca881f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca880cdae0 0x7fca881f72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 -- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca8815bf90 msgr2=0x7fca8815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca8815bf90 0x7fca8815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 -- 172.21.15.181:0/3486631634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca881f77e0 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.512+0000 7fca8e4df640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca88161f40 0x7fca8815aa30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fca8000c7f0 tx=0x7fca8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.513+0000 7fca7e7fc640 1 -- 172.21.15.181:0/3486631634 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80018070 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.513+0000 7fca7e7fc640 1 -- 172.21.15.181:0/3486631634 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8000a5e0 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.513+0000 7fca7e7fc640 1 -- 172.21.15.181:0/3486631634 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8000aa10 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.513+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca881f4840 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.513+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca881f4e00 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.514+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca880cf290 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.514+0000 7fca7e7fc640 1 -- 172.21.15.181:0/3486631634 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca8001b070 con 0x7fca88161f40 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.514+0000 7fca7e7fc640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fca6c06be30 0x7fca6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.515+0000 7fca8dcde640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fca6c06be30 0x7fca6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.515+0000 7fca7e7fc640 1 -- 172.21.15.181:0/3486631634 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fca8008a410 con 0x7fca88161f40 2024-09-12T02:33:25.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.515+0000 7fca8dcde640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fca6c06be30 0x7fca6c06e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca84006fd0 tx=0x7fca84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.519+0000 7fca7e7fc640 1 -- 172.21.15.181:0/3486631634 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca8815f910 con 0x7fca88161f40 2024-09-12T02:33:25.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.684+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca88071830 con 0x7fca88161f40 2024-09-12T02:33:25.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.685+0000 7fca7e7fc640 1 -- 172.21.15.181:0/3486631634 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16810 (secure 0 0 0) 0x7fca80058dc0 con 0x7fca88161f40 2024-09-12T02:33:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:25.686 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":59,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:33:24.427975+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:22.332817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:23.395647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:25.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fca6c06be30 msgr2=0x7fca6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fca6c06be30 0x7fca6c06e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca84006fd0 tx=0x7fca84008040 comp rx=0 tx=0).stop 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca88161f40 msgr2=0x7fca8815aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca88161f40 0x7fca8815aa30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fca8000c7f0 tx=0x7fca8000ccb0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 shutdown_connections 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fca6c06be30 0x7fca6c06e2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca8815bf90 0x7fca8815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca88161f40 0x7fca8815aa30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 --2- 172.21.15.181:0/3486631634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca880cdae0 0x7fca881f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.687+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 >> 172.21.15.181:0/3486631634 conn(0x7fca880b1770 msgr2=0x7fca8815faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.688+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 shutdown_connections 2024-09-12T02:33:25.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.688+0000 7fca8ff42640 1 -- 172.21.15.181:0/3486631634 wait complete. 2024-09-12T02:33:25.699 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:33:25.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.800+0000 7f32b7c3c640 1 Processor -- start 2024-09-12T02:33:25.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.800+0000 7f32b7c3c640 1 -- start start 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b7c3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 0x7f32b00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b7c3c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b00b4070 con 0x7f32b00b4cb0 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b7c3c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b00d0350 con 0x7f32b015ab40 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b7c3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32b00b5100 con 0x7f32b00b3c30 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b61d9640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f32b00b4cb0 0x7f32b00cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38952/0 (socket says 172.21.15.181:38952) 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b61d9640 1 -- 172.21.15.181:0/4041532074 learned_addr learned my addr 172.21.15.181:0/4041532074 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260984516 0 0) 0x7f32b00b4070 con 0x7f32b00b4cb0 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b51d7640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 0x7f32b00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.801+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f329c003520 con 0x7f32b00b4cb0 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 50811554 0 0) 0x7f329c003520 con 0x7f32b00b4cb0 2024-09-12T02:33:25.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 msgr2=0x7f32b00b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 0x7f32b00b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 >> v1:172.21.15.204:6789/0 conn(0x7f32b015ab40 legacy=0x7f32b00cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b00d0630 con 0x7f32b00b4cb0 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f32a80019f0 con 0x7f32b00b4cb0 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 >> v1:172.21.15.181:6789/0 conn(0x7f32b00b4cb0 legacy=0x7f32b00cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 0x7f329c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c003f20 0x7f329c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f329c004d40 0x7f329c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00b5100 con 0x7f329c004d40 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f329c00cbe0 con 0x7f329c003f20 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f329c00bb20 con 0x7f32b00b3c30 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b61d9640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f329c004d40 0x7f329c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b59d8640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 0x7f329c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b51d7640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c003f20 0x7f329c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b61d9640 1 -- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 msgr2=0x7f329c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b61d9640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b00b3c30 0x7f329c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b61d9640 1 -- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c003f20 msgr2=0x7f329c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b61d9640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c003f20 0x7f329c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.802+0000 7f32b61d9640 1 -- 172.21.15.181:0/4041532074 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c003520 con 0x7f329c004d40 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.803+0000 7f32b61d9640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f329c004d40 0x7f329c0051c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f32a800a920 tx=0x7f329c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8a32d037f4232b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.803+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a800a4c0 con 0x7f329c004d40 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.803+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a802f070 con 0x7f329c004d40 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.803+0000 7f32b49d6640 1 -- 172.21.15.181:0/4041532074 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a802bd20 con 0x7f329c004d40 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.804+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4041532074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f329c004d40 msgr2=0x7f329c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.804+0000 7f32b7c3c640 1 --2- 172.21.15.181:0/4041532074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f329c004d40 0x7f329c0051c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f32a800a920 tx=0x7f329c005830 comp rx=0 tx=0).stop 2024-09-12T02:33:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.804+0000 7f32b61d9640 1 -- 172.21.15.181:0/4041532074 reap_dead start 2024-09-12T02:33:25.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.804+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4041532074 shutdown_connections 2024-09-12T02:33:25.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.804+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4041532074 >> 172.21.15.181:0/4041532074 conn(0x7f32b006bc10 msgr2=0x7f32b006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:25.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.804+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4041532074 shutdown_connections 2024-09-12T02:33:25.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.804+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4041532074 wait complete. 2024-09-12T02:33:25.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.805+0000 7f32b7c3c640 1 Processor -- start 2024-09-12T02:33:25.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.805+0000 7f32b7c3c640 1 -- start start 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b7c3c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c004d40 0x7f32b0071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b7c3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b0158b60 0x7f32b01f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b7c3c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b014a6f0 0x7f32b00ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b7c3c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32b015c250 con 0x7f32b014a6f0 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b7c3c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f32b015c0d0 con 0x7f329c004d40 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b7c3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f32b00b4770 con 0x7f32b0158b60 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b014a6f0 0x7f32b00ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b014a6f0 0x7f32b00ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52072/0 (socket says 172.21.15.181:52072) 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 -- 172.21.15.181:0/4013790839 learned_addr learned my addr 172.21.15.181:0/4013790839 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b51d7640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b0158b60 0x7f32b01f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b59d8640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c004d40 0x7f32b0071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 -- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b0158b60 msgr2=0x7f32b01f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b0158b60 0x7f32b01f3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 -- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c004d40 msgr2=0x7f32b0071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c004d40 0x7f32b0071d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 -- 172.21.15.181:0/4013790839 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b01507f0 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b61d9640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b014a6f0 0x7f32b00ae8a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f32a800aa10 tx=0x7f32a8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32a67fc640 1 -- 172.21.15.181:0/4013790839 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a800a4c0 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32a67fc640 1 -- 172.21.15.181:0/4013790839 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a8004b60 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32a67fc640 1 -- 172.21.15.181:0/4013790839 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8034470 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.806+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b014b110 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.807+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b01504f0 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.808+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b0069170 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.808+0000 7f32a67fc640 1 -- 172.21.15.181:0/4013790839 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32a8034610 con 0x7f32b014a6f0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.808+0000 7f32a67fc640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f329406be30 0x7f329406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.808+0000 7f32b59d8640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f329406be30 0x7f329406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.809+0000 7f32a67fc640 1 -- 172.21.15.181:0/4013790839 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f32a80ab040 con 0x7f32b014a6f0 2024-09-12T02:33:25.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.809+0000 7f32b59d8640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f329406be30 0x7f329406e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32b014a470 tx=0x7f32ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:25.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:25.813+0000 7f32a67fc640 1 -- 172.21.15.181:0/4013790839 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32a80799f0 con 0x7f32b014a6f0 2024-09-12T02:33:26.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.013+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f32b006f7c0 con 0x7f32b014a6f0 2024-09-12T02:33:26.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.098+0000 7f32a67fc640 1 -- 172.21.15.181:0/4013790839 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) ==== 118+0+0 (secure 0 0 0) 0x7f32b006f7c0 con 0x7f32b014a6f0 2024-09-12T02:33:26.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f329406be30 msgr2=0x7f329406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f329406be30 0x7f329406e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32b014a470 tx=0x7f32ac009040 comp rx=0 tx=0).stop 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b014a6f0 msgr2=0x7f32b00ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b014a6f0 0x7f32b00ae8a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f32a800aa10 tx=0x7f32a8001dc0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 shutdown_connections 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f329406be30 0x7f329406e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32b014a6f0 0x7f32b00ae8a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f32b0158b60 0x7f32b01f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 --2- 172.21.15.181:0/4013790839 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f329c004d40 0x7f32b0071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 >> 172.21.15.181:0/4013790839 conn(0x7f32b006bc10 msgr2=0x7f32b0159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 shutdown_connections 2024-09-12T02:33:26.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.100+0000 7f32b7c3c640 1 -- 172.21.15.181:0/4013790839 wait complete. 2024-09-12T02:33:26.112 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:33:26.113 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:33:26.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.213+0000 7fe915766640 1 Processor -- start 2024-09-12T02:33:26.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.213+0000 7fe915766640 1 -- start start 2024-09-12T02:33:26.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.214+0000 7fe915766640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9100d4e20 0x7fe9100b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.214+0000 7fe915766640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9100b39d0 con 0x7fe91015e640 2024-09-12T02:33:26.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.214+0000 7fe915766640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9100cf520 con 0x7fe9100cef60 2024-09-12T02:33:26.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.214+0000 7fe915766640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe9100cf800 con 0x7fe9100d4e20 2024-09-12T02:33:26.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.214+0000 7fe90effd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe91015e640 0x7fe9100d2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38966/0 (socket says 172.21.15.181:38966) 2024-09-12T02:33:26.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.214+0000 7fe90effd640 1 -- 172.21.15.181:0/1205383873 learned_addr learned my addr 172.21.15.181:0/1205383873 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:26.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90f7fe640 1 --2- 172.21.15.181:0/1205383873 >> v2:172.21.15.204:3300/0 conn(0x7fe9100d4e20 0x7fe9100b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061111360 0 0) 0x7fe900001490 con 0x7fe91015e640 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8fc003520 con 0x7fe91015e640 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 684623346 0 0) 0x7fe8fc003520 con 0x7fe91015e640 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 >> v2:172.21.15.204:3300/0 conn(0x7fe9100d4e20 msgr2=0x7fe9100b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 --2- 172.21.15.181:0/1205383873 >> v2:172.21.15.204:3300/0 conn(0x7fe9100d4e20 0x7fe9100b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 >> v1:172.21.15.204:6789/0 conn(0x7fe9100cef60 legacy=0x7fe9100d4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9100cfae0 con 0x7fe91015e640 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fe900001bc0 con 0x7fe91015e640 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 >> v1:172.21.15.181:6789/0 conn(0x7fe91015e640 legacy=0x7fe9100d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100cf800 con 0x7fe8fc0051c0 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00c160 con 0x7fe8fc0039b0 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc00c360 con 0x7fe8fc004800 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90f7fe640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90effd640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90e7fc640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90f7fe640 1 -- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc004800 msgr2=0x7fe8fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90f7fe640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90f7fe640 1 -- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8fc0039b0 msgr2=0x7fe8fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90f7fe640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90f7fe640 1 -- 172.21.15.181:0/1205383873 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc003520 con 0x7fe8fc0051c0 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.215+0000 7fe90e7fc640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.216+0000 7fe90f7fe640 1 -- 172.21.15.181:0/1205383873 reap_dead start 2024-09-12T02:33:26.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.216+0000 7fe90f7fe640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe908009ac0 tx=0x7fe8fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5c79f05b240dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.216+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908009690 con 0x7fe8fc0051c0 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.216+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe908004020 con 0x7fe8fc0051c0 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.216+0000 7fe90dffb640 1 -- 172.21.15.181:0/1205383873 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908004410 con 0x7fe8fc0051c0 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.217+0000 7fe915766640 1 -- 172.21.15.181:0/1205383873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0051c0 msgr2=0x7fe8fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.217+0000 7fe915766640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe908009ac0 tx=0x7fe8fc005830 comp rx=0 tx=0).stop 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.217+0000 7fe915766640 1 -- 172.21.15.181:0/1205383873 shutdown_connections 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.217+0000 7fe915766640 1 --2- 172.21.15.181:0/1205383873 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.217+0000 7fe915766640 1 -- 172.21.15.181:0/1205383873 >> 172.21.15.181:0/1205383873 conn(0x7fe910067d70 msgr2=0x7fe910068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.217+0000 7fe915766640 1 -- 172.21.15.181:0/1205383873 shutdown_connections 2024-09-12T02:33:26.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.217+0000 7fe915766640 1 -- 172.21.15.181:0/1205383873 wait complete. 2024-09-12T02:33:26.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.218+0000 7fe915766640 1 Processor -- start 2024-09-12T02:33:26.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.218+0000 7fe915766640 1 -- start start 2024-09-12T02:33:26.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe915766640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc0051c0 0x7fe9101602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe915766640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe91015a520 0x7fe91015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe915766640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe910158400 0x7fe9101588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe915766640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100b3bf0 con 0x7fe91015a520 2024-09-12T02:33:26.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe915766640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe91015ea20 con 0x7fe910158400 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe915766640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100b3d70 con 0x7fe8fc0051c0 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe91015a520 0x7fe91015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe91015a520 0x7fe91015a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52090/0 (socket says 172.21.15.181:52090) 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 -- 172.21.15.181:0/987941363 learned_addr learned my addr 172.21.15.181:0/987941363 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90effd640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc0051c0 0x7fe9101602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90f7fe640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe910158400 0x7fe9101588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 -- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc0051c0 msgr2=0x7fe9101602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc0051c0 0x7fe9101602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 -- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe910158400 msgr2=0x7fe9101588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe910158400 0x7fe9101588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 -- 172.21.15.181:0/987941363 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9100cc260 con 0x7fe91015a520 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.219+0000 7fe90e7fc640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe91015a520 0x7fe91015a9a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8000c00 tx=0x7fe8f800e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:26.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.220+0000 7fe9077fe640 1 -- 172.21.15.181:0/987941363 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8019070 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.220+0000 7fe9077fe640 1 -- 172.21.15.181:0/987941363 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f80052e0 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.220+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9100cd5e0 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.220+0000 7fe9077fe640 1 -- 172.21.15.181:0/987941363 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8003830 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.220+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9100ccac0 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.221+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9100b7c30 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.221+0000 7fe9077fe640 1 -- 172.21.15.181:0/987941363 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8f801c070 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.221+0000 7fe9077fe640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe8f006be30 0x7fe8f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.222+0000 7fe9077fe640 1 -- 172.21.15.181:0/987941363 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f808a3e0 con 0x7fe91015a520 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.222+0000 7fe90effd640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe8f006be30 0x7fe8f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.222+0000 7fe90effd640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe8f006be30 0x7fe8f006e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe900001b40 tx=0x7fe900006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:26.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.226+0000 7fe9077fe640 1 -- 172.21.15.181:0/987941363 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9100cd5e0 con 0x7fe91015a520 2024-09-12T02:33:26.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:26.430+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe9100b7670 con 0x7fe91015a520 2024-09-12T02:33:26.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-12T02:33:26.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-12T02:33:26.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-12T02:33:27.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.103+0000 7fe9077fe640 1 -- 172.21.15.181:0/987941363 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7fe8f8058740 con 0x7fe91015a520 2024-09-12T02:33:27.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe8f006be30 msgr2=0x7fe8f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe8f006be30 0x7fe8f006e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe900001b40 tx=0x7fe900006040 comp rx=0 tx=0).stop 2024-09-12T02:33:27.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe91015a520 msgr2=0x7fe91015a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe91015a520 0x7fe91015a9a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8000c00 tx=0x7fe8f800e8f0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 shutdown_connections 2024-09-12T02:33:27.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe8f006be30 0x7fe8f006e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe910158400 0x7fe9101588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe91015a520 0x7fe91015a9a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 --2- 172.21.15.181:0/987941363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8fc0051c0 0x7fe9101602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 >> 172.21.15.181:0/987941363 conn(0x7fe910067d70 msgr2=0x7fe9100ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:27.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 shutdown_connections 2024-09-12T02:33:27.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.106+0000 7fe915766640 1 -- 172.21.15.181:0/987941363 wait complete. 2024-09-12T02:33:27.121 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:33:27.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:27.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.225+0000 7f6bcdc9b640 1 Processor -- start 2024-09-12T02:33:27.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.225+0000 7f6bcdc9b640 1 -- start start 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bcdc9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6bc815c360 0x7f6bc80b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bcdc9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bcdc9b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc806ff60 con 0x7f6bc80cf820 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bcdc9b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc815c740 con 0x7f6bc815c360 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bcdc9b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc8160de0 con 0x7f6bc806fb20 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6bc815c360 0x7f6bc80b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6bc815c360 0x7f6bc80b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52098/0 (socket says 172.21.15.181:52098) 2024-09-12T02:33:27.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc77fe640 1 -- 172.21.15.181:0/3227548045 learned_addr learned my addr 172.21.15.181:0/3227548045 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc6ffd640 1 --2- 172.21.15.181:0/3227548045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc77fe640 1 -- 172.21.15.181:0/3227548045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 msgr2=0x7f6bc81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc77fe640 1 --2- 172.21.15.181:0/3227548045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc81608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc77fe640 1 -- 172.21.15.181:0/3227548045 >> v1:172.21.15.204:6789/0 conn(0x7f6bc80cf820 legacy=0x7f6bc806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.226+0000 7f6bc77fe640 1 -- 172.21.15.181:0/3227548045 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc80b65b0 con 0x7f6bc815c360 2024-09-12T02:33:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.227+0000 7f6bc77fe640 1 --2- 172.21.15.181:0/3227548045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc815c360 0x7f6bc80b5ef0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009e50 tx=0x7f6bb802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe39eabc1fe026e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.227+0000 7f6bc67fc640 1 -- 172.21.15.181:0/3227548045 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8036070 con 0x7f6bc815c360 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.227+0000 7f6bc67fc640 1 -- 172.21.15.181:0/3227548045 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb8031600 con 0x7f6bc815c360 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.227+0000 7f6bc67fc640 1 -- 172.21.15.181:0/3227548045 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80319d0 con 0x7f6bc815c360 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/3227548045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc815c360 msgr2=0x7f6bc80b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/3227548045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc815c360 0x7f6bc80b5ef0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009e50 tx=0x7f6bb802a6c0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/3227548045 shutdown_connections 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/3227548045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc81608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/3227548045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc815c360 0x7f6bc80b5ef0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/3227548045 >> 172.21.15.181:0/3227548045 conn(0x7f6bc80b1770 msgr2=0x7f6bc80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/3227548045 shutdown_connections 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.228+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/3227548045 wait complete. 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.229+0000 7f6bcdc9b640 1 Processor -- start 2024-09-12T02:33:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.229+0000 7f6bcdc9b640 1 -- start start 2024-09-12T02:33:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bcdc9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bcdc9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc80cf820 0x7f6bc81f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bcdc9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815c360 0x7f6bc814b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bcdc9b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc806f600 con 0x7f6bc80cf820 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bcdc9b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc806f320 con 0x7f6bc815c360 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bcdc9b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc806ef40 con 0x7f6bc806fb20 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc80cf820 0x7f6bc81f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc80cf820 0x7f6bc81f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52114/0 (socket says 172.21.15.181:52114) 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 -- 172.21.15.181:0/2427764748 learned_addr learned my addr 172.21.15.181:0/2427764748 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc77fe640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc7fff640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815c360 0x7f6bc814b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 -- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 msgr2=0x7f6bc815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 -- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815c360 msgr2=0x7f6bc814b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815c360 0x7f6bc814b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 -- 172.21.15.181:0/2427764748 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc814bcf0 con 0x7f6bc80cf820 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bc6ffd640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc80cf820 0x7f6bc81f2920 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c820 tx=0x7f6bbc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6baffff640 1 -- 172.21.15.181:0/2427764748 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc015070 con 0x7f6bc80cf820 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6baffff640 1 -- 172.21.15.181:0/2427764748 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bbc004240 con 0x7f6bc80cf820 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6baffff640 1 -- 172.21.15.181:0/2427764748 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00ce10 con 0x7f6bc80cf820 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.230+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc815e6a0 con 0x7f6bc80cf820 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.231+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc815ec60 con 0x7f6bc80cf820 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.231+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc81608a0 con 0x7f6bc80cf820 2024-09-12T02:33:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.232+0000 7f6baffff640 1 -- 172.21.15.181:0/2427764748 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bbc007830 con 0x7f6bc80cf820 2024-09-12T02:33:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.232+0000 7f6baffff640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6bb406be60 0x7f6bb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.233+0000 7f6bc77fe640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6bb406be60 0x7f6bb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.233+0000 7f6baffff640 1 -- 172.21.15.181:0/2427764748 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6bbc08ac60 con 0x7f6bc80cf820 2024-09-12T02:33:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.233+0000 7f6bc77fe640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6bb406be60 0x7f6bb406e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8033000 tx=0x7f6bb8009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.237+0000 7f6baffff640 1 -- 172.21.15.181:0/2427764748 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bbc058fc0 con 0x7f6bc80cf820 2024-09-12T02:33:27.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.436+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bc8067e30 con 0x7f6bc80cf820 2024-09-12T02:33:27.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.436+0000 7f6baffff640 1 -- 172.21.15.181:0/2427764748 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5232 (secure 0 0 0) 0x7f6bbc05d2c0 con 0x7f6bc80cf820 2024-09-12T02:33:27.438 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:27.438 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":40,"btime":"2024-09-12T02:33:27:099622+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2505607206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2505607206},{"type":"v1","addr":"172.21.15.181:6837","nonce":2505607206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1808682347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1808682347},{"type":"v1","addr":"172.21.15.204:6834","nonce":1808682347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:33:26.432148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6144]},"id":4}]} 2024-09-12T02:33:27.438 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 40 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6bb406be60 msgr2=0x7f6bb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6bb406be60 0x7f6bb406e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8033000 tx=0x7f6bb8009000 comp rx=0 tx=0).stop 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc80cf820 msgr2=0x7f6bc81f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc80cf820 0x7f6bc81f2920 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c820 tx=0x7f6bbc00cce0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 shutdown_connections 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6bb406be60 0x7f6bb406e320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6bc815c360 0x7f6bc814b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bc80cf820 0x7f6bc81f2920 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 --2- 172.21.15.181:0/2427764748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6bc806fb20 0x7f6bc815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 >> 172.21.15.181:0/2427764748 conn(0x7f6bc80b1770 msgr2=0x7f6bc80723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 shutdown_connections 2024-09-12T02:33:27.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.439+0000 7f6bcdc9b640 1 -- 172.21.15.181:0/2427764748 wait complete. 2024-09-12T02:33:27.451 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:27.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.548+0000 7f5aa919d640 1 Processor -- start 2024-09-12T02:33:27.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.548+0000 7f5aa919d640 1 -- start start 2024-09-12T02:33:27.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa919d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa919d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5aa4070270 0x7f5aa40b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa919d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa415c4c0 con 0x7f5aa40724f0 2024-09-12T02:33:27.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa919d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa415ec30 con 0x7f5aa4070270 2024-09-12T02:33:27.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa919d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa415eed0 con 0x7f5aa415b9b0 2024-09-12T02:33:27.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa899c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5aa4070270 0x7f5aa40b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa37fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5aa40724f0 0x7f5aa406fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38980/0 (socket says 172.21.15.181:38980) 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa37fe640 1 -- 172.21.15.181:0/1326860460 learned_addr learned my addr 172.21.15.181:0/1326860460 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.549+0000 7f5aa899c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5aa4070270 0x7f5aa40b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52122/0 (socket says 172.21.15.181:52122) 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa899c640 1 -- 172.21.15.181:0/1326860460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 msgr2=0x7f5aa415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa3fff640 1 --2- 172.21.15.181:0/1326860460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa2ffd640 1 -- 172.21.15.181:0/1326860460 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505951908 0 0) 0x7f5aa415c4c0 con 0x7f5aa40724f0 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa899c640 1 --2- 172.21.15.181:0/1326860460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa415bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa899c640 1 -- 172.21.15.181:0/1326860460 >> v1:172.21.15.181:6789/0 conn(0x7f5aa40724f0 legacy=0x7f5aa406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa899c640 1 -- 172.21.15.181:0/1326860460 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa415f1b0 con 0x7f5aa4070270 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.550+0000 7f5aa899c640 1 --2- 172.21.15.181:0/1326860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b49c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009d90 tx=0x7f5a9c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a694a902b977da48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa2ffd640 1 -- 172.21.15.181:0/1326860460 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c031600 con 0x7f5aa4070270 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa2ffd640 1 -- 172.21.15.181:0/1326860460 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c0317a0 con 0x7f5aa4070270 2024-09-12T02:33:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa2ffd640 1 -- 172.21.15.181:0/1326860460 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c031b70 con 0x7f5aa4070270 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 -- 172.21.15.181:0/1326860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 msgr2=0x7f5aa40b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 --2- 172.21.15.181:0/1326860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b49c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009d90 tx=0x7f5a9c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 -- 172.21.15.181:0/1326860460 shutdown_connections 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 --2- 172.21.15.181:0/1326860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b49c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 --2- 172.21.15.181:0/1326860460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 -- 172.21.15.181:0/1326860460 >> 172.21.15.181:0/1326860460 conn(0x7f5aa406f070 msgr2=0x7f5aa406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 -- 172.21.15.181:0/1326860460 shutdown_connections 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.551+0000 7f5aa919d640 1 -- 172.21.15.181:0/1326860460 wait complete. 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.552+0000 7f5aa919d640 1 Processor -- start 2024-09-12T02:33:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa919d640 1 -- start start 2024-09-12T02:33:27.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa919d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa919d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aa40724f0 0x7f5aa4152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa919d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa919d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40b61d0 con 0x7f5aa4070270 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa919d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa415f9b0 con 0x7f5aa40724f0 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa919d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa40b6350 con 0x7f5aa415b9b0 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa3fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa3fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52136/0 (socket says 172.21.15.181:52136) 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.553+0000 7f5aa3fff640 1 -- 172.21.15.181:0/256267882 learned_addr learned my addr 172.21.15.181:0/256267882 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:27.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa899c640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa3fff640 1 -- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 msgr2=0x7f5aa406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa3fff640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa3fff640 1 -- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aa40724f0 msgr2=0x7f5aa4152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa37fe640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aa40724f0 0x7f5aa4152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa3fff640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aa40724f0 0x7f5aa4152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa3fff640 1 -- 172.21.15.181:0/256267882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa41539a0 con 0x7f5aa4070270 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa37fe640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aa40724f0 0x7f5aa4152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa3fff640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b53f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400c7f0 tx=0x7f5a9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa0ff9640 1 -- 172.21.15.181:0/256267882 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94015070 con 0x7f5aa4070270 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa0ff9640 1 -- 172.21.15.181:0/256267882 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a94004240 con 0x7f5aa4070270 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa4153c80 con 0x7f5aa4070270 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa0ff9640 1 -- 172.21.15.181:0/256267882 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94007620 con 0x7f5aa4070270 2024-09-12T02:33:27.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.554+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa4154760 con 0x7f5aa4070270 2024-09-12T02:33:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.555+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa4072fd0 con 0x7f5aa4070270 2024-09-12T02:33:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.555+0000 7f5aa0ff9640 1 -- 172.21.15.181:0/256267882 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a940079d0 con 0x7f5aa4070270 2024-09-12T02:33:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.556+0000 7f5aa0ff9640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5a9006be30 0x7f5a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.556+0000 7f5aa0ff9640 1 -- 172.21.15.181:0/256267882 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f5a9408b270 con 0x7f5aa4070270 2024-09-12T02:33:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.556+0000 7f5aa37fe640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5a9006be30 0x7f5a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.556+0000 7f5aa37fe640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5a9006be30 0x7f5a9006e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5aa414ca20 tx=0x7f5a98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.560+0000 7f5aa0ff9640 1 -- 172.21.15.181:0/256267882 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5aa4072fd0 con 0x7f5aa4070270 2024-09-12T02:33:27.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.726+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5aa415bd90 con 0x7f5aa4070270 2024-09-12T02:33:27.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.727+0000 7f5aa0ff9640 1 -- 172.21.15.181:0/256267882 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16797 (secure 0 0 0) 0x7f5a94059cb0 con 0x7f5aa4070270 2024-09-12T02:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":60,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:33:26.094961+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:22.332817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:23.395647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:27.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.729+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5a9006be30 msgr2=0x7f5a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.729+0000 7f5aa919d640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5a9006be30 0x7f5a9006e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5aa414ca20 tx=0x7f5a98009040 comp rx=0 tx=0).stop 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.729+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 msgr2=0x7f5aa40b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.729+0000 7f5aa919d640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b53f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400c7f0 tx=0x7f5a9400ccb0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.729+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 shutdown_connections 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.729+0000 7f5aa919d640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5a9006be30 0x7f5a9006e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.730+0000 7f5aa919d640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aa40724f0 0x7f5aa4152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.730+0000 7f5aa919d640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aa415b9b0 0x7f5aa406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.730+0000 7f5aa919d640 1 --2- 172.21.15.181:0/256267882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5aa4070270 0x7f5aa40b53f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.730+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 >> 172.21.15.181:0/256267882 conn(0x7f5aa406f070 msgr2=0x7f5aa41597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.730+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 shutdown_connections 2024-09-12T02:33:27.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.730+0000 7f5aa919d640 1 -- 172.21.15.181:0/256267882 wait complete. 2024-09-12T02:33:27.742 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:33:27.743 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.842+0000 7efdf9cc0640 1 Processor -- start 2024-09-12T02:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.842+0000 7efdf9cc0640 1 -- start start 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf9cc0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efdf4156770 0x7efdf4160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf9cc0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40cff30 0x7efdf406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf9cc0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf4160d50 con 0x7efdf40afec0 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf9cc0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7efdf40b61b0 con 0x7efdf4156770 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf9cc0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40b6490 con 0x7efdf40cff30 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40cff30 0x7efdf406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf37fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efdf4156770 0x7efdf4160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40cff30 0x7efdf406ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:56178/0 (socket says 172.21.15.181:56178) 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf3fff640 1 -- 172.21.15.181:0/4226872692 learned_addr learned my addr 172.21.15.181:0/4226872692 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.843+0000 7efdf2ffd640 1 --1- 172.21.15.181:0/4226872692 >> v1:172.21.15.204:6789/0 conn(0x7efdf40afec0 0x7efdf40cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:54202/0 (socket says 172.21.15.181:54202) 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.844+0000 7efdf3fff640 1 -- 172.21.15.181:0/4226872692 >> v2:172.21.15.204:3300/0 conn(0x7efdf4156770 msgr2=0x7efdf4160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.844+0000 7efdf3fff640 1 --2- 172.21.15.181:0/4226872692 >> v2:172.21.15.204:3300/0 conn(0x7efdf4156770 0x7efdf4160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.844+0000 7efdf3fff640 1 -- 172.21.15.181:0/4226872692 >> v1:172.21.15.204:6789/0 conn(0x7efdf40afec0 legacy=0x7efdf40cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.844+0000 7efdf3fff640 1 -- 172.21.15.181:0/4226872692 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf40b6770 con 0x7efdf40cff30 2024-09-12T02:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.844+0000 7efdf37fe640 1 --2- 172.21.15.181:0/4226872692 >> v2:172.21.15.204:3300/0 conn(0x7efdf4156770 0x7efdf4160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.844+0000 7efdf3fff640 1 --2- 172.21.15.181:0/4226872692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40cff30 0x7efdf406ef40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efdec009e50 tx=0x7efdec02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7947ccfacca77634 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf27fc640 1 -- 172.21.15.181:0/4226872692 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec036070 con 0x7efdf40cff30 2024-09-12T02:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf27fc640 1 -- 172.21.15.181:0/4226872692 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec031600 con 0x7efdf40cff30 2024-09-12T02:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf27fc640 1 -- 172.21.15.181:0/4226872692 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0319d0 con 0x7efdf40cff30 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 -- 172.21.15.181:0/4226872692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40cff30 msgr2=0x7efdf406ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/4226872692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40cff30 0x7efdf406ef40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efdec009e50 tx=0x7efdec02a680 comp rx=0 tx=0).stop 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 -- 172.21.15.181:0/4226872692 shutdown_connections 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/4226872692 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40cff30 0x7efdf406ef40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/4226872692 >> v2:172.21.15.204:3300/0 conn(0x7efdf4156770 0x7efdf4160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 -- 172.21.15.181:0/4226872692 >> 172.21.15.181:0/4226872692 conn(0x7efdf40b1770 msgr2=0x7efdf40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 -- 172.21.15.181:0/4226872692 shutdown_connections 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.845+0000 7efdf9cc0640 1 -- 172.21.15.181:0/4226872692 wait complete. 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.846+0000 7efdf9cc0640 1 Processor -- start 2024-09-12T02:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf9cc0640 1 -- start start 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf9cc0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40afec0 0x7efdf41e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf9cc0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdf40cff30 0x7efdf4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf9cc0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf4156770 0x7efdf41f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf9cc0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4156cd0 con 0x7efdf40cff30 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf9cc0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4156b50 con 0x7efdf40afec0 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf9cc0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40b0350 con 0x7efdf4156770 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.847+0000 7efdf2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdf40cff30 0x7efdf4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdf40cff30 0x7efdf4152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52152/0 (socket says 172.21.15.181:52152) 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 -- 172.21.15.181:0/486109320 learned_addr learned my addr 172.21.15.181:0/486109320 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf37fe640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40afec0 0x7efdf41e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf3fff640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf4156770 0x7efdf41f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 -- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf4156770 msgr2=0x7efdf41f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf4156770 0x7efdf41f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 -- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40afec0 msgr2=0x7efdf41e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40afec0 0x7efdf41e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 -- 172.21.15.181:0/486109320 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf41e6360 con 0x7efdf40cff30 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdf40cff30 0x7efdf4152a60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efde800c400 tx=0x7efde800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efddbfff640 1 -- 172.21.15.181:0/486109320 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde80074e0 con 0x7efdf40cff30 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efddbfff640 1 -- 172.21.15.181:0/486109320 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde80047e0 con 0x7efdf40cff30 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf41e6640 con 0x7efdf40cff30 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efddbfff640 1 -- 172.21.15.181:0/486109320 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8004c10 con 0x7efdf40cff30 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.848+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf41e6c00 con 0x7efdf40cff30 2024-09-12T02:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.849+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf4160810 con 0x7efdf40cff30 2024-09-12T02:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.850+0000 7efddbfff640 1 -- 172.21.15.181:0/486109320 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efde801a020 con 0x7efdf40cff30 2024-09-12T02:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.850+0000 7efddbfff640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde006be30 0x7efde006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.850+0000 7efddbfff640 1 -- 172.21.15.181:0/486109320 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7efde808a5a0 con 0x7efdf40cff30 2024-09-12T02:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.850+0000 7efdf37fe640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde006be30 0x7efde006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.851+0000 7efdf37fe640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde006be30 0x7efde006e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efdf40b1c20 tx=0x7efde4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:27.854+0000 7efddbfff640 1 -- 172.21.15.181:0/486109320 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efde8058880 con 0x7efdf40cff30 2024-09-12T02:33:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.016+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efdf4067e30 con 0x7efde006be30 2024-09-12T02:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.022+0000 7efddbfff640 1 -- 172.21.15.181:0/486109320 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251952 (secure 0 0 0) 0x7efdf4067e30 con 0x7efde006be30 2024-09-12T02:33:28.025 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:33:28.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.024+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde006be30 msgr2=0x7efde006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.024+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde006be30 0x7efde006e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efdf40b1c20 tx=0x7efde4009190 comp rx=0 tx=0).stop 2024-09-12T02:33:28.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.024+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdf40cff30 msgr2=0x7efdf4152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.024+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdf40cff30 0x7efdf4152a60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efde800c400 tx=0x7efde800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 shutdown_connections 2024-09-12T02:33:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde006be30 0x7efde006e2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf4156770 0x7efdf41f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdf40cff30 0x7efdf4152a60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 --2- 172.21.15.181:0/486109320 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40afec0 0x7efdf41e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 >> 172.21.15.181:0/486109320 conn(0x7efdf40b1770 msgr2=0x7efdf40b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:28.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 shutdown_connections 2024-09-12T02:33:28.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.025+0000 7efdf9cc0640 1 -- 172.21.15.181:0/486109320 wait complete. 2024-09-12T02:33:28.037 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-12T02:33:27.676091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235516,"kb_used_data":6780,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739204,"statfs":{"total":773094113280,"available":772852944896,"internally_reserved":0,"allocated":6942720,"data_stored":3562416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.600221"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246143+0000","last_change":"2024-09-12T02:33:25.102177+0000","last_active":"2024-09-12T02:33:26.246143+0000","last_peered":"2024-09-12T02:33:26.246143+0000","last_clean":"2024-09-12T02:33:26.246143+0000","last_became_active":"2024-09-12T02:33:25.101819+0000","last_became_peered":"2024-09-12T02:33:25.101819+0000","last_unstale":"2024-09-12T02:33:26.246143+0000","last_undegraded":"2024-09-12T02:33:26.246143+0000","last_fullsized":"2024-09-12T02:33:26.246143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:18.201084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247643+0000","last_change":"2024-09-12T02:33:25.097196+0000","last_active":"2024-09-12T02:33:26.247643+0000","last_peered":"2024-09-12T02:33:26.247643+0000","last_clean":"2024-09-12T02:33:26.247643+0000","last_became_active":"2024-09-12T02:33:25.096950+0000","last_became_peered":"2024-09-12T02:33:25.096950+0000","last_unstale":"2024-09-12T02:33:26.247643+0000","last_undegraded":"2024-09-12T02:33:26.247643+0000","last_fullsized":"2024-09-12T02:33:26.247643+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:46.058594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103377+0000","last_change":"2024-09-12T02:33:25.102829+0000","last_active":"2024-09-12T02:33:26.103377+0000","last_peered":"2024-09-12T02:33:26.103377+0000","last_clean":"2024-09-12T02:33:26.103377+0000","last_became_active":"2024-09-12T02:33:25.102248+0000","last_became_peered":"2024-09-12T02:33:25.102248+0000","last_unstale":"2024-09-12T02:33:26.103377+0000","last_undegraded":"2024-09-12T02:33:26.103377+0000","last_fullsized":"2024-09-12T02:33:26.103377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.289063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246105+0000","last_change":"2024-09-12T02:33:25.106328+0000","last_active":"2024-09-12T02:33:26.246105+0000","last_peered":"2024-09-12T02:33:26.246105+0000","last_clean":"2024-09-12T02:33:26.246105+0000","last_became_active":"2024-09-12T02:33:25.105885+0000","last_became_peered":"2024-09-12T02:33:25.105885+0000","last_unstale":"2024-09-12T02:33:26.246105+0000","last_undegraded":"2024-09-12T02:33:26.246105+0000","last_fullsized":"2024-09-12T02:33:26.246105+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.870536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246462+0000","last_change":"2024-09-12T02:33:25.103117+0000","last_active":"2024-09-12T02:33:26.246462+0000","last_peered":"2024-09-12T02:33:26.246462+0000","last_clean":"2024-09-12T02:33:26.246462+0000","last_became_active":"2024-09-12T02:33:25.102846+0000","last_became_peered":"2024-09-12T02:33:25.102846+0000","last_unstale":"2024-09-12T02:33:26.246462+0000","last_undegraded":"2024-09-12T02:33:26.246462+0000","last_fullsized":"2024-09-12T02:33:26.246462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:32.758535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245607+0000","last_change":"2024-09-12T02:33:25.098208+0000","last_active":"2024-09-12T02:33:26.245607+0000","last_peered":"2024-09-12T02:33:26.245607+0000","last_clean":"2024-09-12T02:33:26.245607+0000","last_became_active":"2024-09-12T02:33:25.097951+0000","last_became_peered":"2024-09-12T02:33:25.097951+0000","last_unstale":"2024-09-12T02:33:26.245607+0000","last_undegraded":"2024-09-12T02:33:26.245607+0000","last_fullsized":"2024-09-12T02:33:26.245607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:13.041980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108406+0000","last_change":"2024-09-12T02:33:25.101639+0000","last_active":"2024-09-12T02:33:26.108406+0000","last_peered":"2024-09-12T02:33:26.108406+0000","last_clean":"2024-09-12T02:33:26.108406+0000","last_became_active":"2024-09-12T02:33:25.101393+0000","last_became_peered":"2024-09-12T02:33:25.101393+0000","last_unstale":"2024-09-12T02:33:26.108406+0000","last_undegraded":"2024-09-12T02:33:26.108406+0000","last_fullsized":"2024-09-12T02:33:26.108406+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:15.323895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247175+0000","last_change":"2024-09-12T02:33:25.099625+0000","last_active":"2024-09-12T02:33:26.247175+0000","last_peered":"2024-09-12T02:33:26.247175+0000","last_clean":"2024-09-12T02:33:26.247175+0000","last_became_active":"2024-09-12T02:33:25.098348+0000","last_became_peered":"2024-09-12T02:33:25.098348+0000","last_unstale":"2024-09-12T02:33:26.247175+0000","last_undegraded":"2024-09-12T02:33:26.247175+0000","last_fullsized":"2024-09-12T02:33:26.247175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:20.633613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109062+0000","last_change":"2024-09-12T02:33:25.102349+0000","last_active":"2024-09-12T02:33:26.109062+0000","last_peered":"2024-09-12T02:33:26.109062+0000","last_clean":"2024-09-12T02:33:26.109062+0000","last_became_active":"2024-09-12T02:33:25.102083+0000","last_became_peered":"2024-09-12T02:33:25.102083+0000","last_unstale":"2024-09-12T02:33:26.109062+0000","last_undegraded":"2024-09-12T02:33:26.109062+0000","last_fullsized":"2024-09-12T02:33:26.109062+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:12.906590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246578+0000","last_change":"2024-09-12T02:33:25.094293+0000","last_active":"2024-09-12T02:33:26.246578+0000","last_peered":"2024-09-12T02:33:26.246578+0000","last_clean":"2024-09-12T02:33:26.246578+0000","last_became_active":"2024-09-12T02:33:25.094049+0000","last_became_peered":"2024-09-12T02:33:25.094049+0000","last_unstale":"2024-09-12T02:33:26.246578+0000","last_undegraded":"2024-09-12T02:33:26.246578+0000","last_fullsized":"2024-09-12T02:33:26.246578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:12.564791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246126+0000","last_change":"2024-09-12T02:33:25.098475+0000","last_active":"2024-09-12T02:33:26.246126+0000","last_peered":"2024-09-12T02:33:26.246126+0000","last_clean":"2024-09-12T02:33:26.246126+0000","last_became_active":"2024-09-12T02:33:25.098221+0000","last_became_peered":"2024-09-12T02:33:25.098221+0000","last_unstale":"2024-09-12T02:33:26.246126+0000","last_undegraded":"2024-09-12T02:33:26.246126+0000","last_fullsized":"2024-09-12T02:33:26.246126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:49.785571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246243+0000","last_change":"2024-09-12T02:33:25.111707+0000","last_active":"2024-09-12T02:33:26.246243+0000","last_peered":"2024-09-12T02:33:26.246243+0000","last_clean":"2024-09-12T02:33:26.246243+0000","last_became_active":"2024-09-12T02:33:25.111135+0000","last_became_peered":"2024-09-12T02:33:25.111135+0000","last_unstale":"2024-09-12T02:33:26.246243+0000","last_undegraded":"2024-09-12T02:33:26.246243+0000","last_fullsized":"2024-09-12T02:33:26.246243+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:13.041980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109395+0000","last_change":"2024-09-12T02:33:25.097225+0000","last_active":"2024-09-12T02:33:26.109395+0000","last_peered":"2024-09-12T02:33:26.109395+0000","last_clean":"2024-09-12T02:33:26.109395+0000","last_became_active":"2024-09-12T02:33:25.096987+0000","last_became_peered":"2024-09-12T02:33:25.096987+0000","last_unstale":"2024-09-12T02:33:26.109395+0000","last_undegraded":"2024-09-12T02:33:26.109395+0000","last_fullsized":"2024-09-12T02:33:26.109395+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:34.574954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108591+0000","last_change":"2024-09-12T02:33:25.094914+0000","last_active":"2024-09-12T02:33:26.108591+0000","last_peered":"2024-09-12T02:33:26.108591+0000","last_clean":"2024-09-12T02:33:26.108591+0000","last_became_active":"2024-09-12T02:33:25.094451+0000","last_became_peered":"2024-09-12T02:33:25.094451+0000","last_unstale":"2024-09-12T02:33:26.108591+0000","last_undegraded":"2024-09-12T02:33:26.108591+0000","last_fullsized":"2024-09-12T02:33:26.108591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:46.114981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108535+0000","last_change":"2024-09-12T02:33:25.100939+0000","last_active":"2024-09-12T02:33:26.108535+0000","last_peered":"2024-09-12T02:33:26.108535+0000","last_clean":"2024-09-12T02:33:26.108535+0000","last_became_active":"2024-09-12T02:33:25.100470+0000","last_became_peered":"2024-09-12T02:33:25.100470+0000","last_unstale":"2024-09-12T02:33:26.108535+0000","last_undegraded":"2024-09-12T02:33:26.108535+0000","last_fullsized":"2024-09-12T02:33:26.108535+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:03.342562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245548+0000","last_change":"2024-09-12T02:33:25.110738+0000","last_active":"2024-09-12T02:33:26.245548+0000","last_peered":"2024-09-12T02:33:26.245548+0000","last_clean":"2024-09-12T02:33:26.245548+0000","last_became_active":"2024-09-12T02:33:25.110286+0000","last_became_peered":"2024-09-12T02:33:25.110286+0000","last_unstale":"2024-09-12T02:33:26.245548+0000","last_undegraded":"2024-09-12T02:33:26.245548+0000","last_fullsized":"2024-09-12T02:33:26.245548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:53.834499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247346+0000","last_change":"2024-09-12T02:33:25.096387+0000","last_active":"2024-09-12T02:33:26.247346+0000","last_peered":"2024-09-12T02:33:26.247346+0000","last_clean":"2024-09-12T02:33:26.247346+0000","last_became_active":"2024-09-12T02:33:25.095900+0000","last_became_peered":"2024-09-12T02:33:25.095900+0000","last_unstale":"2024-09-12T02:33:26.247346+0000","last_undegraded":"2024-09-12T02:33:26.247346+0000","last_fullsized":"2024-09-12T02:33:26.247346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:07.534838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103554+0000","last_change":"2024-09-12T02:33:25.104112+0000","last_active":"2024-09-12T02:33:26.103554+0000","last_peered":"2024-09-12T02:33:26.103554+0000","last_clean":"2024-09-12T02:33:26.103554+0000","last_became_active":"2024-09-12T02:33:25.103766+0000","last_became_peered":"2024-09-12T02:33:25.103766+0000","last_unstale":"2024-09-12T02:33:26.103554+0000","last_undegraded":"2024-09-12T02:33:26.103554+0000","last_fullsized":"2024-09-12T02:33:26.103554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.870536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246222+0000","last_change":"2024-09-12T02:33:25.102432+0000","last_active":"2024-09-12T02:33:26.246222+0000","last_peered":"2024-09-12T02:33:26.246222+0000","last_clean":"2024-09-12T02:33:26.246222+0000","last_became_active":"2024-09-12T02:33:25.102179+0000","last_became_peered":"2024-09-12T02:33:25.102179+0000","last_unstale":"2024-09-12T02:33:26.246222+0000","last_undegraded":"2024-09-12T02:33:26.246222+0000","last_fullsized":"2024-09-12T02:33:26.246222+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.434104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247692+0000","last_change":"2024-09-12T02:33:25.099201+0000","last_active":"2024-09-12T02:33:26.247692+0000","last_peered":"2024-09-12T02:33:26.247692+0000","last_clean":"2024-09-12T02:33:26.247692+0000","last_became_active":"2024-09-12T02:33:25.098939+0000","last_became_peered":"2024-09-12T02:33:25.098939+0000","last_unstale":"2024-09-12T02:33:26.247692+0000","last_undegraded":"2024-09-12T02:33:26.247692+0000","last_fullsized":"2024-09-12T02:33:26.247692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:58.225930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103492+0000","last_change":"2024-09-12T02:33:25.104295+0000","last_active":"2024-09-12T02:33:26.103492+0000","last_peered":"2024-09-12T02:33:26.103492+0000","last_clean":"2024-09-12T02:33:26.103492+0000","last_became_active":"2024-09-12T02:33:25.104016+0000","last_became_peered":"2024-09-12T02:33:25.104016+0000","last_unstale":"2024-09-12T02:33:26.103492+0000","last_undegraded":"2024-09-12T02:33:26.103492+0000","last_fullsized":"2024-09-12T02:33:26.103492+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:05.444531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247496+0000","last_change":"2024-09-12T02:33:25.107374+0000","last_active":"2024-09-12T02:33:26.247496+0000","last_peered":"2024-09-12T02:33:26.247496+0000","last_clean":"2024-09-12T02:33:26.247496+0000","last_became_active":"2024-09-12T02:33:25.106678+0000","last_became_peered":"2024-09-12T02:33:25.106678+0000","last_unstale":"2024-09-12T02:33:26.247496+0000","last_undegraded":"2024-09-12T02:33:26.247496+0000","last_fullsized":"2024-09-12T02:33:26.247496+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:26.040502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103249+0000","last_change":"2024-09-12T02:33:25.105937+0000","last_active":"2024-09-12T02:33:26.103249+0000","last_peered":"2024-09-12T02:33:26.103249+0000","last_clean":"2024-09-12T02:33:26.103249+0000","last_became_active":"2024-09-12T02:33:25.105660+0000","last_became_peered":"2024-09-12T02:33:25.105660+0000","last_unstale":"2024-09-12T02:33:26.103249+0000","last_undegraded":"2024-09-12T02:33:26.103249+0000","last_fullsized":"2024-09-12T02:33:26.103249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:44.617355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109106+0000","last_change":"2024-09-12T02:33:25.097797+0000","last_active":"2024-09-12T02:33:26.109106+0000","last_peered":"2024-09-12T02:33:26.109106+0000","last_clean":"2024-09-12T02:33:26.109106+0000","last_became_active":"2024-09-12T02:33:25.097581+0000","last_became_peered":"2024-09-12T02:33:25.097581+0000","last_unstale":"2024-09-12T02:33:26.109106+0000","last_undegraded":"2024-09-12T02:33:26.109106+0000","last_fullsized":"2024-09-12T02:33:26.109106+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:15.102186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246414+0000","last_change":"2024-09-12T02:33:25.102770+0000","last_active":"2024-09-12T02:33:26.246414+0000","last_peered":"2024-09-12T02:33:26.246414+0000","last_clean":"2024-09-12T02:33:26.246414+0000","last_became_active":"2024-09-12T02:33:25.102505+0000","last_became_peered":"2024-09-12T02:33:25.102505+0000","last_unstale":"2024-09-12T02:33:26.246414+0000","last_undegraded":"2024-09-12T02:33:26.246414+0000","last_fullsized":"2024-09-12T02:33:26.246414+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:34.319553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246294+0000","last_change":"2024-09-12T02:33:25.102926+0000","last_active":"2024-09-12T02:33:26.246294+0000","last_peered":"2024-09-12T02:33:26.246294+0000","last_clean":"2024-09-12T02:33:26.246294+0000","last_became_active":"2024-09-12T02:33:25.102666+0000","last_became_peered":"2024-09-12T02:33:25.102666+0000","last_unstale":"2024-09-12T02:33:26.246294+0000","last_undegraded":"2024-09-12T02:33:26.246294+0000","last_fullsized":"2024-09-12T02:33:26.246294+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:38.899205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246264+0000","last_change":"2024-09-12T02:33:25.109643+0000","last_active":"2024-09-12T02:33:26.246264+0000","last_peered":"2024-09-12T02:33:26.246264+0000","last_clean":"2024-09-12T02:33:26.246264+0000","last_became_active":"2024-09-12T02:33:25.109386+0000","last_became_peered":"2024-09-12T02:33:25.109386+0000","last_unstale":"2024-09-12T02:33:26.246264+0000","last_undegraded":"2024-09-12T02:33:26.246264+0000","last_fullsized":"2024-09-12T02:33:26.246264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.543436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246598+0000","last_change":"2024-09-12T02:33:25.104146+0000","last_active":"2024-09-12T02:33:26.246598+0000","last_peered":"2024-09-12T02:33:26.246598+0000","last_clean":"2024-09-12T02:33:26.246598+0000","last_became_active":"2024-09-12T02:33:25.103900+0000","last_became_peered":"2024-09-12T02:33:25.103900+0000","last_unstale":"2024-09-12T02:33:26.246598+0000","last_undegraded":"2024-09-12T02:33:26.246598+0000","last_fullsized":"2024-09-12T02:33:26.246598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.939134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247838+0000","last_change":"2024-09-12T02:33:25.104323+0000","last_active":"2024-09-12T02:33:26.247838+0000","last_peered":"2024-09-12T02:33:26.247838+0000","last_clean":"2024-09-12T02:33:26.247838+0000","last_became_active":"2024-09-12T02:33:25.104075+0000","last_became_peered":"2024-09-12T02:33:25.104075+0000","last_unstale":"2024-09-12T02:33:26.247838+0000","last_undegraded":"2024-09-12T02:33:26.247838+0000","last_fullsized":"2024-09-12T02:33:26.247838+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:31.941896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103575+0000","last_change":"2024-09-12T02:33:25.100516+0000","last_active":"2024-09-12T02:33:26.103575+0000","last_peered":"2024-09-12T02:33:26.103575+0000","last_clean":"2024-09-12T02:33:26.103575+0000","last_became_active":"2024-09-12T02:33:25.100210+0000","last_became_peered":"2024-09-12T02:33:25.100210+0000","last_unstale":"2024-09-12T02:33:26.103575+0000","last_undegraded":"2024-09-12T02:33:26.103575+0000","last_fullsized":"2024-09-12T02:33:26.103575+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:53.834499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246069+0000","last_change":"2024-09-12T02:33:25.103029+0000","last_active":"2024-09-12T02:33:26.246069+0000","last_peered":"2024-09-12T02:33:26.246069+0000","last_clean":"2024-09-12T02:33:26.246069+0000","last_became_active":"2024-09-12T02:33:25.101860+0000","last_became_peered":"2024-09-12T02:33:25.101860+0000","last_unstale":"2024-09-12T02:33:26.246069+0000","last_undegraded":"2024-09-12T02:33:26.246069+0000","last_fullsized":"2024-09-12T02:33:26.246069+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:28.789353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245691+0000","last_change":"2024-09-12T02:33:25.097884+0000","last_active":"2024-09-12T02:33:26.245691+0000","last_peered":"2024-09-12T02:33:26.245691+0000","last_clean":"2024-09-12T02:33:26.245691+0000","last_became_active":"2024-09-12T02:33:25.097616+0000","last_became_peered":"2024-09-12T02:33:25.097616+0000","last_unstale":"2024-09-12T02:33:26.245691+0000","last_undegraded":"2024-09-12T02:33:26.245691+0000","last_fullsized":"2024-09-12T02:33:26.245691+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.292727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247182+0000","last_change":"2024-09-12T02:33:25.106253+0000","last_active":"2024-09-12T02:33:26.247182+0000","last_peered":"2024-09-12T02:33:26.247182+0000","last_clean":"2024-09-12T02:33:26.247182+0000","last_became_active":"2024-09-12T02:33:25.105758+0000","last_became_peered":"2024-09-12T02:33:25.105758+0000","last_unstale":"2024-09-12T02:33:26.247182+0000","last_undegraded":"2024-09-12T02:33:26.247182+0000","last_fullsized":"2024-09-12T02:33:26.247182+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:29.340460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246594+0000","last_change":"2024-09-12T02:33:24.103587+0000","last_active":"2024-09-12T02:33:26.246594+0000","last_peered":"2024-09-12T02:33:26.246594+0000","last_clean":"2024-09-12T02:33:26.246594+0000","last_became_active":"2024-09-12T02:33:24.102988+0000","last_became_peered":"2024-09-12T02:33:24.102988+0000","last_unstale":"2024-09-12T02:33:26.246594+0000","last_undegraded":"2024-09-12T02:33:26.246594+0000","last_fullsized":"2024-09-12T02:33:26.246594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:11.899473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246029+0000","last_change":"2024-09-12T02:33:25.104315+0000","last_active":"2024-09-12T02:33:26.246029+0000","last_peered":"2024-09-12T02:33:26.246029+0000","last_clean":"2024-09-12T02:33:26.246029+0000","last_became_active":"2024-09-12T02:33:25.103928+0000","last_became_peered":"2024-09-12T02:33:25.103928+0000","last_unstale":"2024-09-12T02:33:26.246029+0000","last_undegraded":"2024-09-12T02:33:26.246029+0000","last_fullsized":"2024-09-12T02:33:26.246029+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:22.696461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247746+0000","last_change":"2024-09-12T02:33:24.102352+0000","last_active":"2024-09-12T02:33:26.247746+0000","last_peered":"2024-09-12T02:33:26.247746+0000","last_clean":"2024-09-12T02:33:26.247746+0000","last_became_active":"2024-09-12T02:33:24.102096+0000","last_became_peered":"2024-09-12T02:33:24.102096+0000","last_unstale":"2024-09-12T02:33:26.247746+0000","last_undegraded":"2024-09-12T02:33:26.247746+0000","last_fullsized":"2024-09-12T02:33:26.247746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:18.680368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246804+0000","last_change":"2024-09-12T02:33:25.104055+0000","last_active":"2024-09-12T02:33:26.246804+0000","last_peered":"2024-09-12T02:33:26.246804+0000","last_clean":"2024-09-12T02:33:26.246804+0000","last_became_active":"2024-09-12T02:33:25.103577+0000","last_became_peered":"2024-09-12T02:33:25.103577+0000","last_unstale":"2024-09-12T02:33:26.246804+0000","last_undegraded":"2024-09-12T02:33:26.246804+0000","last_fullsized":"2024-09-12T02:33:26.246804+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.780813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246483+0000","last_change":"2024-09-12T02:33:24.103498+0000","last_active":"2024-09-12T02:33:26.246483+0000","last_peered":"2024-09-12T02:33:26.246483+0000","last_clean":"2024-09-12T02:33:26.246483+0000","last_became_active":"2024-09-12T02:33:24.103138+0000","last_became_peered":"2024-09-12T02:33:24.103138+0000","last_unstale":"2024-09-12T02:33:26.246483+0000","last_undegraded":"2024-09-12T02:33:26.246483+0000","last_fullsized":"2024-09-12T02:33:26.246483+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:45.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246360+0000","last_change":"2024-09-12T02:33:25.105726+0000","last_active":"2024-09-12T02:33:26.246360+0000","last_peered":"2024-09-12T02:33:26.246360+0000","last_clean":"2024-09-12T02:33:26.246360+0000","last_became_active":"2024-09-12T02:33:25.105403+0000","last_became_peered":"2024-09-12T02:33:25.105403+0000","last_unstale":"2024-09-12T02:33:26.246360+0000","last_undegraded":"2024-09-12T02:33:26.246360+0000","last_fullsized":"2024-09-12T02:33:26.246360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:08.915690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246220+0000","last_change":"2024-09-12T02:33:24.095977+0000","last_active":"2024-09-12T02:33:26.246220+0000","last_peered":"2024-09-12T02:33:26.246220+0000","last_clean":"2024-09-12T02:33:26.246220+0000","last_became_active":"2024-09-12T02:33:24.095708+0000","last_became_peered":"2024-09-12T02:33:24.095708+0000","last_unstale":"2024-09-12T02:33:26.246220+0000","last_undegraded":"2024-09-12T02:33:26.246220+0000","last_fullsized":"2024-09-12T02:33:26.246220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:11.899473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247683+0000","last_change":"2024-09-12T02:33:25.098843+0000","last_active":"2024-09-12T02:33:26.247683+0000","last_peered":"2024-09-12T02:33:26.247683+0000","last_clean":"2024-09-12T02:33:26.247683+0000","last_became_active":"2024-09-12T02:33:25.098516+0000","last_became_peered":"2024-09-12T02:33:25.098516+0000","last_unstale":"2024-09-12T02:33:26.247683+0000","last_undegraded":"2024-09-12T02:33:26.247683+0000","last_fullsized":"2024-09-12T02:33:26.247683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:03.368159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108837+0000","last_change":"2024-09-12T02:33:24.096943+0000","last_active":"2024-09-12T02:33:26.108837+0000","last_peered":"2024-09-12T02:33:26.108837+0000","last_clean":"2024-09-12T02:33:26.108837+0000","last_became_active":"2024-09-12T02:33:24.096669+0000","last_became_peered":"2024-09-12T02:33:24.096669+0000","last_unstale":"2024-09-12T02:33:26.108837+0000","last_undegraded":"2024-09-12T02:33:26.108837+0000","last_fullsized":"2024-09-12T02:33:26.108837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:39.524630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247621+0000","last_change":"2024-09-12T02:33:25.103412+0000","last_active":"2024-09-12T02:33:26.247621+0000","last_peered":"2024-09-12T02:33:26.247621+0000","last_clean":"2024-09-12T02:33:26.247621+0000","last_became_active":"2024-09-12T02:33:25.103134+0000","last_became_peered":"2024-09-12T02:33:25.103134+0000","last_unstale":"2024-09-12T02:33:26.247621+0000","last_undegraded":"2024-09-12T02:33:26.247621+0000","last_fullsized":"2024-09-12T02:33:26.247621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:33.417456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246105+0000","last_change":"2024-09-12T02:33:24.105374+0000","last_active":"2024-09-12T02:33:26.246105+0000","last_peered":"2024-09-12T02:33:26.246105+0000","last_clean":"2024-09-12T02:33:26.246105+0000","last_became_active":"2024-09-12T02:33:24.104681+0000","last_became_peered":"2024-09-12T02:33:24.104681+0000","last_unstale":"2024-09-12T02:33:26.246105+0000","last_undegraded":"2024-09-12T02:33:26.246105+0000","last_fullsized":"2024-09-12T02:33:26.246105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:57.489698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109283+0000","last_change":"2024-09-12T02:33:25.104517+0000","last_active":"2024-09-12T02:33:26.109283+0000","last_peered":"2024-09-12T02:33:26.109283+0000","last_clean":"2024-09-12T02:33:26.109283+0000","last_became_active":"2024-09-12T02:33:25.104230+0000","last_became_peered":"2024-09-12T02:33:25.104230+0000","last_unstale":"2024-09-12T02:33:26.109283+0000","last_undegraded":"2024-09-12T02:33:26.109283+0000","last_fullsized":"2024-09-12T02:33:26.109283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:40.531746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245962+0000","last_change":"2024-09-12T02:33:24.098923+0000","last_active":"2024-09-12T02:33:26.245962+0000","last_peered":"2024-09-12T02:33:26.245962+0000","last_clean":"2024-09-12T02:33:26.245962+0000","last_became_active":"2024-09-12T02:33:24.098669+0000","last_became_peered":"2024-09-12T02:33:24.098669+0000","last_unstale":"2024-09-12T02:33:26.245962+0000","last_undegraded":"2024-09-12T02:33:26.245962+0000","last_fullsized":"2024-09-12T02:33:26.245962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:20.736662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247877+0000","last_change":"2024-09-12T02:33:25.095356+0000","last_active":"2024-09-12T02:33:26.247877+0000","last_peered":"2024-09-12T02:33:26.247877+0000","last_clean":"2024-09-12T02:33:26.247877+0000","last_became_active":"2024-09-12T02:33:25.095010+0000","last_became_peered":"2024-09-12T02:33:25.095010+0000","last_unstale":"2024-09-12T02:33:26.247877+0000","last_undegraded":"2024-09-12T02:33:26.247877+0000","last_fullsized":"2024-09-12T02:33:26.247877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:53.839897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108473+0000","last_change":"2024-09-12T02:33:24.100872+0000","last_active":"2024-09-12T02:33:26.108473+0000","last_peered":"2024-09-12T02:33:26.108473+0000","last_clean":"2024-09-12T02:33:26.108473+0000","last_became_active":"2024-09-12T02:33:24.100565+0000","last_became_peered":"2024-09-12T02:33:24.100565+0000","last_unstale":"2024-09-12T02:33:26.108473+0000","last_undegraded":"2024-09-12T02:33:26.108473+0000","last_fullsized":"2024-09-12T02:33:26.108473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:48.041451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109160+0000","last_change":"2024-09-12T02:33:25.101505+0000","last_active":"2024-09-12T02:33:26.109160+0000","last_peered":"2024-09-12T02:33:26.109160+0000","last_clean":"2024-09-12T02:33:26.109160+0000","last_became_active":"2024-09-12T02:33:25.101220+0000","last_became_peered":"2024-09-12T02:33:25.101220+0000","last_unstale":"2024-09-12T02:33:26.109160+0000","last_undegraded":"2024-09-12T02:33:26.109160+0000","last_fullsized":"2024-09-12T02:33:26.109160+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:06.797197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103761+0000","last_change":"2024-09-12T02:33:24.102819+0000","last_active":"2024-09-12T02:33:26.103761+0000","last_peered":"2024-09-12T02:33:26.103761+0000","last_clean":"2024-09-12T02:33:26.103761+0000","last_became_active":"2024-09-12T02:33:24.102535+0000","last_became_peered":"2024-09-12T02:33:24.102535+0000","last_unstale":"2024-09-12T02:33:26.103761+0000","last_undegraded":"2024-09-12T02:33:26.103761+0000","last_fullsized":"2024-09-12T02:33:26.103761+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:29.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103748+0000","last_change":"2024-09-12T02:33:25.101728+0000","last_active":"2024-09-12T02:33:26.103748+0000","last_peered":"2024-09-12T02:33:26.103748+0000","last_clean":"2024-09-12T02:33:26.103748+0000","last_became_active":"2024-09-12T02:33:25.101387+0000","last_became_peered":"2024-09-12T02:33:25.101387+0000","last_unstale":"2024-09-12T02:33:26.103748+0000","last_undegraded":"2024-09-12T02:33:26.103748+0000","last_fullsized":"2024-09-12T02:33:26.103748+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:03.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247833+0000","last_change":"2024-09-12T02:33:24.099708+0000","last_active":"2024-09-12T02:33:26.247833+0000","last_peered":"2024-09-12T02:33:26.247833+0000","last_clean":"2024-09-12T02:33:26.247833+0000","last_became_active":"2024-09-12T02:33:24.099449+0000","last_became_peered":"2024-09-12T02:33:24.099449+0000","last_unstale":"2024-09-12T02:33:26.247833+0000","last_undegraded":"2024-09-12T02:33:26.247833+0000","last_fullsized":"2024-09-12T02:33:26.247833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:35.720734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246175+0000","last_change":"2024-09-12T02:33:25.108620+0000","last_active":"2024-09-12T02:33:26.246175+0000","last_peered":"2024-09-12T02:33:26.246175+0000","last_clean":"2024-09-12T02:33:26.246175+0000","last_became_active":"2024-09-12T02:33:25.108363+0000","last_became_peered":"2024-09-12T02:33:25.108363+0000","last_unstale":"2024-09-12T02:33:26.246175+0000","last_undegraded":"2024-09-12T02:33:26.246175+0000","last_fullsized":"2024-09-12T02:33:26.246175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:59.980036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103788+0000","last_change":"2024-09-12T02:33:24.101611+0000","last_active":"2024-09-12T02:33:26.103788+0000","last_peered":"2024-09-12T02:33:26.103788+0000","last_clean":"2024-09-12T02:33:26.103788+0000","last_became_active":"2024-09-12T02:33:24.101323+0000","last_became_peered":"2024-09-12T02:33:24.101323+0000","last_unstale":"2024-09-12T02:33:26.103788+0000","last_undegraded":"2024-09-12T02:33:26.103788+0000","last_fullsized":"2024-09-12T02:33:26.103788+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:51.843242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103702+0000","last_change":"2024-09-12T02:33:25.104303+0000","last_active":"2024-09-12T02:33:26.103702+0000","last_peered":"2024-09-12T02:33:26.103702+0000","last_clean":"2024-09-12T02:33:26.103702+0000","last_became_active":"2024-09-12T02:33:25.104021+0000","last_became_peered":"2024-09-12T02:33:25.104021+0000","last_unstale":"2024-09-12T02:33:26.103702+0000","last_undegraded":"2024-09-12T02:33:26.103702+0000","last_fullsized":"2024-09-12T02:33:26.103702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.543436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109312+0000","last_change":"2024-09-12T02:33:24.103400+0000","last_active":"2024-09-12T02:33:26.109312+0000","last_peered":"2024-09-12T02:33:26.109312+0000","last_clean":"2024-09-12T02:33:26.109312+0000","last_became_active":"2024-09-12T02:33:24.103127+0000","last_became_peered":"2024-09-12T02:33:24.103127+0000","last_unstale":"2024-09-12T02:33:26.109312+0000","last_undegraded":"2024-09-12T02:33:26.109312+0000","last_fullsized":"2024-09-12T02:33:26.109312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:33.567838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245945+0000","last_change":"2024-09-12T02:33:25.106162+0000","last_active":"2024-09-12T02:33:26.245945+0000","last_peered":"2024-09-12T02:33:26.245945+0000","last_clean":"2024-09-12T02:33:26.245945+0000","last_became_active":"2024-09-12T02:33:25.105863+0000","last_became_peered":"2024-09-12T02:33:25.105863+0000","last_unstale":"2024-09-12T02:33:26.245945+0000","last_undegraded":"2024-09-12T02:33:26.245945+0000","last_fullsized":"2024-09-12T02:33:26.245945+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:36.391014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247762+0000","last_change":"2024-09-12T02:33:24.104616+0000","last_active":"2024-09-12T02:33:26.247762+0000","last_peered":"2024-09-12T02:33:26.247762+0000","last_clean":"2024-09-12T02:33:26.247762+0000","last_became_active":"2024-09-12T02:33:24.104322+0000","last_became_peered":"2024-09-12T02:33:24.104322+0000","last_unstale":"2024-09-12T02:33:26.247762+0000","last_undegraded":"2024-09-12T02:33:26.247762+0000","last_fullsized":"2024-09-12T02:33:26.247762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:22.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103411+0000","last_change":"2024-09-12T02:33:25.101495+0000","last_active":"2024-09-12T02:33:26.103411+0000","last_peered":"2024-09-12T02:33:26.103411+0000","last_clean":"2024-09-12T02:33:26.103411+0000","last_became_active":"2024-09-12T02:33:25.100869+0000","last_became_peered":"2024-09-12T02:33:25.100869+0000","last_unstale":"2024-09-12T02:33:26.103411+0000","last_undegraded":"2024-09-12T02:33:26.103411+0000","last_fullsized":"2024-09-12T02:33:26.103411+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:36.391014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108938+0000","last_change":"2024-09-12T02:33:24.099239+0000","last_active":"2024-09-12T02:33:26.108938+0000","last_peered":"2024-09-12T02:33:26.108938+0000","last_clean":"2024-09-12T02:33:26.108938+0000","last_became_active":"2024-09-12T02:33:24.098946+0000","last_became_peered":"2024-09-12T02:33:24.098946+0000","last_unstale":"2024-09-12T02:33:26.108938+0000","last_undegraded":"2024-09-12T02:33:26.108938+0000","last_fullsized":"2024-09-12T02:33:26.108938+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:59.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108383+0000","last_change":"2024-09-12T02:33:25.103275+0000","last_active":"2024-09-12T02:33:26.108383+0000","last_peered":"2024-09-12T02:33:26.108383+0000","last_clean":"2024-09-12T02:33:26.108383+0000","last_became_active":"2024-09-12T02:33:25.103010+0000","last_became_peered":"2024-09-12T02:33:25.103010+0000","last_unstale":"2024-09-12T02:33:26.108383+0000","last_undegraded":"2024-09-12T02:33:26.108383+0000","last_fullsized":"2024-09-12T02:33:26.108383+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:21.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245879+0000","last_change":"2024-09-12T02:33:24.096036+0000","last_active":"2024-09-12T02:33:26.245879+0000","last_peered":"2024-09-12T02:33:26.245879+0000","last_clean":"2024-09-12T02:33:26.245879+0000","last_became_active":"2024-09-12T02:33:24.095750+0000","last_became_peered":"2024-09-12T02:33:24.095750+0000","last_unstale":"2024-09-12T02:33:26.245879+0000","last_undegraded":"2024-09-12T02:33:26.245879+0000","last_fullsized":"2024-09-12T02:33:26.245879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:14.316778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103603+0000","last_change":"2024-09-12T02:33:25.106094+0000","last_active":"2024-09-12T02:33:26.103603+0000","last_peered":"2024-09-12T02:33:26.103603+0000","last_clean":"2024-09-12T02:33:26.103603+0000","last_became_active":"2024-09-12T02:33:25.105803+0000","last_became_peered":"2024-09-12T02:33:25.105803+0000","last_unstale":"2024-09-12T02:33:26.103603+0000","last_undegraded":"2024-09-12T02:33:26.103603+0000","last_fullsized":"2024-09-12T02:33:26.103603+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:13.041980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103214+0000","last_change":"2024-09-12T02:33:24.100164+0000","last_active":"2024-09-12T02:33:26.103214+0000","last_peered":"2024-09-12T02:33:26.103214+0000","last_clean":"2024-09-12T02:33:26.103214+0000","last_became_active":"2024-09-12T02:33:24.099889+0000","last_became_peered":"2024-09-12T02:33:24.099889+0000","last_unstale":"2024-09-12T02:33:26.103214+0000","last_undegraded":"2024-09-12T02:33:26.103214+0000","last_fullsized":"2024-09-12T02:33:26.103214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:55.674613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103680+0000","last_change":"2024-09-12T02:33:25.103609+0000","last_active":"2024-09-12T02:33:26.103680+0000","last_peered":"2024-09-12T02:33:26.103680+0000","last_clean":"2024-09-12T02:33:26.103680+0000","last_became_active":"2024-09-12T02:33:25.103349+0000","last_became_peered":"2024-09-12T02:33:25.103349+0000","last_unstale":"2024-09-12T02:33:26.103680+0000","last_undegraded":"2024-09-12T02:33:26.103680+0000","last_fullsized":"2024-09-12T02:33:26.103680+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.292727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247510+0000","last_change":"2024-09-12T02:33:24.100393+0000","last_active":"2024-09-12T02:33:26.247510+0000","last_peered":"2024-09-12T02:33:26.247510+0000","last_clean":"2024-09-12T02:33:26.247510+0000","last_became_active":"2024-09-12T02:33:24.100095+0000","last_became_peered":"2024-09-12T02:33:24.100095+0000","last_unstale":"2024-09-12T02:33:26.247510+0000","last_undegraded":"2024-09-12T02:33:26.247510+0000","last_fullsized":"2024-09-12T02:33:26.247510+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.219218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246299+0000","last_change":"2024-09-12T02:33:25.106099+0000","last_active":"2024-09-12T02:33:26.246299+0000","last_peered":"2024-09-12T02:33:26.246299+0000","last_clean":"2024-09-12T02:33:26.246299+0000","last_became_active":"2024-09-12T02:33:25.105355+0000","last_became_peered":"2024-09-12T02:33:25.105355+0000","last_unstale":"2024-09-12T02:33:26.246299+0000","last_undegraded":"2024-09-12T02:33:26.246299+0000","last_fullsized":"2024-09-12T02:33:26.246299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.292727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247138+0000","last_change":"2024-09-12T02:33:24.106242+0000","last_active":"2024-09-12T02:33:26.247138+0000","last_peered":"2024-09-12T02:33:26.247138+0000","last_clean":"2024-09-12T02:33:26.247138+0000","last_became_active":"2024-09-12T02:33:24.105965+0000","last_became_peered":"2024-09-12T02:33:24.105965+0000","last_unstale":"2024-09-12T02:33:26.247138+0000","last_undegraded":"2024-09-12T02:33:26.247138+0000","last_fullsized":"2024-09-12T02:33:26.247138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:14.316778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247837+0000","last_change":"2024-09-12T02:33:25.098663+0000","last_active":"2024-09-12T02:33:26.247837+0000","last_peered":"2024-09-12T02:33:26.247837+0000","last_clean":"2024-09-12T02:33:26.247837+0000","last_became_active":"2024-09-12T02:33:25.098373+0000","last_became_peered":"2024-09-12T02:33:25.098373+0000","last_unstale":"2024-09-12T02:33:26.247837+0000","last_undegraded":"2024-09-12T02:33:26.247837+0000","last_fullsized":"2024-09-12T02:33:26.247837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:32.984989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246160+0000","last_change":"2024-09-12T02:33:24.097482+0000","last_active":"2024-09-12T02:33:26.246160+0000","last_peered":"2024-09-12T02:33:26.246160+0000","last_clean":"2024-09-12T02:33:26.246160+0000","last_became_active":"2024-09-12T02:33:24.097212+0000","last_became_peered":"2024-09-12T02:33:24.097212+0000","last_unstale":"2024-09-12T02:33:26.246160+0000","last_undegraded":"2024-09-12T02:33:26.246160+0000","last_fullsized":"2024-09-12T02:33:26.246160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:45.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103650+0000","last_change":"2024-09-12T02:33:25.103054+0000","last_active":"2024-09-12T02:33:26.103650+0000","last_peered":"2024-09-12T02:33:26.103650+0000","last_clean":"2024-09-12T02:33:26.103650+0000","last_became_active":"2024-09-12T02:33:25.102561+0000","last_became_peered":"2024-09-12T02:33:25.102561+0000","last_unstale":"2024-09-12T02:33:26.103650+0000","last_undegraded":"2024-09-12T02:33:26.103650+0000","last_fullsized":"2024-09-12T02:33:26.103650+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:38.899205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246884+0000","last_change":"2024-09-12T02:33:24.105520+0000","last_active":"2024-09-12T02:33:26.246884+0000","last_peered":"2024-09-12T02:33:26.246884+0000","last_clean":"2024-09-12T02:33:26.246884+0000","last_became_active":"2024-09-12T02:33:24.105251+0000","last_became_peered":"2024-09-12T02:33:24.105251+0000","last_unstale":"2024-09-12T02:33:26.246884+0000","last_undegraded":"2024-09-12T02:33:26.246884+0000","last_fullsized":"2024-09-12T02:33:26.246884+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.790080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245951+0000","last_change":"2024-09-12T02:33:25.106040+0000","last_active":"2024-09-12T02:33:26.245951+0000","last_peered":"2024-09-12T02:33:26.245951+0000","last_clean":"2024-09-12T02:33:26.245951+0000","last_became_active":"2024-09-12T02:33:25.105263+0000","last_became_peered":"2024-09-12T02:33:25.105263+0000","last_unstale":"2024-09-12T02:33:26.245951+0000","last_undegraded":"2024-09-12T02:33:26.245951+0000","last_fullsized":"2024-09-12T02:33:26.245951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:05.444531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247850+0000","last_change":"2024-09-12T02:33:24.104742+0000","last_active":"2024-09-12T02:33:26.247850+0000","last_peered":"2024-09-12T02:33:26.247850+0000","last_clean":"2024-09-12T02:33:26.247850+0000","last_became_active":"2024-09-12T02:33:24.104498+0000","last_became_peered":"2024-09-12T02:33:24.104498+0000","last_unstale":"2024-09-12T02:33:26.247850+0000","last_undegraded":"2024-09-12T02:33:26.247850+0000","last_fullsized":"2024-09-12T02:33:26.247850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:15.982240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246294+0000","last_change":"2024-09-12T02:33:25.110315+0000","last_active":"2024-09-12T02:33:26.246294+0000","last_peered":"2024-09-12T02:33:26.246294+0000","last_clean":"2024-09-12T02:33:26.246294+0000","last_became_active":"2024-09-12T02:33:25.110056+0000","last_became_peered":"2024-09-12T02:33:25.110056+0000","last_unstale":"2024-09-12T02:33:26.246294+0000","last_undegraded":"2024-09-12T02:33:26.246294+0000","last_fullsized":"2024-09-12T02:33:26.246294+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:03.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245676+0000","last_change":"2024-09-12T02:33:24.097192+0000","last_active":"2024-09-12T02:33:26.245676+0000","last_peered":"2024-09-12T02:33:26.245676+0000","last_clean":"2024-09-12T02:33:26.245676+0000","last_became_active":"2024-09-12T02:33:24.096902+0000","last_became_peered":"2024-09-12T02:33:24.096902+0000","last_unstale":"2024-09-12T02:33:26.245676+0000","last_undegraded":"2024-09-12T02:33:26.245676+0000","last_fullsized":"2024-09-12T02:33:26.245676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:59.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245669+0000","last_change":"2024-09-12T02:33:25.108078+0000","last_active":"2024-09-12T02:33:26.245669+0000","last_peered":"2024-09-12T02:33:26.245669+0000","last_clean":"2024-09-12T02:33:26.245669+0000","last_became_active":"2024-09-12T02:33:25.107789+0000","last_became_peered":"2024-09-12T02:33:25.107789+0000","last_unstale":"2024-09-12T02:33:26.245669+0000","last_undegraded":"2024-09-12T02:33:26.245669+0000","last_fullsized":"2024-09-12T02:33:26.245669+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:38.899205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245858+0000","last_change":"2024-09-12T02:33:24.105785+0000","last_active":"2024-09-12T02:33:26.245858+0000","last_peered":"2024-09-12T02:33:26.245858+0000","last_clean":"2024-09-12T02:33:26.245858+0000","last_became_active":"2024-09-12T02:33:24.105481+0000","last_became_peered":"2024-09-12T02:33:24.105481+0000","last_unstale":"2024-09-12T02:33:26.245858+0000","last_undegraded":"2024-09-12T02:33:26.245858+0000","last_fullsized":"2024-09-12T02:33:26.245858+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:02.335445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246222+0000","last_change":"2024-09-12T02:33:25.108252+0000","last_active":"2024-09-12T02:33:26.246222+0000","last_peered":"2024-09-12T02:33:26.246222+0000","last_clean":"2024-09-12T02:33:26.246222+0000","last_became_active":"2024-09-12T02:33:25.107997+0000","last_became_peered":"2024-09-12T02:33:25.107997+0000","last_unstale":"2024-09-12T02:33:26.246222+0000","last_undegraded":"2024-09-12T02:33:26.246222+0000","last_fullsized":"2024-09-12T02:33:26.246222+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:53.834499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246144+0000","last_change":"2024-09-12T02:33:24.101310+0000","last_active":"2024-09-12T02:33:26.246144+0000","last_peered":"2024-09-12T02:33:26.246144+0000","last_clean":"2024-09-12T02:33:26.246144+0000","last_became_active":"2024-09-12T02:33:24.101010+0000","last_became_peered":"2024-09-12T02:33:24.101010+0000","last_unstale":"2024-09-12T02:33:26.246144+0000","last_undegraded":"2024-09-12T02:33:26.246144+0000","last_fullsized":"2024-09-12T02:33:26.246144+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:43.893537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246355+0000","last_change":"2024-09-12T02:33:25.108875+0000","last_active":"2024-09-12T02:33:26.246355+0000","last_peered":"2024-09-12T02:33:26.246355+0000","last_clean":"2024-09-12T02:33:26.246355+0000","last_became_active":"2024-09-12T02:33:25.108604+0000","last_became_peered":"2024-09-12T02:33:25.108604+0000","last_unstale":"2024-09-12T02:33:26.246355+0000","last_undegraded":"2024-09-12T02:33:26.246355+0000","last_fullsized":"2024-09-12T02:33:26.246355+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.543436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:27.089580+0000","last_change":"2024-09-12T02:33:24.104611+0000","last_active":"2024-09-12T02:33:27.089580+0000","last_peered":"2024-09-12T02:33:27.089580+0000","last_clean":"2024-09-12T02:33:27.089580+0000","last_became_active":"2024-09-12T02:33:24.104302+0000","last_became_peered":"2024-09-12T02:33:24.104302+0000","last_unstale":"2024-09-12T02:33:27.089580+0000","last_undegraded":"2024-09-12T02:33:27.089580+0000","last_fullsized":"2024-09-12T02:33:27.089580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:02.335445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246306+0000","last_change":"2024-09-12T02:33:25.108421+0000","last_active":"2024-09-12T02:33:26.246306+0000","last_peered":"2024-09-12T02:33:26.246306+0000","last_clean":"2024-09-12T02:33:26.246306+0000","last_became_active":"2024-09-12T02:33:25.108021+0000","last_became_peered":"2024-09-12T02:33:25.108021+0000","last_unstale":"2024-09-12T02:33:26.246306+0000","last_undegraded":"2024-09-12T02:33:26.246306+0000","last_fullsized":"2024-09-12T02:33:26.246306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:44.498268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109338+0000","last_change":"2024-09-12T02:33:24.099009+0000","last_active":"2024-09-12T02:33:26.109338+0000","last_peered":"2024-09-12T02:33:26.109338+0000","last_clean":"2024-09-12T02:33:26.109338+0000","last_became_active":"2024-09-12T02:33:24.098693+0000","last_became_peered":"2024-09-12T02:33:24.098693+0000","last_unstale":"2024-09-12T02:33:26.109338+0000","last_undegraded":"2024-09-12T02:33:26.109338+0000","last_fullsized":"2024-09-12T02:33:26.109338+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:45.561600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246433+0000","last_change":"2024-09-12T02:33:25.102347+0000","last_active":"2024-09-12T02:33:26.246433+0000","last_peered":"2024-09-12T02:33:26.246433+0000","last_clean":"2024-09-12T02:33:26.246433+0000","last_became_active":"2024-09-12T02:33:25.102089+0000","last_became_peered":"2024-09-12T02:33:25.102089+0000","last_unstale":"2024-09-12T02:33:26.246433+0000","last_undegraded":"2024-09-12T02:33:26.246433+0000","last_fullsized":"2024-09-12T02:33:26.246433+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:49.255489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246331+0000","last_change":"2024-09-12T02:33:24.098370+0000","last_active":"2024-09-12T02:33:26.246331+0000","last_peered":"2024-09-12T02:33:26.246331+0000","last_clean":"2024-09-12T02:33:26.246331+0000","last_became_active":"2024-09-12T02:33:24.098081+0000","last_became_peered":"2024-09-12T02:33:24.098081+0000","last_unstale":"2024-09-12T02:33:26.246331+0000","last_undegraded":"2024-09-12T02:33:26.246331+0000","last_fullsized":"2024-09-12T02:33:26.246331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.790080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247625+0000","last_change":"2024-09-12T02:33:25.096803+0000","last_active":"2024-09-12T02:33:26.247625+0000","last_peered":"2024-09-12T02:33:26.247625+0000","last_clean":"2024-09-12T02:33:26.247625+0000","last_became_active":"2024-09-12T02:33:25.096541+0000","last_became_peered":"2024-09-12T02:33:25.096541+0000","last_unstale":"2024-09-12T02:33:26.247625+0000","last_undegraded":"2024-09-12T02:33:26.247625+0000","last_fullsized":"2024-09-12T02:33:26.247625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:53.360197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245663+0000","last_change":"2024-09-12T02:33:24.101589+0000","last_active":"2024-09-12T02:33:26.245663+0000","last_peered":"2024-09-12T02:33:26.245663+0000","last_clean":"2024-09-12T02:33:26.245663+0000","last_became_active":"2024-09-12T02:33:24.101329+0000","last_became_peered":"2024-09-12T02:33:24.101329+0000","last_unstale":"2024-09-12T02:33:26.245663+0000","last_undegraded":"2024-09-12T02:33:26.245663+0000","last_fullsized":"2024-09-12T02:33:26.245663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:45.561600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103749+0000","last_change":"2024-09-12T02:33:25.101923+0000","last_active":"2024-09-12T02:33:26.103749+0000","last_peered":"2024-09-12T02:33:26.103749+0000","last_clean":"2024-09-12T02:33:26.103749+0000","last_became_active":"2024-09-12T02:33:25.101229+0000","last_became_peered":"2024-09-12T02:33:25.101229+0000","last_unstale":"2024-09-12T02:33:26.103749+0000","last_undegraded":"2024-09-12T02:33:26.103749+0000","last_fullsized":"2024-09-12T02:33:26.103749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:08.915690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108552+0000","last_change":"2024-09-12T02:33:24.103563+0000","last_active":"2024-09-12T02:33:26.108552+0000","last_peered":"2024-09-12T02:33:26.108552+0000","last_clean":"2024-09-12T02:33:26.108552+0000","last_became_active":"2024-09-12T02:33:24.103101+0000","last_became_peered":"2024-09-12T02:33:24.103101+0000","last_unstale":"2024-09-12T02:33:26.108552+0000","last_undegraded":"2024-09-12T02:33:26.108552+0000","last_fullsized":"2024-09-12T02:33:26.108552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:21.689344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245547+0000","last_change":"2024-09-12T02:33:25.091321+0000","last_active":"2024-09-12T02:33:26.245547+0000","last_peered":"2024-09-12T02:33:26.245547+0000","last_clean":"2024-09-12T02:33:26.245547+0000","last_became_active":"2024-09-12T02:33:25.091052+0000","last_became_peered":"2024-09-12T02:33:25.091052+0000","last_unstale":"2024-09-12T02:33:26.245547+0000","last_undegraded":"2024-09-12T02:33:26.245547+0000","last_fullsized":"2024-09-12T02:33:26.245547+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:49.048567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245852+0000","last_change":"2024-09-12T02:33:24.100501+0000","last_active":"2024-09-12T02:33:26.245852+0000","last_peered":"2024-09-12T02:33:26.245852+0000","last_clean":"2024-09-12T02:33:26.245852+0000","last_became_active":"2024-09-12T02:33:24.100248+0000","last_became_peered":"2024-09-12T02:33:24.100248+0000","last_unstale":"2024-09-12T02:33:26.245852+0000","last_undegraded":"2024-09-12T02:33:26.245852+0000","last_fullsized":"2024-09-12T02:33:26.245852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:18.481594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247496+0000","last_change":"2024-09-12T02:33:25.094447+0000","last_active":"2024-09-12T02:33:26.247496+0000","last_peered":"2024-09-12T02:33:26.247496+0000","last_clean":"2024-09-12T02:33:26.247496+0000","last_became_active":"2024-09-12T02:33:25.094191+0000","last_became_peered":"2024-09-12T02:33:25.094191+0000","last_unstale":"2024-09-12T02:33:26.247496+0000","last_undegraded":"2024-09-12T02:33:26.247496+0000","last_fullsized":"2024-09-12T02:33:26.247496+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:34.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247418+0000","last_change":"2024-09-12T02:33:24.102027+0000","last_active":"2024-09-12T02:33:26.247418+0000","last_peered":"2024-09-12T02:33:26.247418+0000","last_clean":"2024-09-12T02:33:26.247418+0000","last_became_active":"2024-09-12T02:33:24.101553+0000","last_became_peered":"2024-09-12T02:33:24.101553+0000","last_unstale":"2024-09-12T02:33:26.247418+0000","last_undegraded":"2024-09-12T02:33:26.247418+0000","last_fullsized":"2024-09-12T02:33:26.247418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:49.348238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247322+0000","last_change":"2024-09-12T02:33:25.099186+0000","last_active":"2024-09-12T02:33:26.247322+0000","last_peered":"2024-09-12T02:33:26.247322+0000","last_clean":"2024-09-12T02:33:26.247322+0000","last_became_active":"2024-09-12T02:33:25.098679+0000","last_became_peered":"2024-09-12T02:33:25.098679+0000","last_unstale":"2024-09-12T02:33:26.247322+0000","last_undegraded":"2024-09-12T02:33:26.247322+0000","last_fullsized":"2024-09-12T02:33:26.247322+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:10.310593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109119+0000","last_change":"2024-09-12T02:33:24.096038+0000","last_active":"2024-09-12T02:33:26.109119+0000","last_peered":"2024-09-12T02:33:26.109119+0000","last_clean":"2024-09-12T02:33:26.109119+0000","last_became_active":"2024-09-12T02:33:24.095757+0000","last_became_peered":"2024-09-12T02:33:24.095757+0000","last_unstale":"2024-09-12T02:33:26.109119+0000","last_undegraded":"2024-09-12T02:33:26.109119+0000","last_fullsized":"2024-09-12T02:33:26.109119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:43.893537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":244,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103431+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:33:26.103431+0000","last_peered":"2024-09-12T02:33:26.103431+0000","last_clean":"2024-09-12T02:33:26.103431+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:33:26.103431+0000","last_undegraded":"2024-09-12T02:33:26.103431+0000","last_fullsized":"2024-09-12T02:33:26.103431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1314816,"data_stored":888423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":712704,"data_stored":297895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":720896,"data_stored":298547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":724992,"data_stored":299507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":716800,"data_stored":297985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":890457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":297951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":291651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:33:28.044 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:33:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.177+0000 7fae1195f640 1 Processor -- start 2024-09-12T02:33:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.177+0000 7fae1195f640 1 -- start start 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae1195f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae0c0d0510 0x7fae0c15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae1195f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 0x7fae0c0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae1195f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fae0c143bb0 0x7fae0c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae1195f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fae0c0b2820 con 0x7fae0c0d0510 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae1195f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fae0c0b2b00 con 0x7fae0c143bb0 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae1195f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fae0c141730 con 0x7fae0c0d08f0 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae0c0d0510 0x7fae0c15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae0c0d0510 0x7fae0c15ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52168/0 (socket says 172.21.15.181:52168) 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 -- 172.21.15.181:0/264424249 learned_addr learned my addr 172.21.15.181:0/264424249 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 -- 172.21.15.181:0/264424249 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 msgr2=0x7fae0c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 --2- 172.21.15.181:0/264424249 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 0x7fae0c0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 -- 172.21.15.181:0/264424249 >> v2:172.21.15.204:3300/0 conn(0x7fae0c143bb0 msgr2=0x7fae0c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 --2- 172.21.15.181:0/264424249 >> v2:172.21.15.204:3300/0 conn(0x7fae0c143bb0 0x7fae0c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.178+0000 7fae0affd640 1 -- 172.21.15.181:0/264424249 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c144320 con 0x7fae0c0d0510 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.179+0000 7fae0affd640 1 --2- 172.21.15.181:0/264424249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c0d0510 0x7fae0c15ef90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fae0c1445b0 tx=0x7fadfc02b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459d79c0b4d40126 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.179+0000 7fae0a7fc640 1 -- 172.21.15.181:0/264424249 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc038070 con 0x7fae0c0d0510 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.179+0000 7fae0a7fc640 1 -- 172.21.15.181:0/264424249 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc033640 con 0x7fae0c0d0510 2024-09-12T02:33:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.179+0000 7fae0a7fc640 1 -- 172.21.15.181:0/264424249 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc033a10 con 0x7fae0c0d0510 2024-09-12T02:33:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 -- 172.21.15.181:0/264424249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c0d0510 msgr2=0x7fae0c15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 --2- 172.21.15.181:0/264424249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c0d0510 0x7fae0c15ef90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fae0c1445b0 tx=0x7fadfc02b2d0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 -- 172.21.15.181:0/264424249 shutdown_connections 2024-09-12T02:33:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 --2- 172.21.15.181:0/264424249 >> v2:172.21.15.204:3300/0 conn(0x7fae0c143bb0 0x7fae0c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 --2- 172.21.15.181:0/264424249 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 0x7fae0c0b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 --2- 172.21.15.181:0/264424249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c0d0510 0x7fae0c15ef90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 -- 172.21.15.181:0/264424249 >> 172.21.15.181:0/264424249 conn(0x7fae0c06bc10 msgr2=0x7fae0c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 -- 172.21.15.181:0/264424249 shutdown_connections 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.180+0000 7fae1195f640 1 -- 172.21.15.181:0/264424249 wait complete. 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.181+0000 7fae1195f640 1 Processor -- start 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.181+0000 7fae1195f640 1 -- start start 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae1195f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae0c0d0510 0x7fae0c0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae1195f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 0x7fae0c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae1195f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c143bb0 0x7fae0c0ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae1195f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c0b21c0 con 0x7fae0c143bb0 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae1195f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c0b2040 con 0x7fae0c0d0510 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae1195f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fae0c0b2340 con 0x7fae0c0d08f0 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c143bb0 0x7fae0c0ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c143bb0 0x7fae0c0ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52174/0 (socket says 172.21.15.181:52174) 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 -- 172.21.15.181:0/3972012414 learned_addr learned my addr 172.21.15.181:0/3972012414 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0affd640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae0c0d0510 0x7fae0c0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae027fc640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 0x7fae0c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 -- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 msgr2=0x7fae0c0b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 0x7fae0c0b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 -- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae0c0d0510 msgr2=0x7fae0c0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae0c0d0510 0x7fae0c0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.182+0000 7fae0b7fe640 1 -- 172.21.15.181:0/3972012414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c1f4720 con 0x7fae0c143bb0 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.183+0000 7fae0b7fe640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c143bb0 0x7fae0c0ab4e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fae0400b9a0 tx=0x7fae0400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.183+0000 7fae08ff9640 1 -- 172.21.15.181:0/3972012414 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04019070 con 0x7fae0c143bb0 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.183+0000 7fae08ff9640 1 -- 172.21.15.181:0/3972012414 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0400cbc0 con 0x7fae0c143bb0 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.183+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c1f4a00 con 0x7fae0c143bb0 2024-09-12T02:33:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.183+0000 7fae08ff9640 1 -- 172.21.15.181:0/3972012414 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04014440 con 0x7fae0c143bb0 2024-09-12T02:33:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.183+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c1f4fc0 con 0x7fae0c143bb0 2024-09-12T02:33:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.184+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c0c9500 con 0x7fae0c143bb0 2024-09-12T02:33:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.184+0000 7fae08ff9640 1 -- 172.21.15.181:0/3972012414 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae0401c070 con 0x7fae0c143bb0 2024-09-12T02:33:28.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.185+0000 7fae08ff9640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadec06be30 0x7fadec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.185+0000 7fae08ff9640 1 -- 172.21.15.181:0/3972012414 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fae0408aa70 con 0x7fae0c143bb0 2024-09-12T02:33:28.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.185+0000 7fae0affd640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadec06be30 0x7fadec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.185+0000 7fae0affd640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadec06be30 0x7fadec06e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fadfc035000 tx=0x7fadfc02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.189+0000 7fae08ff9640 1 -- 172.21.15.181:0/3972012414 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae04058e60 con 0x7fae0c143bb0 2024-09-12T02:33:28.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.353+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae0c0ce060 con 0x7fadec06be30 2024-09-12T02:33:28.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.359+0000 7fae08ff9640 1 -- 172.21.15.181:0/3972012414 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251952 (secure 0 0 0) 0x7fae0c0ce060 con 0x7fadec06be30 2024-09-12T02:33:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:28.364 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:33:28.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadec06be30 msgr2=0x7fadec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadec06be30 0x7fadec06e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fadfc035000 tx=0x7fadfc02f000 comp rx=0 tx=0).stop 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c143bb0 msgr2=0x7fae0c0ab4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c143bb0 0x7fae0c0ab4e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fae0400b9a0 tx=0x7fae0400be60 comp rx=0 tx=0).stop 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 shutdown_connections 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadec06be30 0x7fadec06e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0c143bb0 0x7fae0c0ab4e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae0c0d08f0 0x7fae0c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 --2- 172.21.15.181:0/3972012414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae0c0d0510 0x7fae0c0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 >> 172.21.15.181:0/3972012414 conn(0x7fae0c06bc10 msgr2=0x7fae0c0ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:28.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 shutdown_connections 2024-09-12T02:33:28.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.362+0000 7fae1195f640 1 -- 172.21.15.181:0/3972012414 wait complete. 2024-09-12T02:33:28.374 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-12T02:33:27.676091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235516,"kb_used_data":6780,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739204,"statfs":{"total":773094113280,"available":772852944896,"internally_reserved":0,"allocated":6942720,"data_stored":3562416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.600221"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246143+0000","last_change":"2024-09-12T02:33:25.102177+0000","last_active":"2024-09-12T02:33:26.246143+0000","last_peered":"2024-09-12T02:33:26.246143+0000","last_clean":"2024-09-12T02:33:26.246143+0000","last_became_active":"2024-09-12T02:33:25.101819+0000","last_became_peered":"2024-09-12T02:33:25.101819+0000","last_unstale":"2024-09-12T02:33:26.246143+0000","last_undegraded":"2024-09-12T02:33:26.246143+0000","last_fullsized":"2024-09-12T02:33:26.246143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:18.201084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247643+0000","last_change":"2024-09-12T02:33:25.097196+0000","last_active":"2024-09-12T02:33:26.247643+0000","last_peered":"2024-09-12T02:33:26.247643+0000","last_clean":"2024-09-12T02:33:26.247643+0000","last_became_active":"2024-09-12T02:33:25.096950+0000","last_became_peered":"2024-09-12T02:33:25.096950+0000","last_unstale":"2024-09-12T02:33:26.247643+0000","last_undegraded":"2024-09-12T02:33:26.247643+0000","last_fullsized":"2024-09-12T02:33:26.247643+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:46.058594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103377+0000","last_change":"2024-09-12T02:33:25.102829+0000","last_active":"2024-09-12T02:33:26.103377+0000","last_peered":"2024-09-12T02:33:26.103377+0000","last_clean":"2024-09-12T02:33:26.103377+0000","last_became_active":"2024-09-12T02:33:25.102248+0000","last_became_peered":"2024-09-12T02:33:25.102248+0000","last_unstale":"2024-09-12T02:33:26.103377+0000","last_undegraded":"2024-09-12T02:33:26.103377+0000","last_fullsized":"2024-09-12T02:33:26.103377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.289063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246105+0000","last_change":"2024-09-12T02:33:25.106328+0000","last_active":"2024-09-12T02:33:26.246105+0000","last_peered":"2024-09-12T02:33:26.246105+0000","last_clean":"2024-09-12T02:33:26.246105+0000","last_became_active":"2024-09-12T02:33:25.105885+0000","last_became_peered":"2024-09-12T02:33:25.105885+0000","last_unstale":"2024-09-12T02:33:26.246105+0000","last_undegraded":"2024-09-12T02:33:26.246105+0000","last_fullsized":"2024-09-12T02:33:26.246105+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.870536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246462+0000","last_change":"2024-09-12T02:33:25.103117+0000","last_active":"2024-09-12T02:33:26.246462+0000","last_peered":"2024-09-12T02:33:26.246462+0000","last_clean":"2024-09-12T02:33:26.246462+0000","last_became_active":"2024-09-12T02:33:25.102846+0000","last_became_peered":"2024-09-12T02:33:25.102846+0000","last_unstale":"2024-09-12T02:33:26.246462+0000","last_undegraded":"2024-09-12T02:33:26.246462+0000","last_fullsized":"2024-09-12T02:33:26.246462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:32.758535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245607+0000","last_change":"2024-09-12T02:33:25.098208+0000","last_active":"2024-09-12T02:33:26.245607+0000","last_peered":"2024-09-12T02:33:26.245607+0000","last_clean":"2024-09-12T02:33:26.245607+0000","last_became_active":"2024-09-12T02:33:25.097951+0000","last_became_peered":"2024-09-12T02:33:25.097951+0000","last_unstale":"2024-09-12T02:33:26.245607+0000","last_undegraded":"2024-09-12T02:33:26.245607+0000","last_fullsized":"2024-09-12T02:33:26.245607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:13.041980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108406+0000","last_change":"2024-09-12T02:33:25.101639+0000","last_active":"2024-09-12T02:33:26.108406+0000","last_peered":"2024-09-12T02:33:26.108406+0000","last_clean":"2024-09-12T02:33:26.108406+0000","last_became_active":"2024-09-12T02:33:25.101393+0000","last_became_peered":"2024-09-12T02:33:25.101393+0000","last_unstale":"2024-09-12T02:33:26.108406+0000","last_undegraded":"2024-09-12T02:33:26.108406+0000","last_fullsized":"2024-09-12T02:33:26.108406+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:15.323895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247175+0000","last_change":"2024-09-12T02:33:25.099625+0000","last_active":"2024-09-12T02:33:26.247175+0000","last_peered":"2024-09-12T02:33:26.247175+0000","last_clean":"2024-09-12T02:33:26.247175+0000","last_became_active":"2024-09-12T02:33:25.098348+0000","last_became_peered":"2024-09-12T02:33:25.098348+0000","last_unstale":"2024-09-12T02:33:26.247175+0000","last_undegraded":"2024-09-12T02:33:26.247175+0000","last_fullsized":"2024-09-12T02:33:26.247175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:20.633613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109062+0000","last_change":"2024-09-12T02:33:25.102349+0000","last_active":"2024-09-12T02:33:26.109062+0000","last_peered":"2024-09-12T02:33:26.109062+0000","last_clean":"2024-09-12T02:33:26.109062+0000","last_became_active":"2024-09-12T02:33:25.102083+0000","last_became_peered":"2024-09-12T02:33:25.102083+0000","last_unstale":"2024-09-12T02:33:26.109062+0000","last_undegraded":"2024-09-12T02:33:26.109062+0000","last_fullsized":"2024-09-12T02:33:26.109062+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:12.906590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246578+0000","last_change":"2024-09-12T02:33:25.094293+0000","last_active":"2024-09-12T02:33:26.246578+0000","last_peered":"2024-09-12T02:33:26.246578+0000","last_clean":"2024-09-12T02:33:26.246578+0000","last_became_active":"2024-09-12T02:33:25.094049+0000","last_became_peered":"2024-09-12T02:33:25.094049+0000","last_unstale":"2024-09-12T02:33:26.246578+0000","last_undegraded":"2024-09-12T02:33:26.246578+0000","last_fullsized":"2024-09-12T02:33:26.246578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:12.564791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246126+0000","last_change":"2024-09-12T02:33:25.098475+0000","last_active":"2024-09-12T02:33:26.246126+0000","last_peered":"2024-09-12T02:33:26.246126+0000","last_clean":"2024-09-12T02:33:26.246126+0000","last_became_active":"2024-09-12T02:33:25.098221+0000","last_became_peered":"2024-09-12T02:33:25.098221+0000","last_unstale":"2024-09-12T02:33:26.246126+0000","last_undegraded":"2024-09-12T02:33:26.246126+0000","last_fullsized":"2024-09-12T02:33:26.246126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:49.785571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246243+0000","last_change":"2024-09-12T02:33:25.111707+0000","last_active":"2024-09-12T02:33:26.246243+0000","last_peered":"2024-09-12T02:33:26.246243+0000","last_clean":"2024-09-12T02:33:26.246243+0000","last_became_active":"2024-09-12T02:33:25.111135+0000","last_became_peered":"2024-09-12T02:33:25.111135+0000","last_unstale":"2024-09-12T02:33:26.246243+0000","last_undegraded":"2024-09-12T02:33:26.246243+0000","last_fullsized":"2024-09-12T02:33:26.246243+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:13.041980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109395+0000","last_change":"2024-09-12T02:33:25.097225+0000","last_active":"2024-09-12T02:33:26.109395+0000","last_peered":"2024-09-12T02:33:26.109395+0000","last_clean":"2024-09-12T02:33:26.109395+0000","last_became_active":"2024-09-12T02:33:25.096987+0000","last_became_peered":"2024-09-12T02:33:25.096987+0000","last_unstale":"2024-09-12T02:33:26.109395+0000","last_undegraded":"2024-09-12T02:33:26.109395+0000","last_fullsized":"2024-09-12T02:33:26.109395+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:34.574954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108591+0000","last_change":"2024-09-12T02:33:25.094914+0000","last_active":"2024-09-12T02:33:26.108591+0000","last_peered":"2024-09-12T02:33:26.108591+0000","last_clean":"2024-09-12T02:33:26.108591+0000","last_became_active":"2024-09-12T02:33:25.094451+0000","last_became_peered":"2024-09-12T02:33:25.094451+0000","last_unstale":"2024-09-12T02:33:26.108591+0000","last_undegraded":"2024-09-12T02:33:26.108591+0000","last_fullsized":"2024-09-12T02:33:26.108591+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:46.114981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108535+0000","last_change":"2024-09-12T02:33:25.100939+0000","last_active":"2024-09-12T02:33:26.108535+0000","last_peered":"2024-09-12T02:33:26.108535+0000","last_clean":"2024-09-12T02:33:26.108535+0000","last_became_active":"2024-09-12T02:33:25.100470+0000","last_became_peered":"2024-09-12T02:33:25.100470+0000","last_unstale":"2024-09-12T02:33:26.108535+0000","last_undegraded":"2024-09-12T02:33:26.108535+0000","last_fullsized":"2024-09-12T02:33:26.108535+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:03.342562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245548+0000","last_change":"2024-09-12T02:33:25.110738+0000","last_active":"2024-09-12T02:33:26.245548+0000","last_peered":"2024-09-12T02:33:26.245548+0000","last_clean":"2024-09-12T02:33:26.245548+0000","last_became_active":"2024-09-12T02:33:25.110286+0000","last_became_peered":"2024-09-12T02:33:25.110286+0000","last_unstale":"2024-09-12T02:33:26.245548+0000","last_undegraded":"2024-09-12T02:33:26.245548+0000","last_fullsized":"2024-09-12T02:33:26.245548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:53.834499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247346+0000","last_change":"2024-09-12T02:33:25.096387+0000","last_active":"2024-09-12T02:33:26.247346+0000","last_peered":"2024-09-12T02:33:26.247346+0000","last_clean":"2024-09-12T02:33:26.247346+0000","last_became_active":"2024-09-12T02:33:25.095900+0000","last_became_peered":"2024-09-12T02:33:25.095900+0000","last_unstale":"2024-09-12T02:33:26.247346+0000","last_undegraded":"2024-09-12T02:33:26.247346+0000","last_fullsized":"2024-09-12T02:33:26.247346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:07.534838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103554+0000","last_change":"2024-09-12T02:33:25.104112+0000","last_active":"2024-09-12T02:33:26.103554+0000","last_peered":"2024-09-12T02:33:26.103554+0000","last_clean":"2024-09-12T02:33:26.103554+0000","last_became_active":"2024-09-12T02:33:25.103766+0000","last_became_peered":"2024-09-12T02:33:25.103766+0000","last_unstale":"2024-09-12T02:33:26.103554+0000","last_undegraded":"2024-09-12T02:33:26.103554+0000","last_fullsized":"2024-09-12T02:33:26.103554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.870536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246222+0000","last_change":"2024-09-12T02:33:25.102432+0000","last_active":"2024-09-12T02:33:26.246222+0000","last_peered":"2024-09-12T02:33:26.246222+0000","last_clean":"2024-09-12T02:33:26.246222+0000","last_became_active":"2024-09-12T02:33:25.102179+0000","last_became_peered":"2024-09-12T02:33:25.102179+0000","last_unstale":"2024-09-12T02:33:26.246222+0000","last_undegraded":"2024-09-12T02:33:26.246222+0000","last_fullsized":"2024-09-12T02:33:26.246222+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.434104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247692+0000","last_change":"2024-09-12T02:33:25.099201+0000","last_active":"2024-09-12T02:33:26.247692+0000","last_peered":"2024-09-12T02:33:26.247692+0000","last_clean":"2024-09-12T02:33:26.247692+0000","last_became_active":"2024-09-12T02:33:25.098939+0000","last_became_peered":"2024-09-12T02:33:25.098939+0000","last_unstale":"2024-09-12T02:33:26.247692+0000","last_undegraded":"2024-09-12T02:33:26.247692+0000","last_fullsized":"2024-09-12T02:33:26.247692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:58.225930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103492+0000","last_change":"2024-09-12T02:33:25.104295+0000","last_active":"2024-09-12T02:33:26.103492+0000","last_peered":"2024-09-12T02:33:26.103492+0000","last_clean":"2024-09-12T02:33:26.103492+0000","last_became_active":"2024-09-12T02:33:25.104016+0000","last_became_peered":"2024-09-12T02:33:25.104016+0000","last_unstale":"2024-09-12T02:33:26.103492+0000","last_undegraded":"2024-09-12T02:33:26.103492+0000","last_fullsized":"2024-09-12T02:33:26.103492+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:05.444531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247496+0000","last_change":"2024-09-12T02:33:25.107374+0000","last_active":"2024-09-12T02:33:26.247496+0000","last_peered":"2024-09-12T02:33:26.247496+0000","last_clean":"2024-09-12T02:33:26.247496+0000","last_became_active":"2024-09-12T02:33:25.106678+0000","last_became_peered":"2024-09-12T02:33:25.106678+0000","last_unstale":"2024-09-12T02:33:26.247496+0000","last_undegraded":"2024-09-12T02:33:26.247496+0000","last_fullsized":"2024-09-12T02:33:26.247496+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:26.040502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103249+0000","last_change":"2024-09-12T02:33:25.105937+0000","last_active":"2024-09-12T02:33:26.103249+0000","last_peered":"2024-09-12T02:33:26.103249+0000","last_clean":"2024-09-12T02:33:26.103249+0000","last_became_active":"2024-09-12T02:33:25.105660+0000","last_became_peered":"2024-09-12T02:33:25.105660+0000","last_unstale":"2024-09-12T02:33:26.103249+0000","last_undegraded":"2024-09-12T02:33:26.103249+0000","last_fullsized":"2024-09-12T02:33:26.103249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:44.617355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109106+0000","last_change":"2024-09-12T02:33:25.097797+0000","last_active":"2024-09-12T02:33:26.109106+0000","last_peered":"2024-09-12T02:33:26.109106+0000","last_clean":"2024-09-12T02:33:26.109106+0000","last_became_active":"2024-09-12T02:33:25.097581+0000","last_became_peered":"2024-09-12T02:33:25.097581+0000","last_unstale":"2024-09-12T02:33:26.109106+0000","last_undegraded":"2024-09-12T02:33:26.109106+0000","last_fullsized":"2024-09-12T02:33:26.109106+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:15.102186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246414+0000","last_change":"2024-09-12T02:33:25.102770+0000","last_active":"2024-09-12T02:33:26.246414+0000","last_peered":"2024-09-12T02:33:26.246414+0000","last_clean":"2024-09-12T02:33:26.246414+0000","last_became_active":"2024-09-12T02:33:25.102505+0000","last_became_peered":"2024-09-12T02:33:25.102505+0000","last_unstale":"2024-09-12T02:33:26.246414+0000","last_undegraded":"2024-09-12T02:33:26.246414+0000","last_fullsized":"2024-09-12T02:33:26.246414+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:34.319553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246294+0000","last_change":"2024-09-12T02:33:25.102926+0000","last_active":"2024-09-12T02:33:26.246294+0000","last_peered":"2024-09-12T02:33:26.246294+0000","last_clean":"2024-09-12T02:33:26.246294+0000","last_became_active":"2024-09-12T02:33:25.102666+0000","last_became_peered":"2024-09-12T02:33:25.102666+0000","last_unstale":"2024-09-12T02:33:26.246294+0000","last_undegraded":"2024-09-12T02:33:26.246294+0000","last_fullsized":"2024-09-12T02:33:26.246294+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:38.899205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246264+0000","last_change":"2024-09-12T02:33:25.109643+0000","last_active":"2024-09-12T02:33:26.246264+0000","last_peered":"2024-09-12T02:33:26.246264+0000","last_clean":"2024-09-12T02:33:26.246264+0000","last_became_active":"2024-09-12T02:33:25.109386+0000","last_became_peered":"2024-09-12T02:33:25.109386+0000","last_unstale":"2024-09-12T02:33:26.246264+0000","last_undegraded":"2024-09-12T02:33:26.246264+0000","last_fullsized":"2024-09-12T02:33:26.246264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.543436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246598+0000","last_change":"2024-09-12T02:33:25.104146+0000","last_active":"2024-09-12T02:33:26.246598+0000","last_peered":"2024-09-12T02:33:26.246598+0000","last_clean":"2024-09-12T02:33:26.246598+0000","last_became_active":"2024-09-12T02:33:25.103900+0000","last_became_peered":"2024-09-12T02:33:25.103900+0000","last_unstale":"2024-09-12T02:33:26.246598+0000","last_undegraded":"2024-09-12T02:33:26.246598+0000","last_fullsized":"2024-09-12T02:33:26.246598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.939134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247838+0000","last_change":"2024-09-12T02:33:25.104323+0000","last_active":"2024-09-12T02:33:26.247838+0000","last_peered":"2024-09-12T02:33:26.247838+0000","last_clean":"2024-09-12T02:33:26.247838+0000","last_became_active":"2024-09-12T02:33:25.104075+0000","last_became_peered":"2024-09-12T02:33:25.104075+0000","last_unstale":"2024-09-12T02:33:26.247838+0000","last_undegraded":"2024-09-12T02:33:26.247838+0000","last_fullsized":"2024-09-12T02:33:26.247838+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:31.941896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103575+0000","last_change":"2024-09-12T02:33:25.100516+0000","last_active":"2024-09-12T02:33:26.103575+0000","last_peered":"2024-09-12T02:33:26.103575+0000","last_clean":"2024-09-12T02:33:26.103575+0000","last_became_active":"2024-09-12T02:33:25.100210+0000","last_became_peered":"2024-09-12T02:33:25.100210+0000","last_unstale":"2024-09-12T02:33:26.103575+0000","last_undegraded":"2024-09-12T02:33:26.103575+0000","last_fullsized":"2024-09-12T02:33:26.103575+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:53.834499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246069+0000","last_change":"2024-09-12T02:33:25.103029+0000","last_active":"2024-09-12T02:33:26.246069+0000","last_peered":"2024-09-12T02:33:26.246069+0000","last_clean":"2024-09-12T02:33:26.246069+0000","last_became_active":"2024-09-12T02:33:25.101860+0000","last_became_peered":"2024-09-12T02:33:25.101860+0000","last_unstale":"2024-09-12T02:33:26.246069+0000","last_undegraded":"2024-09-12T02:33:26.246069+0000","last_fullsized":"2024-09-12T02:33:26.246069+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:28.789353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245691+0000","last_change":"2024-09-12T02:33:25.097884+0000","last_active":"2024-09-12T02:33:26.245691+0000","last_peered":"2024-09-12T02:33:26.245691+0000","last_clean":"2024-09-12T02:33:26.245691+0000","last_became_active":"2024-09-12T02:33:25.097616+0000","last_became_peered":"2024-09-12T02:33:25.097616+0000","last_unstale":"2024-09-12T02:33:26.245691+0000","last_undegraded":"2024-09-12T02:33:26.245691+0000","last_fullsized":"2024-09-12T02:33:26.245691+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.292727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247182+0000","last_change":"2024-09-12T02:33:25.106253+0000","last_active":"2024-09-12T02:33:26.247182+0000","last_peered":"2024-09-12T02:33:26.247182+0000","last_clean":"2024-09-12T02:33:26.247182+0000","last_became_active":"2024-09-12T02:33:25.105758+0000","last_became_peered":"2024-09-12T02:33:25.105758+0000","last_unstale":"2024-09-12T02:33:26.247182+0000","last_undegraded":"2024-09-12T02:33:26.247182+0000","last_fullsized":"2024-09-12T02:33:26.247182+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:29.340460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246594+0000","last_change":"2024-09-12T02:33:24.103587+0000","last_active":"2024-09-12T02:33:26.246594+0000","last_peered":"2024-09-12T02:33:26.246594+0000","last_clean":"2024-09-12T02:33:26.246594+0000","last_became_active":"2024-09-12T02:33:24.102988+0000","last_became_peered":"2024-09-12T02:33:24.102988+0000","last_unstale":"2024-09-12T02:33:26.246594+0000","last_undegraded":"2024-09-12T02:33:26.246594+0000","last_fullsized":"2024-09-12T02:33:26.246594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:11.899473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246029+0000","last_change":"2024-09-12T02:33:25.104315+0000","last_active":"2024-09-12T02:33:26.246029+0000","last_peered":"2024-09-12T02:33:26.246029+0000","last_clean":"2024-09-12T02:33:26.246029+0000","last_became_active":"2024-09-12T02:33:25.103928+0000","last_became_peered":"2024-09-12T02:33:25.103928+0000","last_unstale":"2024-09-12T02:33:26.246029+0000","last_undegraded":"2024-09-12T02:33:26.246029+0000","last_fullsized":"2024-09-12T02:33:26.246029+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:22.696461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247746+0000","last_change":"2024-09-12T02:33:24.102352+0000","last_active":"2024-09-12T02:33:26.247746+0000","last_peered":"2024-09-12T02:33:26.247746+0000","last_clean":"2024-09-12T02:33:26.247746+0000","last_became_active":"2024-09-12T02:33:24.102096+0000","last_became_peered":"2024-09-12T02:33:24.102096+0000","last_unstale":"2024-09-12T02:33:26.247746+0000","last_undegraded":"2024-09-12T02:33:26.247746+0000","last_fullsized":"2024-09-12T02:33:26.247746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:18.680368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246804+0000","last_change":"2024-09-12T02:33:25.104055+0000","last_active":"2024-09-12T02:33:26.246804+0000","last_peered":"2024-09-12T02:33:26.246804+0000","last_clean":"2024-09-12T02:33:26.246804+0000","last_became_active":"2024-09-12T02:33:25.103577+0000","last_became_peered":"2024-09-12T02:33:25.103577+0000","last_unstale":"2024-09-12T02:33:26.246804+0000","last_undegraded":"2024-09-12T02:33:26.246804+0000","last_fullsized":"2024-09-12T02:33:26.246804+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.780813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246483+0000","last_change":"2024-09-12T02:33:24.103498+0000","last_active":"2024-09-12T02:33:26.246483+0000","last_peered":"2024-09-12T02:33:26.246483+0000","last_clean":"2024-09-12T02:33:26.246483+0000","last_became_active":"2024-09-12T02:33:24.103138+0000","last_became_peered":"2024-09-12T02:33:24.103138+0000","last_unstale":"2024-09-12T02:33:26.246483+0000","last_undegraded":"2024-09-12T02:33:26.246483+0000","last_fullsized":"2024-09-12T02:33:26.246483+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:45.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246360+0000","last_change":"2024-09-12T02:33:25.105726+0000","last_active":"2024-09-12T02:33:26.246360+0000","last_peered":"2024-09-12T02:33:26.246360+0000","last_clean":"2024-09-12T02:33:26.246360+0000","last_became_active":"2024-09-12T02:33:25.105403+0000","last_became_peered":"2024-09-12T02:33:25.105403+0000","last_unstale":"2024-09-12T02:33:26.246360+0000","last_undegraded":"2024-09-12T02:33:26.246360+0000","last_fullsized":"2024-09-12T02:33:26.246360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:08.915690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246220+0000","last_change":"2024-09-12T02:33:24.095977+0000","last_active":"2024-09-12T02:33:26.246220+0000","last_peered":"2024-09-12T02:33:26.246220+0000","last_clean":"2024-09-12T02:33:26.246220+0000","last_became_active":"2024-09-12T02:33:24.095708+0000","last_became_peered":"2024-09-12T02:33:24.095708+0000","last_unstale":"2024-09-12T02:33:26.246220+0000","last_undegraded":"2024-09-12T02:33:26.246220+0000","last_fullsized":"2024-09-12T02:33:26.246220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:11.899473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247683+0000","last_change":"2024-09-12T02:33:25.098843+0000","last_active":"2024-09-12T02:33:26.247683+0000","last_peered":"2024-09-12T02:33:26.247683+0000","last_clean":"2024-09-12T02:33:26.247683+0000","last_became_active":"2024-09-12T02:33:25.098516+0000","last_became_peered":"2024-09-12T02:33:25.098516+0000","last_unstale":"2024-09-12T02:33:26.247683+0000","last_undegraded":"2024-09-12T02:33:26.247683+0000","last_fullsized":"2024-09-12T02:33:26.247683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:03.368159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108837+0000","last_change":"2024-09-12T02:33:24.096943+0000","last_active":"2024-09-12T02:33:26.108837+0000","last_peered":"2024-09-12T02:33:26.108837+0000","last_clean":"2024-09-12T02:33:26.108837+0000","last_became_active":"2024-09-12T02:33:24.096669+0000","last_became_peered":"2024-09-12T02:33:24.096669+0000","last_unstale":"2024-09-12T02:33:26.108837+0000","last_undegraded":"2024-09-12T02:33:26.108837+0000","last_fullsized":"2024-09-12T02:33:26.108837+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:39.524630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247621+0000","last_change":"2024-09-12T02:33:25.103412+0000","last_active":"2024-09-12T02:33:26.247621+0000","last_peered":"2024-09-12T02:33:26.247621+0000","last_clean":"2024-09-12T02:33:26.247621+0000","last_became_active":"2024-09-12T02:33:25.103134+0000","last_became_peered":"2024-09-12T02:33:25.103134+0000","last_unstale":"2024-09-12T02:33:26.247621+0000","last_undegraded":"2024-09-12T02:33:26.247621+0000","last_fullsized":"2024-09-12T02:33:26.247621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:33.417456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246105+0000","last_change":"2024-09-12T02:33:24.105374+0000","last_active":"2024-09-12T02:33:26.246105+0000","last_peered":"2024-09-12T02:33:26.246105+0000","last_clean":"2024-09-12T02:33:26.246105+0000","last_became_active":"2024-09-12T02:33:24.104681+0000","last_became_peered":"2024-09-12T02:33:24.104681+0000","last_unstale":"2024-09-12T02:33:26.246105+0000","last_undegraded":"2024-09-12T02:33:26.246105+0000","last_fullsized":"2024-09-12T02:33:26.246105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:57.489698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109283+0000","last_change":"2024-09-12T02:33:25.104517+0000","last_active":"2024-09-12T02:33:26.109283+0000","last_peered":"2024-09-12T02:33:26.109283+0000","last_clean":"2024-09-12T02:33:26.109283+0000","last_became_active":"2024-09-12T02:33:25.104230+0000","last_became_peered":"2024-09-12T02:33:25.104230+0000","last_unstale":"2024-09-12T02:33:26.109283+0000","last_undegraded":"2024-09-12T02:33:26.109283+0000","last_fullsized":"2024-09-12T02:33:26.109283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:40.531746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245962+0000","last_change":"2024-09-12T02:33:24.098923+0000","last_active":"2024-09-12T02:33:26.245962+0000","last_peered":"2024-09-12T02:33:26.245962+0000","last_clean":"2024-09-12T02:33:26.245962+0000","last_became_active":"2024-09-12T02:33:24.098669+0000","last_became_peered":"2024-09-12T02:33:24.098669+0000","last_unstale":"2024-09-12T02:33:26.245962+0000","last_undegraded":"2024-09-12T02:33:26.245962+0000","last_fullsized":"2024-09-12T02:33:26.245962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:20.736662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247877+0000","last_change":"2024-09-12T02:33:25.095356+0000","last_active":"2024-09-12T02:33:26.247877+0000","last_peered":"2024-09-12T02:33:26.247877+0000","last_clean":"2024-09-12T02:33:26.247877+0000","last_became_active":"2024-09-12T02:33:25.095010+0000","last_became_peered":"2024-09-12T02:33:25.095010+0000","last_unstale":"2024-09-12T02:33:26.247877+0000","last_undegraded":"2024-09-12T02:33:26.247877+0000","last_fullsized":"2024-09-12T02:33:26.247877+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:53.839897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108473+0000","last_change":"2024-09-12T02:33:24.100872+0000","last_active":"2024-09-12T02:33:26.108473+0000","last_peered":"2024-09-12T02:33:26.108473+0000","last_clean":"2024-09-12T02:33:26.108473+0000","last_became_active":"2024-09-12T02:33:24.100565+0000","last_became_peered":"2024-09-12T02:33:24.100565+0000","last_unstale":"2024-09-12T02:33:26.108473+0000","last_undegraded":"2024-09-12T02:33:26.108473+0000","last_fullsized":"2024-09-12T02:33:26.108473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:48.041451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109160+0000","last_change":"2024-09-12T02:33:25.101505+0000","last_active":"2024-09-12T02:33:26.109160+0000","last_peered":"2024-09-12T02:33:26.109160+0000","last_clean":"2024-09-12T02:33:26.109160+0000","last_became_active":"2024-09-12T02:33:25.101220+0000","last_became_peered":"2024-09-12T02:33:25.101220+0000","last_unstale":"2024-09-12T02:33:26.109160+0000","last_undegraded":"2024-09-12T02:33:26.109160+0000","last_fullsized":"2024-09-12T02:33:26.109160+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:06.797197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103761+0000","last_change":"2024-09-12T02:33:24.102819+0000","last_active":"2024-09-12T02:33:26.103761+0000","last_peered":"2024-09-12T02:33:26.103761+0000","last_clean":"2024-09-12T02:33:26.103761+0000","last_became_active":"2024-09-12T02:33:24.102535+0000","last_became_peered":"2024-09-12T02:33:24.102535+0000","last_unstale":"2024-09-12T02:33:26.103761+0000","last_undegraded":"2024-09-12T02:33:26.103761+0000","last_fullsized":"2024-09-12T02:33:26.103761+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:29.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103748+0000","last_change":"2024-09-12T02:33:25.101728+0000","last_active":"2024-09-12T02:33:26.103748+0000","last_peered":"2024-09-12T02:33:26.103748+0000","last_clean":"2024-09-12T02:33:26.103748+0000","last_became_active":"2024-09-12T02:33:25.101387+0000","last_became_peered":"2024-09-12T02:33:25.101387+0000","last_unstale":"2024-09-12T02:33:26.103748+0000","last_undegraded":"2024-09-12T02:33:26.103748+0000","last_fullsized":"2024-09-12T02:33:26.103748+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:03.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247833+0000","last_change":"2024-09-12T02:33:24.099708+0000","last_active":"2024-09-12T02:33:26.247833+0000","last_peered":"2024-09-12T02:33:26.247833+0000","last_clean":"2024-09-12T02:33:26.247833+0000","last_became_active":"2024-09-12T02:33:24.099449+0000","last_became_peered":"2024-09-12T02:33:24.099449+0000","last_unstale":"2024-09-12T02:33:26.247833+0000","last_undegraded":"2024-09-12T02:33:26.247833+0000","last_fullsized":"2024-09-12T02:33:26.247833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:35.720734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246175+0000","last_change":"2024-09-12T02:33:25.108620+0000","last_active":"2024-09-12T02:33:26.246175+0000","last_peered":"2024-09-12T02:33:26.246175+0000","last_clean":"2024-09-12T02:33:26.246175+0000","last_became_active":"2024-09-12T02:33:25.108363+0000","last_became_peered":"2024-09-12T02:33:25.108363+0000","last_unstale":"2024-09-12T02:33:26.246175+0000","last_undegraded":"2024-09-12T02:33:26.246175+0000","last_fullsized":"2024-09-12T02:33:26.246175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:59.980036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103788+0000","last_change":"2024-09-12T02:33:24.101611+0000","last_active":"2024-09-12T02:33:26.103788+0000","last_peered":"2024-09-12T02:33:26.103788+0000","last_clean":"2024-09-12T02:33:26.103788+0000","last_became_active":"2024-09-12T02:33:24.101323+0000","last_became_peered":"2024-09-12T02:33:24.101323+0000","last_unstale":"2024-09-12T02:33:26.103788+0000","last_undegraded":"2024-09-12T02:33:26.103788+0000","last_fullsized":"2024-09-12T02:33:26.103788+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:51.843242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103702+0000","last_change":"2024-09-12T02:33:25.104303+0000","last_active":"2024-09-12T02:33:26.103702+0000","last_peered":"2024-09-12T02:33:26.103702+0000","last_clean":"2024-09-12T02:33:26.103702+0000","last_became_active":"2024-09-12T02:33:25.104021+0000","last_became_peered":"2024-09-12T02:33:25.104021+0000","last_unstale":"2024-09-12T02:33:26.103702+0000","last_undegraded":"2024-09-12T02:33:26.103702+0000","last_fullsized":"2024-09-12T02:33:26.103702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.543436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109312+0000","last_change":"2024-09-12T02:33:24.103400+0000","last_active":"2024-09-12T02:33:26.109312+0000","last_peered":"2024-09-12T02:33:26.109312+0000","last_clean":"2024-09-12T02:33:26.109312+0000","last_became_active":"2024-09-12T02:33:24.103127+0000","last_became_peered":"2024-09-12T02:33:24.103127+0000","last_unstale":"2024-09-12T02:33:26.109312+0000","last_undegraded":"2024-09-12T02:33:26.109312+0000","last_fullsized":"2024-09-12T02:33:26.109312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:33.567838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245945+0000","last_change":"2024-09-12T02:33:25.106162+0000","last_active":"2024-09-12T02:33:26.245945+0000","last_peered":"2024-09-12T02:33:26.245945+0000","last_clean":"2024-09-12T02:33:26.245945+0000","last_became_active":"2024-09-12T02:33:25.105863+0000","last_became_peered":"2024-09-12T02:33:25.105863+0000","last_unstale":"2024-09-12T02:33:26.245945+0000","last_undegraded":"2024-09-12T02:33:26.245945+0000","last_fullsized":"2024-09-12T02:33:26.245945+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:36.391014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247762+0000","last_change":"2024-09-12T02:33:24.104616+0000","last_active":"2024-09-12T02:33:26.247762+0000","last_peered":"2024-09-12T02:33:26.247762+0000","last_clean":"2024-09-12T02:33:26.247762+0000","last_became_active":"2024-09-12T02:33:24.104322+0000","last_became_peered":"2024-09-12T02:33:24.104322+0000","last_unstale":"2024-09-12T02:33:26.247762+0000","last_undegraded":"2024-09-12T02:33:26.247762+0000","last_fullsized":"2024-09-12T02:33:26.247762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:22.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103411+0000","last_change":"2024-09-12T02:33:25.101495+0000","last_active":"2024-09-12T02:33:26.103411+0000","last_peered":"2024-09-12T02:33:26.103411+0000","last_clean":"2024-09-12T02:33:26.103411+0000","last_became_active":"2024-09-12T02:33:25.100869+0000","last_became_peered":"2024-09-12T02:33:25.100869+0000","last_unstale":"2024-09-12T02:33:26.103411+0000","last_undegraded":"2024-09-12T02:33:26.103411+0000","last_fullsized":"2024-09-12T02:33:26.103411+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:36.391014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108938+0000","last_change":"2024-09-12T02:33:24.099239+0000","last_active":"2024-09-12T02:33:26.108938+0000","last_peered":"2024-09-12T02:33:26.108938+0000","last_clean":"2024-09-12T02:33:26.108938+0000","last_became_active":"2024-09-12T02:33:24.098946+0000","last_became_peered":"2024-09-12T02:33:24.098946+0000","last_unstale":"2024-09-12T02:33:26.108938+0000","last_undegraded":"2024-09-12T02:33:26.108938+0000","last_fullsized":"2024-09-12T02:33:26.108938+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:59.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108383+0000","last_change":"2024-09-12T02:33:25.103275+0000","last_active":"2024-09-12T02:33:26.108383+0000","last_peered":"2024-09-12T02:33:26.108383+0000","last_clean":"2024-09-12T02:33:26.108383+0000","last_became_active":"2024-09-12T02:33:25.103010+0000","last_became_peered":"2024-09-12T02:33:25.103010+0000","last_unstale":"2024-09-12T02:33:26.108383+0000","last_undegraded":"2024-09-12T02:33:26.108383+0000","last_fullsized":"2024-09-12T02:33:26.108383+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:21.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245879+0000","last_change":"2024-09-12T02:33:24.096036+0000","last_active":"2024-09-12T02:33:26.245879+0000","last_peered":"2024-09-12T02:33:26.245879+0000","last_clean":"2024-09-12T02:33:26.245879+0000","last_became_active":"2024-09-12T02:33:24.095750+0000","last_became_peered":"2024-09-12T02:33:24.095750+0000","last_unstale":"2024-09-12T02:33:26.245879+0000","last_undegraded":"2024-09-12T02:33:26.245879+0000","last_fullsized":"2024-09-12T02:33:26.245879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:14.316778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103603+0000","last_change":"2024-09-12T02:33:25.106094+0000","last_active":"2024-09-12T02:33:26.103603+0000","last_peered":"2024-09-12T02:33:26.103603+0000","last_clean":"2024-09-12T02:33:26.103603+0000","last_became_active":"2024-09-12T02:33:25.105803+0000","last_became_peered":"2024-09-12T02:33:25.105803+0000","last_unstale":"2024-09-12T02:33:26.103603+0000","last_undegraded":"2024-09-12T02:33:26.103603+0000","last_fullsized":"2024-09-12T02:33:26.103603+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:13.041980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103214+0000","last_change":"2024-09-12T02:33:24.100164+0000","last_active":"2024-09-12T02:33:26.103214+0000","last_peered":"2024-09-12T02:33:26.103214+0000","last_clean":"2024-09-12T02:33:26.103214+0000","last_became_active":"2024-09-12T02:33:24.099889+0000","last_became_peered":"2024-09-12T02:33:24.099889+0000","last_unstale":"2024-09-12T02:33:26.103214+0000","last_undegraded":"2024-09-12T02:33:26.103214+0000","last_fullsized":"2024-09-12T02:33:26.103214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:55.674613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103680+0000","last_change":"2024-09-12T02:33:25.103609+0000","last_active":"2024-09-12T02:33:26.103680+0000","last_peered":"2024-09-12T02:33:26.103680+0000","last_clean":"2024-09-12T02:33:26.103680+0000","last_became_active":"2024-09-12T02:33:25.103349+0000","last_became_peered":"2024-09-12T02:33:25.103349+0000","last_unstale":"2024-09-12T02:33:26.103680+0000","last_undegraded":"2024-09-12T02:33:26.103680+0000","last_fullsized":"2024-09-12T02:33:26.103680+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.292727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247510+0000","last_change":"2024-09-12T02:33:24.100393+0000","last_active":"2024-09-12T02:33:26.247510+0000","last_peered":"2024-09-12T02:33:26.247510+0000","last_clean":"2024-09-12T02:33:26.247510+0000","last_became_active":"2024-09-12T02:33:24.100095+0000","last_became_peered":"2024-09-12T02:33:24.100095+0000","last_unstale":"2024-09-12T02:33:26.247510+0000","last_undegraded":"2024-09-12T02:33:26.247510+0000","last_fullsized":"2024-09-12T02:33:26.247510+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.219218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246299+0000","last_change":"2024-09-12T02:33:25.106099+0000","last_active":"2024-09-12T02:33:26.246299+0000","last_peered":"2024-09-12T02:33:26.246299+0000","last_clean":"2024-09-12T02:33:26.246299+0000","last_became_active":"2024-09-12T02:33:25.105355+0000","last_became_peered":"2024-09-12T02:33:25.105355+0000","last_unstale":"2024-09-12T02:33:26.246299+0000","last_undegraded":"2024-09-12T02:33:26.246299+0000","last_fullsized":"2024-09-12T02:33:26.246299+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.292727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247138+0000","last_change":"2024-09-12T02:33:24.106242+0000","last_active":"2024-09-12T02:33:26.247138+0000","last_peered":"2024-09-12T02:33:26.247138+0000","last_clean":"2024-09-12T02:33:26.247138+0000","last_became_active":"2024-09-12T02:33:24.105965+0000","last_became_peered":"2024-09-12T02:33:24.105965+0000","last_unstale":"2024-09-12T02:33:26.247138+0000","last_undegraded":"2024-09-12T02:33:26.247138+0000","last_fullsized":"2024-09-12T02:33:26.247138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:14.316778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247837+0000","last_change":"2024-09-12T02:33:25.098663+0000","last_active":"2024-09-12T02:33:26.247837+0000","last_peered":"2024-09-12T02:33:26.247837+0000","last_clean":"2024-09-12T02:33:26.247837+0000","last_became_active":"2024-09-12T02:33:25.098373+0000","last_became_peered":"2024-09-12T02:33:25.098373+0000","last_unstale":"2024-09-12T02:33:26.247837+0000","last_undegraded":"2024-09-12T02:33:26.247837+0000","last_fullsized":"2024-09-12T02:33:26.247837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:32.984989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246160+0000","last_change":"2024-09-12T02:33:24.097482+0000","last_active":"2024-09-12T02:33:26.246160+0000","last_peered":"2024-09-12T02:33:26.246160+0000","last_clean":"2024-09-12T02:33:26.246160+0000","last_became_active":"2024-09-12T02:33:24.097212+0000","last_became_peered":"2024-09-12T02:33:24.097212+0000","last_unstale":"2024-09-12T02:33:26.246160+0000","last_undegraded":"2024-09-12T02:33:26.246160+0000","last_fullsized":"2024-09-12T02:33:26.246160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:45.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103650+0000","last_change":"2024-09-12T02:33:25.103054+0000","last_active":"2024-09-12T02:33:26.103650+0000","last_peered":"2024-09-12T02:33:26.103650+0000","last_clean":"2024-09-12T02:33:26.103650+0000","last_became_active":"2024-09-12T02:33:25.102561+0000","last_became_peered":"2024-09-12T02:33:25.102561+0000","last_unstale":"2024-09-12T02:33:26.103650+0000","last_undegraded":"2024-09-12T02:33:26.103650+0000","last_fullsized":"2024-09-12T02:33:26.103650+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:38.899205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246884+0000","last_change":"2024-09-12T02:33:24.105520+0000","last_active":"2024-09-12T02:33:26.246884+0000","last_peered":"2024-09-12T02:33:26.246884+0000","last_clean":"2024-09-12T02:33:26.246884+0000","last_became_active":"2024-09-12T02:33:24.105251+0000","last_became_peered":"2024-09-12T02:33:24.105251+0000","last_unstale":"2024-09-12T02:33:26.246884+0000","last_undegraded":"2024-09-12T02:33:26.246884+0000","last_fullsized":"2024-09-12T02:33:26.246884+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.790080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245951+0000","last_change":"2024-09-12T02:33:25.106040+0000","last_active":"2024-09-12T02:33:26.245951+0000","last_peered":"2024-09-12T02:33:26.245951+0000","last_clean":"2024-09-12T02:33:26.245951+0000","last_became_active":"2024-09-12T02:33:25.105263+0000","last_became_peered":"2024-09-12T02:33:25.105263+0000","last_unstale":"2024-09-12T02:33:26.245951+0000","last_undegraded":"2024-09-12T02:33:26.245951+0000","last_fullsized":"2024-09-12T02:33:26.245951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:05.444531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247850+0000","last_change":"2024-09-12T02:33:24.104742+0000","last_active":"2024-09-12T02:33:26.247850+0000","last_peered":"2024-09-12T02:33:26.247850+0000","last_clean":"2024-09-12T02:33:26.247850+0000","last_became_active":"2024-09-12T02:33:24.104498+0000","last_became_peered":"2024-09-12T02:33:24.104498+0000","last_unstale":"2024-09-12T02:33:26.247850+0000","last_undegraded":"2024-09-12T02:33:26.247850+0000","last_fullsized":"2024-09-12T02:33:26.247850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:15.982240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246294+0000","last_change":"2024-09-12T02:33:25.110315+0000","last_active":"2024-09-12T02:33:26.246294+0000","last_peered":"2024-09-12T02:33:26.246294+0000","last_clean":"2024-09-12T02:33:26.246294+0000","last_became_active":"2024-09-12T02:33:25.110056+0000","last_became_peered":"2024-09-12T02:33:25.110056+0000","last_unstale":"2024-09-12T02:33:26.246294+0000","last_undegraded":"2024-09-12T02:33:26.246294+0000","last_fullsized":"2024-09-12T02:33:26.246294+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:03.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245676+0000","last_change":"2024-09-12T02:33:24.097192+0000","last_active":"2024-09-12T02:33:26.245676+0000","last_peered":"2024-09-12T02:33:26.245676+0000","last_clean":"2024-09-12T02:33:26.245676+0000","last_became_active":"2024-09-12T02:33:24.096902+0000","last_became_peered":"2024-09-12T02:33:24.096902+0000","last_unstale":"2024-09-12T02:33:26.245676+0000","last_undegraded":"2024-09-12T02:33:26.245676+0000","last_fullsized":"2024-09-12T02:33:26.245676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:59.774119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245669+0000","last_change":"2024-09-12T02:33:25.108078+0000","last_active":"2024-09-12T02:33:26.245669+0000","last_peered":"2024-09-12T02:33:26.245669+0000","last_clean":"2024-09-12T02:33:26.245669+0000","last_became_active":"2024-09-12T02:33:25.107789+0000","last_became_peered":"2024-09-12T02:33:25.107789+0000","last_unstale":"2024-09-12T02:33:26.245669+0000","last_undegraded":"2024-09-12T02:33:26.245669+0000","last_fullsized":"2024-09-12T02:33:26.245669+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:38.899205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245858+0000","last_change":"2024-09-12T02:33:24.105785+0000","last_active":"2024-09-12T02:33:26.245858+0000","last_peered":"2024-09-12T02:33:26.245858+0000","last_clean":"2024-09-12T02:33:26.245858+0000","last_became_active":"2024-09-12T02:33:24.105481+0000","last_became_peered":"2024-09-12T02:33:24.105481+0000","last_unstale":"2024-09-12T02:33:26.245858+0000","last_undegraded":"2024-09-12T02:33:26.245858+0000","last_fullsized":"2024-09-12T02:33:26.245858+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:02.335445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246222+0000","last_change":"2024-09-12T02:33:25.108252+0000","last_active":"2024-09-12T02:33:26.246222+0000","last_peered":"2024-09-12T02:33:26.246222+0000","last_clean":"2024-09-12T02:33:26.246222+0000","last_became_active":"2024-09-12T02:33:25.107997+0000","last_became_peered":"2024-09-12T02:33:25.107997+0000","last_unstale":"2024-09-12T02:33:26.246222+0000","last_undegraded":"2024-09-12T02:33:26.246222+0000","last_fullsized":"2024-09-12T02:33:26.246222+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:53.834499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246144+0000","last_change":"2024-09-12T02:33:24.101310+0000","last_active":"2024-09-12T02:33:26.246144+0000","last_peered":"2024-09-12T02:33:26.246144+0000","last_clean":"2024-09-12T02:33:26.246144+0000","last_became_active":"2024-09-12T02:33:24.101010+0000","last_became_peered":"2024-09-12T02:33:24.101010+0000","last_unstale":"2024-09-12T02:33:26.246144+0000","last_undegraded":"2024-09-12T02:33:26.246144+0000","last_fullsized":"2024-09-12T02:33:26.246144+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:43.893537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246355+0000","last_change":"2024-09-12T02:33:25.108875+0000","last_active":"2024-09-12T02:33:26.246355+0000","last_peered":"2024-09-12T02:33:26.246355+0000","last_clean":"2024-09-12T02:33:26.246355+0000","last_became_active":"2024-09-12T02:33:25.108604+0000","last_became_peered":"2024-09-12T02:33:25.108604+0000","last_unstale":"2024-09-12T02:33:26.246355+0000","last_undegraded":"2024-09-12T02:33:26.246355+0000","last_fullsized":"2024-09-12T02:33:26.246355+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.543436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:27.089580+0000","last_change":"2024-09-12T02:33:24.104611+0000","last_active":"2024-09-12T02:33:27.089580+0000","last_peered":"2024-09-12T02:33:27.089580+0000","last_clean":"2024-09-12T02:33:27.089580+0000","last_became_active":"2024-09-12T02:33:24.104302+0000","last_became_peered":"2024-09-12T02:33:24.104302+0000","last_unstale":"2024-09-12T02:33:27.089580+0000","last_undegraded":"2024-09-12T02:33:27.089580+0000","last_fullsized":"2024-09-12T02:33:27.089580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:02.335445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246306+0000","last_change":"2024-09-12T02:33:25.108421+0000","last_active":"2024-09-12T02:33:26.246306+0000","last_peered":"2024-09-12T02:33:26.246306+0000","last_clean":"2024-09-12T02:33:26.246306+0000","last_became_active":"2024-09-12T02:33:25.108021+0000","last_became_peered":"2024-09-12T02:33:25.108021+0000","last_unstale":"2024-09-12T02:33:26.246306+0000","last_undegraded":"2024-09-12T02:33:26.246306+0000","last_fullsized":"2024-09-12T02:33:26.246306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:44.498268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109338+0000","last_change":"2024-09-12T02:33:24.099009+0000","last_active":"2024-09-12T02:33:26.109338+0000","last_peered":"2024-09-12T02:33:26.109338+0000","last_clean":"2024-09-12T02:33:26.109338+0000","last_became_active":"2024-09-12T02:33:24.098693+0000","last_became_peered":"2024-09-12T02:33:24.098693+0000","last_unstale":"2024-09-12T02:33:26.109338+0000","last_undegraded":"2024-09-12T02:33:26.109338+0000","last_fullsized":"2024-09-12T02:33:26.109338+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:45.561600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246433+0000","last_change":"2024-09-12T02:33:25.102347+0000","last_active":"2024-09-12T02:33:26.246433+0000","last_peered":"2024-09-12T02:33:26.246433+0000","last_clean":"2024-09-12T02:33:26.246433+0000","last_became_active":"2024-09-12T02:33:25.102089+0000","last_became_peered":"2024-09-12T02:33:25.102089+0000","last_unstale":"2024-09-12T02:33:26.246433+0000","last_undegraded":"2024-09-12T02:33:26.246433+0000","last_fullsized":"2024-09-12T02:33:26.246433+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:49.255489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.246331+0000","last_change":"2024-09-12T02:33:24.098370+0000","last_active":"2024-09-12T02:33:26.246331+0000","last_peered":"2024-09-12T02:33:26.246331+0000","last_clean":"2024-09-12T02:33:26.246331+0000","last_became_active":"2024-09-12T02:33:24.098081+0000","last_became_peered":"2024-09-12T02:33:24.098081+0000","last_unstale":"2024-09-12T02:33:26.246331+0000","last_undegraded":"2024-09-12T02:33:26.246331+0000","last_fullsized":"2024-09-12T02:33:26.246331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.790080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247625+0000","last_change":"2024-09-12T02:33:25.096803+0000","last_active":"2024-09-12T02:33:26.247625+0000","last_peered":"2024-09-12T02:33:26.247625+0000","last_clean":"2024-09-12T02:33:26.247625+0000","last_became_active":"2024-09-12T02:33:25.096541+0000","last_became_peered":"2024-09-12T02:33:25.096541+0000","last_unstale":"2024-09-12T02:33:26.247625+0000","last_undegraded":"2024-09-12T02:33:26.247625+0000","last_fullsized":"2024-09-12T02:33:26.247625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:53.360197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245663+0000","last_change":"2024-09-12T02:33:24.101589+0000","last_active":"2024-09-12T02:33:26.245663+0000","last_peered":"2024-09-12T02:33:26.245663+0000","last_clean":"2024-09-12T02:33:26.245663+0000","last_became_active":"2024-09-12T02:33:24.101329+0000","last_became_peered":"2024-09-12T02:33:24.101329+0000","last_unstale":"2024-09-12T02:33:26.245663+0000","last_undegraded":"2024-09-12T02:33:26.245663+0000","last_fullsized":"2024-09-12T02:33:26.245663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:45.561600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103749+0000","last_change":"2024-09-12T02:33:25.101923+0000","last_active":"2024-09-12T02:33:26.103749+0000","last_peered":"2024-09-12T02:33:26.103749+0000","last_clean":"2024-09-12T02:33:26.103749+0000","last_became_active":"2024-09-12T02:33:25.101229+0000","last_became_peered":"2024-09-12T02:33:25.101229+0000","last_unstale":"2024-09-12T02:33:26.103749+0000","last_undegraded":"2024-09-12T02:33:26.103749+0000","last_fullsized":"2024-09-12T02:33:26.103749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:08.915690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.108552+0000","last_change":"2024-09-12T02:33:24.103563+0000","last_active":"2024-09-12T02:33:26.108552+0000","last_peered":"2024-09-12T02:33:26.108552+0000","last_clean":"2024-09-12T02:33:26.108552+0000","last_became_active":"2024-09-12T02:33:24.103101+0000","last_became_peered":"2024-09-12T02:33:24.103101+0000","last_unstale":"2024-09-12T02:33:26.108552+0000","last_undegraded":"2024-09-12T02:33:26.108552+0000","last_fullsized":"2024-09-12T02:33:26.108552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:21.689344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245547+0000","last_change":"2024-09-12T02:33:25.091321+0000","last_active":"2024-09-12T02:33:26.245547+0000","last_peered":"2024-09-12T02:33:26.245547+0000","last_clean":"2024-09-12T02:33:26.245547+0000","last_became_active":"2024-09-12T02:33:25.091052+0000","last_became_peered":"2024-09-12T02:33:25.091052+0000","last_unstale":"2024-09-12T02:33:26.245547+0000","last_undegraded":"2024-09-12T02:33:26.245547+0000","last_fullsized":"2024-09-12T02:33:26.245547+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:49.048567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.245852+0000","last_change":"2024-09-12T02:33:24.100501+0000","last_active":"2024-09-12T02:33:26.245852+0000","last_peered":"2024-09-12T02:33:26.245852+0000","last_clean":"2024-09-12T02:33:26.245852+0000","last_became_active":"2024-09-12T02:33:24.100248+0000","last_became_peered":"2024-09-12T02:33:24.100248+0000","last_unstale":"2024-09-12T02:33:26.245852+0000","last_undegraded":"2024-09-12T02:33:26.245852+0000","last_fullsized":"2024-09-12T02:33:26.245852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:18.481594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247496+0000","last_change":"2024-09-12T02:33:25.094447+0000","last_active":"2024-09-12T02:33:26.247496+0000","last_peered":"2024-09-12T02:33:26.247496+0000","last_clean":"2024-09-12T02:33:26.247496+0000","last_became_active":"2024-09-12T02:33:25.094191+0000","last_became_peered":"2024-09-12T02:33:25.094191+0000","last_unstale":"2024-09-12T02:33:26.247496+0000","last_undegraded":"2024-09-12T02:33:26.247496+0000","last_fullsized":"2024-09-12T02:33:26.247496+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:34.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247418+0000","last_change":"2024-09-12T02:33:24.102027+0000","last_active":"2024-09-12T02:33:26.247418+0000","last_peered":"2024-09-12T02:33:26.247418+0000","last_clean":"2024-09-12T02:33:26.247418+0000","last_became_active":"2024-09-12T02:33:24.101553+0000","last_became_peered":"2024-09-12T02:33:24.101553+0000","last_unstale":"2024-09-12T02:33:26.247418+0000","last_undegraded":"2024-09-12T02:33:26.247418+0000","last_fullsized":"2024-09-12T02:33:26.247418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:49.348238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.247322+0000","last_change":"2024-09-12T02:33:25.099186+0000","last_active":"2024-09-12T02:33:26.247322+0000","last_peered":"2024-09-12T02:33:26.247322+0000","last_clean":"2024-09-12T02:33:26.247322+0000","last_became_active":"2024-09-12T02:33:25.098679+0000","last_became_peered":"2024-09-12T02:33:25.098679+0000","last_unstale":"2024-09-12T02:33:26.247322+0000","last_undegraded":"2024-09-12T02:33:26.247322+0000","last_fullsized":"2024-09-12T02:33:26.247322+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:24.073498+0000","last_clean_scrub_stamp":"2024-09-12T02:33:24.073498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:10.310593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.109119+0000","last_change":"2024-09-12T02:33:24.096038+0000","last_active":"2024-09-12T02:33:26.109119+0000","last_peered":"2024-09-12T02:33:26.109119+0000","last_clean":"2024-09-12T02:33:26.109119+0000","last_became_active":"2024-09-12T02:33:24.095757+0000","last_became_peered":"2024-09-12T02:33:24.095757+0000","last_unstale":"2024-09-12T02:33:26.109119+0000","last_undegraded":"2024-09-12T02:33:26.109119+0000","last_fullsized":"2024-09-12T02:33:26.109119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:33:23.066381+0000","last_clean_scrub_stamp":"2024-09-12T02:33:23.066381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:43.893537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":244,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-12T02:33:26.103431+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:33:26.103431+0000","last_peered":"2024-09-12T02:33:26.103431+0000","last_clean":"2024-09-12T02:33:26.103431+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:33:26.103431+0000","last_undegraded":"2024-09-12T02:33:26.103431+0000","last_fullsized":"2024-09-12T02:33:26.103431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1314816,"data_stored":888423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":712704,"data_stored":297895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":720896,"data_stored":298547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":724992,"data_stored":299507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":716800,"data_stored":297985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":890457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":297951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":291651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:33:28.378 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:33:28.378 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:33:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.520+0000 7f71b57a8640 1 Processor -- start 2024-09-12T02:33:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.520+0000 7f71b57a8640 1 -- start start 2024-09-12T02:33:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71b57a8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f71b00b62e0 0x7f71b00b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71b57a8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00c8480 0x7f71b00c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71b57a8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b00d3890 con 0x7f71b015e6b0 2024-09-12T02:33:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71b57a8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f71b00b6c70 con 0x7f71b00b62e0 2024-09-12T02:33:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71b57a8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71b00c7ff0 con 0x7f71b00c8480 2024-09-12T02:33:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71a67fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f71b00b62e0 0x7f71b00b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71a67fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f71b00b62e0 0x7f71b00b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52184/0 (socket says 172.21.15.181:52184) 2024-09-12T02:33:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71a67fc640 1 -- 172.21.15.181:0/2488437448 learned_addr learned my addr 172.21.15.181:0/2488437448 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71af7fe640 1 --2- 172.21.15.181:0/2488437448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00c8480 0x7f71b00c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71a67fc640 1 -- 172.21.15.181:0/2488437448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00c8480 msgr2=0x7f71b00c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71a67fc640 1 --2- 172.21.15.181:0/2488437448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00c8480 0x7f71b00c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71a67fc640 1 -- 172.21.15.181:0/2488437448 >> v1:172.21.15.204:6789/0 conn(0x7f71b015e6b0 legacy=0x7f71b00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71a67fc640 1 -- 172.21.15.181:0/2488437448 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b00d3b70 con 0x7f71b00b62e0 2024-09-12T02:33:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.521+0000 7f71af7fe640 1 --2- 172.21.15.181:0/2488437448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00c8480 0x7f71b00c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.522+0000 7f71a67fc640 1 --2- 172.21.15.181:0/2488437448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00b62e0 0x7f71b00b6730 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7198009870 tx=0x7f719802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1c23cbda758692 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.522+0000 7f71ae7fc640 1 -- 172.21.15.181:0/2488437448 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198037070 con 0x7f71b00b62e0 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.522+0000 7f71ae7fc640 1 -- 172.21.15.181:0/2488437448 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719802ae50 con 0x7f71b00b62e0 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.522+0000 7f71ae7fc640 1 -- 172.21.15.181:0/2488437448 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198032860 con 0x7f71b00b62e0 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 -- 172.21.15.181:0/2488437448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00b62e0 msgr2=0x7f71b00b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 --2- 172.21.15.181:0/2488437448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00b62e0 0x7f71b00b6730 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7198009870 tx=0x7f719802a300 comp rx=0 tx=0).stop 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 -- 172.21.15.181:0/2488437448 shutdown_connections 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 --2- 172.21.15.181:0/2488437448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00c8480 0x7f71b00c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 --2- 172.21.15.181:0/2488437448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00b62e0 0x7f71b00b6730 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 -- 172.21.15.181:0/2488437448 >> 172.21.15.181:0/2488437448 conn(0x7f71b00d1340 msgr2=0x7f71b00d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 -- 172.21.15.181:0/2488437448 shutdown_connections 2024-09-12T02:33:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.523+0000 7f71b57a8640 1 -- 172.21.15.181:0/2488437448 wait complete. 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.524+0000 7f71b57a8640 1 Processor -- start 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.524+0000 7f71b57a8640 1 -- start start 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71b57a8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00b62e0 0x7f71b0154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71b57a8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00c8480 0x7f71b00cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71b57a8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71b015e6b0 0x7f71b0160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71b57a8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f71b00d3570 con 0x7f71b00c8480 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71b57a8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f71b00d4130 con 0x7f71b015e6b0 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71b57a8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71b00cf5c0 con 0x7f71b00b62e0 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00c8480 0x7f71b00cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00c8480 0x7f71b00cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52200/0 (socket says 172.21.15.181:52200) 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 -- 172.21.15.181:0/744248474 learned_addr learned my addr 172.21.15.181:0/744248474 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71af7fe640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71b015e6b0 0x7f71b0160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71aeffd640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00b62e0 0x7f71b0154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 -- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00b62e0 msgr2=0x7f71b0154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00b62e0 0x7f71b0154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 -- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71b015e6b0 msgr2=0x7f71b0160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71b015e6b0 0x7f71b0160d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 -- 172.21.15.181:0/744248474 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b0154e80 con 0x7f71b00c8480 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71aeffd640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00b62e0 0x7f71b0154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.525+0000 7f71a67fc640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00c8480 0x7f71b00cd520 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f719802a340 tx=0x7f71980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.526+0000 7f71a7fff640 1 -- 172.21.15.181:0/744248474 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198041020 con 0x7f71b00c8480 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.526+0000 7f71a7fff640 1 -- 172.21.15.181:0/744248474 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719803c670 con 0x7f71b00c8480 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.526+0000 7f71a7fff640 1 -- 172.21.15.181:0/744248474 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198037040 con 0x7f71b00c8480 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.526+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b00cc480 con 0x7f71b00c8480 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.526+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b00cca40 con 0x7f71b00c8480 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.527+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b00b6730 con 0x7f71b00c8480 2024-09-12T02:33:28.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.527+0000 7f71a7fff640 1 -- 172.21.15.181:0/744248474 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7198044020 con 0x7f71b00c8480 2024-09-12T02:33:28.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.527+0000 7f71a7fff640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be60 0x7f719006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.528+0000 7f71a7fff640 1 -- 172.21.15.181:0/744248474 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f71980ab470 con 0x7f71b00c8480 2024-09-12T02:33:28.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.528+0000 7f71aeffd640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be60 0x7f719006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.528+0000 7f71aeffd640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be60 0x7f719006e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f71b01f7c70 tx=0x7f71a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.532+0000 7f71a7fff640 1 -- 172.21.15.181:0/744248474 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f719804b030 con 0x7f71b00c8480 2024-09-12T02:33:28.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.762+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f71b00cf040 con 0x7f71b00c8480 2024-09-12T02:33:28.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.764+0000 7f71a7fff640 1 -- 172.21.15.181:0/744248474 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f71b0154e80 con 0x7f71b00c8480 2024-09-12T02:33:28.765 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-12T02:33:28.765 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg== 2024-09-12T02:33:28.765 INFO:teuthology.orchestra.run.smithi181.stdout: caps mds = "allow" 2024-09-12T02:33:28.765 INFO:teuthology.orchestra.run.smithi181.stdout: caps mon = "allow r" 2024-09-12T02:33:28.765 INFO:teuthology.orchestra.run.smithi181.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:33:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:updated caps for client.0 2024-09-12T02:33:28.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be60 msgr2=0x7f719006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be60 0x7f719006e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f71b01f7c70 tx=0x7f71a0009040 comp rx=0 tx=0).stop 2024-09-12T02:33:28.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00c8480 msgr2=0x7f71b00cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00c8480 0x7f71b00cd520 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f719802a340 tx=0x7f71980046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 shutdown_connections 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be60 0x7f719006e320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71b015e6b0 0x7f71b0160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71b00c8480 0x7f71b00cd520 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 --2- 172.21.15.181:0/744248474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71b00b62e0 0x7f71b0154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 >> 172.21.15.181:0/744248474 conn(0x7f71b00d1340 msgr2=0x7f71b00c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 shutdown_connections 2024-09-12T02:33:28.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.767+0000 7f71b57a8640 1 -- 172.21.15.181:0/744248474 wait complete. 2024-09-12T02:33:28.779 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:28.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.876+0000 7f25a6e5e640 1 Processor -- start 2024-09-12T02:33:28.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.876+0000 7f25a6e5e640 1 -- start start 2024-09-12T02:33:28.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f25a6e5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00cdfc0 0x7f25a00b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f25a6e5e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f25a00b22c0 0x7f25a00716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f25a6e5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a00ce480 con 0x7f25a015b1e0 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f25a6e5e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f25a00ce760 con 0x7f25a00b22c0 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f25a6e5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00cea40 con 0x7f25a00cdfc0 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f25a53fb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f25a00b22c0 0x7f25a00716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f259ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00cdfc0 0x7f25a00b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.877+0000 7f25a4bfa640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f25a015b1e0 0x7f25a00b3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:54218/0 (socket says 172.21.15.181:54218) 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.878+0000 7f25a4bfa640 1 -- 172.21.15.181:0/826524217 learned_addr learned my addr 172.21.15.181:0/826524217 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.878+0000 7f25a53fb640 1 -- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00cdfc0 msgr2=0x7f25a00b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.878+0000 7f25a53fb640 1 --2- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00cdfc0 0x7f25a00b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.878+0000 7f25a53fb640 1 -- 172.21.15.181:0/826524217 >> v1:172.21.15.204:6789/0 conn(0x7f25a015b1e0 legacy=0x7f25a00b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.878+0000 7f25a53fb640 1 -- 172.21.15.181:0/826524217 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00ced20 con 0x7f25a00b22c0 2024-09-12T02:33:28.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.878+0000 7f259ffff640 1 --2- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00cdfc0 0x7f25a00b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a53fb640 1 --2- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a00b22c0 0x7f25a00716c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f25980097a0 tx=0x7f259802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51071a9b0eac5b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f259f7fe640 1 -- 172.21.15.181:0/826524217 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598037070 con 0x7f25a00b22c0 2024-09-12T02:33:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f259f7fe640 1 -- 172.21.15.181:0/826524217 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2598032440 con 0x7f25a00b22c0 2024-09-12T02:33:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f259f7fe640 1 -- 172.21.15.181:0/826524217 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598032810 con 0x7f25a00b22c0 2024-09-12T02:33:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 -- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a00b22c0 msgr2=0x7f25a00716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a00b22c0 0x7f25a00716c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f25980097a0 tx=0x7f259802a180 comp rx=0 tx=0).stop 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 -- 172.21.15.181:0/826524217 shutdown_connections 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a00b22c0 0x7f25a00716c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/826524217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00cdfc0 0x7f25a00b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 -- 172.21.15.181:0/826524217 >> 172.21.15.181:0/826524217 conn(0x7f25a006bc10 msgr2=0x7f25a006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 -- 172.21.15.181:0/826524217 shutdown_connections 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.879+0000 7f25a6e5e640 1 -- 172.21.15.181:0/826524217 wait complete. 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.881+0000 7f25a6e5e640 1 Processor -- start 2024-09-12T02:33:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.881+0000 7f25a6e5e640 1 -- start start 2024-09-12T02:33:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.881+0000 7f25a6e5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00b22c0 0x7f25a013d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.881+0000 7f25a6e5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25a00cdfc0 0x7f25a0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.881+0000 7f25a6e5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a015b1e0 0x7f25a0152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a6e5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0071130 con 0x7f25a00cdfc0 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a6e5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f25a015b5c0 con 0x7f25a015b1e0 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a6e5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f25a0071c00 con 0x7f25a00b22c0 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25a00cdfc0 0x7f25a0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25a00cdfc0 0x7f25a0150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52208/0 (socket says 172.21.15.181:52208) 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 -- 172.21.15.181:0/3243249966 learned_addr learned my addr 172.21.15.181:0/3243249966 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a53fb640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a015b1e0 0x7f25a0152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a4bfa640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00b22c0 0x7f25a013d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 -- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00b22c0 msgr2=0x7f25a013d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00b22c0 0x7f25a013d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 -- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a015b1e0 msgr2=0x7f25a0152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a015b1e0 0x7f25a0152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 -- 172.21.15.181:0/3243249966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a013ded0 con 0x7f25a00cdfc0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a4bfa640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00b22c0 0x7f25a013d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259ffff640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25a00cdfc0 0x7f25a0150590 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2594009f60 tx=0x7f2594009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259d7fa640 1 -- 172.21.15.181:0/3243249966 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594018020 con 0x7f25a00cdfc0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259d7fa640 1 -- 172.21.15.181:0/3243249966 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594014680 con 0x7f25a00cdfc0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a0151050 con 0x7f25a00cdfc0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f259d7fa640 1 -- 172.21.15.181:0/3243249966 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594014a50 con 0x7f25a00cdfc0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.882+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a0151610 con 0x7f25a00cdfc0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.883+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a00716c0 con 0x7f25a00cdfc0 2024-09-12T02:33:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.884+0000 7f259d7fa640 1 -- 172.21.15.181:0/3243249966 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2594005d10 con 0x7f25a00cdfc0 2024-09-12T02:33:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.884+0000 7f259d7fa640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f258c06be60 0x7f258c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.884+0000 7f259d7fa640 1 -- 172.21.15.181:0/3243249966 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f259408baf0 con 0x7f25a00cdfc0 2024-09-12T02:33:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.884+0000 7f25a4bfa640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f258c06be60 0x7f258c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.885+0000 7f25a4bfa640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f258c06be60 0x7f258c06e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2590000f60 tx=0x7f2590009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:28.889+0000 7f259d7fa640 1 -- 172.21.15.181:0/3243249966 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2594022030 con 0x7f25a00cdfc0 2024-09-12T02:33:29.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.086+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25a0153dd0 con 0x7f25a00cdfc0 2024-09-12T02:33:29.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.087+0000 7f259d7fa640 1 -- 172.21.15.181:0/3243249966 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5232 (secure 0 0 0) 0x7f2594010040 con 0x7f25a00cdfc0 2024-09-12T02:33:29.088 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:29.088 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":40,"btime":"2024-09-12T02:33:27:099622+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2505607206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2505607206},{"type":"v1","addr":"172.21.15.181:6837","nonce":2505607206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/1808682347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1808682347},{"type":"v1","addr":"172.21.15.204:6834","nonce":1808682347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:33:26.432148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6144]},"id":4}]} 2024-09-12T02:33:29.089 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 40 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f258c06be60 msgr2=0x7f258c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f258c06be60 0x7f258c06e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2590000f60 tx=0x7f2590009040 comp rx=0 tx=0).stop 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25a00cdfc0 msgr2=0x7f25a0150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25a00cdfc0 0x7f25a0150590 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2594009f60 tx=0x7f2594009f90 comp rx=0 tx=0).stop 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 shutdown_connections 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f258c06be60 0x7f258c06e320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f25a015b1e0 0x7f25a0152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25a00cdfc0 0x7f25a0150590 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 --2- 172.21.15.181:0/3243249966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25a00b22c0 0x7f25a013d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 >> 172.21.15.181:0/3243249966 conn(0x7f25a006bc10 msgr2=0x7f25a0072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 shutdown_connections 2024-09-12T02:33:29.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.089+0000 7f25a6e5e640 1 -- 172.21.15.181:0/3243249966 wait complete. 2024-09-12T02:33:29.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:33:24.428356+0000', 'modified': '2024-09-12T02:33:26.432148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6144}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6144': {'gid': 6144, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6835/2402478751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6833', 'nonce': 2402478751}, {'type': 'v1', 'addr': '172.21.15.204:6835', 'nonce': 2402478751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6144, 'qdb_cluster': [6144]} 2024-09-12T02:33:29.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:33:29.504 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:33:29.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.606+0000 7f969343c640 1 Processor -- start 2024-09-12T02:33:29.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.606+0000 7f969343c640 1 -- start start 2024-09-12T02:33:29.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f969343c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f968c0cff30 0x7f968c06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f969343c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968c0b61b0 con 0x7f968c0afec0 2024-09-12T02:33:29.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f969343c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968c0b6490 con 0x7f968c156770 2024-09-12T02:33:29.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f969343c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f968c0b6770 con 0x7f968c0cff30 2024-09-12T02:33:29.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f96919d9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f968c0cff30 0x7f968c06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f96909d7640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f968c0afec0 0x7f968c0cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55524/0 (socket says 172.21.15.181:55524) 2024-09-12T02:33:29.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f96919d9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f968c0cff30 0x7f968c06ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49730/0 (socket says 172.21.15.181:49730) 2024-09-12T02:33:29.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f96909d7640 1 -- 172.21.15.181:0/42293888 learned_addr learned my addr 172.21.15.181:0/42293888 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:29.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f96919d9640 1 -- 172.21.15.181:0/42293888 >> v1:172.21.15.204:6789/0 conn(0x7f968c156770 legacy=0x7f968c160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f96919d9640 1 -- 172.21.15.181:0/42293888 >> v1:172.21.15.181:6789/0 conn(0x7f968c0afec0 legacy=0x7f968c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f968bfff640 1 -- 172.21.15.181:0/42293888 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257514809 0 0) 0x7f968c0b61b0 con 0x7f968c0afec0 2024-09-12T02:33:29.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.607+0000 7f96919d9640 1 -- 172.21.15.181:0/42293888 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c160010 con 0x7f968c0cff30 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.608+0000 7f96919d9640 1 --2- 172.21.15.181:0/42293888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0cff30 0x7f968c06ef40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f967c009d90 tx=0x7f967c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990f1580765f6130 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.608+0000 7f968bfff640 1 -- 172.21.15.181:0/42293888 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c007740 con 0x7f968c0cff30 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.608+0000 7f968bfff640 1 -- 172.21.15.181:0/42293888 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c0078e0 con 0x7f968c0cff30 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.608+0000 7f968bfff640 1 -- 172.21.15.181:0/42293888 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c007cb0 con 0x7f968c0cff30 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.608+0000 7f969343c640 1 -- 172.21.15.181:0/42293888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0cff30 msgr2=0x7f968c06ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.608+0000 7f969343c640 1 --2- 172.21.15.181:0/42293888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0cff30 0x7f968c06ef40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f967c009d90 tx=0x7f967c02a660 comp rx=0 tx=0).stop 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.608+0000 7f969343c640 1 -- 172.21.15.181:0/42293888 shutdown_connections 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.609+0000 7f969343c640 1 --2- 172.21.15.181:0/42293888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0cff30 0x7f968c06ef40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.609+0000 7f969343c640 1 -- 172.21.15.181:0/42293888 >> 172.21.15.181:0/42293888 conn(0x7f968c0b1770 msgr2=0x7f968c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.609+0000 7f969343c640 1 -- 172.21.15.181:0/42293888 shutdown_connections 2024-09-12T02:33:29.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.609+0000 7f969343c640 1 -- 172.21.15.181:0/42293888 wait complete. 2024-09-12T02:33:29.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 Processor -- start 2024-09-12T02:33:29.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 -- start start 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0afec0 0x7f968c151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968c0cff30 0x7f968c15f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968c156770 0x7f968c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0b04d0 con 0x7f968c0afec0 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0b0350 con 0x7f968c0cff30 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.610+0000 7f969343c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f968c0b0650 con 0x7f968c156770 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0afec0 0x7f968c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0afec0 0x7f968c151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49746/0 (socket says 172.21.15.181:49746) 2024-09-12T02:33:29.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 -- 172.21.15.181:0/2771641491 learned_addr learned my addr 172.21.15.181:0/2771641491 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96909d7640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968c0cff30 0x7f968c15f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96919d9640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968c156770 0x7f968c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 -- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968c156770 msgr2=0x7f968c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968c156770 0x7f968c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 -- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968c0cff30 msgr2=0x7f968c15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968c0cff30 0x7f968c15f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 -- 172.21.15.181:0/2771641491 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c151cd0 con 0x7f968c0afec0 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96919d9640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968c156770 0x7f968c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f96911d8640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0afec0 0x7f968c151790 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f968400c430 tx=0x7f968400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f9689ffb640 1 -- 172.21.15.181:0/2771641491 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684017070 con 0x7f968c0afec0 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f9689ffb640 1 -- 172.21.15.181:0/2771641491 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96840052d0 con 0x7f968c0afec0 2024-09-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c0cd6b0 con 0x7f968c0afec0 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f9689ffb640 1 -- 172.21.15.181:0/2771641491 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684003830 con 0x7f968c0afec0 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.611+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c0cdc70 con 0x7f968c0afec0 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.613+0000 7f9689ffb640 1 -- 172.21.15.181:0/2771641491 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f968401a070 con 0x7f968c0afec0 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.613+0000 7f9689ffb640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f967806be60 0x7f967806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.613+0000 7f9689ffb640 1 -- 172.21.15.181:0/2771641491 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f968408a140 con 0x7f968c0afec0 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.613+0000 7f96909d7640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f967806be60 0x7f967806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.614+0000 7f96909d7640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f967806be60 0x7f967806e320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9680007f70 tx=0x7f9680007f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.614+0000 7f96961d5740 1 Processor -- start 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.614+0000 7f96961d5740 1 -- start start 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b984a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96961d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93ca80 0x55fc7b93f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b940a50 0x55fc7b9398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96961d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fc7b8a1520 con 0x55fc7b93ca80 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55fc7b8493e0 con 0x55fc7b940a50 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55fc7b89d4e0 con 0x55fc7b93f2c0 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93ca80 0x55fc7b93f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93ca80 0x55fc7b93f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49750/0 (socket says 172.21.15.181:49750) 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 -- 172.21.15.181:0/574718561 learned_addr learned my addr 172.21.15.181:0/574718561 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96911d8640 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b984a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96919d9640 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b940a50 0x55fc7b9398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 -- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 msgr2=0x55fc7b984a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b984a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 -- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b940a50 msgr2=0x55fc7b9398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b940a50 0x55fc7b9398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 -- 172.21.15.181:0/574718561 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7b8642f0 con 0x55fc7b93ca80 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96911d8640 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b984a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.615+0000 7f96909d7640 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93ca80 0x55fc7b93f6a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9680004f70 tx=0x7f9680013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2647bcecc66a4c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f9672ffd640 1 -- 172.21.15.181:0/574718561 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680026070 con 0x55fc7b93ca80 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f9672ffd640 1 -- 172.21.15.181:0/574718561 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9680001d10 con 0x55fc7b93ca80 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f9672ffd640 1 -- 172.21.15.181:0/574718561 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680013d80 con 0x55fc7b93ca80 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 -- 172.21.15.181:0/574718561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93ca80 msgr2=0x55fc7b93f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93ca80 0x55fc7b93f6a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9680004f70 tx=0x7f9680013000 comp rx=0 tx=0).stop 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 -- 172.21.15.181:0/574718561 shutdown_connections 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b940a50 0x55fc7b9398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93ca80 0x55fc7b93f6a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 --2- 172.21.15.181:0/574718561 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b984a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 -- 172.21.15.181:0/574718561 >> 172.21.15.181:0/574718561 conn(0x55fc7b93ba80 msgr2=0x55fc7b983f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 -- 172.21.15.181:0/574718561 shutdown_connections 2024-09-12T02:33:29.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.616+0000 7f96961d5740 1 -- 172.21.15.181:0/574718561 wait complete. 2024-09-12T02:33:29.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.617+0000 7f96961d5740 1 -- start start 2024-09-12T02:33:29.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.617+0000 7f96961d5740 1 Processor -- start 2024-09-12T02:33:29.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93f2c0 0x55fc7b95d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b940a50 0x55fc7b95f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93d790 0x55fc7b93dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fc7b93af20 con 0x55fc7b940a50 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55fc7b82a450 con 0x55fc7b93f2c0 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55fc7b985290 con 0x55fc7b93d790 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 10 client.0 _ll_register_callbacks cb 0x55fc7b5b3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b940a50 0x55fc7b95f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b940a50 0x55fc7b95f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49754/0 (socket says 172.21.15.181:49754) 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 -- 172.21.15.181:0/1980493024 learned_addr learned my addr 172.21.15.181:0/1980493024 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96919d9640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93d790 0x55fc7b93dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96911d8640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93f2c0 0x55fc7b95d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 -- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93d790 msgr2=0x55fc7b93dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93d790 0x55fc7b93dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 -- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93f2c0 msgr2=0x55fc7b95d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93f2c0 0x55fc7b95d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 -- 172.21.15.181:0/1980493024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc7b5b42d0 con 0x55fc7b940a50 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96911d8640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93f2c0 0x55fc7b95d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96909d7640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b940a50 0x55fc7b95f800 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9680021660 tx=0x7f9680007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee096a97a04fce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f966bfff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f966bfff640 1 -- 172.21.15.181:0/1980493024 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680032060 con 0x55fc7b940a50 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f966bfff640 1 -- 172.21.15.181:0/1980493024 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9680021a50 con 0x55fc7b940a50 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.618+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9680001d10 con 0x55fc7b940a50 2024-09-12T02:33:29.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f966bfff640 1 -- 172.21.15.181:0/1980493024 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f9680038050 con 0x55fc7b940a50 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 10 client.6261 fetch_fsmap learned FSMap version 40 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55fc7b67e6b0 con 0x55fc7b940a50 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f966bfff640 1 -- 172.21.15.181:0/1980493024 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9680001d10 con 0x55fc7b940a50 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f966bfff640 1 -- 172.21.15.181:0/1980493024 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f968003b020 con 0x55fc7b940a50 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 10 client.6261 fetch_fsmap finished waiting for FSMap version 40 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 10 client.6261 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 20 client.6261 populate_metadata read hostname 'smithi181' 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b9388d0 0x55fc7b938cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 4 client.6261 mds_command: new command op to 6144 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 --> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc7b8aec50 con 0x55fc7b9388d0 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.619+0000 7f96911d8640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b9388d0 0x55fc7b938cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96911d8640 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b9388d0 0x55fc7b938cb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44c70c39bcf58bb server_cookie=668de8d7c32d463b in_seq=0 out_seq=0 2024-09-12T02:33:29.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f966bfff640 10 client.6261 ms_handle_connect on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f966bfff640 1 -- 172.21.15.181:0/1980493024 <== mds.0 v2:172.21.15.204:6833/2402478751 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc7b8aec50 con 0x55fc7b9388d0 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f966bfff640 10 client.6261 handle_command_reply: tid=0 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 client.6261 shutdown 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b940a50 msgr2=0x55fc7b95f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b940a50 0x55fc7b95f800 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9680021660 tx=0x7f9680007d10 comp rx=0 tx=0).stop 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 shutdown_connections 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b9388d0 0x55fc7b938cb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f966bfff640 0 client.6261 ms_handle_reset on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93d790 0x55fc7b93dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b940a50 0x55fc7b95f800 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.620+0000 7f96961d5740 1 --2- 172.21.15.181:0/1980493024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93f2c0 0x55fc7b95d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.621+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 >> 172.21.15.181:0/1980493024 conn(0x55fc7b93ca80 msgr2=0x55fc7b983750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.621+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 shutdown_connections 2024-09-12T02:33:29.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.621+0000 7f96961d5740 1 -- 172.21.15.181:0/1980493024 wait complete. 2024-09-12T02:33:29.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.621+0000 7f96961d5740 20 client.6261 trim_cache size 0 max 16384 2024-09-12T02:33:29.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.638+0000 7f96961d5740 1 Processor -- start 2024-09-12T02:33:29.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.638+0000 7f96961d5740 1 -- start start 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b9388d0 0x55fc7b981fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93d790 0x55fc7b9680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96961d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93f2c0 0x55fc7b968620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96961d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1ff840 con 0x55fc7b93f2c0 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0af6f0 con 0x55fc7b93d790 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f968c159c40 con 0x55fc7b9388d0 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93f2c0 0x55fc7b968620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93f2c0 0x55fc7b968620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49758/0 (socket says 172.21.15.181:49758) 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 -- 172.21.15.181:0/2513534792 learned_addr learned my addr 172.21.15.181:0/2513534792 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96909d7640 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93d790 0x55fc7b9680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96911d8640 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b9388d0 0x55fc7b981fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 -- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b9388d0 msgr2=0x55fc7b981fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b9388d0 0x55fc7b981fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 -- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93d790 msgr2=0x55fc7b9680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93d790 0x55fc7b9680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.639+0000 7f96919d9640 1 -- 172.21.15.181:0/2513534792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7b95dd30 con 0x55fc7b93f2c0 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96919d9640 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93f2c0 0x55fc7b968620 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f967c007300 tx=0x7f967c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802acb23f25431c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96727fc640 1 -- 172.21.15.181:0/2513534792 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c003e20 con 0x55fc7b93f2c0 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96727fc640 1 -- 172.21.15.181:0/2513534792 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c004040 con 0x55fc7b93f2c0 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96727fc640 1 -- 172.21.15.181:0/2513534792 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c004430 con 0x55fc7b93f2c0 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 -- 172.21.15.181:0/2513534792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93f2c0 msgr2=0x55fc7b968620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93f2c0 0x55fc7b968620 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f967c007300 tx=0x7f967c02e000 comp rx=0 tx=0).stop 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 -- 172.21.15.181:0/2513534792 shutdown_connections 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b93d790 0x55fc7b9680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93f2c0 0x55fc7b968620 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 --2- 172.21.15.181:0/2513534792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b9388d0 0x55fc7b981fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 -- 172.21.15.181:0/2513534792 >> 172.21.15.181:0/2513534792 conn(0x55fc7b93ca80 msgr2=0x55fc7b95cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 -- 172.21.15.181:0/2513534792 shutdown_connections 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.640+0000 7f96961d5740 1 -- 172.21.15.181:0/2513534792 wait complete. 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.641+0000 7f96961d5740 1 -- start start 2024-09-12T02:33:29.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.641+0000 7f96961d5740 1 Processor -- start 2024-09-12T02:33:29.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b9388d0 0x55fc7b993460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96961d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93d790 0x55fc7b983540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96961d5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b983a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96961d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fc7b969970 con 0x55fc7b93d790 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55fc7b9693b0 con 0x55fc7b9388d0 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96961d5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55fc7b968cb0 con 0x55fc7b93f2c0 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96961d5740 10 client.0 _ll_register_callbacks cb 0x7f9680024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93d790 0x55fc7b983540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93d790 0x55fc7b983540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49764/0 (socket says 172.21.15.181:49764) 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 -- 172.21.15.181:0/3820612459 learned_addr learned my addr 172.21.15.181:0/3820612459 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96911d8640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b9388d0 0x55fc7b993460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96919d9640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b983a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 -- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 msgr2=0x55fc7b983a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b983a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 -- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b9388d0 msgr2=0x55fc7b993460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b9388d0 0x55fc7b993460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 -- 172.21.15.181:0/3820612459 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc7b964260 con 0x55fc7b93d790 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96919d9640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b983a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f96909d7640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93d790 0x55fc7b983540 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9680000f60 tx=0x7f968001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580589cd471f5eca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f966bfff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.642+0000 7f966bfff640 1 -- 172.21.15.181:0/3820612459 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680040020 con 0x55fc7b93d790 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f966bfff640 1 -- 172.21.15.181:0/3820612459 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f968002d880 con 0x55fc7b93d790 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f967c004040 con 0x55fc7b93d790 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f966bfff640 1 -- 172.21.15.181:0/3820612459 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f968004a050 con 0x55fc7b93d790 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 10 client.6267 fetch_fsmap learned FSMap version 40 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55fc7ba02f70 con 0x55fc7b93d790 2024-09-12T02:33:29.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f966bfff640 1 -- 172.21.15.181:0/3820612459 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c004040 con 0x55fc7b93d790 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f966bfff640 1 -- 172.21.15.181:0/3820612459 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f968004d020 con 0x55fc7b93d790 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 10 client.6267 fetch_fsmap finished waiting for FSMap version 40 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 10 client.6267 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 20 client.6267 populate_metadata read hostname 'smithi181' 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b940a50 0x55fc7ba02750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 4 client.6267 mds_command: new command op to 6144 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 --> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] -- command(tid 0: {"prefix": "status"}) -- 0x55fc7b8a8fa0 con 0x55fc7b940a50 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.643+0000 7f96911d8640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b940a50 0x55fc7ba02750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f966bfff640 10 client.6267 ms_handle_connect on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96911d8640 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b940a50 0x55fc7ba02750 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cacdc2c66a294165 server_cookie=81070cd3e79cc2e in_seq=0 out_seq=0 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f966bfff640 1 -- 172.21.15.181:0/3820612459 <== mds.0 v2:172.21.15.204:6833/2402478751 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55fc7b8a8fa0 con 0x55fc7b940a50 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f966bfff640 10 client.6267 handle_command_reply: tid=0 2024-09-12T02:33:29.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 client.6267 shutdown 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93d790 msgr2=0x55fc7b983540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93d790 0x55fc7b983540 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9680000f60 tx=0x7f968001e000 comp rx=0 tx=0).stop 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 shutdown_connections 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55fc7b940a50 0x55fc7ba02750 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55fc7b93f2c0 0x55fc7b983a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fc7b93d790 0x55fc7b983540 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 --2- 172.21.15.181:0/3820612459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55fc7b9388d0 0x55fc7b993460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f966bfff640 0 client.6267 ms_handle_reset on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 >> 172.21.15.181:0/3820612459 conn(0x55fc7b93ca80 msgr2=0x55fc7b981fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 shutdown_connections 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 1 -- 172.21.15.181:0/3820612459 wait complete. 2024-09-12T02:33:29.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.644+0000 7f96961d5740 20 client.6267 trim_cache size 0 max 16384 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6144, 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 4.561610076, 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 40, 2024-09-12T02:33:29.653 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 60, 2024-09-12T02:33:29.654 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 60, 2024-09-12T02:33:29.654 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 9.5423997919999994 2024-09-12T02:33:29.654 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f967806be60 msgr2=0x7f967806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f967806be60 0x7f967806e320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9680007f70 tx=0x7f9680007f00 comp rx=0 tx=0).stop 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0afec0 msgr2=0x7f968c151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0afec0 0x7f968c151790 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f968400c430 tx=0x7f968400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 shutdown_connections 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f967806be60 0x7f967806e320 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f968c0cff30 0x7f968c15f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f968c156770 0x7f968c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 --2- 172.21.15.181:0/2771641491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968c0afec0 0x7f968c151790 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 >> 172.21.15.181:0/2771641491 conn(0x7f968c0b1770 msgr2=0x7f968c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 shutdown_connections 2024-09-12T02:33:29.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.645+0000 7f969343c640 1 -- 172.21.15.181:0/2771641491 wait complete. 2024-09-12T02:33:29.657 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:33:29.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.755+0000 7f71b25e4640 1 Processor -- start 2024-09-12T02:33:29.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.755+0000 7f71b25e4640 1 -- start start 2024-09-12T02:33:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71b25e4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71ac162660 0x7f71ac0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71b25e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0af940 0x7f71ac0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71b25e4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ac0cf870 con 0x7f71ac162280 2024-09-12T02:33:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71b25e4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac0b02f0 con 0x7f71ac162660 2024-09-12T02:33:29.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71b25e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac0cfb50 con 0x7f71ac0af940 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71b0b81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0af940 0x7f71ac0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71ab7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71ac162660 0x7f71ac0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71abfff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f71ac162280 0x7f71ac0ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:45578/0 (socket says 172.21.15.181:45578) 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.756+0000 7f71abfff640 1 -- 172.21.15.181:0/2085815187 learned_addr learned my addr 172.21.15.181:0/2085815187 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71aaffd640 1 -- 172.21.15.181:0/2085815187 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703616629 0 0) 0x7f71ac0cf870 con 0x7f71ac162280 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71aaffd640 1 -- 172.21.15.181:0/2085815187 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7194003520 con 0x7f71ac162280 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71ab7fe640 1 -- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0af940 msgr2=0x7f71ac0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71ab7fe640 1 --2- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0af940 0x7f71ac0afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71ab7fe640 1 -- 172.21.15.181:0/2085815187 >> v1:172.21.15.204:6789/0 conn(0x7f71ac162280 legacy=0x7f71ac0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71ab7fe640 1 -- 172.21.15.181:0/2085815187 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac0cfe30 con 0x7f71ac162660 2024-09-12T02:33:29.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71b0b81640 1 --2- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0af940 0x7f71ac0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:29.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.757+0000 7f71ab7fe640 1 --2- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac162660 0x7f71ac0cf290 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f71a00097a0 tx=0x7f71a002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44bd4c573cc9e341 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71aaffd640 1 -- 172.21.15.181:0/2085815187 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0037070 con 0x7f71ac162660 2024-09-12T02:33:29.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71aaffd640 1 -- 172.21.15.181:0/2085815187 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a0032440 con 0x7f71ac162660 2024-09-12T02:33:29.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71aaffd640 1 -- 172.21.15.181:0/2085815187 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0032810 con 0x7f71ac162660 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 -- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac162660 msgr2=0x7f71ac0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac162660 0x7f71ac0cf290 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f71a00097a0 tx=0x7f71a002a180 comp rx=0 tx=0).stop 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 -- 172.21.15.181:0/2085815187 shutdown_connections 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0af940 0x7f71ac0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2085815187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac162660 0x7f71ac0cf290 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 -- 172.21.15.181:0/2085815187 >> 172.21.15.181:0/2085815187 conn(0x7f71ac0b1770 msgr2=0x7f71ac0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 -- 172.21.15.181:0/2085815187 shutdown_connections 2024-09-12T02:33:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.758+0000 7f71b25e4640 1 -- 172.21.15.181:0/2085815187 wait complete. 2024-09-12T02:33:29.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.759+0000 7f71b25e4640 1 Processor -- start 2024-09-12T02:33:29.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71b25e4640 1 -- start start 2024-09-12T02:33:29.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71b25e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0af940 0x7f71ac071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71b25e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac162280 0x7f71ac15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71b25e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac162660 0x7f71ac15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71b25e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac154c50 con 0x7f71ac162280 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71b25e4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0d03f0 con 0x7f71ac0af940 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71b25e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac154dd0 con 0x7f71ac162660 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71ab7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac162280 0x7f71ac15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71ab7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac162280 0x7f71ac15ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49766/0 (socket says 172.21.15.181:49766) 2024-09-12T02:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.760+0000 7f71ab7fe640 1 -- 172.21.15.181:0/2016119024 learned_addr learned my addr 172.21.15.181:0/2016119024 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71abfff640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0af940 0x7f71ac071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71b0b81640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac162660 0x7f71ac15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71ab7fe640 1 -- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac162660 msgr2=0x7f71ac15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71ab7fe640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac162660 0x7f71ac15f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71ab7fe640 1 -- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0af940 msgr2=0x7f71ac071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71ab7fe640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0af940 0x7f71ac071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71ab7fe640 1 -- 172.21.15.181:0/2016119024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac143ac0 con 0x7f71ac162280 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71ab7fe640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac162280 0x7f71ac15ee00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f71a0035040 tx=0x7f71a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71a8ff9640 1 -- 172.21.15.181:0/2016119024 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0041030 con 0x7f71ac162280 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71a8ff9640 1 -- 172.21.15.181:0/2016119024 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a003d4e0 con 0x7f71ac162280 2024-09-12T02:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1f3de0 con 0x7f71ac162280 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71a8ff9640 1 -- 172.21.15.181:0/2016119024 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0037040 con 0x7f71ac162280 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.761+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1f43a0 con 0x7f71ac162280 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.762+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac0afdb0 con 0x7f71ac162280 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.763+0000 7f71a8ff9640 1 -- 172.21.15.181:0/2016119024 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71a0044070 con 0x7f71ac162280 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.763+0000 7f71a8ff9640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.763+0000 7f71a8ff9640 1 -- 172.21.15.181:0/2016119024 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f71a00ab4d0 con 0x7f71ac162280 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.763+0000 7f71abfff640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.764+0000 7f71abfff640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719806be30 0x7f719806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f719c005880 tx=0x7f719c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.768+0000 7f71a8ff9640 1 -- 172.21.15.181:0/2016119024 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71a0044e40 con 0x7f71ac162280 2024-09-12T02:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.968+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f71ac0b6560 con 0x7f71ac162280 2024-09-12T02:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.968+0000 7f71a8ff9640 1 -- 172.21.15.181:0/2016119024 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7f71a00a9e20 con 0x7f71ac162280 2024-09-12T02:33:29.969 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:33:29.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719806be30 msgr2=0x7f719806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719806be30 0x7f719806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f719c005880 tx=0x7f719c009040 comp rx=0 tx=0).stop 2024-09-12T02:33:29.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac162280 msgr2=0x7f71ac15ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:29.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac162280 0x7f71ac15ee00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f71a0035040 tx=0x7f71a00046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 shutdown_connections 2024-09-12T02:33:29.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac162660 0x7f71ac15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac162280 0x7f71ac15ee00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 --2- 172.21.15.181:0/2016119024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0af940 0x7f71ac071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:29.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 >> 172.21.15.181:0/2016119024 conn(0x7f71ac0b1770 msgr2=0x7f71ac0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:29.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 shutdown_connections 2024-09-12T02:33:29.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:29.970+0000 7f71b25e4640 1 -- 172.21.15.181:0/2016119024 wait complete. 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:33:29.982 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:33:29.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:29.983 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:33:29.998 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:33:29.999 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42433sec preferred_lft 42433sec 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:33:30.000 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:33:30.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:30.002 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:33:30.062 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:33:30.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:30.064 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:33:30.120 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:33:30.120 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:33:30.120 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:33:30.120 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:33:30.120 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:33:30.120 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:33:30.121 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:33:30.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:33:30.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:33:30.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:33:30.121 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:33:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:33:30.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:33:30.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:30.246 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:33:30.263 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:33:30.263 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:33:30.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:30.263 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:33:30.328 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:33:30.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:33:30.329 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:33:30.384 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:33:30.384 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:33:30.384 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:33:30.441 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:33:30.506 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:33:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:33:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:33:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:33:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:33:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:33:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:33:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:33:30.563 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:33:30.564 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:33:30.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:30.565 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:33:30.618 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:33:30.618 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:33:30.661 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:33:30.686 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:33:30.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:33:30.741+0000 7f5d9b3d8480 -1 init, newargv = 0x5606aedc1940 newargc=15 2024-09-12T02:33:30.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[57683]: starting ceph client 2024-09-12T02:33:30.743 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:33:30.743 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:33:30.743 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:33:30.743 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:33:30.743 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:33:30.745 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:33:30.746 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:33:30.746 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:33:30.746 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:33:30.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:30.746 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:33:30.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[57683]: starting fuse 2024-09-12T02:33:30.761 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:33:30.761 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:33:30.762 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:33:30.763 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:33:30.879 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.57683.asok 2024-09-12T02:33:30.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:33:30.889 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57683.asok 2024-09-12T02:33:30.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:30.890 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57683.asok status 2024-09-12T02:33:31.023 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:33:31.023 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "57683", 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6279, 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:33:31.024 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 6279 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 662317911 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:33:31.025 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 662317911 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.6279 192.168.0.1:0/662317911", 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/662317911", 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 40, 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 60, 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:33:31.026 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:33:31.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:31.032 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:33:31.032 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:33:31.047 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:33:31.047 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:33:31.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:31.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:33:31.071 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-09-12T02:33:31.071+0000 7f3615ddd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:33:31.113 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-12T02:33:31.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.254+0000 7f1105da8640 1 Processor -- start 2024-09-12T02:33:31.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.254+0000 7f1105da8640 1 -- start start 2024-09-12T02:33:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f1105da8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f110015e640 0x7f11000b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f1105da8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f11000d4710 0x7f11000d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f1105da8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11000b39d0 con 0x7f11000cef60 2024-09-12T02:33:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f1105da8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f11000cf520 con 0x7f110015e640 2024-09-12T02:33:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f1105da8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f11000cf800 con 0x7f11000d4710 2024-09-12T02:33:31.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10ff7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f110015e640 0x7f11000b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10ff7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f110015e640 0x7f11000b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49770/0 (socket says 172.21.15.181:49770) 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10ff7fe640 1 -- 172.21.15.181:0/438890764 learned_addr learned my addr 172.21.15.181:0/438890764 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10fffff640 1 --2- 172.21.15.181:0/438890764 >> v2:172.21.15.204:3300/0 conn(0x7f11000d4710 0x7f11000d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10ff7fe640 1 -- 172.21.15.181:0/438890764 >> v2:172.21.15.204:3300/0 conn(0x7f11000d4710 msgr2=0x7f11000d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10ff7fe640 1 --2- 172.21.15.181:0/438890764 >> v2:172.21.15.204:3300/0 conn(0x7f11000d4710 0x7f11000d4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10ff7fe640 1 -- 172.21.15.181:0/438890764 >> v1:172.21.15.204:6789/0 conn(0x7f11000cef60 legacy=0x7f11000d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.255+0000 7f10ff7fe640 1 -- 172.21.15.181:0/438890764 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11000cfae0 con 0x7f110015e640 2024-09-12T02:33:31.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f10ff7fe640 1 --2- 172.21.15.181:0/438890764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110015e640 0x7f11000b3bf0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f11000d1a20 tx=0x7f10f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0a788a8ab96d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f10fe7fc640 1 -- 172.21.15.181:0/438890764 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0037070 con 0x7f110015e640 2024-09-12T02:33:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f10fe7fc640 1 -- 172.21.15.181:0/438890764 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f0032440 con 0x7f110015e640 2024-09-12T02:33:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f10fe7fc640 1 -- 172.21.15.181:0/438890764 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0032810 con 0x7f110015e640 2024-09-12T02:33:31.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 -- 172.21.15.181:0/438890764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110015e640 msgr2=0x7f11000b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 --2- 172.21.15.181:0/438890764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110015e640 0x7f11000b3bf0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f11000d1a20 tx=0x7f10f002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 -- 172.21.15.181:0/438890764 shutdown_connections 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 --2- 172.21.15.181:0/438890764 >> v2:172.21.15.204:3300/0 conn(0x7f11000d4710 0x7f11000d4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 --2- 172.21.15.181:0/438890764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110015e640 0x7f11000b3bf0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 -- 172.21.15.181:0/438890764 >> 172.21.15.181:0/438890764 conn(0x7f1100067d70 msgr2=0x7f1100068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 -- 172.21.15.181:0/438890764 shutdown_connections 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.256+0000 7f1105da8640 1 -- 172.21.15.181:0/438890764 wait complete. 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 Processor -- start 2024-09-12T02:33:31.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 -- start start 2024-09-12T02:33:31.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11000cef60 0x7f1100150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11000d4710 0x7f11000c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f110015e640 0x7f11000cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f110015ea20 con 0x7f11000cef60 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f11000d5050 con 0x7f11000d4710 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.258+0000 7f1105da8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11000d3590 con 0x7f110015e640 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11000cef60 0x7f1100150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11000cef60 0x7f1100150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49776/0 (socket says 172.21.15.181:49776) 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 -- 172.21.15.181:0/3576404043 learned_addr learned my addr 172.21.15.181:0/3576404043 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10feffd640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11000d4710 0x7f11000c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10fffff640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f110015e640 0x7f11000cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 -- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f110015e640 msgr2=0x7f11000cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f110015e640 0x7f11000cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 -- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11000d4710 msgr2=0x7f11000c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11000d4710 0x7f11000c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 -- 172.21.15.181:0/3576404043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11000c8620 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10fffff640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f110015e640 0x7f11000cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10ff7fe640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11000cef60 0x7f1100150d70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f10f0000c00 tx=0x7f10f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10e7fff640 1 -- 172.21.15.181:0/3576404043 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0041020 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10e7fff640 1 -- 172.21.15.181:0/3576404043 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f00306c0 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f10e7fff640 1 -- 172.21.15.181:0/3576404043 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0037040 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11000c8900 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.259+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11000c8ec0 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.260+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1100069ac0 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.261+0000 7f10e7fff640 1 -- 172.21.15.181:0/3576404043 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10f0044020 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.261+0000 7f10e7fff640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10ec06be30 0x7f10ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.261+0000 7f10e7fff640 1 -- 172.21.15.181:0/3576404043 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f10f00ab5d0 con 0x7f11000cef60 2024-09-12T02:33:31.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.261+0000 7f10feffd640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10ec06be30 0x7f10ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.262+0000 7f10feffd640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10ec06be30 0x7f10ec06e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.265+0000 7f10e7fff640 1 -- 172.21.15.181:0/3576404043 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1100069ac0 con 0x7f11000cef60 2024-09-12T02:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:31.463+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f11000d4b10 con 0x7f11000cef60 2024-09-12T02:33:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.124+0000 7f10e7fff640 1 -- 172.21.15.181:0/3576404043 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v41) ==== 105+0+0 (secure 0 0 0) 0x7f10f004b030 con 0x7f11000cef60 2024-09-12T02:33:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10ec06be30 msgr2=0x7f10ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10ec06be30 0x7f10ec06e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4009060 comp rx=0 tx=0).stop 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11000cef60 msgr2=0x7f1100150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11000cef60 0x7f1100150d70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f10f0000c00 tx=0x7f10f00046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 shutdown_connections 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10ec06be30 0x7f10ec06e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11000d4710 0x7f11000c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f110015e640 0x7f11000cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 --2- 172.21.15.181:0/3576404043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11000cef60 0x7f1100150d70 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.126+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 >> 172.21.15.181:0/3576404043 conn(0x7f1100067d70 msgr2=0x7f11000b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.127+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 shutdown_connections 2024-09-12T02:33:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.127+0000 7f1105da8640 1 -- 172.21.15.181:0/3576404043 wait complete. 2024-09-12T02:33:32.142 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:32.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.241+0000 7f5eddbd6640 1 Processor -- start 2024-09-12T02:33:32.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.241+0000 7f5eddbd6640 1 -- start start 2024-09-12T02:33:32.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5eddbd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed8070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5eddbd6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5ed80cef50 0x7f5ed815f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5eddbd6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed80cf400 con 0x7f5ed80ceaf0 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5eddbd6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed80d0040 con 0x7f5ed80cef50 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5eddbd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed8072f80 con 0x7f5ed815e670 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5ed7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5ed80cef50 0x7f5ed815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5ed77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5ed7fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5ed80cef50 0x7f5ed815f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:47964/0 (socket says 172.21.15.181:47964) 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5ed7fff640 1 -- 172.21.15.181:0/2907674251 learned_addr learned my addr 172.21.15.181:0/2907674251 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.242+0000 7f5ed6ffd640 1 --1- 172.21.15.181:0/2907674251 >> v1:172.21.15.204:6789/0 conn(0x7f5ed80ceaf0 0x7f5ed815ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:45600/0 (socket says 172.21.15.181:45600) 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.243+0000 7f5ed7fff640 1 -- 172.21.15.181:0/2907674251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 msgr2=0x7f5ed8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:32.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.243+0000 7f5ed7fff640 1 --2- 172.21.15.181:0/2907674251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed8070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.243+0000 7f5ed7fff640 1 -- 172.21.15.181:0/2907674251 >> v1:172.21.15.204:6789/0 conn(0x7f5ed80ceaf0 legacy=0x7f5ed815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.243+0000 7f5ed7fff640 1 -- 172.21.15.181:0/2907674251 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed80731d0 con 0x7f5ed80cef50 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.243+0000 7f5ed7fff640 1 --2- 172.21.15.181:0/2907674251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80cef50 0x7f5ed815f160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009870 tx=0x7f5ed002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a181b55c0f5f9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5ed67fc640 1 -- 172.21.15.181:0/2907674251 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0037070 con 0x7f5ed80cef50 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5ed67fc640 1 -- 172.21.15.181:0/2907674251 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed002ae50 con 0x7f5ed80cef50 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5ed67fc640 1 -- 172.21.15.181:0/2907674251 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0032860 con 0x7f5ed80cef50 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 -- 172.21.15.181:0/2907674251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80cef50 msgr2=0x7f5ed815f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/2907674251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80cef50 0x7f5ed815f160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009870 tx=0x7f5ed002a300 comp rx=0 tx=0).stop 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 -- 172.21.15.181:0/2907674251 shutdown_connections 2024-09-12T02:33:32.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/2907674251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80cef50 0x7f5ed815f160 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/2907674251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed8070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 -- 172.21.15.181:0/2907674251 >> 172.21.15.181:0/2907674251 conn(0x7f5ed806f400 msgr2=0x7f5ed806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:32.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 -- 172.21.15.181:0/2907674251 shutdown_connections 2024-09-12T02:33:32.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.244+0000 7f5eddbd6640 1 -- 172.21.15.181:0/2907674251 wait complete. 2024-09-12T02:33:32.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.245+0000 7f5eddbd6640 1 Processor -- start 2024-09-12T02:33:32.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.245+0000 7f5eddbd6640 1 -- start start 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5eddbd6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80ceaf0 0x7f5ed80b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5eddbd6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed80cef50 0x7f5ed81f8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5eddbd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5eddbd6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed8073790 con 0x7f5ed80cef50 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5eddbd6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed8073de0 con 0x7f5ed80ceaf0 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5eddbd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed8073a70 con 0x7f5ed815e670 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5ed6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed80cef50 0x7f5ed81f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5ed6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed80cef50 0x7f5ed81f8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49788/0 (socket says 172.21.15.181:49788) 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5ed6ffd640 1 -- 172.21.15.181:0/3009626631 learned_addr learned my addr 172.21.15.181:0/3009626631 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.246+0000 7f5ed77fe640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80ceaf0 0x7f5ed80b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ed7fff640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ed6ffd640 1 -- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 msgr2=0x7f5ed815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ed6ffd640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ed6ffd640 1 -- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80ceaf0 msgr2=0x7f5ed80b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ed6ffd640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80ceaf0 0x7f5ed80b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ed6ffd640 1 -- 172.21.15.181:0/3009626631 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed81f8cc0 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ed6ffd640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed80cef50 0x7f5ed81f8780 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c440 tx=0x7f5ecc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ebffff640 1 -- 172.21.15.181:0/3009626631 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0074e0 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ebffff640 1 -- 172.21.15.181:0/3009626631 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc007680 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5ebffff640 1 -- 172.21.15.181:0/3009626631 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc004a20 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed80b4120 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.247+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed80b46e0 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.248+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed80b4da0 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.248+0000 7f5ebffff640 1 -- 172.21.15.181:0/3009626631 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ecc01a020 con 0x7f5ed80cef50 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.249+0000 7f5ebffff640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5ec406be30 0x7f5ec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.249+0000 7f5ed77fe640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5ec406be30 0x7f5ec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.249+0000 7f5ebffff640 1 -- 172.21.15.181:0/3009626631 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f5ecc08a670 con 0x7f5ed80cef50 2024-09-12T02:33:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.250+0000 7f5ed77fe640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5ec406be30 0x7f5ec406e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80073f0 tx=0x7f5ec800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:32.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.253+0000 7f5ebffff640 1 -- 172.21.15.181:0/3009626631 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ed80b4da0 con 0x7f5ed80cef50 2024-09-12T02:33:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.452+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ed8071410 con 0x7f5ed80cef50 2024-09-12T02:33:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.453+0000 7f5ebffff640 1 -- 172.21.15.181:0/3009626631 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5248 (secure 0 0 0) 0x7f5ed81f8cc0 con 0x7f5ed80cef50 2024-09-12T02:33:32.454 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:32.454 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":42,"btime":"2024-09-12T02:33:32:127302+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2505607206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2505607206},{"type":"v1","addr":"172.21.15.181:6837","nonce":2505607206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:33:32.127288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6144,"mds_1":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"d","rank":1,"incarnation":42,"state":"up:creating","state_seq":1,"addr":"172.21.15.204:6834/1808682347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1808682347},{"type":"v1","addr":"172.21.15.204:6834","nonce":1808682347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6144]},"id":4}]} 2024-09-12T02:33:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 42 2024-09-12T02:33:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5ec406be30 msgr2=0x7f5ec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5ec406be30 0x7f5ec406e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80073f0 tx=0x7f5ec800b040 comp rx=0 tx=0).stop 2024-09-12T02:33:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed80cef50 msgr2=0x7f5ed81f8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed80cef50 0x7f5ed81f8780 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c440 tx=0x7f5ecc001e70 comp rx=0 tx=0).stop 2024-09-12T02:33:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 shutdown_connections 2024-09-12T02:33:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5ec406be30 0x7f5ec406e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ed815e670 0x7f5ed815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed80cef50 0x7f5ed81f8780 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 --2- 172.21.15.181:0/3009626631 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed80ceaf0 0x7f5ed80b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 >> 172.21.15.181:0/3009626631 conn(0x7f5ed806f400 msgr2=0x7f5ed815cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 shutdown_connections 2024-09-12T02:33:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:32.455+0000 7f5eddbd6640 1 -- 172.21.15.181:0/3009626631 wait complete. 2024-09-12T02:33:32.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:33:24.428356+0000', 'modified': '2024-09-12T02:33:32.127288+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6144, 'mds_1': 6141}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6141': {'gid': 6141, 'name': 'd', 'rank': 1, 'incarnation': 42, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.204:6834/1808682347', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6832', 'nonce': 1808682347}, {'type': 'v1', 'addr': '172.21.15.204:6834', 'nonce': 1808682347}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6144': {'gid': 6144, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6835/2402478751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6833', 'nonce': 2402478751}, {'type': 'v1', 'addr': '172.21.15.204:6835', 'nonce': 2402478751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6144, 'qdb_cluster': [6144]} 2024-09-12T02:33:32.870 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6141:up:creating 2024-09-12T02:33:33.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:33.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.981+0000 7fb030047640 1 Processor -- start 2024-09-12T02:33:33.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.981+0000 7fb030047640 1 -- start start 2024-09-12T02:33:33.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb030047640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 0x7fb02815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb030047640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0280b2820 con 0x7fb0280d08f0 2024-09-12T02:33:33.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb030047640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0280b2b00 con 0x7fb0280d0510 2024-09-12T02:33:33.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb030047640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb028141730 con 0x7fb0280b3800 2024-09-12T02:33:33.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02e5e4640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb0280d08f0 0x7fb028072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55540/0 (socket says 172.21.15.181:55540) 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02e5e4640 1 -- 172.21.15.181:0/3789330403 learned_addr learned my addr 172.21.15.181:0/3789330403 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 818432263 0 0) 0x7fb0280b2820 con 0x7fb0280d08f0 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 0x7fb02815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb014004630 con 0x7fb0280d08f0 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1859479352 0 0) 0x7fb014004630 con 0x7fb0280d08f0 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 msgr2=0x7fb02815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.982+0000 7fb02cde1640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 0x7fb02815ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 >> v1:172.21.15.204:6789/0 conn(0x7fb0280d0510 legacy=0x7fb0280b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:33.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb028144320 con 0x7fb0280d08f0 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fb0200019f0 con 0x7fb0280d08f0 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 0x7fb02815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 >> v1:172.21.15.181:6789/0 conn(0x7fb0280d08f0 legacy=0x7fb028072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014004af0 0x7fb014004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb014005910 0x7fb014005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 0x7fb0140062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb028141730 con 0x7fb014005910 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb014003650 con 0x7fb014004af0 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb014003850 con 0x7fb0280b3800 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb014005910 0x7fb014005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02dde3640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014004af0 0x7fb014004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02e5e4640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 0x7fb0140062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02d5e2640 1 -- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 msgr2=0x7fb0140062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:33.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0280b3800 0x7fb0140062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:33.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02d5e2640 1 -- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014004af0 msgr2=0x7fb014004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:33.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014004af0 0x7fb014004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:33.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.983+0000 7fb02d5e2640 1 -- 172.21.15.181:0/3789330403 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb014004630 con 0x7fb014005910 2024-09-12T02:33:33.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.984+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb014005910 0x7fb014005d90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb01800dab0 tx=0x7fb014006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb10237d74d6db8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:33.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.984+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01800d6b0 con 0x7fb014005910 2024-09-12T02:33:33.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.984+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb018004030 con 0x7fb014005910 2024-09-12T02:33:33.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.984+0000 7fb02cde1640 1 -- 172.21.15.181:0/3789330403 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018004420 con 0x7fb014005910 2024-09-12T02:33:33.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.984+0000 7fb030047640 1 -- 172.21.15.181:0/3789330403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb014005910 msgr2=0x7fb014005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.984+0000 7fb030047640 1 --2- 172.21.15.181:0/3789330403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb014005910 0x7fb014005d90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb01800dab0 tx=0x7fb014006940 comp rx=0 tx=0).stop 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.985+0000 7fb02e5e4640 1 -- 172.21.15.181:0/3789330403 reap_dead start 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.985+0000 7fb030047640 1 -- 172.21.15.181:0/3789330403 shutdown_connections 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.985+0000 7fb030047640 1 -- 172.21.15.181:0/3789330403 >> 172.21.15.181:0/3789330403 conn(0x7fb02806bc10 msgr2=0x7fb02806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.985+0000 7fb030047640 1 -- 172.21.15.181:0/3789330403 shutdown_connections 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.985+0000 7fb030047640 1 -- 172.21.15.181:0/3789330403 wait complete. 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.986+0000 7fb030047640 1 Processor -- start 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.986+0000 7fb030047640 1 -- start start 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014005910 0x7fb02813f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0280ac520 0x7fb028141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb02813fd20 0x7fb028142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb028143bb0 con 0x7fb0280ac520 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb028142eb0 con 0x7fb014005910 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb028143d30 con 0x7fb02813fd20 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0280ac520 0x7fb028141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0280ac520 0x7fb028141b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49802/0 (socket says 172.21.15.181:49802) 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 -- 172.21.15.181:0/4284200323 learned_addr learned my addr 172.21.15.181:0/4284200323 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02dde3640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014005910 0x7fb02813f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02e5e4640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb02813fd20 0x7fb028142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 -- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb02813fd20 msgr2=0x7fb028142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb02813fd20 0x7fb028142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 -- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014005910 msgr2=0x7fb02813f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014005910 0x7fb02813f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 -- 172.21.15.181:0/4284200323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02815c3f0 con 0x7fb0280ac520 2024-09-12T02:33:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02e5e4640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb02813fd20 0x7fb028142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb02d5e2640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0280ac520 0x7fb028141b50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb01800dab0 tx=0x7fb018004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb01e7fc640 1 -- 172.21.15.181:0/4284200323 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018006e10 con 0x7fb0280ac520 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb01e7fc640 1 -- 172.21.15.181:0/4284200323 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb018046070 con 0x7fb0280ac520 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb01e7fc640 1 -- 172.21.15.181:0/4284200323 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0180408e0 con 0x7fb0280ac520 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02815c6d0 con 0x7fb0280ac520 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.987+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02815cc90 con 0x7fb0280ac520 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.988+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb02815ef90 con 0x7fb0280ac520 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.989+0000 7fb01e7fc640 1 -- 172.21.15.181:0/4284200323 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb018040a80 con 0x7fb0280ac520 2024-09-12T02:33:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.989+0000 7fb01e7fc640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb00c06be30 0x7fb00c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.989+0000 7fb02dde3640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb00c06be30 0x7fb00c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.990+0000 7fb01e7fc640 1 -- 172.21.15.181:0/4284200323 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb0180afcc0 con 0x7fb0280ac520 2024-09-12T02:33:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.990+0000 7fb02dde3640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb00c06be30 0x7fb00c06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb024005590 tx=0x7fb024009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:33.994+0000 7fb01e7fc640 1 -- 172.21.15.181:0/4284200323 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb01807e790 con 0x7fb0280ac520 2024-09-12T02:33:34.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.196+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb02815d490 con 0x7fb0280ac520 2024-09-12T02:33:34.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.196+0000 7fb01e7fc640 1 -- 172.21.15.181:0/4284200323 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5251 (secure 0 0 0) 0x7fb01807e090 con 0x7fb0280ac520 2024-09-12T02:33:34.197 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:34.198 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":43,"btime":"2024-09-12T02:33:33:128305+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2505607206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2505607206},{"type":"v1","addr":"172.21.15.181:6837","nonce":2505607206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:33:33.128296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6144,"mds_1":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"d","rank":1,"incarnation":42,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6834/1808682347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1808682347},{"type":"v1","addr":"172.21.15.204:6834","nonce":1808682347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6141,6144]},"id":4}]} 2024-09-12T02:33:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 43 2024-09-12T02:33:34.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb00c06be30 msgr2=0x7fb00c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb00c06be30 0x7fb00c06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb024005590 tx=0x7fb024009040 comp rx=0 tx=0).stop 2024-09-12T02:33:34.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0280ac520 msgr2=0x7fb028141b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0280ac520 0x7fb028141b50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb01800dab0 tx=0x7fb018004730 comp rx=0 tx=0).stop 2024-09-12T02:33:34.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 shutdown_connections 2024-09-12T02:33:34.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb00c06be30 0x7fb00c06e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb02813fd20 0x7fb028142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0280ac520 0x7fb028141b50 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 --2- 172.21.15.181:0/4284200323 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb014005910 0x7fb02813f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 >> 172.21.15.181:0/4284200323 conn(0x7fb02806bc10 msgr2=0x7fb0280b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 shutdown_connections 2024-09-12T02:33:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.199+0000 7fb030047640 1 -- 172.21.15.181:0/4284200323 wait complete. 2024-09-12T02:33:34.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:33:24.428356+0000', 'modified': '2024-09-12T02:33:33.128296+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6144, 'mds_1': 6141}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6141': {'gid': 6141, 'name': 'd', 'rank': 1, 'incarnation': 42, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.204:6834/1808682347', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6832', 'nonce': 1808682347}, {'type': 'v1', 'addr': '172.21.15.204:6834', 'nonce': 1808682347}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6144': {'gid': 6144, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6835/2402478751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6833', 'nonce': 2402478751}, {'type': 'v1', 'addr': '172.21.15.204:6835', 'nonce': 2402478751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6144, 'qdb_cluster': [6141, 6144]} 2024-09-12T02:33:34.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-12T02:33:34.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:33:34.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.714+0000 7fbae364c640 1 Processor -- start 2024-09-12T02:33:34.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.714+0000 7fbae364c640 1 -- start start 2024-09-12T02:33:34.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae364c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae364c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbadc0b2490 0x7fbadc071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae364c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbadc0ce4f0 con 0x7fbadc0cdfc0 2024-09-12T02:33:34.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae364c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fbadc15b6c0 con 0x7fbadc0b2490 2024-09-12T02:33:34.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae364c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc0ce7d0 con 0x7fbadc15b2e0 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae1be9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbadc0b2490 0x7fbadc071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:59730/0 (socket says 172.21.15.181:59730) 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae13e8640 1 -- 172.21.15.181:0/1550034797 learned_addr learned my addr 172.21.15.181:0/1550034797 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae13e8640 1 -- 172.21.15.181:0/1550034797 >> v2:172.21.15.204:3300/0 conn(0x7fbadc0b2490 msgr2=0x7fbadc071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.715+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1550034797 >> v2:172.21.15.204:3300/0 conn(0x7fbadc0b2490 0x7fbadc071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.716+0000 7fbae13e8640 1 -- 172.21.15.181:0/1550034797 >> v1:172.21.15.204:6789/0 conn(0x7fbadc0cdfc0 legacy=0x7fbadc0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.716+0000 7fbae13e8640 1 -- 172.21.15.181:0/1550034797 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc0ceab0 con 0x7fbadc15b2e0 2024-09-12T02:33:34.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.716+0000 7fbae1be9640 1 --2- 172.21.15.181:0/1550034797 >> v2:172.21.15.204:3300/0 conn(0x7fbadc0b2490 0x7fbadc071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:34.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.716+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1550034797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc0b3d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009870 tx=0x7fbad802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c5a9f2d11a7f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.716+0000 7fbad3fff640 1 -- 172.21.15.181:0/1550034797 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8037070 con 0x7fbadc15b2e0 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.716+0000 7fbad3fff640 1 -- 172.21.15.181:0/1550034797 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad8032440 con 0x7fbadc15b2e0 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.716+0000 7fbad3fff640 1 -- 172.21.15.181:0/1550034797 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8032810 con 0x7fbadc15b2e0 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 -- 172.21.15.181:0/1550034797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 msgr2=0x7fbadc0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 --2- 172.21.15.181:0/1550034797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc0b3d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009870 tx=0x7fbad802a270 comp rx=0 tx=0).stop 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 -- 172.21.15.181:0/1550034797 shutdown_connections 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 --2- 172.21.15.181:0/1550034797 >> v2:172.21.15.204:3300/0 conn(0x7fbadc0b2490 0x7fbadc071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 --2- 172.21.15.181:0/1550034797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc0b3d20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 -- 172.21.15.181:0/1550034797 >> 172.21.15.181:0/1550034797 conn(0x7fbadc06bc10 msgr2=0x7fbadc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 -- 172.21.15.181:0/1550034797 shutdown_connections 2024-09-12T02:33:34.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.717+0000 7fbae364c640 1 -- 172.21.15.181:0/1550034797 wait complete. 2024-09-12T02:33:34.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.718+0000 7fbae364c640 1 Processor -- start 2024-09-12T02:33:34.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.718+0000 7fbae364c640 1 -- start start 2024-09-12T02:33:34.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae364c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbadc0b2490 0x7fbadc0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae364c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbadc0cdfc0 0x7fbadc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae364c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae364c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc0712b0 con 0x7fbadc0b2490 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae364c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc071130 con 0x7fbadc0cdfc0 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae364c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc0b4260 con 0x7fbadc15b2e0 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbadc0b2490 0x7fbadc0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbadc0b2490 0x7fbadc0d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49804/0 (socket says 172.21.15.181:49804) 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae13e8640 1 -- 172.21.15.181:0/1336214608 learned_addr learned my addr 172.21.15.181:0/1336214608 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae0be7640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbadc0cdfc0 0x7fbadc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.719+0000 7fbae1be9640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae13e8640 1 -- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 msgr2=0x7fbadc1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc1446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae13e8640 1 -- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbadc0cdfc0 msgr2=0x7fbadc15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbadc0cdfc0 0x7fbadc15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae13e8640 1 -- 172.21.15.181:0/1336214608 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc15dbb0 con 0x7fbadc0b2490 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbadc0b2490 0x7fbadc0d0330 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbad802a2b0 tx=0x7fbad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbad1ffb640 1 -- 172.21.15.181:0/1336214608 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8041030 con 0x7fbadc0b2490 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbad1ffb640 1 -- 172.21.15.181:0/1336214608 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad8030440 con 0x7fbadc0b2490 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbadc15de90 con 0x7fbadc0b2490 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbad1ffb640 1 -- 172.21.15.181:0/1336214608 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8037040 con 0x7fbadc0b2490 2024-09-12T02:33:34.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.720+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbadc15e450 con 0x7fbadc0b2490 2024-09-12T02:33:34.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.722+0000 7fbad1ffb640 1 -- 172.21.15.181:0/1336214608 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbad8044070 con 0x7fbadc0b2490 2024-09-12T02:33:34.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.722+0000 7fbad1ffb640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbac006be60 0x7fbac006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.722+0000 7fbad1ffb640 1 -- 172.21.15.181:0/1336214608 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbad80ab4a0 con 0x7fbadc0b2490 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.722+0000 7fbae0be7640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbac006be60 0x7fbac006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.723+0000 7fbae0be7640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbac006be60 0x7fbac006e320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbadc15d0f0 tx=0x7fbacc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.723+0000 7fbae63e5740 1 Processor -- start 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.723+0000 7fbae63e5740 1 -- start start 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a44a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fca80 0x5610359ff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561035a00a50 0x5610359f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae63e5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561035961520 con 0x5610359ff2c0 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5610359093e0 con 0x5610359fca80 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56103595d4e0 con 0x561035a00a50 2024-09-12T02:33:34.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a44a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a44a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49816/0 (socket says 172.21.15.181:49816) 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 -- 172.21.15.181:0/2168247502 learned_addr learned my addr 172.21.15.181:0/2168247502 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae0be7640 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fca80 0x5610359ff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae1be9640 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561035a00a50 0x5610359f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 -- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561035a00a50 msgr2=0x5610359f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561035a00a50 0x5610359f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 -- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fca80 msgr2=0x5610359ff6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fca80 0x5610359ff6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 -- 172.21.15.181:0/2168247502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610359242f0 con 0x5610359ff2c0 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae1be9640 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561035a00a50 0x5610359f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbae13e8640 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a44a60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbad80a9a00 tx=0x7fbad80790c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5de02ac8dc4e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.724+0000 7fbac6ffd640 1 -- 172.21.15.181:0/2168247502 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8080070 con 0x5610359ff2c0 2024-09-12T02:33:34.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbac6ffd640 1 -- 172.21.15.181:0/2168247502 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad807db10 con 0x5610359ff2c0 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbac6ffd640 1 -- 172.21.15.181:0/2168247502 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8082340 con 0x5610359ff2c0 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 -- 172.21.15.181:0/2168247502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 msgr2=0x561035a44a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a44a60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbad80a9a00 tx=0x7fbad80790c0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 -- 172.21.15.181:0/2168247502 shutdown_connections 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fca80 0x5610359ff6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x561035a00a50 0x5610359f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 --2- 172.21.15.181:0/2168247502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a44a60 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 -- 172.21.15.181:0/2168247502 >> 172.21.15.181:0/2168247502 conn(0x5610359fba80 msgr2=0x561035a43f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 -- 172.21.15.181:0/2168247502 shutdown_connections 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.725+0000 7fbae63e5740 1 -- 172.21.15.181:0/2168247502 wait complete. 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.726+0000 7fbae63e5740 1 -- start start 2024-09-12T02:33:34.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.726+0000 7fbae63e5740 1 Processor -- start 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a1f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a1dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561035961520 con 0x5610359ff2c0 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5610358ea450 con 0x561035a00a50 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5610359faf20 con 0x5610359fe0f0 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 10 client.0 _ll_register_callbacks cb 0x561035673ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a1f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a1f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49818/0 (socket says 172.21.15.181:49818) 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 -- 172.21.15.181:0/3942941708 learned_addr learned my addr 172.21.15.181:0/3942941708 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae0be7640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae1be9640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a1dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 -- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 msgr2=0x561035a1dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a1dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 -- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 msgr2=0x5610359fdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 -- 172.21.15.181:0/3942941708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610356742d0 con 0x5610359ff2c0 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae0be7640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae13e8640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a1f990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009870 tx=0x7fbad8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb11b85c0484a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbabbfff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbabbfff640 1 -- 172.21.15.181:0/3942941708 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad80a9060 con 0x5610359ff2c0 2024-09-12T02:33:34.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbabbfff640 1 -- 172.21.15.181:0/3942941708 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbad803adf0 con 0x5610359ff2c0 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad807db10 con 0x5610359ff2c0 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbabbfff640 1 -- 172.21.15.181:0/3942941708 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fbad8080070 con 0x5610359ff2c0 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 10 client.6303 fetch_fsmap learned FSMap version 43 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.727+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x56103573e6b0 con 0x5610359ff2c0 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbabbfff640 1 -- 172.21.15.181:0/3942941708 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad807db10 con 0x5610359ff2c0 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbabbfff640 1 -- 172.21.15.181:0/3942941708 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 43) ==== 3522+0+0 (secure 0 0 0) 0x7fbad804e060 con 0x5610359ff2c0 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbae63e5740 10 client.6303 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbae63e5740 10 client.6303 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbae63e5740 20 client.6303 populate_metadata read hostname 'smithi181' 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbae63e5740 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x5610359f8c00 0x5610359f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbae63e5740 4 client.6303 mds_command: new command op to 6141 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 --> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56103596ec50 con 0x5610359f8c00 2024-09-12T02:33:34.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.728+0000 7fbae0be7640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x5610359f8c00 0x5610359f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbabbfff640 10 client.6303 ms_handle_connect on v2:172.21.15.204:6832/1808682347 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae0be7640 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x5610359f8c00 0x5610359f8fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6cee221ad84b64c9 server_cookie=7dca8e9d038959a8 in_seq=0 out_seq=0 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbabbfff640 1 -- 172.21.15.181:0/3942941708 <== mds.1 v2:172.21.15.204:6832/1808682347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56103596ec50 con 0x5610359f8c00 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbabbfff640 10 client.6303 handle_command_reply: tid=0 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 client.6303 shutdown 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 msgr2=0x561035a1f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a1f990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009870 tx=0x7fbad8000bc0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 shutdown_connections 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x5610359f8c00 0x5610359f8fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a1dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 --2- 172.21.15.181:0/3942941708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x561035a1f990 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbabbfff640 0 client.6303 ms_handle_reset on v2:172.21.15.204:6832/1808682347 2024-09-12T02:33:34.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.729+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 >> 172.21.15.181:0/3942941708 conn(0x5610359fca80 msgr2=0x561035a41fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.730+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 shutdown_connections 2024-09-12T02:33:34.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.730+0000 7fbae63e5740 1 -- 172.21.15.181:0/3942941708 wait complete. 2024-09-12T02:33:34.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.730+0000 7fbae63e5740 20 client.6303 trim_cache size 0 max 16384 2024-09-12T02:33:34.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.747+0000 7fbae63e5740 1 Processor -- start 2024-09-12T02:33:34.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.747+0000 7fbae63e5740 1 -- start start 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a41760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x5610359fe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae63e5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1fe8f0 con 0x5610359ff2c0 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1fcc60 con 0x561035a00a50 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc1fd2b0 con 0x5610359fe0f0 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x5610359fe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x5610359fe4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49828/0 (socket says 172.21.15.181:49828) 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 -- 172.21.15.181:0/768618929 learned_addr learned my addr 172.21.15.181:0/768618929 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae1be9640 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae13e8640 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a41760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 -- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 msgr2=0x561035a41760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a41760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 -- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 msgr2=0x5610359fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 -- 172.21.15.181:0/768618929 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610359ffd60 con 0x5610359ff2c0 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.748+0000 7fbae0be7640 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x5610359fe4d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0014a0 tx=0x7fbacc017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a2b2d7ba8e494f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbac67fc640 1 -- 172.21.15.181:0/768618929 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00e500 con 0x5610359ff2c0 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbac67fc640 1 -- 172.21.15.181:0/768618929 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc00e6a0 con 0x5610359ff2c0 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbac67fc640 1 -- 172.21.15.181:0/768618929 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00e870 con 0x5610359ff2c0 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 -- 172.21.15.181:0/768618929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 msgr2=0x5610359fe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x5610359fe4d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0014a0 tx=0x7fbacc017040 comp rx=0 tx=0).stop 2024-09-12T02:33:34.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 -- 172.21.15.181:0/768618929 shutdown_connections 2024-09-12T02:33:34.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x561035a00a50 0x5610359fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610359ff2c0 0x5610359fe4d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 --2- 172.21.15.181:0/768618929 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359fe0f0 0x561035a41760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 -- 172.21.15.181:0/768618929 >> 172.21.15.181:0/768618929 conn(0x5610359fca80 msgr2=0x561035a41fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 -- 172.21.15.181:0/768618929 shutdown_connections 2024-09-12T02:33:34.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.749+0000 7fbae63e5740 1 -- 172.21.15.181:0/768618929 wait complete. 2024-09-12T02:33:34.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.750+0000 7fbae63e5740 1 -- start start 2024-09-12T02:33:34.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.750+0000 7fbae63e5740 1 Processor -- start 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fe0f0 0x561035ac1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359ff2c0 0x561035a1eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561035a00a50 0x561035a1f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561035961520 con 0x561035a00a50 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5610358ea450 con 0x5610359fe0f0 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x561035a29a60 con 0x5610359ff2c0 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 10 client.0 _ll_register_callbacks cb 0x7fbad8090070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561035a00a50 0x561035a1f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561035a00a50 0x561035a1f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49830/0 (socket says 172.21.15.181:49830) 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 -- 172.21.15.181:0/1636799274 learned_addr learned my addr 172.21.15.181:0/1636799274 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae0be7640 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359ff2c0 0x561035a1eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fe0f0 0x561035ac1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 -- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359ff2c0 msgr2=0x561035a1eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359ff2c0 0x561035a1eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 -- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fe0f0 msgr2=0x561035ac1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fe0f0 0x561035ac1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 -- 172.21.15.181:0/1636799274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561035a45d50 con 0x561035a00a50 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae1be9640 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561035a00a50 0x561035a1f090 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbadc152ed0 tx=0x7fbad4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c5ab2e47bdb4e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbabbfff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbabbfff640 1 -- 172.21.15.181:0/1636799274 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4003b90 con 0x561035a00a50 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbabbfff640 1 -- 172.21.15.181:0/1636799274 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbad4003d30 con 0x561035a00a50 2024-09-12T02:33:34.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbacc00e6a0 con 0x561035a00a50 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbabbfff640 1 -- 172.21.15.181:0/1636799274 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fbad4029050 con 0x561035a00a50 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 10 client.6309 fetch_fsmap learned FSMap version 43 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.751+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x561035ac1750 con 0x561035a00a50 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbabbfff640 1 -- 172.21.15.181:0/1636799274 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc00e6a0 con 0x561035a00a50 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbabbfff640 1 -- 172.21.15.181:0/1636799274 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 43) ==== 3522+0+0 (secure 0 0 0) 0x7fbad402c020 con 0x561035a00a50 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae63e5740 10 client.6309 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae63e5740 10 client.6309 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae63e5740 20 client.6309 populate_metadata read hostname 'smithi181' 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae63e5740 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x561035a21040 0x561035a66870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae63e5740 4 client.6309 mds_command: new command op to 6141 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 --> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] -- command(tid 0: {"prefix": "status"}) -- 0x561035968fa0 con 0x561035a21040 2024-09-12T02:33:34.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x561035a21040 0x561035a66870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbabbfff640 10 client.6309 ms_handle_connect on v2:172.21.15.204:6832/1808682347 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae13e8640 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x561035a21040 0x561035a66870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c2b290ec27ca006b server_cookie=5b96fb9e3c683bdd in_seq=0 out_seq=0 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbabbfff640 1 -- 172.21.15.181:0/1636799274 <== mds.1 v2:172.21.15.204:6832/1808682347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561035968fa0 con 0x561035a21040 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbabbfff640 10 client.6309 handle_command_reply: tid=0 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.752+0000 7fbae63e5740 1 client.6309 shutdown 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561035a00a50 msgr2=0x561035a1f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561035a00a50 0x561035a1f090 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbadc152ed0 tx=0x7fbad4007700 comp rx=0 tx=0).stop 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 shutdown_connections 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561035a00a50 0x561035a1f090 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5610359ff2c0 0x561035a1eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:6832/1808682347,v1:172.21.15.204:6834/1808682347] conn(0x561035a21040 0x561035a66870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 --2- 172.21.15.181:0/1636799274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5610359fe0f0 0x561035ac1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbabbfff640 0 client.6309 ms_handle_reset on v2:172.21.15.204:6832/1808682347 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 >> 172.21.15.181:0/1636799274 conn(0x5610359fca80 msgr2=0x561035a43750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 shutdown_connections 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 1 -- 172.21.15.181:0/1636799274 wait complete. 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae63e5740 20 client.6309 trim_cache size 0 max 16384 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:33:34.762 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 1, 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6141, 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 2.6248320939999998, 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 43, 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 60, 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 60, 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 14.651198231 2024-09-12T02:33:34.763 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:33:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbac006be60 msgr2=0x7fbac006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbac006be60 0x7fbac006e320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbadc15d0f0 tx=0x7fbacc009040 comp rx=0 tx=0).stop 2024-09-12T02:33:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbadc0b2490 msgr2=0x7fbadc0d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbadc0b2490 0x7fbadc0d0330 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbad802a2b0 tx=0x7fbad80046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 shutdown_connections 2024-09-12T02:33:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbac006be60 0x7fbac006e320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbadc0cdfc0 0x7fbadc15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbadc15b2e0 0x7fbadc1446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 --2- 172.21.15.181:0/1336214608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbadc0b2490 0x7fbadc0d0330 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 >> 172.21.15.181:0/1336214608 conn(0x7fbadc06bc10 msgr2=0x7fbadc0cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 shutdown_connections 2024-09-12T02:33:34.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.753+0000 7fbae364c640 1 -- 172.21.15.181:0/1336214608 wait complete. 2024-09-12T02:33:34.766 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:33:34.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.865+0000 7f176e61e640 1 Processor -- start 2024-09-12T02:33:34.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.866+0000 7f176e61e640 1 -- start start 2024-09-12T02:33:34.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.866+0000 7f176e61e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 0x7f17680ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.866+0000 7f176e61e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f17680cf0e0 0x7f17680cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.866+0000 7f176e61e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176815ea20 con 0x7f17680b2cf0 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.866+0000 7f176e61e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f17680b2860 con 0x7f17680cf0e0 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.866+0000 7f176e61e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f17680b1c50 con 0x7f176815e640 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f176cbbb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f17680b2cf0 0x7f17680b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55546/0 (socket says 172.21.15.181:55546) 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f176cbbb640 1 -- 172.21.15.181:0/3401425727 learned_addr learned my addr 172.21.15.181:0/3401425727 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f17677fe640 1 --2- 172.21.15.181:0/3401425727 >> v2:172.21.15.204:3300/0 conn(0x7f17680cf0e0 0x7f17680cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585944486 0 0) 0x7f176815ea20 con 0x7f17680b2cf0 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1767fff640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 0x7f17680ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1750003520 con 0x7f17680b2cf0 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 280280537 0 0) 0x7f1750003520 con 0x7f17680b2cf0 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 msgr2=0x7f17680ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 0x7f17680ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 >> v2:172.21.15.204:3300/0 conn(0x7f17680cf0e0 msgr2=0x7f17680cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 --2- 172.21.15.181:0/3401425727 >> v2:172.21.15.204:3300/0 conn(0x7f17680cf0e0 0x7f17680cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17680b1f30 con 0x7f17680b2cf0 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f17600019f0 con 0x7f17680b2cf0 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f17677fe640 1 --2- 172.21.15.181:0/3401425727 >> v2:172.21.15.204:3300/0 conn(0x7f17680cf0e0 0x7f17680cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 >> v1:172.21.15.181:6789/0 conn(0x7f17680b2cf0 legacy=0x7f17680b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 0x7f17500039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f1750004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1750004d40 0x7f17500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f17680b2860 con 0x7f1750003f50 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f17680b1c50 con 0x7f1750004d40 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f175000baf0 con 0x7f176815e640 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f17677fe640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f1750004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f1767fff640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 0x7f17500039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.867+0000 7f176cbbb640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1750004d40 0x7f17500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f17677fe640 1 -- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 msgr2=0x7f17500039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f17677fe640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815e640 0x7f17500039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f17677fe640 1 -- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1750004d40 msgr2=0x7f17500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f17677fe640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1750004d40 0x7f17500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f17677fe640 1 -- 172.21.15.181:0/3401425727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1750003520 con 0x7f1750003f50 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f17677fe640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f1750004800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f17680cb580 tx=0x7f1750005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e874f3530a6bdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c037070 con 0x7f1750003f50 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175c02ad00 con 0x7f1750003f50 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.868+0000 7f1766ffd640 1 -- 172.21.15.181:0/3401425727 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c00f040 con 0x7f1750003f50 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.869+0000 7f176e61e640 1 -- 172.21.15.181:0/3401425727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 msgr2=0x7f1750004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.869+0000 7f176e61e640 1 --2- 172.21.15.181:0/3401425727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f1750004800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f17680cb580 tx=0x7f1750005830 comp rx=0 tx=0).stop 2024-09-12T02:33:34.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.869+0000 7f176cbbb640 1 -- 172.21.15.181:0/3401425727 reap_dead start 2024-09-12T02:33:34.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.869+0000 7f176e61e640 1 -- 172.21.15.181:0/3401425727 shutdown_connections 2024-09-12T02:33:34.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.869+0000 7f176e61e640 1 -- 172.21.15.181:0/3401425727 >> 172.21.15.181:0/3401425727 conn(0x7f176809d820 msgr2=0x7f17680d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.869+0000 7f176e61e640 1 -- 172.21.15.181:0/3401425727 shutdown_connections 2024-09-12T02:33:34.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.869+0000 7f176e61e640 1 -- 172.21.15.181:0/3401425727 wait complete. 2024-09-12T02:33:34.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.870+0000 7f176e61e640 1 Processor -- start 2024-09-12T02:33:34.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.870+0000 7f176e61e640 1 -- start start 2024-09-12T02:33:34.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f176e61e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f176815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f176e61e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815cd00 0x7f17680b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f176e61e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17680ca580 0x7f17680caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f176e61e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f17680cfe40 con 0x7f1750003f50 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f176e61e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f17680b24f0 con 0x7f17680ca580 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f176e61e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f17680b73a0 con 0x7f176815cd00 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f176815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f176815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49838/0 (socket says 172.21.15.181:49838) 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 -- 172.21.15.181:0/1801047725 learned_addr learned my addr 172.21.15.181:0/1801047725 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f176cbbb640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17680ca580 0x7f17680caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f17677fe640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815cd00 0x7f17680b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 -- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815cd00 msgr2=0x7f17680b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815cd00 0x7f17680b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 -- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17680ca580 msgr2=0x7f17680caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17680ca580 0x7f17680caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.871+0000 7f1767fff640 1 -- 172.21.15.181:0/1801047725 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17680b4560 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.872+0000 7f1767fff640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f176815d390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f17580119a0 tx=0x7f1758011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.872+0000 7f1764ff9640 1 -- 172.21.15.181:0/1801047725 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175800fa90 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.872+0000 7f1764ff9640 1 -- 172.21.15.181:0/1801047725 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175800fc30 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.872+0000 7f1764ff9640 1 -- 172.21.15.181:0/1801047725 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758014440 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.872+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176815d180 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.872+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17680b4ac0 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.873+0000 7f1764ff9640 1 -- 172.21.15.181:0/1801047725 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1758012040 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.874+0000 7f1764ff9640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f175406be60 0x7f175406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.874+0000 7f1764ff9640 1 -- 172.21.15.181:0/1801047725 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f175808b490 con 0x7f1750003f50 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.874+0000 7f17677fe640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f175406be60 0x7f175406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.874+0000 7f17677fe640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f175406be60 0x7f175406e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f175c034000 tx=0x7f175c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 Processor -- start 2024-09-12T02:33:34.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 -- start start 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca4ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca06a80 0x55a60ca096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca0aa50 0x55a60ca038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a60c96b520 con 0x55a60ca0aa50 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a60c9133e0 con 0x55a60ca092c0 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a60c9674e0 con 0x55a60ca06a80 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f176cbbb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca0aa50 0x55a60ca038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f176cbbb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca0aa50 0x55a60ca038b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49848/0 (socket says 172.21.15.181:49848) 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f176cbbb640 1 -- 172.21.15.181:0/8565523 learned_addr learned my addr 172.21.15.181:0/8565523 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.875+0000 7f17677fe640 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca06a80 0x55a60ca096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f1767fff640 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca4ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f176cbbb640 1 -- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca06a80 msgr2=0x55a60ca096a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f176cbbb640 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca06a80 0x55a60ca096a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f176cbbb640 1 -- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 msgr2=0x55a60ca4ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f176cbbb640 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca4ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f176cbbb640 1 -- 172.21.15.181:0/8565523 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a60c92e2f0 con 0x55a60ca0aa50 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f176cbbb640 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca0aa50 0x55a60ca038b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f176806e620 tx=0x7f176000a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfb41ef5d6056ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f174dffb640 1 -- 172.21.15.181:0/8565523 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17600079e0 con 0x55a60ca0aa50 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f174dffb640 1 -- 172.21.15.181:0/8565523 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176001a070 con 0x55a60ca0aa50 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.876+0000 7f174dffb640 1 -- 172.21.15.181:0/8565523 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17600156b0 con 0x55a60ca0aa50 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 -- 172.21.15.181:0/8565523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca0aa50 msgr2=0x55a60ca038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca0aa50 0x55a60ca038b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f176806e620 tx=0x7f176000a0e0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 -- 172.21.15.181:0/8565523 shutdown_connections 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca0aa50 0x55a60ca038b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca06a80 0x55a60ca096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 --2- 172.21.15.181:0/8565523 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca4ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 -- 172.21.15.181:0/8565523 >> 172.21.15.181:0/8565523 conn(0x55a60ca05a80 msgr2=0x55a60ca4df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 -- 172.21.15.181:0/8565523 shutdown_connections 2024-09-12T02:33:34.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 -- 172.21.15.181:0/8565523 wait complete. 2024-09-12T02:33:34.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 -- start start 2024-09-12T02:33:34.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.877+0000 7f1770ffd740 1 Processor -- start 2024-09-12T02:33:34.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca27a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca0aa50 0x55a60ca2f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca29500 0x55a60ca2f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1770ffd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a60ca04f20 con 0x55a60ca29500 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a60c8f4450 con 0x55a60ca092c0 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a60ca4f290 con 0x55a60ca0aa50 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1770ffd740 10 client.0 _ll_register_callbacks cb 0x55a60c67dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f176cbbb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca29500 0x55a60ca2f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f176cbbb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca29500 0x55a60ca2f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49864/0 (socket says 172.21.15.181:49864) 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f176cbbb640 1 -- 172.21.15.181:0/2646885353 learned_addr learned my addr 172.21.15.181:0/2646885353 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f1767fff640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca27a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.878+0000 7f17677fe640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca0aa50 0x55a60ca2f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f176cbbb640 1 -- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca0aa50 msgr2=0x55a60ca2f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f176cbbb640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca0aa50 0x55a60ca2f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f176cbbb640 1 -- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 msgr2=0x55a60ca27a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f176cbbb640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca27a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f176cbbb640 1 -- 172.21.15.181:0/2646885353 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60c67e2d0 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f17677fe640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca0aa50 0x55a60ca2f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f176cbbb640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca29500 0x55a60ca2f810 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1760006010 tx=0x7f1760001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e34733c52230eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1746ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1746ffd640 1 -- 172.21.15.181:0/2646885353 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760015d90 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1746ffd640 1 -- 172.21.15.181:0/2646885353 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f176002ab20 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176001a070 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1746ffd640 1 -- 172.21.15.181:0/2646885353 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f17600018b0 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 10 client.6321 fetch_fsmap learned FSMap version 43 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55a60c7486b0 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1746ffd640 1 -- 172.21.15.181:0/2646885353 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176001a070 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1746ffd640 1 -- 172.21.15.181:0/2646885353 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 43) ==== 3522+0+0 (secure 0 0 0) 0x7f176002a020 con 0x55a60ca29500 2024-09-12T02:33:34.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 10 client.6321 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:33:34.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 10 client.6321 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:33:34.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 20 client.6321 populate_metadata read hostname 'smithi181' 2024-09-12T02:33:34.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60ca02980 0x55a60ca02d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 4 client.6321 mds_command: new command op to 6144 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:34.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.879+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 --> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a60c978c50 con 0x55a60ca02980 2024-09-12T02:33:34.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.880+0000 7f1767fff640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60ca02980 0x55a60ca02d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.880+0000 7f1767fff640 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60ca02980 0x55a60ca02d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2734779b2e92da server_cookie=e59c8a417a033918 in_seq=0 out_seq=0 2024-09-12T02:33:34.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.880+0000 7f1746ffd640 10 client.6321 ms_handle_connect on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:34.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1746ffd640 1 -- 172.21.15.181:0/2646885353 <== mds.0 v2:172.21.15.204:6833/2402478751 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a60c978c50 con 0x55a60ca02980 2024-09-12T02:33:34.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1746ffd640 10 client.6321 handle_command_reply: tid=0 2024-09-12T02:33:34.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 client.6321 shutdown 2024-09-12T02:33:34.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca29500 msgr2=0x55a60ca2f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca29500 0x55a60ca2f810 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1760006010 tx=0x7f1760001360 comp rx=0 tx=0).stop 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 shutdown_connections 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60ca02980 0x55a60ca02d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca29500 0x55a60ca2f810 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca0aa50 0x55a60ca2f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1746ffd640 0 client.6321 ms_handle_reset on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 --2- 172.21.15.181:0/2646885353 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca092c0 0x55a60ca27a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 >> 172.21.15.181:0/2646885353 conn(0x55a60ca06a80 msgr2=0x55a60ca51440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 shutdown_connections 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 1 -- 172.21.15.181:0/2646885353 wait complete. 2024-09-12T02:33:34.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.881+0000 7f1770ffd740 20 client.6321 trim_cache size 0 max 16384 2024-09-12T02:33:34.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 Processor -- start 2024-09-12T02:33:34.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 -- start start 2024-09-12T02:33:34.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca27660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca2e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca2e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f17682010a0 con 0x55a60ca092c0 2024-09-12T02:33:34.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f17680c9570 con 0x55a60ca0aa50 2024-09-12T02:33:34.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.899+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f17681ffb40 con 0x55a60ca29500 2024-09-12T02:33:34.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca27660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca27660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49866/0 (socket says 172.21.15.181:49866) 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 -- 172.21.15.181:0/3506410072 learned_addr learned my addr 172.21.15.181:0/3506410072 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f17677fe640 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca2e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 -- 172.21.15.181:0/3506410072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 msgr2=0x55a60ca2e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca2e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 -- 172.21.15.181:0/3506410072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 msgr2=0x55a60ca2e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca2e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 -- 172.21.15.181:0/3506410072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a60ca05820 con 0x55a60ca092c0 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1767fff640 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca27660 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f17580899e0 tx=0x7f1758004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c27c352fc724d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f174d7fa640 1 -- 172.21.15.181:0/3506410072 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758076070 con 0x55a60ca092c0 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f174d7fa640 1 -- 172.21.15.181:0/3506410072 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1758057890 con 0x55a60ca092c0 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f174d7fa640 1 -- 172.21.15.181:0/3506410072 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758055e60 con 0x55a60ca092c0 2024-09-12T02:33:34.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1770ffd740 1 -- 172.21.15.181:0/3506410072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 msgr2=0x55a60ca27660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.900+0000 7f1770ffd740 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca27660 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f17580899e0 tx=0x7f1758004700 comp rx=0 tx=0).stop 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 -- 172.21.15.181:0/3506410072 shutdown_connections 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca2e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca2e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 --2- 172.21.15.181:0/3506410072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca27660 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 -- 172.21.15.181:0/3506410072 >> 172.21.15.181:0/3506410072 conn(0x55a60ca06a80 msgr2=0x55a60ca04150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 -- 172.21.15.181:0/3506410072 shutdown_connections 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 -- 172.21.15.181:0/3506410072 wait complete. 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 -- start start 2024-09-12T02:33:34.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.901+0000 7f1770ffd740 1 Processor -- start 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca02d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca032a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1770ffd740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca4a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1770ffd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a60ca333b0 con 0x55a60ca092c0 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a60ca29db0 con 0x55a60ca0aa50 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1770ffd740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a60ca32780 con 0x55a60ca29500 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1770ffd740 10 client.0 _ll_register_callbacks cb 0x7f1758012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:34.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca02d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca02d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49874/0 (socket says 172.21.15.181:49874) 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 -- 172.21.15.181:0/1714843769 learned_addr learned my addr 172.21.15.181:0/1714843769 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f17677fe640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f176cbbb640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca4a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 -- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 msgr2=0x55a60ca4a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca4a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 -- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 msgr2=0x55a60ca032a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca032a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f1767fff640 1 -- 172.21.15.181:0/1714843769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60ca084c0 con 0x55a60ca092c0 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.902+0000 7f176cbbb640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca4a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1767fff640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca02d60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f175801c000 tx=0x7f175808b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5784e8f04f9fc764 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:34.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1746ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1746ffd640 1 -- 172.21.15.181:0/1714843769 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175807c020 con 0x55a60ca092c0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1746ffd640 1 -- 172.21.15.181:0/1714843769 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1758057b70 con 0x55a60ca092c0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1758057890 con 0x55a60ca092c0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1746ffd640 1 -- 172.21.15.181:0/1714843769 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1758076030 con 0x55a60ca092c0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 10 client.6327 fetch_fsmap learned FSMap version 43 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x55a60ca51ff0 con 0x55a60ca092c0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1746ffd640 1 -- 172.21.15.181:0/1714843769 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1758057890 con 0x55a60ca092c0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1746ffd640 1 -- 172.21.15.181:0/1714843769 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 43) ==== 3522+0+0 (secure 0 0 0) 0x7f1758025030 con 0x55a60ca092c0 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 10 client.6327 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 10 client.6327 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 20 client.6327 populate_metadata read hostname 'smithi181' 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60cacba90 0x55a60cacbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 4 client.6327 mds_command: new command op to 6144 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:33:34.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 --> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] -- command(tid 0: {"prefix": "status"}) -- 0x55a60c972fa0 con 0x55a60cacba90 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.903+0000 7f17677fe640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60cacba90 0x55a60cacbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1746ffd640 10 client.6327 ms_handle_connect on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f17677fe640 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60cacba90 0x55a60cacbe70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8b7bc77ea91b3f2 server_cookie=34d8cdc137f637f1 in_seq=0 out_seq=0 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1746ffd640 1 -- 172.21.15.181:0/1714843769 <== mds.0 v2:172.21.15.204:6833/2402478751 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a60c972fa0 con 0x55a60cacba90 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1746ffd640 10 client.6327 handle_command_reply: tid=0 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 client.6327 shutdown 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 msgr2=0x55a60ca02d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca02d60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f175801c000 tx=0x7f175808b040 comp rx=0 tx=0).stop 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 shutdown_connections 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:6833/2402478751,v1:172.21.15.204:6835/2402478751] conn(0x55a60cacba90 0x55a60cacbe70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a60ca0aa50 0x55a60ca032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a60ca29500 0x55a60ca4a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1746ffd640 0 client.6327 ms_handle_reset on v2:172.21.15.204:6833/2402478751 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 --2- 172.21.15.181:0/1714843769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a60ca092c0 0x55a60ca02d60 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 >> 172.21.15.181:0/1714843769 conn(0x55a60ca06a80 msgr2=0x55a60ca51870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 shutdown_connections 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 1 -- 172.21.15.181:0/1714843769 wait complete. 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.904+0000 7f1770ffd740 20 client.6327 trim_cache size 0 max 16384 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:33:34.912 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6144, 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 9.8217652859999998, 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 43, 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 60, 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 60, 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 14.802552695999999 2024-09-12T02:33:34.913 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f175406be60 msgr2=0x7f175406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f175406be60 0x7f175406e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f175c034000 tx=0x7f175c02e000 comp rx=0 tx=0).stop 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 msgr2=0x7f176815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f176815d390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f17580119a0 tx=0x7f1758011e60 comp rx=0 tx=0).stop 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 shutdown_connections 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f175406be60 0x7f175406e320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f17680ca580 0x7f17680caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f176815cd00 0x7f17680b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 --2- 172.21.15.181:0/1801047725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1750003f50 0x7f176815d390 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:34.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 >> 172.21.15.181:0/1801047725 conn(0x7f176809d820 msgr2=0x7f17680b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:34.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 shutdown_connections 2024-09-12T02:33:34.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:34.905+0000 7f176e61e640 1 -- 172.21.15.181:0/1801047725 wait complete. 2024-09-12T02:33:34.917 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable false 2024-09-12T02:33:35.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.017+0000 7f529956f640 1 Processor -- start 2024-09-12T02:33:35.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.017+0000 7f529956f640 1 -- start start 2024-09-12T02:33:35.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.018+0000 7f529956f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5294158ac0 0x7f529406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:35.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.018+0000 7f529956f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529415ea20 con 0x7f529406d1b0 2024-09-12T02:33:35.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.018+0000 7f529956f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529415ece0 con 0x7f529406cd20 2024-09-12T02:33:35.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.018+0000 7f529956f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5294158ea0 con 0x7f5294158ac0 2024-09-12T02:33:35.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.018+0000 7f5292ffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5294158ac0 0x7f529406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:35.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.018+0000 7f52937fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f529406d1b0 0x7f52941622f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55556/0 (socket says 172.21.15.181:55556) 2024-09-12T02:33:35.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.018+0000 7f52937fe640 1 -- 172.21.15.181:0/1801173366 learned_addr learned my addr 172.21.15.181:0/1801173366 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:35.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.019+0000 7f5292ffd640 1 -- 172.21.15.181:0/1801173366 >> v1:172.21.15.204:6789/0 conn(0x7f529406cd20 legacy=0x7f529406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:35.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.019+0000 7f5292ffd640 1 -- 172.21.15.181:0/1801173366 >> v1:172.21.15.181:6789/0 conn(0x7f529406d1b0 legacy=0x7f52941622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:35.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.019+0000 7f5292ffd640 1 -- 172.21.15.181:0/1801173366 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529415efc0 con 0x7f5294158ac0 2024-09-12T02:33:35.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.019+0000 7f5291ffb640 1 -- 172.21.15.181:0/1801173366 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141180191 0 0) 0x7f529415ea20 con 0x7f529406d1b0 2024-09-12T02:33:35.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.019+0000 7f5292ffd640 1 --2- 172.21.15.181:0/1801173366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f529406d640 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b6d3b85d33fc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:35.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f5291ffb640 1 -- 172.21.15.181:0/1801173366 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284007740 con 0x7f5294158ac0 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f5291ffb640 1 -- 172.21.15.181:0/1801173366 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52840078e0 con 0x7f5294158ac0 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f5291ffb640 1 -- 172.21.15.181:0/1801173366 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284007cb0 con 0x7f5294158ac0 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f529956f640 1 -- 172.21.15.181:0/1801173366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 msgr2=0x7f529406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f529956f640 1 --2- 172.21.15.181:0/1801173366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f529406d640 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f529956f640 1 -- 172.21.15.181:0/1801173366 shutdown_connections 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f529956f640 1 --2- 172.21.15.181:0/1801173366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f529406d640 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f529956f640 1 -- 172.21.15.181:0/1801173366 >> 172.21.15.181:0/1801173366 conn(0x7f5294067950 msgr2=0x7f5294067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f529956f640 1 -- 172.21.15.181:0/1801173366 shutdown_connections 2024-09-12T02:33:35.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.020+0000 7f529956f640 1 -- 172.21.15.181:0/1801173366 wait complete. 2024-09-12T02:33:35.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.021+0000 7f529956f640 1 Processor -- start 2024-09-12T02:33:35.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f529956f640 1 -- start start 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f529956f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f529406cd20 0x7f52941f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f529956f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f529406d1b0 0x7f5294140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f529956f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f52941f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f529956f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f52940b6110 con 0x7f5294158ac0 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f529956f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f529415f580 con 0x7f529406cd20 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f529956f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f529415f860 con 0x7f529406d1b0 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f52937fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f52941f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f52937fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f52941f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49888/0 (socket says 172.21.15.181:49888) 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.022+0000 7f52937fe640 1 -- 172.21.15.181:0/2076762720 learned_addr learned my addr 172.21.15.181:0/2076762720 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f5292ffd640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f529406cd20 0x7f52941f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52927fc640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f529406d1b0 0x7f5294140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52937fe640 1 -- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f529406d1b0 msgr2=0x7f5294140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52937fe640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f529406d1b0 0x7f5294140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52937fe640 1 -- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f529406cd20 msgr2=0x7f52941f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52937fe640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f529406cd20 0x7f52941f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52937fe640 1 -- 172.21.15.181:0/2076762720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52941f48f0 con 0x7f5294158ac0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52927fc640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f529406d1b0 0x7f5294140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f52937fe640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f52941f3f10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c480 tx=0x7f528c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f528b7fe640 1 -- 172.21.15.181:0/2076762720 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c018070 con 0x7f5294158ac0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f528b7fe640 1 -- 172.21.15.181:0/2076762720 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c0074e0 con 0x7f5294158ac0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52941f4bd0 con 0x7f5294158ac0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f528b7fe640 1 -- 172.21.15.181:0/2076762720 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c004a20 con 0x7f5294158ac0 2024-09-12T02:33:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.023+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941f7980 con 0x7f5294158ac0 2024-09-12T02:33:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.024+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52941f7b50 con 0x7f5294158ac0 2024-09-12T02:33:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.025+0000 7f528b7fe640 1 -- 172.21.15.181:0/2076762720 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f528c01b070 con 0x7f5294158ac0 2024-09-12T02:33:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.025+0000 7f528b7fe640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f527406be30 0x7f527406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.025+0000 7f528b7fe640 1 -- 172.21.15.181:0/2076762720 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f528c08a040 con 0x7f5294158ac0 2024-09-12T02:33:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.025+0000 7f5292ffd640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f527406be30 0x7f527406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.026+0000 7f5292ffd640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f527406be30 0x7f527406e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5284034000 tx=0x7f528402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.029+0000 7f528b7fe640 1 -- 172.21.15.181:0/2076762720 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f528c058a80 con 0x7f5294158ac0 2024-09-12T02:33:35.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:35.231+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"} v 0) -- 0x7f5294141140 con 0x7f5294158ac0 2024-09-12T02:33:36.072 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-09-12T02:33:36.071+0000 7f3615ddd640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T02:33:36.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.138+0000 7f528b7fe640 1 -- 172.21.15.181:0/2076762720 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"}]=0 cephfs marked not joinable; MDS cannot join as newly active. v44) ==== 170+0+0 (secure 0 0 0) 0x7f528c058380 con 0x7f5294158ac0 2024-09-12T02:33:36.139 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join as newly active. 2024-09-12T02:33:36.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f527406be30 msgr2=0x7f527406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:36.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f527406be30 0x7f527406e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5284034000 tx=0x7f528402f000 comp rx=0 tx=0).stop 2024-09-12T02:33:36.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 msgr2=0x7f52941f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:36.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f52941f3f10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c480 tx=0x7f528c00c940 comp rx=0 tx=0).stop 2024-09-12T02:33:36.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 shutdown_connections 2024-09-12T02:33:36.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f527406be30 0x7f527406e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:36.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5294158ac0 0x7f52941f3f10 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:36.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f529406d1b0 0x7f5294140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:36.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 --2- 172.21.15.181:0/2076762720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f529406cd20 0x7f52941f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:36.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 >> 172.21.15.181:0/2076762720 conn(0x7f5294067950 msgr2=0x7f52941622f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:36.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 shutdown_connections 2024-09-12T02:33:36.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36.141+0000 7f529956f640 1 -- 172.21.15.181:0/2076762720 wait complete. 2024-09-12T02:33:36.155 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir {alpha,bravo} && touch {alpha,bravo}/file') 2024-09-12T02:33:36.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:33:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:33:36.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:36.228 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 alpha/) 2024-09-12T02:33:36.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:33:36.263 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 bravo/) 2024-09-12T02:33:36.320 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-12T02:33:36.444 INFO:teuthology.orchestra.run.smithi204.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-12T02:33:36.445 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-12T02:33:36.445 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-12T02:33:38.446 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-12T02:33:38.572 INFO:teuthology.orchestra.run.smithi204.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-12T02:33:38.572 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-12T02:33:38.572 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-12T02:33:40.574 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-12T02:33:40.701 INFO:teuthology.orchestra.run.smithi204.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-12T02:33:40.701 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-12T02:33:40.701 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-12T02:33:42.702 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-12T02:33:42.829 INFO:teuthology.orchestra.run.smithi204.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"17","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-12T02:33:42.830 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "17", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-12T02:33:42.830 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-12T02:33:44.831 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-12T02:33:44.957 INFO:teuthology.orchestra.run.smithi204.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"17","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-12T02:33:44.958 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "17", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-12T02:33:44.959 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-12T02:33:46.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:46.828 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:46.959 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-12T02:33:47.082 INFO:teuthology.orchestra.run.smithi204.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"18","version":"18","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/alpha","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/bravo","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-12T02:33:47.083 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "18", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "18" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/alpha", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/bravo", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "5", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-12T02:33:47.083 INFO:tasks.cephfs.cephfs_test_case:[('/alpha', 0), ('/bravo', 1)] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-12T02:33:47.084 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:33:47.084 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:47.103 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:33:47.103 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:33:47.103 DEBUG:teuthology.orchestra.run.smithi181:> import uuid 2024-09-12T02:33:47.103 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:47.103 DEBUG:teuthology.orchestra.run.smithi181:> n = 1000 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> create_hard_links = False 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> if 0 > 0: 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> create_hard_links = True 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> path = "/home/ubuntu/cephtest/mnt.0/alpha/file" 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> dpath = os.path.dirname(path) 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> fnameprefix = os.path.basename(path) 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> os.makedirs(dpath, exist_ok=True) 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> try: 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> for i in range(n): 2024-09-12T02:33:47.104 DEBUG:teuthology.orchestra.run.smithi181:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> f.write(f"{i}") 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> f.flush() 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> os.fsync(f.fileno()) 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> os.unlink(fpath) 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> os.fsync(dirfd) 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> if create_hard_links: 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> for j in range(0): 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:47.105 DEBUG:teuthology.orchestra.run.smithi181:> os.fsync(dirfd) 2024-09-12T02:33:47.106 DEBUG:teuthology.orchestra.run.smithi181:> finally: 2024-09-12T02:33:47.106 DEBUG:teuthology.orchestra.run.smithi181:> os.close(dirfd) 2024-09-12T02:33:47.106 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:33:51.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:33:51.531 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:33:51.531 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> stdin-killer -- python3 -c ' 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> import uuid 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> n = 1000 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> create_hard_links = False 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> if 0 > 0: 2024-09-12T02:33:51.588 DEBUG:teuthology.orchestra.run.smithi181:> create_hard_links = True 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> path = "/home/ubuntu/cephtest/mnt.0/bravo/file" 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> dpath = os.path.dirname(path) 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> fnameprefix = os.path.basename(path) 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> os.makedirs(dpath, exist_ok=True) 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> try: 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> for i in range(n): 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> f.write(f"{i}") 2024-09-12T02:33:51.589 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> f.flush() 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> os.fsync(f.fileno()) 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> os.unlink(fpath) 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> os.fsync(dirfd) 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> if create_hard_links: 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> for j in range(0): 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> if False: 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> os.fsync(dirfd) 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> finally: 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> os.close(dirfd) 2024-09-12T02:33:51.590 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:33:59.612 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.751+0000 7f3e9a986640 1 Processor -- start 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.751+0000 7f3e9a986640 1 -- start start 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.751+0000 7f3e9a986640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3e940cf2b0 0x7f3e940d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.751+0000 7f3e9a986640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf720 0x7f3e940d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.751+0000 7f3e9a986640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9415ea20 con 0x7f3e9415e640 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.751+0000 7f3e9a986640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940b3d00 con 0x7f3e940cf2b0 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.751+0000 7f3e9a986640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3e940b2860 con 0x7f3e940cf720 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e98f23640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf720 0x7f3e940d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e937fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3e940cf2b0 0x7f3e940d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e93fff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f3e9415e640 0x7f3e940ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:39894/0 (socket says 172.21.15.181:39894) 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e93fff640 1 -- 172.21.15.181:0/3760865770 learned_addr learned my addr 172.21.15.181:0/3760865770 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e92ffd640 1 -- 172.21.15.181:0/3760865770 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404703129 0 0) 0x7f3e9415ea20 con 0x7f3e9415e640 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e92ffd640 1 -- 172.21.15.181:0/3760865770 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e7c003520 con 0x7f3e9415e640 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e98f23640 1 -- 172.21.15.181:0/3760865770 >> v2:172.21.15.204:3300/0 conn(0x7f3e940cf2b0 msgr2=0x7f3e940d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e98f23640 1 --2- 172.21.15.181:0/3760865770 >> v2:172.21.15.204:3300/0 conn(0x7f3e940cf2b0 0x7f3e940d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e98f23640 1 -- 172.21.15.181:0/3760865770 >> v1:172.21.15.204:6789/0 conn(0x7f3e9415e640 legacy=0x7f3e940ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e98f23640 1 -- 172.21.15.181:0/3760865770 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940b1c50 con 0x7f3e940cf720 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.752+0000 7f3e937fe640 1 --2- 172.21.15.181:0/3760865770 >> v2:172.21.15.204:3300/0 conn(0x7f3e940cf2b0 0x7f3e940d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.753+0000 7f3e98f23640 1 --2- 172.21.15.181:0/3760865770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf720 0x7f3e940d2b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009d90 tx=0x7f3e8c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a964dd30945a7c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.753+0000 7f3e92ffd640 1 -- 172.21.15.181:0/3760865770 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c031600 con 0x7f3e940cf720 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.753+0000 7f3e92ffd640 1 -- 172.21.15.181:0/3760865770 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c0317a0 con 0x7f3e940cf720 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.753+0000 7f3e92ffd640 1 -- 172.21.15.181:0/3760865770 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c031b50 con 0x7f3e940cf720 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 -- 172.21.15.181:0/3760865770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf720 msgr2=0x7f3e940d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3760865770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf720 0x7f3e940d2b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009d90 tx=0x7f3e8c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 -- 172.21.15.181:0/3760865770 shutdown_connections 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3760865770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf720 0x7f3e940d2b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3760865770 >> v2:172.21.15.204:3300/0 conn(0x7f3e940cf2b0 0x7f3e940d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 -- 172.21.15.181:0/3760865770 >> 172.21.15.181:0/3760865770 conn(0x7f3e9409d820 msgr2=0x7f3e940d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 -- 172.21.15.181:0/3760865770 shutdown_connections 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.754+0000 7f3e9a986640 1 -- 172.21.15.181:0/3760865770 wait complete. 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.755+0000 7f3e9a986640 1 Processor -- start 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.755+0000 7f3e9a986640 1 -- start start 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e9a986640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf2b0 0x7f3e940c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e9a986640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e940cf720 0x7f3e94155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e9a986640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e9415e640 0x7f3e940b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e9a986640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940b24f0 con 0x7f3e9415e640 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e9a986640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940b2210 con 0x7f3e940cf720 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e9a986640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3e940cfe40 con 0x7f3e940cf2b0 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e9415e640 0x7f3e940b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e9415e640 0x7f3e940b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36666/0 (socket says 172.21.15.181:36666) 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 -- 172.21.15.181:0/3926199593 learned_addr learned my addr 172.21.15.181:0/3926199593 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e937fe640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e940cf720 0x7f3e94155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e93fff640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf2b0 0x7f3e940c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 -- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf2b0 msgr2=0x7f3e940c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf2b0 0x7f3e940c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 -- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e940cf720 msgr2=0x7f3e94155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e940cf720 0x7f3e94155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 -- 172.21.15.181:0/3926199593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e941f7850 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e98f23640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e9415e640 0x7f3e940b4180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009eb0 tx=0x7f3e8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e90ff9640 1 -- 172.21.15.181:0/3926199593 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c03f070 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e90ff9640 1 -- 172.21.15.181:0/3926199593 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c030850 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e941f7b30 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.756+0000 7f3e90ff9640 1 -- 172.21.15.181:0/3926199593 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c030c40 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.757+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e941f80f0 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.757+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e94068eb0 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.758+0000 7f3e90ff9640 1 -- 172.21.15.181:0/3926199593 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e8c043410 con 0x7f3e9415e640 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.758+0000 7f3e90ff9640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3e8006be60 0x7f3e8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.758+0000 7f3e90ff9640 1 -- 172.21.15.181:0/3926199593 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f3e8c0abe90 con 0x7f3e9415e640 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.758+0000 7f3e93fff640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3e8006be60 0x7f3e8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.759+0000 7f3e93fff640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3e8006be60 0x7f3e8006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3e84005880 tx=0x7f3e84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.763+0000 7f3e90ff9640 1 -- 172.21.15.181:0/3926199593 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e8c07a170 con 0x7f3e9415e640 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.963+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e940b34e0 con 0x7f3e9415e640 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.964+0000 7f3e90ff9640 1 -- 172.21.15.181:0/3926199593 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5253 (secure 0 0 0) 0x7f3e8c07e470 con 0x7f3e9415e640 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":45,"btime":"2024-09-12T02:33:45:151849+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2505607206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2505607206},{"type":"v1","addr":"172.21.15.181:6837","nonce":2505607206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":45,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:33:45.106412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6144,"mds_1":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"d","rank":1,"incarnation":42,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6834/1808682347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1808682347},{"type":"v1","addr":"172.21.15.204:6834","nonce":1808682347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6141,6144]},"id":4}]} 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 45 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3e8006be60 msgr2=0x7f3e8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3e8006be60 0x7f3e8006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3e84005880 tx=0x7f3e84009040 comp rx=0 tx=0).stop 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e9415e640 msgr2=0x7f3e940b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e9415e640 0x7f3e940b4180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009eb0 tx=0x7f3e8c004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 shutdown_connections 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3e8006be60 0x7f3e8006e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e940cf720 0x7f3e94155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e9415e640 0x7f3e940b4180 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 --2- 172.21.15.181:0/3926199593 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e940cf2b0 0x7f3e940c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 >> 172.21.15.181:0/3926199593 conn(0x7f3e9409d820 msgr2=0x7f3e9415bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 shutdown_connections 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:33:59.966+0000 7f3e9a986640 1 -- 172.21.15.181:0/3926199593 wait complete. 2024-09-12T02:33:59.977 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi204.stdout:{"message":"","return_code":0} 2024-09-12T02:34:00.240 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T02:34:00.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.338+0000 7f1cf6a4c640 1 Processor -- start 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.338+0000 7f1cf6a4c640 1 -- start start 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cf6a4c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1cf00cd880 0x7f1cf00b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cf6a4c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf00731f0 con 0x7f1cf0156990 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cf6a4c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf00ce160 con 0x7f1cf00b22c0 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cf6a4c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1cf0156d70 con 0x7f1cf00cd880 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cef7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1cf00cd880 0x7f1cf00b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1ceffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1cf0156990 0x7f1cf00cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33668/0 (socket says 172.21.15.181:33668) 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1ceffff640 1 -- 172.21.15.181:0/3074511494 learned_addr learned my addr 172.21.15.181:0/3074511494 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cef7fe640 1 -- 172.21.15.181:0/3074511494 >> v1:172.21.15.204:6789/0 conn(0x7f1cf00b22c0 legacy=0x7f1cf015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cef7fe640 1 -- 172.21.15.181:0/3074511494 >> v1:172.21.15.181:6789/0 conn(0x7f1cf0156990 legacy=0x7f1cf00cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.339+0000 7f1cef7fe640 1 -- 172.21.15.181:0/3074511494 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf00ce440 con 0x7f1cf00cd880 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.340+0000 7f1cef7fe640 1 --2- 172.21.15.181:0/3074511494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf00cd880 0x7f1cf00b1d80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097a0 tx=0x7f1ce402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25d3c0664adc397 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.340+0000 7f1ceeffd640 1 -- 172.21.15.181:0/3074511494 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4037070 con 0x7f1cf00cd880 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.340+0000 7f1ceeffd640 1 -- 172.21.15.181:0/3074511494 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce4032440 con 0x7f1cf00cd880 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.340+0000 7f1ceeffd640 1 -- 172.21.15.181:0/3074511494 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4032810 con 0x7f1cf00cd880 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.341+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/3074511494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf00cd880 msgr2=0x7f1cf00b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.341+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/3074511494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf00cd880 0x7f1cf00b1d80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097a0 tx=0x7f1ce402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.341+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/3074511494 shutdown_connections 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.341+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/3074511494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf00cd880 0x7f1cf00b1d80 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.341+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/3074511494 >> 172.21.15.181:0/3074511494 conn(0x7f1cf006bc10 msgr2=0x7f1cf006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.341+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/3074511494 shutdown_connections 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.341+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/3074511494 wait complete. 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.342+0000 7f1cf6a4c640 1 Processor -- start 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.342+0000 7f1cf6a4c640 1 -- start start 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf6a4c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cf00b22c0 0x7f1cf014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf6a4c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cf00cd880 0x7f1cf014f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf6a4c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf0156990 0x7f1cf015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf6a4c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00b26d0 con 0x7f1cf0156990 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf6a4c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00cea90 con 0x7f1cf00b22c0 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf6a4c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf00cef20 con 0x7f1cf00cd880 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf0156990 0x7f1cf015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf0156990 0x7f1cf015c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36686/0 (socket says 172.21.15.181:36686) 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 -- 172.21.15.181:0/1464848290 learned_addr learned my addr 172.21.15.181:0/1464848290 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1ceffff640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cf00b22c0 0x7f1cf014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cef7fe640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cf00cd880 0x7f1cf014f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 -- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cf00cd880 msgr2=0x7f1cf014f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cf00cd880 0x7f1cf014f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 -- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cf00b22c0 msgr2=0x7f1cf014ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cf00b22c0 0x7f1cf014ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.343+0000 7f1cf4fe9640 1 -- 172.21.15.181:0/1464848290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf015db00 con 0x7f1cf0156990 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.344+0000 7f1cf4fe9640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf0156990 0x7f1cf015c8d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c7a0 tx=0x7f1ce800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.344+0000 7f1cecff9640 1 -- 172.21.15.181:0/1464848290 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8003b70 con 0x7f1cf0156990 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.344+0000 7f1cecff9640 1 -- 172.21.15.181:0/1464848290 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce8003d30 con 0x7f1cf0156990 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.344+0000 7f1cecff9640 1 -- 172.21.15.181:0/1464848290 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce800aa90 con 0x7f1cf0156990 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.344+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf015dde0 con 0x7f1cf0156990 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.344+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf00b3440 con 0x7f1cf0156990 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.345+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf00b1d80 con 0x7f1cf0156990 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.345+0000 7f1cecff9640 1 -- 172.21.15.181:0/1464848290 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ce800ac30 con 0x7f1cf0156990 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.345+0000 7f1cecff9640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1cdc06be30 0x7f1cdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.346+0000 7f1cecff9640 1 -- 172.21.15.181:0/1464848290 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1ce808abe0 con 0x7f1cf0156990 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.346+0000 7f1ceffff640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1cdc06be30 0x7f1cdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.346+0000 7f1ceffff640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1cdc06be30 0x7f1cdc06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005880 tx=0x7f1ce0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.350+0000 7f1cecff9640 1 -- 172.21.15.181:0/1464848290 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ce8058fd0 con 0x7f1cf0156990 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.547+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1cf014f8c0 con 0x7f1cf0156990 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.547+0000 7f1cecff9640 1 -- 172.21.15.181:0/1464848290 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5253 (secure 0 0 0) 0x7f1ce805d2d0 con 0x7f1cf0156990 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":45,"btime":"2024-09-12T02:33:45:151849+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2505607206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2505607206},{"type":"v1","addr":"172.21.15.181:6837","nonce":2505607206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":45,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:33:45.106412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6144,"mds_1":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"d","rank":1,"incarnation":42,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6834/1808682347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1808682347},{"type":"v1","addr":"172.21.15.204:6834","nonce":1808682347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6141,6144]},"id":4}]} 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 45 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1cdc06be30 msgr2=0x7f1cdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1cdc06be30 0x7f1cdc06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005880 tx=0x7f1ce0009040 comp rx=0 tx=0).stop 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf0156990 msgr2=0x7f1cf015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf0156990 0x7f1cf015c8d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c7a0 tx=0x7f1ce800cc60 comp rx=0 tx=0).stop 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 shutdown_connections 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1cdc06be30 0x7f1cdc06e2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cf0156990 0x7f1cf015c8d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cf00cd880 0x7f1cf014f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 --2- 172.21.15.181:0/1464848290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cf00b22c0 0x7f1cf014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 >> 172.21.15.181:0/1464848290 conn(0x7f1cf006bc10 msgr2=0x7f1cf00cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 shutdown_connections 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.549+0000 7f1cf6a4c640 1 -- 172.21.15.181:0/1464848290 wait complete. 2024-09-12T02:34:00.561 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-12T02:34:00.813 INFO:teuthology.orchestra.run.smithi204.stdout:{"message":"","return_code":0} 2024-09-12T02:34:00.814 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T02:34:00.814 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 4:1 2024-09-12T02:34:00.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.915+0000 7fe8913c4640 1 Processor -- start 2024-09-12T02:34:00.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.915+0000 7fe8913c4640 1 -- start start 2024-09-12T02:34:00.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe8913c4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe88c0d1e10 0x7fe88c0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe8913c4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe88c0d3040 con 0x7fe88c161c60 2024-09-12T02:34:00.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe8913c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe88c073050 con 0x7fe88c06cd90 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe8913c4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe88c0d2df0 con 0x7fe88c0d1e10 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe88b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe88c0d1e10 0x7fe88c0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe88affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe88c161c60 0x7fe88c06d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33672/0 (socket says 172.21.15.181:33672) 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe88affd640 1 -- 172.21.15.181:0/1834277404 learned_addr learned my addr 172.21.15.181:0/1834277404 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.916+0000 7fe88b7fe640 1 -- 172.21.15.181:0/1834277404 >> v1:172.21.15.204:6789/0 conn(0x7fe88c06cd90 legacy=0x7fe88c0d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.917+0000 7fe88b7fe640 1 -- 172.21.15.181:0/1834277404 >> v1:172.21.15.181:6789/0 conn(0x7fe88c161c60 legacy=0x7fe88c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.917+0000 7fe88b7fe640 1 -- 172.21.15.181:0/1834277404 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c073330 con 0x7fe88c0d1e10 2024-09-12T02:34:00.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.917+0000 7fe889ffb640 1 -- 172.21.15.181:0/1834277404 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2813582079 0 0) 0x7fe88c0d3040 con 0x7fe88c161c60 2024-09-12T02:34:00.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.917+0000 7fe88b7fe640 1 --2- 172.21.15.181:0/1834277404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c0b4090 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe884009d90 tx=0x7fe88402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56158489650c0b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.917+0000 7fe889ffb640 1 -- 172.21.15.181:0/1834277404 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884007740 con 0x7fe88c0d1e10 2024-09-12T02:34:00.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.917+0000 7fe889ffb640 1 -- 172.21.15.181:0/1834277404 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8840078e0 con 0x7fe88c0d1e10 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.917+0000 7fe889ffb640 1 -- 172.21.15.181:0/1834277404 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884007cb0 con 0x7fe88c0d1e10 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.918+0000 7fe8913c4640 1 -- 172.21.15.181:0/1834277404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 msgr2=0x7fe88c0b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.918+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1834277404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c0b4090 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe884009d90 tx=0x7fe88402a580 comp rx=0 tx=0).stop 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.918+0000 7fe8913c4640 1 -- 172.21.15.181:0/1834277404 shutdown_connections 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.918+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1834277404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c0b4090 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.918+0000 7fe8913c4640 1 -- 172.21.15.181:0/1834277404 >> 172.21.15.181:0/1834277404 conn(0x7fe88c067950 msgr2=0x7fe88c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.918+0000 7fe8913c4640 1 -- 172.21.15.181:0/1834277404 shutdown_connections 2024-09-12T02:34:00.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.918+0000 7fe8913c4640 1 -- 172.21.15.181:0/1834277404 wait complete. 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.919+0000 7fe8913c4640 1 Processor -- start 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.919+0000 7fe8913c4640 1 -- start start 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe8913c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88c06cd90 0x7fe88c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe8913c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe8913c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe88c161c60 0x7fe88c152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe8913c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c074100 con 0x7fe88c0d1e10 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe8913c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c0d2240 con 0x7fe88c161c60 2024-09-12T02:34:00.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe8913c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe88c0d1530 con 0x7fe88c06cd90 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36698/0 (socket says 172.21.15.181:36698) 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 -- 172.21.15.181:0/1240543685 learned_addr learned my addr 172.21.15.181:0/1240543685 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88b7fe640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe88c161c60 0x7fe88c152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88affd640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88c06cd90 0x7fe88c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 -- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88c06cd90 msgr2=0x7fe88c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88c06cd90 0x7fe88c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 -- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe88c161c60 msgr2=0x7fe88c152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe88c161c60 0x7fe88c152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88a7fc640 1 -- 172.21.15.181:0/1240543685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c153cf0 con 0x7fe88c0d1e10 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.920+0000 7fe88affd640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88c06cd90 0x7fe88c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.921+0000 7fe88a7fc640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c152a90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b420 tx=0x7fe88000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.921+0000 7fe8737fe640 1 -- 172.21.15.181:0/1240543685 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880011830 con 0x7fe88c0d1e10 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.921+0000 7fe8737fe640 1 -- 172.21.15.181:0/1240543685 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe880016070 con 0x7fe88c0d1e10 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.921+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c0b27e0 con 0x7fe88c0d1e10 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.921+0000 7fe8737fe640 1 -- 172.21.15.181:0/1240543685 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880011c10 con 0x7fe88c0d1e10 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.921+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c0b2da0 con 0x7fe88c0d1e10 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.922+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88c0d0e20 con 0x7fe88c0d1e10 2024-09-12T02:34:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.922+0000 7fe8737fe640 1 -- 172.21.15.181:0/1240543685 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe88001b460 con 0x7fe88c0d1e10 2024-09-12T02:34:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.923+0000 7fe8737fe640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe87806be30 0x7fe87806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.923+0000 7fe8737fe640 1 -- 172.21.15.181:0/1240543685 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe88008a8d0 con 0x7fe88c0d1e10 2024-09-12T02:34:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.923+0000 7fe88affd640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe87806be30 0x7fe87806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.923+0000 7fe88affd640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe87806be30 0x7fe87806e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000f60 tx=0x7fe87c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:00.927+0000 7fe8737fe640 1 -- 172.21.15.181:0/1240543685 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe880020020 con 0x7fe88c0d1e10 2024-09-12T02:34:01.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.157+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "4:1"} v 0) -- 0x7fe88c0d1ab0 con 0x7fe88c0d1e10 2024-09-12T02:34:01.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.159+0000 7fe8737fe640 1 -- 172.21.15.181:0/1240543685 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "4:1"}]=0 failed mds gid 6141 v46) ==== 97+0+0 (secure 0 0 0) 0x7fe880059280 con 0x7fe88c0d1e10 2024-09-12T02:34:01.160 INFO:teuthology.orchestra.run.smithi181.stderr:failed mds gid 6141 2024-09-12T02:34:01.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe87806be30 msgr2=0x7fe87806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe87806be30 0x7fe87806e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000f60 tx=0x7fe87c009040 comp rx=0 tx=0).stop 2024-09-12T02:34:01.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 msgr2=0x7fe88c152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c152a90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b420 tx=0x7fe88000b8e0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 shutdown_connections 2024-09-12T02:34:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe87806be30 0x7fe87806e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe88c161c60 0x7fe88c152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe88c0d1e10 0x7fe88c152a90 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 --2- 172.21.15.181:0/1240543685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88c06cd90 0x7fe88c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 >> 172.21.15.181:0/1240543685 conn(0x7fe88c067950 msgr2=0x7fe88c160ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 shutdown_connections 2024-09-12T02:34:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.162+0000 7fe8913c4640 1 -- 172.21.15.181:0/1240543685 wait complete. 2024-09-12T02:34:01.174 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-12T02:34:01.201 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:34:01.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.214+0000 7fd2634eaf40 1 Processor -- start 2024-09-12T02:34:01.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.214+0000 7fd2634eaf40 1 -- start start 2024-09-12T02:34:01.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd2634eaf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343ba0500 0x565343b59f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd2634eaf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 0x565343c2dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd2634eaf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343c188a0 0x565343b870f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd2634eaf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565343b58a50 con 0x565343ba0500 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd2634eaf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x565343aab510 con 0x565343c184c0 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd2634eaf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x565343b58cf0 con 0x565343c188a0 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343ba0500 0x565343b59f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343ba0500 0x565343b59f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36724/0 (socket says 172.21.15.181:36724) 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 -- 172.21.15.181:0/2485332240 learned_addr learned my addr 172.21.15.181:0/2485332240 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd2617e1640 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343c188a0 0x565343b870f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd25bfff640 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 0x565343c2dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 -- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343c188a0 msgr2=0x565343b870f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343c188a0 0x565343b870f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 -- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 msgr2=0x565343c2dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 0x565343c2dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.215+0000 7fd260fe0640 1 -- 172.21.15.181:0/2485332240 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343c2e650 con 0x565343ba0500 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd260fe0640 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343ba0500 0x565343b59f40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd254000c00 tx=0x7fd254051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19424eaabb6c99fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd25affd640 1 -- 172.21.15.181:0/2485332240 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254068070 con 0x565343ba0500 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd25affd640 1 -- 172.21.15.181:0/2485332240 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2540516f0 con 0x565343ba0500 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd25affd640 1 -- 172.21.15.181:0/2485332240 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254055070 con 0x565343ba0500 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 -- 172.21.15.181:0/2485332240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343ba0500 msgr2=0x565343b59f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343ba0500 0x565343b59f40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd254000c00 tx=0x7fd254051000 comp rx=0 tx=0).stop 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 -- 172.21.15.181:0/2485332240 shutdown_connections 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 0x565343c2dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343c188a0 0x565343b870f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/2485332240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343ba0500 0x565343b59f40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 -- 172.21.15.181:0/2485332240 >> 172.21.15.181:0/2485332240 conn(0x565343b839f0 msgr2=0x565343c31ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 -- 172.21.15.181:0/2485332240 shutdown_connections 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.216+0000 7fd2634eaf40 1 -- 172.21.15.181:0/2485332240 wait complete. 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.217+0000 7fd2634eaf40 1 Processor -- start 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.217+0000 7fd2634eaf40 1 -- start start 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343ba0500 0x565343c2f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 0x565343c0c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343c188a0 0x565343c2cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565343c315f0 con 0x565343c188a0 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x565343c321f0 con 0x565343c184c0 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x565343c32490 con 0x565343ba0500 2024-09-12T02:34:01.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343c188a0 0x565343c2cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343c188a0 0x565343c2cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36726/0 (socket says 172.21.15.181:36726) 2024-09-12T02:34:01.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 learned_addr learned my addr 172.21.15.181:0/3602761158 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343ba0500 0x565343c2f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 0x565343c0c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343ba0500 msgr2=0x565343c2f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565343ba0500 0x565343c2f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 msgr2=0x565343c0c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565343c184c0 0x565343c0c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565343c2d180 con 0x565343c188a0 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343c188a0 0x565343c2cc40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00d410 tx=0x7fd25c00d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd259ffb640 1 -- 172.21.15.181:0/3602761158 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c013480 con 0x565343c188a0 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd259ffb640 1 -- 172.21.15.181:0/3602761158 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25c018070 con 0x565343c188a0 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565343ba3760 con 0x565343c188a0 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd259ffb640 1 -- 172.21.15.181:0/3602761158 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c013860 con 0x565343c188a0 2024-09-12T02:34:01.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.218+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565343b9f850 con 0x565343c188a0 2024-09-12T02:34:01.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.220+0000 7fd259ffb640 1 -- 172.21.15.181:0/3602761158 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd25c013c10 con 0x565343c188a0 2024-09-12T02:34:01.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.220+0000 7fd259ffb640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd24406a840 0x7fd24406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.220+0000 7fd259ffb640 1 -- 172.21.15.181:0/3602761158 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7fd25c089cc0 con 0x565343c188a0 2024-09-12T02:34:01.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.220+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd24406a840 0x7fd24406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.220+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x565343c2d5e0 0x565343b9a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.220+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x565343c2d5e0 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.220+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x565343c2d5e0 0x565343b9a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.221+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd24406a840 0x7fd24406cd00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd254045b60 tx=0x7fd254053000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.221+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x565343c2d5e0 0x565343b9a4c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.221+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 [pgnls start_epoch 61 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c009810 con 0x565343c2d5e0 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.221+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd24c007900 0x7fd24c006380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.221+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c007900 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.221+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd24c007900 0x7fd24c006380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.222+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd24c007900 0x7fd24c006380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.224+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(2 [pgnls start_epoch 61 out=201b] v60'12 uv12 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7fd254057030 con 0x7fd24c007900 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.224+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd25405a070 0x7fd25406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.224+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25405a070 2024-09-12T02:34:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.224+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd25405a070 0x7fd25406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.225+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd25405a070 0x7fd25406e950 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.225+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== osd_op_reply(3 [pgnls start_epoch 61 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25405a070 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.225+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd24c01c040 0x7fd24c01c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.225+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01c040 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.225+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd24c01c040 0x7fd24c01c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.225+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd24c01c040 0x7fd24c01c930 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.227+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(4 [pgnls start_epoch 61 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01c040 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.227+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25405a070 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.227+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== osd_op_reply(5 [pgnls start_epoch 61 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25405a070 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.227+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01c040 2024-09-12T02:34:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.228+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(6 [pgnls start_epoch 61 out=149b] v60'1546 uv1546 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01c040 2024-09-12T02:34:01.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.228+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd25c058200 0x7fd25c056e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.228+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c058200 2024-09-12T02:34:01.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.228+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd25c058200 0x7fd25c056e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.228+0000 7fd260fe0640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd25c058200 0x7fd25c056e60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.230+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(7 [pgnls start_epoch 61 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254057030 con 0x7fd25c058200 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.230+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25405a070 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.231+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.5 v2:172.21.15.204:6824/2921904049 3 ==== osd_op_reply(8 [pgnls start_epoch 61 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25405a070 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.231+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01c040 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.231+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(9 [pgnls start_epoch 61 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01c040 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.231+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd25c0606f0 0x7fd25c058930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.231+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c0606f0 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.231+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd25c0606f0 0x7fd25c058930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.231+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd25c0606f0 0x7fd25c058930 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.232+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(10 [pgnls start_epoch 61 out=73b] v60'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25c0606f0 2024-09-12T02:34:01.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.232+0000 7fd25bfff640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd24c01b3b0 0x7fd24c01b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.232+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01b3b0 2024-09-12T02:34:01.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.232+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd24c01b3b0 0x7fd24c01b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.232+0000 7fd2617e1640 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd24c01b3b0 0x7fd24c01b810 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.234+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(11 [pgnls start_epoch 61 out=77b] v60'13 uv13 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01b3b0 2024-09-12T02:34:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.234+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c058200 2024-09-12T02:34:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.234+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(12 [pgnls start_epoch 61 out=49b] v59'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254057030 con 0x7fd25c058200 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.234+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c058200 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.234+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(13 [pgnls start_epoch 61 out=77b] v60'15 uv15 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7fd254057030 con 0x7fd25c058200 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.234+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x565343c2d5e0 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(14 [pgnls start_epoch 61 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd24c009810 con 0x565343c2d5e0 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c058200 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(15 [pgnls start_epoch 61 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd254057030 con 0x7fd25c058200 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x565343c2d5e0 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(16 [pgnls start_epoch 61 out=49b] v59'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c009810 con 0x565343c2d5e0 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01b3b0 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(17 [pgnls start_epoch 61 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01b3b0 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.235+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25405a070 2024-09-12T02:34:01.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.5 v2:172.21.15.204:6824/2921904049 4 ==== osd_op_reply(18 [pgnls start_epoch 61 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25405a070 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c0606f0 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(19 [pgnls start_epoch 61 out=97b] v60'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25c0606f0 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25405a070 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.5 v2:172.21.15.204:6824/2921904049 5 ==== osd_op_reply(20 [pgnls start_epoch 61 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25405a070 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c0606f0 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(21 [pgnls start_epoch 61 out=73b] v60'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25c0606f0 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.236+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c007900 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.237+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== osd_op_reply(22 [pgnls start_epoch 61 out=127b] v60'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fd254057030 con 0x7fd24c007900 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.237+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25405a070 2024-09-12T02:34:01.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.237+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.5 v2:172.21.15.204:6824/2921904049 6 ==== osd_op_reply(23 [pgnls start_epoch 61 out=74b] v59'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd24c009810 con 0x7fd25405a070 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.237+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c058200 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.237+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(24 [pgnls start_epoch 61 out=73b] v60'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd254057030 con 0x7fd25c058200 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.237+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01b3b0 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.238+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.1 v2:172.21.15.181:6826/1372590643 3 ==== osd_op_reply(25 [pgnls start_epoch 61 out=100b] v60'3 uv3 ondisk = 1) ==== 144+0+100 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01b3b0 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.238+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x565343c2d5e0 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.238+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(26 [pgnls start_epoch 61 out=122b] v60'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7fd24c009810 con 0x565343c2d5e0 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.238+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x565343c2d5e0 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.238+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(27 [pgnls start_epoch 61 out=100b] v60'5 uv5 ondisk = 1) ==== 144+0+100 (crc 0 0 0) 0x7fd24c009810 con 0x565343c2d5e0 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.238+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01c040 2024-09-12T02:34:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.239+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(28 [pgnls start_epoch 61 out=122b] v60'1491 uv1491 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01c040 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.239+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c01b3b0 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.239+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 <== osd.1 v2:172.21.15.181:6826/1372590643 4 ==== osd_op_reply(29 [pgnls start_epoch 61 out=129b] v60'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7fd25c054610 con 0x7fd24c01b3b0 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.239+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd24c007900 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.239+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.7 v2:172.21.15.204:6808/3631554107 3 ==== osd_op_reply(30 [pgnls start_epoch 61 out=97b] v60'7 uv7 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7fd254057030 con 0x7fd24c007900 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.239+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x565343c2d5e0 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 <== osd.3 v2:172.21.15.181:6800/1415662156 6 ==== osd_op_reply(31 [pgnls start_epoch 61 out=73b] v59'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd24c009810 con 0x565343c2d5e0 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd25bfff640 1 -- 172.21.15.181:0/3602761158 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 61 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e61) -- 0x565343c17b30 con 0x7fd25c058200 2024-09-12T02:34:01.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd260fe0640 1 -- 172.21.15.181:0/3602761158 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(32 [pgnls start_epoch 61 out=101b] v60'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7fd254057030 con 0x7fd25c058200 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:601.00000000 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:602.00000000 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:10000000000.00000000 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:600.00000000 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:603.00000000 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:60a.00000000 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:613.00000000 2024-09-12T02:34:01.246 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000.inode 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:610.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:606.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:607.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:60e.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:mds1_openfiles.0 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_openfiles.0 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:60f.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:608.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:501.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:612.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:401.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:604.00000000 2024-09-12T02:34:01.247 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000.inode 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:500.00000000 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:mds_snaptable 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:605.00000000 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:mds1_sessionmap 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_inotable 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:611.00000000 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_sessionmap 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:60c.00000000 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:201.00000001 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:mds1_inotable 2024-09-12T02:34:01.248 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000002 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:609.00000000 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:10000000001.00000000 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:60b.00000000 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:60d.00000000 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:201.00000000 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:400.00000000 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000.inode 2024-09-12T02:34:01.249 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd25c058200 msgr2=0x7fd25c056e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd25c058200 0x7fd25c056e60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd24c01b3b0 msgr2=0x7fd24c01b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd24c01b3b0 0x7fd24c01b810 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x565343c2d5e0 msgr2=0x565343b9a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x565343c2d5e0 0x565343b9a4c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd24c01c040 msgr2=0x7fd24c01c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd24c01c040 0x7fd24c01c930 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd25405a070 msgr2=0x7fd25406e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd25405a070 0x7fd25406e950 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd25c0606f0 msgr2=0x7fd25c058930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd25c0606f0 0x7fd25c058930 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd24c007900 msgr2=0x7fd24c006380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 reap_dead start 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd24c007900 0x7fd24c006380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 reap_dead start 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2617e1640 1 -- 172.21.15.181:0/3602761158 reap_dead start 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd24406a840 msgr2=0x7fd24406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd24406a840 0x7fd24406cd00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd254045b60 tx=0x7fd254053000 comp rx=0 tx=0).stop 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343c188a0 msgr2=0x565343c2cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343c188a0 0x565343c2cc40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00d410 tx=0x7fd25c00d810 comp rx=0 tx=0).stop 2024-09-12T02:34:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 shutdown_connections 2024-09-12T02:34:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd24c007900 0x7fd24c006380 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd24406a840 0x7fd24406cd00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 --2- 172.21.15.181:0/3602761158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565343c188a0 0x565343c2cc40 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 >> 172.21.15.181:0/3602761158 conn(0x565343b839f0 msgr2=0x565343b59f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 shutdown_connections 2024-09-12T02:34:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.240+0000 7fd2634eaf40 1 -- 172.21.15.181:0/3602761158 wait complete. 2024-09-12T02:34:01.253 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_openfiles.0 2024-09-12T02:34:01.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.333+0000 7fdf405d1f40 1 Processor -- start 2024-09-12T02:34:01.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.333+0000 7fdf405d1f40 1 -- start start 2024-09-12T02:34:01.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf405d1f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f4741750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf405d1f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f46fc760 0x55b2f4724880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf405d1f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f47b7610 0x55b2f4728040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf405d1f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b2f464b510 con 0x55b2f46fad00 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf405d1f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b2f46a4c50 con 0x55b2f46fc760 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf405d1f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b2f46f8f70 con 0x55b2f47b7610 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f4741750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f4741750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36734/0 (socket says 172.21.15.181:36734) 2024-09-12T02:34:01.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/105930812 learned_addr learned my addr 172.21.15.181:0/105930812 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf358c6640 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f46fc760 0x55b2f4724880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e8c8640 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f47b7610 0x55b2f4728040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f47b7610 msgr2=0x55b2f4728040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f47b7610 0x55b2f4728040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f46fc760 msgr2=0x55b2f4724880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f46fc760 0x55b2f4724880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/105930812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f47b41b0 con 0x55b2f46fad00 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3e0c7640 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f4741750 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdf30001d40 tx=0x7fdf3000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d717d6b25fc4d438 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3d0c5640 1 -- 172.21.15.181:0/105930812 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000bd80 con 0x55b2f46fad00 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3d0c5640 1 -- 172.21.15.181:0/105930812 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3000f400 con 0x55b2f46fad00 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.334+0000 7fdf3d0c5640 1 -- 172.21.15.181:0/105930812 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000f7f0 con 0x55b2f46fad00 2024-09-12T02:34:01.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 -- 172.21.15.181:0/105930812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 msgr2=0x55b2f4741750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f4741750 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdf30001d40 tx=0x7fdf3000b5b0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 -- 172.21.15.181:0/105930812 shutdown_connections 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f46fc760 0x55b2f4724880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f47b7610 0x55b2f4728040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/105930812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f4741750 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 -- 172.21.15.181:0/105930812 >> 172.21.15.181:0/105930812 conn(0x55b2f4723a00 msgr2=0x55b2f4740770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 -- 172.21.15.181:0/105930812 shutdown_connections 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 -- 172.21.15.181:0/105930812 wait complete. 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 Processor -- start 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.335+0000 7fdf405d1f40 1 -- start start 2024-09-12T02:34:01.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf405d1f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f47ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf405d1f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f46fc760 0x55b2f47cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf405d1f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f47b7610 0x55b2f4728430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf405d1f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b2f47d0ee0 con 0x55b2f46fad00 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf405d1f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b2f47acf70 con 0x55b2f47b7610 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf405d1f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b2f47ad1c0 con 0x55b2f46fc760 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f47ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f47ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36748/0 (socket says 172.21.15.181:36748) 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/1237028265 learned_addr learned my addr 172.21.15.181:0/1237028265 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e8c8640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f47b7610 0x55b2f4728430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf358c6640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f46fc760 0x55b2f47cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/1237028265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f46fc760 msgr2=0x55b2f47cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b2f46fc760 0x55b2f47cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/1237028265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f47b7610 msgr2=0x55b2f4728430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b2f47b7610 0x55b2f4728430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.336+0000 7fdf3e0c7640 1 -- 172.21.15.181:0/1237028265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f485a300 con 0x55b2f46fad00 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.337+0000 7fdf3e0c7640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f47ae730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55b2f4741cc0 tx=0x7fdf30000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.337+0000 7fdf37fff640 1 -- 172.21.15.181:0/1237028265 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3001c440 con 0x55b2f46fad00 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.337+0000 7fdf37fff640 1 -- 172.21.15.181:0/1237028265 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3001c5e0 con 0x55b2f46fad00 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.337+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2f485a5e0 con 0x55b2f46fad00 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.337+0000 7fdf37fff640 1 -- 172.21.15.181:0/1237028265 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3001c9f0 con 0x55b2f46fad00 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.337+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f485b0c0 con 0x55b2f46fad00 2024-09-12T02:34:01.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.338+0000 7fdf37fff640 1 -- 172.21.15.181:0/1237028265 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf30017030 con 0x55b2f46fad00 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.338+0000 7fdf37fff640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf2006a810 0x7fdf2006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.339+0000 7fdf37fff640 1 -- 172.21.15.181:0/1237028265 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7fdf3008b5c0 con 0x55b2f46fad00 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.339+0000 7fdf358c6640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf2006a810 0x7fdf2006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.339+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b2f4863c80 0x55b2f4858640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.339+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 8.a 8:54ba6923:::mds1_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e61) -- 0x55b2f485b380 con 0x55b2f4863c80 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.339+0000 7fdf3e8c8640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b2f4863c80 0x55b2f4858640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.339+0000 7fdf358c6640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf2006a810 0x7fdf2006ccd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdf28057000 tx=0x7fdf28052000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.339+0000 7fdf3e8c8640 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b2f4863c80 0x55b2f4858640 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf3e8c8640 1 -- 172.21.15.181:0/1237028265 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds1_openfiles.0 [delete] v61'14 uv14 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7fdf38001650 con 0x55b2f4863c80 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b2f4863c80 msgr2=0x55b2f4858640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b2f4863c80 0x55b2f4858640 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf2006a810 msgr2=0x7fdf2006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf2006a810 0x7fdf2006ccd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdf28057000 tx=0x7fdf28052000 comp rx=0 tx=0).stop 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 msgr2=0x55b2f47ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 --2- 172.21.15.181:0/1237028265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b2f46fad00 0x55b2f47ae730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55b2f4741cc0 tx=0x7fdf30000bc0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf3e8c8640 1 -- 172.21.15.181:0/1237028265 reap_dead start 2024-09-12T02:34:01.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 shutdown_connections 2024-09-12T02:34:01.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 >> 172.21.15.181:0/1237028265 conn(0x55b2f4723a00 msgr2=0x55b2f4740770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 shutdown_connections 2024-09-12T02:34:01.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.341+0000 7fdf405d1f40 1 -- 172.21.15.181:0/1237028265 wait complete. 2024-09-12T02:34:01.350 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_sessionmap 2024-09-12T02:34:01.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.431+0000 7f332fdfdf40 1 Processor -- start 2024-09-12T02:34:01.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.431+0000 7f332fdfdf40 1 -- start start 2024-09-12T02:34:01.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332fdfdf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0140660 0x55dec0216430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332fdfdf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec0187980 0x55dec020d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332fdfdf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec02116c0 0x55dec020c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332fdfdf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dec013ed40 con 0x55dec0187980 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332fdfdf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55dec0091510 con 0x55dec0140660 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332fdfdf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55dec013efe0 con 0x55dec02116c0 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec0187980 0x55dec020d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec0187980 0x55dec020d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36758/0 (socket says 172.21.15.181:36758) 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 -- 172.21.15.181:0/1585379803 learned_addr learned my addr 172.21.15.181:0/1585379803 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d8f3640 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0140660 0x55dec0216430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332e0f4640 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec02116c0 0x55dec020c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 -- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec02116c0 msgr2=0x55dec020c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec02116c0 0x55dec020c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 -- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0140660 msgr2=0x55dec0216430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0140660 0x55dec0216430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 -- 172.21.15.181:0/1585379803 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec01890f0 con 0x55dec0187980 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f332d0f2640 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec0187980 0x55dec020d340 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f332400b2f0 tx=0x7f332400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cedd10ceeba70dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f331ffff640 1 -- 172.21.15.181:0/1585379803 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324012020 con 0x55dec0187980 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f331ffff640 1 -- 172.21.15.181:0/1585379803 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332400e670 con 0x55dec0187980 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.432+0000 7f331ffff640 1 -- 172.21.15.181:0/1585379803 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332400ea20 con 0x55dec0187980 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 -- 172.21.15.181:0/1585379803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec0187980 msgr2=0x55dec020d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec0187980 0x55dec020d340 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f332400b2f0 tx=0x7f332400b7b0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 -- 172.21.15.181:0/1585379803 shutdown_connections 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec02116c0 0x55dec020c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec0187980 0x55dec020d340 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/1585379803 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0140660 0x55dec0216430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 -- 172.21.15.181:0/1585379803 >> 172.21.15.181:0/1585379803 conn(0x55dec0169a00 msgr2=0x55dec016e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 -- 172.21.15.181:0/1585379803 shutdown_connections 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 -- 172.21.15.181:0/1585379803 wait complete. 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.433+0000 7f332fdfdf40 1 Processor -- start 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332fdfdf40 1 -- start start 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332fdfdf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec0140660 0x55dec0208610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332fdfdf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0187980 0x55dec01867e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332fdfdf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec02116c0 0x55dec0186d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332fdfdf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dec01893d0 con 0x55dec02116c0 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332fdfdf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55dec01896b0 con 0x55dec0187980 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332fdfdf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55dec020bf00 con 0x55dec0140660 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332e0f4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec02116c0 0x55dec0186d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332d8f3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec0140660 0x55dec0208610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332d8f3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec0140660 0x55dec0208610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:50858/0 (socket says 172.21.15.181:50858) 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332d8f3640 1 -- 172.21.15.181:0/148792056 learned_addr learned my addr 172.21.15.181:0/148792056 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.434+0000 7f332d0f2640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0187980 0x55dec01867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332e0f4640 1 -- 172.21.15.181:0/148792056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec0140660 msgr2=0x55dec0208610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332e0f4640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec0140660 0x55dec0208610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332e0f4640 1 -- 172.21.15.181:0/148792056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0187980 msgr2=0x55dec01867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332e0f4640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55dec0187980 0x55dec01867e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332e0f4640 1 -- 172.21.15.181:0/148792056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec0210430 con 0x55dec02116c0 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332d8f3640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55dec0140660 0x55dec0208610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332e0f4640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec02116c0 0x55dec0186d20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55dec0216fc0 tx=0x7f3328008730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f331effd640 1 -- 172.21.15.181:0/148792056 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33280147e0 con 0x55dec02116c0 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f331effd640 1 -- 172.21.15.181:0/148792056 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332801a070 con 0x55dec02116c0 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f331effd640 1 -- 172.21.15.181:0/148792056 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328014b80 con 0x55dec02116c0 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dec020e1d0 con 0x55dec02116c0 2024-09-12T02:34:01.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.435+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec02109d0 con 0x55dec02116c0 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.436+0000 7f331effd640 1 -- 172.21.15.181:0/148792056 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3328015470 con 0x55dec02116c0 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f331effd640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f331006a810 0x7f331006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f331effd640 1 -- 172.21.15.181:0/148792056 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7f332808a2a0 con 0x55dec02116c0 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f332d8f3640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f331006a810 0x7f331006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55dec017ed00 0x55dec017f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 8.3 8:c27f454c:::mds1_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e61) -- 0x55dec017f620 con 0x55dec017ed00 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f332d0f2640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55dec017ed00 0x55dec017f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f332d8f3640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f331006a810 0x7f331006ccd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55dec020bd20 tx=0x7f3320007030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.437+0000 7f332d0f2640 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55dec017ed00 0x55dec017f0e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332d0f2640 1 -- 172.21.15.181:0/148792056 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds1_sessionmap [delete] v61'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f332400e820 con 0x55dec017ed00 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55dec017ed00 msgr2=0x55dec017f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55dec017ed00 0x55dec017f0e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f331006a810 msgr2=0x7f331006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f331006a810 0x7f331006ccd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55dec020bd20 tx=0x7f3320007030 comp rx=0 tx=0).stop 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec02116c0 msgr2=0x55dec0186d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 --2- 172.21.15.181:0/148792056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dec02116c0 0x55dec0186d20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55dec0216fc0 tx=0x7f3328008730 comp rx=0 tx=0).stop 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332e0f4640 1 -- 172.21.15.181:0/148792056 reap_dead start 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 shutdown_connections 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 >> 172.21.15.181:0/148792056 conn(0x55dec0169a00 msgr2=0x55dec0216430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 shutdown_connections 2024-09-12T02:34:01.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.439+0000 7f332fdfdf40 1 -- 172.21.15.181:0/148792056 wait complete. 2024-09-12T02:34:01.445 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_inotable 2024-09-12T02:34:01.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 Processor -- start 2024-09-12T02:34:01.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 -- start start 2024-09-12T02:34:01.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7477eb050 0x55a7478a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 0x55a7478c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7478c16b0 0x55a7478308c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a74773a510 con 0x55a7477eb050 2024-09-12T02:34:01.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a747793c50 con 0x55a74782cab0 2024-09-12T02:34:01.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa49056ef40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a7478c20d0 con 0x55a7478c16b0 2024-09-12T02:34:01.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.525+0000 7fa48e064640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7477eb050 0x55a7478a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7477eb050 0x55a7478a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36776/0 (socket says 172.21.15.181:36776) 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 -- 172.21.15.181:0/3407239958 learned_addr learned my addr 172.21.15.181:0/3407239958 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e865640 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7478c16b0 0x55a7478308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa485863640 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 0x55a7478c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 -- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7478c16b0 msgr2=0x55a7478308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7478c16b0 0x55a7478308c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 -- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 msgr2=0x55a7478c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 0x55a7478c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 -- 172.21.15.181:0/3407239958 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7477ea100 con 0x55a7477eb050 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e865640 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7478c16b0 0x55a7478308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48e064640 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7477eb050 0x55a7478a1290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa480045c80 tx=0x7fa480051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4055146c23cbaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48d062640 1 -- 172.21.15.181:0/3407239958 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480058950 con 0x55a7477eb050 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48d062640 1 -- 172.21.15.181:0/3407239958 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa480058af0 con 0x55a7477eb050 2024-09-12T02:34:01.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa48d062640 1 -- 172.21.15.181:0/3407239958 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480064460 con 0x55a7477eb050 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa49056ef40 1 -- 172.21.15.181:0/3407239958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7477eb050 msgr2=0x55a7478a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa49056ef40 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7477eb050 0x55a7478a1290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa480045c80 tx=0x7fa480051000 comp rx=0 tx=0).stop 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa49056ef40 1 -- 172.21.15.181:0/3407239958 shutdown_connections 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa49056ef40 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 0x55a7478c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa49056ef40 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7478c16b0 0x55a7478308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa49056ef40 1 --2- 172.21.15.181:0/3407239958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7477eb050 0x55a7478a1290 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.526+0000 7fa49056ef40 1 -- 172.21.15.181:0/3407239958 >> 172.21.15.181:0/3407239958 conn(0x55a747812a00 msgr2=0x55a747817590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.527+0000 7fa49056ef40 1 -- 172.21.15.181:0/3407239958 shutdown_connections 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.527+0000 7fa49056ef40 1 -- 172.21.15.181:0/3407239958 wait complete. 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.527+0000 7fa49056ef40 1 Processor -- start 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.527+0000 7fa49056ef40 1 -- start start 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa49056ef40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7477eb050 0x55a7478a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa49056ef40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 0x55a7478a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa49056ef40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7478c16b0 0x55a7478a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa49056ef40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7477ea8f0 con 0x55a7478c16b0 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa49056ef40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a7477ea610 con 0x55a74782cab0 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa49056ef40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a74782ef10 con 0x55a7477eb050 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7478c16b0 0x55a7478a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7478c16b0 0x55a7478a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36780/0 (socket says 172.21.15.181:36780) 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 -- 172.21.15.181:0/1512533420 learned_addr learned my addr 172.21.15.181:0/1512533420 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e064640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7477eb050 0x55a7478a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa485863640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 0x55a7478a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 -- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7477eb050 msgr2=0x55a7478a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7477eb050 0x55a7478a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 -- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 msgr2=0x55a7478a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a74782cab0 0x55a7478a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 -- 172.21.15.181:0/1512533420 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7478a4ff0 con 0x55a7478c16b0 2024-09-12T02:34:01.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.528+0000 7fa48e865640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7478c16b0 0x55a7478a8d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa488004270 tx=0x7fa48800d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.529+0000 7fa487fff640 1 -- 172.21.15.181:0/1512533420 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa488018070 con 0x55a7478c16b0 2024-09-12T02:34:01.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.529+0000 7fa487fff640 1 -- 172.21.15.181:0/1512533420 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48800de20 con 0x55a7478c16b0 2024-09-12T02:34:01.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.529+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7478a52d0 con 0x55a7478c16b0 2024-09-12T02:34:01.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.529+0000 7fa487fff640 1 -- 172.21.15.181:0/1512533420 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa488001540 con 0x55a7478c16b0 2024-09-12T02:34:01.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.529+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7478a5890 con 0x55a7478c16b0 2024-09-12T02:34:01.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.530+0000 7fa487fff640 1 -- 172.21.15.181:0/1512533420 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa48801b070 con 0x55a7478c16b0 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.530+0000 7fa487fff640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa47006a810 0x7fa47006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.530+0000 7fa487fff640 1 -- 172.21.15.181:0/1512533420 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7fa4880890a0 con 0x55a7478c16b0 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.530+0000 7fa48e064640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa47006a810 0x7fa47006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.531+0000 7fa49056ef40 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a74794e720 0x55a7478a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.531+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:1 8.1b 8:dbae76b5:::mds1_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e61) -- 0x55a747817a20 con 0x55a74794e720 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.531+0000 7fa485863640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a74794e720 0x55a7478a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.531+0000 7fa48e064640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa47006a810 0x7fa47006ccd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa480063000 tx=0x7fa480053000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.531+0000 7fa485863640 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a74794e720 0x55a7478a3db0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa485863640 1 -- 172.21.15.181:0/1512533420 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(1 mds1_inotable [delete] v61'1492 uv1492 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa47800e040 con 0x55a74794e720 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a74794e720 msgr2=0x55a7478a3db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55a74794e720 0x55a7478a3db0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa47006a810 msgr2=0x7fa47006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa47006a810 0x7fa47006ccd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa480063000 tx=0x7fa480053000 comp rx=0 tx=0).stop 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7478c16b0 msgr2=0x55a7478a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 --2- 172.21.15.181:0/1512533420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7478c16b0 0x55a7478a8d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa488004270 tx=0x7fa48800d5f0 comp rx=0 tx=0).stop 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa48e865640 1 -- 172.21.15.181:0/1512533420 reap_dead start 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 shutdown_connections 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 >> 172.21.15.181:0/1512533420 conn(0x55a747812a00 msgr2=0x55a7477e9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 shutdown_connections 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:34:01.533+0000 7fa49056ef40 1 -- 172.21.15.181:0/1512533420 wait complete. 2024-09-12T02:34:01.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:01.538 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-12T02:34:01.579 INFO:tasks.cephfs.test_journal_repair:Sleeping to check ls is blocked... 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:.: 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:alpha 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:bravo 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:./alpha: 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:file 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:file_0 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:file_1 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:file_10 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:file_100 2024-09-12T02:34:01.639 INFO:teuthology.orchestra.run.smithi181.stdout:file_101 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_102 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_103 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_104 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_105 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_106 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_107 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_108 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_109 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_11 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_110 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_111 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_112 2024-09-12T02:34:01.640 INFO:teuthology.orchestra.run.smithi181.stdout:file_113 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_114 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_115 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_116 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_117 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_118 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_119 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_12 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_120 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_121 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_122 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_123 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_124 2024-09-12T02:34:01.641 INFO:teuthology.orchestra.run.smithi181.stdout:file_125 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_126 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_127 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_128 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_129 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_13 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_130 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_131 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_132 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_133 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_134 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_135 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_136 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_137 2024-09-12T02:34:01.642 INFO:teuthology.orchestra.run.smithi181.stdout:file_138 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_139 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_14 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_140 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_141 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_142 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_143 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_144 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_145 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_146 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_147 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_148 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_149 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_15 2024-09-12T02:34:01.643 INFO:teuthology.orchestra.run.smithi181.stdout:file_150 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_151 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_152 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_153 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_154 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_155 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_156 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_157 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_158 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_159 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_16 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_160 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_161 2024-09-12T02:34:01.644 INFO:teuthology.orchestra.run.smithi181.stdout:file_162 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_163 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_164 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_165 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_166 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_167 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_168 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_169 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_17 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_170 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_171 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_172 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_173 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_174 2024-09-12T02:34:01.645 INFO:teuthology.orchestra.run.smithi181.stdout:file_175 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_176 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_177 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_178 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_179 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_18 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_180 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_181 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_182 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_183 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_184 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_185 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_186 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_187 2024-09-12T02:34:01.646 INFO:teuthology.orchestra.run.smithi181.stdout:file_188 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_189 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_19 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_190 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_191 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_192 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_193 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_194 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_195 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_196 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_197 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_198 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_199 2024-09-12T02:34:01.647 INFO:teuthology.orchestra.run.smithi181.stdout:file_2 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_20 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_200 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_201 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_202 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_203 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_204 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_205 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_206 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_207 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_208 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_209 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_21 2024-09-12T02:34:01.648 INFO:teuthology.orchestra.run.smithi181.stdout:file_210 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_211 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_212 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_213 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_214 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_215 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_216 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_217 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_218 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_219 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_22 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_220 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_221 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_222 2024-09-12T02:34:01.649 INFO:teuthology.orchestra.run.smithi181.stdout:file_223 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_224 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_225 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_226 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_227 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_228 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_229 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_23 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_230 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_231 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_232 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_233 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_234 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_235 2024-09-12T02:34:01.650 INFO:teuthology.orchestra.run.smithi181.stdout:file_236 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_237 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_238 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_239 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_24 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_240 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_241 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_242 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_243 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_244 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_245 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_246 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_247 2024-09-12T02:34:01.651 INFO:teuthology.orchestra.run.smithi181.stdout:file_248 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_249 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_25 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_250 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_251 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_252 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_253 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_254 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_255 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_256 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_257 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_258 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_259 2024-09-12T02:34:01.652 INFO:teuthology.orchestra.run.smithi181.stdout:file_26 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_260 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_261 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_262 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_263 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_264 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_265 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_266 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_267 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_268 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_269 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_27 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_270 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_271 2024-09-12T02:34:01.653 INFO:teuthology.orchestra.run.smithi181.stdout:file_272 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_273 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_274 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_275 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_276 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_277 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_278 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_279 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_28 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_280 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_281 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_282 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_283 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_284 2024-09-12T02:34:01.654 INFO:teuthology.orchestra.run.smithi181.stdout:file_285 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_286 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_287 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_288 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_289 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_29 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_290 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_291 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_292 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_293 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_294 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_295 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_296 2024-09-12T02:34:01.655 INFO:teuthology.orchestra.run.smithi181.stdout:file_297 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_298 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_299 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_3 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_30 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_300 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_301 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_302 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_303 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_304 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_305 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_306 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_307 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_308 2024-09-12T02:34:01.656 INFO:teuthology.orchestra.run.smithi181.stdout:file_309 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_31 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_310 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_311 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_312 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_313 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_314 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_315 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_316 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_317 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_318 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_319 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_32 2024-09-12T02:34:01.657 INFO:teuthology.orchestra.run.smithi181.stdout:file_320 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_321 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_322 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_323 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_324 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_325 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_326 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_327 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_328 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_329 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_33 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_330 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_331 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_332 2024-09-12T02:34:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:file_333 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_334 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_335 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_336 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_337 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_338 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_339 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_34 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_340 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_341 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_342 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_343 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_344 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_345 2024-09-12T02:34:01.659 INFO:teuthology.orchestra.run.smithi181.stdout:file_346 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_347 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_348 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_349 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_35 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_350 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_351 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_352 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_353 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_354 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_355 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_356 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_357 2024-09-12T02:34:01.660 INFO:teuthology.orchestra.run.smithi181.stdout:file_358 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_359 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_36 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_360 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_361 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_362 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_363 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_364 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_365 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_366 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_367 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_368 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_369 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_37 2024-09-12T02:34:01.661 INFO:teuthology.orchestra.run.smithi181.stdout:file_370 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_371 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_372 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_373 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_374 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_375 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_376 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_377 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_378 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_379 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_38 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_380 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_381 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_382 2024-09-12T02:34:01.662 INFO:teuthology.orchestra.run.smithi181.stdout:file_383 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_384 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_385 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_386 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_387 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_388 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_389 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_39 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_390 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_391 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_392 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_393 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_394 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_395 2024-09-12T02:34:01.663 INFO:teuthology.orchestra.run.smithi181.stdout:file_396 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_397 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_398 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_399 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_4 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_40 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_400 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_401 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_402 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_403 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_404 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_405 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_406 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_407 2024-09-12T02:34:01.664 INFO:teuthology.orchestra.run.smithi181.stdout:file_408 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_409 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_41 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_410 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_411 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_412 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_413 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_414 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_415 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_416 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_417 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_418 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_419 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_42 2024-09-12T02:34:01.665 INFO:teuthology.orchestra.run.smithi181.stdout:file_420 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_421 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_422 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_423 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_424 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_425 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_426 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_427 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_428 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_429 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_43 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_430 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_431 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_432 2024-09-12T02:34:01.666 INFO:teuthology.orchestra.run.smithi181.stdout:file_433 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_434 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_435 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_436 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_437 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_438 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_439 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_44 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_440 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_441 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_442 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_443 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_444 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_445 2024-09-12T02:34:01.667 INFO:teuthology.orchestra.run.smithi181.stdout:file_446 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_447 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_448 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_449 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_45 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_450 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_451 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_452 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_453 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_454 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_455 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_456 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_457 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_458 2024-09-12T02:34:01.668 INFO:teuthology.orchestra.run.smithi181.stdout:file_459 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_46 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_460 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_461 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_462 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_463 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_464 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_465 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_466 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_467 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_468 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_469 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_47 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_470 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_471 2024-09-12T02:34:01.669 INFO:teuthology.orchestra.run.smithi181.stdout:file_472 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_473 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_474 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_475 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_476 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_477 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_478 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_479 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_48 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_480 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_481 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_482 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_483 2024-09-12T02:34:01.670 INFO:teuthology.orchestra.run.smithi181.stdout:file_484 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_485 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_486 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_487 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_488 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_489 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_49 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_490 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_491 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_492 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_493 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_494 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_495 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_496 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_497 2024-09-12T02:34:01.671 INFO:teuthology.orchestra.run.smithi181.stdout:file_498 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_499 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_5 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_50 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_500 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_501 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_502 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_503 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_504 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_505 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_506 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_507 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_508 2024-09-12T02:34:01.672 INFO:teuthology.orchestra.run.smithi181.stdout:file_509 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_51 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_510 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_511 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_512 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_513 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_514 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_515 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_516 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_517 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_518 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_519 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_52 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_520 2024-09-12T02:34:01.673 INFO:teuthology.orchestra.run.smithi181.stdout:file_521 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_522 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_523 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_524 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_525 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_526 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_527 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_528 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_529 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_53 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_530 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_531 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_532 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_533 2024-09-12T02:34:01.674 INFO:teuthology.orchestra.run.smithi181.stdout:file_534 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_535 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_536 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_537 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_538 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_539 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_54 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_540 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_541 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_542 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_543 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_544 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_545 2024-09-12T02:34:01.675 INFO:teuthology.orchestra.run.smithi181.stdout:file_546 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_547 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_548 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_549 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_55 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_550 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_551 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_552 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_553 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_554 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_555 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_556 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_557 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_558 2024-09-12T02:34:01.676 INFO:teuthology.orchestra.run.smithi181.stdout:file_559 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_56 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_560 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_561 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_562 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_563 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_564 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_565 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_566 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_567 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_568 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_569 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_57 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_570 2024-09-12T02:34:01.677 INFO:teuthology.orchestra.run.smithi181.stdout:file_571 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_572 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_573 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_574 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_575 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_576 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_577 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_578 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_579 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_58 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_580 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_581 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_582 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_583 2024-09-12T02:34:01.678 INFO:teuthology.orchestra.run.smithi181.stdout:file_584 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_585 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_586 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_587 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_588 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_589 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_59 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_590 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_591 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_592 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_593 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_594 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_595 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_596 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_597 2024-09-12T02:34:01.679 INFO:teuthology.orchestra.run.smithi181.stdout:file_598 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_599 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_6 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_60 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_600 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_601 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_602 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_603 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_604 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_605 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_606 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_607 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_608 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_609 2024-09-12T02:34:01.680 INFO:teuthology.orchestra.run.smithi181.stdout:file_61 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_610 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_611 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_612 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_613 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_614 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_615 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_616 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_617 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_618 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_619 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_62 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_620 2024-09-12T02:34:01.681 INFO:teuthology.orchestra.run.smithi181.stdout:file_621 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_622 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_623 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_624 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_625 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_626 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_627 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_628 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_629 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_63 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_630 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_631 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_632 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_633 2024-09-12T02:34:01.682 INFO:teuthology.orchestra.run.smithi181.stdout:file_634 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_635 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_636 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_637 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_638 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_639 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_64 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_640 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_641 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_642 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_643 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_644 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_645 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_646 2024-09-12T02:34:01.683 INFO:teuthology.orchestra.run.smithi181.stdout:file_647 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_648 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_649 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_65 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_650 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_651 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_652 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_653 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_654 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_655 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_656 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_657 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_658 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_659 2024-09-12T02:34:01.684 INFO:teuthology.orchestra.run.smithi181.stdout:file_66 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_660 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_661 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_662 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_663 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_664 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_665 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_666 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_667 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_668 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_669 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_67 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_670 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_671 2024-09-12T02:34:01.685 INFO:teuthology.orchestra.run.smithi181.stdout:file_672 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_673 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_674 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_675 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_676 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_677 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_678 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_679 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_68 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_680 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_681 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_682 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_683 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_684 2024-09-12T02:34:01.686 INFO:teuthology.orchestra.run.smithi181.stdout:file_685 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_686 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_687 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_688 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_689 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_69 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_690 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_691 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_692 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_693 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_694 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_695 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_696 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_697 2024-09-12T02:34:01.687 INFO:teuthology.orchestra.run.smithi181.stdout:file_698 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_699 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_7 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_70 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_700 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_701 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_702 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_703 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_704 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_705 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_706 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_707 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_708 2024-09-12T02:34:01.688 INFO:teuthology.orchestra.run.smithi181.stdout:file_709 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_71 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_710 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_711 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_712 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_713 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_714 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_715 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_716 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_717 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_718 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_719 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_72 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_720 2024-09-12T02:34:01.689 INFO:teuthology.orchestra.run.smithi181.stdout:file_721 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_722 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_723 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_724 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_725 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_726 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_727 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_728 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_729 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_73 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_730 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_731 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_732 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_733 2024-09-12T02:34:01.690 INFO:teuthology.orchestra.run.smithi181.stdout:file_734 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_735 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_736 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_737 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_738 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_739 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_74 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_740 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_741 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_742 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_743 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_744 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_745 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_746 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_747 2024-09-12T02:34:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:file_748 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_749 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_75 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_750 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_751 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_752 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_753 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_754 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_755 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_756 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_757 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_758 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_759 2024-09-12T02:34:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:file_76 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_760 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_761 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_762 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_763 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_764 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_765 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_766 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_767 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_768 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_769 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_77 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_770 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_771 2024-09-12T02:34:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:file_772 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_773 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_774 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_775 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_776 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_777 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_778 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_779 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_78 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_780 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_781 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_782 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_783 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_784 2024-09-12T02:34:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:file_785 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_786 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_787 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_788 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_789 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_79 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_790 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_791 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_792 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_793 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_794 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_795 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_796 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_797 2024-09-12T02:34:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:file_798 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_799 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_8 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_80 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_800 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_801 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_802 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_803 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_804 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_805 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_806 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_807 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_808 2024-09-12T02:34:01.696 INFO:teuthology.orchestra.run.smithi181.stdout:file_809 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_81 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_810 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_811 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_812 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_813 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_814 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_815 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_816 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_817 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_818 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_819 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_82 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_820 2024-09-12T02:34:01.697 INFO:teuthology.orchestra.run.smithi181.stdout:file_821 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_822 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_823 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_824 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_825 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_826 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_827 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_828 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_829 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_83 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_830 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_831 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_832 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_833 2024-09-12T02:34:01.698 INFO:teuthology.orchestra.run.smithi181.stdout:file_834 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_835 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_836 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_837 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_838 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_839 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_84 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_840 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_841 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_842 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_843 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_844 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_845 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_846 2024-09-12T02:34:01.699 INFO:teuthology.orchestra.run.smithi181.stdout:file_847 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_848 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_849 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_85 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_850 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_851 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_852 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_853 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_854 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_855 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_856 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_857 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_858 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_859 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_86 2024-09-12T02:34:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:file_860 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_861 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_862 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_863 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_864 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_865 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_866 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_867 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_868 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_869 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_87 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_870 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_871 2024-09-12T02:34:01.701 INFO:teuthology.orchestra.run.smithi181.stdout:file_872 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_873 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_874 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_875 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_876 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_877 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_878 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_879 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_88 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_880 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_881 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_882 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_883 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_884 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_885 2024-09-12T02:34:01.702 INFO:teuthology.orchestra.run.smithi181.stdout:file_886 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_887 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_888 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_889 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_89 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_890 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_891 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_892 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_893 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_894 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_895 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_896 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_897 2024-09-12T02:34:01.703 INFO:teuthology.orchestra.run.smithi181.stdout:file_898 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_899 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_9 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_90 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_900 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_901 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_902 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_903 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_904 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_905 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_906 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_907 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_908 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_909 2024-09-12T02:34:01.704 INFO:teuthology.orchestra.run.smithi181.stdout:file_91 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_910 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_911 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_912 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_913 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_914 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_915 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_916 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_917 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_918 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_919 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_92 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_920 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_921 2024-09-12T02:34:01.705 INFO:teuthology.orchestra.run.smithi181.stdout:file_922 2024-09-12T02:34:01.706 INFO:teuthology.orchestra.run.smithi181.stdout:file_923 2024-09-12T02:34:01.706 INFO:teuthology.orchestra.run.smithi181.stdout:file_924 2024-09-12T02:34:16.945 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:16.950 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:47.011 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:47.014 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:01.680 INFO:tasks.cephfs.test_journal_repair:Killing mount, it's blocked on the MDS we killed 2024-09-12T02:35:01.680 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:35:01.681 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:01.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:01.681 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 down 2024-09-12T02:35:01.713 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:01.713 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:01.713 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:01.771 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:35:01.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_925 2024-09-12T02:35:01.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_926 2024-09-12T02:35:01.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_927 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_928 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_929 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_93 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_930 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_931 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_932 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_933 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_934 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_935 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_936 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_937 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_938 2024-09-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_939 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_94 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_940 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_941 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_942 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_943 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_944 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_945 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_946 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_947 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_948 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_949 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_95 2024-09-12T02:35:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_950 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_951 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_952 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_953 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_954 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_955 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_956 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_957 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_958 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_959 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_96 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_960 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_961 2024-09-12T02:35:01.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_962 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_963 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_964 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_965 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_966 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_967 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_968 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_969 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_97 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_970 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_971 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_972 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_973 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_974 2024-09-12T02:35:01.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_975 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_976 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_977 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_978 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_979 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_98 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_980 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_981 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_982 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_983 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_984 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_985 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_986 2024-09-12T02:35:01.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_987 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_988 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_989 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_99 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_990 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_991 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_992 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_993 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_994 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_995 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_996 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_997 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_998 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_999 2024-09-12T02:35:01.821 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:01.822 INFO:teuthology.orchestra.run.smithi181.stdout:./bravo: 2024-09-12T02:35:01.822 INFO:teuthology.orchestra.run.smithi181.stderr:ls: reading directory './bravo': Software caused connection abort 2024-09-12T02:35:01.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.917+0000 7f6fc2bd6640 1 Processor -- start 2024-09-12T02:35:01.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.917+0000 7f6fc2bd6640 1 -- start start 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc2bd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc15b2e0 0x7f6fbc0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc2bd6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6fbc0cdfc0 0x7f6fbc0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc2bd6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6fbc0b22c0 0x7f6fbc0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc2bd6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6fbc15b6c0 con 0x7f6fbc0cdfc0 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc2bd6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f6fbc0ce4f0 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc2bd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6fbc0ce7d0 con 0x7f6fbc15b2e0 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6fbc0cdfc0 0x7f6fbc0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6fbc0cdfc0 0x7f6fbc0b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58604/0 (socket says 172.21.15.181:58604) 2024-09-12T02:35:01.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 -- 172.21.15.181:0/780517422 learned_addr learned my addr 172.21.15.181:0/780517422 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc1173640 1 --2- 172.21.15.181:0/780517422 >> v2:172.21.15.204:3300/0 conn(0x7f6fbc0b22c0 0x7f6fbc0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc0972640 1 --2- 172.21.15.181:0/780517422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc15b2e0 0x7f6fbc0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 -- 172.21.15.181:0/780517422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc15b2e0 msgr2=0x7f6fbc0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 --2- 172.21.15.181:0/780517422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc15b2e0 0x7f6fbc0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 -- 172.21.15.181:0/780517422 >> v2:172.21.15.204:3300/0 conn(0x7f6fbc0b22c0 msgr2=0x7f6fbc0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 --2- 172.21.15.181:0/780517422 >> v2:172.21.15.204:3300/0 conn(0x7f6fbc0b22c0 0x7f6fbc0ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fbbfff640 1 -- 172.21.15.181:0/780517422 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc0ceab0 con 0x7f6fbc0cdfc0 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.918+0000 7f6fc0972640 1 --2- 172.21.15.181:0/780517422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc15b2e0 0x7f6fbc0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.919+0000 7f6fbbfff640 1 --2- 172.21.15.181:0/780517422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0cdfc0 0x7f6fbc0b1d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0d0050 tx=0x7f6fa802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec39b935d28ca87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.919+0000 7f6fbb7fe640 1 -- 172.21.15.181:0/780517422 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8037070 con 0x7f6fbc0cdfc0 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.919+0000 7f6fbb7fe640 1 -- 172.21.15.181:0/780517422 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8032440 con 0x7f6fbc0cdfc0 2024-09-12T02:35:01.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.919+0000 7f6fbb7fe640 1 -- 172.21.15.181:0/780517422 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8032810 con 0x7f6fbc0cdfc0 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/780517422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0cdfc0 msgr2=0x7f6fbc0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/780517422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0cdfc0 0x7f6fbc0b1d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0d0050 tx=0x7f6fa802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/780517422 shutdown_connections 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/780517422 >> v2:172.21.15.204:3300/0 conn(0x7f6fbc0b22c0 0x7f6fbc0ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/780517422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0cdfc0 0x7f6fbc0b1d80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/780517422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc15b2e0 0x7f6fbc0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/780517422 >> 172.21.15.181:0/780517422 conn(0x7f6fbc06bc10 msgr2=0x7f6fbc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/780517422 shutdown_connections 2024-09-12T02:35:01.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.920+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/780517422 wait complete. 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.921+0000 7f6fc2bd6640 1 Processor -- start 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.921+0000 7f6fc2bd6640 1 -- start start 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc2bd6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b22c0 0x7f6fbc151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc2bd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc0cdfc0 0x7f6fbc1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc2bd6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fbc15b2e0 0x7f6fbc14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc2bd6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc0712b0 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc2bd6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc071130 con 0x7f6fbc15b2e0 2024-09-12T02:35:01.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc2bd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6fbc0b4260 con 0x7f6fbc0cdfc0 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b22c0 0x7f6fbc151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b22c0 0x7f6fbc151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58614/0 (socket says 172.21.15.181:58614) 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 -- 172.21.15.181:0/3378192568 learned_addr learned my addr 172.21.15.181:0/3378192568 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc1173640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fbc15b2e0 0x7f6fbc14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fbbfff640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc0cdfc0 0x7f6fbc1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 -- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc0cdfc0 msgr2=0x7f6fbc1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc0cdfc0 0x7f6fbc1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 -- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fbc15b2e0 msgr2=0x7f6fbc14f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fbc15b2e0 0x7f6fbc14f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fc0972640 1 -- 172.21.15.181:0/3378192568 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc15c8f0 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.922+0000 7f6fbbfff640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc0cdfc0 0x7f6fbc1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:01.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.923+0000 7f6fc0972640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b22c0 0x7f6fbc151c80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000d7d0 tx=0x7f6fb000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.923+0000 7f6fb97fa640 1 -- 172.21.15.181:0/3378192568 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0004030 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.923+0000 7f6fb97fa640 1 -- 172.21.15.181:0/3378192568 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb00041d0 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.923+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fbc15b850 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.923+0000 7f6fb97fa640 1 -- 172.21.15.181:0/3378192568 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000b6c0 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.923+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fbc15be10 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.924+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fbc0b1d80 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.924+0000 7f6fb97fa640 1 -- 172.21.15.181:0/3378192568 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fb000b860 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.925+0000 7f6fb97fa640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.925+0000 7f6fbbfff640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.925+0000 7f6fb97fa640 1 -- 172.21.15.181:0/3378192568 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7f6fb008b0e0 con 0x7f6fbc0b22c0 2024-09-12T02:35:01.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.925+0000 7f6fbbfff640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6fa006be30 0x7f6fa006e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8034000 tx=0x7f6fa802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:01.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:01.929+0000 7f6fb97fa640 1 -- 172.21.15.181:0/3378192568 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fbc15c8f0 con 0x7f6fbc0b22c0 2024-09-12T02:35:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.108+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6fbc158e80 con 0x7f6fbc0b22c0 2024-09-12T02:35:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.109+0000 7f6fb97fa640 1 -- 172.21.15.181:0/3378192568 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v61) ==== 80+0+124 (secure 0 0 0) 0x7f6fb0059a30 con 0x7f6fbc0b22c0 2024-09-12T02:35:02.110 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6834/1808682347 2024-09-13T02:34:01.159031+0000 2024-09-12T02:35:02.110 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6832/1808682347 2024-09-13T02:34:01.159031+0000 2024-09-12T02:35:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:listed 2 entries 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6fa006be30 msgr2=0x7f6fa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6fa006be30 0x7f6fa006e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8034000 tx=0x7f6fa802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b22c0 msgr2=0x7f6fbc151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b22c0 0x7f6fbc151c80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000d7d0 tx=0x7f6fb000dc90 comp rx=0 tx=0).stop 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 shutdown_connections 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fbc15b2e0 0x7f6fbc14f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fbc0cdfc0 0x7f6fbc1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 --2- 172.21.15.181:0/3378192568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b22c0 0x7f6fbc151c80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 >> 172.21.15.181:0/3378192568 conn(0x7f6fbc06bc10 msgr2=0x7f6fbc157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 shutdown_connections 2024-09-12T02:35:02.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.111+0000 7f6fc2bd6640 1 -- 172.21.15.181:0/3378192568 wait complete. 2024-09-12T02:35:02.123 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:02.123 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:02.140 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:35:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.279+0000 7fa2299b9640 1 Processor -- start 2024-09-12T02:35:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.279+0000 7fa2299b9640 1 -- start start 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2299b9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa2240cf2b0 0x7fa2240d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2299b9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa2240cf720 0x7fa2240d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2299b9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22415ea20 con 0x7fa22415e640 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2299b9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa2240b3d00 con 0x7fa2240cf2b0 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2299b9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa2240b2860 con 0x7fa2240cf720 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa222ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa22415e640 0x7fa2240ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60972/0 (socket says 172.21.15.181:60972) 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa222ffd640 1 -- 172.21.15.181:0/3883129310 learned_addr learned my addr 172.21.15.181:0/3883129310 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2227fc640 1 --2- 172.21.15.181:0/3883129310 >> v2:172.21.15.181:3300/0 conn(0x7fa2240cf2b0 0x7fa2240d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2237fe640 1 --2- 172.21.15.181:0/3883129310 >> v2:172.21.15.204:3300/0 conn(0x7fa2240cf720 0x7fa2240d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2227fc640 1 -- 172.21.15.181:0/3883129310 >> v2:172.21.15.204:3300/0 conn(0x7fa2240cf720 msgr2=0x7fa2240d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2227fc640 1 --2- 172.21.15.181:0/3883129310 >> v2:172.21.15.204:3300/0 conn(0x7fa2240cf720 0x7fa2240d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2227fc640 1 -- 172.21.15.181:0/3883129310 >> v1:172.21.15.181:6789/0 conn(0x7fa22415e640 legacy=0x7fa2240ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2227fc640 1 -- 172.21.15.181:0/3883129310 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240b1c50 con 0x7fa2240cf2b0 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa221ffb640 1 -- 172.21.15.181:0/3883129310 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674086100 0 0) 0x7fa22415ea20 con 0x7fa22415e640 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.280+0000 7fa2237fe640 1 --2- 172.21.15.181:0/3883129310 >> v2:172.21.15.204:3300/0 conn(0x7fa2240cf720 0x7fa2240d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.281+0000 7fa2227fc640 1 --2- 172.21.15.181:0/3883129310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2240cf2b0 0x7fa2240d2650 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa22415ebf0 tx=0x7fa21802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64726a7a95912630 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.281+0000 7fa221ffb640 1 -- 172.21.15.181:0/3883129310 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218037070 con 0x7fa2240cf2b0 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.281+0000 7fa221ffb640 1 -- 172.21.15.181:0/3883129310 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa218032440 con 0x7fa2240cf2b0 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.281+0000 7fa221ffb640 1 -- 172.21.15.181:0/3883129310 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21802ae60 con 0x7fa2240cf2b0 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 -- 172.21.15.181:0/3883129310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2240cf2b0 msgr2=0x7fa2240d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 --2- 172.21.15.181:0/3883129310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2240cf2b0 0x7fa2240d2650 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa22415ebf0 tx=0x7fa21802a110 comp rx=0 tx=0).stop 2024-09-12T02:35:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 -- 172.21.15.181:0/3883129310 shutdown_connections 2024-09-12T02:35:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 --2- 172.21.15.181:0/3883129310 >> v2:172.21.15.204:3300/0 conn(0x7fa2240cf720 0x7fa2240d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 --2- 172.21.15.181:0/3883129310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2240cf2b0 0x7fa2240d2650 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 -- 172.21.15.181:0/3883129310 >> 172.21.15.181:0/3883129310 conn(0x7fa22409d820 msgr2=0x7fa2240d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 -- 172.21.15.181:0/3883129310 shutdown_connections 2024-09-12T02:35:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.282+0000 7fa2299b9640 1 -- 172.21.15.181:0/3883129310 wait complete. 2024-09-12T02:35:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.283+0000 7fa2299b9640 1 Processor -- start 2024-09-12T02:35:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.283+0000 7fa2299b9640 1 -- start start 2024-09-12T02:35:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2299b9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2240cf2b0 0x7fa2241e95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2299b9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2240cf720 0x7fa22415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2299b9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa22415e640 0x7fa2240cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2299b9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240b24f0 con 0x7fa22415e640 2024-09-12T02:35:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2299b9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240b2210 con 0x7fa2240cf2b0 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2299b9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa2240cfe40 con 0x7fa2240cf720 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa22415e640 0x7fa2240cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa22415e640 0x7fa2240cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58630/0 (socket says 172.21.15.181:58630) 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 -- 172.21.15.181:0/2305210374 learned_addr learned my addr 172.21.15.181:0/2305210374 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2227fc640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2240cf720 0x7fa22415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa222ffd640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2240cf2b0 0x7fa2241e95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 -- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2240cf720 msgr2=0x7fa22415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2240cf720 0x7fa22415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 -- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2240cf2b0 msgr2=0x7fa2241e95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2240cf2b0 0x7fa2241e95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 -- 172.21.15.181:0/2305210374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22415b950 con 0x7fa22415e640 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa222ffd640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2240cf2b0 0x7fa2241e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.284+0000 7fa2237fe640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa22415e640 0x7fa2240cb910 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00cf20 tx=0x7fa21c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.285+0000 7fa20bfff640 1 -- 172.21.15.181:0/2305210374 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c01a070 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.285+0000 7fa20bfff640 1 -- 172.21.15.181:0/2305210374 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c00d840 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.285+0000 7fa20bfff640 1 -- 172.21.15.181:0/2305210374 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00dc30 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.285+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22415af90 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.285+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2241e8af0 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.286+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa224068eb0 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.286+0000 7fa20bfff640 1 -- 172.21.15.181:0/2305210374 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa21c01d070 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.287+0000 7fa20bfff640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa21006be30 0x7fa21006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.287+0000 7fa20bfff640 1 -- 172.21.15.181:0/2305210374 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7fa21c08b770 con 0x7fa22415e640 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.287+0000 7fa222ffd640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa21006be30 0x7fa21006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.287+0000 7fa222ffd640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa21006be30 0x7fa21006e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa214000f60 tx=0x7fa214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.292+0000 7fa20bfff640 1 -- 172.21.15.181:0/2305210374 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa21c05a0c0 con 0x7fa22415e640 2024-09-12T02:35:02.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.465+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2240d1b70 con 0x7fa22415e640 2024-09-12T02:35:02.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.466+0000 7fa20bfff640 1 -- 172.21.15.181:0/2305210374 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v61) ==== 80+0+124 (secure 0 0 0) 0x7fa21c0599c0 con 0x7fa22415e640 2024-09-12T02:35:02.467 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6834/1808682347 2024-09-13T02:34:01.159031+0000 2024-09-12T02:35:02.467 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6832/1808682347 2024-09-13T02:34:01.159031+0000 2024-09-12T02:35:02.467 INFO:teuthology.orchestra.run.smithi181.stderr:listed 2 entries 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa21006be30 msgr2=0x7fa21006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa21006be30 0x7fa21006e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa214000f60 tx=0x7fa214009040 comp rx=0 tx=0).stop 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa22415e640 msgr2=0x7fa2240cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa22415e640 0x7fa2240cb910 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00cf20 tx=0x7fa21c00a7d0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 shutdown_connections 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa21006be30 0x7fa21006e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa22415e640 0x7fa2240cb910 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2240cf720 0x7fa22415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 --2- 172.21.15.181:0/2305210374 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2240cf2b0 0x7fa2241e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 >> 172.21.15.181:0/2305210374 conn(0x7fa22409d820 msgr2=0x7fa22406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 shutdown_connections 2024-09-12T02:35:02.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.468+0000 7fa2299b9640 1 -- 172.21.15.181:0/2305210374 wait complete. 2024-09-12T02:35:02.480 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:35:02.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:02.480 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:02.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:02.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:02.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:02.509 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:35:02.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:02.564 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:35:02.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.706+0000 7fb3c098d640 1 Processor -- start 2024-09-12T02:35:02.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.706+0000 7fb3c098d640 1 -- start start 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3c098d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb3bc159f90 0x7fb3bc0d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3c098d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc0d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3c098d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3bc0d2890 0x7fb3bc073010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3c098d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc0d2ce0 con 0x7fb3bc0d2890 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3c098d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc15a370 con 0x7fb3bc159f90 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3c098d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc160170 con 0x7fb3bc0b5890 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3bc0d2890 0x7fb3bc073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3bc0d2890 0x7fb3bc073010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58644/0 (socket says 172.21.15.181:58644) 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 -- 172.21.15.181:0/1875550841 learned_addr learned my addr 172.21.15.181:0/1875550841 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3ba59c640 1 --2- 172.21.15.181:0/1875550841 >> v2:172.21.15.204:3300/0 conn(0x7fb3bc159f90 0x7fb3bc0d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3b9d9b640 1 --2- 172.21.15.181:0/1875550841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc0d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 -- 172.21.15.181:0/1875550841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 msgr2=0x7fb3bc0d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 --2- 172.21.15.181:0/1875550841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc0d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 -- 172.21.15.181:0/1875550841 >> v2:172.21.15.204:3300/0 conn(0x7fb3bc159f90 msgr2=0x7fb3bc0d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 --2- 172.21.15.181:0/1875550841 >> v2:172.21.15.204:3300/0 conn(0x7fb3bc159f90 0x7fb3bc0d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.707+0000 7fb3bad9d640 1 -- 172.21.15.181:0/1875550841 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc160450 con 0x7fb3bc0d2890 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3bad9d640 1 --2- 172.21.15.181:0/1875550841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc0d2890 0x7fb3bc073010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0cff30 tx=0x7fb3ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b0d7714d6023e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3b959a640 1 -- 172.21.15.181:0/1875550841 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac037070 con 0x7fb3bc0d2890 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3b959a640 1 -- 172.21.15.181:0/1875550841 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac032440 con 0x7fb3bc0d2890 2024-09-12T02:35:02.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3b959a640 1 -- 172.21.15.181:0/1875550841 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac032810 con 0x7fb3bc0d2890 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3c098d640 1 -- 172.21.15.181:0/1875550841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc0d2890 msgr2=0x7fb3bc073010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3c098d640 1 --2- 172.21.15.181:0/1875550841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc0d2890 0x7fb3bc073010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0cff30 tx=0x7fb3ac02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3c098d640 1 -- 172.21.15.181:0/1875550841 shutdown_connections 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3c098d640 1 --2- 172.21.15.181:0/1875550841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc0d2890 0x7fb3bc073010 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3c098d640 1 --2- 172.21.15.181:0/1875550841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc0d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3c098d640 1 --2- 172.21.15.181:0/1875550841 >> v2:172.21.15.204:3300/0 conn(0x7fb3bc159f90 0x7fb3bc0d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.708+0000 7fb3c098d640 1 -- 172.21.15.181:0/1875550841 >> 172.21.15.181:0/1875550841 conn(0x7fb3bc0b7db0 msgr2=0x7fb3bc067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.709+0000 7fb3c098d640 1 -- 172.21.15.181:0/1875550841 shutdown_connections 2024-09-12T02:35:02.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.709+0000 7fb3c098d640 1 -- 172.21.15.181:0/1875550841 wait complete. 2024-09-12T02:35:02.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.710+0000 7fb3c098d640 1 Processor -- start 2024-09-12T02:35:02.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.710+0000 7fb3c098d640 1 -- start start 2024-09-12T02:35:02.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc15d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3bc0d2890 0x7fb3bc0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc159f90 0x7fb3bc0b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc160cf0 con 0x7fb3bc159f90 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc160a10 con 0x7fb3bc0d2890 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc0d0430 con 0x7fb3bc0b5890 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc159f90 0x7fb3bc0b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc159f90 0x7fb3bc0b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58652/0 (socket says 172.21.15.181:58652) 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 -- 172.21.15.181:0/4189563031 learned_addr learned my addr 172.21.15.181:0/4189563031 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3b9d9b640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3bc0d2890 0x7fb3bc0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3ba59c640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc15d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 -- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 msgr2=0x7fb3bc15d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc15d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 -- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3bc0d2890 msgr2=0x7fb3bc0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3bc0d2890 0x7fb3bc0b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 -- 172.21.15.181:0/4189563031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc15d150 con 0x7fb3bc159f90 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3ba59c640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3bad9d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc159f90 0x7fb3bc0b21d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0090b0 tx=0x7fb3ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3b2ffd640 1 -- 172.21.15.181:0/4189563031 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac037040 con 0x7fb3bc159f90 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3b2ffd640 1 -- 172.21.15.181:0/4189563031 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac042070 con 0x7fb3bc159f90 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc14e1a0 con 0x7fb3bc159f90 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3b2ffd640 1 -- 172.21.15.181:0/4189563031 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac030920 con 0x7fb3bc159f90 2024-09-12T02:35:02.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.711+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc14ea40 con 0x7fb3bc159f90 2024-09-12T02:35:02.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.712+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc0d2350 con 0x7fb3bc159f90 2024-09-12T02:35:02.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.713+0000 7fb3b2ffd640 1 -- 172.21.15.181:0/4189563031 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3ac030ac0 con 0x7fb3bc159f90 2024-09-12T02:35:02.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.713+0000 7fb3b2ffd640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb39c06be30 0x7fb39c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:02.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.713+0000 7fb3b2ffd640 1 -- 172.21.15.181:0/4189563031 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7fb3ac0ab6f0 con 0x7fb3bc159f90 2024-09-12T02:35:02.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.713+0000 7fb3ba59c640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb39c06be30 0x7fb39c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:02.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.714+0000 7fb3ba59c640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb39c06be30 0x7fb39c06e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009a80 tx=0x7fb3b40039d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:02.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.718+0000 7fb3b2ffd640 1 -- 172.21.15.181:0/4189563031 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3bc15d150 con 0x7fb3bc159f90 2024-09-12T02:35:02.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:02.915+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fb3bc0b6940 con 0x7fb3bc159f90 2024-09-12T02:35:03.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.293+0000 7fb3b2ffd640 1 -- 172.21.15.181:0/4189563031 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v48) ==== 162+0+0 (secure 0 0 0) 0x7fb3ac07a040 con 0x7fb3bc159f90 2024-09-12T02:35:03.294 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:35:03.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.295+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb39c06be30 msgr2=0x7fb39c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.295+0000 7fb3c098d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb39c06be30 0x7fb39c06e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009a80 tx=0x7fb3b40039d0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.295+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc159f90 msgr2=0x7fb3bc0b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.295+0000 7fb3c098d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc159f90 0x7fb3bc0b21d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0090b0 tx=0x7fb3ac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 shutdown_connections 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb39c06be30 0x7fb39c06e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3bc0d2890 0x7fb3bc0b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3bc159f90 0x7fb3bc0b21d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 --2- 172.21.15.181:0/4189563031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3bc0b5890 0x7fb3bc15d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 >> 172.21.15.181:0/4189563031 conn(0x7fb3bc0b7db0 msgr2=0x7fb3bc0b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 shutdown_connections 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.296+0000 7fb3c098d640 1 -- 172.21.15.181:0/4189563031 wait complete. 2024-09-12T02:35:03.301 INFO:tasks.ceph.mds.c.smithi181.stderr:2024-09-12T02:35:03.301+0000 7f878cc0d640 -1 mds.1.sessionmap _load_finish got (2) No such file or directory 2024-09-12T02:35:03.301 INFO:tasks.ceph.mds.c.smithi181.stderr:2024-09-12T02:35:03.301+0000 7f878cc0d640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory) 2024-09-12T02:35:03.302 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:35:03.301+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-12T02:35:03.310 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:03.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.410+0000 7f0716d3b640 1 Processor -- start 2024-09-12T02:35:03.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.410+0000 7f0716d3b640 1 -- start start 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.410+0000 7f0716d3b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f07100cdfc0 0x7f07100b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.410+0000 7f0716d3b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07100b22c0 0x7f07100716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.410+0000 7f0716d3b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07100ce480 con 0x7f071015b1e0 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.410+0000 7f0716d3b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f07100b2730 con 0x7f07100cdfc0 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.410+0000 7f0716d3b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f07100ce760 con 0x7f07100b22c0 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f07152d8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07100b22c0 0x7f07100716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f070ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f07100cdfc0 0x7f07100b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f070ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f07100cdfc0 0x7f07100b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:33108/0 (socket says 172.21.15.181:33108) 2024-09-12T02:35:03.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f07152d8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07100b22c0 0x7f07100716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:55472/0 (socket says 172.21.15.181:55472) 2024-09-12T02:35:03.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f070ffff640 1 -- 172.21.15.181:0/860242367 learned_addr learned my addr 172.21.15.181:0/860242367 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:03.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f07152d8640 1 -- 172.21.15.181:0/860242367 >> v2:172.21.15.204:3300/0 conn(0x7f07100cdfc0 msgr2=0x7f07100b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:03.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f07152d8640 1 --2- 172.21.15.181:0/860242367 >> v2:172.21.15.204:3300/0 conn(0x7f07100cdfc0 0x7f07100b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f07152d8640 1 -- 172.21.15.181:0/860242367 >> v1:172.21.15.204:6789/0 conn(0x7f071015b1e0 legacy=0x7f07100b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f07152d8640 1 -- 172.21.15.181:0/860242367 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07100cea40 con 0x7f07100b22c0 2024-09-12T02:35:03.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.411+0000 7f070ffff640 1 --2- 172.21.15.181:0/860242367 >> v2:172.21.15.204:3300/0 conn(0x7f07100cdfc0 0x7f07100b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.412+0000 7f07152d8640 1 --2- 172.21.15.181:0/860242367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07100b22c0 0x7f07100716c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f070802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ea6c706944bb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.412+0000 7f070f7fe640 1 -- 172.21.15.181:0/860242367 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708007740 con 0x7f07100b22c0 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.412+0000 7f070f7fe640 1 -- 172.21.15.181:0/860242367 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07080078e0 con 0x7f07100b22c0 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.412+0000 7f070f7fe640 1 -- 172.21.15.181:0/860242367 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708007cb0 con 0x7f07100b22c0 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 -- 172.21.15.181:0/860242367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07100b22c0 msgr2=0x7f07100716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 --2- 172.21.15.181:0/860242367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07100b22c0 0x7f07100716c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f070802a660 comp rx=0 tx=0).stop 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 -- 172.21.15.181:0/860242367 shutdown_connections 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 --2- 172.21.15.181:0/860242367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07100b22c0 0x7f07100716c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 --2- 172.21.15.181:0/860242367 >> v2:172.21.15.204:3300/0 conn(0x7f07100cdfc0 0x7f07100b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 -- 172.21.15.181:0/860242367 >> 172.21.15.181:0/860242367 conn(0x7f071006bc10 msgr2=0x7f071006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 -- 172.21.15.181:0/860242367 shutdown_connections 2024-09-12T02:35:03.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.413+0000 7f0716d3b640 1 -- 172.21.15.181:0/860242367 wait complete. 2024-09-12T02:35:03.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.414+0000 7f0716d3b640 1 Processor -- start 2024-09-12T02:35:03.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.414+0000 7f0716d3b640 1 -- start start 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0716d3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07100b22c0 0x7f071014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0716d3b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07100cdfc0 0x7f07101543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0716d3b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f071015b1e0 0x7f071015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0716d3b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f071015b5c0 con 0x7f07100b22c0 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0716d3b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f07100b43a0 con 0x7f07100cdfc0 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0716d3b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0710071130 con 0x7f071015b1e0 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07100b22c0 0x7f071014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07100b22c0 0x7f071014d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58664/0 (socket says 172.21.15.181:58664) 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 -- 172.21.15.181:0/3374114448 learned_addr learned my addr 172.21.15.181:0/3374114448 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:03.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f070ffff640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07100cdfc0 0x7f07101543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f07152d8640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f071015b1e0 0x7f071015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 -- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f071015b1e0 msgr2=0x7f071015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f071015b1e0 0x7f071015d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 -- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07100cdfc0 msgr2=0x7f07101543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07100cdfc0 0x7f07101543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.415+0000 7f0714ad7640 1 -- 172.21.15.181:0/3374114448 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710153630 con 0x7f07100b22c0 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.416+0000 7f0714ad7640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07100b22c0 0x7f071014d900 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f070400c3f0 tx=0x7f070400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.416+0000 7f070d7fa640 1 -- 172.21.15.181:0/3374114448 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07040052d0 con 0x7f07100b22c0 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.416+0000 7f070d7fa640 1 -- 172.21.15.181:0/3374114448 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0704005490 con 0x7f07100b22c0 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.416+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0710155660 con 0x7f07100b22c0 2024-09-12T02:35:03.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.416+0000 7f070d7fa640 1 -- 172.21.15.181:0/3374114448 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0704007260 con 0x7f07100b22c0 2024-09-12T02:35:03.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.416+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0710153bb0 con 0x7f07100b22c0 2024-09-12T02:35:03.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.417+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710159dc0 con 0x7f07100b22c0 2024-09-12T02:35:03.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.417+0000 7f070d7fa640 1 -- 172.21.15.181:0/3374114448 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0704007400 con 0x7f07100b22c0 2024-09-12T02:35:03.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.418+0000 7f070d7fa640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f06f406be60 0x7f06f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.418+0000 7f070d7fa640 1 -- 172.21.15.181:0/3374114448 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5881+0+0 (secure 0 0 0) 0x7f070408a2c0 con 0x7f07100b22c0 2024-09-12T02:35:03.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.418+0000 7f070ffff640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f06f406be60 0x7f06f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.418+0000 7f070ffff640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f06f406be60 0x7f06f406e320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f071015e610 tx=0x7f06fc009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.422+0000 7f070d7fa640 1 -- 172.21.15.181:0/3374114448 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0704058600 con 0x7f07100b22c0 2024-09-12T02:35:03.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.619+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0710158600 con 0x7f07100b22c0 2024-09-12T02:35:03.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.619+0000 7f070d7fa640 1 -- 172.21.15.181:0/3374114448 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+4400 (secure 0 0 0) 0x7f070405c900 con 0x7f07100b22c0 2024-09-12T02:35:03.620 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:03.621 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":50,"btime":"2024-09-12T02:35:03:302523+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:35:03.302475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6144},"failed":[],"damaged":[1],"stopped":[],"info":{"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6144]},"id":4}]} 2024-09-12T02:35:03.621 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 50 2024-09-12T02:35:03.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f06f406be60 msgr2=0x7f06f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f06f406be60 0x7f06f406e320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f071015e610 tx=0x7f06fc009240 comp rx=0 tx=0).stop 2024-09-12T02:35:03.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07100b22c0 msgr2=0x7f071014d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07100b22c0 0x7f071014d900 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f070400c3f0 tx=0x7f070400c8b0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 shutdown_connections 2024-09-12T02:35:03.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f06f406be60 0x7f06f406e320 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07100cdfc0 0x7f07101543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f071015b1e0 0x7f071015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 --2- 172.21.15.181:0/3374114448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07100b22c0 0x7f071014d900 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 >> 172.21.15.181:0/3374114448 conn(0x7f071006bc10 msgr2=0x7f0710158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 shutdown_connections 2024-09-12T02:35:03.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.621+0000 7f0716d3b640 1 -- 172.21.15.181:0/3374114448 wait complete. 2024-09-12T02:35:03.633 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:35:03.633 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:03.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.732+0000 7f9daedd6640 1 Processor -- start 2024-09-12T02:35:03.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.732+0000 7f9daedd6640 1 -- start start 2024-09-12T02:35:03.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9daedd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da80b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9daedd6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9da80b0610 0x7f9da815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9daedd6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da806e3c0 con 0x7f9da8158c90 2024-09-12T02:35:03.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9daedd6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f9da806e170 con 0x7f9da80b0610 2024-09-12T02:35:03.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9daedd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9da806e6a0 con 0x7f9da806c320 2024-09-12T02:35:03.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9dad373640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9da80b0610 0x7f9da815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9dad373640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9da80b0610 0x7f9da815eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58668/0 (socket says 172.21.15.181:58668) 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9dad373640 1 -- 172.21.15.181:0/396412184 learned_addr learned my addr 172.21.15.181:0/396412184 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9dad373640 1 -- 172.21.15.181:0/396412184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 msgr2=0x7f9da80b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9dad373640 1 --2- 172.21.15.181:0/396412184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da80b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9dad373640 1 -- 172.21.15.181:0/396412184 >> v1:172.21.15.181:6789/0 conn(0x7f9da8158c90 legacy=0x7f9da806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.733+0000 7f9dad373640 1 -- 172.21.15.181:0/396412184 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da806e980 con 0x7f9da80b0610 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.734+0000 7f9dad373640 1 --2- 172.21.15.181:0/396412184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80b0610 0x7f9da815eab0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009870 tx=0x7f9da002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba5e001df952b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.734+0000 7f9da77fe640 1 -- 172.21.15.181:0/396412184 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0037070 con 0x7f9da80b0610 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.734+0000 7f9da77fe640 1 -- 172.21.15.181:0/396412184 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da0032440 con 0x7f9da80b0610 2024-09-12T02:35:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.734+0000 7f9da77fe640 1 -- 172.21.15.181:0/396412184 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0032810 con 0x7f9da80b0610 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 -- 172.21.15.181:0/396412184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80b0610 msgr2=0x7f9da815eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 --2- 172.21.15.181:0/396412184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80b0610 0x7f9da815eab0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009870 tx=0x7f9da002a270 comp rx=0 tx=0).stop 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 -- 172.21.15.181:0/396412184 shutdown_connections 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 --2- 172.21.15.181:0/396412184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80b0610 0x7f9da815eab0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 --2- 172.21.15.181:0/396412184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da80b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 -- 172.21.15.181:0/396412184 >> 172.21.15.181:0/396412184 conn(0x7f9da8067b30 msgr2=0x7f9da806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 -- 172.21.15.181:0/396412184 shutdown_connections 2024-09-12T02:35:03.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.735+0000 7f9daedd6640 1 -- 172.21.15.181:0/396412184 wait complete. 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.736+0000 7f9daedd6640 1 Processor -- start 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.736+0000 7f9daedd6640 1 -- start start 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9daedd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da8144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9daedd6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9da80b0610 0x7f9da815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9daedd6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8158c90 0x7f9da81454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9daedd6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9da80b4210 con 0x7f9da8158c90 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9daedd6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9da80b0ac0 con 0x7f9da80b0610 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9daedd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9da80b4390 con 0x7f9da806c320 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8158c90 0x7f9da81454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8158c90 0x7f9da81454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58684/0 (socket says 172.21.15.181:58684) 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 -- 172.21.15.181:0/553517079 learned_addr learned my addr 172.21.15.181:0/553517079 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 -- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 msgr2=0x7f9da8144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9da7fff640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9da80b0610 0x7f9da815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dacb72640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da8144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da8144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 -- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9da80b0610 msgr2=0x7f9da815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9da80b0610 0x7f9da815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 -- 172.21.15.181:0/553517079 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da815edb0 con 0x7f9da8158c90 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9da7fff640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9da80b0610 0x7f9da815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dacb72640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da8144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.737+0000 7f9dad373640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8158c90 0x7f9da81454a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009870 tx=0x7f9da00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.738+0000 7f9da57fa640 1 -- 172.21.15.181:0/553517079 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0037040 con 0x7f9da8158c90 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.738+0000 7f9da57fa640 1 -- 172.21.15.181:0/553517079 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da0042070 con 0x7f9da8158c90 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.738+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da8161780 con 0x7f9da8158c90 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.738+0000 7f9da57fa640 1 -- 172.21.15.181:0/553517079 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0030c90 con 0x7f9da8158c90 2024-09-12T02:35:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.738+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da8154ab0 con 0x7f9da8158c90 2024-09-12T02:35:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.739+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da80b00d0 con 0x7f9da8158c90 2024-09-12T02:35:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.739+0000 7f9da57fa640 1 -- 172.21.15.181:0/553517079 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9da0047460 con 0x7f9da8158c90 2024-09-12T02:35:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.739+0000 7f9da57fa640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9d9406be30 0x7f9d9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.740+0000 7f9da57fa640 1 -- 172.21.15.181:0/553517079 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5881+0+0 (secure 0 0 0) 0x7f9da00abb20 con 0x7f9da8158c90 2024-09-12T02:35:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.740+0000 7f9dacb72640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9d9406be30 0x7f9d9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.740+0000 7f9dacb72640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9d9406be30 0x7f9d9406e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9da81f7400 tx=0x7f9d98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.744+0000 7f9da57fa640 1 -- 172.21.15.181:0/553517079 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9da0079e60 con 0x7f9da8158c90 2024-09-12T02:35:03.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.943+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9da8161ca0 con 0x7f9da8158c90 2024-09-12T02:35:03.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.944+0000 7f9da57fa640 1 -- 172.21.15.181:0/553517079 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+4400 (secure 0 0 0) 0x7f9da007e160 con 0x7f9da8158c90 2024-09-12T02:35:03.945 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:03.945 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":50,"btime":"2024-09-12T02:35:03:302523+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:33:24.428356+0000","modified":"2024-09-12T02:35:03.302475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6144},"failed":[],"damaged":[1],"stopped":[],"info":{"gid_6144":{"gid":6144,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/2402478751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":2402478751},{"type":"v1","addr":"172.21.15.204:6835","nonce":2402478751}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6144,"qdb_cluster":[6144]},"id":4}]} 2024-09-12T02:35:03.945 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 50 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9d9406be30 msgr2=0x7f9d9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9d9406be30 0x7f9d9406e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9da81f7400 tx=0x7f9d98009040 comp rx=0 tx=0).stop 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8158c90 msgr2=0x7f9da81454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8158c90 0x7f9da81454a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009870 tx=0x7f9da00046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 shutdown_connections 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9d9406be30 0x7f9d9406e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9da80b0610 0x7f9da815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8158c90 0x7f9da81454a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 --2- 172.21.15.181:0/553517079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9da806c320 0x7f9da8144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 >> 172.21.15.181:0/553517079 conn(0x7f9da8067b30 msgr2=0x7f9da80b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 shutdown_connections 2024-09-12T02:35:03.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:03.946+0000 7f9daedd6640 1 -- 172.21.15.181:0/553517079 wait complete. 2024-09-12T02:35:03.958 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:35:04.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.056+0000 7ff63b274640 1 Processor -- start 2024-09-12T02:35:04.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.057+0000 7ff63b274640 1 -- start start 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.057+0000 7ff63b274640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff6340cf2b0 0x7ff6340d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.057+0000 7ff63b274640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6340cf720 0x7ff6340d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.057+0000 7ff63b274640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff63415ea20 con 0x7ff63415e640 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.057+0000 7ff63b274640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff6340b3d00 con 0x7ff6340cf720 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.057+0000 7ff63b274640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff6340b2860 con 0x7ff6340cf2b0 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6340cf720 0x7ff6340d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6340cf720 0x7ff6340d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58686/0 (socket says 172.21.15.181:58686) 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 -- 172.21.15.181:0/3373544298 learned_addr learned my addr 172.21.15.181:0/3373544298 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 -- 172.21.15.181:0/3373544298 >> v2:172.21.15.204:3300/0 conn(0x7ff6340cf2b0 msgr2=0x7ff6340d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 --2- 172.21.15.181:0/3373544298 >> v2:172.21.15.204:3300/0 conn(0x7ff6340cf2b0 0x7ff6340d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 -- 172.21.15.181:0/3373544298 >> v1:172.21.15.204:6789/0 conn(0x7ff63415e640 legacy=0x7ff6340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 -- 172.21.15.181:0/3373544298 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6340b1c50 con 0x7ff6340cf720 2024-09-12T02:35:04.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.058+0000 7ff639811640 1 --2- 172.21.15.181:0/3373544298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6340cf720 0x7ff6340d2b90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff63415ebf0 tx=0x7ff62402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81c519995f4e318 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff633fff640 1 -- 172.21.15.181:0/3373544298 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624037070 con 0x7ff6340cf720 2024-09-12T02:35:04.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff633fff640 1 -- 172.21.15.181:0/3373544298 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff624032440 con 0x7ff6340cf720 2024-09-12T02:35:04.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff633fff640 1 -- 172.21.15.181:0/3373544298 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624032810 con 0x7ff6340cf720 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 -- 172.21.15.181:0/3373544298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6340cf720 msgr2=0x7ff6340d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 --2- 172.21.15.181:0/3373544298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6340cf720 0x7ff6340d2b90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff63415ebf0 tx=0x7ff62402a180 comp rx=0 tx=0).stop 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 -- 172.21.15.181:0/3373544298 shutdown_connections 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 --2- 172.21.15.181:0/3373544298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6340cf720 0x7ff6340d2b90 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 --2- 172.21.15.181:0/3373544298 >> v2:172.21.15.204:3300/0 conn(0x7ff6340cf2b0 0x7ff6340d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 -- 172.21.15.181:0/3373544298 >> 172.21.15.181:0/3373544298 conn(0x7ff63409d820 msgr2=0x7ff6340d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 -- 172.21.15.181:0/3373544298 shutdown_connections 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.059+0000 7ff63b274640 1 -- 172.21.15.181:0/3373544298 wait complete. 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.060+0000 7ff63b274640 1 Processor -- start 2024-09-12T02:35:04.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.060+0000 7ff63b274640 1 -- start start 2024-09-12T02:35:04.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff63b274640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6340cf2b0 0x7ff634155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff63b274640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6340cf720 0x7ff6340b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff63b274640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff63415e640 0x7ff63415d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff63b274640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff6340b24f0 con 0x7ff63415e640 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff63b274640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff6340b2210 con 0x7ff6340cf2b0 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff63b274640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff6340cfe40 con 0x7ff6340cf720 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff639811640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff63415e640 0x7ff63415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff639811640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff63415e640 0x7ff63415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58696/0 (socket says 172.21.15.181:58696) 2024-09-12T02:35:04.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff639811640 1 -- 172.21.15.181:0/4118548606 learned_addr learned my addr 172.21.15.181:0/4118548606 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff639010640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6340cf2b0 0x7ff634155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.061+0000 7ff63880f640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6340cf720 0x7ff6340b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff639811640 1 -- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6340cf720 msgr2=0x7ff6340b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff639811640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6340cf720 0x7ff6340b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff639811640 1 -- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6340cf2b0 msgr2=0x7ff634155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff639811640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6340cf2b0 0x7ff634155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff639811640 1 -- 172.21.15.181:0/4118548606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6340c9460 con 0x7ff63415e640 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff639010640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6340cf2b0 0x7ff634155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff639811640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff63415e640 0x7ff63415d490 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6240090b0 tx=0x7ff6240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff631ffb640 1 -- 172.21.15.181:0/4118548606 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624041070 con 0x7ff63415e640 2024-09-12T02:35:04.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff631ffb640 1 -- 172.21.15.181:0/4118548606 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff62403c950 con 0x7ff63415e640 2024-09-12T02:35:04.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff631ffb640 1 -- 172.21.15.181:0/4118548606 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624037040 con 0x7ff63415e640 2024-09-12T02:35:04.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6340c9740 con 0x7ff63415e640 2024-09-12T02:35:04.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.062+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6340c9d00 con 0x7ff63415e640 2024-09-12T02:35:04.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.063+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff634068eb0 con 0x7ff63415e640 2024-09-12T02:35:04.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.063+0000 7ff631ffb640 1 -- 172.21.15.181:0/4118548606 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff624044070 con 0x7ff63415e640 2024-09-12T02:35:04.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.064+0000 7ff631ffb640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff62006be30 0x7ff62006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.064+0000 7ff631ffb640 1 -- 172.21.15.181:0/4118548606 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5881+0+0 (secure 0 0 0) 0x7ff6240abbf0 con 0x7ff63415e640 2024-09-12T02:35:04.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.064+0000 7ff639010640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff62006be30 0x7ff62006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.064+0000 7ff639010640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff62006be30 0x7ff62006e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff62c001750 tx=0x7ff62c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.068+0000 7ff631ffb640 1 -- 172.21.15.181:0/4118548606 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff62407a610 con 0x7ff63415e640 2024-09-12T02:35:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.266+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff6340d33e0 con 0x7ff63415e640 2024-09-12T02:35:04.268 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:35:04.267+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:35:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.269+0000 7ff631ffb640 1 -- 172.21.15.181:0/4118548606 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) ==== 161+0+0 (secure 0 0 0) 0x7ff624079f10 con 0x7ff63415e640 2024-09-12T02:35:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff62006be30 msgr2=0x7ff62006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff62006be30 0x7ff62006e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff62c001750 tx=0x7ff62c009040 comp rx=0 tx=0).stop 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff63415e640 msgr2=0x7ff63415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff63415e640 0x7ff63415d490 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6240090b0 tx=0x7ff6240046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 shutdown_connections 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff62006be30 0x7ff62006e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff63415e640 0x7ff63415d490 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6340cf720 0x7ff6340b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 --2- 172.21.15.181:0/4118548606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6340cf2b0 0x7ff634155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 >> 172.21.15.181:0/4118548606 conn(0x7ff63409d820 msgr2=0x7ff6340d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 shutdown_connections 2024-09-12T02:35:04.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.271+0000 7ff63b274640 1 -- 172.21.15.181:0/4118548606 wait complete. 2024-09-12T02:35:04.283 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-journal-tool --debug-mds=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries summary 2024-09-12T02:35:04.316 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:35:04.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.324+0000 7fceafc3b280 1 -- start start 2024-09-12T02:35:04.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.324+0000 7fceafc3b280 1 Processor -- start 2024-09-12T02:35:04.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b09a30c00 0x559b09aac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b09a31800 0x559b09aacb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b09a31c00 0x559b09aad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b0a820180 con 0x559b09a30c00 2024-09-12T02:35:04.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559b0a820300 con 0x559b09a31c00 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559b0a820480 con 0x559b09a31800 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b09a30c00 0x559b09aac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b09a30c00 0x559b09aac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58700/0 (socket says 172.21.15.181:58700) 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 -- 172.21.15.181:0/3353491575 learned_addr learned my addr 172.21.15.181:0/3353491575 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceadbdf640 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b09a31800 0x559b09aacb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceaebe1640 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b09a31c00 0x559b09aad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 -- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b09a31800 msgr2=0x559b09aacb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b09a31800 0x559b09aacb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 -- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b09a31c00 msgr2=0x559b09aad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b09a31c00 0x559b09aad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 -- 172.21.15.181:0/3353491575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b09a68780 con 0x559b09a30c00 2024-09-12T02:35:04.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceae3e0640 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b09a30c00 0x559b09aac580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x559b0a8598c0 tx=0x559b0a7d4960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c8f549419df958 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceabbdb640 1 -- 172.21.15.181:0/3353491575 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b09a56680 con 0x559b09a30c00 2024-09-12T02:35:04.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceabbdb640 1 -- 172.21.15.181:0/3353491575 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b09a5cfc0 con 0x559b09a30c00 2024-09-12T02:35:04.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceabbdb640 1 -- 172.21.15.181:0/3353491575 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b09a56b60 con 0x559b09a30c00 2024-09-12T02:35:04.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 -- 172.21.15.181:0/3353491575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b09a694a0 con 0x559b09a30c00 2024-09-12T02:35:04.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.325+0000 7fceafc3b280 1 -- 172.21.15.181:0/3353491575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559b09a68000 con 0x559b09a30c00 2024-09-12T02:35:04.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.326+0000 7fceabbdb640 1 -- 172.21.15.181:0/3353491575 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x559b0a90aa00 con 0x559b09a30c00 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.326+0000 7fceabbdb640 1 -- 172.21.15.181:0/3353491575 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 51) ==== 2304+0+0 (secure 0 0 0) 0x559b09a8b180 con 0x559b09a30c00 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.326+0000 7fceafc3b280 1 Processor -- start 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.326+0000 7fceafc3b280 1 -- start start 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90f400 0x559b09aad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f800 0x559b09aadb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90fc00 0x559b09aae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceafc3b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b0a820600 con 0x559b0a90f800 2024-09-12T02:35:04.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceafc3b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559b0a820780 con 0x559b0a90f400 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceafc3b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559b0a820900 con 0x559b0a90fc00 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f800 0x559b09aadb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f800 0x559b09aadb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58704/0 (socket says 172.21.15.181:58704) 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 -- 172.21.15.181:0/1968210174 learned_addr learned my addr 172.21.15.181:0/1968210174 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceaebe1640 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90f400 0x559b09aad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceadbdf640 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90fc00 0x559b09aae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 -- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90fc00 msgr2=0x559b09aae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90fc00 0x559b09aae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 -- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90f400 msgr2=0x559b09aad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90f400 0x559b09aad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 -- 172.21.15.181:0/1968210174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b09a683c0 con 0x559b0a90f800 2024-09-12T02:35:04.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceadbdf640 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90fc00 0x559b09aae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceaebe1640 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90f400 0x559b09aad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fceae3e0640 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f800 0x559b09aadb80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x559b0a920660 tx=0x559b0a7d2ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fe0c969be26847 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.327+0000 7fcea9bd7640 1 -- 172.21.15.181:0/1968210174 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b09a56820 con 0x559b0a90f800 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fcea9bd7640 1 -- 172.21.15.181:0/1968210174 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b09a5ce00 con 0x559b0a90f800 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fcea9bd7640 1 -- 172.21.15.181:0/1968210174 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b09a56680 con 0x559b0a90f800 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 -- 172.21.15.181:0/1968210174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f800 msgr2=0x559b09aadb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f800 0x559b09aadb80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x559b0a920660 tx=0x559b0a7d2ae0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 -- 172.21.15.181:0/1968210174 shutdown_connections 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90fc00 0x559b09aae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f800 0x559b09aadb80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 --2- 172.21.15.181:0/1968210174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90f400 0x559b09aad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 -- 172.21.15.181:0/1968210174 >> 172.21.15.181:0/1968210174 conn(0x559b0a90f000 msgr2=0x559b09b29000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 -- 172.21.15.181:0/1968210174 shutdown_connections 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 -- 172.21.15.181:0/1968210174 wait complete. 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 Processor -- start 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.328+0000 7fceafc3b280 1 -- start start 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f400 0x559b09aaf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90f800 0x559b09aaec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceafc3b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90fc00 0x559b09aae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceafc3b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b0a821500 con 0x559b0a90f400 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceafc3b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559b0a820a80 con 0x559b0a90fc00 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceafc3b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559b0a821680 con 0x559b0a90f800 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f400 0x559b09aaf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f400 0x559b09aaf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58716/0 (socket says 172.21.15.181:58716) 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 learned_addr learned my addr 172.21.15.181:0/2398222097 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceae3e0640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90f800 0x559b09aaec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceadbdf640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90fc00 0x559b09aae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90f800 msgr2=0x559b09aaec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b0a90f800 0x559b09aaec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90fc00 msgr2=0x559b09aae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b0a90fc00 0x559b09aae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.329+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b09a68780 con 0x559b0a90f400 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.330+0000 7fceaebe1640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f400 0x559b09aaf180 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x559b0a9218c0 tx=0x559b0a7d2a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.330+0000 7fcea83d4640 1 -- 172.21.15.181:0/2398222097 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b09a569c0 con 0x559b0a90f400 2024-09-12T02:35:04.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.330+0000 7fcea83d4640 1 -- 172.21.15.181:0/2398222097 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559b09a5c1c0 con 0x559b0a90f400 2024-09-12T02:35:04.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.330+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b09a694a0 con 0x559b0a90f400 2024-09-12T02:35:04.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.330+0000 7fcea83d4640 1 -- 172.21.15.181:0/2398222097 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559b09a56820 con 0x559b0a90f400 2024-09-12T02:35:04.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.330+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b09a68960 con 0x559b0a90f400 2024-09-12T02:35:04.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.331+0000 7fcea83d4640 1 -- 172.21.15.181:0/2398222097 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x559b0a902c00 con 0x559b0a90f400 2024-09-12T02:35:04.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.331+0000 7fcea83d4640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b0a987000 0x559b09aaf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.331+0000 7fcea83d4640 1 -- 172.21.15.181:0/2398222097 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x559b0a994600 con 0x559b0a90f400 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.331+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x559b0a987400 0x559b09aae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.331+0000 7fceae3e0640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b0a987000 0x559b09aaf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.331+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.f 8:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b0a987800 con 0x559b0a987400 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.332+0000 7fceadbdf640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x559b0a987400 0x559b09aae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.332+0000 7fceae3e0640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b0a987000 0x559b09aaf700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x559b0a920660 tx=0x559b0a926cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.332+0000 7fceadbdf640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x559b0a987400 0x559b09aae100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.334+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x559b09b3e000 con 0x559b0a987400 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.334+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559b0a987c00 0x559b09aadb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.335+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:2 8.14 8:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8000 con 0x559b0a987c00 2024-09-12T02:35:04.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.335+0000 7fceaebe1640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559b0a987c00 0x559b09aadb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.335+0000 7fceaebe1640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559b0a987c00 0x559b09aadb80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.337+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv1545 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x559b09b3e500 con 0x559b0a987c00 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.337+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:3 8.1b 8:ddb4e4d7:::200.00000002:head [read 1367472~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8400 con 0x559b0a987c00 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.338+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(3 200.00000002 [read 1367472~5605 out=5605b] v0'0 uv1491 ondisk = 0) ==== 156+0+5605 (crc 0 0 0) 0x559b09b3e500 con 0x559b0a987c00 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.338+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 8.b 8:d5c7a900:::200.00000003:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8800 con 0x559b0a987400 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.338+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(4 200.00000003 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559b09b3e000 con 0x559b0a987400 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.338+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559b09dc8c00 0x559b09aad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.338+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:5 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9000 con 0x559b09dc8c00 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.338+0000 7fceae3e0640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559b09dc8c00 0x559b09aad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.339+0000 7fceae3e0640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559b09dc8c00 0x559b09aad600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.341+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.341+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:6 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9400 con 0x559b09dc8c00 2024-09-12T02:35:04.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.341+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv6 ondisk = 0) ==== 154+0+522 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.341+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:7 8.13 8:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8800 con 0x559b0a987400 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.342+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x559b09b3e000 con 0x559b0a987400 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.342+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:8 8.13 8:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9800 con 0x559b0a987400 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.342+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x559b09b3e000 con 0x559b0a987400 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.342+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559b09dc9c00 0x559b09dd4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.342+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:9 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b0a987800 con 0x559b09dc9c00 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.342+0000 7fceadbdf640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559b09dc9c00 0x559b09dd4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.342+0000 7fceadbdf640 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559b09dc9c00 0x559b09dd4000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.344+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(9 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x559b09b3e000 con 0x559b09dc9c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.344+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:10 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b0a987800 con 0x559b09dc9c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.344+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(10 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x559b09b3e000 con 0x559b09dc9c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.344+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:11 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8800 con 0x559b09dc8c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.345+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.345+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:12 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9800 con 0x559b09dc8c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.346+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(12 1.00000000 [omap-set-header] v63'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.346+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:13 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9000 con 0x559b09dc8c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.346+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.347+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:14 8.14 8:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9400 con 0x559b0a987c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.347+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(14 1.00000000.inode [read 0~582 out=582b] v0'0 uv1542 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x559b09b3e500 con 0x559b0a987c00 2024-09-12T02:35:04.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.347+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:15 8.14 8:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8800 con 0x559b0a987c00 2024-09-12T02:35:04.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.349+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(15 1.00000000.inode [writefull 0~582] v63'1547 uv1547 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x559b09b3e500 con 0x559b0a987c00 2024-09-12T02:35:04.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.349+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:16 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b0a986c00 con 0x559b09dc8c00 2024-09-12T02:35:04.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.349+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(16 1.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.349+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:17 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x559b0a986800 con 0x559b09dc8c00 2024-09-12T02:35:04.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.351+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 7 ==== osd_op_reply(17 1.00000000 [omap-set-header] v63'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.351+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:18 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b0a986400 con 0x559b09dc8c00 2024-09-12T02:35:04.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.352+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 8 ==== osd_op_reply(18 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv8 ondisk = 0) ==== 154+0+522 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.352+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:19 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=522b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8000 con 0x559b09dc8c00 2024-09-12T02:35:04.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.353+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 9 ==== osd_op_reply(19 1.00000000 [omap-set-vals] v63'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.353+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:20 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8400 con 0x559b09dc8c00 2024-09-12T02:35:04.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.353+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 10 ==== osd_op_reply(20 1.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.353+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:21 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9400 con 0x559b09dc8c00 2024-09-12T02:35:04.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.355+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 11 ==== osd_op_reply(21 1.00000000 [omap-set-header] v63'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.355+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:22 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8800 con 0x559b09dc8c00 2024-09-12T02:35:04.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.355+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 12 ==== osd_op_reply(22 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv10 ondisk = 0) ==== 154+0+522 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.355+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:23 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=522b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x559b0a811400 con 0x559b09dc8c00 2024-09-12T02:35:04.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.356+0000 7fceae3e0640 1 -- 172.21.15.181:0/2398222097 <== osd.0 v2:172.21.15.181:6816/2346029807 13 ==== osd_op_reply(23 1.00000000 [omap-set-vals] v63'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x559b09b3ef00 con 0x559b09dc8c00 2024-09-12T02:35:04.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.356+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:24 8.14 8:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9800 con 0x559b0a987c00 2024-09-12T02:35:04.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.356+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 <== osd.4 v2:172.21.15.204:6816/3702049597 5 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv1547 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x559b09b3e500 con 0x559b0a987c00 2024-09-12T02:35:04.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.356+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:25 8.14 8:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc9000 con 0x559b0a987c00 2024-09-12T02:35:04.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 <== osd.4 v2:172.21.15.204:6816/3702049597 6 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v63'1548 uv1548 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x559b09b3e500 con 0x559b0a987c00 2024-09-12T02:35:04.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:26 8.13 8:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8000 con 0x559b0a987400 2024-09-12T02:35:04.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(26 mds0_inotable [read 0~34 out=34b] v0'0 uv5 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x559b09b3e000 con 0x559b0a987400 2024-09-12T02:35:04.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:27 8.1b 8:dbae76b5:::mds1_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559b09dc8400 con 0x559b0a987c00 2024-09-12T02:35:04.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceaebe1640 1 -- 172.21.15.181:0/2398222097 <== osd.4 v2:172.21.15.204:6816/3702049597 7 ==== osd_op_reply(27 mds1_inotable [read 0~4194304] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x559b09b3e500 con 0x559b0a987c00 2024-09-12T02:35:04.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 -1 consume_inos: unable to read inotable 'mds1_inotable': (2) No such file or directory 2024-09-12T02:35:04.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 main_event: Error updating InoTable for 1 consume inos: (2) No such file or directory 2024-09-12T02:35:04.360 INFO:teuthology.orchestra.run.smithi181.stdout:Events by type: 2024-09-12T02:35:04.360 INFO:teuthology.orchestra.run.smithi181.stdout: SUBTREEMAP: 1 2024-09-12T02:35:04.360 INFO:teuthology.orchestra.run.smithi181.stdout: UPDATE: 3 2024-09-12T02:35:04.360 INFO:teuthology.orchestra.run.smithi181.stdout:Errors: 0 2024-09-12T02:35:04.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559b09dc8c00 msgr2=0x559b09aad600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559b09dc8c00 0x559b09aad600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559b09dc9c00 msgr2=0x559b09dd4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559b09dc9c00 0x559b09dd4000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x559b0a987400 msgr2=0x559b09aae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x559b0a987400 0x559b09aae100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559b0a987c00 msgr2=0x559b09aadb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559b0a987c00 0x559b09aadb80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 reap_dead start 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceadbdf640 1 -- 172.21.15.181:0/2398222097 reap_dead start 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b0a987000 msgr2=0x559b09aaf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.358+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b0a987000 0x559b09aaf700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x559b0a920660 tx=0x559b0a926cc0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f400 msgr2=0x559b09aaf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f400 0x559b09aaf180 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x559b0a9218c0 tx=0x559b0a7d2a80 comp rx=0 tx=0).stop 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 shutdown_connections 2024-09-12T02:35:04.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559b0a987000 0x559b09aaf700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 --2- 172.21.15.181:0/2398222097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b0a90f400 0x559b09aaf180 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 >> 172.21.15.181:0/2398222097 conn(0x559b0a90f000 msgr2=0x559b09b29000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 shutdown_connections 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/2398222097 wait complete. 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/3353491575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b09a30c00 msgr2=0x559b09aac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b09a30c00 0x559b09aac580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x559b0a8598c0 tx=0x559b0a7d4960 comp rx=0 tx=0).stop 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/3353491575 shutdown_connections 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559b09a31c00 0x559b09aad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559b09a31800 0x559b09aacb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 --2- 172.21.15.181:0/3353491575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b09a30c00 0x559b09aac580 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/3353491575 >> 172.21.15.181:0/3353491575 conn(0x559b09a31000 msgr2=0x559b09b28800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/3353491575 shutdown_connections 2024-09-12T02:35:04.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.359+0000 7fceafc3b280 1 -- 172.21.15.181:0/3353491575 wait complete. 2024-09-12T02:35:04.364 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'summary'] in time 0:00:00.081834, result: Events by type: SUBTREEMAP: 1 UPDATE: 3 Errors: 0 2024-09-12T02:35:04.365 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-journal-tool --debug-mds=1 --debug-objecter=1 --rank cephfs:1 event recover_dentries summary 2024-09-12T02:35:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.446+0000 7f7e65d1f280 1 -- start start 2024-09-12T02:35:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.446+0000 7f7e65d1f280 1 Processor -- start 2024-09-12T02:35:04.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9256000 0x559ae8533080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae84b7c00 0x559ae8533b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9256800 0x559ae8533600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559ae92a2480 con 0x559ae9256800 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559ae92a2600 con 0x559ae84b7c00 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559ae92a2780 con 0x559ae9256000 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9256800 0x559ae8533600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9256800 0x559ae8533600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58736/0 (socket says 172.21.15.181:58736) 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 -- 172.21.15.181:0/3270693324 learned_addr learned my addr 172.21.15.181:0/3270693324 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae84b7c00 0x559ae8533b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e644c4640 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9256000 0x559ae8533080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 -- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9256000 msgr2=0x559ae8533080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9256000 0x559ae8533080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 -- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae84b7c00 msgr2=0x559ae8533b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae84b7c00 0x559ae8533b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e64cc5640 1 -- 172.21.15.181:0/3270693324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ae84ee780 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae84b7c00 0x559ae8533b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.447+0000 7f7e644c4640 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9256000 0x559ae8533080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e64cc5640 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9256800 0x559ae8533600 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x559ae92dd8f0 tx=0x559ae925a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4070ee49ea95c671 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e61cbf640 1 -- 172.21.15.181:0/3270693324 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ae84dcd00 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e61cbf640 1 -- 172.21.15.181:0/3270693324 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ae84e2700 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e61cbf640 1 -- 172.21.15.181:0/3270693324 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ae84dc680 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e65d1f280 1 -- 172.21.15.181:0/3270693324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ae84ee000 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e65d1f280 1 -- 172.21.15.181:0/3270693324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559ae84ef680 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e61cbf640 1 -- 172.21.15.181:0/3270693324 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x559ae938a600 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.448+0000 7f7e61cbf640 1 -- 172.21.15.181:0/3270693324 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 51) ==== 2304+0+0 (secure 0 0 0) 0x559ae8511180 con 0x559ae9256800 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 Processor -- start 2024-09-12T02:35:04.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 -- start start 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 0x559ae8534100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9393400 0x559ae8534680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559ae8518180 con 0x559ae9393400 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559ae92a2f00 con 0x559ae9392c00 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559ae92a3080 con 0x559ae9393000 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e63cc3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9393400 0x559ae8534680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e63cc3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9393400 0x559ae8534680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58742/0 (socket says 172.21.15.181:58742) 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1177002235 learned_addr learned my addr 172.21.15.181:0/1177002235 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.449+0000 7f7e644c4640 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 0x559ae8534100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 msgr2=0x559ae8534100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 0x559ae8534100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9392c00 msgr2=0x559ae8532b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1177002235 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ae84efc20 con 0x559ae9393400 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9393400 0x559ae8534680 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x559ae93a2780 tx=0x559ae93a4c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de5cf01fd5da5f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e5fcbb640 1 -- 172.21.15.181:0/1177002235 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ae84dcd00 con 0x559ae9393400 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e5fcbb640 1 -- 172.21.15.181:0/1177002235 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ae84e2fc0 con 0x559ae9393400 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e5fcbb640 1 -- 172.21.15.181:0/1177002235 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ae84dc680 con 0x559ae9393400 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1177002235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9393400 msgr2=0x559ae8534680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9393400 0x559ae8534680 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x559ae93a2780 tx=0x559ae93a4c60 comp rx=0 tx=0).stop 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1177002235 shutdown_connections 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9393400 0x559ae8534680 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 0x559ae8534100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1177002235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1177002235 >> 172.21.15.181:0/1177002235 conn(0x559ae9256400 msgr2=0x559ae85af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1177002235 shutdown_connections 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.450+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1177002235 wait complete. 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 Processor -- start 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 -- start start 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 0x559ae8534100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9393400 0x559ae8534680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559ae92a3380 con 0x559ae9392c00 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559ae92a3200 con 0x559ae9393400 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e65d1f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559ae92a3500 con 0x559ae9393000 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e63cc3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e63cc3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58744/0 (socket says 172.21.15.181:58744) 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.451+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 learned_addr learned my addr 172.21.15.181:0/1433164844 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e644c4640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 0x559ae8534100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9393400 0x559ae8534680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 msgr2=0x559ae8534100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9393000 0x559ae8534100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9393400 msgr2=0x559ae8534680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae9393400 0x559ae8534680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ae84ee780 con 0x559ae9392c00 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9392c00 0x559ae8532b00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x559ae93a37d0 tx=0x559ae93a4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e5e4b8640 1 -- 172.21.15.181:0/1433164844 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ae84dcd00 con 0x559ae9392c00 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e5e4b8640 1 -- 172.21.15.181:0/1433164844 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ae84e2e00 con 0x559ae9392c00 2024-09-12T02:35:04.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ae84ee000 con 0x559ae9392c00 2024-09-12T02:35:04.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e5e4b8640 1 -- 172.21.15.181:0/1433164844 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ae84dc680 con 0x559ae9392c00 2024-09-12T02:35:04.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.452+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ae84efe00 con 0x559ae9392c00 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.453+0000 7f7e5e4b8640 1 -- 172.21.15.181:0/1433164844 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x559ae9410f00 con 0x559ae9392c00 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.453+0000 7f7e5e4b8640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ae940cc00 0x559ae8535700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.453+0000 7f7e5e4b8640 1 -- 172.21.15.181:0/1433164844 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x559ae9418800 con 0x559ae9392c00 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e644c4640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ae940cc00 0x559ae8535700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ae9393800 0x559ae8534c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 8.5 8:a6e36b3f:::401.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae9393c00 con 0x559ae9393800 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ae9393800 0x559ae8534c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e644c4640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ae940cc00 0x559ae8535700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x559ae9249110 tx=0x559ae9258a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ae9393800 0x559ae8534c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 401.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x559ae85c4000 con 0x559ae9393800 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x559ae940d000 0x559ae8535180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.454+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:2 8.17 8:ea85266a:::201.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae940d400 con 0x559ae940d000 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.455+0000 7f7e64cc5640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x559ae940d000 0x559ae8535180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.455+0000 7f7e64cc5640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x559ae940d000 0x559ae8535180 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.455+0000 7f7e64cc5640 1 -- 172.21.15.181:0/1433164844 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(2 201.00000000 [read 0~90 out=90b] v0'0 uv7 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x559ae85c4500 con 0x559ae940d000 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.455+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559ae940d800 0x559ae885e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.455+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:3 8.1b 8:db457a8a:::201.00000001:head [read 2118614~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae940dc00 con 0x559ae940d800 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.456+0000 7f7e644c4640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559ae940d800 0x559ae885e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.456+0000 7f7e644c4640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559ae940d800 0x559ae885e000 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.456+0000 7f7e644c4640 1 -- 172.21.15.181:0/1433164844 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(3 201.00000001 [read 2118614~1740 out=1740b] v0'0 uv1489 ondisk = 0) ==== 156+0+1740 (crc 0 0 0) 0x559ae85c4780 con 0x559ae940d800 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.456+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 8.1b 8:d80f8093:::201.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae8866000 con 0x559ae940d800 2024-09-12T02:35:04.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.457+0000 7f7e644c4640 1 -- 172.21.15.181:0/1433164844 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(4 201.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559ae85c4780 con 0x559ae940d800 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.457+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559ae8866400 0x559ae885e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.457+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:5 8.3 8:c112adae:::101.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae8866800 con 0x559ae8866400 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.457+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559ae8866400 0x559ae885e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.457+0000 7f7e63cc3640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559ae8866400 0x559ae885e580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.457+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(5 101.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x559ae85c4000 con 0x559ae8866400 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.457+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:6 8.3 8:c112adae:::101.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae8866c00 con 0x559ae8866400 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(6 101.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x559ae85c4000 con 0x559ae8866400 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559ae8867000 0x559ae885eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae8867400 con 0x559ae8867000 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e64cc5640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559ae8867000 0x559ae885eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e64cc5640 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559ae8867000 0x559ae885eb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e64cc5640 1 -- 172.21.15.181:0/1433164844 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(7 1.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x559ae85c4500 con 0x559ae8867000 2024-09-12T02:35:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:8 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae8867800 con 0x559ae8867000 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e64cc5640 1 -- 172.21.15.181:0/1433164844 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(8 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv11 ondisk = 0) ==== 154+0+522 (crc 0 0 0) 0x559ae85c4500 con 0x559ae8867000 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.458+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:9 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae8867c00 con 0x559ae8866400 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 <== osd.1 v2:172.21.15.181:6826/1372590643 3 ==== osd_op_reply(9 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x559ae85c4000 con 0x559ae8866400 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:10 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x559ae8866800 con 0x559ae8866400 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e63cc3640 1 -- 172.21.15.181:0/1433164844 <== osd.1 v2:172.21.15.181:6826/1372590643 4 ==== osd_op_reply(10 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x559ae85c4000 con 0x559ae8866400 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:Events by type: 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: SUBTREEMAP: 1 2024-09-12T02:35:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:Errors: 0 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559ae8867000 msgr2=0x559ae885eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x559ae8867000 0x559ae885eb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559ae8866400 msgr2=0x559ae885e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559ae8866400 0x559ae885e580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559ae940d800 msgr2=0x559ae885e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x559ae940d800 0x559ae885e000 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ae9393800 msgr2=0x559ae8534c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ae9393800 0x559ae8534c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e644c4640 1 -- 172.21.15.181:0/1433164844 reap_dead start 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x559ae940d000 msgr2=0x559ae8535180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x559ae940d000 0x559ae8535180 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e644c4640 1 -- 172.21.15.181:0/1433164844 reap_dead start 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ae940cc00 msgr2=0x559ae8535700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ae940cc00 0x559ae8535700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x559ae9249110 tx=0x559ae9258a80 comp rx=0 tx=0).stop 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9392c00 msgr2=0x559ae8532b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9392c00 0x559ae8532b00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x559ae93a37d0 tx=0x559ae93a4cc0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 shutdown_connections 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ae940cc00 0x559ae8535700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/1433164844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9392c00 0x559ae8532b00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 >> 172.21.15.181:0/1433164844 conn(0x559ae9256400 msgr2=0x559ae85af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 shutdown_connections 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.459+0000 7f7e65d1f280 1 -- 172.21.15.181:0/1433164844 wait complete. 2024-09-12T02:35:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 -- 172.21.15.181:0/3270693324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9256800 msgr2=0x559ae8533600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9256800 0x559ae8533600 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x559ae92dd8f0 tx=0x559ae925a240 comp rx=0 tx=0).stop 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 -- 172.21.15.181:0/3270693324 shutdown_connections 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ae84b7c00 0x559ae8533b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ae9256800 0x559ae8533600 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 --2- 172.21.15.181:0/3270693324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ae9256000 0x559ae8533080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 -- 172.21.15.181:0/3270693324 >> 172.21.15.181:0/3270693324 conn(0x559ae84b7000 msgr2=0x559ae85af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 -- 172.21.15.181:0/3270693324 shutdown_connections 2024-09-12T02:35:04.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.460+0000 7f7e65d1f280 1 -- 172.21.15.181:0/3270693324 wait complete. 2024-09-12T02:35:04.472 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=1', '--debug-objecter=1', '--rank', 'cephfs:1', 'event', 'recover_dentries', 'summary'] in time 0:00:00.107823, result: Events by type: SUBTREEMAP: 1 Errors: 0 2024-09-12T02:35:04.472 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 reset session 2024-09-12T02:35:04.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 -- start start 2024-09-12T02:35:04.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 Processor -- start 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d2240c00 0x5593d22bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d2241800 0x5593d22bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d2241c00 0x5593d22bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5593d3104180 con 0x5593d2240c00 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5593d3104300 con 0x5593d2241c00 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.549+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5593d3104480 con 0x5593d2241800 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d2240c00 0x5593d22bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d2240c00 0x5593d22bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58766/0 (socket says 172.21.15.181:58766) 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 -- 172.21.15.181:0/3025854086 learned_addr learned my addr 172.21.15.181:0/3025854086 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dadd95640 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d2241c00 0x5593d22bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dacd93640 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d2241800 0x5593d22bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 -- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d2241800 msgr2=0x5593d22bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d2241800 0x5593d22bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 -- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d2241c00 msgr2=0x5593d22bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d2241c00 0x5593d22bd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 -- 172.21.15.181:0/3025854086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593d2278780 con 0x5593d2240c00 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dadd95640 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d2241c00 0x5593d22bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dad594640 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d2240c00 0x5593d22bc580 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x5593d3073290 tx=0x5593d2fe2540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27525e7a842af97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1daad8f640 1 -- 172.21.15.181:0/3025854086 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5593d22669c0 con 0x5593d2240c00 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1daad8f640 1 -- 172.21.15.181:0/3025854086 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5593d226c700 con 0x5593d2240c00 2024-09-12T02:35:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1daad8f640 1 -- 172.21.15.181:0/3025854086 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5593d2266680 con 0x5593d2240c00 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3025854086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593d22794a0 con 0x5593d2240c00 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3025854086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5593d2278000 con 0x5593d2240c00 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dafe2c280 4 waiting for MDS map... 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1daad8f640 1 -- 172.21.15.181:0/3025854086 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x5593d3128200 con 0x5593d2240c00 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1daad8f640 1 -- 172.21.15.181:0/3025854086 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 51) ==== 2304+0+0 (secure 0 0 0) 0x5593d229b180 con 0x5593d2240c00 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dafe2c280 4 Got MDS map 51 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.550+0000 7f1dafe2c280 10 main: main 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.551+0000 7f1dafe2c280 4 main: connecting to RADOS... 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.551+0000 7f1dafe2c280 1 Processor -- start 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.551+0000 7f1dafe2c280 1 -- start start 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a000 0x5593d22bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a400 0x5593d22bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a800 0x5593d22be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5593d3104600 con 0x5593d317a400 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5593d3104780 con 0x5593d317a800 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5593d3104900 con 0x5593d317a000 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a400 0x5593d22bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a400 0x5593d22bdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58782/0 (socket says 172.21.15.181:58782) 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 -- 172.21.15.181:0/4270729235 learned_addr learned my addr 172.21.15.181:0/4270729235 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dacd93640 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a800 0x5593d22be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dadd95640 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a000 0x5593d22bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 -- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a000 msgr2=0x5593d22bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a000 0x5593d22bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 -- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a800 msgr2=0x5593d22be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a800 0x5593d22be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 -- 172.21.15.181:0/4270729235 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593d22783c0 con 0x5593d317a400 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dadd95640 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a000 0x5593d22bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1dad594640 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a400 0x5593d22bdb80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x5593d3073b60 tx=0x5593d2fe2600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c6ef36afeccccc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1da8d8b640 1 -- 172.21.15.181:0/4270729235 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5593d2266b60 con 0x5593d317a400 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1da8d8b640 1 -- 172.21.15.181:0/4270729235 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5593d226cfc0 con 0x5593d317a400 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.552+0000 7f1da8d8b640 1 -- 172.21.15.181:0/4270729235 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5593d2266820 con 0x5593d317a400 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 -- 172.21.15.181:0/4270729235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a400 msgr2=0x5593d22bdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a400 0x5593d22bdb80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x5593d3073b60 tx=0x5593d2fe2600 comp rx=0 tx=0).stop 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 -- 172.21.15.181:0/4270729235 shutdown_connections 2024-09-12T02:35:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a800 0x5593d22be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a400 0x5593d22bdb80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/4270729235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a000 0x5593d22bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 -- 172.21.15.181:0/4270729235 >> 172.21.15.181:0/4270729235 conn(0x5593d3033c00 msgr2=0x5593d2339000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 -- 172.21.15.181:0/4270729235 shutdown_connections 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 -- 172.21.15.181:0/4270729235 wait complete. 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 Processor -- start 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.553+0000 7f1dafe2c280 1 -- start start 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a000 0x5593d22bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a400 0x5593d22bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dafe2c280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a800 0x5593d22be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5593d3105800 con 0x5593d317a800 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5593d3105680 con 0x5593d317a000 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dafe2c280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5593d3105500 con 0x5593d317a400 2024-09-12T02:35:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a800 0x5593d22be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a800 0x5593d22be680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58784/0 (socket says 172.21.15.181:58784) 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 -- 172.21.15.181:0/3334309623 learned_addr learned my addr 172.21.15.181:0/3334309623 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dad594640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a400 0x5593d22bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dadd95640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a000 0x5593d22bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 -- 172.21.15.181:0/3334309623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a400 msgr2=0x5593d22bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d317a400 0x5593d22bec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 -- 172.21.15.181:0/3334309623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a000 msgr2=0x5593d22bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d317a000 0x5593d22bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 -- 172.21.15.181:0/3334309623 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593d2278960 con 0x5593d317a800 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.554+0000 7f1dacd93640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a800 0x5593d22be680 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x5593d304b6b0 tx=0x5593d3134c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.555+0000 7f1da7588640 1 -- 172.21.15.181:0/3334309623 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5593d2266b60 con 0x5593d317a800 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.555+0000 7f1da7588640 1 -- 172.21.15.181:0/3334309623 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5593d226cc40 con 0x5593d317a800 2024-09-12T02:35:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.555+0000 7f1da7588640 1 -- 172.21.15.181:0/3334309623 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5593d2266820 con 0x5593d317a800 2024-09-12T02:35:04.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.555+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5593d2279680 con 0x5593d317a800 2024-09-12T02:35:04.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.555+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593d2279860 con 0x5593d317a800 2024-09-12T02:35:04.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.555+0000 7f1dafe2c280 4 main: resolving pool 8 2024-09-12T02:35:04.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.556+0000 7f1da7588640 1 -- 172.21.15.181:0/3334309623 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5593d318ac00 con 0x5593d317a800 2024-09-12T02:35:04.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.556+0000 7f1da7588640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5593d3192c00 0x5593d22bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.556+0000 7f1da7588640 1 -- 172.21.15.181:0/3334309623 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x5593d3181000 con 0x5593d317a800 2024-09-12T02:35:04.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.556+0000 7f1dafe2c280 4 main: creating IoCtx.. 2024-09-12T02:35:04.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.556+0000 7f1dadd95640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5593d3192c00 0x5593d22bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.556+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5593d317ac00 0x5593d22be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.556+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.b 8:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x5593d317b000 con 0x5593d317ac00 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.557+0000 7f1dad594640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5593d317ac00 0x5593d22be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.557+0000 7f1dadd95640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5593d3192c00 0x5593d22bf700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5593d234c6f0 tx=0x5593d3134ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.557+0000 7f1dad594640 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5593d317ac00 0x5593d22be100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dad594640 1 -- 172.21.15.181:0/3334309623 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v63'6 uv6 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x5593d2fd2000 con 0x5593d317ac00 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stdout: "data": {}, 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:04.565 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:04.566 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:04.566 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:04.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5593d317ac00 msgr2=0x5593d22be100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5593d317ac00 0x5593d22be100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5593d3192c00 msgr2=0x5593d22bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5593d3192c00 0x5593d22bf700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5593d234c6f0 tx=0x5593d3134ea0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a800 msgr2=0x5593d22be680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3334309623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d317a800 0x5593d22be680 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x5593d304b6b0 tx=0x5593d3134c00 comp rx=0 tx=0).stop 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dacd93640 1 -- 172.21.15.181:0/3334309623 reap_dead start 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 shutdown_connections 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 >> 172.21.15.181:0/3334309623 conn(0x5593d3033c00 msgr2=0x5593d2339000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 shutdown_connections 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.558+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3334309623 wait complete. 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3025854086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d2240c00 msgr2=0x5593d22bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d2240c00 0x5593d22bc580 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x5593d3073290 tx=0x5593d2fe2540 comp rx=0 tx=0).stop 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3025854086 shutdown_connections 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5593d2241c00 0x5593d22bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5593d2241800 0x5593d22bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 --2- 172.21.15.181:0/3025854086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5593d2240c00 0x5593d22bc580 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3025854086 >> 172.21.15.181:0/3025854086 conn(0x5593d2241000 msgr2=0x5593d2338800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3025854086 shutdown_connections 2024-09-12T02:35:04.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.559+0000 7f1dafe2c280 1 -- 172.21.15.181:0/3025854086 wait complete. 2024-09-12T02:35:04.569 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'reset', 'session'] in time 0:00:00.096596, result: { "0": { "data": {}, "result": 0 } } 2024-09-12T02:35:04.569 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-12T02:35:04.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 -- start start 2024-09-12T02:35:04.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 Processor -- start 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb227d0c00 0x55eb2284c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb227d1800 0x55eb2284cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb227d1c00 0x55eb2284d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bc180 con 0x55eb227d1c00 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bc300 con 0x55eb227d1800 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55eb235bc480 con 0x55eb227d0c00 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ad3a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb227d1c00 0x55eb2284d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ad3a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb227d1c00 0x55eb2284d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58814/0 (socket says 172.21.15.181:58814) 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2456469137 learned_addr learned my addr 172.21.15.181:0/2456469137 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3acba0640 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb227d0c00 0x55eb2284c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.649+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb227d1800 0x55eb2284cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb227d0c00 msgr2=0x55eb2284c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb227d0c00 0x55eb2284c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb227d1800 msgr2=0x55eb2284cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb227d1800 0x55eb2284cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2456469137 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb22808780 con 0x55eb227d1c00 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb227d1c00 0x55eb2284d080 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55eb235f9740 tx=0x55eb23572b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddd5f7b29db958d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3aa39b640 1 -- 172.21.15.181:0/2456469137 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb227f69c0 con 0x55eb227d1c00 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3aa39b640 1 -- 172.21.15.181:0/2456469137 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55eb227fcfc0 con 0x55eb227d1c00 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3aa39b640 1 -- 172.21.15.181:0/2456469137 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb227f6680 con 0x55eb227d1c00 2024-09-12T02:35:04.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2456469137 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb228083c0 con 0x55eb227d1c00 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2456469137 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55eb22809680 con 0x55eb227d1c00 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ae3f9280 4 waiting for MDS map... 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3aa39b640 1 -- 172.21.15.181:0/2456469137 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x55eb236c0600 con 0x55eb227d1c00 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3aa39b640 1 -- 172.21.15.181:0/2456469137 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 51) ==== 2304+0+0 (secure 0 0 0) 0x55eb2282b180 con 0x55eb227d1c00 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ae3f9280 4 Got MDS map 51 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ae3f9280 10 main: JournalTool::main 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.650+0000 7fc3ae3f9280 4 main: JournalTool: connecting to RADOS... 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 Processor -- start 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 -- start start 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706000 0x55eb2284d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706800 0x55eb2284e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bc600 con 0x55eb23706000 2024-09-12T02:35:04.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bc780 con 0x55eb23706400 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.651+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55eb235bc900 con 0x55eb23706800 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706000 0x55eb2284d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706000 0x55eb2284d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58820/0 (socket says 172.21.15.181:58820) 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 -- 172.21.15.181:0/3035214033 learned_addr learned my addr 172.21.15.181:0/3035214033 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3acba0640 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706800 0x55eb2284e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 -- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706800 msgr2=0x55eb2284e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706800 0x55eb2284e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 -- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 msgr2=0x55eb2284db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 -- 172.21.15.181:0/3035214033 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb228094a0 con 0x55eb23706000 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706000 0x55eb2284d600 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x55eb235dc6c0 tx=0x55eb236aac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b166c56fdec02589 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3a8397640 1 -- 172.21.15.181:0/3035214033 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb227f69c0 con 0x55eb23706000 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3a8397640 1 -- 172.21.15.181:0/3035214033 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55eb227fca80 con 0x55eb23706000 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3a8397640 1 -- 172.21.15.181:0/3035214033 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb227f6680 con 0x55eb23706000 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/3035214033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706000 msgr2=0x55eb2284d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706000 0x55eb2284d600 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x55eb235dc6c0 tx=0x55eb236aac60 comp rx=0 tx=0).stop 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/3035214033 shutdown_connections 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706800 0x55eb2284e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/3035214033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706000 0x55eb2284d600 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.652+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/3035214033 >> 172.21.15.181:0/3035214033 conn(0x55eb235c5c00 msgr2=0x55eb228c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.653+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/3035214033 shutdown_connections 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.653+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/3035214033 wait complete. 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.653+0000 7fc3ae3f9280 1 Processor -- start 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.653+0000 7fc3ae3f9280 1 -- start start 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706000 0x55eb2284f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706800 0x55eb2284e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bd800 con 0x55eb23706800 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bd680 con 0x55eb23706400 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55eb235bd500 con 0x55eb23706000 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706800 0x55eb2284e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706800 0x55eb2284e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58836/0 (socket says 172.21.15.181:58836) 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 -- 172.21.15.181:0/148252074 learned_addr learned my addr 172.21.15.181:0/148252074 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706000 0x55eb2284f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3acba0640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 -- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706000 msgr2=0x55eb2284f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706000 0x55eb2284f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 -- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 msgr2=0x55eb2284ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 -- 172.21.15.181:0/148252074 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb22808000 con 0x55eb23706800 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3acba0640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706800 0x55eb2284e680 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55eb235dd980 tx=0x55eb236aac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3a6b94640 1 -- 172.21.15.181:0/148252074 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb227f64e0 con 0x55eb23706800 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3a6b94640 1 -- 172.21.15.181:0/148252074 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55eb227fcc40 con 0x55eb23706800 2024-09-12T02:35:04.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb22808960 con 0x55eb23706800 2024-09-12T02:35:04.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3a6b94640 1 -- 172.21.15.181:0/148252074 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb227f69c0 con 0x55eb23706800 2024-09-12T02:35:04.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb22809860 con 0x55eb23706800 2024-09-12T02:35:04.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.654+0000 7fc3ae3f9280 4 main: JournalTool: resolving pool 8 2024-09-12T02:35:04.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.655+0000 7fc3a6b94640 1 -- 172.21.15.181:0/148252074 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55eb23722c00 con 0x55eb23706800 2024-09-12T02:35:04.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3a6b94640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55eb22b50000 0x55eb2284f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3a6b94640 1 -- 172.21.15.181:0/148252074 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x55eb23720a00 con 0x55eb23706800 2024-09-12T02:35:04.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3ae3f9280 4 main: JournalTool: creating IoCtx.. 2024-09-12T02:35:04.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3ae3f9280 4 main: Executing for rank 0 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3acba0640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55eb22b50000 0x55eb2284f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3acba0640 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55eb22b50000 0x55eb2284f700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55eb2294ccf0 tx=0x55eb236aaea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3ae3f9280 1 -- start start 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.656+0000 7fc3ae3f9280 1 Processor -- start 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23707000 0x55eb2284e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb22b51000 0x55eb2284db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ae3f9280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb22b51400 0x55eb2284d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bd200 con 0x55eb22b51000 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55eb235bc600 con 0x55eb23707000 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ae3f9280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55eb235bc780 con 0x55eb22b51400 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb22b51000 0x55eb2284db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb22b51000 0x55eb2284db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58852/0 (socket says 172.21.15.181:58852) 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 -- 172.21.15.181:0/2878495695 learned_addr learned my addr 172.21.15.181:0/2878495695 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23707000 0x55eb2284e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb22b51400 0x55eb2284d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 -- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb22b51400 msgr2=0x55eb2284d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb22b51400 0x55eb2284d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 -- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23707000 msgr2=0x55eb2284e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23707000 0x55eb2284e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.657+0000 7fc3acba0640 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb22809a40 con 0x55eb22b51000 2024-09-12T02:35:04.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb22b51400 0x55eb2284d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:04.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23707000 0x55eb2284e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3acba0640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb22b51000 0x55eb2284db80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55eb23744ed0 tx=0x55eb236abda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d36bf2c75a767fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3a3b8e640 1 -- 172.21.15.181:0/2878495695 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb23753a00 con 0x55eb22b51000 2024-09-12T02:35:04.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3a3b8e640 1 -- 172.21.15.181:0/2878495695 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55eb227fc1c0 con 0x55eb22b51000 2024-09-12T02:35:04.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3a3b8e640 1 -- 172.21.15.181:0/2878495695 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55eb23753860 con 0x55eb22b51000 2024-09-12T02:35:04.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb228094a0 con 0x55eb22b51000 2024-09-12T02:35:04.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55eb22808000 con 0x55eb22b51000 2024-09-12T02:35:04.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ae3f9280 4 waiting for MDS map... 2024-09-12T02:35:04.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3a3b8e640 1 -- 172.21.15.181:0/2878495695 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x55eb22bb6600 con 0x55eb22b51000 2024-09-12T02:35:04.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3a3b8e640 1 -- 172.21.15.181:0/2878495695 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 51) ==== 2304+0+0 (secure 0 0 0) 0x55eb2282b500 con 0x55eb22b51000 2024-09-12T02:35:04.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ae3f9280 4 Got MDS map 51 2024-09-12T02:35:04.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55eb22b51800 0x55eb22bce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.f 8:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x55eb22b51c00 con 0x55eb22b51800 2024-09-12T02:35:04.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55eb22b51800 0x55eb22bce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.658+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55eb22b51800 0x55eb22bce000 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=cefb3ddbe54ada65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.659+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55eb23562000 con 0x55eb22b51800 2024-09-12T02:35:04.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.659+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55eb22bb9400 0x55eb22bce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.659+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:2 8.14 8:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bb9800 con 0x55eb22bb9400 2024-09-12T02:35:04.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.659+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55eb22bb9400 0x55eb22bce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.659+0000 7fc3ac39f640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55eb22bb9400 0x55eb22bce580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=13ff05da47b6d6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.660+0000 7fc3ac39f640 1 -- 172.21.15.181:0/2878495695 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv1545 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55eb23562500 con 0x55eb22bb9400 2024-09-12T02:35:04.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.660+0000 7fc3a238b640 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:3 8.1b 8:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bde000 con 0x55eb22bb9400 2024-09-12T02:35:04.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.660+0000 7fc3a238b640 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:4 8.b 8:d5c7a900:::200.00000003:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bde400 con 0x55eb22b51800 2024-09-12T02:35:04.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.660+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(4 200.00000003 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22b51800 2024-09-12T02:35:04.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.660+0000 7fc3ac39f640 1 -- 172.21.15.181:0/2878495695 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(3 200.00000002 [stat out=16b] v0'0 uv1491 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55eb23562500 con 0x55eb22bb9400 2024-09-12T02:35:04.675 INFO:teuthology.orchestra.run.smithi181.stdout:old journal was 9756080~5605 2024-09-12T02:35:04.676 INFO:teuthology.orchestra.run.smithi181.stdout:new journal start will be 12582912 (2821227 bytes past old end) 2024-09-12T02:35:04.676 INFO:teuthology.orchestra.run.smithi181.stdout:writing journal head 2024-09-12T02:35:04.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.660+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:5 8.14 8:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bb9c00 con 0x55eb22bb9400 2024-09-12T02:35:04.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ac39f640 1 -- 172.21.15.181:0/2878495695 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v63'1549 uv1549 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55eb23562500 con 0x55eb22bb9400 2024-09-12T02:35:04.676 INFO:teuthology.orchestra.run.smithi181.stdout:writing EResetJournal entry 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:6 8.b 8:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bdec00 con 0x55eb22b51800 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55eb22bdf000 0x55eb22bceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 8.1f 8:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bdf400 con 0x55eb22bdf000 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:8 8.1a 8:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bdf800 con 0x55eb22bdf000 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:9 8.1e 8:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bdfc00 con 0x55eb22b51800 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:10 8.1d 8:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22be0000 con 0x55eb22bdf000 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:11 8.1d 8:bf8dcf43:::200.00000008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22be0400 con 0x55eb22bdf000 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55eb22bdf000 0x55eb22bceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.662+0000 7fc3ad3a1640 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55eb22bdf000 0x55eb22bceb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=f8c710ce47285883 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.663+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(6 200.00000003 [delete] v63'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22b51800 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.663+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(9 200.00000006 [delete] v63'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22b51800 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.664+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(7 200.00000004 [delete] v63'12 uv11 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22bdf000 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.664+0000 7fc3a238b640 1 -- 172.21.15.181:0/2878495695 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:12 8.b 8:d5c7a900:::200.00000003:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63) -- 0x55eb22bde800 con 0x55eb22b51800 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.664+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(10 200.00000007 [delete] v63'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22bdf000 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.664+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(11 200.00000008 [delete] v63'5 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22bdf000 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.664+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(8 200.00000005 [delete] v63'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22bdf000 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ad3a1640 1 -- 172.21.15.181:0/2878495695 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(12 200.00000003 [write 0~48] v63'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55eb23562000 con 0x55eb22b51800 2024-09-12T02:35:04.680 INFO:teuthology.orchestra.run.smithi181.stdout:done 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55eb22bdf000 msgr2=0x55eb22bceb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x55eb22bdf000 0x55eb22bceb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55eb22b51800 msgr2=0x55eb22bce000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55eb22b51800 0x55eb22bce000 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55eb22bb9400 msgr2=0x55eb22bce580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55eb22bb9400 0x55eb22bce580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ac39f640 1 -- 172.21.15.181:0/2878495695 reap_dead start 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb22b51000 msgr2=0x55eb2284db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.665+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb22b51000 0x55eb2284db80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55eb23744ed0 tx=0x55eb236abda0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 shutdown_connections 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2878495695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb22b51000 0x55eb2284db80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 >> 172.21.15.181:0/2878495695 conn(0x55eb23706c00 msgr2=0x55eb228c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 shutdown_connections 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2878495695 wait complete. 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55eb22b50000 msgr2=0x55eb2284f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55eb22b50000 0x55eb2284f700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55eb2294ccf0 tx=0x55eb236aaea0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706800 msgr2=0x55eb2284e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706800 0x55eb2284e680 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55eb235dd980 tx=0x55eb236aac00 comp rx=0 tx=0).stop 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 shutdown_connections 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55eb22b50000 0x55eb2284f700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb23706400 0x55eb2284ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb23706800 0x55eb2284e680 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/148252074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb23706000 0x55eb2284f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 >> 172.21.15.181:0/148252074 conn(0x55eb235c5c00 msgr2=0x55eb228c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 shutdown_connections 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/148252074 wait complete. 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2456469137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb227d1c00 msgr2=0x55eb2284d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb227d1c00 0x55eb2284d080 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55eb235f9740 tx=0x55eb23572b40 comp rx=0 tx=0).stop 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2456469137 shutdown_connections 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55eb227d1800 0x55eb2284cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb227d1c00 0x55eb2284d080 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 --2- 172.21.15.181:0/2456469137 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55eb227d0c00 0x55eb2284c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2456469137 >> 172.21.15.181:0/2456469137 conn(0x55eb227d1000 msgr2=0x55eb228c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2456469137 shutdown_connections 2024-09-12T02:35:04.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.666+0000 7fc3ae3f9280 1 -- 172.21.15.181:0/2456469137 wait complete. 2024-09-12T02:35:04.687 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--yes-i-really-really-mean-it'] in time 0:00:00.117512, result: old journal was 9756080~5605 new journal start will be 12582912 (2821227 bytes past old end) writing journal head writing EResetJournal entry done 2024-09-12T02:35:04.687 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-12T02:35:04.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 Processor -- start 2024-09-12T02:35:04.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 -- start start 2024-09-12T02:35:04.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0e86f70 0x5607c0f16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f13ca0 0x5607c0e6c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0f14080 0x5607c0e686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5607c0e84fe0 con 0x5607c0f14080 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5607c0d8e510 con 0x5607c0f13ca0 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.766+0000 7f93142f8f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5607c0e83fc0 con 0x5607c0e86f70 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0e86f70 0x5607c0f16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f93125ef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0f14080 0x5607c0e686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0e86f70 0x5607c0f16a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:55706/0 (socket says 172.21.15.181:55706) 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 -- 172.21.15.181:0/4021371329 learned_addr learned my addr 172.21.15.181:0/4021371329 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f930bfff640 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f13ca0 0x5607c0e6c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 -- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f13ca0 msgr2=0x5607c0e6c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f13ca0 0x5607c0e6c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 -- 172.21.15.181:0/4021371329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0f14080 msgr2=0x5607c0e686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0f14080 0x5607c0e686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 -- 172.21.15.181:0/4021371329 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607c0e6cb50 con 0x5607c0e86f70 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f93125ef640 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0f14080 0x5607c0e686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9311dee640 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0e86f70 0x5607c0f16a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9304055040 tx=0x7f9304051000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5150e025e44bf48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9310dec640 1 -- 172.21.15.181:0/4021371329 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040539c0 con 0x5607c0e86f70 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9310dec640 1 -- 172.21.15.181:0/4021371329 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9304053b60 con 0x5607c0e86f70 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.767+0000 7f9310dec640 1 -- 172.21.15.181:0/4021371329 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304067430 con 0x5607c0e86f70 2024-09-12T02:35:04.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 -- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0e86f70 msgr2=0x5607c0f16a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0e86f70 0x5607c0f16a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9304055040 tx=0x7f9304051000 comp rx=0 tx=0).stop 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 -- 172.21.15.181:0/4021371329 shutdown_connections 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f13ca0 0x5607c0e6c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0f14080 0x5607c0e686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 --2- 172.21.15.181:0/4021371329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0e86f70 0x5607c0f16a40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 -- 172.21.15.181:0/4021371329 >> 172.21.15.181:0/4021371329 conn(0x5607c0e67270 msgr2=0x5607c0f14560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 -- 172.21.15.181:0/4021371329 shutdown_connections 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 -- 172.21.15.181:0/4021371329 wait complete. 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 Processor -- start 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.768+0000 7f93142f8f40 1 -- start start 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f93142f8f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0e86f70 0x5607c0efd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f93142f8f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0f13ca0 0x5607c0f082f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f93142f8f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f14080 0x5607c0f08830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f93142f8f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5607c0f13070 con 0x5607c0e86f70 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f93142f8f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5607c0f12db0 con 0x5607c0f14080 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f93142f8f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5607c0f13350 con 0x5607c0f13ca0 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0e86f70 0x5607c0efd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0e86f70 0x5607c0efd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58870/0 (socket says 172.21.15.181:58870) 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 learned_addr learned my addr 172.21.15.181:0/1390818005 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0f13ca0 0x5607c0f082f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0f13ca0 msgr2=0x5607c0f082f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5607c0f13ca0 0x5607c0f082f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f14080 msgr2=0x5607c0f08830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5607c0f14080 0x5607c0f08830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607c0e80c30 con 0x5607c0e86f70 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.769+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0e86f70 0x5607c0efd230 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9304045a40 tx=0x7f9304002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.770+0000 7f930affd640 1 -- 172.21.15.181:0/1390818005 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304053840 con 0x5607c0e86f70 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.770+0000 7f930affd640 1 -- 172.21.15.181:0/1390818005 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9304074070 con 0x5607c0e86f70 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.770+0000 7f930affd640 1 -- 172.21.15.181:0/1390818005 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304067670 con 0x5607c0e86f70 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.770+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607c0e86780 con 0x5607c0e86f70 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.770+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607c0f07af0 con 0x5607c0e86f70 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.771+0000 7f930affd640 1 -- 172.21.15.181:0/1390818005 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9304053d10 con 0x5607c0e86f70 2024-09-12T02:35:04.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.771+0000 7f930affd640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92f406a810 0x7f92f406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92f406a810 0x7f92f406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f930affd640 1 -- 172.21.15.181:0/1390818005 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f93040cf990 con 0x5607c0e86f70 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5607c0efd770 0x5607c0fb5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x5607c0efd770 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5607c0efd770 0x5607c0fb5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92f406a810 0x7f92f406ccd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5607c0e82c00 tx=0x7f92fc00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5607c0efd770 0x5607c0fb5ea0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c0014a0 con 0x5607c0efd770 2024-09-12T02:35:04.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f930c00e6e0 0x7f930c00b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.772+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00e6e0 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.773+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f930c00e6e0 0x7f930c00b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.773+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f930c00e6e0 0x7f930c00b140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.774+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(2 [pgnls start_epoch 63 out=201b] v60'12 uv12 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00e6e0 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.774+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f930409de30 0x7f930409ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.774+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930409de30 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.774+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f930409de30 0x7f930409ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.774+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f930409de30 0x7f930409ca90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.775+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== osd_op_reply(3 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f92fc020040 con 0x7f930409de30 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.775+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f92fc016950 0x7f92fc0173f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.775+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc016950 2024-09-12T02:35:04.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.775+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f92fc016950 0x7f92fc0173f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.775+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f92fc016950 0x7f92fc0173f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(4 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc016950 2024-09-12T02:35:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930409de30 2024-09-12T02:35:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== osd_op_reply(5 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92fc020040 con 0x7f930409de30 2024-09-12T02:35:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc016950 2024-09-12T02:35:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(6 [pgnls start_epoch 63 out=149b] v63'1549 uv1549 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc016950 2024-09-12T02:35:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f930c00ebc0 0x7f930c019900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00ebc0 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.776+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f930c00ebc0 0x7f930c019900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.777+0000 7f9311dee640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f930c00ebc0 0x7f930c019900 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.777+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(7 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00ebc0 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.777+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930409de30 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.777+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.5 v2:172.21.15.204:6824/2921904049 3 ==== osd_op_reply(8 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f92fc020040 con 0x7f930409de30 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.777+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc016950 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.778+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(9 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc016950 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.778+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f930c00bb30 0x7f930c016870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.778+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00bb30 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.778+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f930c00bb30 0x7f930c016870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.778+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f930c00bb30 0x7f930c016870 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(10 [pgnls start_epoch 63 out=73b] v60'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f92fc020040 con 0x7f930c00bb30 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f930bfff640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f92fc025960 0x7f92fc0243e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc025960 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f92fc025960 0x7f92fc0243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f93125ef640 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f92fc025960 0x7f92fc0243e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(11 [pgnls start_epoch 63 out=49b] v61'14 uv14 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc025960 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00ebc0 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(12 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00ebc0 2024-09-12T02:35:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.779+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00ebc0 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(13 [pgnls start_epoch 63 out=77b] v60'15 uv15 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00ebc0 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x5607c0efd770 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(14 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f930c0014a0 con 0x5607c0efd770 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00ebc0 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(15 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00ebc0 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x5607c0efd770 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(16 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c0014a0 con 0x5607c0efd770 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.780+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc025960 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.781+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(17 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc025960 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.781+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930409de30 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.781+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.5 v2:172.21.15.204:6824/2921904049 4 ==== osd_op_reply(18 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92fc020040 con 0x7f930409de30 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.781+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00bb30 2024-09-12T02:35:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.782+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(19 [pgnls start_epoch 63 out=97b] v60'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f92fc020040 con 0x7f930c00bb30 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.782+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930409de30 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.782+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.5 v2:172.21.15.204:6824/2921904049 5 ==== osd_op_reply(20 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92fc020040 con 0x7f930409de30 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.782+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00bb30 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.782+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(21 [pgnls start_epoch 63 out=73b] v60'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f92fc020040 con 0x7f930c00bb30 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.782+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00e6e0 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.782+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== osd_op_reply(22 [pgnls start_epoch 63 out=127b] v60'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00e6e0 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.783+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930409de30 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.783+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 <== osd.5 v2:172.21.15.204:6824/2921904049 6 ==== osd_op_reply(23 [pgnls start_epoch 63 out=74b] v59'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f92fc020040 con 0x7f930409de30 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.783+0000 7f930bfff640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f930c00ebc0 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.783+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(24 [pgnls start_epoch 63 out=73b] v63'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00ebc0 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.783+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc025960 2024-09-12T02:35:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.783+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.1 v2:172.21.15.181:6826/1372590643 3 ==== osd_op_reply(25 [pgnls start_epoch 63 out=73b] v61'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc025960 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.783+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x5607c0efd770 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.784+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(26 [pgnls start_epoch 63 out=122b] v60'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f930c0014a0 con 0x5607c0efd770 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.784+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x5607c0efd770 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.784+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(27 [pgnls start_epoch 63 out=124b] v63'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7f930c0014a0 con 0x5607c0efd770 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.784+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc016950 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.784+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(28 [pgnls start_epoch 63 out=97b] v61'1492 uv1492 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc016950 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.784+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5607c0efdc00 con 0x7f92fc025960 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.785+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.1 v2:172.21.15.181:6826/1372590643 4 ==== osd_op_reply(29 [pgnls start_epoch 63 out=129b] v60'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7f930c0014a0 con 0x7f92fc025960 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.785+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x7f930c03c090 con 0x7f930c00e6e0 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.785+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.7 v2:172.21.15.204:6808/3631554107 3 ==== osd_op_reply(30 [pgnls start_epoch 63 out=97b] v60'7 uv7 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00e6e0 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.785+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x7f930c03c090 con 0x5607c0efd770 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.785+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 <== osd.3 v2:172.21.15.181:6800/1415662156 6 ==== osd_op_reply(31 [pgnls start_epoch 63 out=73b] v59'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f930c0014a0 con 0x5607c0efd770 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.785+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x7f930c03c090 con 0x7f930c00ebc0 2024-09-12T02:35:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f9311dee640 1 -- 172.21.15.181:0/1390818005 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(32 [pgnls start_epoch 63 out=101b] v63'12 uv11 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f930409a240 con 0x7f930c00ebc0 2024-09-12T02:35:04.795 INFO:teuthology.orchestra.run.smithi181.stdout:601.00000000 2024-09-12T02:35:04.795 INFO:teuthology.orchestra.run.smithi181.stdout:602.00000000 2024-09-12T02:35:04.795 INFO:teuthology.orchestra.run.smithi181.stdout:10000000000.00000000 2024-09-12T02:35:04.795 INFO:teuthology.orchestra.run.smithi181.stdout:600.00000000 2024-09-12T02:35:04.795 INFO:teuthology.orchestra.run.smithi181.stdout:603.00000000 2024-09-12T02:35:04.795 INFO:teuthology.orchestra.run.smithi181.stdout:60a.00000000 2024-09-12T02:35:04.795 INFO:teuthology.orchestra.run.smithi181.stdout:613.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000.inode 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:610.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:606.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:607.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:60e.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_openfiles.0 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:60f.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:608.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:501.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:612.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:401.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:604.00000000 2024-09-12T02:35:04.796 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000.inode 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:500.00000000 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:mds_snaptable 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:605.00000000 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_inotable 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:611.00000000 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_sessionmap 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000003 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:60c.00000000 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:201.00000001 2024-09-12T02:35:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000002 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:609.00000000 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:10000000001.00000000 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:60b.00000000 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:60d.00000000 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:201.00000000 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:400.00000000 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000.inode 2024-09-12T02:35:04.798 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f930c00ebc0 msgr2=0x7f930c019900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f930c00ebc0 0x7f930c019900 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f92fc025960 msgr2=0x7f92fc0243e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f92fc025960 0x7f92fc0243e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5607c0efd770 msgr2=0x5607c0fb5ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5607c0efd770 0x5607c0fb5ea0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f92fc016950 msgr2=0x7f92fc0173f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f92fc016950 0x7f92fc0173f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f930409de30 msgr2=0x7f930409ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f930409de30 0x7f930409ca90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f930c00bb30 msgr2=0x7f930c016870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f930c00bb30 0x7f930c016870 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f930c00e6e0 msgr2=0x7f930c00b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f930c00e6e0 0x7f930c00b140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 reap_dead start 2024-09-12T02:35:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 reap_dead start 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93125ef640 1 -- 172.21.15.181:0/1390818005 reap_dead start 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92f406a810 msgr2=0x7f92f406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92f406a810 0x7f92f406ccd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5607c0e82c00 tx=0x7f92fc00c040 comp rx=0 tx=0).stop 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0e86f70 msgr2=0x5607c0efd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0e86f70 0x5607c0efd230 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9304045a40 tx=0x7f9304002fb0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 shutdown_connections 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92f406a810 0x7f92f406ccd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 --2- 172.21.15.181:0/1390818005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607c0e86f70 0x5607c0efd230 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 >> 172.21.15.181:0/1390818005 conn(0x5607c0e67270 msgr2=0x5607c0f14560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 shutdown_connections 2024-09-12T02:35:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.786+0000 7f93142f8f40 1 -- 172.21.15.181:0/1390818005 wait complete. 2024-09-12T02:35:04.803 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 201.00000001 2024-09-12T02:35:04.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 Processor -- start 2024-09-12T02:35:04.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 -- start start 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 0x55ac733d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac733d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac734752a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ac732fa510 con 0x55ac73461cd0 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55ac73353c50 con 0x55ac733abf70 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe09330f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55ac73462160 con 0x55ac733ac350 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe07629640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac734752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe07629640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac734752a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58878/0 (socket says 172.21.15.181:58878) 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.883+0000 7efe07629640 1 -- 172.21.15.181:0/3708891066 learned_addr learned my addr 172.21.15.181:0/3708891066 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe06e28640 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 0x55ac733d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efdfe627640 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac733d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe07629640 1 -- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 msgr2=0x55ac733d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe07629640 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac733d4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe07629640 1 -- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 msgr2=0x55ac733d9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe07629640 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 0x55ac733d9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe07629640 1 -- 172.21.15.181:0/3708891066 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac733d3150 con 0x55ac73461cd0 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efdfe627640 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac733d4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe07629640 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac734752a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efe000015c0 tx=0x7efe00001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662b9ffadb7b1ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe05e26640 1 -- 172.21.15.181:0/3708891066 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00003650 con 0x55ac73461cd0 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe05e26640 1 -- 172.21.15.181:0/3708891066 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe000037f0 con 0x55ac73461cd0 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe05e26640 1 -- 172.21.15.181:0/3708891066 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00003c60 con 0x55ac73461cd0 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe09330f40 1 -- 172.21.15.181:0/3708891066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 msgr2=0x55ac734752a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe09330f40 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac734752a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efe000015c0 tx=0x7efe00001a80 comp rx=0 tx=0).stop 2024-09-12T02:35:04.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe09330f40 1 -- 172.21.15.181:0/3708891066 shutdown_connections 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe09330f40 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac734752a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe09330f40 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac733d4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe09330f40 1 --2- 172.21.15.181:0/3708891066 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 0x55ac733d9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.884+0000 7efe09330f40 1 -- 172.21.15.181:0/3708891066 >> 172.21.15.181:0/3708891066 conn(0x55ac733a7bb0 msgr2=0x55ac73480e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.885+0000 7efe09330f40 1 -- 172.21.15.181:0/3708891066 shutdown_connections 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.885+0000 7efe09330f40 1 -- 172.21.15.181:0/3708891066 wait complete. 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.885+0000 7efe09330f40 1 Processor -- start 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.885+0000 7efe09330f40 1 -- start start 2024-09-12T02:35:04.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe09330f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 0x55ac735118b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe09330f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac7351a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe09330f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac7351ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe09330f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ac733f42d0 con 0x55ac73461cd0 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe09330f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55ac733a84a0 con 0x55ac733abf70 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe09330f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55ac733a81c0 con 0x55ac733ac350 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac7351ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac7351ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58880/0 (socket says 172.21.15.181:58880) 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 -- 172.21.15.181:0/3483160476 learned_addr learned my addr 172.21.15.181:0/3483160476 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe06e28640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 0x55ac735118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efdfe627640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac7351a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 -- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 msgr2=0x55ac7351a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55ac733ac350 0x55ac7351a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 -- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 msgr2=0x55ac735118b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55ac733abf70 0x55ac735118b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 -- 172.21.15.181:0/3483160476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac73460a40 con 0x55ac73461cd0 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe07629640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac7351ab30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe00000f80 tx=0x7efe00001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe04e24640 1 -- 172.21.15.181:0/3483160476 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00024070 con 0x55ac73461cd0 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe04e24640 1 -- 172.21.15.181:0/3483160476 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00019040 con 0x55ac73461cd0 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe04e24640 1 -- 172.21.15.181:0/3483160476 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00013860 con 0x55ac73461cd0 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.886+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac73467530 con 0x55ac73461cd0 2024-09-12T02:35:04.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.887+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac73481010 con 0x55ac73461cd0 2024-09-12T02:35:04.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.888+0000 7efe04e24640 1 -- 172.21.15.181:0/3483160476 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe00010070 con 0x55ac73461cd0 2024-09-12T02:35:04.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.888+0000 7efe04e24640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde806a810 0x7efde806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.888+0000 7efe04e24640 1 -- 172.21.15.181:0/3483160476 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7efe0008a790 con 0x55ac73461cd0 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.888+0000 7efe06e28640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde806a810 0x7efde806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.888+0000 7efe09330f40 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55ac73511df0 0x55ac73521dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.888+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:1 8.1b 8:db457a8a:::201.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e63) -- 0x55ac73466820 con 0x55ac73511df0 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.889+0000 7efe06e28640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde806a810 0x7efde806ccd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efdf8057000 tx=0x7efdf8052000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.889+0000 7efdfe627640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55ac73511df0 0x55ac73521dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.889+0000 7efdfe627640 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55ac73511df0 0x55ac73521dc0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efdfe627640 1 -- 172.21.15.181:0/3483160476 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(1 201.00000001 [delete] v63'1493 uv1493 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7efdf000e040 con 0x55ac73511df0 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55ac73511df0 msgr2=0x55ac73521dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x55ac73511df0 0x55ac73521dc0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde806a810 msgr2=0x7efde806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efde806a810 0x7efde806ccd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efdf8057000 tx=0x7efdf8052000 comp rx=0 tx=0).stop 2024-09-12T02:35:04.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 msgr2=0x55ac7351ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 --2- 172.21.15.181:0/3483160476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ac73461cd0 0x55ac7351ab30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe00000f80 tx=0x7efe00001250 comp rx=0 tx=0).stop 2024-09-12T02:35:04.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe07629640 1 -- 172.21.15.181:0/3483160476 reap_dead start 2024-09-12T02:35:04.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 shutdown_connections 2024-09-12T02:35:04.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 >> 172.21.15.181:0/3483160476 conn(0x55ac733a7bb0 msgr2=0x55ac733d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 shutdown_connections 2024-09-12T02:35:04.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.892+0000 7efe09330f40 1 -- 172.21.15.181:0/3483160476 wait complete. 2024-09-12T02:35:04.897 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 201.00000000 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.979+0000 7f11f92d2f40 1 Processor -- start 2024-09-12T02:35:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.979+0000 7f11f92d2f40 1 -- start start 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f92d2f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba869ff90 0x558ba8619ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f92d2f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a95c0 0x558ba861a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f92d2f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba86a9ee0 0x558ba86ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f92d2f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558ba86aa640 con 0x558ba869ff90 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f92d2f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558ba8523510 con 0x558ba86a9ee0 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f92d2f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558ba8612660 con 0x558ba86a95c0 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba869ff90 0x558ba8619ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba869ff90 0x558ba8619ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58898/0 (socket says 172.21.15.181:58898) 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 -- 172.21.15.181:0/3536346581 learned_addr learned my addr 172.21.15.181:0/3536346581 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11effff640 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a95c0 0x558ba861a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f75c9640 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba86a9ee0 0x558ba86ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 -- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a95c0 msgr2=0x558ba861a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a95c0 0x558ba861a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 -- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba86a9ee0 msgr2=0x558ba86ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:04.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba86a9ee0 0x558ba86ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 -- 172.21.15.181:0/3536346581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba861a720 con 0x558ba869ff90 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f75c9640 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba86a9ee0 0x558ba86ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.980+0000 7f11f6dc8640 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba869ff90 0x558ba8619ca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f11e800a7a0 tx=0x7f11e800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7bb49edf32500d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f5dc6640 1 -- 172.21.15.181:0/3536346581 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8018070 con 0x558ba869ff90 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f5dc6640 1 -- 172.21.15.181:0/3536346581 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e8007600 con 0x558ba869ff90 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f5dc6640 1 -- 172.21.15.181:0/3536346581 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e80079b0 con 0x558ba869ff90 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3536346581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba869ff90 msgr2=0x558ba8619ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba869ff90 0x558ba8619ca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f11e800a7a0 tx=0x7f11e800a890 comp rx=0 tx=0).stop 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3536346581 shutdown_connections 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba86a9ee0 0x558ba86ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a95c0 0x558ba861a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3536346581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba869ff90 0x558ba8619ca0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3536346581 >> 172.21.15.181:0/3536346581 conn(0x558ba85fc400 msgr2=0x558ba86016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3536346581 shutdown_connections 2024-09-12T02:35:04.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.981+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3536346581 wait complete. 2024-09-12T02:35:04.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 Processor -- start 2024-09-12T02:35:04.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 -- start start 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba869ff90 0x558ba869a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba86a95c0 0x558ba8699f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a9ee0 0x558ba869bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558ba86a9180 con 0x558ba86a95c0 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558ba8696d10 con 0x558ba869ff90 2024-09-12T02:35:04.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f92d2f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558ba8698bd0 con 0x558ba86a9ee0 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11effff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba86a95c0 0x558ba8699f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11effff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba86a95c0 0x558ba8699f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58904/0 (socket says 172.21.15.181:58904) 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11effff640 1 -- 172.21.15.181:0/3618438202 learned_addr learned my addr 172.21.15.181:0/3618438202 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f6dc8640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba869ff90 0x558ba869a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.982+0000 7f11f75c9640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a9ee0 0x558ba869bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11effff640 1 -- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a9ee0 msgr2=0x558ba869bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11effff640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558ba86a9ee0 0x558ba869bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11effff640 1 -- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba869ff90 msgr2=0x558ba869a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11effff640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558ba869ff90 0x558ba869a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11effff640 1 -- 172.21.15.181:0/3618438202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba8696680 con 0x558ba86a95c0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11effff640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba86a95c0 0x558ba8699f30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f11e0025d20 tx=0x7f11e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11f4dc4640 1 -- 172.21.15.181:0/3618438202 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e0055070 con 0x558ba86a95c0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11f4dc4640 1 -- 172.21.15.181:0/3618438202 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e0051820 con 0x558ba86a95c0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ba8695de0 con 0x558ba86a95c0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11f4dc4640 1 -- 172.21.15.181:0/3618438202 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e0051c10 con 0x558ba86a95c0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.983+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba86963a0 con 0x558ba86a95c0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.984+0000 7f11f4dc4640 1 -- 172.21.15.181:0/3618438202 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11e0058070 con 0x558ba86a95c0 2024-09-12T02:35:04.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.985+0000 7f11f4dc4640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11d806a840 0x7f11d806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.985+0000 7f11f4dc4640 1 -- 172.21.15.181:0/3618438202 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f11e00cd590 con 0x558ba86a95c0 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.985+0000 7f11f6dc8640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11d806a840 0x7f11d806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.985+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x558ba869cd60 0x558ba86a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.985+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:1 8.17 8:ea85266a:::201.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e63) -- 0x558ba86a28b0 con 0x558ba869cd60 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.985+0000 7f11f6dc8640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11d806a840 0x7f11d806cd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11e8000c00 tx=0x7f11e800c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.985+0000 7f11f75c9640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x558ba869cd60 0x558ba86a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.986+0000 7f11f75c9640 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x558ba869cd60 0x558ba86a2370 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f75c9640 1 -- 172.21.15.181:0/3618438202 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(1 201.00000000 [delete] v63'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f11f0002660 con 0x558ba869cd60 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x558ba869cd60 msgr2=0x558ba86a2370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x558ba869cd60 0x558ba86a2370 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11d806a840 msgr2=0x7f11d806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11d806a840 0x7f11d806cd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11e8000c00 tx=0x7f11e800c000 comp rx=0 tx=0).stop 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba86a95c0 msgr2=0x558ba8699f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 --2- 172.21.15.181:0/3618438202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba86a95c0 0x558ba8699f30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f11e0025d20 tx=0x7f11e0002fb0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f75c9640 1 -- 172.21.15.181:0/3618438202 reap_dead start 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 shutdown_connections 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 >> 172.21.15.181:0/3618438202 conn(0x558ba85fc400 msgr2=0x558ba8601690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 shutdown_connections 2024-09-12T02:35:04.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:04.987+0000 7f11f92d2f40 1 -- 172.21.15.181:0/3618438202 wait complete. 2024-09-12T02:35:04.993 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.074+0000 7f13edd1cf40 1 Processor -- start 2024-09-12T02:35:05.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.074+0000 7f13edd1cf40 1 -- start start 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13edd1cf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 0x560326b068e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13edd1cf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326bad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13edd1cf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326ba5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13edd1cf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560326b8f670 con 0x560326b90810 2024-09-12T02:35:05.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13edd1cf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x560326a27510 con 0x560326ad9340 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13edd1cf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x560326b8f950 con 0x560326ad8f60 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326ba5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326ba5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58922/0 (socket says 172.21.15.181:58922) 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eaefa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 0x560326b068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 -- 172.21.15.181:0/1569716213 learned_addr learned my addr 172.21.15.181:0/1569716213 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13e26f9640 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326bad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 -- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 msgr2=0x560326b068e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 0x560326b068e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 -- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 msgr2=0x560326bad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326bad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 -- 172.21.15.181:0/1569716213 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560326baddf0 con 0x560326b90810 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13e26f9640 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326bad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326ba5560 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f13e4001580 tx=0x7f13e4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664c4d669daf1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13e9ef8640 1 -- 172.21.15.181:0/1569716213 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e400f710 con 0x560326b90810 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13e9ef8640 1 -- 172.21.15.181:0/1569716213 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e400f8b0 con 0x560326b90810 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.075+0000 7f13e9ef8640 1 -- 172.21.15.181:0/1569716213 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e400fca0 con 0x560326b90810 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 -- 172.21.15.181:0/1569716213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 msgr2=0x560326ba5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326ba5560 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f13e4001580 tx=0x7f13e4001a40 comp rx=0 tx=0).stop 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 -- 172.21.15.181:0/1569716213 shutdown_connections 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326bad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326ba5560 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/1569716213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 0x560326b068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 -- 172.21.15.181:0/1569716213 >> 172.21.15.181:0/1569716213 conn(0x560326ad4ba0 msgr2=0x560326b8e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 -- 172.21.15.181:0/1569716213 shutdown_connections 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.076+0000 7f13edd1cf40 1 -- 172.21.15.181:0/1569716213 wait complete. 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 Processor -- start 2024-09-12T02:35:05.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 -- start start 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 0x560326b8a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326ba9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326c39970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560326b00f20 con 0x560326b90810 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x560326badb10 con 0x560326ad9340 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13edd1cf40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x560326bac040 con 0x560326ad8f60 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13eb6fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326c39970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13eb6fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326c39970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58926/0 (socket says 172.21.15.181:58926) 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 learned_addr learned my addr 172.21.15.181:0/740882882 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 0x560326b8a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.077+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326ba9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 msgr2=0x560326b8a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560326ad8f60 0x560326b8a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 msgr2=0x560326ba9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560326ad9340 0x560326ba9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560326c3aa20 con 0x560326b90810 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326c39970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f13e4001f40 tx=0x7f13e4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13e8ef6640 1 -- 172.21.15.181:0/740882882 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4022020 con 0x560326b90810 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13e8ef6640 1 -- 172.21.15.181:0/740882882 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e401e880 con 0x560326b90810 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560326b06aa0 con 0x560326b90810 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13e8ef6640 1 -- 172.21.15.181:0/740882882 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e401ec70 con 0x560326b90810 2024-09-12T02:35:05.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.078+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560326b07060 con 0x560326b90810 2024-09-12T02:35:05.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13e8ef6640 1 -- 172.21.15.181:0/740882882 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13e4025020 con 0x560326b90810 2024-09-12T02:35:05.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13e8ef6640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f13cc06a840 0x7f13cc06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13e8ef6640 1 -- 172.21.15.181:0/740882882 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f13e408bbb0 con 0x560326b90810 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f13cc06a840 0x7f13cc06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x560326ba9db0 0x560326c3b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x560326ba9db0 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x560326ba9db0 0x560326c3b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.080+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f13cc06a840 0x7f13cc06cd00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13dc057000 tx=0x7f13dc05e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.081+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x560326ba9db0 0x560326c3b1e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.081+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13d4009990 con 0x560326ba9db0 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.081+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f13d4009c20 0x7f13d4006380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.081+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d4009c20 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.081+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f13d4009c20 0x7f13d4006380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.082+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f13d4009c20 0x7f13d4006380 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.082+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(2 [pgnls start_epoch 63 out=201b] v60'12 uv12 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7f13dc057030 con 0x7f13d4009c20 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.082+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f13dc05a070 0x7f13dc068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.082+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13dc05a070 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.082+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f13dc05a070 0x7f13dc068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.083+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f13dc05a070 0x7f13dc068920 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.083+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== osd_op_reply(3 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13d4009990 con 0x7f13dc05a070 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.083+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f13d401c950 0x7f13d40193b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.083+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d401c950 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.083+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f13d401c950 0x7f13d40193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.084+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f13d401c950 0x7f13d40193b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.084+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(4 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d401c950 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.084+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13dc05a070 2024-09-12T02:35:05.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.084+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== osd_op_reply(5 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13d4009990 con 0x7f13dc05a070 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.084+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d401c950 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(6 [pgnls start_epoch 63 out=149b] v63'1549 uv1549 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d401c950 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f13e4027020 0x7f13e4058ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e4027020 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f13e4027020 0x7f13e4058ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13eaefa640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f13e4027020 0x7f13e4058ce0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(7 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc057030 con 0x7f13e4027020 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13dc05a070 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.5 v2:172.21.15.204:6824/2921904049 3 ==== osd_op_reply(8 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13d4009990 con 0x7f13dc05a070 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.085+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d401c950 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.086+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(9 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d401c950 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.086+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f13e401e070 0x7f13e40583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.086+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e401e070 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.086+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f13e401e070 0x7f13e40583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.086+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f13e401e070 0x7f13e40583e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.087+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(10 [pgnls start_epoch 63 out=73b] v60'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13d4009990 con 0x7f13e401e070 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.087+0000 7f13e26f9640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f13d402b960 0x7f13d4029430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.087+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d402b960 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.087+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f13d402b960 0x7f13d4029430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.087+0000 7f13eb6fb640 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f13d402b960 0x7f13d4029430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.087+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(11 [pgnls start_epoch 63 out=49b] v61'14 uv14 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d402b960 2024-09-12T02:35:05.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.087+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e4027020 2024-09-12T02:35:05.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(12 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc057030 con 0x7f13e4027020 2024-09-12T02:35:05.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e4027020 2024-09-12T02:35:05.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(13 [pgnls start_epoch 63 out=77b] v60'15 uv15 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f13dc057030 con 0x7f13e4027020 2024-09-12T02:35:05.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x560326ba9db0 2024-09-12T02:35:05.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(14 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13d4009990 con 0x560326ba9db0 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e4027020 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(15 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13dc057030 con 0x7f13e4027020 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.088+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x560326ba9db0 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.089+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(16 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13d4009990 con 0x560326ba9db0 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.089+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d402b960 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.089+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(17 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d402b960 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.089+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13dc05a070 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.089+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.5 v2:172.21.15.204:6824/2921904049 4 ==== osd_op_reply(18 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13d4009990 con 0x7f13dc05a070 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.089+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e401e070 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.090+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(19 [pgnls start_epoch 63 out=97b] v60'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f13d4009990 con 0x7f13e401e070 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.090+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13dc05a070 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.090+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.5 v2:172.21.15.204:6824/2921904049 5 ==== osd_op_reply(20 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13d4009990 con 0x7f13dc05a070 2024-09-12T02:35:05.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.090+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e401e070 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.090+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(21 [pgnls start_epoch 63 out=73b] v60'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13d4009990 con 0x7f13e401e070 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.090+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d4009c20 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.091+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== osd_op_reply(22 [pgnls start_epoch 63 out=127b] v60'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f13dc057030 con 0x7f13d4009c20 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.091+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13dc05a070 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.091+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.5 v2:172.21.15.204:6824/2921904049 6 ==== osd_op_reply(23 [pgnls start_epoch 63 out=74b] v59'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f13d4009990 con 0x7f13dc05a070 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.091+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e4027020 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.091+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(24 [pgnls start_epoch 63 out=73b] v63'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13dc057030 con 0x7f13e4027020 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.091+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d402b960 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.092+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.1 v2:172.21.15.181:6826/1372590643 3 ==== osd_op_reply(25 [pgnls start_epoch 63 out=73b] v61'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d402b960 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.092+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x560326ba9db0 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.092+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(26 [pgnls start_epoch 63 out=122b] v60'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f13d4009990 con 0x560326ba9db0 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.092+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x560326ba9db0 2024-09-12T02:35:05.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.092+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(27 [pgnls start_epoch 63 out=124b] v63'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7f13d4009990 con 0x560326ba9db0 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.092+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d401c950 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(28 [pgnls start_epoch 63 out=73b] v63'1493 uv1493 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d401c950 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d402b960 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 <== osd.1 v2:172.21.15.181:6826/1372590643 4 ==== osd_op_reply(29 [pgnls start_epoch 63 out=129b] v60'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7f13e400f070 con 0x7f13d402b960 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13d4009c20 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.7 v2:172.21.15.204:6808/3631554107 3 ==== osd_op_reply(30 [pgnls start_epoch 63 out=73b] v63'8 uv8 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13dc057030 con 0x7f13d4009c20 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x560326ba9db0 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 <== osd.3 v2:172.21.15.181:6800/1415662156 6 ==== osd_op_reply(31 [pgnls start_epoch 63 out=73b] v59'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f13d4009990 con 0x560326ba9db0 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.093+0000 7f13e26f9640 1 -- 172.21.15.181:0/740882882 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x560326c3b720 con 0x7f13e4027020 2024-09-12T02:35:05.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13eaefa640 1 -- 172.21.15.181:0/740882882 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(32 [pgnls start_epoch 63 out=101b] v63'12 uv11 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f13dc057030 con 0x7f13e4027020 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:601.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:602.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:10000000000.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:600.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:603.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:60a.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:613.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000.inode 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:610.00000000 2024-09-12T02:35:05.100 INFO:teuthology.orchestra.run.smithi181.stdout:606.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:607.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:60e.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_openfiles.0 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:60f.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:608.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:501.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:612.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:401.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:604.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000.inode 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:500.00000000 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:mds_snaptable 2024-09-12T02:35:05.101 INFO:teuthology.orchestra.run.smithi181.stdout:605.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_inotable 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:611.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_sessionmap 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000003 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:60c.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000002 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:609.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:10000000001.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:60b.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:60d.00000000 2024-09-12T02:35:05.102 INFO:teuthology.orchestra.run.smithi181.stdout:400.00000000 2024-09-12T02:35:05.103 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000.inode 2024-09-12T02:35:05.103 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000 2024-09-12T02:35:05.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f13e4027020 msgr2=0x7f13e4058ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f13e4027020 0x7f13e4058ce0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f13d402b960 msgr2=0x7f13d4029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f13d402b960 0x7f13d4029430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x560326ba9db0 msgr2=0x560326c3b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x560326ba9db0 0x560326c3b1e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f13d401c950 msgr2=0x7f13d40193b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f13d401c950 0x7f13d40193b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f13dc05a070 msgr2=0x7f13dc068920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f13dc05a070 0x7f13dc068920 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f13e401e070 msgr2=0x7f13e40583e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 reap_dead start 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f13e401e070 0x7f13e40583e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 reap_dead start 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13eb6fb640 1 -- 172.21.15.181:0/740882882 reap_dead start 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f13d4009c20 msgr2=0x7f13d4006380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f13d4009c20 0x7f13d4006380 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f13cc06a840 msgr2=0x7f13cc06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f13cc06a840 0x7f13cc06cd00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13dc057000 tx=0x7f13dc05e040 comp rx=0 tx=0).stop 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 msgr2=0x560326c39970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326c39970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f13e4001f40 tx=0x7f13e4001250 comp rx=0 tx=0).stop 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 shutdown_connections 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f13d4009c20 0x7f13d4006380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f13cc06a840 0x7f13cc06cd00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 --2- 172.21.15.181:0/740882882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560326b90810 0x560326c39970 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 >> 172.21.15.181:0/740882882 conn(0x560326ad4ba0 msgr2=0x560326bae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 shutdown_connections 2024-09-12T02:35:05.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.094+0000 7f13edd1cf40 1 -- 172.21.15.181:0/740882882 wait complete. 2024-09-12T02:35:05.107 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-12T02:35:05.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.185+0000 7f9380d72f40 1 Processor -- start 2024-09-12T02:35:05.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.185+0000 7f9380d72f40 1 -- start start 2024-09-12T02:35:05.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.185+0000 7f9380d72f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edc67cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.185+0000 7f9380d72f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf75b0 0x5617edc681f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9380d72f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf7f00 0x5617edcebd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9380d72f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5617edcf8630 con 0x5617edcf75b0 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9380d72f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5617edb71510 con 0x5617edcf7f00 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9380d72f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5617edc60650 con 0x5617edcedf80 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf75b0 0x5617edc681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf75b0 0x5617edc681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58948/0 (socket says 172.21.15.181:58948) 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 -- 172.21.15.181:0/2013177227 learned_addr learned my addr 172.21.15.181:0/2013177227 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f937e868640 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edc67cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f937f069640 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf7f00 0x5617edcebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 -- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 msgr2=0x5617edc67cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edc67cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 -- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf7f00 msgr2=0x5617edcebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf7f00 0x5617edcebd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 -- 172.21.15.181:0/2013177227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617edc68730 con 0x5617edcf75b0 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f937e868640 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edc67cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f9376067640 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf75b0 0x5617edc681f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9368055040 tx=0x7f9368051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31617da5a97ab84a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f937d866640 1 -- 172.21.15.181:0/2013177227 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368005700 con 0x5617edcf75b0 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f937d866640 1 -- 172.21.15.181:0/2013177227 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9368062070 con 0x5617edcf75b0 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.186+0000 7f937d866640 1 -- 172.21.15.181:0/2013177227 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368053d10 con 0x5617edcf75b0 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 -- 172.21.15.181:0/2013177227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf75b0 msgr2=0x5617edc681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf75b0 0x5617edc681f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9368055040 tx=0x7f9368051000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 -- 172.21.15.181:0/2013177227 shutdown_connections 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf7f00 0x5617edcebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf75b0 0x5617edc681f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2013177227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edc67cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 -- 172.21.15.181:0/2013177227 >> 172.21.15.181:0/2013177227 conn(0x5617edc4a3f0 msgr2=0x5617edc68ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 -- 172.21.15.181:0/2013177227 shutdown_connections 2024-09-12T02:35:05.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 -- 172.21.15.181:0/2013177227 wait complete. 2024-09-12T02:35:05.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 Processor -- start 2024-09-12T02:35:05.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.187+0000 7f9380d72f40 1 -- start start 2024-09-12T02:35:05.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f9380d72f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edce9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f9380d72f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf75b0 0x5617edcefbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f9380d72f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf7f00 0x5617edce4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f9380d72f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5617edce7e20 con 0x5617edcf7f00 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f9380d72f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5617edce4bc0 con 0x5617edcf75b0 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f9380d72f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5617edc4f7d0 con 0x5617edcedf80 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f937f069640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf7f00 0x5617edce4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f937f069640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf7f00 0x5617edce4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58952/0 (socket says 172.21.15.181:58952) 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 learned_addr learned my addr 172.21.15.181:0/2096422031 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf75b0 0x5617edcefbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edce9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 msgr2=0x5617edce9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.188+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edce9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf75b0 msgr2=0x5617edcefbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf75b0 0x5617edcefbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617edcee500 con 0x5617edcf7f00 2024-09-12T02:35:05.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5617edcf75b0 0x5617edcefbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5617edcedf80 0x5617edce9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf7f00 0x5617edce4110 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9378006ed0 tx=0x7f937800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937c864640 1 -- 172.21.15.181:0/2096422031 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378017070 con 0x5617edcf7f00 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937c864640 1 -- 172.21.15.181:0/2096422031 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93780062d0 con 0x5617edcf7f00 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617edceb400 con 0x5617edcf7f00 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f937c864640 1 -- 172.21.15.181:0/2096422031 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378004740 con 0x5617edcf7f00 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.189+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617edcf7060 con 0x5617edcf7f00 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.190+0000 7f937c864640 1 -- 172.21.15.181:0/2096422031 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f937801a070 con 0x5617edcf7f00 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f937c864640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f936006a810 0x7f936006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f937c864640 1 -- 172.21.15.181:0/2096422031 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f93780892c0 con 0x5617edcf7f00 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f936006a810 0x7f936006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5617edceab90 0x5617edd99c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x5617edceab90 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5617edceab90 0x5617edd99c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f936006a810 0x7f936006ccd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9370005fd0 tx=0x7f93700055c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.191+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5617edceab90 0x5617edd99c80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.192+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9368053ad0 con 0x5617edceab90 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.192+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f936805e410 0x7f936805e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.192+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f936805e410 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.192+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f936805e410 0x7f936805e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.192+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f936805e410 0x7f936805e850 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.193+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(2 [pgnls start_epoch 63 out=201b] v60'12 uv12 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7f9370015070 con 0x7f936805e410 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.193+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f9370018040 0x7f9370018420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.193+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9370018040 2024-09-12T02:35:05.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.193+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f9370018040 0x7f9370018420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.193+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f9370018040 0x7f9370018420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.193+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== osd_op_reply(3 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9370018040 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.194+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f9368077920 0x7f936805d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.194+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368077920 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.194+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f9368077920 0x7f936805d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.194+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f9368077920 0x7f936805d430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.194+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(4 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9378019030 con 0x7f9368077920 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.194+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9370018040 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.195+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== osd_op_reply(5 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9370018040 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.195+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368077920 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.195+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(6 [pgnls start_epoch 63 out=149b] v63'1549 uv1549 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f9378019030 con 0x7f9368077920 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.195+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f937801c060 0x7f93780563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.195+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f937801c060 2024-09-12T02:35:05.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.195+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f937801c060 0x7f93780563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.195+0000 7f937e868640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f937801c060 0x7f93780563c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(7 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9370015070 con 0x7f937801c060 2024-09-12T02:35:05.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9370018040 2024-09-12T02:35:05.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.5 v2:172.21.15.204:6824/2921904049 3 ==== osd_op_reply(8 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9370018040 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368077920 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(9 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9378019030 con 0x7f9368077920 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f9378057760 0x7f937806d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9378057760 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.196+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f9378057760 0x7f937806d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.197+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f9378057760 0x7f937806d9a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.197+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(10 [pgnls start_epoch 63 out=73b] v60'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9378057760 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.197+0000 7f9376067640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f9368085ab0 0x7f93680843c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.197+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368085ab0 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.197+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f9368085ab0 0x7f93680843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.197+0000 7f937f069640 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f9368085ab0 0x7f93680843c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(11 [pgnls start_epoch 63 out=49b] v61'14 uv14 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9378019030 con 0x7f9368085ab0 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f937801c060 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(12 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9370015070 con 0x7f937801c060 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f937801c060 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(13 [pgnls start_epoch 63 out=77b] v60'15 uv15 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f9370015070 con 0x7f937801c060 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x5617edceab90 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(14 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9368053ad0 con 0x5617edceab90 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.198+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f937801c060 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.199+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(15 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9370015070 con 0x7f937801c060 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.199+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x5617edceab90 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.199+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(16 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9368053ad0 con 0x5617edceab90 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.199+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368085ab0 2024-09-12T02:35:05.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.199+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(17 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9378019030 con 0x7f9368085ab0 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.199+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9370018040 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.200+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.5 v2:172.21.15.204:6824/2921904049 4 ==== osd_op_reply(18 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9370018040 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.200+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9378057760 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.200+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(19 [pgnls start_epoch 63 out=97b] v60'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9378057760 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.200+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9370018040 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.200+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.5 v2:172.21.15.204:6824/2921904049 5 ==== osd_op_reply(20 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9370018040 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.200+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9378057760 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.201+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(21 [pgnls start_epoch 63 out=73b] v60'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9378057760 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.201+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f936805e410 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.201+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== osd_op_reply(22 [pgnls start_epoch 63 out=127b] v60'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f9370015070 con 0x7f936805e410 2024-09-12T02:35:05.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.201+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9370018040 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.201+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.5 v2:172.21.15.204:6824/2921904049 6 ==== osd_op_reply(23 [pgnls start_epoch 63 out=74b] v59'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9368053ad0 con 0x7f9370018040 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.201+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f937801c060 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(24 [pgnls start_epoch 63 out=73b] v63'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9370015070 con 0x7f937801c060 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368085ab0 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.1 v2:172.21.15.181:6826/1372590643 3 ==== osd_op_reply(25 [pgnls start_epoch 63 out=73b] v61'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9378019030 con 0x7f9368085ab0 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x5617edceab90 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(26 [pgnls start_epoch 63 out=122b] v60'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f9368053ad0 con 0x5617edceab90 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x5617edceab90 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(27 [pgnls start_epoch 63 out=124b] v63'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7f9368053ad0 con 0x5617edceab90 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.202+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368077920 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.203+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(28 [pgnls start_epoch 63 out=73b] v63'1493 uv1493 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9378019030 con 0x7f9368077920 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.203+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f9368085ab0 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.203+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 <== osd.1 v2:172.21.15.181:6826/1372590643 4 ==== osd_op_reply(29 [pgnls start_epoch 63 out=129b] v60'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7f9378019030 con 0x7f9368085ab0 2024-09-12T02:35:05.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.203+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f936805e410 2024-09-12T02:35:05.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.203+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.7 v2:172.21.15.204:6808/3631554107 3 ==== osd_op_reply(30 [pgnls start_epoch 63 out=73b] v63'8 uv8 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9370015070 con 0x7f936805e410 2024-09-12T02:35:05.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.203+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x5617edceab90 2024-09-12T02:35:05.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 <== osd.3 v2:172.21.15.181:6800/1415662156 6 ==== osd_op_reply(31 [pgnls start_epoch 63 out=73b] v59'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9368053ad0 con 0x5617edceab90 2024-09-12T02:35:05.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9376067640 1 -- 172.21.15.181:0/2096422031 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x5617edcfa460 con 0x7f937801c060 2024-09-12T02:35:05.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f937e868640 1 -- 172.21.15.181:0/2096422031 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(32 [pgnls start_epoch 63 out=101b] v63'12 uv11 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f9370015070 con 0x7f937801c060 2024-09-12T02:35:05.211 INFO:teuthology.orchestra.run.smithi181.stdout:601.00000000 2024-09-12T02:35:05.211 INFO:teuthology.orchestra.run.smithi181.stdout:602.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:10000000000.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:600.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:603.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:60a.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:613.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000.inode 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:610.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:606.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:607.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:60e.00000000 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_openfiles.0 2024-09-12T02:35:05.212 INFO:teuthology.orchestra.run.smithi181.stdout:60f.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:608.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:501.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:612.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:401.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:604.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000.inode 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:500.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:mds_snaptable 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:605.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_inotable 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:611.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000 2024-09-12T02:35:05.213 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_sessionmap 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000003 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:60c.00000000 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000002 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:609.00000000 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:10000000001.00000000 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:60b.00000000 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:60d.00000000 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:400.00000000 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000.inode 2024-09-12T02:35:05.214 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000 2024-09-12T02:35:05.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f937801c060 msgr2=0x7f93780563c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7f937801c060 0x7f93780563c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f9368085ab0 msgr2=0x7f93680843c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7f9368085ab0 0x7f93680843c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5617edceab90 msgr2=0x5617edd99c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x5617edceab90 0x5617edd99c80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f9368077920 msgr2=0x7f936805d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7f9368077920 0x7f936805d430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f9370018040 msgr2=0x7f9370018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7f9370018040 0x7f9370018420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f9378057760 msgr2=0x7f937806d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7f9378057760 0x7f937806d9a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 reap_dead start 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f936805e410 msgr2=0x7f936805e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f936805e410 0x7f936805e850 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 reap_dead start 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 reap_dead start 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f937f069640 1 -- 172.21.15.181:0/2096422031 reap_dead start 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f936006a810 msgr2=0x7f936006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f936006a810 0x7f936006ccd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9370005fd0 tx=0x7f93700055c0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf7f00 msgr2=0x5617edce4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf7f00 0x5617edce4110 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9378006ed0 tx=0x7f937800c520 comp rx=0 tx=0).stop 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 shutdown_connections 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f936006a810 0x7f936006ccd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 --2- 172.21.15.181:0/2096422031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617edcf7f00 0x5617edce4110 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 >> 172.21.15.181:0/2096422031 conn(0x5617edc4a3f0 msgr2=0x5617edce53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 shutdown_connections 2024-09-12T02:35:05.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.204+0000 7f9380d72f40 1 -- 172.21.15.181:0/2096422031 wait complete. 2024-09-12T02:35:05.218 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 401.00000000 2024-09-12T02:35:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 Processor -- start 2024-09-12T02:35:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 -- start start 2024-09-12T02:35:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fcec910 0x55f73fd6ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fd5b5d0 0x55f73fcce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd7b2f0 0x55f73fca1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f73fbf4510 con 0x55f73fd5b5d0 2024-09-12T02:35:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55f73fd5c2f0 con 0x55f73fd7b2f0 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.299+0000 7f92bd3b8f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55f73fd5b3c0 con 0x55f73fcec910 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fd5b5d0 0x55f73fcce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fd5b5d0 0x55f73fcce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58956/0 (socket says 172.21.15.181:58956) 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 -- 172.21.15.181:0/1733168000 learned_addr learned my addr 172.21.15.181:0/1733168000 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92baeb0640 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fcec910 0x55f73fd6ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92bb6b1640 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd7b2f0 0x55f73fca1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 -- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fcec910 msgr2=0x55f73fd6ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fcec910 0x55f73fd6ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 -- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd7b2f0 msgr2=0x55f73fca1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd7b2f0 0x55f73fca1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 -- 172.21.15.181:0/1733168000 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73fd77bf0 con 0x55f73fd5b5d0 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92baeb0640 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fcec910 0x55f73fd6ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92ba6af640 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fd5b5d0 0x55f73fcce280 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f92b0001d80 tx=0x7f92b0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa36f85ed4fee29a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92b96ad640 1 -- 172.21.15.181:0/1733168000 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000bd70 con 0x55f73fd5b5d0 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92b96ad640 1 -- 172.21.15.181:0/1733168000 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b000f400 con 0x55f73fd5b5d0 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.300+0000 7f92b96ad640 1 -- 172.21.15.181:0/1733168000 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000f7f0 con 0x55f73fd5b5d0 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/1733168000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fd5b5d0 msgr2=0x55f73fcce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fd5b5d0 0x55f73fcce280 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f92b0001d80 tx=0x7f92b0001e70 comp rx=0 tx=0).stop 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/1733168000 shutdown_connections 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd7b2f0 0x55f73fca1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fd5b5d0 0x55f73fcce280 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/1733168000 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fcec910 0x55f73fd6ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/1733168000 >> 172.21.15.181:0/1733168000 conn(0x55f73fccd400 msgr2=0x55f73fca3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/1733168000 shutdown_connections 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/1733168000 wait complete. 2024-09-12T02:35:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 Processor -- start 2024-09-12T02:35:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.301+0000 7f92bd3b8f40 1 -- start start 2024-09-12T02:35:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92bd3b8f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fcec910 0x55f73fe01b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92bd3b8f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd5b5d0 0x55f73fd58d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92bd3b8f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fd7b2f0 0x55f73fca1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92bd3b8f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f73fd77e90 con 0x55f73fcec910 2024-09-12T02:35:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92bd3b8f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55f73fd5b0e0 con 0x55f73fd5b5d0 2024-09-12T02:35:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92bd3b8f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55f73fd6e510 con 0x55f73fd7b2f0 2024-09-12T02:35:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fcec910 0x55f73fe01b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fcec910 0x55f73fe01b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58964/0 (socket says 172.21.15.181:58964) 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 -- 172.21.15.181:0/2289037565 learned_addr learned my addr 172.21.15.181:0/2289037565 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92ba6af640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd5b5d0 0x55f73fd58d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92bb6b1640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fd7b2f0 0x55f73fca1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 -- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fd7b2f0 msgr2=0x55f73fca1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55f73fd7b2f0 0x55f73fca1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 -- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd5b5d0 msgr2=0x55f73fd58d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd5b5d0 0x55f73fd58d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92baeb0640 1 -- 172.21.15.181:0/2289037565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73fca3340 con 0x55f73fcec910 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.302+0000 7f92ba6af640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55f73fd5b5d0 0x55f73fd58d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.303+0000 7f92baeb0640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fcec910 0x55f73fe01b50 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00f5f0 tx=0x7f92ac00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.303+0000 7f92a3fff640 1 -- 172.21.15.181:0/2289037565 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac019030 con 0x55f73fcec910 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.303+0000 7f92a3fff640 1 -- 172.21.15.181:0/2289037565 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac015690 con 0x55f73fcec910 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.303+0000 7f92a3fff640 1 -- 172.21.15.181:0/2289037565 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac015840 con 0x55f73fcec910 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.303+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f73fd75880 con 0x55f73fcec910 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.303+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73fd592a0 con 0x55f73fcec910 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.304+0000 7f92a3fff640 1 -- 172.21.15.181:0/2289037565 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92ac01c070 con 0x55f73fcec910 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.304+0000 7f92a3fff640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92a806a810 0x7f92a806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.305+0000 7f92a3fff640 1 -- 172.21.15.181:0/2289037565 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f92ac089e50 con 0x55f73fcec910 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.305+0000 7f92ba6af640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92a806a810 0x7f92a806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.305+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55f73fcd2610 0x55f73fd73680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.305+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 8.5 8:a6e36b3f:::401.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e63) -- 0x55f73fd73bc0 con 0x55f73fcd2610 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.305+0000 7f92ba6af640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92a806a810 0x7f92a806ccd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55f73fcd2d90 tx=0x7f92b0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.305+0000 7f92bb6b1640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55f73fcd2610 0x55f73fd73680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.305+0000 7f92bb6b1640 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55f73fcd2610 0x55f73fd73680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bb6b1640 1 -- 172.21.15.181:0/2289037565 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 401.00000000 [delete] v63'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f92b4057030 con 0x55f73fcd2610 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55f73fcd2610 msgr2=0x55f73fd73680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55f73fcd2610 0x55f73fd73680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92a806a810 msgr2=0x7f92a806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f92a806a810 0x7f92a806ccd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55f73fcd2d90 tx=0x7f92b0009000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fcec910 msgr2=0x55f73fe01b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 --2- 172.21.15.181:0/2289037565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f73fcec910 0x55f73fe01b50 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00f5f0 tx=0x7f92ac00fab0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bb6b1640 1 -- 172.21.15.181:0/2289037565 reap_dead start 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 shutdown_connections 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 >> 172.21.15.181:0/2289037565 conn(0x55f73fccd400 msgr2=0x55f73fcce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 shutdown_connections 2024-09-12T02:35:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.307+0000 7f92bd3b8f40 1 -- 172.21.15.181:0/2289037565 wait complete. 2024-09-12T02:35:05.312 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-12T02:35:05.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 Processor -- start 2024-09-12T02:35:05.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 -- start start 2024-09-12T02:35:05.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fdf6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fdef5c0 0x55655fd65e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fe0f2e0 0x55655fd66360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55655fc88510 con 0x55655fdef5c0 2024-09-12T02:35:05.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55655fdf02e0 con 0x55655fd80900 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.395+0000 7fd28c246f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55655fdf5de0 con 0x55655fe0f2e0 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fdef5c0 0x55655fd65e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fdef5c0 0x55655fd65e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58980/0 (socket says 172.21.15.181:58980) 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 -- 172.21.15.181:0/798066376 learned_addr learned my addr 172.21.15.181:0/798066376 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd28a53d640 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fe0f2e0 0x55655fd66360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd289d3c640 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fdf6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 -- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fe0f2e0 msgr2=0x55655fd66360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fe0f2e0 0x55655fd66360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 -- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 msgr2=0x55655fdf6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fdf6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 -- 172.21.15.181:0/798066376 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55655fd66a40 con 0x55655fdef5c0 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd283fff640 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fdef5c0 0x55655fd65e20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd274001eb0 tx=0x7fd27400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a488341143bf06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd288d3a640 1 -- 172.21.15.181:0/798066376 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27400e5c0 con 0x55655fdef5c0 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd288d3a640 1 -- 172.21.15.181:0/798066376 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd274006070 con 0x55655fdef5c0 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.396+0000 7fd288d3a640 1 -- 172.21.15.181:0/798066376 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27400ea00 con 0x55655fdef5c0 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 -- 172.21.15.181:0/798066376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fdef5c0 msgr2=0x55655fd65e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fdef5c0 0x55655fd65e20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd274001eb0 tx=0x7fd27400b6c0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 -- 172.21.15.181:0/798066376 shutdown_connections 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fe0f2e0 0x55655fd66360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fdef5c0 0x55655fd65e20 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 --2- 172.21.15.181:0/798066376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fdf6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 -- 172.21.15.181:0/798066376 >> 172.21.15.181:0/798066376 conn(0x55655fd613f0 msgr2=0x55655fe0dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 -- 172.21.15.181:0/798066376 shutdown_connections 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 -- 172.21.15.181:0/798066376 wait complete. 2024-09-12T02:35:05.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 Processor -- start 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.397+0000 7fd28c246f40 1 -- start start 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28c246f40 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fe08790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28c246f40 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fdef5c0 0x55655fdeee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28c246f40 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fe0f2e0 0x55655fe0d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28c246f40 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55655fdf5a70 con 0x55655fe0f2e0 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28c246f40 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55655fdf5790 con 0x55655fd80900 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28c246f40 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55655fe0bd30 con 0x55655fdef5c0 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28a53d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fe0f2e0 0x55655fe0d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28a53d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fe0f2e0 0x55655fe0d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58984/0 (socket says 172.21.15.181:58984) 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 learned_addr learned my addr 172.21.15.181:0/4088135777 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fe08790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fdef5c0 0x55655fdeee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fdef5c0 msgr2=0x55655fdeee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55655fdef5c0 0x55655fdeee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 msgr2=0x55655fe08790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.398+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fe08790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55655fdef340 con 0x55655fe0f2e0 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55655fd80900 0x55655fe08790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fe0f2e0 0x55655fe0d670 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd284010690 tx=0x7fd284010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd282ffd640 1 -- 172.21.15.181:0/4088135777 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284018070 con 0x55655fe0f2e0 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd282ffd640 1 -- 172.21.15.181:0/4088135777 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd284010e60 con 0x55655fe0f2e0 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55655fe0e230 con 0x55655fe0f2e0 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd282ffd640 1 -- 172.21.15.181:0/4088135777 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28400ebf0 con 0x55655fe0f2e0 2024-09-12T02:35:05.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.399+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55655fe0b5d0 con 0x55655fe0f2e0 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.400+0000 7fd282ffd640 1 -- 172.21.15.181:0/4088135777 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd284011040 con 0x55655fe0f2e0 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd282ffd640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd26c06a810 0x7fd26c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd26c06a810 0x7fd26c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd282ffd640 1 -- 172.21.15.181:0/4088135777 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7fd28408a000 con 0x55655fe0f2e0 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55655fd66330 0x55655fdf34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x55655fd66330 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55655fd66330 0x55655fdf34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd26c06a810 0x7fd26c06ccd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd27c057000 tx=0x7fd27c052000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.401+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55655fd66330 0x55655fdf34f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.402+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== osd_op_reply(1 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27400e760 con 0x55655fd66330 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.402+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd27400f070 0x7fd27401d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.402+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27400f070 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.402+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd27400f070 0x7fd27401d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.402+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd27400f070 0x7fd27401d450 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.403+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== osd_op_reply(2 [pgnls start_epoch 63 out=201b] v60'12 uv12 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7fd27c065070 con 0x7fd27400f070 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.403+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd27c068040 0x7fd27c06a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.403+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27c068040 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.403+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd27c068040 0x7fd27c06a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.403+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd27c068040 0x7fd27c06a440 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.404+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== osd_op_reply(3 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd27402a040 con 0x7fd27c068040 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.404+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd27401db00 0x7fd27401a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.404+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27401db00 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.404+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd27401db00 0x7fd27401a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.404+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd27401db00 0x7fd27401a8d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== osd_op_reply(4 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd284023070 con 0x7fd27401db00 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27c068040 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== osd_op_reply(5 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a040 con 0x7fd27c068040 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27401db00 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== osd_op_reply(6 [pgnls start_epoch 63 out=149b] v63'1549 uv1549 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7fd284023070 con 0x7fd27401db00 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd2840584a0 0x7fd284057100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd2840584a0 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.405+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd2840584a0 0x7fd284057100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.406+0000 7fd289d3c640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd2840584a0 0x7fd284057100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.406+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== osd_op_reply(7 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27c065070 con 0x7fd2840584a0 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.406+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27c068040 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.406+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.5 v2:172.21.15.204:6824/2921904049 3 ==== osd_op_reply(8 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd27402a040 con 0x7fd27c068040 2024-09-12T02:35:05.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.406+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27401db00 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.407+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.4 v2:172.21.15.204:6816/3702049597 3 ==== osd_op_reply(9 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd284023070 con 0x7fd27401db00 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.407+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd284060990 0x7fd28405d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.407+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd284060990 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.407+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd284060990 0x7fd28405d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.407+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd284060990 0x7fd28405d780 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.407+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(10 [pgnls start_epoch 63 out=73b] v60'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd27402a040 con 0x7fd284060990 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.407+0000 7fd283fff640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd27402f3f0 0x7fd27402f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.408+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27402f3f0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.408+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd27402f3f0 0x7fd27402f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.408+0000 7fd28a53d640 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd27402f3f0 0x7fd27402f870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.408+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(11 [pgnls start_epoch 63 out=49b] v61'14 uv14 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd284023070 con 0x7fd27402f3f0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.408+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd2840584a0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.408+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== osd_op_reply(12 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27c065070 con 0x7fd2840584a0 2024-09-12T02:35:05.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.408+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd2840584a0 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.409+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.0 v2:172.21.15.181:6816/2346029807 3 ==== osd_op_reply(13 [pgnls start_epoch 63 out=77b] v60'15 uv15 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7fd27c065070 con 0x7fd2840584a0 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.409+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x55655fd66330 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.409+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== osd_op_reply(14 [pgnls start_epoch 63 out=73b] v60'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd27402a040 con 0x55655fd66330 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.409+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd2840584a0 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.409+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.0 v2:172.21.15.181:6816/2346029807 4 ==== osd_op_reply(15 [pgnls start_epoch 63 out=73b] v59'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd27c065070 con 0x7fd2840584a0 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.409+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x55655fd66330 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.3 v2:172.21.15.181:6800/1415662156 3 ==== osd_op_reply(16 [pgnls start_epoch 63 out=49b] v63'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a040 con 0x55655fd66330 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27402f3f0 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== osd_op_reply(17 [pgnls start_epoch 63 out=49b] v60'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd284023070 con 0x7fd27402f3f0 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27c068040 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.5 v2:172.21.15.204:6824/2921904049 4 ==== osd_op_reply(18 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a040 con 0x7fd27c068040 2024-09-12T02:35:05.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd284060990 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(19 [pgnls start_epoch 63 out=97b] v60'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7fd27402a040 con 0x7fd284060990 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.410+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27c068040 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.411+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.5 v2:172.21.15.204:6824/2921904049 5 ==== osd_op_reply(20 [pgnls start_epoch 63 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a040 con 0x7fd27c068040 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.411+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd284060990 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.411+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(21 [pgnls start_epoch 63 out=49b] v63'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a040 con 0x7fd284060990 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.411+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27400f070 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== osd_op_reply(22 [pgnls start_epoch 63 out=127b] v60'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fd27c065070 con 0x7fd27400f070 2024-09-12T02:35:05.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27c068040 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.5 v2:172.21.15.204:6824/2921904049 6 ==== osd_op_reply(23 [pgnls start_epoch 63 out=74b] v59'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd27402a040 con 0x7fd27c068040 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd2840584a0 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.0 v2:172.21.15.181:6816/2346029807 5 ==== osd_op_reply(24 [pgnls start_epoch 63 out=73b] v63'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd27c065070 con 0x7fd2840584a0 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27402f3f0 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.1 v2:172.21.15.181:6826/1372590643 3 ==== osd_op_reply(25 [pgnls start_epoch 63 out=73b] v61'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd284023070 con 0x7fd27402f3f0 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.412+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x55655fd66330 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.413+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.3 v2:172.21.15.181:6800/1415662156 4 ==== osd_op_reply(26 [pgnls start_epoch 63 out=122b] v60'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7fd27402a040 con 0x55655fd66330 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.413+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x55655fd66330 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.413+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.3 v2:172.21.15.181:6800/1415662156 5 ==== osd_op_reply(27 [pgnls start_epoch 63 out=124b] v63'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7fd274048090 con 0x55655fd66330 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.413+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27401db00 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.413+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.4 v2:172.21.15.204:6816/3702049597 4 ==== osd_op_reply(28 [pgnls start_epoch 63 out=73b] v63'1493 uv1493 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd284023070 con 0x7fd27401db00 2024-09-12T02:35:05.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.413+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27402f3f0 2024-09-12T02:35:05.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.414+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 <== osd.1 v2:172.21.15.181:6826/1372590643 4 ==== osd_op_reply(29 [pgnls start_epoch 63 out=129b] v60'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7fd284023070 con 0x7fd27402f3f0 2024-09-12T02:35:05.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.414+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd27400f070 2024-09-12T02:35:05.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.414+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.7 v2:172.21.15.204:6808/3631554107 3 ==== osd_op_reply(30 [pgnls start_epoch 63 out=73b] v63'8 uv8 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd27c065070 con 0x7fd27400f070 2024-09-12T02:35:05.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.414+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x55655fd66330 2024-09-12T02:35:05.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.414+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 <== osd.3 v2:172.21.15.181:6800/1415662156 6 ==== osd_op_reply(31 [pgnls start_epoch 63 out=73b] v59'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7fd274048090 con 0x55655fd66330 2024-09-12T02:35:05.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.414+0000 7fd283fff640 1 -- 172.21.15.181:0/4088135777 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 63 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e63) -- 0x55655fdf3a30 con 0x7fd2840584a0 2024-09-12T02:35:05.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd289d3c640 1 -- 172.21.15.181:0/4088135777 <== osd.0 v2:172.21.15.181:6816/2346029807 6 ==== osd_op_reply(32 [pgnls start_epoch 63 out=101b] v63'12 uv11 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7fd27c065070 con 0x7fd2840584a0 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:601.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:602.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:10000000000.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:600.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:603.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:60a.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:613.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000.inode 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:610.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:606.00000000 2024-09-12T02:35:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:607.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:60e.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_openfiles.0 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:60f.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:608.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:501.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:612.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:604.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000.inode 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:500.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:mds_snaptable 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:605.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:101.00000000 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_inotable 2024-09-12T02:35:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:611.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:mds0_sessionmap 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000003 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:60c.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:200.00000002 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:609.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:10000000001.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:60b.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:60d.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:400.00000000 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:100.00000000.inode 2024-09-12T02:35:05.423 INFO:teuthology.orchestra.run.smithi181.stdout:1.00000000 2024-09-12T02:35:05.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd2840584a0 msgr2=0x7fd284057100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fd2840584a0 0x7fd284057100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd27402f3f0 msgr2=0x7fd27402f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd27402f3f0 0x7fd27402f870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55655fd66330 msgr2=0x55655fdf34f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x55655fd66330 0x55655fdf34f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd27401db00 msgr2=0x7fd27401a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fd27401db00 0x7fd27401a8d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd27c068040 msgr2=0x7fd27c06a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd27c068040 0x7fd27c06a440 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd284060990 msgr2=0x7fd28405d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 reap_dead start 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7fd284060990 0x7fd28405d780 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 reap_dead start 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28a53d640 1 -- 172.21.15.181:0/4088135777 reap_dead start 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd27400f070 msgr2=0x7fd27401d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd27400f070 0x7fd27401d450 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd26c06a810 msgr2=0x7fd26c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd26c06a810 0x7fd26c06ccd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd27c057000 tx=0x7fd27c052000 comp rx=0 tx=0).stop 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fe0f2e0 msgr2=0x55655fe0d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fe0f2e0 0x55655fe0d670 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd284010690 tx=0x7fd284010b50 comp rx=0 tx=0).stop 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 shutdown_connections 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7fd27400f070 0x7fd27401d450 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd26c06a810 0x7fd26c06ccd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 --2- 172.21.15.181:0/4088135777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55655fe0f2e0 0x55655fe0d670 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 >> 172.21.15.181:0/4088135777 conn(0x55655fd613f0 msgr2=0x55655fe0e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 shutdown_connections 2024-09-12T02:35:05.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.415+0000 7fd28c246f40 1 -- 172.21.15.181:0/4088135777 wait complete. 2024-09-12T02:35:05.428 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs reset cephfs --yes-i-really-mean-it 2024-09-12T02:35:05.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.566+0000 7efdf9add640 1 Processor -- start 2024-09-12T02:35:05.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.566+0000 7efdf9add640 1 -- start start 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf9add640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 0x7efdf40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf9add640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf415f9d0 con 0x7efdf415b2e0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf9add640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf415fcb0 con 0x7efdf415edf0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf9add640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efdf4073fe0 con 0x7efdf40b50a0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf37fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7efdf415b2e0 0x7efdf40b4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:32812/0 (socket says 172.21.15.181:32812) 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf37fe640 1 -- 172.21.15.181:0/3978585545 learned_addr learned my addr 172.21.15.181:0/3978585545 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 0x7efdf40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842618797 0 0) 0x7efdf415f9d0 con 0x7efdf415b2e0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde0003520 con 0x7efdf415b2e0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 269748501 0 0) 0x7efdf415fcb0 con 0x7efdf415edf0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf415f9d0 con 0x7efdf415edf0 2024-09-12T02:35:05.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2420671799 0 0) 0x7efde0003520 con 0x7efdf415b2e0 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 msgr2=0x7efdf40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 0x7efdf40ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 >> v1:172.21.15.204:6789/0 conn(0x7efdf415edf0 legacy=0x7efdf40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf40cdea0 con 0x7efdf415b2e0 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7efde4001670 con 0x7efdf415b2e0 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 >> v1:172.21.15.181:6789/0 conn(0x7efdf415b2e0 legacy=0x7efdf40b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde0003b70 0x7efde0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efde0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 0x7efde00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efde000dc80 con 0x7efde0004800 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7efde000de30 con 0x7efde0003b70 2024-09-12T02:35:05.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.567+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efde000e030 con 0x7efdf40b50a0 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efde0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf37fe640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde0003b70 0x7efde0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf3fff640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 0x7efde00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf2ffd640 1 -- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 msgr2=0x7efde00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 0x7efde00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf2ffd640 1 -- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde0003b70 msgr2=0x7efde0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efde0003b70 0x7efde0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf2ffd640 1 -- 172.21.15.181:0/3978585545 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde0003520 con 0x7efde0004800 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.568+0000 7efdf3fff640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf40b50a0 0x7efde00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efde0004c80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efdf406c7e0 tx=0x7efde0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548a2ff3267e1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc036070 con 0x7efde0004800 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc031400 con 0x7efde0004800 2024-09-12T02:35:05.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf27fc640 1 -- 172.21.15.181:0/3978585545 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc009690 con 0x7efde0004800 2024-09-12T02:35:05.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf9add640 1 -- 172.21.15.181:0/3978585545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 msgr2=0x7efde0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf9add640 1 --2- 172.21.15.181:0/3978585545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efde0004c80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efdf406c7e0 tx=0x7efde0005830 comp rx=0 tx=0).stop 2024-09-12T02:35:05.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf3fff640 1 -- 172.21.15.181:0/3978585545 reap_dead start 2024-09-12T02:35:05.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf9add640 1 -- 172.21.15.181:0/3978585545 shutdown_connections 2024-09-12T02:35:05.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf9add640 1 -- 172.21.15.181:0/3978585545 >> 172.21.15.181:0/3978585545 conn(0x7efdf406bc10 msgr2=0x7efdf406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:05.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf9add640 1 -- 172.21.15.181:0/3978585545 shutdown_connections 2024-09-12T02:35:05.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.569+0000 7efdf9add640 1 -- 172.21.15.181:0/3978585545 wait complete. 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.570+0000 7efdf9add640 1 Processor -- start 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf9add640 1 -- start start 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf9add640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efdf414ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf9add640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40b1c50 0x7efdf415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf9add640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf415d4f0 0x7efdf415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf9add640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efdf415b6c0 con 0x7efde0004800 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf9add640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40ce4f0 con 0x7efdf40b1c50 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf9add640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40ce980 con 0x7efdf415d4f0 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efdf414ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efdf414ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:59000/0 (socket says 172.21.15.181:59000) 2024-09-12T02:35:05.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.571+0000 7efdf37fe640 1 -- 172.21.15.181:0/3409786524 learned_addr learned my addr 172.21.15.181:0/3409786524 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40b1c50 0x7efdf415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf3fff640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf415d4f0 0x7efdf415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf37fe640 1 -- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf415d4f0 msgr2=0x7efdf415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf37fe640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf415d4f0 0x7efdf415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf37fe640 1 -- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40b1c50 msgr2=0x7efdf415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf37fe640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40b1c50 0x7efdf415cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf37fe640 1 -- 172.21.15.181:0/3409786524 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf40b05f0 con 0x7efde0004800 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf37fe640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efdf414ef40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7efde40072c0 tx=0x7efde4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdebfff640 1 -- 172.21.15.181:0/3409786524 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4001670 con 0x7efde0004800 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdebfff640 1 -- 172.21.15.181:0/3409786524 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde4018070 con 0x7efde0004800 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdebfff640 1 -- 172.21.15.181:0/3409786524 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde400fc00 con 0x7efde0004800 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf414f480 con 0x7efde0004800 2024-09-12T02:35:05.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.572+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf40b0b90 con 0x7efde0004800 2024-09-12T02:35:05.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.573+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf4069170 con 0x7efde0004800 2024-09-12T02:35:05.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.573+0000 7efdebfff640 1 -- 172.21.15.181:0/3409786524 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efde401d460 con 0x7efde0004800 2024-09-12T02:35:05.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.574+0000 7efdebfff640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efdd406be60 0x7efdd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:05.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.574+0000 7efdebfff640 1 -- 172.21.15.181:0/3409786524 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7efde408afa0 con 0x7efde0004800 2024-09-12T02:35:05.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.574+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efdd406be60 0x7efdd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.574+0000 7efdf2ffd640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efdd406be60 0x7efdd406e320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efddc033000 tx=0x7efddc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:05.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.578+0000 7efdebfff640 1 -- 172.21.15.181:0/3409786524 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efde4059850 con 0x7efde0004800 2024-09-12T02:35:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:05.779+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efdf415f2a0 con 0x7efde0004800 2024-09-12T02:35:06.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.322+0000 7efdebfff640 1 -- 172.21.15.181:0/3409786524 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) ==== 107+0+0 (secure 0 0 0) 0x7efde4059150 con 0x7efde0004800 2024-09-12T02:35:06.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efdd406be60 msgr2=0x7efdd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efdd406be60 0x7efdd406e320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efddc033000 tx=0x7efddc008030 comp rx=0 tx=0).stop 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 msgr2=0x7efdf414ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efdf414ef40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7efde40072c0 tx=0x7efde4007780 comp rx=0 tx=0).stop 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 shutdown_connections 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efdd406be60 0x7efdd406e320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efdf40b1c50 0x7efdf415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efdf415d4f0 0x7efdf415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 --2- 172.21.15.181:0/3409786524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efde0004800 0x7efdf414ef40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.324+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 >> 172.21.15.181:0/3409786524 conn(0x7efdf406bc10 msgr2=0x7efdf4071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.325+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 shutdown_connections 2024-09-12T02:35:06.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.325+0000 7efdf9add640 1 -- 172.21.15.181:0/3409786524 wait complete. 2024-09-12T02:35:06.340 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-12T02:35:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.441+0000 7f62705d6640 1 Processor -- start 2024-09-12T02:35:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.441+0000 7f62705d6640 1 -- start start 2024-09-12T02:35:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f62705d6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f62680d2190 0x7f62680b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f62705d6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62680b54e0 0x7f6268073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f62705d6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626815ec10 con 0x7f626815e830 2024-09-12T02:35:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f62705d6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6268071b10 con 0x7f62680b54e0 2024-09-12T02:35:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f62705d6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f62680cc500 con 0x7f62680d2190 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f626eb73640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62680b54e0 0x7f6268073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f626e372640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f626815e830 0x7f62680d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:32820/0 (socket says 172.21.15.181:32820) 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.442+0000 7f626e372640 1 -- 172.21.15.181:0/3544353905 learned_addr learned my addr 172.21.15.181:0/3544353905 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.443+0000 7f626db71640 1 --2- 172.21.15.181:0/3544353905 >> v2:172.21.15.204:3300/0 conn(0x7f62680d2190 0x7f62680b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.443+0000 7f626eb73640 1 -- 172.21.15.181:0/3544353905 >> v2:172.21.15.204:3300/0 conn(0x7f62680d2190 msgr2=0x7f62680b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.443+0000 7f626eb73640 1 --2- 172.21.15.181:0/3544353905 >> v2:172.21.15.204:3300/0 conn(0x7f62680d2190 0x7f62680b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.443+0000 7f626eb73640 1 -- 172.21.15.181:0/3544353905 >> v1:172.21.15.181:6789/0 conn(0x7f626815e830 legacy=0x7f62680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.443+0000 7f626d370640 1 -- 172.21.15.181:0/3544353905 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309979536 0 0) 0x7f626815ec10 con 0x7f626815e830 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.443+0000 7f626eb73640 1 -- 172.21.15.181:0/3544353905 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62680cc7e0 con 0x7f62680b54e0 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.443+0000 7f626eb73640 1 --2- 172.21.15.181:0/3544353905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f6268073440 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f626806f050 tx=0x7f626002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92bfa5687d36ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f626d370640 1 -- 172.21.15.181:0/3544353905 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260007740 con 0x7f62680b54e0 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f626d370640 1 -- 172.21.15.181:0/3544353905 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62600078e0 con 0x7f62680b54e0 2024-09-12T02:35:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f626d370640 1 -- 172.21.15.181:0/3544353905 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260007cb0 con 0x7f62680b54e0 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 -- 172.21.15.181:0/3544353905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 msgr2=0x7f6268073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 --2- 172.21.15.181:0/3544353905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f6268073440 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f626806f050 tx=0x7f626002a5f0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 -- 172.21.15.181:0/3544353905 shutdown_connections 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 --2- 172.21.15.181:0/3544353905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f6268073440 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 --2- 172.21.15.181:0/3544353905 >> v2:172.21.15.204:3300/0 conn(0x7f62680d2190 0x7f62680b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 -- 172.21.15.181:0/3544353905 >> 172.21.15.181:0/3544353905 conn(0x7f62680d2570 msgr2=0x7f62680d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 -- 172.21.15.181:0/3544353905 shutdown_connections 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.444+0000 7f62705d6640 1 -- 172.21.15.181:0/3544353905 wait complete. 2024-09-12T02:35:06.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.445+0000 7f62705d6640 1 Processor -- start 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.445+0000 7f62705d6640 1 -- start start 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f62705d6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f626814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f62705d6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62680d2190 0x7f6268151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f62705d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f626815e830 0x7f6268161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f62705d6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62680cc1b0 con 0x7f62680b54e0 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f62705d6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f62680717a0 con 0x7f62680d2190 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f62705d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f62680d1b20 con 0x7f626815e830 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f626e372640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f626814f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f626e372640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f626814f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:59018/0 (socket says 172.21.15.181:59018) 2024-09-12T02:35:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f626e372640 1 -- 172.21.15.181:0/57272010 learned_addr learned my addr 172.21.15.181:0/57272010 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f626eb73640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f626815e830 0x7f6268161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.446+0000 7f626db71640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62680d2190 0x7f6268151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626e372640 1 -- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f626815e830 msgr2=0x7f6268161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626e372640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f626815e830 0x7f6268161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626e372640 1 -- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62680d2190 msgr2=0x7f6268151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626e372640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62680d2190 0x7f6268151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626e372640 1 -- 172.21.15.181:0/57272010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6268150660 con 0x7f62680b54e0 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626db71640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62680d2190 0x7f6268151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626eb73640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f626815e830 0x7f6268161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f626e372640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f626814f380 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f626400c430 tx=0x7f626400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f625effd640 1 -- 172.21.15.181:0/57272010 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640074e0 con 0x7f62680b54e0 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f625effd640 1 -- 172.21.15.181:0/57272010 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62640047e0 con 0x7f62680b54e0 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f625effd640 1 -- 172.21.15.181:0/57272010 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264004bd0 con 0x7f62680b54e0 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6268150940 con 0x7f62680b54e0 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.447+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6268150f00 con 0x7f62680b54e0 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.448+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62680b1ad0 con 0x7f62680b54e0 2024-09-12T02:35:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.448+0000 7f625effd640 1 -- 172.21.15.181:0/57272010 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6264011070 con 0x7f62680b54e0 2024-09-12T02:35:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.449+0000 7f625effd640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f624c06be30 0x7f624c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.449+0000 7f625effd640 1 -- 172.21.15.181:0/57272010 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f626408ac00 con 0x7f62680b54e0 2024-09-12T02:35:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.449+0000 7f626db71640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f624c06be30 0x7f624c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.449+0000 7f626db71640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f624c06be30 0x7f624c06e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f62680711b0 tx=0x7f6258008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.453+0000 7f625effd640 1 -- 172.21.15.181:0/57272010 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6264091080 con 0x7f62680b54e0 2024-09-12T02:35:06.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:06.653+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f626806fd40 con 0x7f62680b54e0 2024-09-12T02:35:07.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.327+0000 7f625effd640 1 -- 172.21.15.181:0/57272010 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v55) ==== 162+0+0 (secure 0 0 0) 0x7f62640594b0 con 0x7f62680b54e0 2024-09-12T02:35:07.328 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f624c06be30 msgr2=0x7f624c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f624c06be30 0x7f624c06e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f62680711b0 tx=0x7f6258008040 comp rx=0 tx=0).stop 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 msgr2=0x7f626814f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f626814f380 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f626400c430 tx=0x7f626400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 shutdown_connections 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f624c06be30 0x7f624c06e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62680d2190 0x7f6268151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f626815e830 0x7f6268161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 --2- 172.21.15.181:0/57272010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62680b54e0 0x7f626814f380 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 >> 172.21.15.181:0/57272010 conn(0x7f62680d2570 msgr2=0x7f626814fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 shutdown_connections 2024-09-12T02:35:07.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.329+0000 7f62705d6640 1 -- 172.21.15.181:0/57272010 wait complete. 2024-09-12T02:35:07.342 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:07.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.443+0000 7f063c3b7640 1 Processor -- start 2024-09-12T02:35:07.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.443+0000 7f063c3b7640 1 -- start start 2024-09-12T02:35:07.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.444+0000 7f063c3b7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f06340cf720 0x7f06340d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.444+0000 7f063c3b7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f063415ea20 con 0x7f06340cf2b0 2024-09-12T02:35:07.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.444+0000 7f063c3b7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06340b1c50 con 0x7f063415e640 2024-09-12T02:35:07.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f063c3b7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f06340b3d00 con 0x7f06340cf720 2024-09-12T02:35:07.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639952640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f06340cf2b0 0x7f06340d2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:32830/0 (socket says 172.21.15.181:32830) 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639952640 1 -- 172.21.15.181:0/520917122 learned_addr learned my addr 172.21.15.181:0/520917122 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f063a954640 1 --2- 172.21.15.181:0/520917122 >> v2:172.21.15.204:3300/0 conn(0x7f06340cf720 0x7f06340d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159454505 0 0) 0x7f063415ea20 con 0x7f06340cf2b0 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0620003520 con 0x7f06340cf2b0 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1218551780 0 0) 0x7f0620003520 con 0x7f06340cf2b0 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 >> v2:172.21.15.204:3300/0 conn(0x7f06340cf720 msgr2=0x7f06340d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 --2- 172.21.15.181:0/520917122 >> v2:172.21.15.204:3300/0 conn(0x7f06340cf720 0x7f06340d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 >> v1:172.21.15.204:6789/0 conn(0x7f063415e640 legacy=0x7f06340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06340b1f30 con 0x7f06340cf2b0 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f0624001670 con 0x7f06340cf2b0 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 >> v1:172.21.15.181:6789/0 conn(0x7f06340cf2b0 legacy=0x7f06340d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200039b0 0x7f0620003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f0620004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0620005120 0x7f062000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f062000c030 con 0x7f06200043b0 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f062000c1e0 con 0x7f06200039b0 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f062000c3e0 con 0x7f0620005120 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f0639952640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f0620004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f063a153640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200039b0 0x7f0620003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.445+0000 7f063a954640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0620005120 0x7f062000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639952640 1 -- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0620005120 msgr2=0x7f062000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639952640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0620005120 0x7f062000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639952640 1 -- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200039b0 msgr2=0x7f0620003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639952640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06200039b0 0x7f0620003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639952640 1 -- 172.21.15.181:0/520917122 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0620003520 con 0x7f06200043b0 2024-09-12T02:35:07.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f063a954640 1 -- 172.21.15.181:0/520917122 reap_dead start 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639952640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f0620004880 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f062400c240 tx=0x7f0620005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9c216608397d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624007d30 con 0x7f06200043b0 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0624005af0 con 0x7f06200043b0 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.446+0000 7f0639151640 1 -- 172.21.15.181:0/520917122 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624007070 con 0x7f06200043b0 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.447+0000 7f063c3b7640 1 -- 172.21.15.181:0/520917122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 msgr2=0x7f0620004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.447+0000 7f063c3b7640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f0620004880 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f062400c240 tx=0x7f0620005830 comp rx=0 tx=0).stop 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.447+0000 7f063c3b7640 1 -- 172.21.15.181:0/520917122 shutdown_connections 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.447+0000 7f063c3b7640 1 --2- 172.21.15.181:0/520917122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f0620004880 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.447+0000 7f063c3b7640 1 -- 172.21.15.181:0/520917122 >> 172.21.15.181:0/520917122 conn(0x7f063409d820 msgr2=0x7f06340d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.447+0000 7f063c3b7640 1 -- 172.21.15.181:0/520917122 shutdown_connections 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.447+0000 7f063c3b7640 1 -- 172.21.15.181:0/520917122 wait complete. 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.448+0000 7f063c3b7640 1 Processor -- start 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.448+0000 7f063c3b7640 1 -- start start 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063c3b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f06341593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063c3b7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06340c9c20 0x7f06340c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063c3b7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06340c85c0 0x7f06340b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063c3b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06340b24f0 con 0x7f06200043b0 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063c3b7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f06340b2860 con 0x7f06340c9c20 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063c3b7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f06340cfe40 con 0x7f06340c85c0 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f06341593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f06341593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:59036/0 (socket says 172.21.15.181:59036) 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 -- 172.21.15.181:0/632452807 learned_addr learned my addr 172.21.15.181:0/632452807 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a954640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06340c85c0 0x7f06340b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f0639952640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06340c9c20 0x7f06340c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 -- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06340c85c0 msgr2=0x7f06340b94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06340c85c0 0x7f06340b94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 -- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06340c9c20 msgr2=0x7f06340c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06340c9c20 0x7f06340c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 -- 172.21.15.181:0/632452807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06340c8b80 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.449+0000 7f063a153640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f06341593c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f063000f7f0 tx=0x7f063000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.450+0000 7f062affd640 1 -- 172.21.15.181:0/632452807 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063001a070 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.450+0000 7f062affd640 1 -- 172.21.15.181:0/632452807 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0630005320 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.450+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06340c8e60 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.450+0000 7f062affd640 1 -- 172.21.15.181:0/632452807 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063000fea0 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.450+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06340c9420 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.451+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0634068eb0 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.451+0000 7f062affd640 1 -- 172.21.15.181:0/632452807 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f063001d070 con 0x7f06200043b0 2024-09-12T02:35:07.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.451+0000 7f062affd640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f061806be30 0x7f061806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.452+0000 7f0639952640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f061806be30 0x7f061806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.452+0000 7f062affd640 1 -- 172.21.15.181:0/632452807 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f063008a6a0 con 0x7f06200043b0 2024-09-12T02:35:07.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.452+0000 7f0639952640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f061806be30 0x7f061806e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f062400c210 tx=0x7f062402d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.456+0000 7f062affd640 1 -- 172.21.15.181:0/632452807 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0630058fe0 con 0x7f06200043b0 2024-09-12T02:35:07.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.652+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06340d4810 con 0x7f06200043b0 2024-09-12T02:35:07.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.652+0000 7f062affd640 1 -- 172.21.15.181:0/632452807 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+4393 (secure 0 0 0) 0x7f063005de20 con 0x7f06200043b0 2024-09-12T02:35:07.653 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:07.653 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":55,"btime":"2024-09-12T02:35:07:326877+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3005461030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3005461030},{"type":"v1","addr":"172.21.15.204:6835","nonce":3005461030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:05.781182+0000","modified":"2024-09-12T02:35:06.654895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6126":{"gid":6126,"name":"a","rank":0,"incarnation":54,"state":"up:reconnect","state_seq":28,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-12T02:35:07.653 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 55 2024-09-12T02:35:07.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f061806be30 msgr2=0x7f061806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f061806be30 0x7f061806e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f062400c210 tx=0x7f062402d000 comp rx=0 tx=0).stop 2024-09-12T02:35:07.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 msgr2=0x7f06341593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f06341593c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f063000f7f0 tx=0x7f063000fcb0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 shutdown_connections 2024-09-12T02:35:07.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f061806be30 0x7f061806e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f06340c9c20 0x7f06340c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f06340c85c0 0x7f06340b94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 --2- 172.21.15.181:0/632452807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06200043b0 0x7f06341593c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 >> 172.21.15.181:0/632452807 conn(0x7f063409d820 msgr2=0x7f06341613c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 shutdown_connections 2024-09-12T02:35:07.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:07.654+0000 7f063c3b7640 1 -- 172.21.15.181:0/632452807 wait complete. 2024-09-12T02:35:08.054 INFO:tasks.ceph.mds.c.smithi181.stderr: -48> 2024-09-12T02:35:03.301+0000 7f878cc0d640 -1 mds.1.sessionmap _load_finish got (2) No such file or directory 2024-09-12T02:35:08.054 INFO:tasks.ceph.mds.c.smithi181.stderr: -47> 2024-09-12T02:35:03.301+0000 7f878cc0d640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory) 2024-09-12T02:35:08.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:35:05.781182+0000', 'modified': '2024-09-12T02:35:06.654895+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6126}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_6126': {'gid': 6126, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:reconnect', 'state_seq': 28, 'addr': '172.21.15.181:6836/844285681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 844285681}, {'type': 'v1', 'addr': '172.21.15.181:6836', 'nonce': 844285681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:35:08.069 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6126:up:reconnect 2024-09-12T02:35:08.079 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:35:09.070 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:09.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.181+0000 7f34063c4640 1 Processor -- start 2024-09-12T02:35:09.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.181+0000 7f34063c4640 1 -- start start 2024-09-12T02:35:09.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.182+0000 7f34063c4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f34000cd880 0x7f34000b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.182+0000 7f34063c4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34000731f0 con 0x7f34000b22c0 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.182+0000 7f34063c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34000ce160 con 0x7f3400156990 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.182+0000 7f34063c4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3400156d70 con 0x7f34000cd880 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.182+0000 7f33ff7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f34000cd880 0x7f34000b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.182+0000 7f3404961640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f34000b22c0 0x7f340015c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:32838/0 (socket says 172.21.15.181:32838) 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.182+0000 7f3404961640 1 -- 172.21.15.181:0/504114883 learned_addr learned my addr 172.21.15.181:0/504114883 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.183+0000 7f33ff7fe640 1 -- 172.21.15.181:0/504114883 >> v1:172.21.15.204:6789/0 conn(0x7f3400156990 legacy=0x7f34000cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.183+0000 7f33ff7fe640 1 -- 172.21.15.181:0/504114883 >> v1:172.21.15.181:6789/0 conn(0x7f34000b22c0 legacy=0x7f340015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.183+0000 7f33ff7fe640 1 -- 172.21.15.181:0/504114883 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000ce440 con 0x7f34000cd880 2024-09-12T02:35:09.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.183+0000 7f33feffd640 1 -- 172.21.15.181:0/504114883 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054376033 0 0) 0x7f34000731f0 con 0x7f34000b22c0 2024-09-12T02:35:09.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.183+0000 7f33ff7fe640 1 --2- 172.21.15.181:0/504114883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34000cd880 0x7f34000b1d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f33f40097a0 tx=0x7f33f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395505f694a19adc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f33feffd640 1 -- 172.21.15.181:0/504114883 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4037070 con 0x7f34000cd880 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f33feffd640 1 -- 172.21.15.181:0/504114883 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f402ae50 con 0x7f34000cd880 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f33feffd640 1 -- 172.21.15.181:0/504114883 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4032660 con 0x7f34000cd880 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f34063c4640 1 -- 172.21.15.181:0/504114883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34000cd880 msgr2=0x7f34000b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f34063c4640 1 --2- 172.21.15.181:0/504114883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34000cd880 0x7f34000b1d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f33f40097a0 tx=0x7f33f402a140 comp rx=0 tx=0).stop 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f34063c4640 1 -- 172.21.15.181:0/504114883 shutdown_connections 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f34063c4640 1 --2- 172.21.15.181:0/504114883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34000cd880 0x7f34000b1d80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f34063c4640 1 -- 172.21.15.181:0/504114883 >> 172.21.15.181:0/504114883 conn(0x7f340006bc10 msgr2=0x7f340006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f34063c4640 1 -- 172.21.15.181:0/504114883 shutdown_connections 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.184+0000 7f34063c4640 1 -- 172.21.15.181:0/504114883 wait complete. 2024-09-12T02:35:09.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.185+0000 7f34063c4640 1 Processor -- start 2024-09-12T02:35:09.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.186+0000 7f34063c4640 1 -- start start 2024-09-12T02:35:09.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.186+0000 7f34063c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34000b22c0 0x7f340014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.186+0000 7f34063c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34000cd880 0x7f340015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.186+0000 7f34063c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3400156990 0x7f34000b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.186+0000 7f34063c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f34000b26d0 con 0x7f3400156990 2024-09-12T02:35:09.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.186+0000 7f34063c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f34000cea90 con 0x7f34000cd880 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.186+0000 7f34063c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f34000cef20 con 0x7f34000b22c0 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3400156990 0x7f34000b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3400156990 0x7f34000b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:59064/0 (socket says 172.21.15.181:59064) 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 -- 172.21.15.181:0/2352627585 learned_addr learned my addr 172.21.15.181:0/2352627585 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f33ff7fe640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34000cd880 0x7f340015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f33fffff640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34000b22c0 0x7f340014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 -- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34000b22c0 msgr2=0x7f340014ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34000b22c0 0x7f340014ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 -- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34000cd880 msgr2=0x7f340015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34000cd880 0x7f340015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 -- 172.21.15.181:0/2352627585 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3400158f50 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f3404961640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3400156990 0x7f34000b0880 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f33f800c7a0 tx=0x7f33f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f33fcff9640 1 -- 172.21.15.181:0/2352627585 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8018070 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f33fcff9640 1 -- 172.21.15.181:0/2352627585 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f800a640 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3400159230 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f33fcff9640 1 -- 172.21.15.181:0/2352627585 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f800aab0 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.187+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001597f0 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.188+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34000b1d60 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.189+0000 7f33fcff9640 1 -- 172.21.15.181:0/2352627585 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33f801b070 con 0x7f3400156990 2024-09-12T02:35:09.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.189+0000 7f33fcff9640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f33ec06be60 0x7f33ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.189+0000 7f33fcff9640 1 -- 172.21.15.181:0/2352627585 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f33f808a430 con 0x7f3400156990 2024-09-12T02:35:09.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.189+0000 7f33fffff640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f33ec06be60 0x7f33ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.190+0000 7f33fffff640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f33ec06be60 0x7f33ec06e320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f34001f53e0 tx=0x7f33f0009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.194+0000 7f33fcff9640 1 -- 172.21.15.181:0/2352627585 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33f8058720 con 0x7f3400156990 2024-09-12T02:35:09.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.395+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3400068480 con 0x7f3400156990 2024-09-12T02:35:09.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.395+0000 7f33fcff9640 1 -- 172.21.15.181:0/2352627585 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f33f805ca20 con 0x7f3400156990 2024-09-12T02:35:09.397 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:09.397 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":57,"btime":"2024-09-12T02:35:09:335237+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3005461030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3005461030},{"type":"v1","addr":"172.21.15.204:6835","nonce":3005461030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3281666188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3281666188},{"type":"v1","addr":"172.21.15.181:6837","nonce":3281666188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:05.781182+0000","modified":"2024-09-12T02:35:09.335231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6126":{"gid":6126,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":30,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6126,"qdb_cluster":[6126]},"id":4}]} 2024-09-12T02:35:09.399 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 57 2024-09-12T02:35:09.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.397+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f33ec06be60 msgr2=0x7f33ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.397+0000 7f34063c4640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f33ec06be60 0x7f33ec06e320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f34001f53e0 tx=0x7f33f0009060 comp rx=0 tx=0).stop 2024-09-12T02:35:09.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.397+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3400156990 msgr2=0x7f34000b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.397+0000 7f34063c4640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3400156990 0x7f34000b0880 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f33f800c7a0 tx=0x7f33f800cc60 comp rx=0 tx=0).stop 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 shutdown_connections 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f33ec06be60 0x7f33ec06e320 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34000cd880 0x7f340015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3400156990 0x7f34000b0880 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 --2- 172.21.15.181:0/2352627585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34000b22c0 0x7f340014ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 >> 172.21.15.181:0/2352627585 conn(0x7f340006bc10 msgr2=0x7f34000d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 shutdown_connections 2024-09-12T02:35:09.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.398+0000 7f34063c4640 1 -- 172.21.15.181:0/2352627585 wait complete. 2024-09-12T02:35:09.812 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:35:05.781182+0000', 'modified': '2024-09-12T02:35:09.335231+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6126}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_6126': {'gid': 6126, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 30, 'addr': '172.21.15.181:6836/844285681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 844285681}, {'type': 'v1', 'addr': '172.21.15.181:6836', 'nonce': 844285681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6126, 'qdb_cluster': [6126]} 2024-09-12T02:35:09.812 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:35:09.813 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:35:09.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.912+0000 7f5b4db78640 1 Processor -- start 2024-09-12T02:35:09.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.912+0000 7f5b4db78640 1 -- start start 2024-09-12T02:35:09.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b4db78640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5b4815e8c0 0x7f5b480d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b4db78640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b4806cec0 con 0x7f5b4815e4e0 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b4db78640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b4806d160 con 0x7f5b480b6ee0 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b4db78640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5b480d2d40 con 0x7f5b4815e8c0 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b477fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5b4815e4e0 0x7f5b480b67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38964/0 (socket says 172.21.15.181:38964) 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b477fe640 1 -- 172.21.15.181:0/781596642 learned_addr learned my addr 172.21.15.181:0/781596642 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/781596642 >> v2:172.21.15.204:3300/0 conn(0x7f5b4815e8c0 0x7f5b480d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034029792 0 0) 0x7f5b4806cec0 con 0x7f5b4815e4e0 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b30003520 con 0x7f5b4815e4e0 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4211040600 0 0) 0x7f5b30003520 con 0x7f5b4815e4e0 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 >> v2:172.21.15.204:3300/0 conn(0x7f5b4815e8c0 msgr2=0x7f5b480d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.913+0000 7f5b467fc640 1 --2- 172.21.15.181:0/781596642 >> v2:172.21.15.204:3300/0 conn(0x7f5b4815e8c0 0x7f5b480d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 >> v1:172.21.15.204:6789/0 conn(0x7f5b480b6ee0 legacy=0x7f5b480d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4806d440 con 0x7f5b4815e4e0 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f5b38001690 con 0x7f5b4815e4e0 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 >> v1:172.21.15.181:6789/0 conn(0x7f5b4815e4e0 legacy=0x7f5b480b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300039b0 0x7f5b30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b30004800 0x7f5b30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b300051c0 0x7f5b3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5b480d2d40 con 0x7f5b300051c0 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3000c160 con 0x7f5b30004800 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3000c360 con 0x7f5b300039b0 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b47fff640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b300051c0 0x7f5b3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b30004800 0x7f5b30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b477fe640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300039b0 0x7f5b30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b47fff640 1 -- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300039b0 msgr2=0x7f5b30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b47fff640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300039b0 0x7f5b30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b47fff640 1 -- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b30004800 msgr2=0x7f5b30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b47fff640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b30004800 0x7f5b30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b47fff640 1 -- 172.21.15.181:0/781596642 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b30003520 con 0x7f5b300051c0 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.914+0000 7f5b477fe640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300039b0 0x7f5b30003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b47fff640 1 -- 172.21.15.181:0/781596642 reap_dead start 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b47fff640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b300051c0 0x7f5b3000b9c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5b40001e50 tx=0x7f5b30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fd054c0cdbbcd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40001a70 con 0x7f5b300051c0 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b40003970 con 0x7f5b300051c0 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b467fc640 1 -- 172.21.15.181:0/781596642 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40003d60 con 0x7f5b300051c0 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b4db78640 1 -- 172.21.15.181:0/781596642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b300051c0 msgr2=0x7f5b3000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b4db78640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b300051c0 0x7f5b3000b9c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5b40001e50 tx=0x7f5b30005830 comp rx=0 tx=0).stop 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b4db78640 1 -- 172.21.15.181:0/781596642 shutdown_connections 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b4db78640 1 --2- 172.21.15.181:0/781596642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b300051c0 0x7f5b3000b9c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b4db78640 1 -- 172.21.15.181:0/781596642 >> 172.21.15.181:0/781596642 conn(0x7f5b4806f400 msgr2=0x7f5b4806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b4db78640 1 -- 172.21.15.181:0/781596642 shutdown_connections 2024-09-12T02:35:09.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.915+0000 7f5b4db78640 1 -- 172.21.15.181:0/781596642 wait complete. 2024-09-12T02:35:09.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.917+0000 7f5b4db78640 1 Processor -- start 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.917+0000 7f5b4db78640 1 -- start start 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.917+0000 7f5b4db78640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300051c0 0x7f5b48145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.917+0000 7f5b4db78640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b480b19c0 0x7f5b480b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b4db78640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b48159240 0x7f5b481596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b4db78640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5b480b6950 con 0x7f5b48159240 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b4db78640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5b480b67d0 con 0x7f5b300051c0 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b4db78640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5b480b6ad0 con 0x7f5b480b19c0 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b48159240 0x7f5b481596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b48159240 0x7f5b481596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60564/0 (socket says 172.21.15.181:60564) 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 -- 172.21.15.181:0/3756723544 learned_addr learned my addr 172.21.15.181:0/3756723544 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b480b19c0 0x7f5b480b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b477fe640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300051c0 0x7f5b48145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 -- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b480b19c0 msgr2=0x7f5b480b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b480b19c0 0x7f5b480b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 -- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300051c0 msgr2=0x7f5b48145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300051c0 0x7f5b48145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 -- 172.21.15.181:0/3756723544 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b480b2380 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b47fff640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b48159240 0x7f5b481596c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5b4002a920 tx=0x7f5b400014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b2ffff640 1 -- 172.21.15.181:0/3756723544 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40007db0 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b2ffff640 1 -- 172.21.15.181:0/3756723544 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b40001250 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b48159f70 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b2ffff640 1 -- 172.21.15.181:0/3756723544 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40006b50 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.918+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b48146460 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.920+0000 7f5b2ffff640 1 -- 172.21.15.181:0/3756723544 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b4003b030 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.920+0000 7f5b2ffff640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5b3406be30 0x7f5b3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.920+0000 7f5b2ffff640 1 -- 172.21.15.181:0/3756723544 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f5b400a9e80 con 0x7f5b48159240 2024-09-12T02:35:09.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.920+0000 7f5b477fe640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5b3406be30 0x7f5b3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.921+0000 7f5b477fe640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5b3406be30 0x7f5b3406e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5b38001010 tx=0x7f5b38007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.921+0000 7f5b509f2740 1 Processor -- start 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.921+0000 7f5b509f2740 1 -- start start 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135ad1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a89a80 0x563135a8c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135a868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b509f2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5631359ee520 con 0x563135a8c2c0 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5631359963e0 con 0x563135a8da50 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5631359ea4e0 con 0x563135a89a80 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135ad1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135ad1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60576/0 (socket says 172.21.15.181:60576) 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 -- 172.21.15.181:0/4191956365 learned_addr learned my addr 172.21.15.181:0/4191956365 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 -- 172.21.15.181:0/4191956365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a89a80 msgr2=0x563135a8c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 --2- 172.21.15.181:0/4191956365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a89a80 0x563135a8c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 -- 172.21.15.181:0/4191956365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 msgr2=0x563135a868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 --2- 172.21.15.181:0/4191956365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135a868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 -- 172.21.15.181:0/4191956365 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631359b12f0 con 0x563135a8c2c0 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.922+0000 7f5b477fe640 1 --2- 172.21.15.181:0/4191956365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135ad1a60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5b38011d80 tx=0x7f5b38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b6c53d6bc74d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b2d7fa640 1 -- 172.21.15.181:0/4191956365 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38005260 con 0x563135a8c2c0 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b2d7fa640 1 -- 172.21.15.181:0/4191956365 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38005400 con 0x563135a8c2c0 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b2d7fa640 1 -- 172.21.15.181:0/4191956365 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380057b0 con 0x563135a8c2c0 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 -- 172.21.15.181:0/4191956365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 msgr2=0x563135ad1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 --2- 172.21.15.181:0/4191956365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135ad1a60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5b38011d80 tx=0x7f5b38014000 comp rx=0 tx=0).stop 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 -- 172.21.15.181:0/4191956365 shutdown_connections 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 --2- 172.21.15.181:0/4191956365 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135a868b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 --2- 172.21.15.181:0/4191956365 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a89a80 0x563135a8c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 --2- 172.21.15.181:0/4191956365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135ad1a60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 -- 172.21.15.181:0/4191956365 >> 172.21.15.181:0/4191956365 conn(0x563135a88a80 msgr2=0x563135ad0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 -- 172.21.15.181:0/4191956365 shutdown_connections 2024-09-12T02:35:09.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.923+0000 7f5b509f2740 1 -- 172.21.15.181:0/4191956365 wait complete. 2024-09-12T02:35:09.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.924+0000 7f5b509f2740 1 -- start start 2024-09-12T02:35:09.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.924+0000 7f5b509f2740 1 Processor -- start 2024-09-12T02:35:09.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ace590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135a8b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563135a87f20 con 0x563135a8ae40 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563135977450 con 0x563135a8c2c0 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563135ad2290 con 0x563135a8da50 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 10 client.0 _ll_register_callbacks cb 0x563135700ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135a8b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135a8b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60588/0 (socket says 172.21.15.181:60588) 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 -- 172.21.15.181:0/3251522289 learned_addr learned my addr 172.21.15.181:0/3251522289 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b477fe640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ace590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 -- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 msgr2=0x563135ace590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ace590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 -- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 msgr2=0x563135ae20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 -- 172.21.15.181:0/3251522289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631357012d0 con 0x563135a8ae40 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ace590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b477fe640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b47fff640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135a8b2c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5b400a8220 tx=0x7f5b40077b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f5723100657bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b267fc640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b267fc640 1 -- 172.21.15.181:0/3251522289 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40042070 con 0x563135a8ae40 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b267fc640 1 -- 172.21.15.181:0/3251522289 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f5b40074750 con 0x563135a8ae40 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.925+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b38005400 con 0x563135a8ae40 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b267fc640 1 -- 172.21.15.181:0/3251522289 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f5b40080c10 con 0x563135a8ae40 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 10 client.6609 fetch_fsmap learned FSMap version 57 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x5631357cb6b0 con 0x563135a8ae40 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b267fc640 1 -- 172.21.15.181:0/3251522289 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38005400 con 0x563135a8ae40 2024-09-12T02:35:09.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b267fc640 1 -- 172.21.15.181:0/3251522289 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 57) ==== 3506+0+0 (secure 0 0 0) 0x7f5b40080780 con 0x563135a8ae40 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 10 client.6609 fetch_fsmap finished waiting for FSMap version 57 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 10 client.6609 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 20 client.6609 populate_metadata read hostname 'smithi181' 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ab41c0 0x563135ab45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 4 client.6609 mds_command: new command op to 6126 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 --> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631359fbc50 con 0x563135ab41c0 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b477fe640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ab41c0 0x563135ab45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b267fc640 10 client.6609 ms_handle_connect on v2:172.21.15.181:6834/844285681 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.926+0000 7f5b477fe640 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ab41c0 0x563135ab45a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e4932e676356d51 server_cookie=4228966364b16c13 in_seq=0 out_seq=0 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b267fc640 1 -- 172.21.15.181:0/3251522289 <== mds.0 v2:172.21.15.181:6834/844285681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631359fbc50 con 0x563135ab41c0 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b267fc640 10 client.6609 handle_command_reply: tid=0 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 client.6609 shutdown 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 msgr2=0x563135a8b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135a8b2c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5b400a8220 tx=0x7f5b40077b00 comp rx=0 tx=0).stop 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 shutdown_connections 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ab41c0 0x563135ab45a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135a8b2c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b267fc640 0 client.6609 ms_handle_reset on v2:172.21.15.181:6834/844285681 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ace590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 --2- 172.21.15.181:0/3251522289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 >> 172.21.15.181:0/3251522289 conn(0x563135a89a80 msgr2=0x563135a8a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 shutdown_connections 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 1 -- 172.21.15.181:0/3251522289 wait complete. 2024-09-12T02:35:09.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.927+0000 7f5b509f2740 20 client.6609 trim_cache size 0 max 16384 2024-09-12T02:35:09.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.945+0000 7f5b509f2740 1 Processor -- start 2024-09-12T02:35:09.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.945+0000 7f5b509f2740 1 -- start start 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135ae0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ab45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b509f2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48200230 con 0x563135a8ae40 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48147bc0 con 0x563135a8c2c0 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5b481ffbe0 con 0x563135a8da50 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135ae0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135ae0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60598/0 (socket says 172.21.15.181:60598) 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 -- 172.21.15.181:0/2728474634 learned_addr learned my addr 172.21.15.181:0/2728474634 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b47fff640 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ab45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 -- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 msgr2=0x563135ab45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ab45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 -- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 msgr2=0x563135ae1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 -- 172.21.15.181:0/2728474634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563135ab77d0 con 0x563135a8ae40 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.946+0000 7f5b477fe640 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135ae0f30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5b38007010 tx=0x7f5b38016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9940e06e80faa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b2cff9640 1 -- 172.21.15.181:0/2728474634 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38015470 con 0x563135a8ae40 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b2cff9640 1 -- 172.21.15.181:0/2728474634 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38015610 con 0x563135a8ae40 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b2cff9640 1 -- 172.21.15.181:0/2728474634 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380159c0 con 0x563135a8ae40 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 -- 172.21.15.181:0/2728474634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 msgr2=0x563135ae0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135ae0f30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5b38007010 tx=0x7f5b38016000 comp rx=0 tx=0).stop 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 -- 172.21.15.181:0/2728474634 shutdown_connections 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8c2c0 0x563135ae1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8da50 0x563135ab45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 --2- 172.21.15.181:0/2728474634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8ae40 0x563135ae0f30 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 -- 172.21.15.181:0/2728474634 >> 172.21.15.181:0/2728474634 conn(0x563135a89a80 msgr2=0x563135aceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 -- 172.21.15.181:0/2728474634 shutdown_connections 2024-09-12T02:35:09.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.947+0000 7f5b509f2740 1 -- 172.21.15.181:0/2728474634 wait complete. 2024-09-12T02:35:09.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.948+0000 7f5b509f2740 1 -- start start 2024-09-12T02:35:09.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.948+0000 7f5b509f2740 1 Processor -- start 2024-09-12T02:35:09.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8ae40 0x563135b548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135af4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135b39850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563135a87f20 con 0x563135a8c2c0 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x563135977450 con 0x563135a8da50 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x563135a860a0 con 0x563135a8ae40 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 10 client.0 _ll_register_callbacks cb 0x7f5b40001b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135af4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135af4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60600/0 (socket says 172.21.15.181:60600) 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 -- 172.21.15.181:0/887629554 learned_addr learned my addr 172.21.15.181:0/887629554 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b477fe640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8ae40 0x563135b548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b47fff640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135b39850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 -- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8ae40 msgr2=0x563135b548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8ae40 0x563135b548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 -- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 msgr2=0x563135b39850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135b39850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 -- 172.21.15.181:0/887629554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563135ab4bd0 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b47fff640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135b39850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b46ffd640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135af4ee0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0176c0 tx=0x7f5b3c017b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728f2cbe6165571 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b267fc640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b267fc640 1 -- 172.21.15.181:0/887629554 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004240 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b267fc640 1 -- 172.21.15.181:0/887629554 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f5b3c0043e0 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b38015610 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b267fc640 1 -- 172.21.15.181:0/887629554 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f5b3c015920 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.949+0000 7f5b509f2740 10 client.6615 fetch_fsmap learned FSMap version 57 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x563135b39d90 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b267fc640 1 -- 172.21.15.181:0/887629554 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38015610 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b267fc640 1 -- 172.21.15.181:0/887629554 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 57) ==== 3506+0+0 (secure 0 0 0) 0x7f5b3c028050 con 0x563135a8c2c0 2024-09-12T02:35:09.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 10 client.6615 fetch_fsmap finished waiting for FSMap version 57 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 10 client.6615 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 20 client.6615 populate_metadata read hostname 'smithi181' 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ad0c00 0x563135ab0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 4 client.6615 mds_command: new command op to 6126 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 --> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] -- command(tid 0: {"prefix": "status"}) -- 0x5631359f5fa0 con 0x563135ad0c00 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b477fe640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ad0c00 0x563135ab0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b267fc640 10 client.6615 ms_handle_connect on v2:172.21.15.181:6834/844285681 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b477fe640 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ad0c00 0x563135ab0e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8ed73cad7038b2 server_cookie=2da3b7c5785de1b4 in_seq=0 out_seq=0 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b267fc640 1 -- 172.21.15.181:0/887629554 <== mds.0 v2:172.21.15.181:6834/844285681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5631359f5fa0 con 0x563135ad0c00 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b267fc640 10 client.6615 handle_command_reply: tid=0 2024-09-12T02:35:09.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 1 client.6615 shutdown 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 msgr2=0x563135af4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.950+0000 7f5b509f2740 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135af4ee0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0176c0 tx=0x7f5b3c017b80 comp rx=0 tx=0).stop 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 shutdown_connections 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:6834/844285681,v1:172.21.15.181:6836/844285681] conn(0x563135ad0c00 0x563135ab0e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x563135a8da50 0x563135b39850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563135a8c2c0 0x563135af4ee0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b267fc640 0 client.6615 ms_handle_reset on v2:172.21.15.181:6834/844285681 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 --2- 172.21.15.181:0/887629554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x563135a8ae40 0x563135b548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 >> 172.21.15.181:0/887629554 conn(0x563135a89a80 msgr2=0x563135ae1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 shutdown_connections 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 1 -- 172.21.15.181:0/887629554 wait complete. 2024-09-12T02:35:09.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b509f2740 20 client.6615 trim_cache size 0 max 16384 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6126, 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 3.6244975460000002, 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 57, 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 63, 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 63, 2024-09-12T02:35:09.959 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 109.858910106 2024-09-12T02:35:09.960 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:09.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5b3406be30 msgr2=0x7f5b3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5b3406be30 0x7f5b3406e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5b38001010 tx=0x7f5b38007040 comp rx=0 tx=0).stop 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b48159240 msgr2=0x7f5b481596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b48159240 0x7f5b481596c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5b4002a920 tx=0x7f5b400014a0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 shutdown_connections 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5b3406be30 0x7f5b3406e2f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b48159240 0x7f5b481596c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b480b19c0 0x7f5b480b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 --2- 172.21.15.181:0/3756723544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300051c0 0x7f5b48145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 >> 172.21.15.181:0/3756723544 conn(0x7f5b4806f400 msgr2=0x7f5b4815b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 shutdown_connections 2024-09-12T02:35:09.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:09.951+0000 7f5b4db78640 1 -- 172.21.15.181:0/3756723544 wait complete. 2024-09-12T02:35:09.963 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:35:10.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.061+0000 7f5c1bf11640 1 Processor -- start 2024-09-12T02:35:10.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.061+0000 7f5c1bf11640 1 -- start start 2024-09-12T02:35:10.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1bf11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b8b90 0x7f5c140d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1bf11640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5c1406dcb0 0x7f5c140d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1bf11640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c140d17e0 con 0x7f5c1415eab0 2024-09-12T02:35:10.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1bf11640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5c140d09d0 con 0x7f5c1406dcb0 2024-09-12T02:35:10.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1bf11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1415ee90 con 0x7f5c140b8b90 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1a4ae640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5c1406dcb0 0x7f5c140d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1a4ae640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5c1406dcb0 0x7f5c140d29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60614/0 (socket says 172.21.15.181:60614) 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1a4ae640 1 -- 172.21.15.181:0/3259589613 learned_addr learned my addr 172.21.15.181:0/3259589613 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c194ac640 1 --2- 172.21.15.181:0/3259589613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b8b90 0x7f5c140d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1a4ae640 1 -- 172.21.15.181:0/3259589613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b8b90 msgr2=0x7f5c140d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1a4ae640 1 --2- 172.21.15.181:0/3259589613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b8b90 0x7f5c140d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1a4ae640 1 -- 172.21.15.181:0/3259589613 >> v1:172.21.15.204:6789/0 conn(0x7f5c1415eab0 legacy=0x7f5c1406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c1a4ae640 1 -- 172.21.15.181:0/3259589613 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c140cfc10 con 0x7f5c1406dcb0 2024-09-12T02:35:10.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.062+0000 7f5c194ac640 1 --2- 172.21.15.181:0/3259589613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b8b90 0x7f5c140d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.063+0000 7f5c1a4ae640 1 --2- 172.21.15.181:0/3259589613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1406dcb0 0x7f5c140d29b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009e50 tx=0x7f5c0c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173c9495378bcd34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.063+0000 7f5c18cab640 1 -- 172.21.15.181:0/3259589613 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c036070 con 0x7f5c1406dcb0 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.063+0000 7f5c18cab640 1 -- 172.21.15.181:0/3259589613 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c031600 con 0x7f5c1406dcb0 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.063+0000 7f5c18cab640 1 -- 172.21.15.181:0/3259589613 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0319d0 con 0x7f5c1406dcb0 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 -- 172.21.15.181:0/3259589613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1406dcb0 msgr2=0x7f5c140d29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/3259589613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1406dcb0 0x7f5c140d29b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009e50 tx=0x7f5c0c02a750 comp rx=0 tx=0).stop 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 -- 172.21.15.181:0/3259589613 shutdown_connections 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/3259589613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c1406dcb0 0x7f5c140d29b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/3259589613 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c140b8b90 0x7f5c140d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 -- 172.21.15.181:0/3259589613 >> 172.21.15.181:0/3259589613 conn(0x7f5c140d4b30 msgr2=0x7f5c140d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 -- 172.21.15.181:0/3259589613 shutdown_connections 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.064+0000 7f5c1bf11640 1 -- 172.21.15.181:0/3259589613 wait complete. 2024-09-12T02:35:10.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.065+0000 7f5c1bf11640 1 Processor -- start 2024-09-12T02:35:10.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.065+0000 7f5c1bf11640 1 -- start start 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1bf11640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c1406dcb0 0x7f5c141e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1bf11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b8b90 0x7f5c1414d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1bf11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415eab0 0x7f5c141e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1bf11640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c140d04b0 con 0x7f5c140b8b90 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1bf11640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5c140d01d0 con 0x7f5c1406dcb0 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1bf11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c140ceb50 con 0x7f5c1415eab0 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b8b90 0x7f5c1414d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b8b90 0x7f5c1414d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60622/0 (socket says 172.21.15.181:60622) 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 -- 172.21.15.181:0/950884554 learned_addr learned my addr 172.21.15.181:0/950884554 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c19cad640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c1406dcb0 0x7f5c141e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1a4ae640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415eab0 0x7f5c141e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 -- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415eab0 msgr2=0x7f5c141e9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415eab0 0x7f5c141e9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 -- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c1406dcb0 msgr2=0x7f5c141e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c1406dcb0 0x7f5c141e9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 -- 172.21.15.181:0/950884554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c141e7fb0 con 0x7f5c140b8b90 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c19cad640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c1406dcb0 0x7f5c141e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c1a4ae640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415eab0 0x7f5c141e9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c194ac640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b8b90 0x7f5c1414d6c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c7f0 tx=0x7f5c0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.066+0000 7f5c0a7fc640 1 -- 172.21.15.181:0/950884554 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04015070 con 0x7f5c140b8b90 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.067+0000 7f5c0a7fc640 1 -- 172.21.15.181:0/950884554 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c04007a30 con 0x7f5c140b8b90 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.067+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c141e8290 con 0x7f5c140b8b90 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.067+0000 7f5c0a7fc640 1 -- 172.21.15.181:0/950884554 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04007e00 con 0x7f5c140b8b90 2024-09-12T02:35:10.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.067+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c141e8850 con 0x7f5c140b8b90 2024-09-12T02:35:10.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.068+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1406e380 con 0x7f5c140b8b90 2024-09-12T02:35:10.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.068+0000 7f5c0a7fc640 1 -- 172.21.15.181:0/950884554 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c04018070 con 0x7f5c140b8b90 2024-09-12T02:35:10.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.069+0000 7f5c0a7fc640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5bf806be60 0x7f5bf806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:10.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.069+0000 7f5c0a7fc640 1 -- 172.21.15.181:0/950884554 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f5c0408af50 con 0x7f5c140b8b90 2024-09-12T02:35:10.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.069+0000 7f5c19cad640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5bf806be60 0x7f5bf806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:10.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.069+0000 7f5c19cad640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5bf806be60 0x7f5bf806e320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5c141508e0 tx=0x7f5c10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:10.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.073+0000 7f5c0a7fc640 1 -- 172.21.15.181:0/950884554 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c04059800 con 0x7f5c140b8b90 2024-09-12T02:35:10.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.271+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c140693a0 con 0x7f5c140b8b90 2024-09-12T02:35:10.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.272+0000 7f5c0a7fc640 1 -- 172.21.15.181:0/950884554 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) ==== 53+0+73 (secure 0 0 0) 0x7f5c04059100 con 0x7f5c140b8b90 2024-09-12T02:35:10.273 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:35:10.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5bf806be60 msgr2=0x7f5bf806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5bf806be60 0x7f5bf806e320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5c141508e0 tx=0x7f5c10009040 comp rx=0 tx=0).stop 2024-09-12T02:35:10.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b8b90 msgr2=0x7f5c1414d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:10.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b8b90 0x7f5c1414d6c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c7f0 tx=0x7f5c0400cbf0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 shutdown_connections 2024-09-12T02:35:10.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5bf806be60 0x7f5bf806e320 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c1415eab0 0x7f5c141e9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c140b8b90 0x7f5c1414d6c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 --2- 172.21.15.181:0/950884554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c1406dcb0 0x7f5c141e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:10.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 >> 172.21.15.181:0/950884554 conn(0x7f5c140d4b30 msgr2=0x7f5c140b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:10.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 shutdown_connections 2024-09-12T02:35:10.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10.274+0000 7f5c1bf11640 1 -- 172.21.15.181:0/950884554 wait complete. 2024-09-12T02:35:10.285 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:35:10.286 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:10.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:10.287 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:35:10.302 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:35:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:35:10.303 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42333sec preferred_lft 42333sec 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:35:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:10.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:10.306 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:35:10.365 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:35:10.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:10.367 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:35:10.423 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:35:10.424 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:35:10.424 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:35:10.424 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:35:10.424 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:35:10.424 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:10.424 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:35:10.424 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:35:10.425 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:35:10.425 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:35:10.425 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:35:10.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:10.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:10.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:10.549 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:35:10.565 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:35:10.565 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:35:10.565 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:10.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:10.565 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:35:10.630 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:35:10.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:10.631 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:10.690 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:10.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:10.690 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:10.746 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:35:10.812 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:35:10.868 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:10.869 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:10.870 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:10.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:10.871 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:35:10.924 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:35:10.924 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:35:10.967 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:35:10.992 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:35:11.049 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:11.050 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:11.051 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:11.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:11.052 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:35:11.074 INFO:tasks.ceph.mds.a.smithi181.stderr:2024-09-12T02:35:11.073+0000 7f845392a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:35:11.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:35:11.255+0000 7f4d9e236480 -1 init, newargv = 0x5612c6b9cee0 newargc=15 2024-09-12T02:35:11.257 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[59917]: starting ceph client 2024-09-12T02:35:11.260 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[59917]: starting fuse 2024-09-12T02:35:12.190 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:35:12.219 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:12.277 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:35:12.277 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:35:12.277 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:35:12.277 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:35:12.277 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:35:12.277 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:12.279 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:12.280 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:12.280 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:12.280 INFO:teuthology.orchestra.run.smithi181.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:12.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:12.280 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:35:12.334 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:35:12.334 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:35:12.335 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:35:12.336 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:12.337 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:35:12.337 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:35:12.453 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.59917.asok 2024-09-12T02:35:12.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:12.464 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59917.asok 2024-09-12T02:35:12.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:12.464 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59917.asok status 2024-09-12T02:35:12.596 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:12.596 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "59917", 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6630, 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:35:12.597 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 6630 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3466501480 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:12.598 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3466501480 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.6630 192.168.0.1:0/3466501480", 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/3466501480", 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 57, 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 63, 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:35:12.599 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:12.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:12.605 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:35:12.606 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:12.621 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:35:12.621 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:12.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:12.621 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:12.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:12.687 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-12T02:35:12.811 INFO:teuthology.orchestra.run.smithi181.stdout:.: 2024-09-12T02:35:12.811 INFO:teuthology.orchestra.run.smithi181.stdout:alpha 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:bravo 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:./alpha: 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_0 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_1 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_10 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_100 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_101 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_102 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_103 2024-09-12T02:35:12.812 INFO:teuthology.orchestra.run.smithi181.stdout:file_104 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_105 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_106 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_107 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_108 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_109 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_11 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_110 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_111 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_112 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_113 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_114 2024-09-12T02:35:12.813 INFO:teuthology.orchestra.run.smithi181.stdout:file_115 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_116 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_117 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_118 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_119 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_12 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_120 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_121 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_122 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_123 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_124 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_125 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_126 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_127 2024-09-12T02:35:12.814 INFO:teuthology.orchestra.run.smithi181.stdout:file_128 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_129 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_13 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_130 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_131 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_132 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_133 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_134 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_135 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_136 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_137 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_138 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_139 2024-09-12T02:35:12.815 INFO:teuthology.orchestra.run.smithi181.stdout:file_14 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_140 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_141 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_142 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_143 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_144 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_145 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_146 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_147 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_148 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_149 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_15 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_150 2024-09-12T02:35:12.816 INFO:teuthology.orchestra.run.smithi181.stdout:file_151 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_152 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_153 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_154 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_155 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_156 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_157 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_158 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_159 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_16 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_160 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_161 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_162 2024-09-12T02:35:12.817 INFO:teuthology.orchestra.run.smithi181.stdout:file_163 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_164 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_165 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_166 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_167 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_168 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_169 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_17 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_170 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_171 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_172 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_173 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_174 2024-09-12T02:35:12.818 INFO:teuthology.orchestra.run.smithi181.stdout:file_175 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_176 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_177 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_178 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_179 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_18 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_180 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_181 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_182 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_183 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_184 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_185 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_186 2024-09-12T02:35:12.819 INFO:teuthology.orchestra.run.smithi181.stdout:file_187 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_188 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_189 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_19 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_190 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_191 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_192 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_193 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_194 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_195 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_196 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_197 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_198 2024-09-12T02:35:12.820 INFO:teuthology.orchestra.run.smithi181.stdout:file_199 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_2 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_20 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_200 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_201 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_202 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_203 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_204 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_205 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_206 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_207 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_208 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_209 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_21 2024-09-12T02:35:12.821 INFO:teuthology.orchestra.run.smithi181.stdout:file_210 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_211 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_212 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_213 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_214 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_215 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_216 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_217 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_218 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_219 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_22 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_220 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_221 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_222 2024-09-12T02:35:12.822 INFO:teuthology.orchestra.run.smithi181.stdout:file_223 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_224 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_225 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_226 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_227 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_228 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_229 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_23 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_230 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_231 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_232 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_233 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_234 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_235 2024-09-12T02:35:12.823 INFO:teuthology.orchestra.run.smithi181.stdout:file_236 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_237 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_238 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_239 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_24 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_240 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_241 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_242 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_243 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_244 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_245 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_246 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_247 2024-09-12T02:35:12.824 INFO:teuthology.orchestra.run.smithi181.stdout:file_248 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_249 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_25 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_250 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_251 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_252 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_253 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_254 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_255 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_256 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_257 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_258 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_259 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_26 2024-09-12T02:35:12.825 INFO:teuthology.orchestra.run.smithi181.stdout:file_260 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_261 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_262 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_263 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_264 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_265 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_266 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_267 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_268 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_269 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_27 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_270 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_271 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_272 2024-09-12T02:35:12.826 INFO:teuthology.orchestra.run.smithi181.stdout:file_273 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_274 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_275 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_276 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_277 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_278 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_279 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_28 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_280 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_281 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_282 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_283 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_284 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_285 2024-09-12T02:35:12.827 INFO:teuthology.orchestra.run.smithi181.stdout:file_286 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_287 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_288 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_289 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_29 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_290 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_291 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_292 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_293 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_294 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_295 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_296 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_297 2024-09-12T02:35:12.828 INFO:teuthology.orchestra.run.smithi181.stdout:file_298 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_299 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_3 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_30 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_300 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_301 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_302 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_303 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_304 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_305 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_306 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_307 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_308 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_309 2024-09-12T02:35:12.829 INFO:teuthology.orchestra.run.smithi181.stdout:file_31 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_310 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_311 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_312 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_313 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_314 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_315 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_316 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_317 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_318 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_319 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_32 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_320 2024-09-12T02:35:12.830 INFO:teuthology.orchestra.run.smithi181.stdout:file_321 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_322 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_323 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_324 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_325 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_326 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_327 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_328 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_329 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_33 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_330 2024-09-12T02:35:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:file_331 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_332 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_333 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_334 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_335 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_336 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_337 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_338 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_339 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_34 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_340 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_341 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_342 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_343 2024-09-12T02:35:12.832 INFO:teuthology.orchestra.run.smithi181.stdout:file_344 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_345 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_346 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_347 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_348 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_349 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_35 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_350 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_351 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_352 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_353 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_354 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_355 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_356 2024-09-12T02:35:12.833 INFO:teuthology.orchestra.run.smithi181.stdout:file_357 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_358 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_359 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_36 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_360 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_361 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_362 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_363 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_364 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_365 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_366 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_367 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_368 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_369 2024-09-12T02:35:12.834 INFO:teuthology.orchestra.run.smithi181.stdout:file_37 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_370 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_371 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_372 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_373 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_374 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_375 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_376 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_377 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_378 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_379 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_38 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_380 2024-09-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi181.stdout:file_381 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_382 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_383 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_384 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_385 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_386 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_387 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_388 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_389 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_39 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_390 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_391 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_392 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_393 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi181.stdout:file_394 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_395 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_396 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_397 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_398 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_399 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_4 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_40 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_400 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_401 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_402 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_403 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_404 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_405 2024-09-12T02:35:12.837 INFO:teuthology.orchestra.run.smithi181.stdout:file_406 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_407 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_408 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_409 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_41 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_410 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_411 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_412 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_413 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_414 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_415 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_416 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_417 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_418 2024-09-12T02:35:12.838 INFO:teuthology.orchestra.run.smithi181.stdout:file_419 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_42 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_420 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_421 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_422 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_423 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_424 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_425 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_426 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_427 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_428 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_429 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_43 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_430 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi181.stdout:file_431 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_432 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_433 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_434 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_435 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_436 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_437 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_438 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_439 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_44 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_440 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_441 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_442 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_443 2024-09-12T02:35:12.840 INFO:teuthology.orchestra.run.smithi181.stdout:file_444 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_445 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_446 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_447 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_448 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_449 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_45 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_450 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_451 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_452 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_453 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_454 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_455 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_456 2024-09-12T02:35:12.841 INFO:teuthology.orchestra.run.smithi181.stdout:file_457 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_458 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_459 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_46 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_460 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_461 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_462 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_463 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_464 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_465 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_466 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_467 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_468 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_469 2024-09-12T02:35:12.842 INFO:teuthology.orchestra.run.smithi181.stdout:file_47 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_470 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_471 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_472 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_473 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_474 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_475 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_476 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_477 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_478 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_479 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_48 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_480 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_481 2024-09-12T02:35:12.843 INFO:teuthology.orchestra.run.smithi181.stdout:file_482 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_483 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_484 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_485 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_486 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_487 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_488 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_489 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_49 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_490 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_491 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_492 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_493 2024-09-12T02:35:12.844 INFO:teuthology.orchestra.run.smithi181.stdout:file_494 2024-09-12T02:35:12.845 INFO:teuthology.orchestra.run.smithi181.stdout:file_495 2024-09-12T02:35:12.845 INFO:teuthology.orchestra.run.smithi181.stdout:file_496 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_497 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_498 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_499 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_5 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_50 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_500 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_501 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_502 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_503 2024-09-12T02:35:12.846 INFO:teuthology.orchestra.run.smithi181.stdout:file_504 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_505 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_506 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_507 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_508 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_509 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_51 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_510 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_511 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_512 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_513 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_514 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_515 2024-09-12T02:35:12.847 INFO:teuthology.orchestra.run.smithi181.stdout:file_516 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_517 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_518 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_519 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_52 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_520 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_521 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_522 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_523 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_524 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_525 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_526 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_527 2024-09-12T02:35:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:file_528 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_529 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_53 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_530 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_531 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_532 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_533 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_534 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_535 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_536 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_537 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_538 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_539 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_54 2024-09-12T02:35:12.849 INFO:teuthology.orchestra.run.smithi181.stdout:file_540 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_541 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_542 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_543 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_544 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_545 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_546 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_547 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_548 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_549 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_55 2024-09-12T02:35:12.850 INFO:teuthology.orchestra.run.smithi181.stdout:file_550 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_551 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_552 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_553 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_554 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_555 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_556 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_557 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_558 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_559 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_56 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_560 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_561 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_562 2024-09-12T02:35:12.851 INFO:teuthology.orchestra.run.smithi181.stdout:file_563 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_564 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_565 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_566 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_567 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_568 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_569 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_57 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_570 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_571 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_572 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_573 2024-09-12T02:35:12.852 INFO:teuthology.orchestra.run.smithi181.stdout:file_574 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_575 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_576 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_577 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_578 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_579 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_58 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_580 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_581 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_582 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_583 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_584 2024-09-12T02:35:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:file_585 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_586 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_587 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_588 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_589 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_59 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_590 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_591 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_592 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_593 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_594 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_595 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_596 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_597 2024-09-12T02:35:12.854 INFO:teuthology.orchestra.run.smithi181.stdout:file_598 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_599 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_6 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_60 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_600 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_601 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_602 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_603 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_604 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_605 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_606 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_607 2024-09-12T02:35:12.855 INFO:teuthology.orchestra.run.smithi181.stdout:file_608 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_609 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_61 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_610 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_611 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_612 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_613 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_614 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_615 2024-09-12T02:35:12.856 INFO:teuthology.orchestra.run.smithi181.stdout:file_616 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_617 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_618 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_619 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_62 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_620 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_621 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_622 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_623 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_624 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_625 2024-09-12T02:35:12.857 INFO:teuthology.orchestra.run.smithi181.stdout:file_626 2024-09-12T02:35:12.858 INFO:teuthology.orchestra.run.smithi181.stdout:file_627 2024-09-12T02:35:12.858 INFO:teuthology.orchestra.run.smithi181.stdout:file_628 2024-09-12T02:35:12.858 INFO:teuthology.orchestra.run.smithi181.stdout:file_629 2024-09-12T02:35:12.858 INFO:teuthology.orchestra.run.smithi181.stdout:file_63 2024-09-12T02:35:12.858 INFO:teuthology.orchestra.run.smithi181.stdout:file_630 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_631 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_632 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_633 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_634 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_635 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_636 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_637 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_638 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_639 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_64 2024-09-12T02:35:12.859 INFO:teuthology.orchestra.run.smithi181.stdout:file_640 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_641 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_642 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_643 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_644 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_645 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_646 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_647 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_648 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_649 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_65 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_650 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_651 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_652 2024-09-12T02:35:12.860 INFO:teuthology.orchestra.run.smithi181.stdout:file_653 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_654 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_655 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_656 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_657 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_658 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_659 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_66 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_660 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_661 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_662 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_663 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_664 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_665 2024-09-12T02:35:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:file_666 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_667 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_668 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_669 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_67 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_670 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_671 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_672 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_673 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_674 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_675 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_676 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_677 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_678 2024-09-12T02:35:12.862 INFO:teuthology.orchestra.run.smithi181.stdout:file_679 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_68 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_680 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_681 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_682 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_683 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_684 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_685 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_686 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_687 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_688 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_689 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_69 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_690 2024-09-12T02:35:12.863 INFO:teuthology.orchestra.run.smithi181.stdout:file_691 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_692 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_693 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_694 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_695 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_696 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_697 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_698 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_699 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_7 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_70 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_700 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_701 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_702 2024-09-12T02:35:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:file_703 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_704 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_705 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_706 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_707 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_708 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_709 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_71 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_710 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_711 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_712 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_713 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_714 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_715 2024-09-12T02:35:12.865 INFO:teuthology.orchestra.run.smithi181.stdout:file_716 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_717 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_718 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_719 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_72 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_720 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_721 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_722 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_723 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_724 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_725 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_726 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_727 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_728 2024-09-12T02:35:12.866 INFO:teuthology.orchestra.run.smithi181.stdout:file_729 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_73 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_730 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_731 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_732 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_733 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_734 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_735 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_736 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_737 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_738 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_739 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_74 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi181.stdout:file_740 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_741 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_742 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_743 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_744 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_745 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_746 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_747 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_748 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_749 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_75 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_750 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_751 2024-09-12T02:35:12.868 INFO:teuthology.orchestra.run.smithi181.stdout:file_752 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_753 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_754 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_755 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_756 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_757 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_758 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_759 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_76 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_760 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_761 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_762 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_763 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_764 2024-09-12T02:35:12.869 INFO:teuthology.orchestra.run.smithi181.stdout:file_765 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_766 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_767 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_768 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_769 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_77 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_770 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_771 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_772 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_773 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_774 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_775 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_776 2024-09-12T02:35:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:file_777 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_778 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_779 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_78 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_780 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_781 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_782 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_783 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_784 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_785 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_786 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_787 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_788 2024-09-12T02:35:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:file_789 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_79 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_790 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_791 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_792 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_793 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_794 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_795 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_796 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_797 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_798 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_799 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_8 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_80 2024-09-12T02:35:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:file_800 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_801 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_802 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_803 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_804 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_805 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_806 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_807 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_808 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_809 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_81 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_810 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_811 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_812 2024-09-12T02:35:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:file_813 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_814 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_815 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_816 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_817 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_818 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_819 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_82 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_820 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_821 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_822 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_823 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_824 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_825 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_826 2024-09-12T02:35:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:file_827 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_828 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_829 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_83 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_830 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_831 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_832 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_833 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_834 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_835 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_836 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_837 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_838 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_839 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_84 2024-09-12T02:35:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:file_840 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_841 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_842 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_843 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_844 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_845 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_846 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_847 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_848 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_849 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_85 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_850 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_851 2024-09-12T02:35:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:file_852 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_853 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_854 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_855 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_856 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_857 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_858 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_859 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_86 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_860 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_861 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_862 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_863 2024-09-12T02:35:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:file_864 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_865 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_866 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_867 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_868 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_869 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_87 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_870 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_871 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_872 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_873 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_874 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_875 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_876 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_877 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_878 2024-09-12T02:35:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:file_879 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_88 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_880 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_881 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_882 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_883 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_884 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_885 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_886 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_887 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_888 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_889 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_89 2024-09-12T02:35:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:file_890 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_891 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_892 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_893 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_894 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_895 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_896 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_897 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_898 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_899 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_9 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_90 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_900 2024-09-12T02:35:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:file_901 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_902 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_903 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_904 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_905 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_906 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_907 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_908 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_909 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_91 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_910 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_911 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_912 2024-09-12T02:35:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:file_913 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_914 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_915 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_916 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_917 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_918 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_919 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_92 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_920 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_921 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_922 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_923 2024-09-12T02:35:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:file_924 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_925 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_926 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_927 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_928 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_929 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_93 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_930 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_931 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_932 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_933 2024-09-12T02:35:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:file_934 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_935 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_936 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_937 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_938 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_939 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_94 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_940 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_941 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_942 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_943 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_944 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_945 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_946 2024-09-12T02:35:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:file_947 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_948 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_949 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_95 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_950 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_951 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_952 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_953 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_954 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_955 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_956 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_957 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_958 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_959 2024-09-12T02:35:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:file_96 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_960 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_961 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_962 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_963 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_964 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_965 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_966 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_967 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_968 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_969 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_97 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_970 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_971 2024-09-12T02:35:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:file_972 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_973 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_974 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_975 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_976 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_977 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_978 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_979 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_98 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_980 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_981 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_982 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_983 2024-09-12T02:35:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:file_984 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_985 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_986 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_987 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_988 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_989 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_99 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_990 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_991 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_992 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_993 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_994 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_995 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_996 2024-09-12T02:35:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:file_997 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_998 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_999 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:./bravo: 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_0 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_1 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_10 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_100 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_101 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_102 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_103 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_104 2024-09-12T02:35:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:file_105 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_106 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_107 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_108 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_109 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_11 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_110 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_111 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_112 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_113 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_114 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_115 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_116 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_117 2024-09-12T02:35:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:file_118 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_119 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_12 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_120 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_121 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_122 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_123 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_124 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_125 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_126 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_127 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_128 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_129 2024-09-12T02:35:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:file_13 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_130 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_131 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_132 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_133 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_134 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_135 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_136 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_137 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_138 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_139 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_14 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_140 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_141 2024-09-12T02:35:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:file_142 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_143 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_144 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_145 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_146 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_147 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_148 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_149 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_15 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_150 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_151 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_152 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_153 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_154 2024-09-12T02:35:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:file_155 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_156 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_157 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_158 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_159 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_16 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_160 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_161 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_162 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_163 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_164 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_165 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_166 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_167 2024-09-12T02:35:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:file_168 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_169 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_17 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_170 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_171 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_172 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_173 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_174 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_175 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_176 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_177 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_178 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_179 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_18 2024-09-12T02:35:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:file_180 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_181 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_182 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_183 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_184 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_185 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_186 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_187 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_188 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_189 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_19 2024-09-12T02:35:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:file_190 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_191 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_192 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_193 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_194 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_195 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_196 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_197 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_198 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_199 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_2 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_20 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_200 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_201 2024-09-12T02:35:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:file_202 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_203 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_204 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_205 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_206 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_207 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_208 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_209 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_21 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_210 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_211 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_212 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_213 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_214 2024-09-12T02:35:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:file_215 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_216 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_217 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_218 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_219 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_22 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_220 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_221 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_222 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_223 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_224 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_225 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_226 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_227 2024-09-12T02:35:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:file_228 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_229 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_23 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_230 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_231 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_232 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_233 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_234 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_235 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_236 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_237 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_238 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_239 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_24 2024-09-12T02:35:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:file_240 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_241 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_242 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_243 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_244 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_245 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_246 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_247 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_248 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_249 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_25 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_250 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_251 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_252 2024-09-12T02:35:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:file_253 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_254 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_255 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_256 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_257 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_258 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_259 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_26 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_260 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_261 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_262 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_263 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_264 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_265 2024-09-12T02:35:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:file_266 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_267 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_268 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_269 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_27 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_270 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_271 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_272 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_273 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_274 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_275 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_276 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_277 2024-09-12T02:35:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:file_278 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_279 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_28 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_280 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_281 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_282 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_283 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_284 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_285 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_286 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_287 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_288 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_289 2024-09-12T02:35:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:file_29 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_290 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_291 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_292 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_293 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_294 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_295 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_296 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_297 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_298 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_299 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_3 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_30 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_300 2024-09-12T02:35:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:file_301 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_302 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_303 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_304 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_305 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_306 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_307 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_308 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_309 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_31 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_310 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_311 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_312 2024-09-12T02:35:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:file_313 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_314 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_315 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_316 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_317 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_318 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_319 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_32 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_320 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_321 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_322 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_323 2024-09-12T02:35:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:file_324 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_325 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_326 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_327 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_328 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_329 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_33 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_330 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_331 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_332 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_333 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_334 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_335 2024-09-12T02:35:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:file_336 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_337 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_338 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_339 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_34 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_340 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_341 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_342 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_343 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_344 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_345 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_346 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_347 2024-09-12T02:35:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:file_348 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_349 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_35 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_350 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_351 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_352 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_353 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_354 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_355 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_356 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_357 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_358 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_359 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_36 2024-09-12T02:35:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:file_360 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_361 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_362 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_363 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_364 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_365 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_366 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_367 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_368 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_369 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_37 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_370 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_371 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_372 2024-09-12T02:35:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:file_373 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_374 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_375 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_376 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_377 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_378 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_379 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_38 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_380 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_381 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_382 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_383 2024-09-12T02:35:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:file_384 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_385 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_386 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_387 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_388 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_389 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_39 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_390 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_391 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_392 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_393 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_394 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_395 2024-09-12T02:35:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:file_396 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_397 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_398 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_399 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_4 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_40 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_400 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_401 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_402 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_403 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_404 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_405 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_406 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_407 2024-09-12T02:35:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:file_408 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_409 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_41 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_410 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_411 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_412 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_413 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_414 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_415 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_416 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_417 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_418 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_419 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_42 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_420 2024-09-12T02:35:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:file_421 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_422 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_423 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_424 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_425 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_426 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_427 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_428 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_429 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_43 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_430 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_431 2024-09-12T02:35:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:file_432 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_433 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_434 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_435 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_436 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_437 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_438 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_439 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_44 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_440 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_441 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_442 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_443 2024-09-12T02:35:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:file_444 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_445 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_446 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_447 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_448 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_449 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_45 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_450 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_451 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_452 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_453 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_454 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_455 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_456 2024-09-12T02:35:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:file_457 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_458 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_459 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_46 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_460 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_461 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_462 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_463 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_464 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_465 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_466 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_467 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_468 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_469 2024-09-12T02:35:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:file_47 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_470 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_471 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_472 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_473 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_474 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_475 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_476 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_477 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_478 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_479 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_48 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_480 2024-09-12T02:35:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:file_481 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_482 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_483 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_484 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_485 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_486 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_487 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_488 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_489 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_49 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_490 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_491 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_492 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_493 2024-09-12T02:35:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:file_494 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_495 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_496 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_497 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_498 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_499 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_5 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_50 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_500 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_501 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_502 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_503 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_504 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_505 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_506 2024-09-12T02:35:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:file_507 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_508 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_509 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_51 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_510 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_511 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_512 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_513 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_514 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_515 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_516 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_517 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_518 2024-09-12T02:35:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:file_519 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_52 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_520 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_521 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_522 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_523 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_524 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_525 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_526 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_527 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_528 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_529 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_53 2024-09-12T02:35:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:file_530 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_531 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_532 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_533 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_534 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_535 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_536 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_537 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_538 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_539 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_54 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_540 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_541 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_542 2024-09-12T02:35:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:file_543 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_544 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_545 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_546 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_547 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_548 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_549 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_55 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_550 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_551 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_552 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_553 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_554 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_555 2024-09-12T02:35:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:file_556 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_557 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_558 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_559 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_56 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_560 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_561 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_562 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_563 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_564 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_565 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_566 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_567 2024-09-12T02:35:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:file_568 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_569 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_57 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_570 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_571 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_572 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_573 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_574 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_575 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_576 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_577 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_578 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_579 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_58 2024-09-12T02:35:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:file_580 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_581 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_582 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_583 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_584 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_585 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_586 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_587 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_588 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_589 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_59 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_590 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_591 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_592 2024-09-12T02:35:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:file_593 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_594 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_595 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_596 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_597 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_598 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_599 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_6 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_60 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_600 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_601 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_602 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_603 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_604 2024-09-12T02:35:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:file_605 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_606 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_607 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_608 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_609 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_61 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_610 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_611 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_612 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_613 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_614 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_615 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_616 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_617 2024-09-12T02:35:12.932 INFO:teuthology.orchestra.run.smithi181.stdout:file_618 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_619 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_62 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_620 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_621 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_622 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_623 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_624 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_625 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_626 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_627 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_628 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_629 2024-09-12T02:35:12.933 INFO:teuthology.orchestra.run.smithi181.stdout:file_63 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_630 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_631 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_632 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_633 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_634 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_635 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_636 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_637 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_638 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_639 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_64 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_640 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_641 2024-09-12T02:35:12.934 INFO:teuthology.orchestra.run.smithi181.stdout:file_642 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_643 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_644 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_645 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_646 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_647 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_648 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_649 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_65 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_650 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_651 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_652 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_653 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_654 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_655 2024-09-12T02:35:12.935 INFO:teuthology.orchestra.run.smithi181.stdout:file_656 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_657 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_658 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_659 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_66 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_660 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_661 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_662 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_663 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_664 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_665 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_666 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_667 2024-09-12T02:35:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:file_668 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_669 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_67 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_670 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_671 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_672 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_673 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_674 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_675 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_676 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_677 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_678 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_679 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_68 2024-09-12T02:35:12.937 INFO:teuthology.orchestra.run.smithi181.stdout:file_680 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_681 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_682 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_683 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_684 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_685 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_686 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_687 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_688 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_689 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_69 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_690 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_691 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_692 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_693 2024-09-12T02:35:12.938 INFO:teuthology.orchestra.run.smithi181.stdout:file_694 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_695 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_696 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_697 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_698 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_699 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_7 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_70 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_700 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_701 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_702 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_703 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_704 2024-09-12T02:35:12.939 INFO:teuthology.orchestra.run.smithi181.stdout:file_705 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_706 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_707 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_708 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_709 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_71 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_710 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_711 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_712 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_713 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_714 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_715 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_716 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_717 2024-09-12T02:35:12.940 INFO:teuthology.orchestra.run.smithi181.stdout:file_718 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_719 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_72 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_720 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_721 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_722 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_723 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_724 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_725 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_726 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_727 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_728 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_729 2024-09-12T02:35:12.941 INFO:teuthology.orchestra.run.smithi181.stdout:file_73 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_730 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_731 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_732 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_733 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_734 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_735 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_736 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_737 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_738 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_739 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_74 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_740 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_741 2024-09-12T02:35:12.942 INFO:teuthology.orchestra.run.smithi181.stdout:file_742 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_743 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_744 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_745 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_746 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_747 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_748 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_749 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_75 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_750 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_751 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_752 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_753 2024-09-12T02:35:12.943 INFO:teuthology.orchestra.run.smithi181.stdout:file_754 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_755 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_756 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_757 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_758 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_759 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_76 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_760 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_761 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_762 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_763 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_764 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_765 2024-09-12T02:35:12.944 INFO:teuthology.orchestra.run.smithi181.stdout:file_766 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_767 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_768 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_769 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_77 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_770 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_771 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_772 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_773 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_774 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_775 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_776 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_777 2024-09-12T02:35:12.945 INFO:teuthology.orchestra.run.smithi181.stdout:file_778 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_779 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_78 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_780 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_781 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_782 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_783 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_784 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_785 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_786 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_787 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_788 2024-09-12T02:35:12.946 INFO:teuthology.orchestra.run.smithi181.stdout:file_789 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_79 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_790 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_791 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_792 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_793 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_794 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_795 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_796 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_797 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_798 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_799 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_8 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_80 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_800 2024-09-12T02:35:12.947 INFO:teuthology.orchestra.run.smithi181.stdout:file_801 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_802 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_803 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_804 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_805 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_806 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_807 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_808 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_809 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_81 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_810 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_811 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_812 2024-09-12T02:35:12.948 INFO:teuthology.orchestra.run.smithi181.stdout:file_813 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_814 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_815 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_816 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_817 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_818 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_819 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_82 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_820 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_821 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_822 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_823 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_824 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_825 2024-09-12T02:35:12.949 INFO:teuthology.orchestra.run.smithi181.stdout:file_826 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_827 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_828 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_829 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_83 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_830 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_831 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_832 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_833 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_834 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_835 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_836 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_837 2024-09-12T02:35:12.950 INFO:teuthology.orchestra.run.smithi181.stdout:file_838 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_839 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_84 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_840 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_841 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_842 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_843 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_844 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_845 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_846 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_847 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_848 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_849 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_85 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_850 2024-09-12T02:35:12.951 INFO:teuthology.orchestra.run.smithi181.stdout:file_851 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_852 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_853 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_854 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_855 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_856 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_857 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_858 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_859 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_86 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_860 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_861 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_862 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_863 2024-09-12T02:35:12.952 INFO:teuthology.orchestra.run.smithi181.stdout:file_864 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_865 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_866 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_867 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_868 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_869 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_87 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_870 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_871 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_872 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_873 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_874 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_875 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_876 2024-09-12T02:35:12.953 INFO:teuthology.orchestra.run.smithi181.stdout:file_877 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_878 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_879 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_88 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_880 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_881 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_882 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_883 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_884 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_885 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_886 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_887 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_888 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_889 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_89 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_890 2024-09-12T02:35:12.954 INFO:teuthology.orchestra.run.smithi181.stdout:file_891 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_892 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_893 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_894 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_895 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_896 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_897 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_898 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_899 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_9 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_90 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_900 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_901 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_902 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_903 2024-09-12T02:35:12.955 INFO:teuthology.orchestra.run.smithi181.stdout:file_904 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_905 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_906 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_907 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_908 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_909 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_91 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_910 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_911 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_912 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_913 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_914 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_915 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_916 2024-09-12T02:35:12.956 INFO:teuthology.orchestra.run.smithi181.stdout:file_917 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_918 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_919 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_92 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_920 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_921 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_922 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_923 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_924 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_925 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_926 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_927 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_928 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_929 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_93 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_930 2024-09-12T02:35:12.957 INFO:teuthology.orchestra.run.smithi181.stdout:file_931 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_932 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_933 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_934 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_935 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_936 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_937 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_938 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_939 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_94 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_940 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_941 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_942 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_943 2024-09-12T02:35:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:file_944 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_945 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_946 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_947 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_948 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_949 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_95 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_950 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_951 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_952 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_953 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_954 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_955 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_956 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_957 2024-09-12T02:35:12.959 INFO:teuthology.orchestra.run.smithi181.stdout:file_958 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_959 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_96 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_960 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_961 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_962 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_963 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_964 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_965 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_966 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_967 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_968 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_969 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_97 2024-09-12T02:35:12.960 INFO:teuthology.orchestra.run.smithi181.stdout:file_970 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_971 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_972 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_973 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_974 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_975 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_976 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_977 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_978 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_979 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_98 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_980 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_981 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_982 2024-09-12T02:35:12.961 INFO:teuthology.orchestra.run.smithi181.stdout:file_983 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_984 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_985 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_986 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_987 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_988 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_989 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_99 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_990 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_991 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_992 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_993 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_994 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_995 2024-09-12T02:35:12.962 INFO:teuthology.orchestra.run.smithi181.stdout:file_996 2024-09-12T02:35:12.963 INFO:teuthology.orchestra.run.smithi181.stdout:file_997 2024-09-12T02:35:12.963 INFO:teuthology.orchestra.run.smithi181.stdout:file_998 2024-09-12T02:35:12.963 INFO:teuthology.orchestra.run.smithi181.stdout:file_999 2024-09-12T02:35:12.963 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:35:12.963 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:13.007 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:13.049 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:35:13.049 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:13.050 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:13.050 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:13.066 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:35:13.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.202+0000 7f5710186640 1 Processor -- start 2024-09-12T02:35:13.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.203+0000 7f5710186640 1 -- start start 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.203+0000 7f5710186640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f570815b1e0 0x7f57080b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f5710186640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57080ce480 con 0x7f57080b41d0 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f5710186640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57080ce760 con 0x7f57080b2490 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f5710186640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f57080cea40 con 0x7f570815b1e0 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f570df22640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f570815b1e0 0x7f57080b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f570d721640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f57080b41d0 0x7f57080b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38968/0 (socket says 172.21.15.181:38968) 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f570d721640 1 -- 172.21.15.181:0/3523402313 learned_addr learned my addr 172.21.15.181:0/3523402313 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f570df22640 1 -- 172.21.15.181:0/3523402313 >> v1:172.21.15.204:6789/0 conn(0x7f57080b2490 legacy=0x7f57080716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f570df22640 1 -- 172.21.15.181:0/3523402313 >> v1:172.21.15.181:6789/0 conn(0x7f57080b41d0 legacy=0x7f57080b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f570df22640 1 -- 172.21.15.181:0/3523402313 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57080ced20 con 0x7f570815b1e0 2024-09-12T02:35:13.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.204+0000 7f570cf20640 1 -- 172.21.15.181:0/3523402313 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293263134 0 0) 0x7f57080ce480 con 0x7f57080b41d0 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f570df22640 1 --2- 172.21.15.181:0/3523402313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f57080b3c90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0097a0 tx=0x7f56fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6ac94ce5e26026 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f570cf20640 1 -- 172.21.15.181:0/3523402313 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc037070 con 0x7f570815b1e0 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f570cf20640 1 -- 172.21.15.181:0/3523402313 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56fc032440 con 0x7f570815b1e0 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f570cf20640 1 -- 172.21.15.181:0/3523402313 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc032810 con 0x7f570815b1e0 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f5710186640 1 -- 172.21.15.181:0/3523402313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 msgr2=0x7f57080b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f5710186640 1 --2- 172.21.15.181:0/3523402313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f57080b3c90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0097a0 tx=0x7f56fc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f5710186640 1 -- 172.21.15.181:0/3523402313 shutdown_connections 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f5710186640 1 --2- 172.21.15.181:0/3523402313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f57080b3c90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.205+0000 7f5710186640 1 -- 172.21.15.181:0/3523402313 >> 172.21.15.181:0/3523402313 conn(0x7f570806bc10 msgr2=0x7f570806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.206+0000 7f5710186640 1 -- 172.21.15.181:0/3523402313 shutdown_connections 2024-09-12T02:35:13.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.206+0000 7f5710186640 1 -- 172.21.15.181:0/3523402313 wait complete. 2024-09-12T02:35:13.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 Processor -- start 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 -- start start 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57080b2490 0x7f570815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57080b41d0 0x7f5708147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f5708153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57080cdfc0 con 0x7f570815b1e0 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5708071130 con 0x7f57080b41d0 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.207+0000 7f5710186640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f57080ce140 con 0x7f57080b2490 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f5708153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f5708153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60640/0 (socket says 172.21.15.181:60640) 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 -- 172.21.15.181:0/1439403206 learned_addr learned my addr 172.21.15.181:0/1439403206 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570df22640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57080b2490 0x7f570815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570d721640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57080b41d0 0x7f5708147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 -- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57080b2490 msgr2=0x7f570815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57080b2490 0x7f570815de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 -- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57080b41d0 msgr2=0x7f5708147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57080b41d0 0x7f5708147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 -- 172.21.15.181:0/1439403206 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570815e350 con 0x7f570815b1e0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570df22640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57080b2490 0x7f570815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570d721640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57080b41d0 0x7f5708147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f570e723640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f5708153840 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f570000c730 tx=0x7f570000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f56fa7fc640 1 -- 172.21.15.181:0/1439403206 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700016020 con 0x7f570815b1e0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f56fa7fc640 1 -- 172.21.15.181:0/1439403206 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570000aa50 con 0x7f570815b1e0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5708154290 con 0x7f570815b1e0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f56fa7fc640 1 -- 172.21.15.181:0/1439403206 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570000ce40 con 0x7f570815b1e0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.208+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570815d610 con 0x7f570815b1e0 2024-09-12T02:35:13.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.209+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57080b3c90 con 0x7f570815b1e0 2024-09-12T02:35:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.210+0000 7f56fa7fc640 1 -- 172.21.15.181:0/1439403206 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5700019020 con 0x7f570815b1e0 2024-09-12T02:35:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.210+0000 7f56fa7fc640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f56ec06be30 0x7f56ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.210+0000 7f56fa7fc640 1 -- 172.21.15.181:0/1439403206 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f570008aeb0 con 0x7f570815b1e0 2024-09-12T02:35:13.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.210+0000 7f570df22640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f56ec06be30 0x7f56ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.210+0000 7f570df22640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f56ec06be30 0x7f56ec06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f56fc034000 tx=0x7f56fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.214+0000 7f56fa7fc640 1 -- 172.21.15.181:0/1439403206 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5700020030 con 0x7f570815b1e0 2024-09-12T02:35:13.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.392+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5708074260 con 0x7f570815b1e0 2024-09-12T02:35:13.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.393+0000 7f56fa7fc640 1 -- 172.21.15.181:0/1439403206 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v63) ==== 80+0+372 (secure 0 0 0) 0x7f57000212b0 con 0x7f570815b1e0 2024-09-12T02:35:13.394 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6833/2402478751 2024-09-13T02:35:04.268262+0000 2024-09-12T02:35:13.394 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181:6837/2505607206 2024-09-13T02:35:03.302339+0000 2024-09-12T02:35:13.394 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6835/2402478751 2024-09-13T02:35:04.268262+0000 2024-09-12T02:35:13.394 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181:6835/2505607206 2024-09-13T02:35:03.302339+0000 2024-09-12T02:35:13.394 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6834/1808682347 2024-09-13T02:34:01.159031+0000 2024-09-12T02:35:13.394 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.204:6832/1808682347 2024-09-13T02:34:01.159031+0000 2024-09-12T02:35:13.395 INFO:teuthology.orchestra.run.smithi181.stderr:listed 6 entries 2024-09-12T02:35:13.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f56ec06be30 msgr2=0x7f56ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f56ec06be30 0x7f56ec06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f56fc034000 tx=0x7f56fc02e000 comp rx=0 tx=0).stop 2024-09-12T02:35:13.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 msgr2=0x7f5708153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f5708153840 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f570000c730 tx=0x7f570000cbf0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 shutdown_connections 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f56ec06be30 0x7f56ec06e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57080b41d0 0x7f5708147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f570815b1e0 0x7f5708153840 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 --2- 172.21.15.181:0/1439403206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57080b2490 0x7f570815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 >> 172.21.15.181:0/1439403206 conn(0x7f570806bc10 msgr2=0x7f57080b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 shutdown_connections 2024-09-12T02:35:13.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.395+0000 7f5710186640 1 -- 172.21.15.181:0/1439403206 wait complete. 2024-09-12T02:35:13.406 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:35:13.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:13.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[59917]: fuse finished with error 0 and tester_r 0 2024-09-12T02:35:13.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:13.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.432 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:35:13.597 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:13.597 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:13.597 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:13.616 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:13.617 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:35:13.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.617 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:35:13.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:13.674 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-12T02:35:13.675 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:13.675 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:13.675 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:13.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:13.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:13.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.691 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:35:13.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:13.746 INFO:teuthology.orchestra.run.smithi181.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T02:35:13.747 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:13.747 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:13.747 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:13.764 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:13.765 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:35:13.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:13.765 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:35:13.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:13.822 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T02:35:13.823 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:13.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.920+0000 7f1079047640 1 Processor -- start 2024-09-12T02:35:13.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.920+0000 7f1079047640 1 -- start start 2024-09-12T02:35:13.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f1079047640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f107415eb90 0x7f10740af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f1079047640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107406d2d0 con 0x7f1074072850 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f1079047640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107406d5b0 con 0x7f1074071890 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f1079047640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f107406ea50 con 0x7f107415eb90 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f106a59c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1074072850 0x7f1074071180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38984/0 (socket says 172.21.15.181:38984) 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f106a59c640 1 -- 172.21.15.181:0/2369104510 learned_addr learned my addr 172.21.15.181:0/2369104510 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f1072d9d640 1 --2- 172.21.15.181:0/2369104510 >> v2:172.21.15.204:3300/0 conn(0x7f107415eb90 0x7f10740af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851917065 0 0) 0x7f107406d2d0 con 0x7f1074072850 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1060003520 con 0x7f1074072850 2024-09-12T02:35:13.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3731773397 0 0) 0x7f1060003520 con 0x7f1074072850 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 >> v2:172.21.15.204:3300/0 conn(0x7f107415eb90 msgr2=0x7f10740af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 --2- 172.21.15.181:0/2369104510 >> v2:172.21.15.204:3300/0 conn(0x7f107415eb90 0x7f10740af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 >> v1:172.21.15.204:6789/0 conn(0x7f1074071890 legacy=0x7f10740cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1074072330 con 0x7f1074072850 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f105c001670 con 0x7f1074072850 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 >> v1:172.21.15.181:6789/0 conn(0x7f1074072850 legacy=0x7f1074071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600039b0 0x7f1060003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1060004800 0x7f1060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10600051c0 0x7f106000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f107406ea50 con 0x7f10600051c0 2024-09-12T02:35:13.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f106000e280 con 0x7f1060004800 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f106000e480 con 0x7f10600039b0 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.921+0000 7f107359e640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10600051c0 0x7f106000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f106a59c640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1060004800 0x7f1060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f1072d9d640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600039b0 0x7f1060003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f107359e640 1 -- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600039b0 msgr2=0x7f1060003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f107359e640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600039b0 0x7f1060003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f107359e640 1 -- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1060004800 msgr2=0x7f1060004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f107359e640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1060004800 0x7f1060004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f107359e640 1 -- 172.21.15.181:0/2369104510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1060003520 con 0x7f10600051c0 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f107359e640 1 -- 172.21.15.181:0/2369104510 reap_dead start 2024-09-12T02:35:13.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.922+0000 7f107359e640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10600051c0 0x7f106000dbd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f106c001e50 tx=0x7f1060005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2889b8a3b14bb6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c001a70 con 0x7f10600051c0 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c003970 con 0x7f10600051c0 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f107259c640 1 -- 172.21.15.181:0/2369104510 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c003d60 con 0x7f10600051c0 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f1079047640 1 -- 172.21.15.181:0/2369104510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10600051c0 msgr2=0x7f106000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f1079047640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10600051c0 0x7f106000dbd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f106c001e50 tx=0x7f1060005830 comp rx=0 tx=0).stop 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f1079047640 1 -- 172.21.15.181:0/2369104510 shutdown_connections 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f1079047640 1 --2- 172.21.15.181:0/2369104510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10600051c0 0x7f106000dbd0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f1079047640 1 -- 172.21.15.181:0/2369104510 >> 172.21.15.181:0/2369104510 conn(0x7f10740b21c0 msgr2=0x7f10740b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f1079047640 1 -- 172.21.15.181:0/2369104510 shutdown_connections 2024-09-12T02:35:13.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.923+0000 7f1079047640 1 -- 172.21.15.181:0/2369104510 wait complete. 2024-09-12T02:35:13.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.924+0000 7f1079047640 1 Processor -- start 2024-09-12T02:35:13.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1079047640 1 -- start start 2024-09-12T02:35:13.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1079047640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600051c0 0x7f1074150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1079047640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1074153bc0 0x7f1074154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1079047640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10740d01e0 0x7f10740d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1079047640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1074072000 con 0x7f1074153bc0 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1079047640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1074071e80 con 0x7f10740d01e0 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1079047640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f10740d0bd0 con 0x7f10600051c0 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f106a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1074153bc0 0x7f1074154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f106a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1074153bc0 0x7f1074154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60656/0 (socket says 172.21.15.181:60656) 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f106a59c640 1 -- 172.21.15.181:0/125894913 learned_addr learned my addr 172.21.15.181:0/125894913 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.925+0000 7f1072d9d640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600051c0 0x7f1074150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f107359e640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10740d01e0 0x7f10740d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106a59c640 1 -- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600051c0 msgr2=0x7f1074150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106a59c640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600051c0 0x7f1074150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106a59c640 1 -- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10740d01e0 msgr2=0x7f10740d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106a59c640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10740d01e0 0x7f10740d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106a59c640 1 -- 172.21.15.181:0/125894913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10740d0e60 con 0x7f1074153bc0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106a59c640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1074153bc0 0x7f1074154040 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f105c007290 tx=0x7f105c007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106bfff640 1 -- 172.21.15.181:0/125894913 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c00f960 con 0x7f1074153bc0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106bfff640 1 -- 172.21.15.181:0/125894913 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f105c018070 con 0x7f1074153bc0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10740d1140 con 0x7f1074153bc0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f106bfff640 1 -- 172.21.15.181:0/125894913 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c00fd80 con 0x7f1074153bc0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.926+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10741563d0 con 0x7f1074153bc0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.927+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1074154580 con 0x7f1074153bc0 2024-09-12T02:35:13.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.928+0000 7f106bfff640 1 -- 172.21.15.181:0/125894913 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f105c01d460 con 0x7f1074153bc0 2024-09-12T02:35:13.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.928+0000 7f106bfff640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f105406be30 0x7f105406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.928+0000 7f106bfff640 1 -- 172.21.15.181:0/125894913 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f105c08af20 con 0x7f1074153bc0 2024-09-12T02:35:13.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.928+0000 7f1072d9d640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f105406be30 0x7f105406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.928+0000 7f1072d9d640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f105406be30 0x7f105406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1064009b40 tx=0x7f1064009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:13.932+0000 7f106bfff640 1 -- 172.21.15.181:0/125894913 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f105c059860 con 0x7f1074153bc0 2024-09-12T02:35:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.129+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10740af9d0 con 0x7f1074153bc0 2024-09-12T02:35:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.130+0000 7f106bfff640 1 -- 172.21.15.181:0/125894913 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f105c059160 con 0x7f1074153bc0 2024-09-12T02:35:14.131 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:14.131 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":57,"btime":"2024-09-12T02:35:09:335237+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3005461030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3005461030},{"type":"v1","addr":"172.21.15.204:6835","nonce":3005461030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3281666188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3281666188},{"type":"v1","addr":"172.21.15.181:6837","nonce":3281666188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:05.781182+0000","modified":"2024-09-12T02:35:09.335231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6126":{"gid":6126,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":30,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6126,"qdb_cluster":[6126]},"id":4}]} 2024-09-12T02:35:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 57 2024-09-12T02:35:14.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f105406be30 msgr2=0x7f105406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f105406be30 0x7f105406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1064009b40 tx=0x7f1064009190 comp rx=0 tx=0).stop 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1074153bc0 msgr2=0x7f1074154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1074153bc0 0x7f1074154040 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f105c007290 tx=0x7f105c007690 comp rx=0 tx=0).stop 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 shutdown_connections 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f105406be30 0x7f105406e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10740d01e0 0x7f10740d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1074153bc0 0x7f1074154040 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 --2- 172.21.15.181:0/125894913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10600051c0 0x7f1074150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 >> 172.21.15.181:0/125894913 conn(0x7f10740b21c0 msgr2=0x7f10740b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 shutdown_connections 2024-09-12T02:35:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.132+0000 7f1079047640 1 -- 172.21.15.181:0/125894913 wait complete. 2024-09-12T02:35:14.145 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:14.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.243+0000 7fa21c99f640 1 Processor -- start 2024-09-12T02:35:14.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.243+0000 7fa21c99f640 1 -- start start 2024-09-12T02:35:14.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa21c99f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa21815b2e0 0x7fa2180b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa21c99f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa2180b2490 0x7fa218071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa21c99f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2180ce4f0 con 0x7fa2180cdfc0 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa21c99f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa21815b6c0 con 0x7fa2180b2490 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa21c99f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa2180ce7d0 con 0x7fa21815b2e0 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa216d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa2180b2490 0x7fa218071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa216d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa2180b2490 0x7fa218071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60658/0 (socket says 172.21.15.181:60658) 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa216d9d640 1 -- 172.21.15.181:0/3319208693 learned_addr learned my addr 172.21.15.181:0/3319208693 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa20ffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa2180cdfc0 0x7fa2180b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:38992/0 (socket says 172.21.15.181:38992) 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa21659c640 1 --2- 172.21.15.181:0/3319208693 >> v2:172.21.15.204:3300/0 conn(0x7fa21815b2e0 0x7fa2180b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa216d9d640 1 -- 172.21.15.181:0/3319208693 >> v2:172.21.15.204:3300/0 conn(0x7fa21815b2e0 msgr2=0x7fa2180b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:14.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa216d9d640 1 --2- 172.21.15.181:0/3319208693 >> v2:172.21.15.204:3300/0 conn(0x7fa21815b2e0 0x7fa2180b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa216d9d640 1 -- 172.21.15.181:0/3319208693 >> v1:172.21.15.181:6789/0 conn(0x7fa2180cdfc0 legacy=0x7fa2180b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa216d9d640 1 -- 172.21.15.181:0/3319208693 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2180ceab0 con 0x7fa2180b2490 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa215d9b640 1 -- 172.21.15.181:0/3319208693 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72085153 0 0) 0x7fa2180ce4f0 con 0x7fa2180cdfc0 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.244+0000 7fa21659c640 1 --2- 172.21.15.181:0/3319208693 >> v2:172.21.15.204:3300/0 conn(0x7fa21815b2e0 0x7fa2180b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.245+0000 7fa216d9d640 1 --2- 172.21.15.181:0/3319208693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180b2490 0x7fa218071750 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa218069550 tx=0x7fa21002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696ff2cdc39d0c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.245+0000 7fa215d9b640 1 -- 172.21.15.181:0/3319208693 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21000b2d0 con 0x7fa2180b2490 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.245+0000 7fa215d9b640 1 -- 172.21.15.181:0/3319208693 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21000b470 con 0x7fa2180b2490 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.245+0000 7fa215d9b640 1 -- 172.21.15.181:0/3319208693 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210009820 con 0x7fa2180b2490 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 -- 172.21.15.181:0/3319208693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180b2490 msgr2=0x7fa218071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 --2- 172.21.15.181:0/3319208693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180b2490 0x7fa218071750 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa218069550 tx=0x7fa21002c8b0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 -- 172.21.15.181:0/3319208693 shutdown_connections 2024-09-12T02:35:14.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 --2- 172.21.15.181:0/3319208693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180b2490 0x7fa218071750 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 --2- 172.21.15.181:0/3319208693 >> v2:172.21.15.204:3300/0 conn(0x7fa21815b2e0 0x7fa2180b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 -- 172.21.15.181:0/3319208693 >> 172.21.15.181:0/3319208693 conn(0x7fa21806bc10 msgr2=0x7fa21806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 -- 172.21.15.181:0/3319208693 shutdown_connections 2024-09-12T02:35:14.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.246+0000 7fa21c99f640 1 -- 172.21.15.181:0/3319208693 wait complete. 2024-09-12T02:35:14.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.247+0000 7fa21c99f640 1 Processor -- start 2024-09-12T02:35:14.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.247+0000 7fa21c99f640 1 -- start start 2024-09-12T02:35:14.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa21c99f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180b2490 0x7fa2181f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa21c99f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180cdfc0 0x7fa21814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa21c99f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21815b2e0 0x7fa21815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa21c99f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa2180712b0 con 0x7fa2180cdfc0 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa21c99f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa218071130 con 0x7fa21815b2e0 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa21c99f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa2180b4260 con 0x7fa2180b2490 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180cdfc0 0x7fa21814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180cdfc0 0x7fa21814fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60664/0 (socket says 172.21.15.181:60664) 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 -- 172.21.15.181:0/74509616 learned_addr learned my addr 172.21.15.181:0/74509616 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa216d9d640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21815b2e0 0x7fa21815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa21659c640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180b2490 0x7fa2181f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 -- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180b2490 msgr2=0x7fa2181f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180b2490 0x7fa2181f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 -- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21815b2e0 msgr2=0x7fa21815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21815b2e0 0x7fa21815c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 -- 172.21.15.181:0/74509616 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21815d360 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa216d9d640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21815b2e0 0x7fa21815c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20ffff640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180cdfc0 0x7fa21814fa90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c4a0 tx=0x7fa20000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.248+0000 7fa20effd640 1 -- 172.21.15.181:0/74509616 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200018070 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.249+0000 7fa20effd640 1 -- 172.21.15.181:0/74509616 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2000074e0 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.249+0000 7fa20effd640 1 -- 172.21.15.181:0/74509616 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200004a20 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.249+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21815d640 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.249+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2181f72d0 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.250+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2180b3d20 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.250+0000 7fa20effd640 1 -- 172.21.15.181:0/74509616 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa20001b070 con 0x7fa2180cdfc0 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.251+0000 7fa20effd640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1f806be30 0x7fa1f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.251+0000 7fa21659c640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1f806be30 0x7fa1f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.251+0000 7fa20effd640 1 -- 172.21.15.181:0/74509616 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7fa20008a260 con 0x7fa2180cdfc0 2024-09-12T02:35:14.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.251+0000 7fa21659c640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1f806be30 0x7fa1f806e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa208006fd0 tx=0x7fa208008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.255+0000 7fa20effd640 1 -- 172.21.15.181:0/74509616 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa200058b10 con 0x7fa2180cdfc0 2024-09-12T02:35:14.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.455+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa218156280 con 0x7fa2180cdfc0 2024-09-12T02:35:14.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.455+0000 7fa20effd640 1 -- 172.21.15.181:0/74509616 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7fa200058410 con 0x7fa2180cdfc0 2024-09-12T02:35:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:14.456 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":57,"btime":"2024-09-12T02:35:09:335237+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3005461030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3005461030},{"type":"v1","addr":"172.21.15.204:6835","nonce":3005461030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3281666188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3281666188},{"type":"v1","addr":"172.21.15.181:6837","nonce":3281666188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:05.781182+0000","modified":"2024-09-12T02:35:09.335231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6126":{"gid":6126,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":30,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6126,"qdb_cluster":[6126]},"id":4}]} 2024-09-12T02:35:14.457 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 57 2024-09-12T02:35:14.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1f806be30 msgr2=0x7fa1f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1f806be30 0x7fa1f806e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa208006fd0 tx=0x7fa208008040 comp rx=0 tx=0).stop 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180cdfc0 msgr2=0x7fa21814fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180cdfc0 0x7fa21814fa90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c4a0 tx=0x7fa20000c960 comp rx=0 tx=0).stop 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 shutdown_connections 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1f806be30 0x7fa1f806e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa21815b2e0 0x7fa21815c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2180cdfc0 0x7fa21814fa90 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 --2- 172.21.15.181:0/74509616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2180b2490 0x7fa2181f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 >> 172.21.15.181:0/74509616 conn(0x7fa21806bc10 msgr2=0x7fa2180b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 shutdown_connections 2024-09-12T02:35:14.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.457+0000 7fa21c99f640 1 -- 172.21.15.181:0/74509616 wait complete. 2024-09-12T02:35:14.469 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:14.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.566+0000 7fe9947cf640 1 Processor -- start 2024-09-12T02:35:14.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.566+0000 7fe9947cf640 1 -- start start 2024-09-12T02:35:14.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe9947cf640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe98c0cdfc0 0x7fe98c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe9947cf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe98c0ce480 con 0x7fe98c0b22c0 2024-09-12T02:35:14.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe9947cf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe98c0ce760 con 0x7fe98c15b1e0 2024-09-12T02:35:14.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe9947cf640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe98c0b26f0 con 0x7fe98c0cdfc0 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe991d6a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe98c0cdfc0 0x7fe98c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe992d6c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe98c0b22c0 0x7fe98c0716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:39008/0 (socket says 172.21.15.181:39008) 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe992d6c640 1 -- 172.21.15.181:0/3882135474 learned_addr learned my addr 172.21.15.181:0/3882135474 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe991d6a640 1 -- 172.21.15.181:0/3882135474 >> v1:172.21.15.204:6789/0 conn(0x7fe98c15b1e0 legacy=0x7fe98c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe991d6a640 1 -- 172.21.15.181:0/3882135474 >> v1:172.21.15.181:6789/0 conn(0x7fe98c0b22c0 legacy=0x7fe98c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.567+0000 7fe991d6a640 1 -- 172.21.15.181:0/3882135474 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c0cea40 con 0x7fe98c0cdfc0 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.568+0000 7fe991d6a640 1 --2- 172.21.15.181:0/3882135474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c0cdfc0 0x7fe98c0b1d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0097a0 tx=0x7fe97c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3d8be1f4627544 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.568+0000 7fe991569640 1 -- 172.21.15.181:0/3882135474 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c037070 con 0x7fe98c0cdfc0 2024-09-12T02:35:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.568+0000 7fe991569640 1 -- 172.21.15.181:0/3882135474 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c032440 con 0x7fe98c0cdfc0 2024-09-12T02:35:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.568+0000 7fe991569640 1 -- 172.21.15.181:0/3882135474 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c032810 con 0x7fe98c0cdfc0 2024-09-12T02:35:14.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.569+0000 7fe9947cf640 1 -- 172.21.15.181:0/3882135474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c0cdfc0 msgr2=0x7fe98c0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.569+0000 7fe9947cf640 1 --2- 172.21.15.181:0/3882135474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c0cdfc0 0x7fe98c0b1d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0097a0 tx=0x7fe97c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.569+0000 7fe9947cf640 1 -- 172.21.15.181:0/3882135474 shutdown_connections 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.569+0000 7fe9947cf640 1 --2- 172.21.15.181:0/3882135474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c0cdfc0 0x7fe98c0b1d80 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.569+0000 7fe9947cf640 1 -- 172.21.15.181:0/3882135474 >> 172.21.15.181:0/3882135474 conn(0x7fe98c06bc10 msgr2=0x7fe98c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.569+0000 7fe9947cf640 1 -- 172.21.15.181:0/3882135474 shutdown_connections 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.569+0000 7fe9947cf640 1 -- 172.21.15.181:0/3882135474 wait complete. 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.570+0000 7fe9947cf640 1 Processor -- start 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.570+0000 7fe9947cf640 1 -- start start 2024-09-12T02:35:14.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe9947cf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe98c0b22c0 0x7fe98c0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe9947cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe98c0cdfc0 0x7fe98c14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe9947cf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c15b1e0 0x7fe98c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe9947cf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c15b5c0 con 0x7fe98c15b1e0 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe9947cf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0b43a0 con 0x7fe98c0b22c0 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe9947cf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe98c071130 con 0x7fe98c0cdfc0 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c15b1e0 0x7fe98c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c15b1e0 0x7fe98c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60680/0 (socket says 172.21.15.181:60680) 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 -- 172.21.15.181:0/745822765 learned_addr learned my addr 172.21.15.181:0/745822765 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe99256b640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe98c0b22c0 0x7fe98c0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe991d6a640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe98c0cdfc0 0x7fe98c14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 -- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe98c0cdfc0 msgr2=0x7fe98c14d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe98c0cdfc0 0x7fe98c14d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 -- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe98c0b22c0 msgr2=0x7fe98c0ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe98c0b22c0 0x7fe98c0ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 -- 172.21.15.181:0/745822765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c14de20 con 0x7fe98c15b1e0 2024-09-12T02:35:14.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe991d6a640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe98c0cdfc0 0x7fe98c14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe992d6c640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c15b1e0 0x7fe98c15df80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c3a0 tx=0x7fe98400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe982ffd640 1 -- 172.21.15.181:0/745822765 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984017070 con 0x7fe98c15b1e0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe982ffd640 1 -- 172.21.15.181:0/745822765 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe984005ce0 con 0x7fe98c15b1e0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.571+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c0ae990 con 0x7fe98c15b1e0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.572+0000 7fe982ffd640 1 -- 172.21.15.181:0/745822765 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840072d0 con 0x7fe98c15b1e0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.572+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c0aef50 con 0x7fe98c15b1e0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.573+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98c0b1d80 con 0x7fe98c15b1e0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.573+0000 7fe982ffd640 1 -- 172.21.15.181:0/745822765 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe98401a070 con 0x7fe98c15b1e0 2024-09-12T02:35:14.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.573+0000 7fe982ffd640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe97006be30 0x7fe97006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.573+0000 7fe982ffd640 1 -- 172.21.15.181:0/745822765 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7fe98408a0e0 con 0x7fe98c15b1e0 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.573+0000 7fe99256b640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe97006be30 0x7fe97006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.574+0000 7fe99256b640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe97006be30 0x7fe97006e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe98c14e270 tx=0x7fe988003d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.578+0000 7fe982ffd640 1 -- 172.21.15.181:0/745822765 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe98c14de20 con 0x7fe98c15b1e0 2024-09-12T02:35:14.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.745+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe98c157a70 con 0x7fe98c15b1e0 2024-09-12T02:35:14.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.746+0000 7fe982ffd640 1 -- 172.21.15.181:0/745822765 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+17192 (secure 0 0 0) 0x7fe9840583d0 con 0x7fe98c15b1e0 2024-09-12T02:35:14.747 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:14.747 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:04.268284+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:22.332817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:23.395647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.204:6833/2402478751":"2024-09-13T02:35:04.268262+0000","172.21.15.181:6837/2505607206":"2024-09-13T02:35:03.302339+0000","172.21.15.204:6835/2402478751":"2024-09-13T02:35:04.268262+0000","172.21.15.181:6835/2505607206":"2024-09-13T02:35:03.302339+0000","172.21.15.204:6834/1808682347":"2024-09-13T02:34:01.159031+0000","172.21.15.204:6832/1808682347":"2024-09-13T02:34:01.159031+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.748+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe97006be30 msgr2=0x7fe97006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.748+0000 7fe9947cf640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe97006be30 0x7fe97006e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe98c14e270 tx=0x7fe988003d90 comp rx=0 tx=0).stop 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.748+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c15b1e0 msgr2=0x7fe98c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.748+0000 7fe9947cf640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c15b1e0 0x7fe98c15df80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c3a0 tx=0x7fe98400c860 comp rx=0 tx=0).stop 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 shutdown_connections 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe97006be30 0x7fe97006e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe98c15b1e0 0x7fe98c15df80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe98c0cdfc0 0x7fe98c14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 --2- 172.21.15.181:0/745822765 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe98c0b22c0 0x7fe98c0ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 >> 172.21.15.181:0/745822765 conn(0x7fe98c06bc10 msgr2=0x7fe98c14f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 shutdown_connections 2024-09-12T02:35:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.749+0000 7fe9947cf640 1 -- 172.21.15.181:0/745822765 wait complete. 2024-09-12T02:35:14.761 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:35:14.761 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:14.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.859+0000 7f729d4a5640 1 Processor -- start 2024-09-12T02:35:14.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.859+0000 7f729d4a5640 1 -- start start 2024-09-12T02:35:14.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f729d4a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72980cf2b0 0x7f72980d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f729d4a5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f72980cf6f0 0x7f72980d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f729d4a5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729815ea20 con 0x7f729815e640 2024-09-12T02:35:14.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f729d4a5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f72980b3d00 con 0x7f72980cf6f0 2024-09-12T02:35:14.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f729d4a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f72980b2860 con 0x7f72980cf2b0 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72967fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72980cf2b0 0x7f72980d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72977fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f72980cf6f0 0x7f72980d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72967fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72980cf2b0 0x7f72980d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:42322/0 (socket says 172.21.15.181:42322) 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72967fc640 1 -- 172.21.15.181:0/2780539966 learned_addr learned my addr 172.21.15.181:0/2780539966 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72977fe640 1 -- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72980cf2b0 msgr2=0x7f72980d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72977fe640 1 --2- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72980cf2b0 0x7f72980d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72977fe640 1 -- 172.21.15.181:0/2780539966 >> v1:172.21.15.204:6789/0 conn(0x7f729815e640 legacy=0x7f72980ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72977fe640 1 -- 172.21.15.181:0/2780539966 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72980b1c50 con 0x7f72980cf6f0 2024-09-12T02:35:14.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.860+0000 7f72967fc640 1 --2- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72980cf2b0 0x7f72980d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:14.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.861+0000 7f72977fe640 1 --2- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf6f0 0x7f72980d2b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f729815ebf0 tx=0x7f729002a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=997e46a27ca7fb76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.861+0000 7f7295ffb640 1 -- 172.21.15.181:0/2780539966 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290007740 con 0x7f72980cf6f0 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.861+0000 7f7295ffb640 1 -- 172.21.15.181:0/2780539966 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72900078e0 con 0x7f72980cf6f0 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.861+0000 7f7295ffb640 1 -- 172.21.15.181:0/2780539966 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290007cb0 con 0x7f72980cf6f0 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 -- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf6f0 msgr2=0x7f72980d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 --2- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf6f0 0x7f72980d2b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f729815ebf0 tx=0x7f729002a5b0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 -- 172.21.15.181:0/2780539966 shutdown_connections 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 --2- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf6f0 0x7f72980d2b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 --2- 172.21.15.181:0/2780539966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72980cf2b0 0x7f72980d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 -- 172.21.15.181:0/2780539966 >> 172.21.15.181:0/2780539966 conn(0x7f729809d820 msgr2=0x7f72980d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 -- 172.21.15.181:0/2780539966 shutdown_connections 2024-09-12T02:35:14.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.862+0000 7f729d4a5640 1 -- 172.21.15.181:0/2780539966 wait complete. 2024-09-12T02:35:14.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.863+0000 7f729d4a5640 1 Processor -- start 2024-09-12T02:35:14.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.863+0000 7f729d4a5640 1 -- start start 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f729d4a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf2b0 0x7f72980ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f729d4a5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72980cf6f0 0x7f72980cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f729d4a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f729815e640 0x7f72980cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f729d4a5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f72980b24f0 con 0x7f72980cf6f0 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f729d4a5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f72980b2210 con 0x7f72980cf2b0 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f729d4a5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f72980cfe40 con 0x7f729815e640 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f72967fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72980cf6f0 0x7f72980cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f72967fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72980cf6f0 0x7f72980cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60690/0 (socket says 172.21.15.181:60690) 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f72967fc640 1 -- 172.21.15.181:0/1184373530 learned_addr learned my addr 172.21.15.181:0/1184373530 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f72977fe640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f729815e640 0x7f72980cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.864+0000 7f7296ffd640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf2b0 0x7f72980ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f72967fc640 1 -- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f729815e640 msgr2=0x7f72980cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f72967fc640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f729815e640 0x7f72980cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f72967fc640 1 -- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf2b0 msgr2=0x7f72980ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f72967fc640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf2b0 0x7f72980ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f72967fc640 1 -- 172.21.15.181:0/1184373530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7298160980 con 0x7f72980cf6f0 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f72967fc640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72980cf6f0 0x7f72980cbd10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f728c00e900 tx=0x7f728c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f727f7fe640 1 -- 172.21.15.181:0/1184373530 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c017070 con 0x7f72980cf6f0 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f727f7fe640 1 -- 172.21.15.181:0/1184373530 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c00ca00 con 0x7f72980cf6f0 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7298160cc0 con 0x7f72980cf6f0 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f727f7fe640 1 -- 172.21.15.181:0/1184373530 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c00cdf0 con 0x7f72980cf6f0 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.865+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7298161500 con 0x7f72980cf6f0 2024-09-12T02:35:14.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.866+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7298068eb0 con 0x7f72980cf6f0 2024-09-12T02:35:14.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.867+0000 7f727f7fe640 1 -- 172.21.15.181:0/1184373530 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f728c01a070 con 0x7f72980cf6f0 2024-09-12T02:35:14.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.867+0000 7f727f7fe640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f728406be30 0x7f728406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:14.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.867+0000 7f7296ffd640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f728406be30 0x7f728406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:14.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.867+0000 7f727f7fe640 1 -- 172.21.15.181:0/1184373530 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f728c08adc0 con 0x7f72980cf6f0 2024-09-12T02:35:14.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.868+0000 7f7296ffd640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f728406be30 0x7f728406e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7288001780 tx=0x7f7288009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:14.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:14.872+0000 7f727f7fe640 1 -- 172.21.15.181:0/1184373530 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7298160cc0 con 0x7f72980cf6f0 2024-09-12T02:35:15.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.071+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72980b73a0 con 0x7f72980cf6f0 2024-09-12T02:35:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.071+0000 7f727f7fe640 1 -- 172.21.15.181:0/1184373530 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f728c059020 con 0x7f72980cf6f0 2024-09-12T02:35:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:15.072 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":57,"btime":"2024-09-12T02:35:09:335237+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3005461030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3005461030},{"type":"v1","addr":"172.21.15.204:6835","nonce":3005461030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3281666188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3281666188},{"type":"v1","addr":"172.21.15.181:6837","nonce":3281666188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:05.781182+0000","modified":"2024-09-12T02:35:09.335231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6126":{"gid":6126,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":30,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6126,"qdb_cluster":[6126]},"id":4}]} 2024-09-12T02:35:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 57 2024-09-12T02:35:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f728406be30 msgr2=0x7f728406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f728406be30 0x7f728406e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7288001780 tx=0x7f7288009040 comp rx=0 tx=0).stop 2024-09-12T02:35:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72980cf6f0 msgr2=0x7f72980cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72980cf6f0 0x7f72980cbd10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f728c00e900 tx=0x7f728c00edc0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 shutdown_connections 2024-09-12T02:35:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f728406be30 0x7f728406e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f729815e640 0x7f72980cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72980cf6f0 0x7f72980cbd10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 --2- 172.21.15.181:0/1184373530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72980cf2b0 0x7f72980ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 >> 172.21.15.181:0/1184373530 conn(0x7f729809d820 msgr2=0x7f72980b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 shutdown_connections 2024-09-12T02:35:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.073+0000 7f729d4a5640 1 -- 172.21.15.181:0/1184373530 wait complete. 2024-09-12T02:35:15.085 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:15.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.182+0000 7f2bd7b8d640 1 Processor -- start 2024-09-12T02:35:15.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.183+0000 7f2bd7b8d640 1 -- start start 2024-09-12T02:35:15.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.183+0000 7f2bd7b8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd015b1e0 0x7f2bd00b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd7b8d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2bd00b41d0 0x7f2bd00b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd7b8d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd00ce480 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd7b8d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd00ce760 con 0x7f2bd00b41d0 2024-09-12T02:35:15.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd7b8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd00cea40 con 0x7f2bd015b1e0 2024-09-12T02:35:15.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5929640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd015b1e0 0x7f2bd00b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5929640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd015b1e0 0x7f2bd00b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:42338/0 (socket says 172.21.15.181:42338) 2024-09-12T02:35:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5929640 1 -- 172.21.15.181:0/85226913 learned_addr learned my addr 172.21.15.181:0/85226913 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5128640 1 --2- 172.21.15.181:0/85226913 >> v2:172.21.15.204:3300/0 conn(0x7f2bd00b41d0 0x7f2bd00b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5929640 1 -- 172.21.15.181:0/85226913 >> v2:172.21.15.204:3300/0 conn(0x7f2bd00b41d0 msgr2=0x7f2bd00b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5929640 1 --2- 172.21.15.181:0/85226913 >> v2:172.21.15.204:3300/0 conn(0x7f2bd00b41d0 0x7f2bd00b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5929640 1 -- 172.21.15.181:0/85226913 >> v1:172.21.15.204:6789/0 conn(0x7f2bd00cdfc0 legacy=0x7f2bd00ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.184+0000 7f2bd5929640 1 -- 172.21.15.181:0/85226913 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd00ced20 con 0x7f2bd015b1e0 2024-09-12T02:35:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.185+0000 7f2bd5929640 1 --2- 172.21.15.181:0/85226913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd015b1e0 0x7f2bd00b3c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009870 tx=0x7f2bc402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c55aa2846d6aa65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.185+0000 7f2bd4927640 1 -- 172.21.15.181:0/85226913 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4037070 con 0x7f2bd015b1e0 2024-09-12T02:35:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.185+0000 7f2bd4927640 1 -- 172.21.15.181:0/85226913 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc4032440 con 0x7f2bd015b1e0 2024-09-12T02:35:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.185+0000 7f2bd4927640 1 -- 172.21.15.181:0/85226913 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4032810 con 0x7f2bd015b1e0 2024-09-12T02:35:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/85226913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd015b1e0 msgr2=0x7f2bd00b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/85226913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd015b1e0 0x7f2bd00b3c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009870 tx=0x7f2bc402a270 comp rx=0 tx=0).stop 2024-09-12T02:35:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/85226913 shutdown_connections 2024-09-12T02:35:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/85226913 >> v2:172.21.15.204:3300/0 conn(0x7f2bd00b41d0 0x7f2bd00b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/85226913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd015b1e0 0x7f2bd00b3c90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/85226913 >> 172.21.15.181:0/85226913 conn(0x7f2bd006bc10 msgr2=0x7f2bd006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/85226913 shutdown_connections 2024-09-12T02:35:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.186+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/85226913 wait complete. 2024-09-12T02:35:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.187+0000 7f2bd7b8d640 1 Processor -- start 2024-09-12T02:35:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.187+0000 7f2bd7b8d640 1 -- start start 2024-09-12T02:35:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b41d0 0x7f2bd01445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00cdfc0 0x7f2bd014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd015b1e0 0x7f2bd015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd00726d0 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd0071130 con 0x7f2bd015b1e0 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd0072850 con 0x7f2bd00b41d0 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00cdfc0 0x7f2bd014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00cdfc0 0x7f2bd014cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60704/0 (socket says 172.21.15.181:60704) 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 -- 172.21.15.181:0/3319671329 learned_addr learned my addr 172.21.15.181:0/3319671329 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5929640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b41d0 0x7f2bd01445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd612a640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd015b1e0 0x7f2bd015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 -- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b41d0 msgr2=0x7f2bd01445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b41d0 0x7f2bd01445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 -- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd015b1e0 msgr2=0x7f2bd015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd015b1e0 0x7f2bd015c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 -- 172.21.15.181:0/3319671329 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd015b870 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd5128640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00cdfc0 0x7f2bd014cb10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00e9b0 tx=0x7f2bcc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bc27fc640 1 -- 172.21.15.181:0/3319671329 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc017070 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bc27fc640 1 -- 172.21.15.181:0/3319671329 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00c9a0 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd015bb50 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bc27fc640 1 -- 172.21.15.181:0/3319671329 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00cd90 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.188+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd015c110 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.189+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd014f2a0 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.190+0000 7f2bc27fc640 1 -- 172.21.15.181:0/3319671329 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bcc01a070 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.190+0000 7f2bc27fc640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bb406be60 0x7f2bb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.190+0000 7f2bc27fc640 1 -- 172.21.15.181:0/3319671329 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f2bcc08b2c0 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.190+0000 7f2bd5929640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bb406be60 0x7f2bb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.191+0000 7f2bd5929640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bb406be60 0x7f2bb406e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4034000 tx=0x7f2bc402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.194+0000 7f2bc27fc640 1 -- 172.21.15.181:0/3319671329 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bcc059490 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.394+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bd00b3c90 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.395+0000 7f2bc27fc640 1 -- 172.21.15.181:0/3319671329 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f2bcc05d790 con 0x7f2bd00cdfc0 2024-09-12T02:35:15.396 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:15.396 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":57,"btime":"2024-09-12T02:35:09:335237+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3005461030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3005461030},{"type":"v1","addr":"172.21.15.204:6835","nonce":3005461030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3281666188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3281666188},{"type":"v1","addr":"172.21.15.181:6837","nonce":3281666188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:05.781182+0000","modified":"2024-09-12T02:35:09.335231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6126":{"gid":6126,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":30,"addr":"172.21.15.181:6836/844285681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":844285681},{"type":"v1","addr":"172.21.15.181:6836","nonce":844285681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6126,"qdb_cluster":[6126]},"id":4}]} 2024-09-12T02:35:15.396 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 57 2024-09-12T02:35:15.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bb406be60 msgr2=0x7f2bb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bb406be60 0x7f2bb406e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4034000 tx=0x7f2bc402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:15.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00cdfc0 msgr2=0x7f2bd014cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00cdfc0 0x7f2bd014cb10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00e9b0 tx=0x7f2bcc00ee70 comp rx=0 tx=0).stop 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 shutdown_connections 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2bb406be60 0x7f2bb406e320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2bd015b1e0 0x7f2bd015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00cdfc0 0x7f2bd014cb10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 --2- 172.21.15.181:0/3319671329 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2bd00b41d0 0x7f2bd01445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 >> 172.21.15.181:0/3319671329 conn(0x7f2bd006bc10 msgr2=0x7f2bd014f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 shutdown_connections 2024-09-12T02:35:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.397+0000 7f2bd7b8d640 1 -- 172.21.15.181:0/3319671329 wait complete. 2024-09-12T02:35:15.409 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:15.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.506+0000 7f71b3e9b640 1 Processor -- start 2024-09-12T02:35:15.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.506+0000 7f71b3e9b640 1 -- start start 2024-09-12T02:35:15.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b3e9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cd880 0x7f71ac0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b3e9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b22c0 0x7f71ac15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b3e9b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ac0b2710 con 0x7f71ac156990 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b3e9b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac156d70 con 0x7f71ac0cd880 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b3e9b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac0cea90 con 0x7f71ac0b22c0 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b1436640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cd880 0x7f71ac0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b2438640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b22c0 0x7f71ac15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b1436640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cd880 0x7f71ac0b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:42398/0 (socket says 172.21.15.181:42398) 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b2438640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b22c0 0x7f71ac15c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:42356/0 (socket says 172.21.15.181:42356) 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b1c37640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f71ac156990 0x7f71ac0cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:60216/0 (socket says 172.21.15.181:60216) 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.507+0000 7f71b1436640 1 -- 172.21.15.181:0/4162370157 learned_addr learned my addr 172.21.15.181:0/4162370157 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b0c35640 1 -- 172.21.15.181:0/4162370157 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606021846 0 0) 0x7f71ac0b2710 con 0x7f71ac156990 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b0c35640 1 -- 172.21.15.181:0/4162370157 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7198003520 con 0x7f71ac156990 2024-09-12T02:35:15.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b2438640 1 -- 172.21.15.181:0/4162370157 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cd880 msgr2=0x7f71ac0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:15.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b2438640 1 --2- 172.21.15.181:0/4162370157 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cd880 0x7f71ac0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b2438640 1 -- 172.21.15.181:0/4162370157 >> v1:172.21.15.204:6789/0 conn(0x7f71ac156990 legacy=0x7f71ac0cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b2438640 1 -- 172.21.15.181:0/4162370157 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac0731f0 con 0x7f71ac0b22c0 2024-09-12T02:35:15.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b1436640 1 --2- 172.21.15.181:0/4162370157 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cd880 0x7f71ac0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:15.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.508+0000 7f71b2438640 1 --2- 172.21.15.181:0/4162370157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b22c0 0x7f71ac15c8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009d90 tx=0x7f71a402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0586f6a3a9634b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b0c35640 1 -- 172.21.15.181:0/4162370157 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4031600 con 0x7f71ac0b22c0 2024-09-12T02:35:15.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b0c35640 1 -- 172.21.15.181:0/4162370157 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a40317a0 con 0x7f71ac0b22c0 2024-09-12T02:35:15.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b0c35640 1 -- 172.21.15.181:0/4162370157 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4031b50 con 0x7f71ac0b22c0 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 -- 172.21.15.181:0/4162370157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b22c0 msgr2=0x7f71ac15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/4162370157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b22c0 0x7f71ac15c8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009d90 tx=0x7f71a402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 -- 172.21.15.181:0/4162370157 shutdown_connections 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/4162370157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0b22c0 0x7f71ac15c8d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/4162370157 >> v2:172.21.15.204:3300/0 conn(0x7f71ac0cd880 0x7f71ac0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 -- 172.21.15.181:0/4162370157 >> 172.21.15.181:0/4162370157 conn(0x7f71ac06bc10 msgr2=0x7f71ac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 -- 172.21.15.181:0/4162370157 shutdown_connections 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.509+0000 7f71b3e9b640 1 -- 172.21.15.181:0/4162370157 wait complete. 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.510+0000 7f71b3e9b640 1 Processor -- start 2024-09-12T02:35:15.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.510+0000 7f71b3e9b640 1 -- start start 2024-09-12T02:35:15.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b3e9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0b22c0 0x7f71ac144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b3e9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0cd880 0x7f71ac15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b3e9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac156990 0x7f71ac15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b3e9b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0ce720 con 0x7f71ac156990 2024-09-12T02:35:15.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b3e9b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0ce440 con 0x7f71ac0b22c0 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b3e9b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac0cef20 con 0x7f71ac0cd880 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b2438640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac156990 0x7f71ac15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b2438640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac156990 0x7f71ac15f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60712/0 (socket says 172.21.15.181:60712) 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b2438640 1 -- 172.21.15.181:0/3189637894 learned_addr learned my addr 172.21.15.181:0/3189637894 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b1436640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0cd880 0x7f71ac15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.511+0000 7f71b1c37640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0b22c0 0x7f71ac144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b2438640 1 -- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0cd880 msgr2=0x7f71ac15ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b2438640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0cd880 0x7f71ac15ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b2438640 1 -- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0b22c0 msgr2=0x7f71ac144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b2438640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0b22c0 0x7f71ac144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b2438640 1 -- 172.21.15.181:0/3189637894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac1484b0 con 0x7f71ac156990 2024-09-12T02:35:15.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b2438640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac156990 0x7f71ac15f3c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009eb0 tx=0x7f71a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71a27fc640 1 -- 172.21.15.181:0/3189637894 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a403f070 con 0x7f71ac156990 2024-09-12T02:35:15.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71a27fc640 1 -- 172.21.15.181:0/3189637894 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a4030850 con 0x7f71ac156990 2024-09-12T02:35:15.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1458b0 con 0x7f71ac156990 2024-09-12T02:35:15.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71a27fc640 1 -- 172.21.15.181:0/3189637894 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4030c40 con 0x7f71ac156990 2024-09-12T02:35:15.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.512+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1477c0 con 0x7f71ac156990 2024-09-12T02:35:15.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.513+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac0b1d80 con 0x7f71ac156990 2024-09-12T02:35:15.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.513+0000 7f71a27fc640 1 -- 172.21.15.181:0/3189637894 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71a4043410 con 0x7f71ac156990 2024-09-12T02:35:15.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.514+0000 7f71a27fc640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be30 0x7f719006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.514+0000 7f71b1c37640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be30 0x7f719006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.514+0000 7f71a27fc640 1 -- 172.21.15.181:0/3189637894 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7f71a40abfc0 con 0x7f71ac156990 2024-09-12T02:35:15.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.514+0000 7f71b1c37640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be30 0x7f719006e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71a8000f60 tx=0x7f71a8007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.518+0000 7f71a27fc640 1 -- 172.21.15.181:0/3189637894 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71a407a1a0 con 0x7f71ac156990 2024-09-12T02:35:15.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.685+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71ac0afe90 con 0x7f71ac156990 2024-09-12T02:35:15.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.687+0000 7f71a27fc640 1 -- 172.21.15.181:0/3189637894 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+17192 (secure 0 0 0) 0x7f71a407e4a0 con 0x7f71ac156990 2024-09-12T02:35:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:15.688 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:04.268284+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:33:22.332817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:33:23.395647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.204:6833/2402478751":"2024-09-13T02:35:04.268262+0000","172.21.15.181:6837/2505607206":"2024-09-13T02:35:03.302339+0000","172.21.15.204:6835/2402478751":"2024-09-13T02:35:04.268262+0000","172.21.15.181:6835/2505607206":"2024-09-13T02:35:03.302339+0000","172.21.15.204:6834/1808682347":"2024-09-13T02:34:01.159031+0000","172.21.15.204:6832/1808682347":"2024-09-13T02:34:01.159031+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:15.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be30 msgr2=0x7f719006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be30 0x7f719006e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71a8000f60 tx=0x7f71a8007cf0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac156990 msgr2=0x7f71ac15f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac156990 0x7f71ac15f3c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009eb0 tx=0x7f71a4004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:15.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 shutdown_connections 2024-09-12T02:35:15.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f719006be30 0x7f719006e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71ac156990 0x7f71ac15f3c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71ac0cd880 0x7f71ac15ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 --2- 172.21.15.181:0/3189637894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71ac0b22c0 0x7f71ac144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 >> 172.21.15.181:0/3189637894 conn(0x7f71ac06bc10 msgr2=0x7f71ac0737e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 shutdown_connections 2024-09-12T02:35:15.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.689+0000 7f71b3e9b640 1 -- 172.21.15.181:0/3189637894 wait complete. 2024-09-12T02:35:15.701 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:35:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.799+0000 7fadd254b640 1 Processor -- start 2024-09-12T02:35:15.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.799+0000 7fadd254b640 1 -- start start 2024-09-12T02:35:15.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.800+0000 7fadd254b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fadcc0cf720 0x7fadcc0d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.800+0000 7fadd254b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc15ea20 con 0x7fadcc0cf2b0 2024-09-12T02:35:15.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.800+0000 7fadd254b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc0b1c50 con 0x7fadcc15e640 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.800+0000 7fadd254b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fadcc0b3d00 con 0x7fadcc0cf720 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.800+0000 7fadcb7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fadcc0cf2b0 0x7fadcc0d2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:39014/0 (socket says 172.21.15.181:39014) 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.800+0000 7fadcb7fe640 1 -- 172.21.15.181:0/3396002288 learned_addr learned my addr 172.21.15.181:0/3396002288 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadd0ae8640 1 --2- 172.21.15.181:0/3396002288 >> v2:172.21.15.204:3300/0 conn(0x7fadcc0cf720 0x7fadcc0d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430607652 0 0) 0x7fadcc15ea20 con 0x7fadcc0cf2b0 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb4003520 con 0x7fadcc0cf2b0 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1634558367 0 0) 0x7fadb4003520 con 0x7fadcc0cf2b0 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 >> v2:172.21.15.204:3300/0 conn(0x7fadcc0cf720 msgr2=0x7fadcc0d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 --2- 172.21.15.181:0/3396002288 >> v2:172.21.15.204:3300/0 conn(0x7fadcc0cf720 0x7fadcc0d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 >> v1:172.21.15.204:6789/0 conn(0x7fadcc15e640 legacy=0x7fadcc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0b1f30 con 0x7fadcc0cf2b0 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fadc0001670 con 0x7fadcc0cf2b0 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 >> v1:172.21.15.181:6789/0 conn(0x7fadcc0cf2b0 legacy=0x7fadcc0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadb40039b0 0x7fadb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40043b0 0x7fadb4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadb4005120 0x7fadb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fadb400c030 con 0x7fadb40039b0 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fadb400c1e0 con 0x7fadb40043b0 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fadb400c3e0 con 0x7fadb4005120 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcbfff640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadb40039b0 0x7fadb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadd0ae8640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadb4005120 0x7fadb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcb7fe640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40043b0 0x7fadb4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcbfff640 1 -- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadb4005120 msgr2=0x7fadb400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.801+0000 7fadcbfff640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadb4005120 0x7fadb400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadcbfff640 1 -- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40043b0 msgr2=0x7fadb4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadcbfff640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40043b0 0x7fadb4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadcbfff640 1 -- 172.21.15.181:0/3396002288 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb4003520 con 0x7fadb40039b0 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadd0ae8640 1 -- 172.21.15.181:0/3396002288 reap_dead start 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadcbfff640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadb40039b0 0x7fadb4003d90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fadbc001830 tx=0x7fadb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c607825495e0458b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc001430 con 0x7fadb40039b0 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc0052f0 con 0x7fadb40039b0 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.802+0000 7fadcaffd640 1 -- 172.21.15.181:0/3396002288 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc02ac10 con 0x7fadb40039b0 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.803+0000 7fadd254b640 1 -- 172.21.15.181:0/3396002288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadb40039b0 msgr2=0x7fadb4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.803+0000 7fadd254b640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadb40039b0 0x7fadb4003d90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fadbc001830 tx=0x7fadb4005830 comp rx=0 tx=0).stop 2024-09-12T02:35:15.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.803+0000 7fadd254b640 1 -- 172.21.15.181:0/3396002288 shutdown_connections 2024-09-12T02:35:15.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.803+0000 7fadd254b640 1 --2- 172.21.15.181:0/3396002288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadb40039b0 0x7fadb4003d90 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.803+0000 7fadd254b640 1 -- 172.21.15.181:0/3396002288 >> 172.21.15.181:0/3396002288 conn(0x7fadcc09d820 msgr2=0x7fadcc0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:15.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.803+0000 7fadd254b640 1 -- 172.21.15.181:0/3396002288 shutdown_connections 2024-09-12T02:35:15.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.803+0000 7fadd254b640 1 -- 172.21.15.181:0/3396002288 wait complete. 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.804+0000 7fadd254b640 1 Processor -- start 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.804+0000 7fadd254b640 1 -- start start 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadd254b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40039b0 0x7fadcc0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadd254b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadcc0cb0d0 0x7fadcc0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadd254b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadcc0ca630 0x7fadcc09fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadd254b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0b24f0 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadd254b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0b2860 con 0x7fadb40039b0 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadd254b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc0cfe40 con 0x7fadcc0ca630 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadcc0cb0d0 0x7fadcc0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadcc0cb0d0 0x7fadcc0ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60732/0 (socket says 172.21.15.181:60732) 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 -- 172.21.15.181:0/4149037532 learned_addr learned my addr 172.21.15.181:0/4149037532 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcbfff640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40039b0 0x7fadcc0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadd0ae8640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadcc0ca630 0x7fadcc09fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 -- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadcc0ca630 msgr2=0x7fadcc09fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadcc0ca630 0x7fadcc09fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 -- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40039b0 msgr2=0x7fadcc0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40039b0 0x7fadcc0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcb7fe640 1 -- 172.21.15.181:0/4149037532 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0c9050 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.805+0000 7fadcbfff640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40039b0 0x7fadcc0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.806+0000 7fadcb7fe640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadcc0cb0d0 0x7fadcc0ca0f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fadc0004ec0 tx=0x7fadc0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.806+0000 7fadc8ff9640 1 -- 172.21.15.181:0/4149037532 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc000f7b0 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.806+0000 7fadc8ff9640 1 -- 172.21.15.181:0/4149037532 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0018070 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.806+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc0c9330 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.806+0000 7fadc8ff9640 1 -- 172.21.15.181:0/4149037532 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc000fbd0 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.806+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc0c98f0 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.807+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc0b73a0 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.807+0000 7fadc8ff9640 1 -- 172.21.15.181:0/4149037532 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadc001d460 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.808+0000 7fadc8ff9640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadb806be30 0x7fadb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.808+0000 7fadc8ff9640 1 -- 172.21.15.181:0/4149037532 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5967+0+0 (secure 0 0 0) 0x7fadc008ae60 con 0x7fadcc0cb0d0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.808+0000 7fadcbfff640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadb806be30 0x7fadb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:15.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.808+0000 7fadcbfff640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadb806be30 0x7fadb806e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fadbc032000 tx=0x7fadbc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:15.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:15.812+0000 7fadc8ff9640 1 -- 172.21.15.181:0/4149037532 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadc00597a0 con 0x7fadcc0cb0d0 2024-09-12T02:35:16.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.011+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fadcc0ba0e0 con 0x7fadcc0cb0d0 2024-09-12T02:35:16.012 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:35:16.011+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:35:16.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.013+0000 7fadc8ff9640 1 -- 172.21.15.181:0/4149037532 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) ==== 161+0+0 (secure 0 0 0) 0x7fadc00590a0 con 0x7fadcc0cb0d0 2024-09-12T02:35:16.013 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:35:16.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadb806be30 msgr2=0x7fadb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadb806be30 0x7fadb806e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fadbc032000 tx=0x7fadbc009030 comp rx=0 tx=0).stop 2024-09-12T02:35:16.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadcc0cb0d0 msgr2=0x7fadcc0ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadcc0cb0d0 0x7fadcc0ca0f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fadc0004ec0 tx=0x7fadc0007430 comp rx=0 tx=0).stop 2024-09-12T02:35:16.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 shutdown_connections 2024-09-12T02:35:16.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fadb806be30 0x7fadb806e2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fadcc0ca630 0x7fadcc09fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadcc0cb0d0 0x7fadcc0ca0f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 --2- 172.21.15.181:0/4149037532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fadb40039b0 0x7fadcc0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 >> 172.21.15.181:0/4149037532 conn(0x7fadcc09d820 msgr2=0x7fadcc161200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 shutdown_connections 2024-09-12T02:35:16.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.015+0000 7fadd254b640 1 -- 172.21.15.181:0/4149037532 wait complete. 2024-09-12T02:35:16.028 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:35:16.052 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:35:16.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.130+0000 7f1cbae17640 1 Processor -- start 2024-09-12T02:35:16.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.130+0000 7f1cbae17640 1 -- start start 2024-09-12T02:35:16.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cbae17640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 0x7f1cb40d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cbae17640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1cb40b3490 0x7f1cb40cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cbae17640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb40d2790 con 0x7f1cb40b75a0 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cbae17640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb40b6c10 con 0x7f1cb40b3490 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cbae17640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb40d2a70 con 0x7f1cb40cedd0 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cb93b4640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1cb40b75a0 0x7f1cb40d3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:39036/0 (socket says 172.21.15.181:39036) 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cb93b4640 1 -- 172.21.15.181:0/3049135294 learned_addr learned my addr 172.21.15.181:0/3049135294 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cabfff640 1 --2- 172.21.15.181:0/3049135294 >> v2:172.21.15.204:3300/0 conn(0x7f1cb40b3490 0x7f1cb40cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cb8bb3640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 0x7f1cb40d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3140246794 0 0) 0x7f1cb40d2790 con 0x7f1cb40b75a0 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c9c003520 con 0x7f1cb40b75a0 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 378754048 0 0) 0x7f1c9c003520 con 0x7f1cb40b75a0 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 msgr2=0x7f1cb40d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 0x7f1cb40d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 >> v2:172.21.15.204:3300/0 conn(0x7f1cb40b3490 msgr2=0x7f1cb40cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 --2- 172.21.15.181:0/3049135294 >> v2:172.21.15.204:3300/0 conn(0x7f1cb40b3490 0x7f1cb40cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb40d2d50 con 0x7f1cb40b75a0 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.131+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f1cac0019f0 con 0x7f1cb40b75a0 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 >> v1:172.21.15.181:6789/0 conn(0x7f1cb40b75a0 legacy=0x7f1cb40d3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cab7fe640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 0x7f1c9c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cab7fe640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c9c003f30 0x7f1c9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cab7fe640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c004d40 0x7f1c9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40b6c10 con 0x7f1c9c004d40 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40d2a70 con 0x7f1c9c003f30 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c00b9c0 con 0x7f1cb40cedd0 2024-09-12T02:35:16.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cb93b4640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c004d40 0x7f1c9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cb8bb3640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 0x7f1c9c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cabfff640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c9c003f30 0x7f1c9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cb93b4640 1 -- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 msgr2=0x7f1c9c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cb93b4640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1cb40cedd0 0x7f1c9c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cb93b4640 1 -- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c9c003f30 msgr2=0x7f1c9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cb93b4640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c9c003f30 0x7f1c9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.132+0000 7f1cb93b4640 1 -- 172.21.15.181:0/3049135294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c003520 con 0x7f1c9c004d40 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cb93b4640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c004d40 0x7f1c9c0051c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00a920 tx=0x7f1c9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9d2caf495162e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00a4c0 con 0x7f1c9c004d40 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cac02f070 con 0x7f1c9c004d40 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cab7fe640 1 -- 172.21.15.181:0/3049135294 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac02bd40 con 0x7f1c9c004d40 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cbae17640 1 -- 172.21.15.181:0/3049135294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c004d40 msgr2=0x7f1c9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cbae17640 1 --2- 172.21.15.181:0/3049135294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c004d40 0x7f1c9c0051c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00a920 tx=0x7f1c9c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:16.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cb93b4640 1 -- 172.21.15.181:0/3049135294 reap_dead start 2024-09-12T02:35:16.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cbae17640 1 -- 172.21.15.181:0/3049135294 shutdown_connections 2024-09-12T02:35:16.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cbae17640 1 -- 172.21.15.181:0/3049135294 >> 172.21.15.181:0/3049135294 conn(0x7f1cb40d0f40 msgr2=0x7f1cb40d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cbae17640 1 -- 172.21.15.181:0/3049135294 shutdown_connections 2024-09-12T02:35:16.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.133+0000 7f1cbae17640 1 -- 172.21.15.181:0/3049135294 wait complete. 2024-09-12T02:35:16.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.134+0000 7f1cbae17640 1 Processor -- start 2024-09-12T02:35:16.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.135+0000 7f1cbae17640 1 -- start start 2024-09-12T02:35:16.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.135+0000 7f1cbae17640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c9c004d40 0x7f1cb40cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.135+0000 7f1cbae17640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cb40b88b0 0x7f1cb40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.135+0000 7f1cbae17640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cb4158600 0x7f1cb4158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.135+0000 7f1cbae17640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40cf6f0 con 0x7f1cb4158600 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.135+0000 7f1cbae17640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40d3310 con 0x7f1cb40b88b0 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.135+0000 7f1cbae17640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb415e720 con 0x7f1c9c004d40 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cb4158600 0x7f1cb4158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cb4158600 0x7f1cb4158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60766/0 (socket says 172.21.15.181:60766) 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 -- 172.21.15.181:0/4187335659 learned_addr learned my addr 172.21.15.181:0/4187335659 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cabfff640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cb40b88b0 0x7f1cb40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb8bb3640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c9c004d40 0x7f1cb40cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 -- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c9c004d40 msgr2=0x7f1cb40cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c9c004d40 0x7f1cb40cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 -- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cb40b88b0 msgr2=0x7f1cb40ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cb40b88b0 0x7f1cb40ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 -- 172.21.15.181:0/4187335659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb40cc7f0 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cb93b4640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cb4158600 0x7f1cb4158a80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00aa40 tx=0x7f1cb40b7410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1ca97fa640 1 -- 172.21.15.181:0/4187335659 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac044070 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1ca97fa640 1 -- 172.21.15.181:0/4187335659 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cac001a00 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb40ccad0 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1ca97fa640 1 -- 172.21.15.181:0/4187335659 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00a4c0 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.136+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb40cd090 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.137+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb4158fc0 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.138+0000 7f1ca97fa640 1 -- 172.21.15.181:0/4187335659 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cac047070 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.138+0000 7f1ca97fa640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1ca006be60 0x7f1ca006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.138+0000 7f1ca97fa640 1 -- 172.21.15.181:0/4187335659 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6053+0+0 (secure 0 0 0) 0x7f1cac0aaea0 con 0x7f1cb4158600 2024-09-12T02:35:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.138+0000 7f1cb8bb3640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1ca006be60 0x7f1ca006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.139+0000 7f1cb8bb3640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1ca006be60 0x7f1ca006e320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009bc0 tx=0x7f1cb0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.143+0000 7f1ca97fa640 1 -- 172.21.15.181:0/4187335659 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1cac0790d0 con 0x7f1cb4158600 2024-09-12T02:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:16.341+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1cb40b7a50 con 0x7f1cb4158600 2024-09-12T02:35:17.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.014+0000 7f1ca97fa640 1 -- 172.21.15.181:0/4187335659 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) ==== 104+0+0 (secure 0 0 0) 0x7f1cac07d3d0 con 0x7f1cb4158600 2024-09-12T02:35:17.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1ca006be60 msgr2=0x7f1ca006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1ca006be60 0x7f1ca006e320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009bc0 tx=0x7f1cb0009190 comp rx=0 tx=0).stop 2024-09-12T02:35:17.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cb4158600 msgr2=0x7f1cb4158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cb4158600 0x7f1cb4158a80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00aa40 tx=0x7f1cb40b7410 comp rx=0 tx=0).stop 2024-09-12T02:35:17.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 shutdown_connections 2024-09-12T02:35:17.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1ca006be60 0x7f1ca006e320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1cb40b88b0 0x7f1cb40ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cb4158600 0x7f1cb4158a80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 --2- 172.21.15.181:0/4187335659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c9c004d40 0x7f1cb40cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 >> 172.21.15.181:0/4187335659 conn(0x7f1cb40d0f40 msgr2=0x7f1cb40d4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 shutdown_connections 2024-09-12T02:35:17.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.017+0000 7f1cbae17640 1 -- 172.21.15.181:0/4187335659 wait complete. 2024-09-12T02:35:17.032 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:35:17.158 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:17.161 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:17.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.183+0000 7f62d4311640 1 Processor -- start 2024-09-12T02:35:17.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.183+0000 7f62d4311640 1 -- start start 2024-09-12T02:35:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d4311640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62cc0d1b80 0x7f62cc16a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d4311640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f62cc0d1630 0x7f62cc16c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d4311640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62cc0b4cc0 con 0x7f62cc070660 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d4311640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f62cc0742e0 con 0x7f62cc0d1b80 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d4311640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f62cc0b6a90 con 0x7f62cc0d1630 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d18ac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62cc0d1b80 0x7f62cc16a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d18ac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62cc0d1b80 0x7f62cc16a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60778/0 (socket says 172.21.15.181:60778) 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.184+0000 7f62d18ac640 1 -- 172.21.15.181:0/1248958260 learned_addr learned my addr 172.21.15.181:0/1248958260 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.185+0000 7f62d28ae640 1 --2- 172.21.15.181:0/1248958260 >> v2:172.21.15.204:3300/0 conn(0x7f62cc0d1630 0x7f62cc16c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.185+0000 7f62d18ac640 1 -- 172.21.15.181:0/1248958260 >> v2:172.21.15.204:3300/0 conn(0x7f62cc0d1630 msgr2=0x7f62cc16c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.185+0000 7f62d18ac640 1 --2- 172.21.15.181:0/1248958260 >> v2:172.21.15.204:3300/0 conn(0x7f62cc0d1630 0x7f62cc16c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.185+0000 7f62d18ac640 1 -- 172.21.15.181:0/1248958260 >> v1:172.21.15.204:6789/0 conn(0x7f62cc070660 legacy=0x7f62cc070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.185+0000 7f62d18ac640 1 -- 172.21.15.181:0/1248958260 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc0b6d70 con 0x7f62cc0d1b80 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.185+0000 7f62d28ae640 1 --2- 172.21.15.181:0/1248958260 >> v2:172.21.15.204:3300/0 conn(0x7f62cc0d1630 0x7f62cc16c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.185+0000 7f62d18ac640 1 --2- 172.21.15.181:0/1248958260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc16a440 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f62cc072f10 tx=0x7f62c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f9c47e17c19643 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d10ab640 1 -- 172.21.15.181:0/1248958260 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8037070 con 0x7f62cc0d1b80 2024-09-12T02:35:17.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d10ab640 1 -- 172.21.15.181:0/1248958260 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c8032440 con 0x7f62cc0d1b80 2024-09-12T02:35:17.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d10ab640 1 -- 172.21.15.181:0/1248958260 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8032810 con 0x7f62cc0d1b80 2024-09-12T02:35:17.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 -- 172.21.15.181:0/1248958260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 msgr2=0x7f62cc16a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 --2- 172.21.15.181:0/1248958260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc16a440 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f62cc072f10 tx=0x7f62c802a270 comp rx=0 tx=0).stop 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 -- 172.21.15.181:0/1248958260 shutdown_connections 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 --2- 172.21.15.181:0/1248958260 >> v2:172.21.15.204:3300/0 conn(0x7f62cc0d1630 0x7f62cc16c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 --2- 172.21.15.181:0/1248958260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc16a440 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 -- 172.21.15.181:0/1248958260 >> 172.21.15.181:0/1248958260 conn(0x7f62cc0b4020 msgr2=0x7f62cc0b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 -- 172.21.15.181:0/1248958260 shutdown_connections 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.186+0000 7f62d4311640 1 -- 172.21.15.181:0/1248958260 wait complete. 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.187+0000 7f62d4311640 1 Processor -- start 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d4311640 1 -- start start 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d4311640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62cc070660 0x7f62cc151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d4311640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62cc0d1630 0x7f62cc1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d4311640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d4311640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc16ced0 con 0x7f62cc0d1b80 2024-09-12T02:35:17.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d4311640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc0b7570 con 0x7f62cc070660 2024-09-12T02:35:17.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d4311640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f62cc16d050 con 0x7f62cc0d1630 2024-09-12T02:35:17.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d28ae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d28ae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc161820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60784/0 (socket says 172.21.15.181:60784) 2024-09-12T02:35:17.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d28ae640 1 -- 172.21.15.181:0/1931435753 learned_addr learned my addr 172.21.15.181:0/1931435753 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:17.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d20ad640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62cc070660 0x7f62cc151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.188+0000 7f62d18ac640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62cc0d1630 0x7f62cc1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d28ae640 1 -- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62cc0d1630 msgr2=0x7f62cc1612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d28ae640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62cc0d1630 0x7f62cc1612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d28ae640 1 -- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62cc070660 msgr2=0x7f62cc151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d28ae640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62cc070660 0x7f62cc151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d28ae640 1 -- 172.21.15.181:0/1931435753 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc15fdc0 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d28ae640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc161820 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f62c4007df0 tx=0x7f62c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62c2ffd640 1 -- 172.21.15.181:0/1931435753 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c401a070 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62c2ffd640 1 -- 172.21.15.181:0/1931435753 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c4003990 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc1600a0 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62c2ffd640 1 -- 172.21.15.181:0/1931435753 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4003d80 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.189+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc160660 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.190+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc070a40 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.191+0000 7f62c2ffd640 1 -- 172.21.15.181:0/1931435753 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62c401d070 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.191+0000 7f62c2ffd640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f62b006be30 0x7f62b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.191+0000 7f62c2ffd640 1 -- 172.21.15.181:0/1931435753 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6053+0+0 (secure 0 0 0) 0x7f62c408b250 con 0x7f62cc0d1b80 2024-09-12T02:35:17.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.191+0000 7f62d20ad640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f62b006be30 0x7f62b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:17.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.191+0000 7f62d20ad640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f62b006be30 0x7f62b006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0016e0 tx=0x7f62bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:17.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.195+0000 7f62c2ffd640 1 -- 172.21.15.181:0/1931435753 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62c4010070 con 0x7f62cc0d1b80 2024-09-12T02:35:17.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:17.363+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f62cc0d13c0 con 0x7f62cc0d1b80 2024-09-12T02:35:18.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.369+0000 7f62c2ffd640 1 -- 172.21.15.181:0/1931435753 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) ==== 181+0+0 (secure 0 0 0) 0x7f62c40593c0 con 0x7f62cc0d1b80 2024-09-12T02:35:18.370 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:35:18.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.372+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f62b006be30 msgr2=0x7f62b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.372+0000 7f62d4311640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f62b006be30 0x7f62b006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0016e0 tx=0x7f62bc009040 comp rx=0 tx=0).stop 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.372+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 msgr2=0x7f62cc161820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.372+0000 7f62d4311640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc161820 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f62c4007df0 tx=0x7f62c400d4a0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 shutdown_connections 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f62b006be30 0x7f62b006e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62cc0d1b80 0x7f62cc161820 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62cc0d1630 0x7f62cc1612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 --2- 172.21.15.181:0/1931435753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f62cc070660 0x7f62cc151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 >> 172.21.15.181:0/1931435753 conn(0x7f62cc0b4020 msgr2=0x7f62cc06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 shutdown_connections 2024-09-12T02:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.373+0000 7f62d4311640 1 -- 172.21.15.181:0/1931435753 wait complete. 2024-09-12T02:35:18.388 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:35:18.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.496+0000 7f0eddbf6640 1 Processor -- start 2024-09-12T02:35:18.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.496+0000 7f0eddbf6640 1 -- start start 2024-09-12T02:35:18.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0eddbf6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed80ce690 0x7f0ed806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0eddbf6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0ed80d0830 0x7f0ed8072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0eddbf6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed815d930 con 0x7f0ed815c540 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0eddbf6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed8073580 con 0x7f0ed80d0830 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0eddbf6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed80cfd50 con 0x7f0ed80ce690 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0ed7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0ed80d0830 0x7f0ed8072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0ed77fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0ed815c540 0x7f0ed80cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:39038/0 (socket says 172.21.15.181:39038) 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.497+0000 7f0ed77fe640 1 -- 172.21.15.181:0/3520205396 learned_addr learned my addr 172.21.15.181:0/3520205396 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed6ffd640 1 --2- 172.21.15.181:0/3520205396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed80ce690 0x7f0ed806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed7fff640 1 -- 172.21.15.181:0/3520205396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed80ce690 msgr2=0x7f0ed806d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed7fff640 1 --2- 172.21.15.181:0/3520205396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed80ce690 0x7f0ed806d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed7fff640 1 -- 172.21.15.181:0/3520205396 >> v1:172.21.15.181:6789/0 conn(0x7f0ed815c540 legacy=0x7f0ed80cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed67fc640 1 -- 172.21.15.181:0/3520205396 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202391517 0 0) 0x7f0ec8001110 con 0x7f0ed815c540 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed7fff640 1 -- 172.21.15.181:0/3520205396 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed80d0030 con 0x7f0ed80d0830 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed6ffd640 1 --2- 172.21.15.181:0/3520205396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed80ce690 0x7f0ed806d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed7fff640 1 --2- 172.21.15.181:0/3520205396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8072190 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009d90 tx=0x7f0ed002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cb664d4e279e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed67fc640 1 -- 172.21.15.181:0/3520205396 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0007740 con 0x7f0ed80d0830 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed67fc640 1 -- 172.21.15.181:0/3520205396 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed00078e0 con 0x7f0ed80d0830 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.498+0000 7f0ed67fc640 1 -- 172.21.15.181:0/3520205396 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0007cb0 con 0x7f0ed80d0830 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 -- 172.21.15.181:0/3520205396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 msgr2=0x7f0ed8072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/3520205396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8072190 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009d90 tx=0x7f0ed002a660 comp rx=0 tx=0).stop 2024-09-12T02:35:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 -- 172.21.15.181:0/3520205396 shutdown_connections 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/3520205396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8072190 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/3520205396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed80ce690 0x7f0ed806d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 -- 172.21.15.181:0/3520205396 >> 172.21.15.181:0/3520205396 conn(0x7f0ed806bc10 msgr2=0x7f0ed806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 -- 172.21.15.181:0/3520205396 shutdown_connections 2024-09-12T02:35:18.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.499+0000 7f0eddbf6640 1 -- 172.21.15.181:0/3520205396 wait complete. 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.500+0000 7f0eddbf6640 1 Processor -- start 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.500+0000 7f0eddbf6640 1 -- start start 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0eddbf6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ed80ce690 0x7f0ed8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0eddbf6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0eddbf6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed815c540 0x7f0ed8156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0eddbf6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed806dd50 con 0x7f0ed80d0830 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0eddbf6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed806dbd0 con 0x7f0ed80ce690 2024-09-12T02:35:18.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0eddbf6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed806ded0 con 0x7f0ed815c540 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60792/0 (socket says 172.21.15.181:60792) 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 -- 172.21.15.181:0/2465391281 learned_addr learned my addr 172.21.15.181:0/2465391281 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed7fff640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed815c540 0x7f0ed8156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed77fe640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ed80ce690 0x7f0ed8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 -- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed815c540 msgr2=0x7f0ed8156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed815c540 0x7f0ed8156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 -- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ed80ce690 msgr2=0x7f0ed8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ed80ce690 0x7f0ed8155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed6ffd640 1 -- 172.21.15.181:0/2465391281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed81e7990 con 0x7f0ed80d0830 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.501+0000 7f0ed77fe640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ed80ce690 0x7f0ed8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.502+0000 7f0ed6ffd640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8156430 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00c7f0 tx=0x7f0ecc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.502+0000 7f0ebffff640 1 -- 172.21.15.181:0/2465391281 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc015070 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.502+0000 7f0ebffff640 1 -- 172.21.15.181:0/2465391281 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ecc007820 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.502+0000 7f0ebffff640 1 -- 172.21.15.181:0/2465391281 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc007bd0 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.502+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed81f25a0 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.502+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed8156140 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.503+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed8069170 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.503+0000 7f0ebffff640 1 -- 172.21.15.181:0/2465391281 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ecc018070 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.504+0000 7f0ebffff640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ec406be30 0x7f0ec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.504+0000 7f0ed77fe640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ec406be30 0x7f0ec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.504+0000 7f0ebffff640 1 -- 172.21.15.181:0/2465391281 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5615+0+0 (secure 0 0 0) 0x7f0ecc08af70 con 0x7f0ed80d0830 2024-09-12T02:35:18.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.504+0000 7f0ed77fe640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ec406be30 0x7f0ec406e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80013b0 tx=0x7f0ec8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.508+0000 7f0ebffff640 1 -- 172.21.15.181:0/2465391281 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ecc059980 con 0x7f0ed80d0830 2024-09-12T02:35:18.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:18.675+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0ed8050090 con 0x7f0ed80d0830 2024-09-12T02:35:19.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.370+0000 7f0ebffff640 1 -- 172.21.15.181:0/2465391281 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) ==== 169+0+0 (secure 0 0 0) 0x7f0ed8050090 con 0x7f0ed80d0830 2024-09-12T02:35:19.371 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' removed 2024-09-12T02:35:19.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ec406be30 msgr2=0x7f0ec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ec406be30 0x7f0ec406e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80013b0 tx=0x7f0ec8009040 comp rx=0 tx=0).stop 2024-09-12T02:35:19.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 msgr2=0x7f0ed8156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8156430 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00c7f0 tx=0x7f0ecc00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 shutdown_connections 2024-09-12T02:35:19.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ec406be30 0x7f0ec406e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ed815c540 0x7f0ed8156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ed80d0830 0x7f0ed8156430 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 --2- 172.21.15.181:0/2465391281 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ed80ce690 0x7f0ed8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 >> 172.21.15.181:0/2465391281 conn(0x7f0ed806bc10 msgr2=0x7f0ed806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 shutdown_connections 2024-09-12T02:35:19.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.373+0000 7f0eddbf6640 1 -- 172.21.15.181:0/2465391281 wait complete. 2024-09-12T02:35:19.386 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:35:19.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.505+0000 7fd80bf6d640 1 Processor -- start 2024-09-12T02:35:19.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.505+0000 7fd80bf6d640 1 -- start start 2024-09-12T02:35:19.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd80bf6d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8040b50a0 0x7fd8040ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd80bf6d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd80415edf0 0x7fd80415f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd80bf6d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd80415f9d0 con 0x7fd80415b2e0 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd80bf6d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd804073fe0 con 0x7fd8040b50a0 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd80bf6d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd804071060 con 0x7fd80415edf0 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd809508640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8040b50a0 0x7fd8040ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd809d09640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd80415b2e0 0x7fd8040b4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55544/0 (socket says 172.21.15.181:55544) 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.506+0000 7fd809d09640 1 -- 172.21.15.181:0/2037187417 learned_addr learned my addr 172.21.15.181:0/2037187417 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.507+0000 7fd80a50a640 1 --2- 172.21.15.181:0/2037187417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd80415edf0 0x7fd80415f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.507+0000 7fd809508640 1 -- 172.21.15.181:0/2037187417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd80415edf0 msgr2=0x7fd80415f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.507+0000 7fd809508640 1 --2- 172.21.15.181:0/2037187417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd80415edf0 0x7fd80415f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.507+0000 7fd809508640 1 -- 172.21.15.181:0/2037187417 >> v1:172.21.15.181:6789/0 conn(0x7fd80415b2e0 legacy=0x7fd8040b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.507+0000 7fd809508640 1 -- 172.21.15.181:0/2037187417 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80415fcb0 con 0x7fd8040b50a0 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.507+0000 7fd808d07640 1 -- 172.21.15.181:0/2037187417 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511223136 0 0) 0x7fd80415f9d0 con 0x7fd80415b2e0 2024-09-12T02:35:19.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.507+0000 7fd809508640 1 --2- 172.21.15.181:0/2037187417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8040b50a0 0x7fd8040ce980 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40097a0 tx=0x7fd7f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c53767d460d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd808d07640 1 -- 172.21.15.181:0/2037187417 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4037070 con 0x7fd8040b50a0 2024-09-12T02:35:19.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd808d07640 1 -- 172.21.15.181:0/2037187417 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f4032440 con 0x7fd8040b50a0 2024-09-12T02:35:19.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd808d07640 1 -- 172.21.15.181:0/2037187417 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4032810 con 0x7fd8040b50a0 2024-09-12T02:35:19.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2037187417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8040b50a0 msgr2=0x7fd8040ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2037187417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8040b50a0 0x7fd8040ce980 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40097a0 tx=0x7fd7f402a210 comp rx=0 tx=0).stop 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2037187417 shutdown_connections 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2037187417 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd80415edf0 0x7fd80415f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2037187417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8040b50a0 0x7fd8040ce980 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2037187417 >> 172.21.15.181:0/2037187417 conn(0x7fd80406bc10 msgr2=0x7fd80406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2037187417 shutdown_connections 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.508+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2037187417 wait complete. 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.509+0000 7fd80bf6d640 1 Processor -- start 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.509+0000 7fd80bf6d640 1 -- start start 2024-09-12T02:35:19.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80bf6d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8040b50a0 0x7fd804146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80bf6d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd80415b2e0 0x7fd804072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80bf6d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80415edf0 0x7fd804073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80bf6d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd8040ce4f0 con 0x7fd80415edf0 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80bf6d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd80415b6c0 con 0x7fd80415b2e0 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80bf6d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8040ce180 con 0x7fd8040b50a0 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80a50a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80415edf0 0x7fd804073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80a50a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80415edf0 0x7fd804073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60936/0 (socket says 172.21.15.181:60936) 2024-09-12T02:35:19.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd80a50a640 1 -- 172.21.15.181:0/2801854676 learned_addr learned my addr 172.21.15.181:0/2801854676 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd809d09640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8040b50a0 0x7fd804146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.510+0000 7fd809508640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd80415b2e0 0x7fd804072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80a50a640 1 -- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8040b50a0 msgr2=0x7fd804146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80a50a640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8040b50a0 0x7fd804146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80a50a640 1 -- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd80415b2e0 msgr2=0x7fd804072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80a50a640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd80415b2e0 0x7fd804072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80a50a640 1 -- 172.21.15.181:0/2801854676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd804158200 con 0x7fd80415edf0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80a50a640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80415edf0 0x7fd804073390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00d830 tx=0x7fd7fc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd7fa7fc640 1 -- 172.21.15.181:0/2801854676 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00b6c0 con 0x7fd80415edf0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd7fa7fc640 1 -- 172.21.15.181:0/2801854676 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc019070 con 0x7fd80415edf0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8041584a0 con 0x7fd80415edf0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd7fa7fc640 1 -- 172.21.15.181:0/2801854676 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00bac0 con 0x7fd80415edf0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.511+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd804158a60 con 0x7fd80415edf0 2024-09-12T02:35:19.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.512+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd804069170 con 0x7fd80415edf0 2024-09-12T02:35:19.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.512+0000 7fd7fa7fc640 1 -- 172.21.15.181:0/2801854676 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7fc00bc60 con 0x7fd80415edf0 2024-09-12T02:35:19.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.513+0000 7fd7fa7fc640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd7e806be30 0x7fd7e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.513+0000 7fd7fa7fc640 1 -- 172.21.15.181:0/2801854676 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7fd7fc08b0f0 con 0x7fd80415edf0 2024-09-12T02:35:19.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.513+0000 7fd809d09640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd7e806be30 0x7fd7e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.513+0000 7fd809d09640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd7e806be30 0x7fd7e806e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd8000012e0 tx=0x7fd800007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.517+0000 7fd7fa7fc640 1 -- 172.21.15.181:0/2801854676 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7fc059c90 con 0x7fd80415edf0 2024-09-12T02:35:19.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.683+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd8040b4de0 con 0x7fd80415edf0 2024-09-12T02:35:19.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.686+0000 7fd7fa7fc640 1 -- 172.21.15.181:0/2801854676 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fd8040b4de0 con 0x7fd80415edf0 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.688+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd7e806be30 msgr2=0x7fd7e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.688+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd7e806be30 0x7fd7e806e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd8000012e0 tx=0x7fd800007ed0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.688+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80415edf0 msgr2=0x7fd804073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.688+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80415edf0 0x7fd804073390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00d830 tx=0x7fd7fc00dcf0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 shutdown_connections 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd7e806be30 0x7fd7e806e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd80415b2e0 0x7fd804072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80415edf0 0x7fd804073390 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 --2- 172.21.15.181:0/2801854676 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8040b50a0 0x7fd804146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 >> 172.21.15.181:0/2801854676 conn(0x7fd80406bc10 msgr2=0x7fd80406dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 shutdown_connections 2024-09-12T02:35:19.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.689+0000 7fd80bf6d640 1 -- 172.21.15.181:0/2801854676 wait complete. 2024-09-12T02:35:19.700 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset' 2024-09-12T02:35:19.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.798+0000 7f781f73b640 1 Processor -- start 2024-09-12T02:35:19.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.799+0000 7f781f73b640 1 -- start start 2024-09-12T02:35:19.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.799+0000 7f781f73b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f781815e640 0x7f78180ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.799+0000 7f781f73b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180cf0e0 0x7f78180cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781f73b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78180b2cf0 0x7f78180b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781f73b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f78180b2860 con 0x7f781815e640 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781f73b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f781815ea20 con 0x7f78180b2cf0 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781f73b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78180b1c50 con 0x7f78180cf0e0 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f781815e640 0x7f78180ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f781815e640 0x7f78180ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60950/0 (socket says 172.21.15.181:60950) 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 -- 172.21.15.181:0/1552700893 learned_addr learned my addr 172.21.15.181:0/1552700893 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:19.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 -- 172.21.15.181:0/1552700893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180cf0e0 msgr2=0x7f78180cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781ccd6640 1 --2- 172.21.15.181:0/1552700893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180cf0e0 0x7f78180cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 --2- 172.21.15.181:0/1552700893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180cf0e0 0x7f78180cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781dcd8640 1 --2- 172.21.15.181:0/1552700893 >> v2:172.21.15.204:3300/0 conn(0x7f78180b2cf0 0x7f78180b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 -- 172.21.15.181:0/1552700893 >> v2:172.21.15.204:3300/0 conn(0x7f78180b2cf0 msgr2=0x7f78180b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 --2- 172.21.15.181:0/1552700893 >> v2:172.21.15.204:3300/0 conn(0x7f78180b2cf0 0x7f78180b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781d4d7640 1 -- 172.21.15.181:0/1552700893 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78180b1f30 con 0x7f781815e640 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781ccd6640 1 --2- 172.21.15.181:0/1552700893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180cf0e0 0x7f78180cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.800+0000 7f781dcd8640 1 --2- 172.21.15.181:0/1552700893 >> v2:172.21.15.204:3300/0 conn(0x7f78180b2cf0 0x7f78180b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781d4d7640 1 --2- 172.21.15.181:0/1552700893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180ceba0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f781808ed40 tx=0x7f781002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eeace895791daad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f7817fff640 1 -- 172.21.15.181:0/1552700893 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810037070 con 0x7f781815e640 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f7817fff640 1 -- 172.21.15.181:0/1552700893 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7810032440 con 0x7f781815e640 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f7817fff640 1 -- 172.21.15.181:0/1552700893 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810032810 con 0x7f781815e640 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781f73b640 1 -- 172.21.15.181:0/1552700893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 msgr2=0x7f78180ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781f73b640 1 --2- 172.21.15.181:0/1552700893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180ceba0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f781808ed40 tx=0x7f781002a140 comp rx=0 tx=0).stop 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781f73b640 1 -- 172.21.15.181:0/1552700893 shutdown_connections 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781f73b640 1 --2- 172.21.15.181:0/1552700893 >> v2:172.21.15.204:3300/0 conn(0x7f78180b2cf0 0x7f78180b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781f73b640 1 --2- 172.21.15.181:0/1552700893 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180cf0e0 0x7f78180cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781f73b640 1 --2- 172.21.15.181:0/1552700893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180ceba0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.801+0000 7f781f73b640 1 -- 172.21.15.181:0/1552700893 >> 172.21.15.181:0/1552700893 conn(0x7f781809d820 msgr2=0x7f78180d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:19.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.802+0000 7f781f73b640 1 -- 172.21.15.181:0/1552700893 shutdown_connections 2024-09-12T02:35:19.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.802+0000 7f781f73b640 1 -- 172.21.15.181:0/1552700893 wait complete. 2024-09-12T02:35:19.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 Processor -- start 2024-09-12T02:35:19.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 -- start start 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180b2cf0 0x7f7818158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78180cf0e0 0x7f78180cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f78180cfe40 con 0x7f781815e640 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f78180b24f0 con 0x7f78180cf0e0 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781f73b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78180b73a0 con 0x7f78180b2cf0 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.803+0000 7f781dcd8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60956/0 (socket says 172.21.15.181:60956) 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 -- 172.21.15.181:0/798545684 learned_addr learned my addr 172.21.15.181:0/798545684 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781d4d7640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180b2cf0 0x7f7818158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781ccd6640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78180cf0e0 0x7f78180cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 -- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180b2cf0 msgr2=0x7f7818158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180b2cf0 0x7f7818158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 -- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78180cf0e0 msgr2=0x7f78180cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78180cf0e0 0x7f78180cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 -- 172.21.15.181:0/798545684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78181613d0 con 0x7f781815e640 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781dcd8640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180b5ab0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f780800cd10 tx=0x7f780800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f7815ffb640 1 -- 172.21.15.181:0/798545684 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780800f680 con 0x7f781815e640 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f7815ffb640 1 -- 172.21.15.181:0/798545684 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780800f840 con 0x7f781815e640 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7818160b30 con 0x7f781815e640 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f7815ffb640 1 -- 172.21.15.181:0/798545684 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780800fc30 con 0x7f781815e640 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.804+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78181610f0 con 0x7f781815e640 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.805+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7818068eb0 con 0x7f781815e640 2024-09-12T02:35:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.806+0000 7f7815ffb640 1 -- 172.21.15.181:0/798545684 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78080213f0 con 0x7f781815e640 2024-09-12T02:35:19.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.806+0000 7f7815ffb640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f780006be60 0x7f780006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:19.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.806+0000 7f7815ffb640 1 -- 172.21.15.181:0/798545684 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7f780808b830 con 0x7f781815e640 2024-09-12T02:35:19.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.806+0000 7f781d4d7640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f780006be60 0x7f780006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:19.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.807+0000 7f781d4d7640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f780006be60 0x7f780006e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7810034000 tx=0x7f781002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:19.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:19.811+0000 7f7815ffb640 1 -- 172.21.15.181:0/798545684 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7808014030 con 0x7f781815e640 2024-09-12T02:35:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.041+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]} v 0) -- 0x7f781806bf50 con 0x7f781815e640 2024-09-12T02:35:20.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.376+0000 7f7815ffb640 1 -- 172.21.15.181:0/798545684 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]}]=0 v297) ==== 140+0+0 (secure 0 0 0) 0x7f7808059d80 con 0x7f781815e640 2024-09-12T02:35:20.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f780006be60 msgr2=0x7f780006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f780006be60 0x7f780006e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7810034000 tx=0x7f781002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:20.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 msgr2=0x7f78180b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180b5ab0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f780800cd10 tx=0x7f780800a650 comp rx=0 tx=0).stop 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 shutdown_connections 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f780006be60 0x7f780006e320 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78180cf0e0 0x7f78180cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f781815e640 0x7f78180b5ab0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 --2- 172.21.15.181:0/798545684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78180b2cf0 0x7f7818158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 >> 172.21.15.181:0/798545684 conn(0x7f781809d820 msgr2=0x7f78180cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 shutdown_connections 2024-09-12T02:35:20.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.378+0000 7f781f73b640 1 -- 172.21.15.181:0/798545684 wait complete. 2024-09-12T02:35:20.391 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into ... ok 2024-09-12T02:35:20.391 INFO:tasks.cephfs_test_runner:Starting test: test_table_tool (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-12T02:35:20.391 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.490+0000 7fdce5b0a640 1 Processor -- start 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.490+0000 7fdce5b0a640 1 -- start start 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.490+0000 7fdce5b0a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdce015e640 0x7fdce00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.490+0000 7fdce5b0a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce015ea20 con 0x7fdce00d3660 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.490+0000 7fdce5b0a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce00b1c50 con 0x7fdce00cf0e0 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.490+0000 7fdce5b0a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdce00b2860 con 0x7fdce015e640 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcdf7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdce015e640 0x7fdce00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcdf7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdce015e640 0x7fdce00ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60972/0 (socket says 172.21.15.181:60972) 2024-09-12T02:35:20.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcdffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdce00d3660 0x7fdce00b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55548/0 (socket says 172.21.15.181:55548) 2024-09-12T02:35:20.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcdf7fe640 1 -- 172.21.15.181:0/2056110274 learned_addr learned my addr 172.21.15.181:0/2056110274 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:20.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcdf7fe640 1 -- 172.21.15.181:0/2056110274 >> v1:172.21.15.204:6789/0 conn(0x7fdce00cf0e0 legacy=0x7fdce00b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcdf7fe640 1 -- 172.21.15.181:0/2056110274 >> v1:172.21.15.181:6789/0 conn(0x7fdce00d3660 legacy=0x7fdce00b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcdf7fe640 1 -- 172.21.15.181:0/2056110274 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce00b1f30 con 0x7fdce015e640 2024-09-12T02:35:20.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.491+0000 7fdcde7fc640 1 -- 172.21.15.181:0/2056110274 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161955777 0 0) 0x7fdce015ea20 con 0x7fdce00d3660 2024-09-12T02:35:20.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdcdf7fe640 1 --2- 172.21.15.181:0/2056110274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce015e640 0x7fdce00ceba0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009870 tx=0x7fdcd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e0c6abb0a697d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdcde7fc640 1 -- 172.21.15.181:0/2056110274 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0037070 con 0x7fdce015e640 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdcde7fc640 1 -- 172.21.15.181:0/2056110274 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd0032440 con 0x7fdce015e640 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdcde7fc640 1 -- 172.21.15.181:0/2056110274 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0032810 con 0x7fdce015e640 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdce5b0a640 1 -- 172.21.15.181:0/2056110274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce015e640 msgr2=0x7fdce00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/2056110274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce015e640 0x7fdce00ceba0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009870 tx=0x7fdcd002a270 comp rx=0 tx=0).stop 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdce5b0a640 1 -- 172.21.15.181:0/2056110274 shutdown_connections 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/2056110274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce015e640 0x7fdce00ceba0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdce5b0a640 1 -- 172.21.15.181:0/2056110274 >> 172.21.15.181:0/2056110274 conn(0x7fdce009d820 msgr2=0x7fdce00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdce5b0a640 1 -- 172.21.15.181:0/2056110274 shutdown_connections 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.492+0000 7fdce5b0a640 1 -- 172.21.15.181:0/2056110274 wait complete. 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.493+0000 7fdce5b0a640 1 Processor -- start 2024-09-12T02:35:20.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdce5b0a640 1 -- start start 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdce5b0a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00cf0e0 0x7fdce0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdce5b0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce00d3660 0x7fdce014a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdce5b0a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce015e640 0x7fdce0160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdce5b0a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdce00cfe40 con 0x7fdce00d3660 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdce5b0a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdce00b24f0 con 0x7fdce015e640 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdce5b0a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdce00b73a0 con 0x7fdce00cf0e0 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdcdeffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce00d3660 0x7fdce014a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdcdeffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce00d3660 0x7fdce014a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60978/0 (socket says 172.21.15.181:60978) 2024-09-12T02:35:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.494+0000 7fdcdeffd640 1 -- 172.21.15.181:0/1166249858 learned_addr learned my addr 172.21.15.181:0/1166249858 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdf7fe640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00cf0e0 0x7fdce0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdffff640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce015e640 0x7fdce0160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdeffd640 1 -- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00cf0e0 msgr2=0x7fdce0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdeffd640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00cf0e0 0x7fdce0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdeffd640 1 -- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce015e640 msgr2=0x7fdce0160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdeffd640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce015e640 0x7fdce0160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdeffd640 1 -- 172.21.15.181:0/1166249858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce01f3e60 con 0x7fdce00d3660 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdffff640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce015e640 0x7fdce0160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcdeffd640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce00d3660 0x7fdce014a9b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400c400 tx=0x7fdcd400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcc7fff640 1 -- 172.21.15.181:0/1166249858 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4017070 con 0x7fdce00d3660 2024-09-12T02:35:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcc7fff640 1 -- 172.21.15.181:0/1166249858 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40052d0 con 0x7fdce00d3660 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdcc7fff640 1 -- 172.21.15.181:0/1166249858 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4003830 con 0x7fdce00d3660 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce014b100 con 0x7fdce00d3660 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.495+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce014b6c0 con 0x7fdce00d3660 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.496+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce0068eb0 con 0x7fdce00d3660 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.497+0000 7fdcc7fff640 1 -- 172.21.15.181:0/1166249858 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcd401a070 con 0x7fdce00d3660 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.497+0000 7fdcc7fff640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdccc06be60 0x7fdccc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.497+0000 7fdcc7fff640 1 -- 172.21.15.181:0/1166249858 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7fdcd4089f10 con 0x7fdce00d3660 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.497+0000 7fdcdf7fe640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdccc06be60 0x7fdccc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.498+0000 7fdcdf7fe640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdccc06be60 0x7fdccc06e320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0034000 tx=0x7fdcd002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.501+0000 7fdcc7fff640 1 -- 172.21.15.181:0/1166249858 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdcd4058460 con 0x7fdce00d3660 2024-09-12T02:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.668+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdce00ceba0 con 0x7fdce00d3660 2024-09-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.669+0000 7fdcc7fff640 1 -- 172.21.15.181:0/1166249858 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+13500 (secure 0 0 0) 0x7fdcd405c760 con 0x7fdce00d3660 2024-09-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":66,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:19.370017+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6836/844285681":"2024-09-13T02:35:16.012459+0000","172.21.15.181:6834/844285681":"2024-09-13T02:35:16.012459+0000","172.21.15.204:6833/2402478751":"2024-09-13T02:35:04.268262+0000","172.21.15.181:6837/2505607206":"2024-09-13T02:35:03.302339+0000","172.21.15.204:6835/2402478751":"2024-09-13T02:35:04.268262+0000","172.21.15.181:6835/2505607206":"2024-09-13T02:35:03.302339+0000","172.21.15.204:6834/1808682347":"2024-09-13T02:34:01.159031+0000","172.21.15.204:6832/1808682347":"2024-09-13T02:34:01.159031+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdccc06be60 msgr2=0x7fdccc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdccc06be60 0x7fdccc06e320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0034000 tx=0x7fdcd002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce00d3660 msgr2=0x7fdce014a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce00d3660 0x7fdce014a9b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400c400 tx=0x7fdcd400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 shutdown_connections 2024-09-12T02:35:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdccc06be60 0x7fdccc06e320 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce015e640 0x7fdce0160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce00d3660 0x7fdce014a9b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 --2- 172.21.15.181:0/1166249858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00cf0e0 0x7fdce0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 >> 172.21.15.181:0/1166249858 conn(0x7fdce009d820 msgr2=0x7fdce006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 shutdown_connections 2024-09-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.671+0000 7fdce5b0a640 1 -- 172.21.15.181:0/1166249858 wait complete. 2024-09-12T02:35:20.683 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:28:11.641634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:35:20.683 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:35:20.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.785+0000 7f9456a1e640 1 Processor -- start 2024-09-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.785+0000 7f9456a1e640 1 -- start start 2024-09-12T02:35:20.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.785+0000 7f9456a1e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f94500b3490 0x7f94500d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.785+0000 7f9456a1e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94500b75a0 0x7f94500d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.785+0000 7f9456a1e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94500d2790 con 0x7f94500cedd0 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.785+0000 7f9456a1e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f94500b6c10 con 0x7f94500b75a0 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.785+0000 7f9456a1e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f94500d2a70 con 0x7f94500b3490 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9454fbb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94500b75a0 0x7f94500d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9454fbb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94500b75a0 0x7f94500d3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:60994/0 (socket says 172.21.15.181:60994) 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9454fbb640 1 -- 172.21.15.181:0/930503663 learned_addr learned my addr 172.21.15.181:0/930503663 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9447fff640 1 --2- 172.21.15.181:0/930503663 >> v2:172.21.15.204:3300/0 conn(0x7f94500b3490 0x7f94500d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9454fbb640 1 -- 172.21.15.181:0/930503663 >> v2:172.21.15.204:3300/0 conn(0x7f94500b3490 msgr2=0x7f94500d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9454fbb640 1 --2- 172.21.15.181:0/930503663 >> v2:172.21.15.204:3300/0 conn(0x7f94500b3490 0x7f94500d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9454fbb640 1 -- 172.21.15.181:0/930503663 >> v1:172.21.15.204:6789/0 conn(0x7f94500cedd0 legacy=0x7f94500cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9454fbb640 1 -- 172.21.15.181:0/930503663 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94500d2d50 con 0x7f94500b75a0 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.786+0000 7f9447fff640 1 --2- 172.21.15.181:0/930503663 >> v2:172.21.15.204:3300/0 conn(0x7f94500b3490 0x7f94500d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9454fbb640 1 --2- 172.21.15.181:0/930503663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500d3830 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f94500ba240 tx=0x7f944802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af019d19e9de7838 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f944f7fe640 1 -- 172.21.15.181:0/930503663 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448036070 con 0x7f94500b75a0 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f944f7fe640 1 -- 172.21.15.181:0/930503663 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9448031600 con 0x7f94500b75a0 2024-09-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f944f7fe640 1 -- 172.21.15.181:0/930503663 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94480319d0 con 0x7f94500b75a0 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 -- 172.21.15.181:0/930503663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 msgr2=0x7f94500d3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 --2- 172.21.15.181:0/930503663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500d3830 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f94500ba240 tx=0x7f944802a660 comp rx=0 tx=0).stop 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 -- 172.21.15.181:0/930503663 shutdown_connections 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 --2- 172.21.15.181:0/930503663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500d3830 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 --2- 172.21.15.181:0/930503663 >> v2:172.21.15.204:3300/0 conn(0x7f94500b3490 0x7f94500d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 -- 172.21.15.181:0/930503663 >> 172.21.15.181:0/930503663 conn(0x7f94500d0f40 msgr2=0x7f94500d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 -- 172.21.15.181:0/930503663 shutdown_connections 2024-09-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.787+0000 7f9456a1e640 1 -- 172.21.15.181:0/930503663 wait complete. 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 Processor -- start 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 -- start start 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94500b3490 0x7f94500cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94500cedd0 0x7f945014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f945015e720 con 0x7f94500b75a0 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f94500d3310 con 0x7f94500b3490 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9456a1e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f945015e8a0 con 0x7f94500cedd0 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9447fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9447fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32774/0 (socket says 172.21.15.181:32774) 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.789+0000 7f9447fff640 1 -- 172.21.15.181:0/3018603655 learned_addr learned my addr 172.21.15.181:0/3018603655 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9454fbb640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94500cedd0 0x7f945014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f944ffff640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94500b3490 0x7f94500cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9447fff640 1 -- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94500cedd0 msgr2=0x7f945014c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9447fff640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94500cedd0 0x7f945014c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9447fff640 1 -- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94500b3490 msgr2=0x7f94500cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9447fff640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94500b3490 0x7f94500cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9447fff640 1 -- 172.21.15.181:0/3018603655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94500cb730 con 0x7f94500b75a0 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9447fff640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500cd4e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f943800c7f0 tx=0x7f943800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f944d7fa640 1 -- 172.21.15.181:0/3018603655 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438015070 con 0x7f94500b75a0 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f944d7fa640 1 -- 172.21.15.181:0/3018603655 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9438007a30 con 0x7f94500b75a0 2024-09-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f944d7fa640 1 -- 172.21.15.181:0/3018603655 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438007e00 con 0x7f94500b75a0 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94500cba10 con 0x7f94500b75a0 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.790+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94500cbfd0 con 0x7f94500b75a0 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.791+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94500cc1d0 con 0x7f94500b75a0 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.792+0000 7f944d7fa640 1 -- 172.21.15.181:0/3018603655 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9438018070 con 0x7f94500b75a0 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.792+0000 7f944d7fa640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f943006be30 0x7f943006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.792+0000 7f944d7fa640 1 -- 172.21.15.181:0/3018603655 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7f943808abd0 con 0x7f94500b75a0 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.792+0000 7f944ffff640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f943006be30 0x7f943006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.792+0000 7f944ffff640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f943006be30 0x7f943006e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9440006fd0 tx=0x7f9440008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.796+0000 7f944d7fa640 1 -- 172.21.15.181:0/3018603655 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94500cc1d0 con 0x7f94500b75a0 2024-09-12T02:35:20.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.961+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f94500b7a10 con 0x7f94500b75a0 2024-09-12T02:35:20.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.961+0000 7f944d7fa640 1 -- 172.21.15.181:0/3018603655 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7f9438059800 con 0x7f94500b75a0 2024-09-12T02:35:20.962 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 1 2024-09-12T02:35:20.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f943006be30 msgr2=0x7f943006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f943006be30 0x7f943006e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9440006fd0 tx=0x7f9440008040 comp rx=0 tx=0).stop 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 msgr2=0x7f94500cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500cd4e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f943800c7f0 tx=0x7f943800cbf0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 shutdown_connections 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f943006be30 0x7f943006e2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94500cedd0 0x7f945014c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94500b75a0 0x7f94500cd4e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 --2- 172.21.15.181:0/3018603655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94500b3490 0x7f94500cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 >> 172.21.15.181:0/3018603655 conn(0x7f94500d0f40 msgr2=0x7f945015d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 shutdown_connections 2024-09-12T02:35:20.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:20.963+0000 7f9456a1e640 1 -- 172.21.15.181:0/3018603655 wait complete. 2024-09-12T02:35:20.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool' 2024-09-12T02:35:21.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.073+0000 7f0102042640 1 Processor -- start 2024-09-12T02:35:21.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.073+0000 7f0102042640 1 -- start start 2024-09-12T02:35:21.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f0102042640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00fc156770 0x7f00fc160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f0102042640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00fc160d50 con 0x7f00fc0cff30 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f0102042640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00fc0b61b0 con 0x7f00fc0afec0 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f0102042640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc0b6490 con 0x7f00fc156770 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f00fbfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f00fc0cff30 0x7f00fc06ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55560/0 (socket says 172.21.15.181:55560) 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f00fbfff640 1 -- 172.21.15.181:0/514517785 learned_addr learned my addr 172.21.15.181:0/514517785 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959384992 0 0) 0x7f00fc160d50 con 0x7f00fc0cff30 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00e4003520 con 0x7f00fc0cff30 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.074+0000 7f00fb7fe640 1 --2- 172.21.15.181:0/514517785 >> v2:172.21.15.204:3300/0 conn(0x7f00fc156770 0x7f00fc160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1107809732 0 0) 0x7f00e4003520 con 0x7f00fc0cff30 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 >> v2:172.21.15.204:3300/0 conn(0x7f00fc156770 msgr2=0x7f00fc160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 --2- 172.21.15.181:0/514517785 >> v2:172.21.15.204:3300/0 conn(0x7f00fc156770 0x7f00fc160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 >> v1:172.21.15.204:6789/0 conn(0x7f00fc0afec0 legacy=0x7f00fc0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc0b6770 con 0x7f00fc0cff30 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f00f4001a10 con 0x7f00fc0cff30 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 >> v1:172.21.15.181:6789/0 conn(0x7f00fc0cff30 legacy=0x7f00fc06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e40039b0 0x7f00e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e40052e0 0x7f00e400fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0b6490 con 0x7f00e4004800 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f00e40079a0 con 0x7f00e40052e0 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f00e4007ba0 con 0x7f00e40039b0 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00faffd640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fb7fe640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e40039b0 0x7f00e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fbfff640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e40052e0 0x7f00e400fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00faffd640 1 -- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e40039b0 msgr2=0x7f00e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00faffd640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00e40039b0 0x7f00e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00faffd640 1 -- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e40052e0 msgr2=0x7f00e400fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00faffd640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00e40052e0 0x7f00e400fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00fbfff640 1 -- 172.21.15.181:0/514517785 reap_dead start 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.075+0000 7f00faffd640 1 -- 172.21.15.181:0/514517785 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e4003520 con 0x7f00e4004800 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f00faffd640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00e4004c80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f00f0001720 tx=0x7f00e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4339b37ef5892b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0001370 con 0x7f00e4004800 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f00052d0 con 0x7f00e4004800 2024-09-12T02:35:21.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f00fa7fc640 1 -- 172.21.15.181:0/514517785 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f002ab90 con 0x7f00e4004800 2024-09-12T02:35:21.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f0102042640 1 -- 172.21.15.181:0/514517785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 msgr2=0x7f00e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f0102042640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00e4004c80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f00f0001720 tx=0x7f00e4005830 comp rx=0 tx=0).stop 2024-09-12T02:35:21.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f0102042640 1 -- 172.21.15.181:0/514517785 shutdown_connections 2024-09-12T02:35:21.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f0102042640 1 --2- 172.21.15.181:0/514517785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00e4004c80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.076+0000 7f0102042640 1 -- 172.21.15.181:0/514517785 >> 172.21.15.181:0/514517785 conn(0x7f00fc0b1770 msgr2=0x7f00fc0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.077+0000 7f0102042640 1 -- 172.21.15.181:0/514517785 shutdown_connections 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.077+0000 7f0102042640 1 -- 172.21.15.181:0/514517785 wait complete. 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.078+0000 7f0102042640 1 Processor -- start 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.078+0000 7f0102042640 1 -- start start 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00fc13cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc14ec30 0x7f00fc14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00fc14f0b0 0x7f00fc14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc156cd0 con 0x7f00e4004800 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc156b50 con 0x7f00fc14f0b0 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc0b0350 con 0x7f00fc14ec30 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00fc13cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00fc13cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32782/0 (socket says 172.21.15.181:32782) 2024-09-12T02:35:21.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 -- 172.21.15.181:0/4100731567 learned_addr learned my addr 172.21.15.181:0/4100731567 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00faffd640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc14ec30 0x7f00fc14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fbfff640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00fc14f0b0 0x7f00fc14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 -- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc14ec30 msgr2=0x7f00fc14a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc14ec30 0x7f00fc14a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 -- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00fc14f0b0 msgr2=0x7f00fc14a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00fc14f0b0 0x7f00fc14a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 -- 172.21.15.181:0/4100731567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc1f0630 con 0x7f00e4004800 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00fb7fe640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00fc13cf70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00b850 tx=0x7f00ec00bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00e3fff640 1 -- 172.21.15.181:0/4100731567 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec018070 con 0x7f00e4004800 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00e3fff640 1 -- 172.21.15.181:0/4100731567 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ec00be40 con 0x7f00e4004800 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f00e3fff640 1 -- 172.21.15.181:0/4100731567 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec010c60 con 0x7f00e4004800 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc14f640 con 0x7f00e4004800 2024-09-12T02:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.079+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc149a80 con 0x7f00e4004800 2024-09-12T02:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.080+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc160810 con 0x7f00e4004800 2024-09-12T02:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.081+0000 7f00e3fff640 1 -- 172.21.15.181:0/4100731567 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00ec01b070 con 0x7f00e4004800 2024-09-12T02:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.081+0000 7f00e3fff640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f00e806be30 0x7f00e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.081+0000 7f00e3fff640 1 -- 172.21.15.181:0/4100731567 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7f00ec08b040 con 0x7f00e4004800 2024-09-12T02:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.081+0000 7f00faffd640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f00e806be30 0x7f00e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.082+0000 7f00faffd640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f00e806be30 0x7f00e806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f00f0032000 tx=0x7f00f002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.085+0000 7f00e3fff640 1 -- 172.21.15.181:0/4100731567 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00fc1f0630 con 0x7f00e4004800 2024-09-12T02:35:21.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.315+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]} v 0) -- 0x7f00fc067e30 con 0x7f00e4004800 2024-09-12T02:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.377+0000 7f00e3fff640 1 -- 172.21.15.181:0/4100731567 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]}]=0 v298) ==== 148+0+0 (secure 0 0 0) 0x7f00ec059c70 con 0x7f00e4004800 2024-09-12T02:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f00e806be30 msgr2=0x7f00e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f00e806be30 0x7f00e806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f00f0032000 tx=0x7f00f002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 msgr2=0x7f00fc13cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00fc13cf70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00b850 tx=0x7f00ec00bd10 comp rx=0 tx=0).stop 2024-09-12T02:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 shutdown_connections 2024-09-12T02:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f00e806be30 0x7f00e806e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00fc14f0b0 0x7f00fc14a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00fc14ec30 0x7f00fc14a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 --2- 172.21.15.181:0/4100731567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00e4004800 0x7f00fc13cf70 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 >> 172.21.15.181:0/4100731567 conn(0x7f00fc0b1770 msgr2=0x7f00fc0b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 shutdown_connections 2024-09-12T02:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.379+0000 7f0102042640 1 -- 172.21.15.181:0/4100731567 wait complete. 2024-09-12T02:35:21.391 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:35:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.491+0000 7fb4a49e4640 1 Processor -- start 2024-09-12T02:35:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.491+0000 7fb4a49e4640 1 -- start start 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb4a49e4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb4a0160250 0x7fb4a015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb4a49e4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb4a0073160 0x7fb4a0073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb4a49e4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a0073ab0 con 0x7fb4a00ce8f0 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb4a49e4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a0160750 con 0x7fb4a0073160 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb4a49e4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a0160a30 con 0x7fb4a0160250 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb49ed9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb4a0073160 0x7fb4a0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb49ed9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb4a0073160 0x7fb4a0073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32796/0 (socket says 172.21.15.181:32796) 2024-09-12T02:35:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb49ed9d640 1 -- 172.21.15.181:0/932016977 learned_addr learned my addr 172.21.15.181:0/932016977 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb49ed9d640 1 -- 172.21.15.181:0/932016977 >> v2:172.21.15.204:3300/0 conn(0x7fb4a0160250 msgr2=0x7fb4a015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb49ed9d640 1 --2- 172.21.15.181:0/932016977 >> v2:172.21.15.204:3300/0 conn(0x7fb4a0160250 0x7fb4a015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb49ed9d640 1 -- 172.21.15.181:0/932016977 >> v1:172.21.15.204:6789/0 conn(0x7fb4a00ce8f0 legacy=0x7fb4a00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.492+0000 7fb49ed9d640 1 -- 172.21.15.181:0/932016977 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a0160d10 con 0x7fb4a0073160 2024-09-12T02:35:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.493+0000 7fb49ed9d640 1 --2- 172.21.15.181:0/932016977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0073570 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb4a006f070 tx=0x7fb49802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882e469c8b84d5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.493+0000 7fb49d59a640 1 -- 172.21.15.181:0/932016977 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498036070 con 0x7fb4a0073160 2024-09-12T02:35:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.493+0000 7fb49d59a640 1 -- 172.21.15.181:0/932016977 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb498031600 con 0x7fb4a0073160 2024-09-12T02:35:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.493+0000 7fb49d59a640 1 -- 172.21.15.181:0/932016977 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4980319d0 con 0x7fb4a0073160 2024-09-12T02:35:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 -- 172.21.15.181:0/932016977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 msgr2=0x7fb4a0073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/932016977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0073570 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb4a006f070 tx=0x7fb49802a660 comp rx=0 tx=0).stop 2024-09-12T02:35:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 -- 172.21.15.181:0/932016977 shutdown_connections 2024-09-12T02:35:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/932016977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0073570 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/932016977 >> v2:172.21.15.204:3300/0 conn(0x7fb4a0160250 0x7fb4a015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 -- 172.21.15.181:0/932016977 >> 172.21.15.181:0/932016977 conn(0x7fb4a00d2570 msgr2=0x7fb4a00d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 -- 172.21.15.181:0/932016977 shutdown_connections 2024-09-12T02:35:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.494+0000 7fb4a49e4640 1 -- 172.21.15.181:0/932016977 wait complete. 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.495+0000 7fb4a49e4640 1 Processor -- start 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.495+0000 7fb4a49e4640 1 -- start start 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb4a49e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb4a49e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4a00ce8f0 0x7fb4a00cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb4a49e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4a0160250 0x7fb4a0147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb4a49e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a00d30d0 con 0x7fb4a0073160 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb4a49e4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a00cecd0 con 0x7fb4a00ce8f0 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb4a49e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a00d3250 con 0x7fb4a0160250 2024-09-12T02:35:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32808/0 (socket says 172.21.15.181:32808) 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 -- 172.21.15.181:0/1377122538 learned_addr learned my addr 172.21.15.181:0/1377122538 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 -- 172.21.15.181:0/1377122538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4a0160250 msgr2=0x7fb4a0147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4a0160250 0x7fb4a0147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 -- 172.21.15.181:0/1377122538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4a00ce8f0 msgr2=0x7fb4a00cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4a00ce8f0 0x7fb4a00cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 -- 172.21.15.181:0/1377122538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a0148f80 con 0x7fb4a0073160 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb49e59c640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0148a40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb49000c410 tx=0x7fb49000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb48effd640 1 -- 172.21.15.181:0/1377122538 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490017070 con 0x7fb4a0073160 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb48effd640 1 -- 172.21.15.181:0/1377122538 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4900035f0 con 0x7fb4a0073160 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a00c9d70 con 0x7fb4a0073160 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.496+0000 7fb48effd640 1 -- 172.21.15.181:0/1377122538 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490003a20 con 0x7fb4a0073160 2024-09-12T02:35:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.497+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a00ca330 con 0x7fb4a0073160 2024-09-12T02:35:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.497+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a0073570 con 0x7fb4a0073160 2024-09-12T02:35:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.498+0000 7fb48effd640 1 -- 172.21.15.181:0/1377122538 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb49001a070 con 0x7fb4a0073160 2024-09-12T02:35:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.498+0000 7fb48effd640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb48006be60 0x7fb48006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.499+0000 7fb48effd640 1 -- 172.21.15.181:0/1377122538 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7fb49008a1e0 con 0x7fb4a0073160 2024-09-12T02:35:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.499+0000 7fb49dd9b640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb48006be60 0x7fb48006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.499+0000 7fb49dd9b640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb48006be60 0x7fb48006e320 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4a015f020 tx=0x7fb494006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.503+0000 7fb48effd640 1 -- 172.21.15.181:0/1377122538 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb490058cf0 con 0x7fb4a0073160 2024-09-12T02:35:21.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.668+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb4a015f050 con 0x7fb4a0073160 2024-09-12T02:35:21.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.671+0000 7fb48effd640 1 -- 172.21.15.181:0/1377122538 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fb4900010c0 con 0x7fb4a0073160 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb48006be60 msgr2=0x7fb48006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb48006be60 0x7fb48006e320 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4a015f020 tx=0x7fb494006bf0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 msgr2=0x7fb4a0148a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0148a40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb49000c410 tx=0x7fb49000c8d0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 shutdown_connections 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb48006be60 0x7fb48006e320 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb4a00ce8f0 0x7fb4a00cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb4a0160250 0x7fb4a0147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 --2- 172.21.15.181:0/1377122538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4a0073160 0x7fb4a0148a40 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 >> 172.21.15.181:0/1377122538 conn(0x7fb4a00d2570 msgr2=0x7fb4a015f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:21.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 shutdown_connections 2024-09-12T02:35:21.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.673+0000 7fb4a49e4640 1 -- 172.21.15.181:0/1377122538 wait complete. 2024-09-12T02:35:21.685 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:35:21.685 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:21.724 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:21.768 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:35:21.768 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:21.768 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:21.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:21.784 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:21.785 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:21.827 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:21.827 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:21.827 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:21.842 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:21.843 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:21.843 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:21.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:21.886 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:35:21.886 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:21.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.982+0000 7fd9645b9640 1 Processor -- start 2024-09-12T02:35:21.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.982+0000 7fd9645b9640 1 -- start start 2024-09-12T02:35:21.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd9645b9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd95c156990 0x7fd95c0cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd9645b9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd95c0b2490 0x7fd95c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd9645b9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95c0ce160 con 0x7fd95c0cd6b0 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd9645b9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd95c156d70 con 0x7fd95c156990 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd9645b9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd95c0cea90 con 0x7fd95c0b2490 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962355640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd95c156990 0x7fd95c0cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962355640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd95c156990 0x7fd95c0cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32820/0 (socket says 172.21.15.181:32820) 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962355640 1 -- 172.21.15.181:0/152862712 learned_addr learned my addr 172.21.15.181:0/152862712 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd961b54640 1 --1- 172.21.15.181:0/152862712 >> v1:172.21.15.181:6789/0 conn(0x7fd95c0cd6b0 0x7fd95c0b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55566/0 (socket says 172.21.15.181:55566) 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962b56640 1 --2- 172.21.15.181:0/152862712 >> v2:172.21.15.204:3300/0 conn(0x7fd95c0b2490 0x7fd95c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962355640 1 -- 172.21.15.181:0/152862712 >> v2:172.21.15.204:3300/0 conn(0x7fd95c0b2490 msgr2=0x7fd95c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962355640 1 --2- 172.21.15.181:0/152862712 >> v2:172.21.15.204:3300/0 conn(0x7fd95c0b2490 0x7fd95c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962355640 1 -- 172.21.15.181:0/152862712 >> v1:172.21.15.181:6789/0 conn(0x7fd95c0cd6b0 legacy=0x7fd95c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.983+0000 7fd962355640 1 -- 172.21.15.181:0/152862712 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c0731f0 con 0x7fd95c156990 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.984+0000 7fd962355640 1 --2- 172.21.15.181:0/152862712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c0cd170 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd95c06f0f0 tx=0x7fd94c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf94e2d5d15a7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.984+0000 7fd961353640 1 -- 172.21.15.181:0/152862712 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c036070 con 0x7fd95c156990 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.984+0000 7fd961353640 1 -- 172.21.15.181:0/152862712 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94c031600 con 0x7fd95c156990 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.984+0000 7fd961353640 1 -- 172.21.15.181:0/152862712 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0319d0 con 0x7fd95c156990 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 -- 172.21.15.181:0/152862712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 msgr2=0x7fd95c0cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 --2- 172.21.15.181:0/152862712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c0cd170 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd95c06f0f0 tx=0x7fd94c02a610 comp rx=0 tx=0).stop 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 -- 172.21.15.181:0/152862712 shutdown_connections 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 --2- 172.21.15.181:0/152862712 >> v2:172.21.15.204:3300/0 conn(0x7fd95c0b2490 0x7fd95c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 --2- 172.21.15.181:0/152862712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c0cd170 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 -- 172.21.15.181:0/152862712 >> 172.21.15.181:0/152862712 conn(0x7fd95c06bc10 msgr2=0x7fd95c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:21.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 -- 172.21.15.181:0/152862712 shutdown_connections 2024-09-12T02:35:21.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.985+0000 7fd9645b9640 1 -- 172.21.15.181:0/152862712 wait complete. 2024-09-12T02:35:21.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.986+0000 7fd9645b9640 1 Processor -- start 2024-09-12T02:35:21.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.986+0000 7fd9645b9640 1 -- start start 2024-09-12T02:35:21.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd9645b9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd95c0b2490 0x7fd95c14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd9645b9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd95c0cd6b0 0x7fd95c15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd9645b9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd9645b9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c0cef20 con 0x7fd95c156990 2024-09-12T02:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd9645b9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c0ce720 con 0x7fd95c0cd6b0 2024-09-12T02:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd9645b9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd95c0cf0a0 con 0x7fd95c0b2490 2024-09-12T02:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32832/0 (socket says 172.21.15.181:32832) 2024-09-12T02:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 -- 172.21.15.181:0/1658412999 learned_addr learned my addr 172.21.15.181:0/1658412999 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962355640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd95c0b2490 0x7fd95c14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 -- 172.21.15.181:0/1658412999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd95c0b2490 msgr2=0x7fd95c14e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd95c0b2490 0x7fd95c14e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 -- 172.21.15.181:0/1658412999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd95c0cd6b0 msgr2=0x7fd95c15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd95c0cd6b0 0x7fd95c15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 -- 172.21.15.181:0/1658412999 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c15de70 con 0x7fd95c156990 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.987+0000 7fd962b56640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c15f450 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd95400d5d0 tx=0x7fd95400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.988+0000 7fd95affd640 1 -- 172.21.15.181:0/1658412999 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9540125f0 con 0x7fd95c156990 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.988+0000 7fd95affd640 1 -- 172.21.15.181:0/1658412999 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd954019070 con 0x7fd95c156990 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.988+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c15e150 con 0x7fd95c156990 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.988+0000 7fd95affd640 1 -- 172.21.15.181:0/1658412999 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9540129f0 con 0x7fd95c156990 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.988+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c15e9f0 con 0x7fd95c156990 2024-09-12T02:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.988+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95c15e540 con 0x7fd95c156990 2024-09-12T02:35:21.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.989+0000 7fd95affd640 1 -- 172.21.15.181:0/1658412999 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd954012b90 con 0x7fd95c156990 2024-09-12T02:35:21.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.989+0000 7fd95affd640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:21.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.989+0000 7fd95affd640 1 -- 172.21.15.181:0/1658412999 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7fd95408b010 con 0x7fd95c156990 2024-09-12T02:35:21.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.989+0000 7fd962355640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:21.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.990+0000 7fd962355640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd94c033000 tx=0x7fd94c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:21.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:21.994+0000 7fd95affd640 1 -- 172.21.15.181:0/1658412999 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd954059bc0 con 0x7fd95c156990 2024-09-12T02:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.191+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd95c1557c0 con 0x7fd95c156990 2024-09-12T02:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.191+0000 7fd95affd640 1 -- 172.21.15.181:0/1658412999 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+3914 (secure 0 0 0) 0x7fd9540594c0 con 0x7fd95c156990 2024-09-12T02:35:22.193 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:22.193 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":59,"btime":"2024-09-12T02:35:17:014114+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/3005461030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":3005461030},{"type":"v1","addr":"172.21.15.204:6835","nonce":3005461030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5962,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/8804983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":8804983},{"type":"v1","addr":"172.21.15.204:6834","nonce":8804983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3281666188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3281666188},{"type":"v1","addr":"172.21.15.181:6837","nonce":3281666188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/1015133644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1015133644},{"type":"v1","addr":"172.21.15.181:6836","nonce":1015133644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[]} 2024-09-12T02:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 59 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 msgr2=0x7fd94806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd94c033000 tx=0x7fd94c009000 comp rx=0 tx=0).stop 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 msgr2=0x7fd95c15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c15f450 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd95400d5d0 tx=0x7fd95400da90 comp rx=0 tx=0).stop 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 shutdown_connections 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd95c0cd6b0 0x7fd95c15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd95c156990 0x7fd95c15f450 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 --2- 172.21.15.181:0/1658412999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd95c0b2490 0x7fd95c14e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 >> 172.21.15.181:0/1658412999 conn(0x7fd95c06bc10 msgr2=0x7fd95c0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:22.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 shutdown_connections 2024-09-12T02:35:22.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.194+0000 7fd9645b9640 1 -- 172.21.15.181:0/1658412999 wait complete. 2024-09-12T02:35:22.206 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:35:22.206 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:35:22.206 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:35:22.206 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:22.206 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:35:22.206 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:35:22.207 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:35:22.207 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:22.207 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:35:22.207 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:35:22.207 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:35:22.207 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:22.207 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:35:22.208 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:35:22.208 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:35:22.208 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:22.215 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:35:22.216 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:35:22.216 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:35:22.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:35:22.219 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:35:22.219 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:35:22.220 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:35:22.220 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:35:22.258 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:35:22.259 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:22.259 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:35:22.259 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:22.262 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:35:22.262 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:22.262 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:35:22.263 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:22.263 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:35:22.333 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:35:22.333 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:35:22.345 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:35:22.345 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:35:22.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.366+0000 7fa1c39c4640 1 Processor -- start 2024-09-12T02:35:22.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.367+0000 7fa1c39c4640 1 -- start start 2024-09-12T02:35:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.367+0000 7fa1c39c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.367+0000 7fa1c39c4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa1bc15c380 0x7fa1bc071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.367+0000 7fa1c39c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1bc072740 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.367+0000 7fa1c39c4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa1bc0cf1a0 con 0x7fa1bc15c380 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.367+0000 7fa1c39c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc0cf480 con 0x7fa1bc0cdb90 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1760640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c0f5f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa1bc15c380 0x7fa1bc071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1760640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:58010/0 (socket says 172.21.15.181:58010) 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1760640 1 -- 172.21.15.181:0/1261236224 learned_addr learned my addr 172.21.15.181:0/1261236224 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1f61640 1 --1- 172.21.15.181:0/1261236224 >> v1:172.21.15.204:6789/0 conn(0x7fa1bc0cfc80 0x7fa1bc15c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:55206/0 (socket says 172.21.15.181:55206) 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1b3fff640 1 -- 172.21.15.181:0/1261236224 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163178371 0 0) 0x7fa1bc072740 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1b3fff640 1 -- 172.21.15.181:0/1261236224 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1a8003520 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1760640 1 -- 172.21.15.181:0/1261236224 >> v2:172.21.15.204:3300/0 conn(0x7fa1bc15c380 msgr2=0x7fa1bc071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1760640 1 --2- 172.21.15.181:0/1261236224 >> v2:172.21.15.204:3300/0 conn(0x7fa1bc15c380 0x7fa1bc071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1760640 1 -- 172.21.15.181:0/1261236224 >> v1:172.21.15.204:6789/0 conn(0x7fa1bc0cfc80 legacy=0x7fa1bc15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c1760640 1 -- 172.21.15.181:0/1261236224 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc0cf760 con 0x7fa1bc0cdb90 2024-09-12T02:35:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.368+0000 7fa1c0f5f640 1 --2- 172.21.15.181:0/1261236224 >> v2:172.21.15.204:3300/0 conn(0x7fa1bc15c380 0x7fa1bc071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:22.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.369+0000 7fa1c1760640 1 --2- 172.21.15.181:0/1261236224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0cdf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac009870 tx=0x7fa1ac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6520c2ff0210d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:22.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.369+0000 7fa1b3fff640 1 -- 172.21.15.181:0/1261236224 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac037070 con 0x7fa1bc0cdb90 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.369+0000 7fa1b3fff640 1 -- 172.21.15.181:0/1261236224 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac032440 con 0x7fa1bc0cdb90 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.369+0000 7fa1b3fff640 1 -- 172.21.15.181:0/1261236224 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac032810 con 0x7fa1bc0cdb90 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 -- 172.21.15.181:0/1261236224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 msgr2=0x7fa1bc0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/1261236224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0cdf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac009870 tx=0x7fa1ac02a270 comp rx=0 tx=0).stop 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 -- 172.21.15.181:0/1261236224 shutdown_connections 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/1261236224 >> v2:172.21.15.204:3300/0 conn(0x7fa1bc15c380 0x7fa1bc071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/1261236224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0cdf70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 -- 172.21.15.181:0/1261236224 >> 172.21.15.181:0/1261236224 conn(0x7fa1bc06d110 msgr2=0x7fa1bc06d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 -- 172.21.15.181:0/1261236224 shutdown_connections 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.370+0000 7fa1c39c4640 1 -- 172.21.15.181:0/1261236224 wait complete. 2024-09-12T02:35:22.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.371+0000 7fa1c39c4640 1 Processor -- start 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.371+0000 7fa1c39c4640 1 -- start start 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c39c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c39c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc0cfc80 0x7fa1bc166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c39c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1bc15c380 0x7fa1bc1674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c39c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc159050 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c39c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc0723f0 con 0x7fa1bc15c380 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c39c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc072a20 con 0x7fa1bc0cdb90 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc0cfc80 0x7fa1bc166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc0cfc80 0x7fa1bc166fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32862/0 (socket says 172.21.15.181:32862) 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 -- 172.21.15.181:0/4007065263 learned_addr learned my addr 172.21.15.181:0/4007065263 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c1760640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c1f61640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1bc15c380 0x7fa1bc1674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 -- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 msgr2=0x7fa1bc0aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 -- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1bc15c380 msgr2=0x7fa1bc1674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1bc15c380 0x7fa1bc1674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 -- 172.21.15.181:0/4007065263 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc0ab1d0 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c0f5f640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc0cfc80 0x7fa1bc166fb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800ebb0 tx=0x7fa1b800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1b1ffb640 1 -- 172.21.15.181:0/4007065263 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8017070 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1b1ffb640 1 -- 172.21.15.181:0/4007065263 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b800cc30 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc167b50 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.372+0000 7fa1b1ffb640 1 -- 172.21.15.181:0/4007065263 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8013470 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.373+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc168110 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.374+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1bc0d0130 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.374+0000 7fa1b1ffb640 1 -- 172.21.15.181:0/4007065263 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1b801a070 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.374+0000 7fa1b1ffb640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1a006be30 0x7fa1a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.375+0000 7fa1b1ffb640 1 -- 172.21.15.181:0/4007065263 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5201+0+0 (secure 0 0 0) 0x7fa1b808aeb0 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.375+0000 7fa1c1760640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1a006be30 0x7fa1a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.375+0000 7fa1c1760640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1a006be30 0x7fa1a006e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac034000 tx=0x7fa1ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:22.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.379+0000 7fa1b1ffb640 1 -- 172.21.15.181:0/4007065263 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1b8059ae0 con 0x7fa1bc0cfc80 2024-09-12T02:35:22.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:22.558+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa1bc1511e0 con 0x7fa1bc0cfc80 2024-09-12T02:35:23.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.396+0000 7fa1b1ffb640 1 -- 172.21.15.181:0/4007065263 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) ==== 97+0+0 (secure 0 0 0) 0x7fa1b80593e0 con 0x7fa1bc0cfc80 2024-09-12T02:35:23.397 INFO:teuthology.orchestra.run.smithi181.stderr: removed all blocklist entries 2024-09-12T02:35:23.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1a006be30 msgr2=0x7fa1a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1a006be30 0x7fa1a006e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac034000 tx=0x7fa1ac02e000 comp rx=0 tx=0).stop 2024-09-12T02:35:23.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc0cfc80 msgr2=0x7fa1bc166fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc0cfc80 0x7fa1bc166fb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800ebb0 tx=0x7fa1b800c520 comp rx=0 tx=0).stop 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 shutdown_connections 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa1a006be30 0x7fa1a006e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa1bc15c380 0x7fa1bc1674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1bc0cfc80 0x7fa1bc166fb0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 --2- 172.21.15.181:0/4007065263 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa1bc0cdb90 0x7fa1bc0aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 >> 172.21.15.181:0/4007065263 conn(0x7fa1bc06d110 msgr2=0x7fa1bc15c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 shutdown_connections 2024-09-12T02:35:23.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.399+0000 7fa1c39c4640 1 -- 172.21.15.181:0/4007065263 wait complete. 2024-09-12T02:35:23.412 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:35:23.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.512+0000 7f886268d640 1 Processor -- start 2024-09-12T02:35:23.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.512+0000 7f886268d640 1 -- start start 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f886268d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f885c15b2e0 0x7f885c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f886268d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f885c0b2490 0x7f885c071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f886268d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f885c0ce4f0 con 0x7f885c0cdfc0 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f886268d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f885c15b6c0 con 0x7f885c15b2e0 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f886268d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f885c0ce7d0 con 0x7f885c0b2490 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f885bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f885c15b2e0 0x7f885c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f885bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f885c15b2e0 0x7f885c0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32876/0 (socket says 172.21.15.181:32876) 2024-09-12T02:35:23.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f885bfff640 1 -- 172.21.15.181:0/3229060217 learned_addr learned my addr 172.21.15.181:0/3229060217 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.513+0000 7f8860c2a640 1 --2- 172.21.15.181:0/3229060217 >> v2:172.21.15.204:3300/0 conn(0x7f885c0b2490 0x7f885c071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885bfff640 1 -- 172.21.15.181:0/3229060217 >> v2:172.21.15.204:3300/0 conn(0x7f885c0b2490 msgr2=0x7f885c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885bfff640 1 --2- 172.21.15.181:0/3229060217 >> v2:172.21.15.204:3300/0 conn(0x7f885c0b2490 0x7f885c071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885bfff640 1 -- 172.21.15.181:0/3229060217 >> v1:172.21.15.204:6789/0 conn(0x7f885c0cdfc0 legacy=0x7f885c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885bfff640 1 -- 172.21.15.181:0/3229060217 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c0ceab0 con 0x7f885c15b2e0 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885bfff640 1 --2- 172.21.15.181:0/3229060217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c15b2e0 0x7f885c0b3d20 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f885c0b4830 tx=0x7f884c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915ddfca0ea96f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885affd640 1 -- 172.21.15.181:0/3229060217 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c037070 con 0x7f885c15b2e0 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885affd640 1 -- 172.21.15.181:0/3229060217 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c032440 con 0x7f885c15b2e0 2024-09-12T02:35:23.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.514+0000 7f885affd640 1 -- 172.21.15.181:0/3229060217 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c032810 con 0x7f885c15b2e0 2024-09-12T02:35:23.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 -- 172.21.15.181:0/3229060217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c15b2e0 msgr2=0x7f885c0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 --2- 172.21.15.181:0/3229060217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c15b2e0 0x7f885c0b3d20 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f885c0b4830 tx=0x7f884c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 -- 172.21.15.181:0/3229060217 shutdown_connections 2024-09-12T02:35:23.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 --2- 172.21.15.181:0/3229060217 >> v2:172.21.15.204:3300/0 conn(0x7f885c0b2490 0x7f885c071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 --2- 172.21.15.181:0/3229060217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c15b2e0 0x7f885c0b3d20 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 -- 172.21.15.181:0/3229060217 >> 172.21.15.181:0/3229060217 conn(0x7f885c06bc10 msgr2=0x7f885c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:23.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 -- 172.21.15.181:0/3229060217 shutdown_connections 2024-09-12T02:35:23.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.515+0000 7f886268d640 1 -- 172.21.15.181:0/3229060217 wait complete. 2024-09-12T02:35:23.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.516+0000 7f886268d640 1 Processor -- start 2024-09-12T02:35:23.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f886268d640 1 -- start start 2024-09-12T02:35:23.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f886268d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c0b2490 0x7f885c1f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f886268d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f885c0cdfc0 0x7f885c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f886268d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f885c15b2e0 0x7f885c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f886268d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f885c0712b0 con 0x7f885c0b2490 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f886268d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f885c071130 con 0x7f885c0cdfc0 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f886268d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f885c0b4260 con 0x7f885c15b2e0 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f885bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c0b2490 0x7f885c1f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f885bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c0b2490 0x7f885c1f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32888/0 (socket says 172.21.15.181:32888) 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f885bfff640 1 -- 172.21.15.181:0/2881472869 learned_addr learned my addr 172.21.15.181:0/2881472869 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f885b7fe640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f885c0cdfc0 0x7f885c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.517+0000 7f8860c2a640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f885c15b2e0 0x7f885c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f885bfff640 1 -- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f885c15b2e0 msgr2=0x7f885c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f885bfff640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f885c15b2e0 0x7f885c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f885bfff640 1 -- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f885c0cdfc0 msgr2=0x7f885c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f885bfff640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f885c0cdfc0 0x7f885c157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f885bfff640 1 -- 172.21.15.181:0/2881472869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c1f52b0 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f885b7fe640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f885c0cdfc0 0x7f885c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f8860c2a640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f885c15b2e0 0x7f885c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f885bfff640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c0b2490 0x7f885c1f4d70 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f884c000c00 tx=0x7f884c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f8858ff9640 1 -- 172.21.15.181:0/2881472869 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c041020 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f8858ff9640 1 -- 172.21.15.181:0/2881472869 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c0306c0 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f8858ff9640 1 -- 172.21.15.181:0/2881472869 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c037040 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c15d750 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.518+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c15dd10 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.519+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c1599c0 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.519+0000 7f8858ff9640 1 -- 172.21.15.181:0/2881472869 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f884c044020 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.520+0000 7f8858ff9640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f884806be30 0x7f884806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.520+0000 7f8858ff9640 1 -- 172.21.15.181:0/2881472869 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4857+0+0 (secure 0 0 0) 0x7f884c0ab2c0 con 0x7f885c0b2490 2024-09-12T02:35:23.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.520+0000 7f885b7fe640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f884806be30 0x7f884806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.520+0000 7f885b7fe640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f884806be30 0x7f884806e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8850007fd0 tx=0x7f8850009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:23.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.524+0000 7f8858ff9640 1 -- 172.21.15.181:0/2881472869 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f884c04b030 con 0x7f885c0b2490 2024-09-12T02:35:23.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.752+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f885c0b3ca0 con 0x7f885c0b2490 2024-09-12T02:35:23.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.753+0000 7f8858ff9640 1 -- 172.21.15.181:0/2881472869 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f884c07a050 con 0x7f885c0b2490 2024-09-12T02:35:23.754 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:23.754 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:23.754 INFO:teuthology.orchestra.run.smithi181.stdout: "auth_dump": [ 2024-09-12T02:35:23.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.754 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.a", 2024-09-12T02:35:23.754 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmgqStABAAuR5/mEmoQ93BJ/aXTfZ3Vg==", 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.b", 2024-09-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmHB1xDBAA9v9urEvVrgq4ujbl1dq0ow==", 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.c", 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmA6uoBxAAsY99fp7CzedZ/yS6xKV3Ww==", 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.756 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.d", 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmSVuPExAA2lIlASsgadRjRVyKwAD+ig==", 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.757 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:23.758 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:23.758 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.758 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.0", 2024-09-12T02:35:23.758 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCJUeJmXm6kMxAAhxzDDmGdbM/mLqwsr2z0qw==", 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.1", 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCNUeJm3UvvNBAAiZKHPj471Ql3u3MDU+vYrg==", 2024-09-12T02:35:23.759 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.2", 2024-09-12T02:35:23.760 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCRUeJm6pZuJxAABApQFY9e5yj6ehNZsZcerA==", 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.3", 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCVUeJm5e9GKBAA0ZoeZyPDkw7vRVjKLRZIZQ==", 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.761 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.4", 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCcUeJmd20TMhAA0MSq5FoRha+jFQ6aJbfs/A==", 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.5", 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCgUeJmcgSVMxAAFDsp8jmrJ2uco7rmn4q9XQ==", 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.6", 2024-09-12T02:35:23.763 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCkUeJmTwSWNBAApWkWkCbc9Mpk7VGR27a4+Q==", 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.7", 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCoUeJmVts/NRAAQ3JpiLZSmnd2VbHLmZyXJQ==", 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:23.764 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.0", 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg==", 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow r", 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.1", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm8f6AIBAA96HxvzttXuXOClAGiYwh7g==", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.2", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm/+dGHRAAw3bdTqnuOcV2umDd/1577Q==", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.3", 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmCFcdJhAAEpU/Swkitc8CXjG0SKzeLQ==", 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.admin", 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmD708IBAAP+FE49F+D1d43sRbMVLBlQ==", 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.x", 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmmPEKORAAtnB+3V0qg1BS1zEVF5qImQ==", 2024-09-12T02:35:23.768 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.y", 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmMrTWNBAAVU9k50mu969QuqrLSsdtGw==", 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:23.770 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:23.770 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f884806be30 msgr2=0x7f884806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f884806be30 0x7f884806e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8850007fd0 tx=0x7f8850009040 comp rx=0 tx=0).stop 2024-09-12T02:35:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c0b2490 msgr2=0x7f885c1f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c0b2490 0x7f885c1f4d70 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f884c000c00 tx=0x7f884c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 shutdown_connections 2024-09-12T02:35:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f884806be30 0x7f884806e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f885c0cdfc0 0x7f885c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f885c15b2e0 0x7f885c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 --2- 172.21.15.181:0/2881472869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f885c0b2490 0x7f885c1f4d70 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 >> 172.21.15.181:0/2881472869 conn(0x7f885c06bc10 msgr2=0x7f885c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 shutdown_connections 2024-09-12T02:35:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.755+0000 7f886268d640 1 -- 172.21.15.181:0/2881472869 wait complete. 2024-09-12T02:35:23.772 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:35:23.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.870+0000 7f9f27778640 1 Processor -- start 2024-09-12T02:35:23.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.870+0000 7f9f27778640 1 -- start start 2024-09-12T02:35:23.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f27778640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 0x7f9f200b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f27778640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f200ce4f0 con 0x7f9f2015b2e0 2024-09-12T02:35:23.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f27778640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f200ce7d0 con 0x7f9f200b22c0 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f27778640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2015b6c0 con 0x7f9f200cdfc0 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f25514640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9f2015b2e0 0x7f9f200b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55586/0 (socket says 172.21.15.181:55586) 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f25514640 1 -- 172.21.15.181:0/3786441764 learned_addr learned my addr 172.21.15.181:0/3786441764 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474591050 0 0) 0x7f9f200ce4f0 con 0x7f9f2015b2e0 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f0c005730 con 0x7f9f2015b2e0 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f24d13640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 0x7f9f200b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1918374668 0 0) 0x7f9f0c005730 con 0x7f9f2015b2e0 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 msgr2=0x7f9f200b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 0x7f9f200b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 >> v1:172.21.15.204:6789/0 conn(0x7f9f200b22c0 legacy=0x7f9f20071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f200ceab0 con 0x7f9f2015b2e0 2024-09-12T02:35:23.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f9f1c001670 con 0x7f9f2015b2e0 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f24d13640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 0x7f9f200b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 >> v1:172.21.15.181:6789/0 conn(0x7f9f2015b2e0 legacy=0x7f9f200b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 0x7f9f0c005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f0c0061e0 0x7f9f0c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f0c006f50 0x7f9f0c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c00dd00 con 0x7f9f0c0061e0 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c00deb0 con 0x7f9f0c006f50 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.871+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0c00e0b0 con 0x7f9f200cdfc0 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f24d13640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f0c0061e0 0x7f9f0c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f25514640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 0x7f9f0c005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f25d15640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f0c006f50 0x7f9f0c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f24d13640 1 -- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 msgr2=0x7f9f0c005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:23.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f24d13640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f200cdfc0 0x7f9f0c005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f24d13640 1 -- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f0c006f50 msgr2=0x7f9f0c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f24d13640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f0c006f50 0x7f9f0c0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f24d13640 1 -- 172.21.15.181:0/3786441764 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c005730 con 0x7f9f0c0061e0 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.872+0000 7f9f24d13640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f0c0061e0 0x7f9f0c006a10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098a0 tx=0x7f9f0c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc5f91995b416b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000f040 con 0x7f9f0c0061e0 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1002ac10 con 0x7f9f0c0061e0 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f17fff640 1 -- 172.21.15.181:0/3786441764 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10004030 con 0x7f9f0c0061e0 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f27778640 1 -- 172.21.15.181:0/3786441764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f0c0061e0 msgr2=0x7f9f0c006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f27778640 1 --2- 172.21.15.181:0/3786441764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f0c0061e0 0x7f9f0c006a10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098a0 tx=0x7f9f0c007a40 comp rx=0 tx=0).stop 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f25d15640 1 -- 172.21.15.181:0/3786441764 reap_dead start 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f27778640 1 -- 172.21.15.181:0/3786441764 shutdown_connections 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f27778640 1 -- 172.21.15.181:0/3786441764 >> 172.21.15.181:0/3786441764 conn(0x7f9f2006bc10 msgr2=0x7f9f2006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:23.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f27778640 1 -- 172.21.15.181:0/3786441764 shutdown_connections 2024-09-12T02:35:23.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.873+0000 7f9f27778640 1 -- 172.21.15.181:0/3786441764 wait complete. 2024-09-12T02:35:23.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.874+0000 7f9f27778640 1 Processor -- start 2024-09-12T02:35:23.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.874+0000 7f9f27778640 1 -- start start 2024-09-12T02:35:23.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f27778640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f0c0061e0 0x7f9f2015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f27778640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f200ac300 0x7f9f201f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f27778640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f200b0490 0x7f9f201558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f27778640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20071130 con 0x7f9f200ac300 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f27778640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9f200b4430 con 0x7f9f200b0490 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f27778640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9f200712b0 con 0x7f9f0c0061e0 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f200ac300 0x7f9f201f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f200ac300 0x7f9f201f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32900/0 (socket says 172.21.15.181:32900) 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 -- 172.21.15.181:0/1703242305 learned_addr learned my addr 172.21.15.181:0/1703242305 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f25d15640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f200b0490 0x7f9f201558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f25514640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f0c0061e0 0x7f9f2015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 -- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f0c0061e0 msgr2=0x7f9f2015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f0c0061e0 0x7f9f2015e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 -- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f200b0490 msgr2=0x7f9f201558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:23.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f200b0490 0x7f9f201558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.875+0000 7f9f24d13640 1 -- 172.21.15.181:0/1703242305 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f200acaa0 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f25514640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f0c0061e0 0x7f9f2015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f25d15640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f200b0490 0x7f9f201558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f24d13640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f200ac300 0x7f9f201f0250 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098a0 tx=0x7f9f10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f15ffb640 1 -- 172.21.15.181:0/1703242305 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10041070 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f15ffb640 1 -- 172.21.15.181:0/1703242305 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1002aa10 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f200acd80 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f15ffb640 1 -- 172.21.15.181:0/1703242305 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1003d430 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.876+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f200aaa50 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.877+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f200b1d80 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.877+0000 7f9f15ffb640 1 -- 172.21.15.181:0/1703242305 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f10044070 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.878+0000 7f9f15ffb640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9f0406be60 0x7f9f0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.878+0000 7f9f15ffb640 1 -- 172.21.15.181:0/1703242305 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4857+0+0 (secure 0 0 0) 0x7f9f100ab330 con 0x7f9f200ac300 2024-09-12T02:35:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.878+0000 7f9f25514640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9f0406be60 0x7f9f0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:23.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.878+0000 7f9f25514640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9f0406be60 0x7f9f0406e320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c001eb0 tx=0x7f9f1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:23.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:23.882+0000 7f9f15ffb640 1 -- 172.21.15.181:0/1703242305 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f10079fa0 con 0x7f9f200ac300 2024-09-12T02:35:24.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.051+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9f20158290 con 0x7f9f200ac300 2024-09-12T02:35:24.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.052+0000 7f9f15ffb640 1 -- 172.21.15.181:0/1703242305 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f9f100798a0 con 0x7f9f200ac300 2024-09-12T02:35:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:24.053 INFO:teuthology.orchestra.run.smithi181.stdout:[ 2024-09-12T02:35:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "poolnum": 1, 2024-09-12T02:35:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "poolname": ".mgr" 2024-09-12T02:35:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:24.053 INFO:teuthology.orchestra.run.smithi181.stdout:] 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9f0406be60 msgr2=0x7f9f0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9f0406be60 0x7f9f0406e320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c001eb0 tx=0x7f9f1c009040 comp rx=0 tx=0).stop 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f200ac300 msgr2=0x7f9f201f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f200ac300 0x7f9f201f0250 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098a0 tx=0x7f9f10004730 comp rx=0 tx=0).stop 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 shutdown_connections 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f9f0406be60 0x7f9f0406e320 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f200b0490 0x7f9f201558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f200ac300 0x7f9f201f0250 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 --2- 172.21.15.181:0/1703242305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f0c0061e0 0x7f9f2015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 >> 172.21.15.181:0/1703242305 conn(0x7f9f2006bc10 msgr2=0x7f9f20157b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 shutdown_connections 2024-09-12T02:35:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.054+0000 7f9f27778640 1 -- 172.21.15.181:0/1703242305 wait complete. 2024-09-12T02:35:24.065 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:35:24.066 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:35:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.167+0000 7f10e3642640 1 Processor -- start 2024-09-12T02:35:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.167+0000 7f10e3642640 1 -- start start 2024-09-12T02:35:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10e3642640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 0x7f10dc06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10e3642640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10dc15d930 con 0x7f10dc15c540 2024-09-12T02:35:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10e3642640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10dc073580 con 0x7f10dc0d0830 2024-09-12T02:35:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10e3642640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f10dc0cfd50 con 0x7f10dc0ce690 2024-09-12T02:35:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10e13de640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f10dc15c540 0x7f10dc0cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55600/0 (socket says 172.21.15.181:55600) 2024-09-12T02:35:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10e13de640 1 -- 172.21.15.181:0/619451759 learned_addr learned my addr 172.21.15.181:0/619451759 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10e0bdd640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 0x7f10dc06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742696327 0 0) 0x7f10d8001110 con 0x7f10dc15c540 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.168+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10c8003520 con 0x7f10dc15c540 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1356907886 0 0) 0x7f10c8003520 con 0x7f10dc15c540 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 msgr2=0x7f10dc06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 0x7f10dc06d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 >> v1:172.21.15.204:6789/0 conn(0x7f10dc0d0830 legacy=0x7f10dc072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10dc0d0030 con 0x7f10dc15c540 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f10d8001840 con 0x7f10dc15c540 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 >> v1:172.21.15.181:6789/0 conn(0x7f10dc15c540 legacy=0x7f10dc0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10c8004390 0x7f10c8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 0x7f10c80050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc0cfd50 con 0x7f10c80039e0 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8005990 con 0x7f10c8004390 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f10c8005b90 con 0x7f10dc0ce690 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e13de640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e0bdd640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10c8004390 0x7f10c8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e1bdf640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 0x7f10c80050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e13de640 1 -- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 msgr2=0x7f10c80050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e13de640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc0ce690 0x7f10c80050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e13de640 1 -- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10c8004390 msgr2=0x7f10c8004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e13de640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10c8004390 0x7f10c8004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.169+0000 7f10e13de640 1 -- 172.21.15.181:0/619451759 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c8003520 con 0x7f10c80039e0 2024-09-12T02:35:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.170+0000 7f10e13de640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10c8003dc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c4c0 tx=0x7f10c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a019c3bf76b9253 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.170+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d800c0e0 con 0x7f10c80039e0 2024-09-12T02:35:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.170+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8034070 con 0x7f10c80039e0 2024-09-12T02:35:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.170+0000 7f10d3fff640 1 -- 172.21.15.181:0/619451759 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8005d10 con 0x7f10c80039e0 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.171+0000 7f10e3642640 1 -- 172.21.15.181:0/619451759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 msgr2=0x7f10c8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.171+0000 7f10e3642640 1 --2- 172.21.15.181:0/619451759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10c8003dc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c4c0 tx=0x7f10c8005830 comp rx=0 tx=0).stop 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.171+0000 7f10e1bdf640 1 -- 172.21.15.181:0/619451759 reap_dead start 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.171+0000 7f10e3642640 1 -- 172.21.15.181:0/619451759 shutdown_connections 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.171+0000 7f10e3642640 1 -- 172.21.15.181:0/619451759 >> 172.21.15.181:0/619451759 conn(0x7f10dc06bc10 msgr2=0x7f10dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.171+0000 7f10e3642640 1 -- 172.21.15.181:0/619451759 shutdown_connections 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.171+0000 7f10e3642640 1 -- 172.21.15.181:0/619451759 wait complete. 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.172+0000 7f10e3642640 1 Processor -- start 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.172+0000 7f10e3642640 1 -- start start 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e3642640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10dc15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e3642640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10dc153050 0x7f10dc15e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e3642640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc14cb00 0x7f10dc14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e3642640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc06dd50 con 0x7f10c80039e0 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e3642640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc06dbd0 con 0x7f10dc153050 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e3642640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f10dc06ded0 con 0x7f10dc14cb00 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10dc15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10dc15de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32920/0 (socket says 172.21.15.181:32920) 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 -- 172.21.15.181:0/403447228 learned_addr learned my addr 172.21.15.181:0/403447228 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e0bdd640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10dc153050 0x7f10dc15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e1bdf640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc14cb00 0x7f10dc14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 -- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc14cb00 msgr2=0x7f10dc14cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc14cb00 0x7f10dc14cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 -- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10dc153050 msgr2=0x7f10dc15e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10dc153050 0x7f10dc15e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 -- 172.21.15.181:0/403447228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10dc1535e0 con 0x7f10c80039e0 2024-09-12T02:35:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e13de640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10dc15de40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f10d8031040 tx=0x7f10dc0d0200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10d1ffb640 1 -- 172.21.15.181:0/403447228 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8007270 con 0x7f10c80039e0 2024-09-12T02:35:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10d1ffb640 1 -- 172.21.15.181:0/403447228 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8007410 con 0x7f10c80039e0 2024-09-12T02:35:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10d1ffb640 1 -- 172.21.15.181:0/403447228 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8007800 con 0x7f10c80039e0 2024-09-12T02:35:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.173+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10dc1538c0 con 0x7f10c80039e0 2024-09-12T02:35:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.174+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10dc153e80 con 0x7f10c80039e0 2024-09-12T02:35:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.175+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10dc069170 con 0x7f10c80039e0 2024-09-12T02:35:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.175+0000 7f10d1ffb640 1 -- 172.21.15.181:0/403447228 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10d8039480 con 0x7f10c80039e0 2024-09-12T02:35:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.175+0000 7f10d1ffb640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10c006be30 0x7f10c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.176+0000 7f10d1ffb640 1 -- 172.21.15.181:0/403447228 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4857+0+0 (secure 0 0 0) 0x7f10d80abd70 con 0x7f10c80039e0 2024-09-12T02:35:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.176+0000 7f10e0bdd640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10c006be30 0x7f10c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.176+0000 7f10e0bdd640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10c006be30 0x7f10c006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f10dc156990 tx=0x7f10cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.180+0000 7f10d1ffb640 1 -- 172.21.15.181:0/403447228 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10d8049060 con 0x7f10c80039e0 2024-09-12T02:35:24.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.348+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f10dc06d5f0 con 0x7f10c80039e0 2024-09-12T02:35:24.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.402+0000 7f10d1ffb640 1 -- 172.21.15.181:0/403447228 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f10dc15d930 con 0x7f10c80039e0 2024-09-12T02:35:24.403 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' created 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10c006be30 msgr2=0x7f10c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10c006be30 0x7f10c006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f10dc156990 tx=0x7f10cc008040 comp rx=0 tx=0).stop 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 msgr2=0x7f10dc15de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10dc15de40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f10d8031040 tx=0x7f10dc0d0200 comp rx=0 tx=0).stop 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 shutdown_connections 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f10c006be30 0x7f10c006e2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10dc153050 0x7f10dc15e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f10dc14cb00 0x7f10dc14cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 --2- 172.21.15.181:0/403447228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10c80039e0 0x7f10dc15de40 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 >> 172.21.15.181:0/403447228 conn(0x7f10dc06bc10 msgr2=0x7f10dc072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:24.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.405+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 shutdown_connections 2024-09-12T02:35:24.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.406+0000 7f10e3642640 1 -- 172.21.15.181:0/403447228 wait complete. 2024-09-12T02:35:24.420 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:35:24.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.525+0000 7f3161053640 1 Processor -- start 2024-09-12T02:35:24.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.525+0000 7f3161053640 1 -- start start 2024-09-12T02:35:24.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.526+0000 7f3161053640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f315c0af000 0x7f315c15f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.526+0000 7f3161053640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c06bc10 0x7f315c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.526+0000 7f3161053640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c1627f0 con 0x7f315c15bf10 2024-09-12T02:35:24.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.526+0000 7f3161053640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f315c15edf0 con 0x7f315c0af000 2024-09-12T02:35:24.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.526+0000 7f3161053640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f315c162ad0 con 0x7f315c06bc10 2024-09-12T02:35:24.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315b59e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c06bc10 0x7f315c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315a59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f315c0af000 0x7f315c15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315a59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f315c0af000 0x7f315c15f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:39580/0 (socket says 172.21.15.181:39580) 2024-09-12T02:35:24.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315b59e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c06bc10 0x7f315c06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:58094/0 (socket says 172.21.15.181:58094) 2024-09-12T02:35:24.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315ad9d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f315c15bf10 0x7f315c161f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:55252/0 (socket says 172.21.15.181:55252) 2024-09-12T02:35:24.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315a59c640 1 -- 172.21.15.181:0/2145625851 learned_addr learned my addr 172.21.15.181:0/2145625851 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:24.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315a59c640 1 -- 172.21.15.181:0/2145625851 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c06bc10 msgr2=0x7f315c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:24.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315a59c640 1 --2- 172.21.15.181:0/2145625851 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c06bc10 0x7f315c06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315a59c640 1 -- 172.21.15.181:0/2145625851 >> v1:172.21.15.204:6789/0 conn(0x7f315c15bf10 legacy=0x7f315c161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.527+0000 7f315a59c640 1 -- 172.21.15.181:0/2145625851 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c162db0 con 0x7f315c0af000 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f315a59c640 1 --2- 172.21.15.181:0/2145625851 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c0af000 0x7f315c15f280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3150009870 tx=0x7f315002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fa1fe126a01cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3159d9b640 1 -- 172.21.15.181:0/2145625851 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150037070 con 0x7f315c0af000 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3159d9b640 1 -- 172.21.15.181:0/2145625851 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315002ae50 con 0x7f315c0af000 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3159d9b640 1 -- 172.21.15.181:0/2145625851 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150032860 con 0x7f315c0af000 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 -- 172.21.15.181:0/2145625851 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c0af000 msgr2=0x7f315c15f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 --2- 172.21.15.181:0/2145625851 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c0af000 0x7f315c15f280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3150009870 tx=0x7f315002a300 comp rx=0 tx=0).stop 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 -- 172.21.15.181:0/2145625851 shutdown_connections 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 --2- 172.21.15.181:0/2145625851 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c06bc10 0x7f315c06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 --2- 172.21.15.181:0/2145625851 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c0af000 0x7f315c15f280 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 -- 172.21.15.181:0/2145625851 >> 172.21.15.181:0/2145625851 conn(0x7f315c0b3010 msgr2=0x7f315c0b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 -- 172.21.15.181:0/2145625851 shutdown_connections 2024-09-12T02:35:24.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.528+0000 7f3161053640 1 -- 172.21.15.181:0/2145625851 wait complete. 2024-09-12T02:35:24.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.530+0000 7f3161053640 1 Processor -- start 2024-09-12T02:35:24.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.530+0000 7f3161053640 1 -- start start 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c06bc10 0x7f315c1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c0af000 0x7f315c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c15bf10 0x7f315c152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f315c15f7c0 con 0x7f315c0af000 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f315c15c2f0 con 0x7f315c06bc10 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f315c15f940 con 0x7f315c15bf10 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c0af000 0x7f315c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c0af000 0x7f315c156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32928/0 (socket says 172.21.15.181:32928) 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 -- 172.21.15.181:0/2026444414 learned_addr learned my addr 172.21.15.181:0/2026444414 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315b59e640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c15bf10 0x7f315c152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315ad9d640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c06bc10 0x7f315c1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 -- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c15bf10 msgr2=0x7f315c152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c15bf10 0x7f315c152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 -- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c06bc10 msgr2=0x7f315c1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c06bc10 0x7f315c1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 -- 172.21.15.181:0/2026444414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c157580 con 0x7f315c0af000 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f315a59c640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c0af000 0x7f315c156de0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3150000c00 tx=0x7f31500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f31437fe640 1 -- 172.21.15.181:0/2026444414 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150041070 con 0x7f315c0af000 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f31437fe640 1 -- 172.21.15.181:0/2026444414 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315003c660 con 0x7f315c0af000 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c157860 con 0x7f315c0af000 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f31437fe640 1 -- 172.21.15.181:0/2026444414 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150037040 con 0x7f315c0af000 2024-09-12T02:35:24.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.531+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c157e20 con 0x7f315c0af000 2024-09-12T02:35:24.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.533+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c0aff80 con 0x7f315c0af000 2024-09-12T02:35:24.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.533+0000 7f31437fe640 1 -- 172.21.15.181:0/2026444414 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3150044070 con 0x7f315c0af000 2024-09-12T02:35:24.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.533+0000 7f31437fe640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f314806be30 0x7f314806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.534+0000 7f31437fe640 1 -- 172.21.15.181:0/2026444414 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5227+0+0 (secure 0 0 0) 0x7f31500ab2b0 con 0x7f315c0af000 2024-09-12T02:35:24.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.534+0000 7f315ad9d640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f314806be30 0x7f314806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.534+0000 7f315ad9d640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f314806be30 0x7f314806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b69d0 tx=0x7f314c007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.538+0000 7f31437fe640 1 -- 172.21.15.181:0/2026444414 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f315c0aff80 con 0x7f315c0af000 2024-09-12T02:35:24.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:24.705+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f315c070830 con 0x7f315c0af000 2024-09-12T02:35:25.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.404+0000 7f31437fe640 1 -- 172.21.15.181:0/2026444414 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f315c070830 con 0x7f315c0af000 2024-09-12T02:35:25.405 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' created 2024-09-12T02:35:25.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.407+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f314806be30 msgr2=0x7f314806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.407+0000 7f3161053640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f314806be30 0x7f314806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b69d0 tx=0x7f314c007e80 comp rx=0 tx=0).stop 2024-09-12T02:35:25.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.407+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c0af000 msgr2=0x7f315c156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.407+0000 7f3161053640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c0af000 0x7f315c156de0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3150000c00 tx=0x7f31500046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 shutdown_connections 2024-09-12T02:35:25.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f314806be30 0x7f314806e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315c15bf10 0x7f315c152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c0af000 0x7f315c156de0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 --2- 172.21.15.181:0/2026444414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f315c06bc10 0x7f315c1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 >> 172.21.15.181:0/2026444414 conn(0x7f315c0b3010 msgr2=0x7f315c0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:25.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 shutdown_connections 2024-09-12T02:35:25.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.408+0000 7f3161053640 1 -- 172.21.15.181:0/2026444414 wait complete. 2024-09-12T02:35:25.433 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:35:25.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.536+0000 7f9271981640 1 Processor -- start 2024-09-12T02:35:25.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.536+0000 7f9271981640 1 -- start start 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f9271981640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 0x7f926c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f9271981640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926c0b39d0 con 0x7f926c0cef60 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f9271981640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926c0cf520 con 0x7f926c0d4710 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f9271981640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f926c0cf800 con 0x7f926c15e640 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f926a7fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f926c0cef60 0x7f926c0d2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55616/0 (socket says 172.21.15.181:55616) 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f926a7fc640 1 -- 172.21.15.181:0/493598289 learned_addr learned my addr 172.21.15.181:0/493598289 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63963419 0 0) 0x7f9260001110 con 0x7f926c0cef60 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9254003520 con 0x7f926c0cef60 2024-09-12T02:35:25.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.537+0000 7f926affd640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 0x7f926c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3101927543 0 0) 0x7f9254003520 con 0x7f926c0cef60 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 msgr2=0x7f926c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 0x7f926c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 >> v1:172.21.15.204:6789/0 conn(0x7f926c0d4710 legacy=0x7f926c0d4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926c0cfae0 con 0x7f926c0cef60 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f9260001840 con 0x7f926c0cef60 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926affd640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 0x7f926c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 >> v1:172.21.15.181:6789/0 conn(0x7f926c0cef60 legacy=0x7f926c0d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92540039e0 0x7f9254003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 0x7f9254004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9254004d40 0x7f92540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f926c0cf800 con 0x7f9254004d40 2024-09-12T02:35:25.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f925400bb50 con 0x7f92540039e0 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f925400bd50 con 0x7f926c15e640 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926b7fe640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9254004d40 0x7f92540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926a7fc640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 0x7f9254004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926affd640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92540039e0 0x7f9254003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926b7fe640 1 -- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 msgr2=0x7f9254004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926b7fe640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c15e640 0x7f9254004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926b7fe640 1 -- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92540039e0 msgr2=0x7f9254003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926b7fe640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92540039e0 0x7f9254003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.538+0000 7f926b7fe640 1 -- 172.21.15.181:0/493598289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9254003520 con 0x7f9254004d40 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.539+0000 7f926b7fe640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9254004d40 0x7f92540051c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9264001750 tx=0x7f9254005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac1098203adb674 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.539+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264001370 con 0x7f9254004d40 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.539+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92640052d0 con 0x7f9254004d40 2024-09-12T02:35:25.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.539+0000 7f9269ffb640 1 -- 172.21.15.181:0/493598289 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926402abe0 con 0x7f9254004d40 2024-09-12T02:35:25.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.539+0000 7f9271981640 1 -- 172.21.15.181:0/493598289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9254004d40 msgr2=0x7f92540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.539+0000 7f9271981640 1 --2- 172.21.15.181:0/493598289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9254004d40 0x7f92540051c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9264001750 tx=0x7f9254005830 comp rx=0 tx=0).stop 2024-09-12T02:35:25.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.539+0000 7f926b7fe640 1 -- 172.21.15.181:0/493598289 reap_dead start 2024-09-12T02:35:25.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.540+0000 7f9271981640 1 -- 172.21.15.181:0/493598289 shutdown_connections 2024-09-12T02:35:25.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.540+0000 7f9271981640 1 -- 172.21.15.181:0/493598289 >> 172.21.15.181:0/493598289 conn(0x7f926c067d70 msgr2=0x7f926c068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:25.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.540+0000 7f9271981640 1 -- 172.21.15.181:0/493598289 shutdown_connections 2024-09-12T02:35:25.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.540+0000 7f9271981640 1 -- 172.21.15.181:0/493598289 wait complete. 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.541+0000 7f9271981640 1 Processor -- start 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.541+0000 7f9271981640 1 -- start start 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c157a90 0x7f926c158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f926c1f47a0 0x7f926c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f926c0cd090 0x7f926c0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f926c0d3590 con 0x7f926c0cd090 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f926c15ea20 con 0x7f926c1f47a0 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f926c0d3710 con 0x7f926c157a90 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f926c0cd090 0x7f926c0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f926c0cd090 0x7f926c0cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32954/0 (socket says 172.21.15.181:32954) 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 -- 172.21.15.181:0/3615399276 learned_addr learned my addr 172.21.15.181:0/3615399276 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926a7fc640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f926c1f47a0 0x7f926c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926affd640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c157a90 0x7f926c158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 -- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c157a90 msgr2=0x7f926c158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c157a90 0x7f926c158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 -- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f926c1f47a0 msgr2=0x7f926c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f926c1f47a0 0x7f926c15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 -- 172.21.15.181:0/3615399276 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926c0cb850 con 0x7f926c0cd090 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f926b7fe640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f926c0cd090 0x7f926c0cd510 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f9264001840 tx=0x7f9264001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9253fff640 1 -- 172.21.15.181:0/3615399276 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264001370 con 0x7f926c0cd090 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9253fff640 1 -- 172.21.15.181:0/3615399276 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9264005480 con 0x7f926c0cd090 2024-09-12T02:35:25.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926c15b110 con 0x7f926c0cd090 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9253fff640 1 -- 172.21.15.181:0/3615399276 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264007a30 con 0x7f926c0cd090 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.542+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926c15b6d0 con 0x7f926c0cd090 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.543+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f926c0b4d70 con 0x7f926c0cd090 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.544+0000 7f9253fff640 1 -- 172.21.15.181:0/3615399276 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9264043020 con 0x7f926c0cd090 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.544+0000 7f9253fff640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f925806be60 0x7f925806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.544+0000 7f9253fff640 1 -- 172.21.15.181:0/3615399276 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5609+0+0 (secure 0 0 0) 0x7f92640a9e30 con 0x7f926c0cd090 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.544+0000 7f926affd640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f925806be60 0x7f925806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.545+0000 7f926affd640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f925806be60 0x7f925806e320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f925c0095c0 tx=0x7f925c009820 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:25.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.549+0000 7f9253fff640 1 -- 172.21.15.181:0/3615399276 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9264078160 con 0x7f926c0cd090 2024-09-12T02:35:25.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:25.748+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f926c0cb610 con 0x7f926c0cd090 2024-09-12T02:35:26.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.430+0000 7f9253fff640 1 -- 172.21.15.181:0/3615399276 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v61) ==== 174+0+0 (secure 0 0 0) 0x7f926407c460 con 0x7f926c0cd090 2024-09-12T02:35:26.431 INFO:teuthology.orchestra.run.smithi181.stderr:new fs with metadata pool 10 and data pool 11 2024-09-12T02:35:26.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.434+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f925806be60 msgr2=0x7f925806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.434+0000 7f9271981640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f925806be60 0x7f925806e320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f925c0095c0 tx=0x7f925c009820 comp rx=0 tx=0).stop 2024-09-12T02:35:26.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.434+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f926c0cd090 msgr2=0x7f926c0cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.434+0000 7f9271981640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f926c0cd090 0x7f926c0cd510 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f9264001840 tx=0x7f9264001120 comp rx=0 tx=0).stop 2024-09-12T02:35:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.436+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 shutdown_connections 2024-09-12T02:35:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.436+0000 7f9271981640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f925806be60 0x7f925806e320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.436+0000 7f9271981640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f926c1f47a0 0x7f926c15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.436+0000 7f9271981640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f926c0cd090 0x7f926c0cd510 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.436+0000 7f9271981640 1 --2- 172.21.15.181:0/3615399276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f926c157a90 0x7f926c158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.436+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 >> 172.21.15.181:0/3615399276 conn(0x7f926c067d70 msgr2=0x7f926c15eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:26.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.438+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 shutdown_connections 2024-09-12T02:35:26.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.439+0000 7f9271981640 1 -- 172.21.15.181:0/3615399276 wait complete. 2024-09-12T02:35:26.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:26.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.557+0000 7fb162198640 1 Processor -- start 2024-09-12T02:35:26.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.558+0000 7fb162198640 1 -- start start 2024-09-12T02:35:26.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.558+0000 7fb162198640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c15e640 0x7fb15c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.558+0000 7fb162198640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb15c0d3660 0x7fb15c0cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.558+0000 7fb162198640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15c15ea20 con 0x7fb15c0cf0e0 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.558+0000 7fb162198640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb15c0b2860 con 0x7fb15c0d3660 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.558+0000 7fb162198640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb15c0b1c50 con 0x7fb15c15e640 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.558+0000 7fb15bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb15c0d3660 0x7fb15c0cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb15c0d3660 0x7fb15c0cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32956/0 (socket says 172.21.15.181:32956) 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15bfff640 1 -- 172.21.15.181:0/1425980796 learned_addr learned my addr 172.21.15.181:0/1425980796 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15b7fe640 1 --2- 172.21.15.181:0/1425980796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c15e640 0x7fb15c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15bfff640 1 -- 172.21.15.181:0/1425980796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c15e640 msgr2=0x7fb15c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15bfff640 1 --2- 172.21.15.181:0/1425980796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c15e640 0x7fb15c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15bfff640 1 -- 172.21.15.181:0/1425980796 >> v1:172.21.15.204:6789/0 conn(0x7fb15c0cf0e0 legacy=0x7fb15c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15bfff640 1 -- 172.21.15.181:0/1425980796 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c0b1f30 con 0x7fb15c0d3660 2024-09-12T02:35:26.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.559+0000 7fb15b7fe640 1 --2- 172.21.15.181:0/1425980796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c15e640 0x7fb15c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:26.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb15bfff640 1 --2- 172.21.15.181:0/1425980796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c0d3660 0x7fb15c0cf520 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb15c15ebf0 tx=0x7fb15402a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1ba1f5e1e18aec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb15affd640 1 -- 172.21.15.181:0/1425980796 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154036070 con 0x7fb15c0d3660 2024-09-12T02:35:26.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb15affd640 1 -- 172.21.15.181:0/1425980796 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154031600 con 0x7fb15c0d3660 2024-09-12T02:35:26.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb15affd640 1 -- 172.21.15.181:0/1425980796 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540319d0 con 0x7fb15c0d3660 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 -- 172.21.15.181:0/1425980796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c0d3660 msgr2=0x7fb15c0cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 --2- 172.21.15.181:0/1425980796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c0d3660 0x7fb15c0cf520 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb15c15ebf0 tx=0x7fb15402a590 comp rx=0 tx=0).stop 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 -- 172.21.15.181:0/1425980796 shutdown_connections 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 --2- 172.21.15.181:0/1425980796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c0d3660 0x7fb15c0cf520 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 --2- 172.21.15.181:0/1425980796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c15e640 0x7fb15c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 -- 172.21.15.181:0/1425980796 >> 172.21.15.181:0/1425980796 conn(0x7fb15c09d820 msgr2=0x7fb15c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 -- 172.21.15.181:0/1425980796 shutdown_connections 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.560+0000 7fb162198640 1 -- 172.21.15.181:0/1425980796 wait complete. 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.561+0000 7fb162198640 1 Processor -- start 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.562+0000 7fb162198640 1 -- start start 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.562+0000 7fb162198640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb15c0cf0e0 0x7fb15c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.562+0000 7fb162198640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c0d3660 0x7fb15c1f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.562+0000 7fb162198640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c15e640 0x7fb15c161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.562+0000 7fb162198640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c0cfe40 con 0x7fb15c15e640 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.562+0000 7fb162198640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c0b24f0 con 0x7fb15c0cf0e0 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.562+0000 7fb162198640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb15c0b73a0 con 0x7fb15c0d3660 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c15e640 0x7fb15c161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c15e640 0x7fb15c161550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32966/0 (socket says 172.21.15.181:32966) 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 -- 172.21.15.181:0/2779486596 learned_addr learned my addr 172.21.15.181:0/2779486596 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15b7fe640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb15c0cf0e0 0x7fb15c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb152ffd640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c0d3660 0x7fb15c1f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 -- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c0d3660 msgr2=0x7fb15c1f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c0d3660 0x7fb15c1f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 -- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb15c0cf0e0 msgr2=0x7fb15c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb15c0cf0e0 0x7fb15c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 -- 172.21.15.181:0/2779486596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c1585f0 con 0x7fb15c15e640 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15b7fe640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb15c0cf0e0 0x7fb15c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb15bfff640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c15e640 0x7fb15c161550 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb15402ab80 tx=0x7fb154004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb158ff9640 1 -- 172.21.15.181:0/2779486596 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154036050 con 0x7fb15c15e640 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb158ff9640 1 -- 172.21.15.181:0/2779486596 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154042070 con 0x7fb15c15e640 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15c0cc360 con 0x7fb15c15e640 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb158ff9640 1 -- 172.21.15.181:0/2779486596 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154009510 con 0x7fb15c15e640 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.563+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15c1f7a30 con 0x7fb15c15e640 2024-09-12T02:35:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.564+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb15c0ceba0 con 0x7fb15c15e640 2024-09-12T02:35:26.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.564+0000 7fb158ff9640 1 -- 172.21.15.181:0/2779486596 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb154007bd0 con 0x7fb15c15e640 2024-09-12T02:35:26.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.565+0000 7fb158ff9640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb13c06be30 0x7fb13c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.565+0000 7fb15b7fe640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb13c06be30 0x7fb13c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.565+0000 7fb158ff9640 1 -- 172.21.15.181:0/2779486596 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7fb1540abdf0 con 0x7fb15c15e640 2024-09-12T02:35:26.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.565+0000 7fb15b7fe640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb13c06be30 0x7fb13c06e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00aa30 tx=0x7fb14c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.570+0000 7fb158ff9640 1 -- 172.21.15.181:0/2779486596 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb15407a7a0 con 0x7fb15c15e640 2024-09-12T02:35:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.737+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb15c06cc80 con 0x7fb15c15e640 2024-09-12T02:35:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.738+0000 7fb158ff9640 1 -- 172.21.15.181:0/2779486596 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16813 (secure 0 0 0) 0x7fb15407a0a0 con 0x7fb15c15e640 2024-09-12T02:35:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:26.739 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":74,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:25.750210+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:24.367784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:24.724437+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb13c06be30 msgr2=0x7fb13c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb13c06be30 0x7fb13c06e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00aa30 tx=0x7fb14c008040 comp rx=0 tx=0).stop 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c15e640 msgr2=0x7fb15c161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c15e640 0x7fb15c161550 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb15402ab80 tx=0x7fb154004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 shutdown_connections 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb13c06be30 0x7fb13c06e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15c15e640 0x7fb15c161550 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb15c0d3660 0x7fb15c1f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 --2- 172.21.15.181:0/2779486596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb15c0cf0e0 0x7fb15c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.740+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 >> 172.21.15.181:0/2779486596 conn(0x7fb15c09d820 msgr2=0x7fb15c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.741+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 shutdown_connections 2024-09-12T02:35:26.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.741+0000 7fb162198640 1 -- 172.21.15.181:0/2779486596 wait complete. 2024-09-12T02:35:26.753 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:26.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.852+0000 7eff244ae640 1 Processor -- start 2024-09-12T02:35:26.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.852+0000 7eff244ae640 1 -- start start 2024-09-12T02:35:26.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff244ae640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0b3800 0x7eff1c15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff244ae640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7eff1c0d08f0 0x7eff1c072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff244ae640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c0b2820 con 0x7eff1c0d0510 2024-09-12T02:35:26.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff244ae640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c0b2b00 con 0x7eff1c0d08f0 2024-09-12T02:35:26.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff244ae640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c141730 con 0x7eff1c0b3800 2024-09-12T02:35:26.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff2224a640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7eff1c0d0510 0x7eff1c0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55624/0 (socket says 172.21.15.181:55624) 2024-09-12T02:35:26.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff2224a640 1 -- 172.21.15.181:0/1815721266 learned_addr learned my addr 172.21.15.181:0/1815721266 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:26.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff21a49640 1 --2- 172.21.15.181:0/1815721266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0b3800 0x7eff1c15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff22a4b640 1 --2- 172.21.15.181:0/1815721266 >> v2:172.21.15.204:3300/0 conn(0x7eff1c0d08f0 0x7eff1c072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff21248640 1 -- 172.21.15.181:0/1815721266 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873779071 0 0) 0x7eff1c0b2820 con 0x7eff1c0d0510 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.853+0000 7eff21248640 1 -- 172.21.15.181:0/1815721266 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff08003520 con 0x7eff1c0d0510 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.854+0000 7eff21a49640 1 -- 172.21.15.181:0/1815721266 >> v2:172.21.15.204:3300/0 conn(0x7eff1c0d08f0 msgr2=0x7eff1c072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.854+0000 7eff21a49640 1 --2- 172.21.15.181:0/1815721266 >> v2:172.21.15.204:3300/0 conn(0x7eff1c0d08f0 0x7eff1c072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.854+0000 7eff21a49640 1 -- 172.21.15.181:0/1815721266 >> v1:172.21.15.181:6789/0 conn(0x7eff1c0d0510 legacy=0x7eff1c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.854+0000 7eff21a49640 1 -- 172.21.15.181:0/1815721266 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c144320 con 0x7eff1c0b3800 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.854+0000 7eff22a4b640 1 --2- 172.21.15.181:0/1815721266 >> v2:172.21.15.204:3300/0 conn(0x7eff1c0d08f0 0x7eff1c072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.854+0000 7eff21a49640 1 --2- 172.21.15.181:0/1815721266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0b3800 0x7eff1c15ef90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097a0 tx=0x7eff0c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af7b5e66dafabff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff21248640 1 -- 172.21.15.181:0/1815721266 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c037070 con 0x7eff1c0b3800 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff21248640 1 -- 172.21.15.181:0/1815721266 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c032440 con 0x7eff1c0b3800 2024-09-12T02:35:26.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff21248640 1 -- 172.21.15.181:0/1815721266 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0327f0 con 0x7eff1c0b3800 2024-09-12T02:35:26.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 -- 172.21.15.181:0/1815721266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0b3800 msgr2=0x7eff1c15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 --2- 172.21.15.181:0/1815721266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0b3800 0x7eff1c15ef90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097a0 tx=0x7eff0c02a180 comp rx=0 tx=0).stop 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 -- 172.21.15.181:0/1815721266 shutdown_connections 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 --2- 172.21.15.181:0/1815721266 >> v2:172.21.15.204:3300/0 conn(0x7eff1c0d08f0 0x7eff1c072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 --2- 172.21.15.181:0/1815721266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0b3800 0x7eff1c15ef90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 -- 172.21.15.181:0/1815721266 >> 172.21.15.181:0/1815721266 conn(0x7eff1c06bc10 msgr2=0x7eff1c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 -- 172.21.15.181:0/1815721266 shutdown_connections 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.855+0000 7eff244ae640 1 -- 172.21.15.181:0/1815721266 wait complete. 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.856+0000 7eff244ae640 1 Processor -- start 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.856+0000 7eff244ae640 1 -- start start 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff244ae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff1c0b3800 0x7eff1c1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff244ae640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0d0510 0x7eff1c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff244ae640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff1c0d08f0 0x7eff1c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff244ae640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0b1df0 con 0x7eff1c0b3800 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff244ae640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c143dc0 con 0x7eff1c0d08f0 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff244ae640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c0b1f70 con 0x7eff1c0d0510 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff2224a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff1c0b3800 0x7eff1c1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff2224a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff1c0b3800 0x7eff1c1596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32978/0 (socket says 172.21.15.181:32978) 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff2224a640 1 -- 172.21.15.181:0/4159475788 learned_addr learned my addr 172.21.15.181:0/4159475788 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff21a49640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0d0510 0x7eff1c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff22a4b640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff1c0d08f0 0x7eff1c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff2224a640 1 -- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0d0510 msgr2=0x7eff1c156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff2224a640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0d0510 0x7eff1c156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.857+0000 7eff2224a640 1 -- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff1c0d08f0 msgr2=0x7eff1c15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff2224a640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff1c0d08f0 0x7eff1c15c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff2224a640 1 -- 172.21.15.181:0/4159475788 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c156e60 con 0x7eff1c0b3800 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff21a49640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0d0510 0x7eff1c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff22a4b640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff1c0d08f0 0x7eff1c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff2224a640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff1c0b3800 0x7eff1c1596e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c430 tx=0x7eff1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff12ffd640 1 -- 172.21.15.181:0/4159475788 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18017070 con 0x7eff1c0b3800 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff12ffd640 1 -- 172.21.15.181:0/4159475788 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff18005ce0 con 0x7eff1c0b3800 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c155880 con 0x7eff1c0b3800 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff12ffd640 1 -- 172.21.15.181:0/4159475788 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180072f0 con 0x7eff1c0b3800 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.858+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c155e40 con 0x7eff1c0b3800 2024-09-12T02:35:26.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.859+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c141510 con 0x7eff1c0b3800 2024-09-12T02:35:26.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.859+0000 7eff12ffd640 1 -- 172.21.15.181:0/4159475788 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff1801a070 con 0x7eff1c0b3800 2024-09-12T02:35:26.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.860+0000 7eff12ffd640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff0006be30 0x7eff0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.860+0000 7eff21a49640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff0006be30 0x7eff0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.860+0000 7eff12ffd640 1 -- 172.21.15.181:0/4159475788 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7eff1808a250 con 0x7eff1c0b3800 2024-09-12T02:35:26.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.860+0000 7eff21a49640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff0006be30 0x7eff0006e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff0c034000 tx=0x7eff0c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:26.864+0000 7eff12ffd640 1 -- 172.21.15.181:0/4159475788 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff1c156e60 con 0x7eff1c0b3800 2024-09-12T02:35:27.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.031+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff1c0b2360 con 0x7eff1c0b3800 2024-09-12T02:35:27.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.032+0000 7eff12ffd640 1 -- 172.21.15.181:0/4159475788 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16813 (secure 0 0 0) 0x7eff18058c90 con 0x7eff1c0b3800 2024-09-12T02:35:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:27.033 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":74,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:25.750210+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:24.367784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:24.724437+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:27.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff0006be30 msgr2=0x7eff0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff0006be30 0x7eff0006e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff0c034000 tx=0x7eff0c02e000 comp rx=0 tx=0).stop 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff1c0b3800 msgr2=0x7eff1c1596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff1c0b3800 0x7eff1c1596e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c430 tx=0x7eff1800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 shutdown_connections 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7eff0006be30 0x7eff0006e2f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7eff1c0d08f0 0x7eff1c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7eff1c0d0510 0x7eff1c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 --2- 172.21.15.181:0/4159475788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff1c0b3800 0x7eff1c1596e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.034+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 >> 172.21.15.181:0/4159475788 conn(0x7eff1c06bc10 msgr2=0x7eff1c0b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.035+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 shutdown_connections 2024-09-12T02:35:27.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.035+0000 7eff244ae640 1 -- 172.21.15.181:0/4159475788 wait complete. 2024-09-12T02:35:27.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:35:27.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.149+0000 7fe88f911640 1 Processor -- start 2024-09-12T02:35:27.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.149+0000 7fe88f911640 1 -- start start 2024-09-12T02:35:27.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88f911640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88f911640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe888073d30 0x7fe8880d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88f911640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe888070090 con 0x7fe8880d26e0 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88f911640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe88815ff40 con 0x7fe888073d30 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88f911640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe88815edf0 con 0x7fe88815c1f0 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88ceac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe888073d30 0x7fe8880d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88ceac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe888073d30 0x7fe8880d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32986/0 (socket says 172.21.15.181:32986) 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88ceac640 1 -- 172.21.15.181:0/691234052 learned_addr learned my addr 172.21.15.181:0/691234052 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88d6ad640 1 --2- 172.21.15.181:0/691234052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88ceac640 1 -- 172.21.15.181:0/691234052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 msgr2=0x7fe88806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.150+0000 7fe88ceac640 1 --2- 172.21.15.181:0/691234052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.151+0000 7fe88ceac640 1 -- 172.21.15.181:0/691234052 >> v1:172.21.15.204:6789/0 conn(0x7fe8880d26e0 legacy=0x7fe8880d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:27.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.151+0000 7fe88ceac640 1 -- 172.21.15.181:0/691234052 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88815f040 con 0x7fe888073d30 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.151+0000 7fe88ceac640 1 --2- 172.21.15.181:0/691234052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe8880d21a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe878009870 tx=0x7fe87802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2879434fc46bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.151+0000 7fe87ffff640 1 -- 172.21.15.181:0/691234052 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878037070 con 0x7fe888073d30 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.151+0000 7fe87ffff640 1 -- 172.21.15.181:0/691234052 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878032440 con 0x7fe888073d30 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.151+0000 7fe87ffff640 1 -- 172.21.15.181:0/691234052 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878032810 con 0x7fe888073d30 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 -- 172.21.15.181:0/691234052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 msgr2=0x7fe8880d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 --2- 172.21.15.181:0/691234052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe8880d21a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe878009870 tx=0x7fe87802a210 comp rx=0 tx=0).stop 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 -- 172.21.15.181:0/691234052 shutdown_connections 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 --2- 172.21.15.181:0/691234052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe8880d21a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 --2- 172.21.15.181:0/691234052 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 -- 172.21.15.181:0/691234052 >> 172.21.15.181:0/691234052 conn(0x7fe8880b7db0 msgr2=0x7fe888067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:27.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 -- 172.21.15.181:0/691234052 shutdown_connections 2024-09-12T02:35:27.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.152+0000 7fe88f911640 1 -- 172.21.15.181:0/691234052 wait complete. 2024-09-12T02:35:27.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.153+0000 7fe88f911640 1 Processor -- start 2024-09-12T02:35:27.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.153+0000 7fe88f911640 1 -- start start 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88f911640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe88815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88f911640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8880d26e0 0x7fe8880cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88f911640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88f911640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe88815f8e0 con 0x7fe888073d30 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88f911640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe88815f600 con 0x7fe8880d26e0 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88f911640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880d2b00 con 0x7fe88815c1f0 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe88815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe88815ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32996/0 (socket says 172.21.15.181:32996) 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 -- 172.21.15.181:0/85913144 learned_addr learned my addr 172.21.15.181:0/85913144 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:27.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88ceac640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8880d26e0 0x7fe8880cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88deae640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 -- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 msgr2=0x7fe88814ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88814ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 -- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8880d26e0 msgr2=0x7fe8880cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8880d26e0 0x7fe8880cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88d6ad640 1 -- 172.21.15.181:0/85913144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88815b200 con 0x7fe888073d30 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.154+0000 7fe88deae640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88814ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.155+0000 7fe88d6ad640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe88815ac20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c7f0 tx=0x7fe88400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:27.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.155+0000 7fe87dffb640 1 -- 172.21.15.181:0/85913144 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884015070 con 0x7fe888073d30 2024-09-12T02:35:27.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.155+0000 7fe87dffb640 1 -- 172.21.15.181:0/85913144 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe884004220 con 0x7fe888073d30 2024-09-12T02:35:27.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.155+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88815b4e0 con 0x7fe888073d30 2024-09-12T02:35:27.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.155+0000 7fe87dffb640 1 -- 172.21.15.181:0/85913144 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884007620 con 0x7fe888073d30 2024-09-12T02:35:27.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.155+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8880cf560 con 0x7fe888073d30 2024-09-12T02:35:27.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.156+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88815ba00 con 0x7fe888073d30 2024-09-12T02:35:27.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.156+0000 7fe87dffb640 1 -- 172.21.15.181:0/85913144 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8840079d0 con 0x7fe888073d30 2024-09-12T02:35:27.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.157+0000 7fe87dffb640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe86c06be30 0x7fe86c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.157+0000 7fe87dffb640 1 -- 172.21.15.181:0/85913144 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7fe88408ad90 con 0x7fe888073d30 2024-09-12T02:35:27.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.157+0000 7fe88ceac640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe86c06be30 0x7fe86c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.157+0000 7fe88ceac640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe86c06be30 0x7fe86c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe878034000 tx=0x7fe87802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:27.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.161+0000 7fe87dffb640 1 -- 172.21.15.181:0/85913144 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe884059180 con 0x7fe888073d30 2024-09-12T02:35:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.359+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe88815c5d0 con 0x7fe888073d30 2024-09-12T02:35:27.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.435+0000 7fe87dffb640 1 -- 172.21.15.181:0/85913144 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) ==== 118+0+0 (secure 0 0 0) 0x7fe88405d480 con 0x7fe888073d30 2024-09-12T02:35:27.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe86c06be30 msgr2=0x7fe86c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe86c06be30 0x7fe86c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe878034000 tx=0x7fe87802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:27.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 msgr2=0x7fe88815ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe88815ac20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c7f0 tx=0x7fe88400ccb0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 shutdown_connections 2024-09-12T02:35:27.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe86c06be30 0x7fe86c06e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8880d26e0 0x7fe8880cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe88815c1f0 0x7fe88814ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 --2- 172.21.15.181:0/85913144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe888073d30 0x7fe88815ac20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 >> 172.21.15.181:0/85913144 conn(0x7fe8880b7db0 msgr2=0x7fe8880b67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:27.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 shutdown_connections 2024-09-12T02:35:27.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.437+0000 7fe88f911640 1 -- 172.21.15.181:0/85913144 wait complete. 2024-09-12T02:35:27.449 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:35:27.449 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:35:27.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.550+0000 7f79f0c5e640 1 Processor -- start 2024-09-12T02:35:27.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.550+0000 7f79f0c5e640 1 -- start start 2024-09-12T02:35:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79f0c5e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f79ec145110 0x7f79ec0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79f0c5e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec1454f0 con 0x7f79ec0b2530 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79f0c5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec072f50 con 0x7f79ec145700 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79f0c5e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f79ec073b60 con 0x7f79ec145110 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79ead9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f79ec0b2530 0x7f79ec0cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55632/0 (socket says 172.21.15.181:55632) 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79ead9d640 1 -- 172.21.15.181:0/3043272194 learned_addr learned my addr 172.21.15.181:0/3043272194 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79ea59c640 1 --2- 172.21.15.181:0/3043272194 >> v2:172.21.15.204:3300/0 conn(0x7f79ec145110 0x7f79ec0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99819524 0 0) 0x7f79ec1454f0 con 0x7f79ec0b2530 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79d8003520 con 0x7f79ec0b2530 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2483310009 0 0) 0x7f79d8003520 con 0x7f79ec0b2530 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 >> v2:172.21.15.204:3300/0 conn(0x7f79ec145110 msgr2=0x7f79ec0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 --2- 172.21.15.181:0/3043272194 >> v2:172.21.15.204:3300/0 conn(0x7f79ec145110 0x7f79ec0af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 >> v1:172.21.15.204:6789/0 conn(0x7f79ec145700 legacy=0x7f79ec0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec073230 con 0x7f79ec0b2530 2024-09-12T02:35:27.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.551+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f79e40019f0 con 0x7f79ec0b2530 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 >> v1:172.21.15.181:6789/0 conn(0x7f79ec0b2530 legacy=0x7f79ec0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e9d9b640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79d80039b0 0x7f79d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e9d9b640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e9d9b640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d80051c0 0x7f79d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec073b60 con 0x7f79d8004800 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f79d800c160 con 0x7f79d80039b0 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f79d800c360 con 0x7f79d80051c0 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e1d9b640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79ea59c640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79d80039b0 0x7f79d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79ead9d640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d80051c0 0x7f79d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e1d9b640 1 -- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d80051c0 msgr2=0x7f79d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:27.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e1d9b640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d80051c0 0x7f79d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e1d9b640 1 -- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79d80039b0 msgr2=0x7f79d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e1d9b640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79d80039b0 0x7f79d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79e1d9b640 1 -- 172.21.15.181:0/3043272194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d8003520 con 0x7f79d8004800 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79ead9d640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d80051c0 0x7f79d800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.552+0000 7f79ead9d640 1 -- 172.21.15.181:0/3043272194 reap_dead start 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79e1d9b640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001750 tx=0x7f79d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668496657b4b1b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d4001370 con 0x7f79d8004800 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d40052d0 con 0x7f79d8004800 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79e9d9b640 1 -- 172.21.15.181:0/3043272194 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d402abc0 con 0x7f79d8004800 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79f0c5e640 1 -- 172.21.15.181:0/3043272194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79d8004800 msgr2=0x7f79d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001750 tx=0x7f79d8005830 comp rx=0 tx=0).stop 2024-09-12T02:35:27.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79f0c5e640 1 -- 172.21.15.181:0/3043272194 shutdown_connections 2024-09-12T02:35:27.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/3043272194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79f0c5e640 1 -- 172.21.15.181:0/3043272194 >> 172.21.15.181:0/3043272194 conn(0x7f79ec06bc10 msgr2=0x7f79ec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:27.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79f0c5e640 1 -- 172.21.15.181:0/3043272194 shutdown_connections 2024-09-12T02:35:27.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.553+0000 7f79f0c5e640 1 -- 172.21.15.181:0/3043272194 wait complete. 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 Processor -- start 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 -- start start 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d8004800 0x7f79ec0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec144740 0x7f79ec141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79ec1423b0 0x7f79ec1f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec0af6f0 con 0x7f79ec144740 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec0737f0 con 0x7f79ec1423b0 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.555+0000 7f79f0c5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec0af870 con 0x7f79d8004800 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec144740 0x7f79ec141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec144740 0x7f79ec141e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33006/0 (socket says 172.21.15.181:33006) 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 -- 172.21.15.181:0/2450115072 learned_addr learned my addr 172.21.15.181:0/2450115072 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79ea59c640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d8004800 0x7f79ec0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79ead9d640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79ec1423b0 0x7f79ec1f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 -- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d8004800 msgr2=0x7f79ec0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d8004800 0x7f79ec0aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 -- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79ec1423b0 msgr2=0x7f79ec1f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79ec1423b0 0x7f79ec1f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 -- 172.21.15.181:0/2450115072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec1f7860 con 0x7f79ec144740 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79ead9d640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79ec1423b0 0x7f79ec1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e1d9b640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec144740 0x7f79ec141e70 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001870 tx=0x7f79d4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e37fe640 1 -- 172.21.15.181:0/2450115072 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d4037040 con 0x7f79ec144740 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e37fe640 1 -- 172.21.15.181:0/2450115072 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d4040070 con 0x7f79ec144740 2024-09-12T02:35:27.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79e37fe640 1 -- 172.21.15.181:0/2450115072 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d4007a30 con 0x7f79ec144740 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec1f7ad0 con 0x7f79ec144740 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.556+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec1f8090 con 0x7f79ec144740 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.557+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ec069170 con 0x7f79ec144740 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.558+0000 7f79e37fe640 1 -- 172.21.15.181:0/2450115072 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79d40052d0 con 0x7f79ec144740 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.558+0000 7f79e37fe640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f79cc06be30 0x7f79cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.558+0000 7f79e37fe640 1 -- 172.21.15.181:0/2450115072 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f79d40aaa70 con 0x7f79ec144740 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.558+0000 7f79ea59c640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f79cc06be30 0x7f79cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.559+0000 7f79ea59c640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f79cc06be30 0x7f79cc06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c40 tx=0x7f79dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:27.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.562+0000 7f79e37fe640 1 -- 172.21.15.181:0/2450115072 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79d4079390 con 0x7f79ec144740 2024-09-12T02:35:27.680 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-09-12T02:35:27.680+0000 7f94dcb1b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:35:27.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:27.763+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f79ec0b1e20 con 0x7f79ec144740 2024-09-12T02:35:28.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.440+0000 7f79e37fe640 1 -- 172.21.15.181:0/2450115072 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) ==== 122+0+0 (secure 0 0 0) 0x7f79d4078c90 con 0x7f79ec144740 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f79cc06be30 msgr2=0x7f79cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f79cc06be30 0x7f79cc06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c40 tx=0x7f79dc009190 comp rx=0 tx=0).stop 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec144740 msgr2=0x7f79ec141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec144740 0x7f79ec141e70 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001870 tx=0x7f79d4001120 comp rx=0 tx=0).stop 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 shutdown_connections 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f79cc06be30 0x7f79cc06e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79ec1423b0 0x7f79ec1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec144740 0x7f79ec141e70 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 --2- 172.21.15.181:0/2450115072 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f79d8004800 0x7f79ec0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 >> 172.21.15.181:0/2450115072 conn(0x7f79ec06bc10 msgr2=0x7f79ec0b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 shutdown_connections 2024-09-12T02:35:28.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.443+0000 7f79f0c5e640 1 -- 172.21.15.181:0/2450115072 wait complete. 2024-09-12T02:35:28.457 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:35:28.457 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:28.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.559+0000 7f2b5ca53640 1 Processor -- start 2024-09-12T02:35:28.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.559+0000 7f2b5ca53640 1 -- start start 2024-09-12T02:35:28.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.560+0000 7f2b5ca53640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2b580d1670 0x7f2b5815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.560+0000 7f2b5ca53640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b580d1a50 0x7f2b580cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.560+0000 7f2b5ca53640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b580afa20 con 0x7f2b580cf310 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.560+0000 7f2b5ca53640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5815eef0 con 0x7f2b580d1a50 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.560+0000 7f2b5ca53640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5815f170 con 0x7f2b580d1670 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b55d9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b580d1a50 0x7f2b580cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b56d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2b580cf310 0x7f2b58162660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55640/0 (socket says 172.21.15.181:55640) 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b56d9d640 1 -- 172.21.15.181:0/3503385639 learned_addr learned my addr 172.21.15.181:0/3503385639 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b5659c640 1 --2- 172.21.15.181:0/3503385639 >> v2:172.21.15.204:3300/0 conn(0x7f2b580d1670 0x7f2b5815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b55d9b640 1 -- 172.21.15.181:0/3503385639 >> v2:172.21.15.204:3300/0 conn(0x7f2b580d1670 msgr2=0x7f2b5815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b55d9b640 1 --2- 172.21.15.181:0/3503385639 >> v2:172.21.15.204:3300/0 conn(0x7f2b580d1670 0x7f2b5815e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b55d9b640 1 -- 172.21.15.181:0/3503385639 >> v1:172.21.15.181:6789/0 conn(0x7f2b580cf310 legacy=0x7f2b58162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b55d9b640 1 -- 172.21.15.181:0/3503385639 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5815f450 con 0x7f2b580d1a50 2024-09-12T02:35:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.561+0000 7f2b5659c640 1 --2- 172.21.15.181:0/3503385639 >> v2:172.21.15.204:3300/0 conn(0x7f2b580d1670 0x7f2b5815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b55d9b640 1 --2- 172.21.15.181:0/3503385639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580cedd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2b580ce290 tx=0x7f2b4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e998230b5fecc592 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5559a640 1 -- 172.21.15.181:0/3503385639 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40037070 con 0x7f2b580d1a50 2024-09-12T02:35:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5559a640 1 -- 172.21.15.181:0/3503385639 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b40032440 con 0x7f2b580d1a50 2024-09-12T02:35:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5559a640 1 -- 172.21.15.181:0/3503385639 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40032810 con 0x7f2b580d1a50 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 -- 172.21.15.181:0/3503385639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 msgr2=0x7f2b580cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/3503385639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580cedd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2b580ce290 tx=0x7f2b4002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 -- 172.21.15.181:0/3503385639 shutdown_connections 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/3503385639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580cedd0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/3503385639 >> v2:172.21.15.204:3300/0 conn(0x7f2b580d1670 0x7f2b5815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 -- 172.21.15.181:0/3503385639 >> 172.21.15.181:0/3503385639 conn(0x7f2b5806d110 msgr2=0x7f2b5806d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 -- 172.21.15.181:0/3503385639 shutdown_connections 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.562+0000 7f2b5ca53640 1 -- 172.21.15.181:0/3503385639 wait complete. 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 Processor -- start 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 -- start start 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b580cf310 0x7f2b580b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580d1670 0x7f2b581e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580d1eb0 con 0x7f2b580d1a50 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2b58162d70 con 0x7f2b580d1670 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.564+0000 7f2b5ca53640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2b580b01c0 con 0x7f2b580cf310 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33028/0 (socket says 172.21.15.181:33028) 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 -- 172.21.15.181:0/4287269501 learned_addr learned my addr 172.21.15.181:0/4287269501 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b55d9b640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580d1670 0x7f2b581e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b5659c640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b580cf310 0x7f2b580b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 -- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b580cf310 msgr2=0x7f2b580b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b580cf310 0x7f2b580b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 -- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580d1670 msgr2=0x7f2b581e9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580d1670 0x7f2b581e9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 -- 172.21.15.181:0/4287269501 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b580b5980 con 0x7f2b580d1a50 2024-09-12T02:35:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b5659c640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b580cf310 0x7f2b580b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b56d9d640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580b6a20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000cb10 tx=0x7f2b5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b4effd640 1 -- 172.21.15.181:0/4287269501 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50017070 con 0x7f2b580d1a50 2024-09-12T02:35:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b4effd640 1 -- 172.21.15.181:0/4287269501 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5000ac70 con 0x7f2b580d1a50 2024-09-12T02:35:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b580b5c60 con 0x7f2b580d1a50 2024-09-12T02:35:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b4effd640 1 -- 172.21.15.181:0/4287269501 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50012600 con 0x7f2b580d1a50 2024-09-12T02:35:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.565+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b580b6220 con 0x7f2b580d1a50 2024-09-12T02:35:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.566+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5815e9b0 con 0x7f2b580d1a50 2024-09-12T02:35:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.567+0000 7f2b4effd640 1 -- 172.21.15.181:0/4287269501 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b5001a070 con 0x7f2b580d1a50 2024-09-12T02:35:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.567+0000 7f2b4effd640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3806be30 0x7f2b3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.567+0000 7f2b4effd640 1 -- 172.21.15.181:0/4287269501 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f2b5008aab0 con 0x7f2b580d1a50 2024-09-12T02:35:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.567+0000 7f2b5659c640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3806be30 0x7f2b3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.568+0000 7f2b5659c640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3806be30 0x7f2b3806e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800aa30 tx=0x7f2b48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.571+0000 7f2b4effd640 1 -- 172.21.15.181:0/4287269501 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b580afa20 con 0x7f2b580d1a50 2024-09-12T02:35:28.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.770+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b5806e410 con 0x7f2b580d1a50 2024-09-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.771+0000 7f2b4effd640 1 -- 172.21.15.181:0/4287269501 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5234 (secure 0 0 0) 0x7f2b5000ae20 con 0x7f2b580d1a50 2024-09-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"btime":"2024-09-12T02:35:28:436708+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:25.750512+0000","modified":"2024-09-12T02:35:27.765241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6834/1682794667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1682794667},{"type":"v1","addr":"172.21.15.204:6834","nonce":1682794667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6780,"qdb_cluster":[6780]},"id":5}]} 2024-09-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 63 2024-09-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3806be30 msgr2=0x7f2b3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3806be30 0x7f2b3806e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800aa30 tx=0x7f2b48008040 comp rx=0 tx=0).stop 2024-09-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 msgr2=0x7f2b580b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580b6a20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000cb10 tx=0x7f2b5000a060 comp rx=0 tx=0).stop 2024-09-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 shutdown_connections 2024-09-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2b3806be30 0x7f2b3806e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b580d1670 0x7f2b581e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b580d1a50 0x7f2b580b6a20 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 --2- 172.21.15.181:0/4287269501 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b580cf310 0x7f2b580b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 >> 172.21.15.181:0/4287269501 conn(0x7f2b5806d110 msgr2=0x7f2b58071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 shutdown_connections 2024-09-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.773+0000 7f2b5ca53640 1 -- 172.21.15.181:0/4287269501 wait complete. 2024-09-12T02:35:28.785 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.887+0000 7f7d8e80e640 1 Processor -- start 2024-09-12T02:35:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.887+0000 7f7d8e80e640 1 -- start start 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.888+0000 7f7d8e80e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7d880d1d00 0x7f7d8815c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.888+0000 7f7d8e80e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d88071e00 con 0x7f7d88156700 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.888+0000 7f7d8e80e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d88160740 con 0x7f7d88156ae0 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.888+0000 7f7d8e80e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7d88160a20 con 0x7f7d880d1d00 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.888+0000 7f7d87fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7d88156700 0x7f7d8815fef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55650/0 (socket says 172.21.15.181:55650) 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.888+0000 7f7d87fff640 1 -- 172.21.15.181:0/3052371178 learned_addr learned my addr 172.21.15.181:0/3052371178 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d8cdab640 1 --2- 172.21.15.181:0/3052371178 >> v2:172.21.15.204:3300/0 conn(0x7f7d880d1d00 0x7f7d8815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855250842 0 0) 0x7f7d88071e00 con 0x7f7d88156700 2024-09-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d70003520 con 0x7f7d88156700 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1445419607 0 0) 0x7f7d70003520 con 0x7f7d88156700 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 >> v2:172.21.15.204:3300/0 conn(0x7f7d880d1d00 msgr2=0x7f7d8815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 --2- 172.21.15.181:0/3052371178 >> v2:172.21.15.204:3300/0 conn(0x7f7d880d1d00 0x7f7d8815c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 >> v1:172.21.15.204:6789/0 conn(0x7f7d88156ae0 legacy=0x7f7d880d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d88072070 con 0x7f7d88156700 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f7d78001670 con 0x7f7d88156700 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 >> v1:172.21.15.181:6789/0 conn(0x7f7d88156700 legacy=0x7f7d8815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d700039b0 0x7f7d70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d70004800 0x7f7d70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d700051c0 0x7f7d7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88160a20 con 0x7f7d700039b0 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7000c060 con 0x7f7d700051c0 2024-09-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7000c260 con 0x7f7d70004800 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d87fff640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d700039b0 0x7f7d70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d8cdab640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d700051c0 0x7f7d7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d877fe640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d70004800 0x7f7d70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d87fff640 1 -- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d70004800 msgr2=0x7f7d70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d87fff640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d70004800 0x7f7d70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d87fff640 1 -- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d700051c0 msgr2=0x7f7d7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d87fff640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d700051c0 0x7f7d7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d87fff640 1 -- 172.21.15.181:0/3052371178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d70003520 con 0x7f7d700039b0 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d8cdab640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d700051c0 0x7f7d7000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.889+0000 7f7d8cdab640 1 -- 172.21.15.181:0/3052371178 reap_dead start 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.890+0000 7f7d87fff640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d700039b0 0x7f7d70003dd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800c240 tx=0x7f7d70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbaef13e06109fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.890+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78007cf0 con 0x7f7d700039b0 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.890+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d78005af0 con 0x7f7d700039b0 2024-09-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.890+0000 7f7d86ffd640 1 -- 172.21.15.181:0/3052371178 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78007070 con 0x7f7d700039b0 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.891+0000 7f7d8e80e640 1 -- 172.21.15.181:0/3052371178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d700039b0 msgr2=0x7f7d70003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.891+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d700039b0 0x7f7d70003dd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800c240 tx=0x7f7d70005830 comp rx=0 tx=0).stop 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.891+0000 7f7d8e80e640 1 -- 172.21.15.181:0/3052371178 shutdown_connections 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.891+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/3052371178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d700039b0 0x7f7d70003dd0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.891+0000 7f7d8e80e640 1 -- 172.21.15.181:0/3052371178 >> 172.21.15.181:0/3052371178 conn(0x7f7d8806d110 msgr2=0x7f7d8806d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.891+0000 7f7d8e80e640 1 -- 172.21.15.181:0/3052371178 shutdown_connections 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.891+0000 7f7d8e80e640 1 -- 172.21.15.181:0/3052371178 wait complete. 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.892+0000 7f7d8e80e640 1 Processor -- start 2024-09-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.892+0000 7f7d8e80e640 1 -- start start 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8e80e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d700039b0 0x7f7d88145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8e80e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d88158b70 0x7f7d88158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8e80e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d88156f80 0x7f7d88157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8e80e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8815cc90 con 0x7f7d88158b70 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8e80e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8815cb10 con 0x7f7d88156f80 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8e80e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7d880d15f0 con 0x7f7d700039b0 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d88158b70 0x7f7d88158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d88158b70 0x7f7d88158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33046/0 (socket says 172.21.15.181:33046) 2024-09-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 -- 172.21.15.181:0/2313791849 learned_addr learned my addr 172.21.15.181:0/2313791849 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8cdab640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d88156f80 0x7f7d88157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d87fff640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d700039b0 0x7f7d88145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 -- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d700039b0 msgr2=0x7f7d88145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d700039b0 0x7f7d88145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 -- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d88156f80 msgr2=0x7f7d88157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d88156f80 0x7f7d88157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 -- 172.21.15.181:0/2313791849 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d88157d00 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d8cdab640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d88156f80 0x7f7d88157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d87fff640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d700039b0 0x7f7d88145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d877fe640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d88158b70 0x7f7d88158fd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00e500 tx=0x7f7d7c00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.893+0000 7f7d84ff9640 1 -- 172.21.15.181:0/2313791849 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0053a0 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.894+0000 7f7d84ff9640 1 -- 172.21.15.181:0/2313791849 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c018070 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.894+0000 7f7d84ff9640 1 -- 172.21.15.181:0/2313791849 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c003810 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.894+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d88157fe0 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.894+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881585a0 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.895+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d880d1980 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.895+0000 7f7d84ff9640 1 -- 172.21.15.181:0/2313791849 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d7c0039b0 con 0x7f7d88158b70 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.895+0000 7f7d84ff9640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7d7406be60 0x7f7d7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.896+0000 7f7d84ff9640 1 -- 172.21.15.181:0/2313791849 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f7d7c08aa60 con 0x7f7d88158b70 2024-09-12T02:35:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.896+0000 7f7d87fff640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7d7406be60 0x7f7d7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.896+0000 7f7d87fff640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7d7406be60 0x7f7d7406e320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7d78032000 tx=0x7f7d78009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:28.900+0000 7f7d84ff9640 1 -- 172.21.15.181:0/2313791849 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d7c059420 con 0x7f7d88158b70 2024-09-12T02:35:29.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.065+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d8815dcf0 con 0x7f7d88158b70 2024-09-12T02:35:29.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.066+0000 7f7d84ff9640 1 -- 172.21.15.181:0/2313791849 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16800 (secure 0 0 0) 0x7f7d7c058d20 con 0x7f7d88158b70 2024-09-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":75,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:27.429904+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:24.367784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:24.724437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7d7406be60 msgr2=0x7f7d7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7d7406be60 0x7f7d7406e320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7d78032000 tx=0x7f7d78009030 comp rx=0 tx=0).stop 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d88158b70 msgr2=0x7f7d88158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d88158b70 0x7f7d88158fd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00e500 tx=0x7f7d7c00e9c0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 shutdown_connections 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7d7406be60 0x7f7d7406e320 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7d88156f80 0x7f7d88157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d88158b70 0x7f7d88158fd0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 --2- 172.21.15.181:0/2313791849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7d700039b0 0x7f7d88145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 >> 172.21.15.181:0/2313791849 conn(0x7f7d8806d110 msgr2=0x7f7d8806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:29.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 shutdown_connections 2024-09-12T02:35:29.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.068+0000 7f7d8e80e640 1 -- 172.21.15.181:0/2313791849 wait complete. 2024-09-12T02:35:29.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:35:29.081 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.180+0000 7f7e12da6640 1 Processor -- start 2024-09-12T02:35:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.180+0000 7f7e12da6640 1 -- start start 2024-09-12T02:35:29.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.180+0000 7f7e12da6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c15b2e0 0x7f7e0c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e12da6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cdfc0 0x7f7e0c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e12da6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e0c0ce4f0 con 0x7f7e0c0b22c0 2024-09-12T02:35:29.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e12da6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7e0c15b6c0 con 0x7f7e0c0cdfc0 2024-09-12T02:35:29.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e12da6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c0ce7d0 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e11343640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7e0c0b22c0 0x7f7e0c0ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:55662/0 (socket says 172.21.15.181:55662) 2024-09-12T02:35:29.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e11343640 1 -- 172.21.15.181:0/2569731114 learned_addr learned my addr 172.21.15.181:0/2569731114 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:29.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0bfff640 1 --2- 172.21.15.181:0/2569731114 >> v2:172.21.15.204:3300/0 conn(0x7f7e0c0cdfc0 0x7f7e0c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e10b42640 1 --2- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c15b2e0 0x7f7e0c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0b7fe640 1 -- 172.21.15.181:0/2569731114 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110520783 0 0) 0x7f7e0c0ce4f0 con 0x7f7e0c0b22c0 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0b7fe640 1 -- 172.21.15.181:0/2569731114 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7df8003520 con 0x7f7e0c0b22c0 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0b7fe640 1 -- 172.21.15.181:0/2569731114 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960708799 0 0) 0x7f7df8003520 con 0x7f7e0c0b22c0 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0bfff640 1 -- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c15b2e0 msgr2=0x7f7e0c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0bfff640 1 --2- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c15b2e0 0x7f7e0c0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0bfff640 1 -- 172.21.15.181:0/2569731114 >> v1:172.21.15.181:6789/0 conn(0x7f7e0c0b22c0 legacy=0x7f7e0c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e0bfff640 1 -- 172.21.15.181:0/2569731114 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c0ceab0 con 0x7f7e0c0cdfc0 2024-09-12T02:35:29.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.181+0000 7f7e10b42640 1 --2- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c15b2e0 0x7f7e0c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.182+0000 7f7e0bfff640 1 --2- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0cdfc0 0x7f7e0c0b1d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009d90 tx=0x7f7dfc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e90e7e1e48bd8fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.182+0000 7f7e0b7fe640 1 -- 172.21.15.181:0/2569731114 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4001670 con 0x7f7e0c0cdfc0 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.182+0000 7f7e0b7fe640 1 -- 172.21.15.181:0/2569731114 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dfc007540 con 0x7f7e0c0cdfc0 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.182+0000 7f7e0b7fe640 1 -- 172.21.15.181:0/2569731114 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0078f0 con 0x7f7e0c0cdfc0 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 -- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0cdfc0 msgr2=0x7f7e0c0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0cdfc0 0x7f7e0c0b1d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009d90 tx=0x7f7dfc02a5f0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 -- 172.21.15.181:0/2569731114 shutdown_connections 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0cdfc0 0x7f7e0c0b1d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2569731114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c15b2e0 0x7f7e0c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 -- 172.21.15.181:0/2569731114 >> 172.21.15.181:0/2569731114 conn(0x7f7e0c06bc10 msgr2=0x7f7e0c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 -- 172.21.15.181:0/2569731114 shutdown_connections 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.183+0000 7f7e12da6640 1 -- 172.21.15.181:0/2569731114 wait complete. 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.184+0000 7f7e12da6640 1 Processor -- start 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.184+0000 7f7e12da6640 1 -- start start 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e12da6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0b22c0 0x7f7e0c143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e12da6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cdfc0 0x7f7e0c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e12da6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c15b2e0 0x7f7e0c1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e12da6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0712b0 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e12da6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c071130 con 0x7f7e0c0b22c0 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e12da6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c0b4260 con 0x7f7e0c0cdfc0 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c15b2e0 0x7f7e0c1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c15b2e0 0x7f7e0c1462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33052/0 (socket says 172.21.15.181:33052) 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 -- 172.21.15.181:0/2226753975 learned_addr learned my addr 172.21.15.181:0/2226753975 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e0bfff640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cdfc0 0x7f7e0c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e10b42640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0b22c0 0x7f7e0c143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 -- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cdfc0 msgr2=0x7f7e0c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cdfc0 0x7f7e0c13fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 -- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0b22c0 msgr2=0x7f7e0c143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0b22c0 0x7f7e0c143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 -- 172.21.15.181:0/2226753975 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c1406f0 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e11343640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c15b2e0 0x7f7e0c1462c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7df40017e0 tx=0x7f7df400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e097fa640 1 -- 172.21.15.181:0/2226753975 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4017070 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.185+0000 7f7e097fa640 1 -- 172.21.15.181:0/2226753975 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df4005ad0 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.186+0000 7f7e097fa640 1 -- 172.21.15.181:0/2226753975 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4007070 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.186+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c140990 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.186+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c140f50 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.186+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c0b1d80 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.187+0000 7f7e097fa640 1 -- 172.21.15.181:0/2226753975 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7df401a070 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.187+0000 7f7e097fa640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dec06be30 0x7f7dec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.188+0000 7f7e097fa640 1 -- 172.21.15.181:0/2226753975 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f7df408a1d0 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.188+0000 7f7e10b42640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dec06be30 0x7f7dec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.188+0000 7f7e10b42640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dec06be30 0x7f7dec06e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009950 tx=0x7f7e04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.192+0000 7f7e097fa640 1 -- 172.21.15.181:0/2226753975 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7df4058530 con 0x7f7e0c15b2e0 2024-09-12T02:35:29.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.353+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e0c0cd410 con 0x7f7dec06be30 2024-09-12T02:35:29.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.359+0000 7f7e097fa640 1 -- 172.21.15.181:0/2226753975 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7f7e0c0cd410 con 0x7f7dec06be30 2024-09-12T02:35:29.363 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:29.364 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dec06be30 msgr2=0x7f7dec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dec06be30 0x7f7dec06e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009950 tx=0x7f7e04008040 comp rx=0 tx=0).stop 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c15b2e0 msgr2=0x7f7e0c1462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c15b2e0 0x7f7e0c1462c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7df40017e0 tx=0x7f7df400cbe0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 shutdown_connections 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7dec06be30 0x7f7dec06e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c15b2e0 0x7f7e0c1462c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e0c0cdfc0 0x7f7e0c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 --2- 172.21.15.181:0/2226753975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e0c0b22c0 0x7f7e0c143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 >> 172.21.15.181:0/2226753975 conn(0x7f7e0c06bc10 msgr2=0x7f7e0c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:29.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 shutdown_connections 2024-09-12T02:35:29.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.362+0000 7f7e12da6640 1 -- 172.21.15.181:0/2226753975 wait complete. 2024-09-12T02:35:29.374 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-12T02:35:27.704151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284092,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754690628,"statfs":{"total":773094113280,"available":772803203072,"internally_reserved":0,"allocated":8364032,"data_stored":4221598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000600"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442133+0000","last_change":"2024-09-12T02:35:26.438221+0000","last_active":"2024-09-12T02:35:27.442133+0000","last_peered":"2024-09-12T02:35:27.442133+0000","last_clean":"2024-09-12T02:35:27.442133+0000","last_became_active":"2024-09-12T02:35:26.437927+0000","last_became_peered":"2024-09-12T02:35:26.437927+0000","last_unstale":"2024-09-12T02:35:27.442133+0000","last_undegraded":"2024-09-12T02:35:27.442133+0000","last_fullsized":"2024-09-12T02:35:27.442133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:21.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442367+0000","last_change":"2024-09-12T02:35:26.441483+0000","last_active":"2024-09-12T02:35:27.442367+0000","last_peered":"2024-09-12T02:35:27.442367+0000","last_clean":"2024-09-12T02:35:27.442367+0000","last_became_active":"2024-09-12T02:35:26.441203+0000","last_became_peered":"2024-09-12T02:35:26.441203+0000","last_unstale":"2024-09-12T02:35:27.442367+0000","last_undegraded":"2024-09-12T02:35:27.442367+0000","last_fullsized":"2024-09-12T02:35:27.442367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:50.623033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.442552+0000","last_change":"2024-09-12T02:35:26.433199+0000","last_active":"2024-09-12T02:35:26.442552+0000","last_peered":"2024-09-12T02:35:26.442552+0000","last_clean":"2024-09-12T02:35:26.442552+0000","last_became_active":"2024-09-12T02:35:26.432930+0000","last_became_peered":"2024-09-12T02:35:26.432930+0000","last_unstale":"2024-09-12T02:35:26.442552+0000","last_undegraded":"2024-09-12T02:35:26.442552+0000","last_fullsized":"2024-09-12T02:35:26.442552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444771+0000","last_change":"2024-09-12T02:35:26.438608+0000","last_active":"2024-09-12T02:35:26.444771+0000","last_peered":"2024-09-12T02:35:26.444771+0000","last_clean":"2024-09-12T02:35:26.444771+0000","last_became_active":"2024-09-12T02:35:26.438299+0000","last_became_peered":"2024-09-12T02:35:26.438299+0000","last_unstale":"2024-09-12T02:35:26.444771+0000","last_undegraded":"2024-09-12T02:35:26.444771+0000","last_fullsized":"2024-09-12T02:35:26.444771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:53.526494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441756+0000","last_change":"2024-09-12T02:35:26.436627+0000","last_active":"2024-09-12T02:35:26.441756+0000","last_peered":"2024-09-12T02:35:26.441756+0000","last_clean":"2024-09-12T02:35:26.441756+0000","last_became_active":"2024-09-12T02:35:26.436348+0000","last_became_peered":"2024-09-12T02:35:26.436348+0000","last_unstale":"2024-09-12T02:35:26.441756+0000","last_undegraded":"2024-09-12T02:35:26.441756+0000","last_fullsized":"2024-09-12T02:35:26.441756+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:51.309838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441702+0000","last_change":"2024-09-12T02:35:26.440464+0000","last_active":"2024-09-12T02:35:27.441702+0000","last_peered":"2024-09-12T02:35:27.441702+0000","last_clean":"2024-09-12T02:35:27.441702+0000","last_became_active":"2024-09-12T02:35:26.439661+0000","last_became_peered":"2024-09-12T02:35:26.439661+0000","last_unstale":"2024-09-12T02:35:27.441702+0000","last_undegraded":"2024-09-12T02:35:27.441702+0000","last_fullsized":"2024-09-12T02:35:27.441702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:33.432587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.435676+0000","last_change":"2024-09-12T02:35:26.434850+0000","last_active":"2024-09-12T02:35:26.435676+0000","last_peered":"2024-09-12T02:35:26.435676+0000","last_clean":"2024-09-12T02:35:26.435676+0000","last_became_active":"2024-09-12T02:35:26.434563+0000","last_became_peered":"2024-09-12T02:35:26.434563+0000","last_unstale":"2024-09-12T02:35:26.435676+0000","last_undegraded":"2024-09-12T02:35:26.435676+0000","last_fullsized":"2024-09-12T02:35:26.435676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.803908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441187+0000","last_change":"2024-09-12T02:35:26.432108+0000","last_active":"2024-09-12T02:35:27.441187+0000","last_peered":"2024-09-12T02:35:27.441187+0000","last_clean":"2024-09-12T02:35:27.441187+0000","last_became_active":"2024-09-12T02:35:26.431847+0000","last_became_peered":"2024-09-12T02:35:26.431847+0000","last_unstale":"2024-09-12T02:35:27.441187+0000","last_undegraded":"2024-09-12T02:35:27.441187+0000","last_fullsized":"2024-09-12T02:35:27.441187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:23.335926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445545+0000","last_change":"2024-09-12T02:35:26.444484+0000","last_active":"2024-09-12T02:35:26.445545+0000","last_peered":"2024-09-12T02:35:26.445545+0000","last_clean":"2024-09-12T02:35:26.445545+0000","last_became_active":"2024-09-12T02:35:26.444018+0000","last_became_peered":"2024-09-12T02:35:26.444018+0000","last_unstale":"2024-09-12T02:35:26.445545+0000","last_undegraded":"2024-09-12T02:35:26.445545+0000","last_fullsized":"2024-09-12T02:35:26.445545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:22.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443224+0000","last_change":"2024-09-12T02:35:26.436020+0000","last_active":"2024-09-12T02:35:27.443224+0000","last_peered":"2024-09-12T02:35:27.443224+0000","last_clean":"2024-09-12T02:35:27.443224+0000","last_became_active":"2024-09-12T02:35:26.435706+0000","last_became_peered":"2024-09-12T02:35:26.435706+0000","last_unstale":"2024-09-12T02:35:27.443224+0000","last_undegraded":"2024-09-12T02:35:27.443224+0000","last_fullsized":"2024-09-12T02:35:27.443224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.803908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441558+0000","last_change":"2024-09-12T02:35:26.434801+0000","last_active":"2024-09-12T02:35:27.441558+0000","last_peered":"2024-09-12T02:35:27.441558+0000","last_clean":"2024-09-12T02:35:27.441558+0000","last_became_active":"2024-09-12T02:35:26.434545+0000","last_became_peered":"2024-09-12T02:35:26.434545+0000","last_unstale":"2024-09-12T02:35:27.441558+0000","last_undegraded":"2024-09-12T02:35:27.441558+0000","last_fullsized":"2024-09-12T02:35:27.441558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:32.333697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444732+0000","last_change":"2024-09-12T02:35:26.437115+0000","last_active":"2024-09-12T02:35:26.444732+0000","last_peered":"2024-09-12T02:35:26.444732+0000","last_clean":"2024-09-12T02:35:26.444732+0000","last_became_active":"2024-09-12T02:35:26.436829+0000","last_became_peered":"2024-09-12T02:35:26.436829+0000","last_unstale":"2024-09-12T02:35:26.444732+0000","last_undegraded":"2024-09-12T02:35:26.444732+0000","last_fullsized":"2024-09-12T02:35:26.444732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:32.982637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447799+0000","last_change":"2024-09-12T02:35:26.443632+0000","last_active":"2024-09-12T02:35:26.447799+0000","last_peered":"2024-09-12T02:35:26.447799+0000","last_clean":"2024-09-12T02:35:26.447799+0000","last_became_active":"2024-09-12T02:35:26.441808+0000","last_became_peered":"2024-09-12T02:35:26.441808+0000","last_unstale":"2024-09-12T02:35:26.447799+0000","last_undegraded":"2024-09-12T02:35:26.447799+0000","last_fullsized":"2024-09-12T02:35:26.447799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:32.178929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441783+0000","last_change":"2024-09-12T02:35:26.436911+0000","last_active":"2024-09-12T02:35:26.441783+0000","last_peered":"2024-09-12T02:35:26.441783+0000","last_clean":"2024-09-12T02:35:26.441783+0000","last_became_active":"2024-09-12T02:35:26.436480+0000","last_became_peered":"2024-09-12T02:35:26.436480+0000","last_unstale":"2024-09-12T02:35:26.441783+0000","last_undegraded":"2024-09-12T02:35:26.441783+0000","last_fullsized":"2024-09-12T02:35:26.441783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:18.319244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.439235+0000","last_change":"2024-09-12T02:35:26.435101+0000","last_active":"2024-09-12T02:35:26.439235+0000","last_peered":"2024-09-12T02:35:26.439235+0000","last_clean":"2024-09-12T02:35:26.439235+0000","last_became_active":"2024-09-12T02:35:26.434197+0000","last_became_peered":"2024-09-12T02:35:26.434197+0000","last_unstale":"2024-09-12T02:35:26.439235+0000","last_undegraded":"2024-09-12T02:35:26.439235+0000","last_fullsized":"2024-09-12T02:35:26.439235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:24.972170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442575+0000","last_change":"2024-09-12T02:35:26.440523+0000","last_active":"2024-09-12T02:35:27.442575+0000","last_peered":"2024-09-12T02:35:27.442575+0000","last_clean":"2024-09-12T02:35:27.442575+0000","last_became_active":"2024-09-12T02:35:26.440268+0000","last_became_peered":"2024-09-12T02:35:26.440268+0000","last_unstale":"2024-09-12T02:35:27.442575+0000","last_undegraded":"2024-09-12T02:35:27.442575+0000","last_fullsized":"2024-09-12T02:35:27.442575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:44.641368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445529+0000","last_change":"2024-09-12T02:35:26.444280+0000","last_active":"2024-09-12T02:35:26.445529+0000","last_peered":"2024-09-12T02:35:26.445529+0000","last_clean":"2024-09-12T02:35:26.445529+0000","last_became_active":"2024-09-12T02:35:26.443678+0000","last_became_peered":"2024-09-12T02:35:26.443678+0000","last_unstale":"2024-09-12T02:35:26.445529+0000","last_undegraded":"2024-09-12T02:35:26.445529+0000","last_fullsized":"2024-09-12T02:35:26.445529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:34.203619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441702+0000","last_change":"2024-09-12T02:35:26.438440+0000","last_active":"2024-09-12T02:35:26.441702+0000","last_peered":"2024-09-12T02:35:26.441702+0000","last_clean":"2024-09-12T02:35:26.441702+0000","last_became_active":"2024-09-12T02:35:26.438168+0000","last_became_peered":"2024-09-12T02:35:26.438168+0000","last_unstale":"2024-09-12T02:35:26.441702+0000","last_undegraded":"2024-09-12T02:35:26.441702+0000","last_fullsized":"2024-09-12T02:35:26.441702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:20.292627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442290+0000","last_change":"2024-09-12T02:35:26.435888+0000","last_active":"2024-09-12T02:35:27.442290+0000","last_peered":"2024-09-12T02:35:27.442290+0000","last_clean":"2024-09-12T02:35:27.442290+0000","last_became_active":"2024-09-12T02:35:26.435642+0000","last_became_peered":"2024-09-12T02:35:26.435642+0000","last_unstale":"2024-09-12T02:35:27.442290+0000","last_undegraded":"2024-09-12T02:35:27.442290+0000","last_fullsized":"2024-09-12T02:35:27.442290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:02.594236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.436267+0000","last_change":"2024-09-12T02:35:26.430807+0000","last_active":"2024-09-12T02:35:26.436267+0000","last_peered":"2024-09-12T02:35:26.436267+0000","last_clean":"2024-09-12T02:35:26.436267+0000","last_became_active":"2024-09-12T02:35:26.430532+0000","last_became_peered":"2024-09-12T02:35:26.430532+0000","last_unstale":"2024-09-12T02:35:26.436267+0000","last_undegraded":"2024-09-12T02:35:26.436267+0000","last_fullsized":"2024-09-12T02:35:26.436267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:13.141345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442928+0000","last_change":"2024-09-12T02:35:26.432745+0000","last_active":"2024-09-12T02:35:27.442928+0000","last_peered":"2024-09-12T02:35:27.442928+0000","last_clean":"2024-09-12T02:35:27.442928+0000","last_became_active":"2024-09-12T02:35:26.432480+0000","last_became_peered":"2024-09-12T02:35:26.432480+0000","last_unstale":"2024-09-12T02:35:27.442928+0000","last_undegraded":"2024-09-12T02:35:27.442928+0000","last_fullsized":"2024-09-12T02:35:27.442928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.360557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442633+0000","last_change":"2024-09-12T02:35:26.442736+0000","last_active":"2024-09-12T02:35:27.442633+0000","last_peered":"2024-09-12T02:35:27.442633+0000","last_clean":"2024-09-12T02:35:27.442633+0000","last_became_active":"2024-09-12T02:35:26.442432+0000","last_became_peered":"2024-09-12T02:35:26.442432+0000","last_unstale":"2024-09-12T02:35:27.442633+0000","last_undegraded":"2024-09-12T02:35:27.442633+0000","last_fullsized":"2024-09-12T02:35:27.442633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:48.580045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441281+0000","last_change":"2024-09-12T02:35:26.429953+0000","last_active":"2024-09-12T02:35:27.441281+0000","last_peered":"2024-09-12T02:35:27.441281+0000","last_clean":"2024-09-12T02:35:27.441281+0000","last_became_active":"2024-09-12T02:35:26.429671+0000","last_became_peered":"2024-09-12T02:35:26.429671+0000","last_unstale":"2024-09-12T02:35:27.441281+0000","last_undegraded":"2024-09-12T02:35:27.441281+0000","last_fullsized":"2024-09-12T02:35:27.441281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:22.716966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441644+0000","last_change":"2024-09-12T02:35:26.440676+0000","last_active":"2024-09-12T02:35:27.441644+0000","last_peered":"2024-09-12T02:35:27.441644+0000","last_clean":"2024-09-12T02:35:27.441644+0000","last_became_active":"2024-09-12T02:35:26.440402+0000","last_became_peered":"2024-09-12T02:35:26.440402+0000","last_unstale":"2024-09-12T02:35:27.441644+0000","last_undegraded":"2024-09-12T02:35:27.441644+0000","last_fullsized":"2024-09-12T02:35:27.441644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:32.962519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443225+0000","last_change":"2024-09-12T02:35:26.427130+0000","last_active":"2024-09-12T02:35:27.443225+0000","last_peered":"2024-09-12T02:35:27.443225+0000","last_clean":"2024-09-12T02:35:27.443225+0000","last_became_active":"2024-09-12T02:35:26.426475+0000","last_became_peered":"2024-09-12T02:35:26.426475+0000","last_unstale":"2024-09-12T02:35:27.443225+0000","last_undegraded":"2024-09-12T02:35:27.443225+0000","last_fullsized":"2024-09-12T02:35:27.443225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.803445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446444+0000","last_change":"2024-09-12T02:35:26.445272+0000","last_active":"2024-09-12T02:35:26.446444+0000","last_peered":"2024-09-12T02:35:26.446444+0000","last_clean":"2024-09-12T02:35:26.446444+0000","last_became_active":"2024-09-12T02:35:26.445005+0000","last_became_peered":"2024-09-12T02:35:26.445005+0000","last_unstale":"2024-09-12T02:35:26.446444+0000","last_undegraded":"2024-09-12T02:35:26.446444+0000","last_fullsized":"2024-09-12T02:35:26.446444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.637134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445001+0000","last_change":"2024-09-12T02:35:26.440119+0000","last_active":"2024-09-12T02:35:26.445001+0000","last_peered":"2024-09-12T02:35:26.445001+0000","last_clean":"2024-09-12T02:35:26.445001+0000","last_became_active":"2024-09-12T02:35:26.439609+0000","last_became_peered":"2024-09-12T02:35:26.439609+0000","last_unstale":"2024-09-12T02:35:26.445001+0000","last_undegraded":"2024-09-12T02:35:26.445001+0000","last_fullsized":"2024-09-12T02:35:26.445001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.319580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443077+0000","last_change":"2024-09-12T02:35:26.437813+0000","last_active":"2024-09-12T02:35:27.443077+0000","last_peered":"2024-09-12T02:35:27.443077+0000","last_clean":"2024-09-12T02:35:27.443077+0000","last_became_active":"2024-09-12T02:35:26.437541+0000","last_became_peered":"2024-09-12T02:35:26.437541+0000","last_unstale":"2024-09-12T02:35:27.443077+0000","last_undegraded":"2024-09-12T02:35:27.443077+0000","last_fullsized":"2024-09-12T02:35:27.443077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.607315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447911+0000","last_change":"2024-09-12T02:35:26.443141+0000","last_active":"2024-09-12T02:35:26.447911+0000","last_peered":"2024-09-12T02:35:26.447911+0000","last_clean":"2024-09-12T02:35:26.447911+0000","last_became_active":"2024-09-12T02:35:26.442421+0000","last_became_peered":"2024-09-12T02:35:26.442421+0000","last_unstale":"2024-09-12T02:35:26.447911+0000","last_undegraded":"2024-09-12T02:35:26.447911+0000","last_fullsized":"2024-09-12T02:35:26.447911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:27.004313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446689+0000","last_change":"2024-09-12T02:35:26.445718+0000","last_active":"2024-09-12T02:35:26.446689+0000","last_peered":"2024-09-12T02:35:26.446689+0000","last_clean":"2024-09-12T02:35:26.446689+0000","last_became_active":"2024-09-12T02:35:26.444589+0000","last_became_peered":"2024-09-12T02:35:26.444589+0000","last_unstale":"2024-09-12T02:35:26.446689+0000","last_undegraded":"2024-09-12T02:35:26.446689+0000","last_fullsized":"2024-09-12T02:35:26.446689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:13.141345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446397+0000","last_change":"2024-09-12T02:35:26.438947+0000","last_active":"2024-09-12T02:35:26.446397+0000","last_peered":"2024-09-12T02:35:26.446397+0000","last_clean":"2024-09-12T02:35:26.446397+0000","last_became_active":"2024-09-12T02:35:26.438635+0000","last_became_peered":"2024-09-12T02:35:26.438635+0000","last_unstale":"2024-09-12T02:35:26.446397+0000","last_undegraded":"2024-09-12T02:35:26.446397+0000","last_fullsized":"2024-09-12T02:35:26.446397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:46.612463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441525+0000","last_change":"2024-09-12T02:35:26.435097+0000","last_active":"2024-09-12T02:35:27.441525+0000","last_peered":"2024-09-12T02:35:27.441525+0000","last_clean":"2024-09-12T02:35:27.441525+0000","last_became_active":"2024-09-12T02:35:26.434796+0000","last_became_peered":"2024-09-12T02:35:26.434796+0000","last_unstale":"2024-09-12T02:35:27.441525+0000","last_undegraded":"2024-09-12T02:35:27.441525+0000","last_fullsized":"2024-09-12T02:35:27.441525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:58.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441290+0000","last_change":"2024-09-12T02:35:26.441698+0000","last_active":"2024-09-12T02:35:27.441290+0000","last_peered":"2024-09-12T02:35:27.441290+0000","last_clean":"2024-09-12T02:35:27.441290+0000","last_became_active":"2024-09-12T02:35:26.441198+0000","last_became_peered":"2024-09-12T02:35:26.441198+0000","last_unstale":"2024-09-12T02:35:27.441290+0000","last_undegraded":"2024-09-12T02:35:27.441290+0000","last_fullsized":"2024-09-12T02:35:27.441290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:59.794530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441835+0000","last_change":"2024-09-12T02:35:25.426168+0000","last_active":"2024-09-12T02:35:27.441835+0000","last_peered":"2024-09-12T02:35:27.441835+0000","last_clean":"2024-09-12T02:35:27.441835+0000","last_became_active":"2024-09-12T02:35:25.425899+0000","last_became_peered":"2024-09-12T02:35:25.425899+0000","last_unstale":"2024-09-12T02:35:27.441835+0000","last_undegraded":"2024-09-12T02:35:27.441835+0000","last_fullsized":"2024-09-12T02:35:27.441835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:55.601921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445505+0000","last_change":"2024-09-12T02:35:26.443383+0000","last_active":"2024-09-12T02:35:26.445505+0000","last_peered":"2024-09-12T02:35:26.445505+0000","last_clean":"2024-09-12T02:35:26.445505+0000","last_became_active":"2024-09-12T02:35:26.443099+0000","last_became_peered":"2024-09-12T02:35:26.443099+0000","last_unstale":"2024-09-12T02:35:26.445505+0000","last_undegraded":"2024-09-12T02:35:26.445505+0000","last_fullsized":"2024-09-12T02:35:26.445505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:55.581462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447839+0000","last_change":"2024-09-12T02:35:25.423872+0000","last_active":"2024-09-12T02:35:26.447839+0000","last_peered":"2024-09-12T02:35:26.447839+0000","last_clean":"2024-09-12T02:35:26.447839+0000","last_became_active":"2024-09-12T02:35:25.423580+0000","last_became_peered":"2024-09-12T02:35:25.423580+0000","last_unstale":"2024-09-12T02:35:26.447839+0000","last_undegraded":"2024-09-12T02:35:26.447839+0000","last_fullsized":"2024-09-12T02:35:26.447839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:38.052508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442211+0000","last_change":"2024-09-12T02:35:26.441341+0000","last_active":"2024-09-12T02:35:27.442211+0000","last_peered":"2024-09-12T02:35:27.442211+0000","last_clean":"2024-09-12T02:35:27.442211+0000","last_became_active":"2024-09-12T02:35:26.440411+0000","last_became_peered":"2024-09-12T02:35:26.440411+0000","last_unstale":"2024-09-12T02:35:27.442211+0000","last_undegraded":"2024-09-12T02:35:27.442211+0000","last_fullsized":"2024-09-12T02:35:27.442211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:02.191203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443067+0000","last_change":"2024-09-12T02:35:25.419330+0000","last_active":"2024-09-12T02:35:27.443067+0000","last_peered":"2024-09-12T02:35:27.443067+0000","last_clean":"2024-09-12T02:35:27.443067+0000","last_became_active":"2024-09-12T02:35:25.419046+0000","last_became_peered":"2024-09-12T02:35:25.419046+0000","last_unstale":"2024-09-12T02:35:27.443067+0000","last_undegraded":"2024-09-12T02:35:27.443067+0000","last_fullsized":"2024-09-12T02:35:27.443067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.860594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442057+0000","last_change":"2024-09-12T02:35:26.431389+0000","last_active":"2024-09-12T02:35:27.442057+0000","last_peered":"2024-09-12T02:35:27.442057+0000","last_clean":"2024-09-12T02:35:27.442057+0000","last_became_active":"2024-09-12T02:35:26.431105+0000","last_became_peered":"2024-09-12T02:35:26.431105+0000","last_unstale":"2024-09-12T02:35:27.442057+0000","last_undegraded":"2024-09-12T02:35:27.442057+0000","last_fullsized":"2024-09-12T02:35:27.442057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:43.764019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442384+0000","last_change":"2024-09-12T02:35:25.422115+0000","last_active":"2024-09-12T02:35:27.442384+0000","last_peered":"2024-09-12T02:35:27.442384+0000","last_clean":"2024-09-12T02:35:27.442384+0000","last_became_active":"2024-09-12T02:35:25.421077+0000","last_became_peered":"2024-09-12T02:35:25.421077+0000","last_unstale":"2024-09-12T02:35:27.442384+0000","last_undegraded":"2024-09-12T02:35:27.442384+0000","last_fullsized":"2024-09-12T02:35:27.442384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:32.425282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.435001+0000","last_change":"2024-09-12T02:35:26.432163+0000","last_active":"2024-09-12T02:35:26.435001+0000","last_peered":"2024-09-12T02:35:26.435001+0000","last_clean":"2024-09-12T02:35:26.435001+0000","last_became_active":"2024-09-12T02:35:26.431861+0000","last_became_peered":"2024-09-12T02:35:26.431861+0000","last_unstale":"2024-09-12T02:35:26.435001+0000","last_undegraded":"2024-09-12T02:35:26.435001+0000","last_fullsized":"2024-09-12T02:35:26.435001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.607315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.450483+0000","last_change":"2024-09-12T02:35:25.417458+0000","last_active":"2024-09-12T02:35:26.450483+0000","last_peered":"2024-09-12T02:35:26.450483+0000","last_clean":"2024-09-12T02:35:26.450483+0000","last_became_active":"2024-09-12T02:35:25.417177+0000","last_became_peered":"2024-09-12T02:35:25.417177+0000","last_unstale":"2024-09-12T02:35:26.450483+0000","last_undegraded":"2024-09-12T02:35:26.450483+0000","last_fullsized":"2024-09-12T02:35:26.450483+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:46.479870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442914+0000","last_change":"2024-09-12T02:35:26.426927+0000","last_active":"2024-09-12T02:35:27.442914+0000","last_peered":"2024-09-12T02:35:27.442914+0000","last_clean":"2024-09-12T02:35:27.442914+0000","last_became_active":"2024-09-12T02:35:26.426484+0000","last_became_peered":"2024-09-12T02:35:26.426484+0000","last_unstale":"2024-09-12T02:35:27.442914+0000","last_undegraded":"2024-09-12T02:35:27.442914+0000","last_fullsized":"2024-09-12T02:35:27.442914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:53.796934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441817+0000","last_change":"2024-09-12T02:35:25.425791+0000","last_active":"2024-09-12T02:35:27.441817+0000","last_peered":"2024-09-12T02:35:27.441817+0000","last_clean":"2024-09-12T02:35:27.441817+0000","last_became_active":"2024-09-12T02:35:25.425560+0000","last_became_peered":"2024-09-12T02:35:25.425560+0000","last_unstale":"2024-09-12T02:35:27.441817+0000","last_undegraded":"2024-09-12T02:35:27.441817+0000","last_fullsized":"2024-09-12T02:35:27.441817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:06.848578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441724+0000","last_change":"2024-09-12T02:35:26.437580+0000","last_active":"2024-09-12T02:35:26.441724+0000","last_peered":"2024-09-12T02:35:26.441724+0000","last_clean":"2024-09-12T02:35:26.441724+0000","last_became_active":"2024-09-12T02:35:26.437334+0000","last_became_peered":"2024-09-12T02:35:26.437334+0000","last_unstale":"2024-09-12T02:35:26.441724+0000","last_undegraded":"2024-09-12T02:35:26.441724+0000","last_fullsized":"2024-09-12T02:35:26.441724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:14.466398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.424886+0000","last_change":"2024-09-12T02:35:25.421052+0000","last_active":"2024-09-12T02:35:26.424886+0000","last_peered":"2024-09-12T02:35:26.424886+0000","last_clean":"2024-09-12T02:35:26.424886+0000","last_became_active":"2024-09-12T02:35:25.420712+0000","last_became_peered":"2024-09-12T02:35:25.420712+0000","last_unstale":"2024-09-12T02:35:26.424886+0000","last_undegraded":"2024-09-12T02:35:26.424886+0000","last_fullsized":"2024-09-12T02:35:26.424886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:28.840899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.433299+0000","last_change":"2024-09-12T02:35:26.429485+0000","last_active":"2024-09-12T02:35:26.433299+0000","last_peered":"2024-09-12T02:35:26.433299+0000","last_clean":"2024-09-12T02:35:26.433299+0000","last_became_active":"2024-09-12T02:35:26.429224+0000","last_became_peered":"2024-09-12T02:35:26.429224+0000","last_unstale":"2024-09-12T02:35:26.433299+0000","last_undegraded":"2024-09-12T02:35:26.433299+0000","last_fullsized":"2024-09-12T02:35:26.433299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.637134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.426090+0000","last_change":"2024-09-12T02:35:25.422607+0000","last_active":"2024-09-12T02:35:26.426090+0000","last_peered":"2024-09-12T02:35:26.426090+0000","last_clean":"2024-09-12T02:35:26.426090+0000","last_became_active":"2024-09-12T02:35:25.422356+0000","last_became_peered":"2024-09-12T02:35:25.422356+0000","last_unstale":"2024-09-12T02:35:26.426090+0000","last_undegraded":"2024-09-12T02:35:26.426090+0000","last_fullsized":"2024-09-12T02:35:26.426090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:17.550828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446424+0000","last_change":"2024-09-12T02:35:26.442919+0000","last_active":"2024-09-12T02:35:26.446424+0000","last_peered":"2024-09-12T02:35:26.446424+0000","last_clean":"2024-09-12T02:35:26.446424+0000","last_became_active":"2024-09-12T02:35:26.442653+0000","last_became_peered":"2024-09-12T02:35:26.442653+0000","last_unstale":"2024-09-12T02:35:26.446424+0000","last_undegraded":"2024-09-12T02:35:26.446424+0000","last_fullsized":"2024-09-12T02:35:26.446424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:30.082908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443185+0000","last_change":"2024-09-12T02:35:25.418650+0000","last_active":"2024-09-12T02:35:27.443185+0000","last_peered":"2024-09-12T02:35:27.443185+0000","last_clean":"2024-09-12T02:35:27.443185+0000","last_became_active":"2024-09-12T02:35:25.418381+0000","last_became_peered":"2024-09-12T02:35:25.418381+0000","last_unstale":"2024-09-12T02:35:27.443185+0000","last_undegraded":"2024-09-12T02:35:27.443185+0000","last_fullsized":"2024-09-12T02:35:27.443185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:17.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441558+0000","last_change":"2024-09-12T02:35:26.441459+0000","last_active":"2024-09-12T02:35:27.441558+0000","last_peered":"2024-09-12T02:35:27.441558+0000","last_clean":"2024-09-12T02:35:27.441558+0000","last_became_active":"2024-09-12T02:35:26.441157+0000","last_became_peered":"2024-09-12T02:35:26.441157+0000","last_unstale":"2024-09-12T02:35:27.441558+0000","last_undegraded":"2024-09-12T02:35:27.441558+0000","last_fullsized":"2024-09-12T02:35:27.441558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:20.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442457+0000","last_change":"2024-09-12T02:35:25.419163+0000","last_active":"2024-09-12T02:35:27.442457+0000","last_peered":"2024-09-12T02:35:27.442457+0000","last_clean":"2024-09-12T02:35:27.442457+0000","last_became_active":"2024-09-12T02:35:25.418792+0000","last_became_peered":"2024-09-12T02:35:25.418792+0000","last_unstale":"2024-09-12T02:35:27.442457+0000","last_undegraded":"2024-09-12T02:35:27.442457+0000","last_fullsized":"2024-09-12T02:35:27.442457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:19.287233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442128+0000","last_change":"2024-09-12T02:35:26.440895+0000","last_active":"2024-09-12T02:35:27.442128+0000","last_peered":"2024-09-12T02:35:27.442128+0000","last_clean":"2024-09-12T02:35:27.442128+0000","last_became_active":"2024-09-12T02:35:26.440068+0000","last_became_peered":"2024-09-12T02:35:26.440068+0000","last_unstale":"2024-09-12T02:35:27.442128+0000","last_undegraded":"2024-09-12T02:35:27.442128+0000","last_fullsized":"2024-09-12T02:35:27.442128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:38.699529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451720+0000","last_change":"2024-09-12T02:35:25.423000+0000","last_active":"2024-09-12T02:35:26.451720+0000","last_peered":"2024-09-12T02:35:26.451720+0000","last_clean":"2024-09-12T02:35:26.451720+0000","last_became_active":"2024-09-12T02:35:25.422692+0000","last_became_peered":"2024-09-12T02:35:25.422692+0000","last_unstale":"2024-09-12T02:35:26.451720+0000","last_undegraded":"2024-09-12T02:35:26.451720+0000","last_fullsized":"2024-09-12T02:35:26.451720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:33.954220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.443143+0000","last_change":"2024-09-12T02:35:26.436849+0000","last_active":"2024-09-12T02:35:26.443143+0000","last_peered":"2024-09-12T02:35:26.443143+0000","last_clean":"2024-09-12T02:35:26.443143+0000","last_became_active":"2024-09-12T02:35:26.436523+0000","last_became_peered":"2024-09-12T02:35:26.436523+0000","last_unstale":"2024-09-12T02:35:26.443143+0000","last_undegraded":"2024-09-12T02:35:26.443143+0000","last_fullsized":"2024-09-12T02:35:26.443143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:24.589144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451951+0000","last_change":"2024-09-12T02:35:25.417572+0000","last_active":"2024-09-12T02:35:26.451951+0000","last_peered":"2024-09-12T02:35:26.451951+0000","last_clean":"2024-09-12T02:35:26.451951+0000","last_became_active":"2024-09-12T02:35:25.417320+0000","last_became_peered":"2024-09-12T02:35:25.417320+0000","last_unstale":"2024-09-12T02:35:26.451951+0000","last_undegraded":"2024-09-12T02:35:26.451951+0000","last_fullsized":"2024-09-12T02:35:26.451951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:43.677454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441157+0000","last_change":"2024-09-12T02:35:26.438216+0000","last_active":"2024-09-12T02:35:27.441157+0000","last_peered":"2024-09-12T02:35:27.441157+0000","last_clean":"2024-09-12T02:35:27.441157+0000","last_became_active":"2024-09-12T02:35:26.437897+0000","last_became_peered":"2024-09-12T02:35:26.437897+0000","last_unstale":"2024-09-12T02:35:27.441157+0000","last_undegraded":"2024-09-12T02:35:27.441157+0000","last_fullsized":"2024-09-12T02:35:27.441157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:06.427317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.448112+0000","last_change":"2024-09-12T02:35:25.422123+0000","last_active":"2024-09-12T02:35:26.448112+0000","last_peered":"2024-09-12T02:35:26.448112+0000","last_clean":"2024-09-12T02:35:26.448112+0000","last_became_active":"2024-09-12T02:35:25.421817+0000","last_became_peered":"2024-09-12T02:35:25.421817+0000","last_unstale":"2024-09-12T02:35:26.448112+0000","last_undegraded":"2024-09-12T02:35:26.448112+0000","last_fullsized":"2024-09-12T02:35:26.448112+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:25.206546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.436497+0000","last_change":"2024-09-12T02:35:26.435040+0000","last_active":"2024-09-12T02:35:26.436497+0000","last_peered":"2024-09-12T02:35:26.436497+0000","last_clean":"2024-09-12T02:35:26.436497+0000","last_became_active":"2024-09-12T02:35:26.434698+0000","last_became_peered":"2024-09-12T02:35:26.434698+0000","last_unstale":"2024-09-12T02:35:26.436497+0000","last_undegraded":"2024-09-12T02:35:26.436497+0000","last_fullsized":"2024-09-12T02:35:26.436497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.803445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441924+0000","last_change":"2024-09-12T02:35:25.424427+0000","last_active":"2024-09-12T02:35:27.441924+0000","last_peered":"2024-09-12T02:35:27.441924+0000","last_clean":"2024-09-12T02:35:27.441924+0000","last_became_active":"2024-09-12T02:35:25.423479+0000","last_became_peered":"2024-09-12T02:35:25.423479+0000","last_unstale":"2024-09-12T02:35:27.441924+0000","last_undegraded":"2024-09-12T02:35:27.441924+0000","last_fullsized":"2024-09-12T02:35:27.441924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:25.206546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447316+0000","last_change":"2024-09-12T02:35:26.439509+0000","last_active":"2024-09-12T02:35:26.447316+0000","last_peered":"2024-09-12T02:35:26.447316+0000","last_clean":"2024-09-12T02:35:26.447316+0000","last_became_active":"2024-09-12T02:35:26.439209+0000","last_became_peered":"2024-09-12T02:35:26.439209+0000","last_unstale":"2024-09-12T02:35:26.447316+0000","last_undegraded":"2024-09-12T02:35:26.447316+0000","last_fullsized":"2024-09-12T02:35:26.447316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:27.885812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428135+0000","last_change":"2024-09-12T02:35:25.425434+0000","last_active":"2024-09-12T02:35:26.428135+0000","last_peered":"2024-09-12T02:35:26.428135+0000","last_clean":"2024-09-12T02:35:26.428135+0000","last_became_active":"2024-09-12T02:35:25.425072+0000","last_became_peered":"2024-09-12T02:35:25.425072+0000","last_unstale":"2024-09-12T02:35:26.428135+0000","last_undegraded":"2024-09-12T02:35:26.428135+0000","last_fullsized":"2024-09-12T02:35:26.428135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444885+0000","last_change":"2024-09-12T02:35:26.440515+0000","last_active":"2024-09-12T02:35:26.444885+0000","last_peered":"2024-09-12T02:35:26.444885+0000","last_clean":"2024-09-12T02:35:26.444885+0000","last_became_active":"2024-09-12T02:35:26.440273+0000","last_became_peered":"2024-09-12T02:35:26.440273+0000","last_unstale":"2024-09-12T02:35:26.444885+0000","last_undegraded":"2024-09-12T02:35:26.444885+0000","last_fullsized":"2024-09-12T02:35:26.444885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:52.369070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442604+0000","last_change":"2024-09-12T02:35:25.427277+0000","last_active":"2024-09-12T02:35:27.442604+0000","last_peered":"2024-09-12T02:35:27.442604+0000","last_clean":"2024-09-12T02:35:27.442604+0000","last_became_active":"2024-09-12T02:35:25.426989+0000","last_became_peered":"2024-09-12T02:35:25.426989+0000","last_unstale":"2024-09-12T02:35:27.442604+0000","last_undegraded":"2024-09-12T02:35:27.442604+0000","last_fullsized":"2024-09-12T02:35:27.442604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:47.585000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443297+0000","last_change":"2024-09-12T02:35:26.433567+0000","last_active":"2024-09-12T02:35:27.443297+0000","last_peered":"2024-09-12T02:35:27.443297+0000","last_clean":"2024-09-12T02:35:27.443297+0000","last_became_active":"2024-09-12T02:35:26.433232+0000","last_became_peered":"2024-09-12T02:35:26.433232+0000","last_unstale":"2024-09-12T02:35:27.443297+0000","last_undegraded":"2024-09-12T02:35:27.443297+0000","last_fullsized":"2024-09-12T02:35:27.443297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:39.057903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442736+0000","last_change":"2024-09-12T02:35:25.420918+0000","last_active":"2024-09-12T02:35:27.442736+0000","last_peered":"2024-09-12T02:35:27.442736+0000","last_clean":"2024-09-12T02:35:27.442736+0000","last_became_active":"2024-09-12T02:35:25.420395+0000","last_became_peered":"2024-09-12T02:35:25.420395+0000","last_unstale":"2024-09-12T02:35:27.442736+0000","last_undegraded":"2024-09-12T02:35:27.442736+0000","last_fullsized":"2024-09-12T02:35:27.442736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:46.117200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441729+0000","last_change":"2024-09-12T02:35:26.437669+0000","last_active":"2024-09-12T02:35:27.441729+0000","last_peered":"2024-09-12T02:35:27.441729+0000","last_clean":"2024-09-12T02:35:27.441729+0000","last_became_active":"2024-09-12T02:35:26.437395+0000","last_became_peered":"2024-09-12T02:35:26.437395+0000","last_unstale":"2024-09-12T02:35:27.441729+0000","last_undegraded":"2024-09-12T02:35:27.441729+0000","last_fullsized":"2024-09-12T02:35:27.441729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:40.362898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443343+0000","last_change":"2024-09-12T02:35:25.419344+0000","last_active":"2024-09-12T02:35:27.443343+0000","last_peered":"2024-09-12T02:35:27.443343+0000","last_clean":"2024-09-12T02:35:27.443343+0000","last_became_active":"2024-09-12T02:35:25.419060+0000","last_became_peered":"2024-09-12T02:35:25.419060+0000","last_unstale":"2024-09-12T02:35:27.443343+0000","last_undegraded":"2024-09-12T02:35:27.443343+0000","last_fullsized":"2024-09-12T02:35:27.443343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:22.330532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444753+0000","last_change":"2024-09-12T02:35:26.437969+0000","last_active":"2024-09-12T02:35:26.444753+0000","last_peered":"2024-09-12T02:35:26.444753+0000","last_clean":"2024-09-12T02:35:26.444753+0000","last_became_active":"2024-09-12T02:35:26.437658+0000","last_became_peered":"2024-09-12T02:35:26.437658+0000","last_unstale":"2024-09-12T02:35:26.444753+0000","last_undegraded":"2024-09-12T02:35:26.444753+0000","last_fullsized":"2024-09-12T02:35:26.444753+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:51.932287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442409+0000","last_change":"2024-09-12T02:35:25.419278+0000","last_active":"2024-09-12T02:35:27.442409+0000","last_peered":"2024-09-12T02:35:27.442409+0000","last_clean":"2024-09-12T02:35:27.442409+0000","last_became_active":"2024-09-12T02:35:25.419013+0000","last_became_peered":"2024-09-12T02:35:25.419013+0000","last_unstale":"2024-09-12T02:35:27.442409+0000","last_undegraded":"2024-09-12T02:35:27.442409+0000","last_fullsized":"2024-09-12T02:35:27.442409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:28.840899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.443186+0000","last_change":"2024-09-12T02:35:26.438195+0000","last_active":"2024-09-12T02:35:26.443186+0000","last_peered":"2024-09-12T02:35:26.443186+0000","last_clean":"2024-09-12T02:35:26.443186+0000","last_became_active":"2024-09-12T02:35:26.437941+0000","last_became_peered":"2024-09-12T02:35:26.437941+0000","last_unstale":"2024-09-12T02:35:26.443186+0000","last_undegraded":"2024-09-12T02:35:26.443186+0000","last_fullsized":"2024-09-12T02:35:26.443186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:51.109828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441219+0000","last_change":"2024-09-12T02:35:25.425623+0000","last_active":"2024-09-12T02:35:27.441219+0000","last_peered":"2024-09-12T02:35:27.441219+0000","last_clean":"2024-09-12T02:35:27.441219+0000","last_became_active":"2024-09-12T02:35:25.425365+0000","last_became_peered":"2024-09-12T02:35:25.425365+0000","last_unstale":"2024-09-12T02:35:27.441219+0000","last_undegraded":"2024-09-12T02:35:27.441219+0000","last_fullsized":"2024-09-12T02:35:27.441219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.355162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447886+0000","last_change":"2024-09-12T02:35:26.442864+0000","last_active":"2024-09-12T02:35:26.447886+0000","last_peered":"2024-09-12T02:35:26.447886+0000","last_clean":"2024-09-12T02:35:26.447886+0000","last_became_active":"2024-09-12T02:35:26.442494+0000","last_became_peered":"2024-09-12T02:35:26.442494+0000","last_unstale":"2024-09-12T02:35:26.447886+0000","last_undegraded":"2024-09-12T02:35:26.447886+0000","last_fullsized":"2024-09-12T02:35:26.447886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:31.902049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442037+0000","last_change":"2024-09-12T02:35:25.425920+0000","last_active":"2024-09-12T02:35:27.442037+0000","last_peered":"2024-09-12T02:35:27.442037+0000","last_clean":"2024-09-12T02:35:27.442037+0000","last_became_active":"2024-09-12T02:35:25.425641+0000","last_became_peered":"2024-09-12T02:35:25.425641+0000","last_unstale":"2024-09-12T02:35:27.442037+0000","last_undegraded":"2024-09-12T02:35:27.442037+0000","last_fullsized":"2024-09-12T02:35:27.442037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:31.977242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.450319+0000","last_change":"2024-09-12T02:35:26.445498+0000","last_active":"2024-09-12T02:35:26.450319+0000","last_peered":"2024-09-12T02:35:26.450319+0000","last_clean":"2024-09-12T02:35:26.450319+0000","last_became_active":"2024-09-12T02:35:26.445225+0000","last_became_peered":"2024-09-12T02:35:26.445225+0000","last_unstale":"2024-09-12T02:35:26.450319+0000","last_undegraded":"2024-09-12T02:35:26.450319+0000","last_fullsized":"2024-09-12T02:35:26.450319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:32.115363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428325+0000","last_change":"2024-09-12T02:35:25.422276+0000","last_active":"2024-09-12T02:35:26.428325+0000","last_peered":"2024-09-12T02:35:26.428325+0000","last_clean":"2024-09-12T02:35:26.428325+0000","last_became_active":"2024-09-12T02:35:25.421435+0000","last_became_peered":"2024-09-12T02:35:25.421435+0000","last_unstale":"2024-09-12T02:35:26.428325+0000","last_undegraded":"2024-09-12T02:35:26.428325+0000","last_fullsized":"2024-09-12T02:35:26.428325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:52.791540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451635+0000","last_change":"2024-09-12T02:35:26.448346+0000","last_active":"2024-09-12T02:35:26.451635+0000","last_peered":"2024-09-12T02:35:26.451635+0000","last_clean":"2024-09-12T02:35:26.451635+0000","last_became_active":"2024-09-12T02:35:26.448052+0000","last_became_peered":"2024-09-12T02:35:26.448052+0000","last_unstale":"2024-09-12T02:35:26.451635+0000","last_undegraded":"2024-09-12T02:35:26.451635+0000","last_fullsized":"2024-09-12T02:35:26.451635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:12.878968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428802+0000","last_change":"2024-09-12T02:35:25.418511+0000","last_active":"2024-09-12T02:35:26.428802+0000","last_peered":"2024-09-12T02:35:26.428802+0000","last_clean":"2024-09-12T02:35:26.428802+0000","last_became_active":"2024-09-12T02:35:25.418226+0000","last_became_peered":"2024-09-12T02:35:25.418226+0000","last_unstale":"2024-09-12T02:35:26.428802+0000","last_undegraded":"2024-09-12T02:35:26.428802+0000","last_fullsized":"2024-09-12T02:35:26.428802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:29.077513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441679+0000","last_change":"2024-09-12T02:35:26.438157+0000","last_active":"2024-09-12T02:35:26.441679+0000","last_peered":"2024-09-12T02:35:26.441679+0000","last_clean":"2024-09-12T02:35:26.441679+0000","last_became_active":"2024-09-12T02:35:26.437871+0000","last_became_peered":"2024-09-12T02:35:26.437871+0000","last_unstale":"2024-09-12T02:35:26.441679+0000","last_undegraded":"2024-09-12T02:35:26.441679+0000","last_fullsized":"2024-09-12T02:35:26.441679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:14.760222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442513+0000","last_change":"2024-09-12T02:35:25.420653+0000","last_active":"2024-09-12T02:35:27.442513+0000","last_peered":"2024-09-12T02:35:27.442513+0000","last_clean":"2024-09-12T02:35:27.442513+0000","last_became_active":"2024-09-12T02:35:25.420001+0000","last_became_peered":"2024-09-12T02:35:25.420001+0000","last_unstale":"2024-09-12T02:35:27.442513+0000","last_undegraded":"2024-09-12T02:35:27.442513+0000","last_fullsized":"2024-09-12T02:35:27.442513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:16.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445505+0000","last_change":"2024-09-12T02:35:26.435846+0000","last_active":"2024-09-12T02:35:26.445505+0000","last_peered":"2024-09-12T02:35:26.445505+0000","last_clean":"2024-09-12T02:35:26.445505+0000","last_became_active":"2024-09-12T02:35:26.435325+0000","last_became_peered":"2024-09-12T02:35:26.435325+0000","last_unstale":"2024-09-12T02:35:26.445505+0000","last_undegraded":"2024-09-12T02:35:26.445505+0000","last_fullsized":"2024-09-12T02:35:26.445505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:39.057903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428602+0000","last_change":"2024-09-12T02:35:25.425367+0000","last_active":"2024-09-12T02:35:26.428602+0000","last_peered":"2024-09-12T02:35:26.428602+0000","last_clean":"2024-09-12T02:35:26.428602+0000","last_became_active":"2024-09-12T02:35:25.425044+0000","last_became_peered":"2024-09-12T02:35:25.425044+0000","last_unstale":"2024-09-12T02:35:26.428602+0000","last_undegraded":"2024-09-12T02:35:26.428602+0000","last_fullsized":"2024-09-12T02:35:26.428602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.355162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441183+0000","last_change":"2024-09-12T02:35:26.440285+0000","last_active":"2024-09-12T02:35:27.441183+0000","last_peered":"2024-09-12T02:35:27.441183+0000","last_clean":"2024-09-12T02:35:27.441183+0000","last_became_active":"2024-09-12T02:35:26.439960+0000","last_became_peered":"2024-09-12T02:35:26.439960+0000","last_unstale":"2024-09-12T02:35:27.441183+0000","last_undegraded":"2024-09-12T02:35:27.441183+0000","last_fullsized":"2024-09-12T02:35:27.441183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:09.146688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428154+0000","last_change":"2024-09-12T02:35:25.425161+0000","last_active":"2024-09-12T02:35:26.428154+0000","last_peered":"2024-09-12T02:35:26.428154+0000","last_clean":"2024-09-12T02:35:26.428154+0000","last_became_active":"2024-09-12T02:35:25.424849+0000","last_became_peered":"2024-09-12T02:35:25.424849+0000","last_unstale":"2024-09-12T02:35:26.428154+0000","last_undegraded":"2024-09-12T02:35:26.428154+0000","last_fullsized":"2024-09-12T02:35:26.428154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:50.679847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442204+0000","last_change":"2024-09-12T02:35:26.430757+0000","last_active":"2024-09-12T02:35:27.442204+0000","last_peered":"2024-09-12T02:35:27.442204+0000","last_clean":"2024-09-12T02:35:27.442204+0000","last_became_active":"2024-09-12T02:35:26.430353+0000","last_became_peered":"2024-09-12T02:35:26.430353+0000","last_unstale":"2024-09-12T02:35:27.442204+0000","last_undegraded":"2024-09-12T02:35:27.442204+0000","last_fullsized":"2024-09-12T02:35:27.442204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:53.659022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.425513+0000","last_change":"2024-09-12T02:35:25.418450+0000","last_active":"2024-09-12T02:35:26.425513+0000","last_peered":"2024-09-12T02:35:26.425513+0000","last_clean":"2024-09-12T02:35:26.425513+0000","last_became_active":"2024-09-12T02:35:25.418177+0000","last_became_peered":"2024-09-12T02:35:25.418177+0000","last_unstale":"2024-09-12T02:35:26.425513+0000","last_undegraded":"2024-09-12T02:35:26.425513+0000","last_fullsized":"2024-09-12T02:35:26.425513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:45.607069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.448942+0000","last_change":"2024-09-12T02:35:26.447093+0000","last_active":"2024-09-12T02:35:26.448942+0000","last_peered":"2024-09-12T02:35:26.448942+0000","last_clean":"2024-09-12T02:35:26.448942+0000","last_became_active":"2024-09-12T02:35:26.446846+0000","last_became_peered":"2024-09-12T02:35:26.446846+0000","last_unstale":"2024-09-12T02:35:26.448942+0000","last_undegraded":"2024-09-12T02:35:26.448942+0000","last_fullsized":"2024-09-12T02:35:26.448942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:05.395418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.426595+0000","last_change":"2024-09-12T02:35:25.417575+0000","last_active":"2024-09-12T02:35:26.426595+0000","last_peered":"2024-09-12T02:35:26.426595+0000","last_clean":"2024-09-12T02:35:26.426595+0000","last_became_active":"2024-09-12T02:35:25.417291+0000","last_became_peered":"2024-09-12T02:35:25.417291+0000","last_unstale":"2024-09-12T02:35:26.426595+0000","last_undegraded":"2024-09-12T02:35:26.426595+0000","last_fullsized":"2024-09-12T02:35:26.426595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:37.052343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441768+0000","last_change":"2024-09-12T02:35:26.440008+0000","last_active":"2024-09-12T02:35:27.441768+0000","last_peered":"2024-09-12T02:35:27.441768+0000","last_clean":"2024-09-12T02:35:27.441768+0000","last_became_active":"2024-09-12T02:35:26.439727+0000","last_became_peered":"2024-09-12T02:35:26.439727+0000","last_unstale":"2024-09-12T02:35:27.441768+0000","last_undegraded":"2024-09-12T02:35:27.441768+0000","last_fullsized":"2024-09-12T02:35:27.441768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:48.517918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.425049+0000","last_change":"2024-09-12T02:35:25.413028+0000","last_active":"2024-09-12T02:35:26.425049+0000","last_peered":"2024-09-12T02:35:26.425049+0000","last_clean":"2024-09-12T02:35:26.425049+0000","last_became_active":"2024-09-12T02:35:25.412760+0000","last_became_peered":"2024-09-12T02:35:25.412760+0000","last_unstale":"2024-09-12T02:35:26.425049+0000","last_undegraded":"2024-09-12T02:35:26.425049+0000","last_fullsized":"2024-09-12T02:35:26.425049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:06.848578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445002+0000","last_change":"2024-09-12T02:35:26.443323+0000","last_active":"2024-09-12T02:35:26.445002+0000","last_peered":"2024-09-12T02:35:26.445002+0000","last_clean":"2024-09-12T02:35:26.445002+0000","last_became_active":"2024-09-12T02:35:26.443077+0000","last_became_peered":"2024-09-12T02:35:26.443077+0000","last_unstale":"2024-09-12T02:35:26.445002+0000","last_undegraded":"2024-09-12T02:35:26.445002+0000","last_fullsized":"2024-09-12T02:35:26.445002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:40.147852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442555+0000","last_change":"2024-09-12T02:35:25.426681+0000","last_active":"2024-09-12T02:35:27.442555+0000","last_peered":"2024-09-12T02:35:27.442555+0000","last_clean":"2024-09-12T02:35:27.442555+0000","last_became_active":"2024-09-12T02:35:25.426402+0000","last_became_peered":"2024-09-12T02:35:25.426402+0000","last_unstale":"2024-09-12T02:35:27.442555+0000","last_undegraded":"2024-09-12T02:35:27.442555+0000","last_fullsized":"2024-09-12T02:35:27.442555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:01.365770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441923+0000","last_change":"2024-09-12T02:35:26.443087+0000","last_active":"2024-09-12T02:35:27.441923+0000","last_peered":"2024-09-12T02:35:27.441923+0000","last_clean":"2024-09-12T02:35:27.441923+0000","last_became_active":"2024-09-12T02:35:26.440864+0000","last_became_peered":"2024-09-12T02:35:26.440864+0000","last_unstale":"2024-09-12T02:35:27.441923+0000","last_undegraded":"2024-09-12T02:35:27.441923+0000","last_fullsized":"2024-09-12T02:35:27.441923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:14.278689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441643+0000","last_change":"2024-09-12T02:35:25.421849+0000","last_active":"2024-09-12T02:35:27.441643+0000","last_peered":"2024-09-12T02:35:27.441643+0000","last_clean":"2024-09-12T02:35:27.441643+0000","last_became_active":"2024-09-12T02:35:25.421570+0000","last_became_peered":"2024-09-12T02:35:25.421570+0000","last_unstale":"2024-09-12T02:35:27.441643+0000","last_undegraded":"2024-09-12T02:35:27.441643+0000","last_fullsized":"2024-09-12T02:35:27.441643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:43.677454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451697+0000","last_change":"2024-09-12T02:35:26.448462+0000","last_active":"2024-09-12T02:35:26.451697+0000","last_peered":"2024-09-12T02:35:26.451697+0000","last_clean":"2024-09-12T02:35:26.451697+0000","last_became_active":"2024-09-12T02:35:26.448183+0000","last_became_peered":"2024-09-12T02:35:26.448183+0000","last_unstale":"2024-09-12T02:35:26.451697+0000","last_undegraded":"2024-09-12T02:35:26.451697+0000","last_fullsized":"2024-09-12T02:35:26.451697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:52.997759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441885+0000","last_change":"2024-09-12T02:35:25.421395+0000","last_active":"2024-09-12T02:35:27.441885+0000","last_peered":"2024-09-12T02:35:27.441885+0000","last_clean":"2024-09-12T02:35:27.441885+0000","last_became_active":"2024-09-12T02:35:25.420965+0000","last_became_peered":"2024-09-12T02:35:25.420965+0000","last_unstale":"2024-09-12T02:35:27.441885+0000","last_undegraded":"2024-09-12T02:35:27.441885+0000","last_fullsized":"2024-09-12T02:35:27.441885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.926893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":274,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.440871+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:35:27.440871+0000","last_peered":"2024-09-12T02:35:27.440871+0000","last_clean":"2024-09-12T02:35:27.440871+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:35:27.440871+0000","last_undegraded":"2024-09-12T02:35:27.440871+0000","last_fullsized":"2024-09-12T02:35:27.440871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509530,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1495040,"data_stored":971611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":901120,"data_stored":380719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509530,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":897024,"data_stored":380717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45972,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325868,"statfs":{"total":96636764160,"available":96589688832,"internally_reserved":0,"allocated":909312,"data_stored":386997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509530,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":382855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509531,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40972,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330868,"statfs":{"total":96636764160,"available":96594808832,"internally_reserved":0,"allocated":1486848,"data_stored":970995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542235,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":880640,"data_stored":373852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542234,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36208,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335632,"statfs":{"total":96636764160,"available":96599687168,"internally_reserved":0,"allocated":880640,"data_stored":373852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:29.379 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.512+0000 7f8e3be74640 1 Processor -- start 2024-09-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.512+0000 7f8e3be74640 1 -- start start 2024-09-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e3be74640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8e34158c90 0x7f8e3406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e3be74640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 0x7f8e340b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e3be74640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e3406e3c0 con 0x7f8e340b0610 2024-09-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e3be74640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8e3406c5b0 con 0x7f8e34158c90 2024-09-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e3be74640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3406e170 con 0x7f8e3406c150 2024-09-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e3a411640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8e340b0610 0x7f8e340d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53566/0 (socket says 172.21.15.181:53566) 2024-09-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e3a411640 1 -- 172.21.15.181:0/2780757615 learned_addr learned my addr 172.21.15.181:0/2780757615 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.513+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341099231 0 0) 0x7f8e3406e3c0 con 0x7f8e340b0610 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e20003520 con 0x7f8e340b0610 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e39c10640 1 --2- 172.21.15.181:0/2780757615 >> v2:172.21.15.204:3300/0 conn(0x7f8e34158c90 0x7f8e3406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3940f640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 0x7f8e340b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 823841224 0 0) 0x7f8e20003520 con 0x7f8e340b0610 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 msgr2=0x7f8e340b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 0x7f8e340b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 >> v2:172.21.15.204:3300/0 conn(0x7f8e34158c90 msgr2=0x7f8e3406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 --2- 172.21.15.181:0/2780757615 >> v2:172.21.15.204:3300/0 conn(0x7f8e34158c90 0x7f8e3406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3406e6a0 con 0x7f8e340b0610 2024-09-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f8e2c0019f0 con 0x7f8e340b0610 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 >> v1:172.21.15.181:6789/0 conn(0x7f8e340b0610 legacy=0x7f8e340d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e200039b0 0x7f8e20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20004800 0x7f8e20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 0x7f8e200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3406e170 con 0x7f8e20004800 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2000b9c0 con 0x7f8e200039b0 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2000bb40 con 0x7f8e3406c150 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3940f640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20004800 0x7f8e20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e39c10640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e200039b0 0x7f8e20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3a411640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 0x7f8e200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3940f640 1 -- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 msgr2=0x7f8e200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3940f640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e3406c150 0x7f8e200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3940f640 1 -- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e200039b0 msgr2=0x7f8e20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3940f640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e200039b0 0x7f8e20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.514+0000 7f8e3940f640 1 -- 172.21.15.181:0/2780757615 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e20003520 con 0x7f8e20004800 2024-09-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.515+0000 7f8e3940f640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20004800 0x7f8e20004c80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009a90 tx=0x7f8e20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2442bc31219821a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.515+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24036070 con 0x7f8e20004800 2024-09-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.515+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e24031400 con 0x7f8e20004800 2024-09-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.515+0000 7f8e38c0e640 1 -- 172.21.15.181:0/2780757615 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24009690 con 0x7f8e20004800 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.516+0000 7f8e3be74640 1 -- 172.21.15.181:0/2780757615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20004800 msgr2=0x7f8e20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.516+0000 7f8e3be74640 1 --2- 172.21.15.181:0/2780757615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20004800 0x7f8e20004c80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009a90 tx=0x7f8e20005830 comp rx=0 tx=0).stop 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.516+0000 7f8e3a411640 1 -- 172.21.15.181:0/2780757615 reap_dead start 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.516+0000 7f8e3be74640 1 -- 172.21.15.181:0/2780757615 shutdown_connections 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.516+0000 7f8e3be74640 1 -- 172.21.15.181:0/2780757615 >> 172.21.15.181:0/2780757615 conn(0x7f8e34067b30 msgr2=0x7f8e3406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.516+0000 7f8e3be74640 1 -- 172.21.15.181:0/2780757615 shutdown_connections 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.516+0000 7f8e3be74640 1 -- 172.21.15.181:0/2780757615 wait complete. 2024-09-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.517+0000 7f8e3be74640 1 Processor -- start 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.517+0000 7f8e3be74640 1 -- start start 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e20004800 0x7f8e34144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e34154b30 0x7f8e34157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e340cf2c0 0x7f8e340cf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3406ec60 con 0x7f8e340cf2c0 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3415fac0 con 0x7f8e34154b30 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8e340b0ac0 con 0x7f8e20004800 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e340cf2c0 0x7f8e340cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e340cf2c0 0x7f8e340cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40942/0 (socket says 172.21.15.181:40942) 2024-09-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 -- 172.21.15.181:0/3526277512 learned_addr learned my addr 172.21.15.181:0/3526277512 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3940f640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e34154b30 0x7f8e34157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e39c10640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e20004800 0x7f8e34144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 -- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e20004800 msgr2=0x7f8e34144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e20004800 0x7f8e34144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 -- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e34154b30 msgr2=0x7f8e34157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e34154b30 0x7f8e34157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 -- 172.21.15.181:0/3526277512 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e341449d0 con 0x7f8e340cf2c0 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e39c10640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e20004800 0x7f8e34144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3a411640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e340cf2c0 0x7f8e340cf750 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8e34071c40 tx=0x7f8e2c00a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e2a7fc640 1 -- 172.21.15.181:0/3526277512 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00ad50 con 0x7f8e340cf2c0 2024-09-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e2a7fc640 1 -- 172.21.15.181:0/3526277512 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c018070 con 0x7f8e340cf2c0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e2a7fc640 1 -- 172.21.15.181:0/3526277512 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c013630 con 0x7f8e340cf2c0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e34151370 con 0x7f8e340cf2c0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.518+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e340ce7e0 con 0x7f8e340cf2c0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.519+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e340b4210 con 0x7f8e340cf2c0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.520+0000 7f8e2a7fc640 1 -- 172.21.15.181:0/3526277512 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e2c0137d0 con 0x7f8e340cf2c0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.520+0000 7f8e2a7fc640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e1806be30 0x7f8e1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.520+0000 7f8e39c10640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e1806be30 0x7f8e1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.520+0000 7f8e2a7fc640 1 -- 172.21.15.181:0/3526277512 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f8e2c08b470 con 0x7f8e340cf2c0 2024-09-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.521+0000 7f8e39c10640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e1806be30 0x7f8e1806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009bc0 tx=0x7f8e30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.525+0000 7f8e2a7fc640 1 -- 172.21.15.181:0/3526277512 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e2c059eb0 con 0x7f8e340cf2c0 2024-09-12T02:35:29.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.687+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e340b5080 con 0x7f8e1806be30 2024-09-12T02:35:29.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.693+0000 7f8e2a7fc640 1 -- 172.21.15.181:0/3526277512 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7f8e340b5080 con 0x7f8e1806be30 2024-09-12T02:35:29.696 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:29.698 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:35:29.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e1806be30 msgr2=0x7f8e1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e1806be30 0x7f8e1806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009bc0 tx=0x7f8e30008040 comp rx=0 tx=0).stop 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e340cf2c0 msgr2=0x7f8e340cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e340cf2c0 0x7f8e340cf750 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8e34071c40 tx=0x7f8e2c00a750 comp rx=0 tx=0).stop 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 shutdown_connections 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e1806be30 0x7f8e1806e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e34154b30 0x7f8e34157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e340cf2c0 0x7f8e340cf750 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 --2- 172.21.15.181:0/3526277512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e20004800 0x7f8e34144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 >> 172.21.15.181:0/3526277512 conn(0x7f8e34067b30 msgr2=0x7f8e34071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 shutdown_connections 2024-09-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.696+0000 7f8e3be74640 1 -- 172.21.15.181:0/3526277512 wait complete. 2024-09-12T02:35:29.707 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-12T02:35:27.704151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284092,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754690628,"statfs":{"total":773094113280,"available":772803203072,"internally_reserved":0,"allocated":8364032,"data_stored":4221598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000600"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442133+0000","last_change":"2024-09-12T02:35:26.438221+0000","last_active":"2024-09-12T02:35:27.442133+0000","last_peered":"2024-09-12T02:35:27.442133+0000","last_clean":"2024-09-12T02:35:27.442133+0000","last_became_active":"2024-09-12T02:35:26.437927+0000","last_became_peered":"2024-09-12T02:35:26.437927+0000","last_unstale":"2024-09-12T02:35:27.442133+0000","last_undegraded":"2024-09-12T02:35:27.442133+0000","last_fullsized":"2024-09-12T02:35:27.442133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:21.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442367+0000","last_change":"2024-09-12T02:35:26.441483+0000","last_active":"2024-09-12T02:35:27.442367+0000","last_peered":"2024-09-12T02:35:27.442367+0000","last_clean":"2024-09-12T02:35:27.442367+0000","last_became_active":"2024-09-12T02:35:26.441203+0000","last_became_peered":"2024-09-12T02:35:26.441203+0000","last_unstale":"2024-09-12T02:35:27.442367+0000","last_undegraded":"2024-09-12T02:35:27.442367+0000","last_fullsized":"2024-09-12T02:35:27.442367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:50.623033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.442552+0000","last_change":"2024-09-12T02:35:26.433199+0000","last_active":"2024-09-12T02:35:26.442552+0000","last_peered":"2024-09-12T02:35:26.442552+0000","last_clean":"2024-09-12T02:35:26.442552+0000","last_became_active":"2024-09-12T02:35:26.432930+0000","last_became_peered":"2024-09-12T02:35:26.432930+0000","last_unstale":"2024-09-12T02:35:26.442552+0000","last_undegraded":"2024-09-12T02:35:26.442552+0000","last_fullsized":"2024-09-12T02:35:26.442552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.247962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444771+0000","last_change":"2024-09-12T02:35:26.438608+0000","last_active":"2024-09-12T02:35:26.444771+0000","last_peered":"2024-09-12T02:35:26.444771+0000","last_clean":"2024-09-12T02:35:26.444771+0000","last_became_active":"2024-09-12T02:35:26.438299+0000","last_became_peered":"2024-09-12T02:35:26.438299+0000","last_unstale":"2024-09-12T02:35:26.444771+0000","last_undegraded":"2024-09-12T02:35:26.444771+0000","last_fullsized":"2024-09-12T02:35:26.444771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:53.526494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441756+0000","last_change":"2024-09-12T02:35:26.436627+0000","last_active":"2024-09-12T02:35:26.441756+0000","last_peered":"2024-09-12T02:35:26.441756+0000","last_clean":"2024-09-12T02:35:26.441756+0000","last_became_active":"2024-09-12T02:35:26.436348+0000","last_became_peered":"2024-09-12T02:35:26.436348+0000","last_unstale":"2024-09-12T02:35:26.441756+0000","last_undegraded":"2024-09-12T02:35:26.441756+0000","last_fullsized":"2024-09-12T02:35:26.441756+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:51.309838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441702+0000","last_change":"2024-09-12T02:35:26.440464+0000","last_active":"2024-09-12T02:35:27.441702+0000","last_peered":"2024-09-12T02:35:27.441702+0000","last_clean":"2024-09-12T02:35:27.441702+0000","last_became_active":"2024-09-12T02:35:26.439661+0000","last_became_peered":"2024-09-12T02:35:26.439661+0000","last_unstale":"2024-09-12T02:35:27.441702+0000","last_undegraded":"2024-09-12T02:35:27.441702+0000","last_fullsized":"2024-09-12T02:35:27.441702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:33.432587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.435676+0000","last_change":"2024-09-12T02:35:26.434850+0000","last_active":"2024-09-12T02:35:26.435676+0000","last_peered":"2024-09-12T02:35:26.435676+0000","last_clean":"2024-09-12T02:35:26.435676+0000","last_became_active":"2024-09-12T02:35:26.434563+0000","last_became_peered":"2024-09-12T02:35:26.434563+0000","last_unstale":"2024-09-12T02:35:26.435676+0000","last_undegraded":"2024-09-12T02:35:26.435676+0000","last_fullsized":"2024-09-12T02:35:26.435676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.803908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441187+0000","last_change":"2024-09-12T02:35:26.432108+0000","last_active":"2024-09-12T02:35:27.441187+0000","last_peered":"2024-09-12T02:35:27.441187+0000","last_clean":"2024-09-12T02:35:27.441187+0000","last_became_active":"2024-09-12T02:35:26.431847+0000","last_became_peered":"2024-09-12T02:35:26.431847+0000","last_unstale":"2024-09-12T02:35:27.441187+0000","last_undegraded":"2024-09-12T02:35:27.441187+0000","last_fullsized":"2024-09-12T02:35:27.441187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:23.335926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445545+0000","last_change":"2024-09-12T02:35:26.444484+0000","last_active":"2024-09-12T02:35:26.445545+0000","last_peered":"2024-09-12T02:35:26.445545+0000","last_clean":"2024-09-12T02:35:26.445545+0000","last_became_active":"2024-09-12T02:35:26.444018+0000","last_became_peered":"2024-09-12T02:35:26.444018+0000","last_unstale":"2024-09-12T02:35:26.445545+0000","last_undegraded":"2024-09-12T02:35:26.445545+0000","last_fullsized":"2024-09-12T02:35:26.445545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:22.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443224+0000","last_change":"2024-09-12T02:35:26.436020+0000","last_active":"2024-09-12T02:35:27.443224+0000","last_peered":"2024-09-12T02:35:27.443224+0000","last_clean":"2024-09-12T02:35:27.443224+0000","last_became_active":"2024-09-12T02:35:26.435706+0000","last_became_peered":"2024-09-12T02:35:26.435706+0000","last_unstale":"2024-09-12T02:35:27.443224+0000","last_undegraded":"2024-09-12T02:35:27.443224+0000","last_fullsized":"2024-09-12T02:35:27.443224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.803908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441558+0000","last_change":"2024-09-12T02:35:26.434801+0000","last_active":"2024-09-12T02:35:27.441558+0000","last_peered":"2024-09-12T02:35:27.441558+0000","last_clean":"2024-09-12T02:35:27.441558+0000","last_became_active":"2024-09-12T02:35:26.434545+0000","last_became_peered":"2024-09-12T02:35:26.434545+0000","last_unstale":"2024-09-12T02:35:27.441558+0000","last_undegraded":"2024-09-12T02:35:27.441558+0000","last_fullsized":"2024-09-12T02:35:27.441558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:32.333697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444732+0000","last_change":"2024-09-12T02:35:26.437115+0000","last_active":"2024-09-12T02:35:26.444732+0000","last_peered":"2024-09-12T02:35:26.444732+0000","last_clean":"2024-09-12T02:35:26.444732+0000","last_became_active":"2024-09-12T02:35:26.436829+0000","last_became_peered":"2024-09-12T02:35:26.436829+0000","last_unstale":"2024-09-12T02:35:26.444732+0000","last_undegraded":"2024-09-12T02:35:26.444732+0000","last_fullsized":"2024-09-12T02:35:26.444732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:32.982637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447799+0000","last_change":"2024-09-12T02:35:26.443632+0000","last_active":"2024-09-12T02:35:26.447799+0000","last_peered":"2024-09-12T02:35:26.447799+0000","last_clean":"2024-09-12T02:35:26.447799+0000","last_became_active":"2024-09-12T02:35:26.441808+0000","last_became_peered":"2024-09-12T02:35:26.441808+0000","last_unstale":"2024-09-12T02:35:26.447799+0000","last_undegraded":"2024-09-12T02:35:26.447799+0000","last_fullsized":"2024-09-12T02:35:26.447799+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:32.178929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441783+0000","last_change":"2024-09-12T02:35:26.436911+0000","last_active":"2024-09-12T02:35:26.441783+0000","last_peered":"2024-09-12T02:35:26.441783+0000","last_clean":"2024-09-12T02:35:26.441783+0000","last_became_active":"2024-09-12T02:35:26.436480+0000","last_became_peered":"2024-09-12T02:35:26.436480+0000","last_unstale":"2024-09-12T02:35:26.441783+0000","last_undegraded":"2024-09-12T02:35:26.441783+0000","last_fullsized":"2024-09-12T02:35:26.441783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:18.319244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.439235+0000","last_change":"2024-09-12T02:35:26.435101+0000","last_active":"2024-09-12T02:35:26.439235+0000","last_peered":"2024-09-12T02:35:26.439235+0000","last_clean":"2024-09-12T02:35:26.439235+0000","last_became_active":"2024-09-12T02:35:26.434197+0000","last_became_peered":"2024-09-12T02:35:26.434197+0000","last_unstale":"2024-09-12T02:35:26.439235+0000","last_undegraded":"2024-09-12T02:35:26.439235+0000","last_fullsized":"2024-09-12T02:35:26.439235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:24.972170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442575+0000","last_change":"2024-09-12T02:35:26.440523+0000","last_active":"2024-09-12T02:35:27.442575+0000","last_peered":"2024-09-12T02:35:27.442575+0000","last_clean":"2024-09-12T02:35:27.442575+0000","last_became_active":"2024-09-12T02:35:26.440268+0000","last_became_peered":"2024-09-12T02:35:26.440268+0000","last_unstale":"2024-09-12T02:35:27.442575+0000","last_undegraded":"2024-09-12T02:35:27.442575+0000","last_fullsized":"2024-09-12T02:35:27.442575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:44.641368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445529+0000","last_change":"2024-09-12T02:35:26.444280+0000","last_active":"2024-09-12T02:35:26.445529+0000","last_peered":"2024-09-12T02:35:26.445529+0000","last_clean":"2024-09-12T02:35:26.445529+0000","last_became_active":"2024-09-12T02:35:26.443678+0000","last_became_peered":"2024-09-12T02:35:26.443678+0000","last_unstale":"2024-09-12T02:35:26.445529+0000","last_undegraded":"2024-09-12T02:35:26.445529+0000","last_fullsized":"2024-09-12T02:35:26.445529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:34.203619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441702+0000","last_change":"2024-09-12T02:35:26.438440+0000","last_active":"2024-09-12T02:35:26.441702+0000","last_peered":"2024-09-12T02:35:26.441702+0000","last_clean":"2024-09-12T02:35:26.441702+0000","last_became_active":"2024-09-12T02:35:26.438168+0000","last_became_peered":"2024-09-12T02:35:26.438168+0000","last_unstale":"2024-09-12T02:35:26.441702+0000","last_undegraded":"2024-09-12T02:35:26.441702+0000","last_fullsized":"2024-09-12T02:35:26.441702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:20.292627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442290+0000","last_change":"2024-09-12T02:35:26.435888+0000","last_active":"2024-09-12T02:35:27.442290+0000","last_peered":"2024-09-12T02:35:27.442290+0000","last_clean":"2024-09-12T02:35:27.442290+0000","last_became_active":"2024-09-12T02:35:26.435642+0000","last_became_peered":"2024-09-12T02:35:26.435642+0000","last_unstale":"2024-09-12T02:35:27.442290+0000","last_undegraded":"2024-09-12T02:35:27.442290+0000","last_fullsized":"2024-09-12T02:35:27.442290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:02.594236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.436267+0000","last_change":"2024-09-12T02:35:26.430807+0000","last_active":"2024-09-12T02:35:26.436267+0000","last_peered":"2024-09-12T02:35:26.436267+0000","last_clean":"2024-09-12T02:35:26.436267+0000","last_became_active":"2024-09-12T02:35:26.430532+0000","last_became_peered":"2024-09-12T02:35:26.430532+0000","last_unstale":"2024-09-12T02:35:26.436267+0000","last_undegraded":"2024-09-12T02:35:26.436267+0000","last_fullsized":"2024-09-12T02:35:26.436267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:13.141345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442928+0000","last_change":"2024-09-12T02:35:26.432745+0000","last_active":"2024-09-12T02:35:27.442928+0000","last_peered":"2024-09-12T02:35:27.442928+0000","last_clean":"2024-09-12T02:35:27.442928+0000","last_became_active":"2024-09-12T02:35:26.432480+0000","last_became_peered":"2024-09-12T02:35:26.432480+0000","last_unstale":"2024-09-12T02:35:27.442928+0000","last_undegraded":"2024-09-12T02:35:27.442928+0000","last_fullsized":"2024-09-12T02:35:27.442928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.360557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442633+0000","last_change":"2024-09-12T02:35:26.442736+0000","last_active":"2024-09-12T02:35:27.442633+0000","last_peered":"2024-09-12T02:35:27.442633+0000","last_clean":"2024-09-12T02:35:27.442633+0000","last_became_active":"2024-09-12T02:35:26.442432+0000","last_became_peered":"2024-09-12T02:35:26.442432+0000","last_unstale":"2024-09-12T02:35:27.442633+0000","last_undegraded":"2024-09-12T02:35:27.442633+0000","last_fullsized":"2024-09-12T02:35:27.442633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:48.580045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441281+0000","last_change":"2024-09-12T02:35:26.429953+0000","last_active":"2024-09-12T02:35:27.441281+0000","last_peered":"2024-09-12T02:35:27.441281+0000","last_clean":"2024-09-12T02:35:27.441281+0000","last_became_active":"2024-09-12T02:35:26.429671+0000","last_became_peered":"2024-09-12T02:35:26.429671+0000","last_unstale":"2024-09-12T02:35:27.441281+0000","last_undegraded":"2024-09-12T02:35:27.441281+0000","last_fullsized":"2024-09-12T02:35:27.441281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:22.716966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441644+0000","last_change":"2024-09-12T02:35:26.440676+0000","last_active":"2024-09-12T02:35:27.441644+0000","last_peered":"2024-09-12T02:35:27.441644+0000","last_clean":"2024-09-12T02:35:27.441644+0000","last_became_active":"2024-09-12T02:35:26.440402+0000","last_became_peered":"2024-09-12T02:35:26.440402+0000","last_unstale":"2024-09-12T02:35:27.441644+0000","last_undegraded":"2024-09-12T02:35:27.441644+0000","last_fullsized":"2024-09-12T02:35:27.441644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:32.962519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443225+0000","last_change":"2024-09-12T02:35:26.427130+0000","last_active":"2024-09-12T02:35:27.443225+0000","last_peered":"2024-09-12T02:35:27.443225+0000","last_clean":"2024-09-12T02:35:27.443225+0000","last_became_active":"2024-09-12T02:35:26.426475+0000","last_became_peered":"2024-09-12T02:35:26.426475+0000","last_unstale":"2024-09-12T02:35:27.443225+0000","last_undegraded":"2024-09-12T02:35:27.443225+0000","last_fullsized":"2024-09-12T02:35:27.443225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.803445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446444+0000","last_change":"2024-09-12T02:35:26.445272+0000","last_active":"2024-09-12T02:35:26.446444+0000","last_peered":"2024-09-12T02:35:26.446444+0000","last_clean":"2024-09-12T02:35:26.446444+0000","last_became_active":"2024-09-12T02:35:26.445005+0000","last_became_peered":"2024-09-12T02:35:26.445005+0000","last_unstale":"2024-09-12T02:35:26.446444+0000","last_undegraded":"2024-09-12T02:35:26.446444+0000","last_fullsized":"2024-09-12T02:35:26.446444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.637134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445001+0000","last_change":"2024-09-12T02:35:26.440119+0000","last_active":"2024-09-12T02:35:26.445001+0000","last_peered":"2024-09-12T02:35:26.445001+0000","last_clean":"2024-09-12T02:35:26.445001+0000","last_became_active":"2024-09-12T02:35:26.439609+0000","last_became_peered":"2024-09-12T02:35:26.439609+0000","last_unstale":"2024-09-12T02:35:26.445001+0000","last_undegraded":"2024-09-12T02:35:26.445001+0000","last_fullsized":"2024-09-12T02:35:26.445001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.319580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443077+0000","last_change":"2024-09-12T02:35:26.437813+0000","last_active":"2024-09-12T02:35:27.443077+0000","last_peered":"2024-09-12T02:35:27.443077+0000","last_clean":"2024-09-12T02:35:27.443077+0000","last_became_active":"2024-09-12T02:35:26.437541+0000","last_became_peered":"2024-09-12T02:35:26.437541+0000","last_unstale":"2024-09-12T02:35:27.443077+0000","last_undegraded":"2024-09-12T02:35:27.443077+0000","last_fullsized":"2024-09-12T02:35:27.443077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.607315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447911+0000","last_change":"2024-09-12T02:35:26.443141+0000","last_active":"2024-09-12T02:35:26.447911+0000","last_peered":"2024-09-12T02:35:26.447911+0000","last_clean":"2024-09-12T02:35:26.447911+0000","last_became_active":"2024-09-12T02:35:26.442421+0000","last_became_peered":"2024-09-12T02:35:26.442421+0000","last_unstale":"2024-09-12T02:35:26.447911+0000","last_undegraded":"2024-09-12T02:35:26.447911+0000","last_fullsized":"2024-09-12T02:35:26.447911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:27.004313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446689+0000","last_change":"2024-09-12T02:35:26.445718+0000","last_active":"2024-09-12T02:35:26.446689+0000","last_peered":"2024-09-12T02:35:26.446689+0000","last_clean":"2024-09-12T02:35:26.446689+0000","last_became_active":"2024-09-12T02:35:26.444589+0000","last_became_peered":"2024-09-12T02:35:26.444589+0000","last_unstale":"2024-09-12T02:35:26.446689+0000","last_undegraded":"2024-09-12T02:35:26.446689+0000","last_fullsized":"2024-09-12T02:35:26.446689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:13.141345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446397+0000","last_change":"2024-09-12T02:35:26.438947+0000","last_active":"2024-09-12T02:35:26.446397+0000","last_peered":"2024-09-12T02:35:26.446397+0000","last_clean":"2024-09-12T02:35:26.446397+0000","last_became_active":"2024-09-12T02:35:26.438635+0000","last_became_peered":"2024-09-12T02:35:26.438635+0000","last_unstale":"2024-09-12T02:35:26.446397+0000","last_undegraded":"2024-09-12T02:35:26.446397+0000","last_fullsized":"2024-09-12T02:35:26.446397+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:46.612463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441525+0000","last_change":"2024-09-12T02:35:26.435097+0000","last_active":"2024-09-12T02:35:27.441525+0000","last_peered":"2024-09-12T02:35:27.441525+0000","last_clean":"2024-09-12T02:35:27.441525+0000","last_became_active":"2024-09-12T02:35:26.434796+0000","last_became_peered":"2024-09-12T02:35:26.434796+0000","last_unstale":"2024-09-12T02:35:27.441525+0000","last_undegraded":"2024-09-12T02:35:27.441525+0000","last_fullsized":"2024-09-12T02:35:27.441525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:58.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441290+0000","last_change":"2024-09-12T02:35:26.441698+0000","last_active":"2024-09-12T02:35:27.441290+0000","last_peered":"2024-09-12T02:35:27.441290+0000","last_clean":"2024-09-12T02:35:27.441290+0000","last_became_active":"2024-09-12T02:35:26.441198+0000","last_became_peered":"2024-09-12T02:35:26.441198+0000","last_unstale":"2024-09-12T02:35:27.441290+0000","last_undegraded":"2024-09-12T02:35:27.441290+0000","last_fullsized":"2024-09-12T02:35:27.441290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:59.794530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441835+0000","last_change":"2024-09-12T02:35:25.426168+0000","last_active":"2024-09-12T02:35:27.441835+0000","last_peered":"2024-09-12T02:35:27.441835+0000","last_clean":"2024-09-12T02:35:27.441835+0000","last_became_active":"2024-09-12T02:35:25.425899+0000","last_became_peered":"2024-09-12T02:35:25.425899+0000","last_unstale":"2024-09-12T02:35:27.441835+0000","last_undegraded":"2024-09-12T02:35:27.441835+0000","last_fullsized":"2024-09-12T02:35:27.441835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:55.601921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445505+0000","last_change":"2024-09-12T02:35:26.443383+0000","last_active":"2024-09-12T02:35:26.445505+0000","last_peered":"2024-09-12T02:35:26.445505+0000","last_clean":"2024-09-12T02:35:26.445505+0000","last_became_active":"2024-09-12T02:35:26.443099+0000","last_became_peered":"2024-09-12T02:35:26.443099+0000","last_unstale":"2024-09-12T02:35:26.445505+0000","last_undegraded":"2024-09-12T02:35:26.445505+0000","last_fullsized":"2024-09-12T02:35:26.445505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:55.581462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447839+0000","last_change":"2024-09-12T02:35:25.423872+0000","last_active":"2024-09-12T02:35:26.447839+0000","last_peered":"2024-09-12T02:35:26.447839+0000","last_clean":"2024-09-12T02:35:26.447839+0000","last_became_active":"2024-09-12T02:35:25.423580+0000","last_became_peered":"2024-09-12T02:35:25.423580+0000","last_unstale":"2024-09-12T02:35:26.447839+0000","last_undegraded":"2024-09-12T02:35:26.447839+0000","last_fullsized":"2024-09-12T02:35:26.447839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:38.052508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442211+0000","last_change":"2024-09-12T02:35:26.441341+0000","last_active":"2024-09-12T02:35:27.442211+0000","last_peered":"2024-09-12T02:35:27.442211+0000","last_clean":"2024-09-12T02:35:27.442211+0000","last_became_active":"2024-09-12T02:35:26.440411+0000","last_became_peered":"2024-09-12T02:35:26.440411+0000","last_unstale":"2024-09-12T02:35:27.442211+0000","last_undegraded":"2024-09-12T02:35:27.442211+0000","last_fullsized":"2024-09-12T02:35:27.442211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:02.191203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443067+0000","last_change":"2024-09-12T02:35:25.419330+0000","last_active":"2024-09-12T02:35:27.443067+0000","last_peered":"2024-09-12T02:35:27.443067+0000","last_clean":"2024-09-12T02:35:27.443067+0000","last_became_active":"2024-09-12T02:35:25.419046+0000","last_became_peered":"2024-09-12T02:35:25.419046+0000","last_unstale":"2024-09-12T02:35:27.443067+0000","last_undegraded":"2024-09-12T02:35:27.443067+0000","last_fullsized":"2024-09-12T02:35:27.443067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.860594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442057+0000","last_change":"2024-09-12T02:35:26.431389+0000","last_active":"2024-09-12T02:35:27.442057+0000","last_peered":"2024-09-12T02:35:27.442057+0000","last_clean":"2024-09-12T02:35:27.442057+0000","last_became_active":"2024-09-12T02:35:26.431105+0000","last_became_peered":"2024-09-12T02:35:26.431105+0000","last_unstale":"2024-09-12T02:35:27.442057+0000","last_undegraded":"2024-09-12T02:35:27.442057+0000","last_fullsized":"2024-09-12T02:35:27.442057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:43.764019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442384+0000","last_change":"2024-09-12T02:35:25.422115+0000","last_active":"2024-09-12T02:35:27.442384+0000","last_peered":"2024-09-12T02:35:27.442384+0000","last_clean":"2024-09-12T02:35:27.442384+0000","last_became_active":"2024-09-12T02:35:25.421077+0000","last_became_peered":"2024-09-12T02:35:25.421077+0000","last_unstale":"2024-09-12T02:35:27.442384+0000","last_undegraded":"2024-09-12T02:35:27.442384+0000","last_fullsized":"2024-09-12T02:35:27.442384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:32.425282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.435001+0000","last_change":"2024-09-12T02:35:26.432163+0000","last_active":"2024-09-12T02:35:26.435001+0000","last_peered":"2024-09-12T02:35:26.435001+0000","last_clean":"2024-09-12T02:35:26.435001+0000","last_became_active":"2024-09-12T02:35:26.431861+0000","last_became_peered":"2024-09-12T02:35:26.431861+0000","last_unstale":"2024-09-12T02:35:26.435001+0000","last_undegraded":"2024-09-12T02:35:26.435001+0000","last_fullsized":"2024-09-12T02:35:26.435001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.607315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.450483+0000","last_change":"2024-09-12T02:35:25.417458+0000","last_active":"2024-09-12T02:35:26.450483+0000","last_peered":"2024-09-12T02:35:26.450483+0000","last_clean":"2024-09-12T02:35:26.450483+0000","last_became_active":"2024-09-12T02:35:25.417177+0000","last_became_peered":"2024-09-12T02:35:25.417177+0000","last_unstale":"2024-09-12T02:35:26.450483+0000","last_undegraded":"2024-09-12T02:35:26.450483+0000","last_fullsized":"2024-09-12T02:35:26.450483+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:46.479870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442914+0000","last_change":"2024-09-12T02:35:26.426927+0000","last_active":"2024-09-12T02:35:27.442914+0000","last_peered":"2024-09-12T02:35:27.442914+0000","last_clean":"2024-09-12T02:35:27.442914+0000","last_became_active":"2024-09-12T02:35:26.426484+0000","last_became_peered":"2024-09-12T02:35:26.426484+0000","last_unstale":"2024-09-12T02:35:27.442914+0000","last_undegraded":"2024-09-12T02:35:27.442914+0000","last_fullsized":"2024-09-12T02:35:27.442914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:53.796934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441817+0000","last_change":"2024-09-12T02:35:25.425791+0000","last_active":"2024-09-12T02:35:27.441817+0000","last_peered":"2024-09-12T02:35:27.441817+0000","last_clean":"2024-09-12T02:35:27.441817+0000","last_became_active":"2024-09-12T02:35:25.425560+0000","last_became_peered":"2024-09-12T02:35:25.425560+0000","last_unstale":"2024-09-12T02:35:27.441817+0000","last_undegraded":"2024-09-12T02:35:27.441817+0000","last_fullsized":"2024-09-12T02:35:27.441817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:06.848578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441724+0000","last_change":"2024-09-12T02:35:26.437580+0000","last_active":"2024-09-12T02:35:26.441724+0000","last_peered":"2024-09-12T02:35:26.441724+0000","last_clean":"2024-09-12T02:35:26.441724+0000","last_became_active":"2024-09-12T02:35:26.437334+0000","last_became_peered":"2024-09-12T02:35:26.437334+0000","last_unstale":"2024-09-12T02:35:26.441724+0000","last_undegraded":"2024-09-12T02:35:26.441724+0000","last_fullsized":"2024-09-12T02:35:26.441724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:14.466398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.424886+0000","last_change":"2024-09-12T02:35:25.421052+0000","last_active":"2024-09-12T02:35:26.424886+0000","last_peered":"2024-09-12T02:35:26.424886+0000","last_clean":"2024-09-12T02:35:26.424886+0000","last_became_active":"2024-09-12T02:35:25.420712+0000","last_became_peered":"2024-09-12T02:35:25.420712+0000","last_unstale":"2024-09-12T02:35:26.424886+0000","last_undegraded":"2024-09-12T02:35:26.424886+0000","last_fullsized":"2024-09-12T02:35:26.424886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:28.840899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.433299+0000","last_change":"2024-09-12T02:35:26.429485+0000","last_active":"2024-09-12T02:35:26.433299+0000","last_peered":"2024-09-12T02:35:26.433299+0000","last_clean":"2024-09-12T02:35:26.433299+0000","last_became_active":"2024-09-12T02:35:26.429224+0000","last_became_peered":"2024-09-12T02:35:26.429224+0000","last_unstale":"2024-09-12T02:35:26.433299+0000","last_undegraded":"2024-09-12T02:35:26.433299+0000","last_fullsized":"2024-09-12T02:35:26.433299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.637134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.426090+0000","last_change":"2024-09-12T02:35:25.422607+0000","last_active":"2024-09-12T02:35:26.426090+0000","last_peered":"2024-09-12T02:35:26.426090+0000","last_clean":"2024-09-12T02:35:26.426090+0000","last_became_active":"2024-09-12T02:35:25.422356+0000","last_became_peered":"2024-09-12T02:35:25.422356+0000","last_unstale":"2024-09-12T02:35:26.426090+0000","last_undegraded":"2024-09-12T02:35:26.426090+0000","last_fullsized":"2024-09-12T02:35:26.426090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:17.550828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.446424+0000","last_change":"2024-09-12T02:35:26.442919+0000","last_active":"2024-09-12T02:35:26.446424+0000","last_peered":"2024-09-12T02:35:26.446424+0000","last_clean":"2024-09-12T02:35:26.446424+0000","last_became_active":"2024-09-12T02:35:26.442653+0000","last_became_peered":"2024-09-12T02:35:26.442653+0000","last_unstale":"2024-09-12T02:35:26.446424+0000","last_undegraded":"2024-09-12T02:35:26.446424+0000","last_fullsized":"2024-09-12T02:35:26.446424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:30.082908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443185+0000","last_change":"2024-09-12T02:35:25.418650+0000","last_active":"2024-09-12T02:35:27.443185+0000","last_peered":"2024-09-12T02:35:27.443185+0000","last_clean":"2024-09-12T02:35:27.443185+0000","last_became_active":"2024-09-12T02:35:25.418381+0000","last_became_peered":"2024-09-12T02:35:25.418381+0000","last_unstale":"2024-09-12T02:35:27.443185+0000","last_undegraded":"2024-09-12T02:35:27.443185+0000","last_fullsized":"2024-09-12T02:35:27.443185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:17.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441558+0000","last_change":"2024-09-12T02:35:26.441459+0000","last_active":"2024-09-12T02:35:27.441558+0000","last_peered":"2024-09-12T02:35:27.441558+0000","last_clean":"2024-09-12T02:35:27.441558+0000","last_became_active":"2024-09-12T02:35:26.441157+0000","last_became_peered":"2024-09-12T02:35:26.441157+0000","last_unstale":"2024-09-12T02:35:27.441558+0000","last_undegraded":"2024-09-12T02:35:27.441558+0000","last_fullsized":"2024-09-12T02:35:27.441558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:20.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442457+0000","last_change":"2024-09-12T02:35:25.419163+0000","last_active":"2024-09-12T02:35:27.442457+0000","last_peered":"2024-09-12T02:35:27.442457+0000","last_clean":"2024-09-12T02:35:27.442457+0000","last_became_active":"2024-09-12T02:35:25.418792+0000","last_became_peered":"2024-09-12T02:35:25.418792+0000","last_unstale":"2024-09-12T02:35:27.442457+0000","last_undegraded":"2024-09-12T02:35:27.442457+0000","last_fullsized":"2024-09-12T02:35:27.442457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:19.287233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442128+0000","last_change":"2024-09-12T02:35:26.440895+0000","last_active":"2024-09-12T02:35:27.442128+0000","last_peered":"2024-09-12T02:35:27.442128+0000","last_clean":"2024-09-12T02:35:27.442128+0000","last_became_active":"2024-09-12T02:35:26.440068+0000","last_became_peered":"2024-09-12T02:35:26.440068+0000","last_unstale":"2024-09-12T02:35:27.442128+0000","last_undegraded":"2024-09-12T02:35:27.442128+0000","last_fullsized":"2024-09-12T02:35:27.442128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:38.699529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451720+0000","last_change":"2024-09-12T02:35:25.423000+0000","last_active":"2024-09-12T02:35:26.451720+0000","last_peered":"2024-09-12T02:35:26.451720+0000","last_clean":"2024-09-12T02:35:26.451720+0000","last_became_active":"2024-09-12T02:35:25.422692+0000","last_became_peered":"2024-09-12T02:35:25.422692+0000","last_unstale":"2024-09-12T02:35:26.451720+0000","last_undegraded":"2024-09-12T02:35:26.451720+0000","last_fullsized":"2024-09-12T02:35:26.451720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:33.954220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.443143+0000","last_change":"2024-09-12T02:35:26.436849+0000","last_active":"2024-09-12T02:35:26.443143+0000","last_peered":"2024-09-12T02:35:26.443143+0000","last_clean":"2024-09-12T02:35:26.443143+0000","last_became_active":"2024-09-12T02:35:26.436523+0000","last_became_peered":"2024-09-12T02:35:26.436523+0000","last_unstale":"2024-09-12T02:35:26.443143+0000","last_undegraded":"2024-09-12T02:35:26.443143+0000","last_fullsized":"2024-09-12T02:35:26.443143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:24.589144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451951+0000","last_change":"2024-09-12T02:35:25.417572+0000","last_active":"2024-09-12T02:35:26.451951+0000","last_peered":"2024-09-12T02:35:26.451951+0000","last_clean":"2024-09-12T02:35:26.451951+0000","last_became_active":"2024-09-12T02:35:25.417320+0000","last_became_peered":"2024-09-12T02:35:25.417320+0000","last_unstale":"2024-09-12T02:35:26.451951+0000","last_undegraded":"2024-09-12T02:35:26.451951+0000","last_fullsized":"2024-09-12T02:35:26.451951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:43.677454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441157+0000","last_change":"2024-09-12T02:35:26.438216+0000","last_active":"2024-09-12T02:35:27.441157+0000","last_peered":"2024-09-12T02:35:27.441157+0000","last_clean":"2024-09-12T02:35:27.441157+0000","last_became_active":"2024-09-12T02:35:26.437897+0000","last_became_peered":"2024-09-12T02:35:26.437897+0000","last_unstale":"2024-09-12T02:35:27.441157+0000","last_undegraded":"2024-09-12T02:35:27.441157+0000","last_fullsized":"2024-09-12T02:35:27.441157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:06.427317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.448112+0000","last_change":"2024-09-12T02:35:25.422123+0000","last_active":"2024-09-12T02:35:26.448112+0000","last_peered":"2024-09-12T02:35:26.448112+0000","last_clean":"2024-09-12T02:35:26.448112+0000","last_became_active":"2024-09-12T02:35:25.421817+0000","last_became_peered":"2024-09-12T02:35:25.421817+0000","last_unstale":"2024-09-12T02:35:26.448112+0000","last_undegraded":"2024-09-12T02:35:26.448112+0000","last_fullsized":"2024-09-12T02:35:26.448112+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:25.206546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.436497+0000","last_change":"2024-09-12T02:35:26.435040+0000","last_active":"2024-09-12T02:35:26.436497+0000","last_peered":"2024-09-12T02:35:26.436497+0000","last_clean":"2024-09-12T02:35:26.436497+0000","last_became_active":"2024-09-12T02:35:26.434698+0000","last_became_peered":"2024-09-12T02:35:26.434698+0000","last_unstale":"2024-09-12T02:35:26.436497+0000","last_undegraded":"2024-09-12T02:35:26.436497+0000","last_fullsized":"2024-09-12T02:35:26.436497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.803445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441924+0000","last_change":"2024-09-12T02:35:25.424427+0000","last_active":"2024-09-12T02:35:27.441924+0000","last_peered":"2024-09-12T02:35:27.441924+0000","last_clean":"2024-09-12T02:35:27.441924+0000","last_became_active":"2024-09-12T02:35:25.423479+0000","last_became_peered":"2024-09-12T02:35:25.423479+0000","last_unstale":"2024-09-12T02:35:27.441924+0000","last_undegraded":"2024-09-12T02:35:27.441924+0000","last_fullsized":"2024-09-12T02:35:27.441924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:25.206546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447316+0000","last_change":"2024-09-12T02:35:26.439509+0000","last_active":"2024-09-12T02:35:26.447316+0000","last_peered":"2024-09-12T02:35:26.447316+0000","last_clean":"2024-09-12T02:35:26.447316+0000","last_became_active":"2024-09-12T02:35:26.439209+0000","last_became_peered":"2024-09-12T02:35:26.439209+0000","last_unstale":"2024-09-12T02:35:26.447316+0000","last_undegraded":"2024-09-12T02:35:26.447316+0000","last_fullsized":"2024-09-12T02:35:26.447316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:27.885812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428135+0000","last_change":"2024-09-12T02:35:25.425434+0000","last_active":"2024-09-12T02:35:26.428135+0000","last_peered":"2024-09-12T02:35:26.428135+0000","last_clean":"2024-09-12T02:35:26.428135+0000","last_became_active":"2024-09-12T02:35:25.425072+0000","last_became_peered":"2024-09-12T02:35:25.425072+0000","last_unstale":"2024-09-12T02:35:26.428135+0000","last_undegraded":"2024-09-12T02:35:26.428135+0000","last_fullsized":"2024-09-12T02:35:26.428135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:47.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444885+0000","last_change":"2024-09-12T02:35:26.440515+0000","last_active":"2024-09-12T02:35:26.444885+0000","last_peered":"2024-09-12T02:35:26.444885+0000","last_clean":"2024-09-12T02:35:26.444885+0000","last_became_active":"2024-09-12T02:35:26.440273+0000","last_became_peered":"2024-09-12T02:35:26.440273+0000","last_unstale":"2024-09-12T02:35:26.444885+0000","last_undegraded":"2024-09-12T02:35:26.444885+0000","last_fullsized":"2024-09-12T02:35:26.444885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:52.369070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442604+0000","last_change":"2024-09-12T02:35:25.427277+0000","last_active":"2024-09-12T02:35:27.442604+0000","last_peered":"2024-09-12T02:35:27.442604+0000","last_clean":"2024-09-12T02:35:27.442604+0000","last_became_active":"2024-09-12T02:35:25.426989+0000","last_became_peered":"2024-09-12T02:35:25.426989+0000","last_unstale":"2024-09-12T02:35:27.442604+0000","last_undegraded":"2024-09-12T02:35:27.442604+0000","last_fullsized":"2024-09-12T02:35:27.442604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:47.585000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443297+0000","last_change":"2024-09-12T02:35:26.433567+0000","last_active":"2024-09-12T02:35:27.443297+0000","last_peered":"2024-09-12T02:35:27.443297+0000","last_clean":"2024-09-12T02:35:27.443297+0000","last_became_active":"2024-09-12T02:35:26.433232+0000","last_became_peered":"2024-09-12T02:35:26.433232+0000","last_unstale":"2024-09-12T02:35:27.443297+0000","last_undegraded":"2024-09-12T02:35:27.443297+0000","last_fullsized":"2024-09-12T02:35:27.443297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:39.057903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442736+0000","last_change":"2024-09-12T02:35:25.420918+0000","last_active":"2024-09-12T02:35:27.442736+0000","last_peered":"2024-09-12T02:35:27.442736+0000","last_clean":"2024-09-12T02:35:27.442736+0000","last_became_active":"2024-09-12T02:35:25.420395+0000","last_became_peered":"2024-09-12T02:35:25.420395+0000","last_unstale":"2024-09-12T02:35:27.442736+0000","last_undegraded":"2024-09-12T02:35:27.442736+0000","last_fullsized":"2024-09-12T02:35:27.442736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:46.117200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441729+0000","last_change":"2024-09-12T02:35:26.437669+0000","last_active":"2024-09-12T02:35:27.441729+0000","last_peered":"2024-09-12T02:35:27.441729+0000","last_clean":"2024-09-12T02:35:27.441729+0000","last_became_active":"2024-09-12T02:35:26.437395+0000","last_became_peered":"2024-09-12T02:35:26.437395+0000","last_unstale":"2024-09-12T02:35:27.441729+0000","last_undegraded":"2024-09-12T02:35:27.441729+0000","last_fullsized":"2024-09-12T02:35:27.441729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:40.362898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.443343+0000","last_change":"2024-09-12T02:35:25.419344+0000","last_active":"2024-09-12T02:35:27.443343+0000","last_peered":"2024-09-12T02:35:27.443343+0000","last_clean":"2024-09-12T02:35:27.443343+0000","last_became_active":"2024-09-12T02:35:25.419060+0000","last_became_peered":"2024-09-12T02:35:25.419060+0000","last_unstale":"2024-09-12T02:35:27.443343+0000","last_undegraded":"2024-09-12T02:35:27.443343+0000","last_fullsized":"2024-09-12T02:35:27.443343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:22.330532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.444753+0000","last_change":"2024-09-12T02:35:26.437969+0000","last_active":"2024-09-12T02:35:26.444753+0000","last_peered":"2024-09-12T02:35:26.444753+0000","last_clean":"2024-09-12T02:35:26.444753+0000","last_became_active":"2024-09-12T02:35:26.437658+0000","last_became_peered":"2024-09-12T02:35:26.437658+0000","last_unstale":"2024-09-12T02:35:26.444753+0000","last_undegraded":"2024-09-12T02:35:26.444753+0000","last_fullsized":"2024-09-12T02:35:26.444753+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:51.932287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442409+0000","last_change":"2024-09-12T02:35:25.419278+0000","last_active":"2024-09-12T02:35:27.442409+0000","last_peered":"2024-09-12T02:35:27.442409+0000","last_clean":"2024-09-12T02:35:27.442409+0000","last_became_active":"2024-09-12T02:35:25.419013+0000","last_became_peered":"2024-09-12T02:35:25.419013+0000","last_unstale":"2024-09-12T02:35:27.442409+0000","last_undegraded":"2024-09-12T02:35:27.442409+0000","last_fullsized":"2024-09-12T02:35:27.442409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:28.840899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.443186+0000","last_change":"2024-09-12T02:35:26.438195+0000","last_active":"2024-09-12T02:35:26.443186+0000","last_peered":"2024-09-12T02:35:26.443186+0000","last_clean":"2024-09-12T02:35:26.443186+0000","last_became_active":"2024-09-12T02:35:26.437941+0000","last_became_peered":"2024-09-12T02:35:26.437941+0000","last_unstale":"2024-09-12T02:35:26.443186+0000","last_undegraded":"2024-09-12T02:35:26.443186+0000","last_fullsized":"2024-09-12T02:35:26.443186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:51.109828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441219+0000","last_change":"2024-09-12T02:35:25.425623+0000","last_active":"2024-09-12T02:35:27.441219+0000","last_peered":"2024-09-12T02:35:27.441219+0000","last_clean":"2024-09-12T02:35:27.441219+0000","last_became_active":"2024-09-12T02:35:25.425365+0000","last_became_peered":"2024-09-12T02:35:25.425365+0000","last_unstale":"2024-09-12T02:35:27.441219+0000","last_undegraded":"2024-09-12T02:35:27.441219+0000","last_fullsized":"2024-09-12T02:35:27.441219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.355162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.447886+0000","last_change":"2024-09-12T02:35:26.442864+0000","last_active":"2024-09-12T02:35:26.447886+0000","last_peered":"2024-09-12T02:35:26.447886+0000","last_clean":"2024-09-12T02:35:26.447886+0000","last_became_active":"2024-09-12T02:35:26.442494+0000","last_became_peered":"2024-09-12T02:35:26.442494+0000","last_unstale":"2024-09-12T02:35:26.447886+0000","last_undegraded":"2024-09-12T02:35:26.447886+0000","last_fullsized":"2024-09-12T02:35:26.447886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:31.902049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442037+0000","last_change":"2024-09-12T02:35:25.425920+0000","last_active":"2024-09-12T02:35:27.442037+0000","last_peered":"2024-09-12T02:35:27.442037+0000","last_clean":"2024-09-12T02:35:27.442037+0000","last_became_active":"2024-09-12T02:35:25.425641+0000","last_became_peered":"2024-09-12T02:35:25.425641+0000","last_unstale":"2024-09-12T02:35:27.442037+0000","last_undegraded":"2024-09-12T02:35:27.442037+0000","last_fullsized":"2024-09-12T02:35:27.442037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:31.977242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.450319+0000","last_change":"2024-09-12T02:35:26.445498+0000","last_active":"2024-09-12T02:35:26.450319+0000","last_peered":"2024-09-12T02:35:26.450319+0000","last_clean":"2024-09-12T02:35:26.450319+0000","last_became_active":"2024-09-12T02:35:26.445225+0000","last_became_peered":"2024-09-12T02:35:26.445225+0000","last_unstale":"2024-09-12T02:35:26.450319+0000","last_undegraded":"2024-09-12T02:35:26.450319+0000","last_fullsized":"2024-09-12T02:35:26.450319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:32.115363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428325+0000","last_change":"2024-09-12T02:35:25.422276+0000","last_active":"2024-09-12T02:35:26.428325+0000","last_peered":"2024-09-12T02:35:26.428325+0000","last_clean":"2024-09-12T02:35:26.428325+0000","last_became_active":"2024-09-12T02:35:25.421435+0000","last_became_peered":"2024-09-12T02:35:25.421435+0000","last_unstale":"2024-09-12T02:35:26.428325+0000","last_undegraded":"2024-09-12T02:35:26.428325+0000","last_fullsized":"2024-09-12T02:35:26.428325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:52.791540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451635+0000","last_change":"2024-09-12T02:35:26.448346+0000","last_active":"2024-09-12T02:35:26.451635+0000","last_peered":"2024-09-12T02:35:26.451635+0000","last_clean":"2024-09-12T02:35:26.451635+0000","last_became_active":"2024-09-12T02:35:26.448052+0000","last_became_peered":"2024-09-12T02:35:26.448052+0000","last_unstale":"2024-09-12T02:35:26.451635+0000","last_undegraded":"2024-09-12T02:35:26.451635+0000","last_fullsized":"2024-09-12T02:35:26.451635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:12.878968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428802+0000","last_change":"2024-09-12T02:35:25.418511+0000","last_active":"2024-09-12T02:35:26.428802+0000","last_peered":"2024-09-12T02:35:26.428802+0000","last_clean":"2024-09-12T02:35:26.428802+0000","last_became_active":"2024-09-12T02:35:25.418226+0000","last_became_peered":"2024-09-12T02:35:25.418226+0000","last_unstale":"2024-09-12T02:35:26.428802+0000","last_undegraded":"2024-09-12T02:35:26.428802+0000","last_fullsized":"2024-09-12T02:35:26.428802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:29.077513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.441679+0000","last_change":"2024-09-12T02:35:26.438157+0000","last_active":"2024-09-12T02:35:26.441679+0000","last_peered":"2024-09-12T02:35:26.441679+0000","last_clean":"2024-09-12T02:35:26.441679+0000","last_became_active":"2024-09-12T02:35:26.437871+0000","last_became_peered":"2024-09-12T02:35:26.437871+0000","last_unstale":"2024-09-12T02:35:26.441679+0000","last_undegraded":"2024-09-12T02:35:26.441679+0000","last_fullsized":"2024-09-12T02:35:26.441679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:14.760222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442513+0000","last_change":"2024-09-12T02:35:25.420653+0000","last_active":"2024-09-12T02:35:27.442513+0000","last_peered":"2024-09-12T02:35:27.442513+0000","last_clean":"2024-09-12T02:35:27.442513+0000","last_became_active":"2024-09-12T02:35:25.420001+0000","last_became_peered":"2024-09-12T02:35:25.420001+0000","last_unstale":"2024-09-12T02:35:27.442513+0000","last_undegraded":"2024-09-12T02:35:27.442513+0000","last_fullsized":"2024-09-12T02:35:27.442513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:16.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445505+0000","last_change":"2024-09-12T02:35:26.435846+0000","last_active":"2024-09-12T02:35:26.445505+0000","last_peered":"2024-09-12T02:35:26.445505+0000","last_clean":"2024-09-12T02:35:26.445505+0000","last_became_active":"2024-09-12T02:35:26.435325+0000","last_became_peered":"2024-09-12T02:35:26.435325+0000","last_unstale":"2024-09-12T02:35:26.445505+0000","last_undegraded":"2024-09-12T02:35:26.445505+0000","last_fullsized":"2024-09-12T02:35:26.445505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:39.057903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428602+0000","last_change":"2024-09-12T02:35:25.425367+0000","last_active":"2024-09-12T02:35:26.428602+0000","last_peered":"2024-09-12T02:35:26.428602+0000","last_clean":"2024-09-12T02:35:26.428602+0000","last_became_active":"2024-09-12T02:35:25.425044+0000","last_became_peered":"2024-09-12T02:35:25.425044+0000","last_unstale":"2024-09-12T02:35:26.428602+0000","last_undegraded":"2024-09-12T02:35:26.428602+0000","last_fullsized":"2024-09-12T02:35:26.428602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.355162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441183+0000","last_change":"2024-09-12T02:35:26.440285+0000","last_active":"2024-09-12T02:35:27.441183+0000","last_peered":"2024-09-12T02:35:27.441183+0000","last_clean":"2024-09-12T02:35:27.441183+0000","last_became_active":"2024-09-12T02:35:26.439960+0000","last_became_peered":"2024-09-12T02:35:26.439960+0000","last_unstale":"2024-09-12T02:35:27.441183+0000","last_undegraded":"2024-09-12T02:35:27.441183+0000","last_fullsized":"2024-09-12T02:35:27.441183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:09.146688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.428154+0000","last_change":"2024-09-12T02:35:25.425161+0000","last_active":"2024-09-12T02:35:26.428154+0000","last_peered":"2024-09-12T02:35:26.428154+0000","last_clean":"2024-09-12T02:35:26.428154+0000","last_became_active":"2024-09-12T02:35:25.424849+0000","last_became_peered":"2024-09-12T02:35:25.424849+0000","last_unstale":"2024-09-12T02:35:26.428154+0000","last_undegraded":"2024-09-12T02:35:26.428154+0000","last_fullsized":"2024-09-12T02:35:26.428154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:50.679847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442204+0000","last_change":"2024-09-12T02:35:26.430757+0000","last_active":"2024-09-12T02:35:27.442204+0000","last_peered":"2024-09-12T02:35:27.442204+0000","last_clean":"2024-09-12T02:35:27.442204+0000","last_became_active":"2024-09-12T02:35:26.430353+0000","last_became_peered":"2024-09-12T02:35:26.430353+0000","last_unstale":"2024-09-12T02:35:27.442204+0000","last_undegraded":"2024-09-12T02:35:27.442204+0000","last_fullsized":"2024-09-12T02:35:27.442204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:53.659022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.425513+0000","last_change":"2024-09-12T02:35:25.418450+0000","last_active":"2024-09-12T02:35:26.425513+0000","last_peered":"2024-09-12T02:35:26.425513+0000","last_clean":"2024-09-12T02:35:26.425513+0000","last_became_active":"2024-09-12T02:35:25.418177+0000","last_became_peered":"2024-09-12T02:35:25.418177+0000","last_unstale":"2024-09-12T02:35:26.425513+0000","last_undegraded":"2024-09-12T02:35:26.425513+0000","last_fullsized":"2024-09-12T02:35:26.425513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:45.607069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.448942+0000","last_change":"2024-09-12T02:35:26.447093+0000","last_active":"2024-09-12T02:35:26.448942+0000","last_peered":"2024-09-12T02:35:26.448942+0000","last_clean":"2024-09-12T02:35:26.448942+0000","last_became_active":"2024-09-12T02:35:26.446846+0000","last_became_peered":"2024-09-12T02:35:26.446846+0000","last_unstale":"2024-09-12T02:35:26.448942+0000","last_undegraded":"2024-09-12T02:35:26.448942+0000","last_fullsized":"2024-09-12T02:35:26.448942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:05.395418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.426595+0000","last_change":"2024-09-12T02:35:25.417575+0000","last_active":"2024-09-12T02:35:26.426595+0000","last_peered":"2024-09-12T02:35:26.426595+0000","last_clean":"2024-09-12T02:35:26.426595+0000","last_became_active":"2024-09-12T02:35:25.417291+0000","last_became_peered":"2024-09-12T02:35:25.417291+0000","last_unstale":"2024-09-12T02:35:26.426595+0000","last_undegraded":"2024-09-12T02:35:26.426595+0000","last_fullsized":"2024-09-12T02:35:26.426595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:37.052343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441768+0000","last_change":"2024-09-12T02:35:26.440008+0000","last_active":"2024-09-12T02:35:27.441768+0000","last_peered":"2024-09-12T02:35:27.441768+0000","last_clean":"2024-09-12T02:35:27.441768+0000","last_became_active":"2024-09-12T02:35:26.439727+0000","last_became_peered":"2024-09-12T02:35:26.439727+0000","last_unstale":"2024-09-12T02:35:27.441768+0000","last_undegraded":"2024-09-12T02:35:27.441768+0000","last_fullsized":"2024-09-12T02:35:27.441768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:48.517918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.425049+0000","last_change":"2024-09-12T02:35:25.413028+0000","last_active":"2024-09-12T02:35:26.425049+0000","last_peered":"2024-09-12T02:35:26.425049+0000","last_clean":"2024-09-12T02:35:26.425049+0000","last_became_active":"2024-09-12T02:35:25.412760+0000","last_became_peered":"2024-09-12T02:35:25.412760+0000","last_unstale":"2024-09-12T02:35:26.425049+0000","last_undegraded":"2024-09-12T02:35:26.425049+0000","last_fullsized":"2024-09-12T02:35:26.425049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:06.848578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.445002+0000","last_change":"2024-09-12T02:35:26.443323+0000","last_active":"2024-09-12T02:35:26.445002+0000","last_peered":"2024-09-12T02:35:26.445002+0000","last_clean":"2024-09-12T02:35:26.445002+0000","last_became_active":"2024-09-12T02:35:26.443077+0000","last_became_peered":"2024-09-12T02:35:26.443077+0000","last_unstale":"2024-09-12T02:35:26.445002+0000","last_undegraded":"2024-09-12T02:35:26.445002+0000","last_fullsized":"2024-09-12T02:35:26.445002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:40.147852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.442555+0000","last_change":"2024-09-12T02:35:25.426681+0000","last_active":"2024-09-12T02:35:27.442555+0000","last_peered":"2024-09-12T02:35:27.442555+0000","last_clean":"2024-09-12T02:35:27.442555+0000","last_became_active":"2024-09-12T02:35:25.426402+0000","last_became_peered":"2024-09-12T02:35:25.426402+0000","last_unstale":"2024-09-12T02:35:27.442555+0000","last_undegraded":"2024-09-12T02:35:27.442555+0000","last_fullsized":"2024-09-12T02:35:27.442555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:01.365770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441923+0000","last_change":"2024-09-12T02:35:26.443087+0000","last_active":"2024-09-12T02:35:27.441923+0000","last_peered":"2024-09-12T02:35:27.441923+0000","last_clean":"2024-09-12T02:35:27.441923+0000","last_became_active":"2024-09-12T02:35:26.440864+0000","last_became_peered":"2024-09-12T02:35:26.440864+0000","last_unstale":"2024-09-12T02:35:27.441923+0000","last_undegraded":"2024-09-12T02:35:27.441923+0000","last_fullsized":"2024-09-12T02:35:27.441923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:14.278689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441643+0000","last_change":"2024-09-12T02:35:25.421849+0000","last_active":"2024-09-12T02:35:27.441643+0000","last_peered":"2024-09-12T02:35:27.441643+0000","last_clean":"2024-09-12T02:35:27.441643+0000","last_became_active":"2024-09-12T02:35:25.421570+0000","last_became_peered":"2024-09-12T02:35:25.421570+0000","last_unstale":"2024-09-12T02:35:27.441643+0000","last_undegraded":"2024-09-12T02:35:27.441643+0000","last_fullsized":"2024-09-12T02:35:27.441643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:43.677454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T02:35:26.451697+0000","last_change":"2024-09-12T02:35:26.448462+0000","last_active":"2024-09-12T02:35:26.451697+0000","last_peered":"2024-09-12T02:35:26.451697+0000","last_clean":"2024-09-12T02:35:26.451697+0000","last_became_active":"2024-09-12T02:35:26.448183+0000","last_became_peered":"2024-09-12T02:35:26.448183+0000","last_unstale":"2024-09-12T02:35:26.451697+0000","last_undegraded":"2024-09-12T02:35:26.451697+0000","last_fullsized":"2024-09-12T02:35:26.451697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:25.403385+0000","last_clean_scrub_stamp":"2024-09-12T02:35:25.403385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:52.997759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.441885+0000","last_change":"2024-09-12T02:35:25.421395+0000","last_active":"2024-09-12T02:35:27.441885+0000","last_peered":"2024-09-12T02:35:27.441885+0000","last_clean":"2024-09-12T02:35:27.441885+0000","last_became_active":"2024-09-12T02:35:25.420965+0000","last_became_peered":"2024-09-12T02:35:25.420965+0000","last_unstale":"2024-09-12T02:35:27.441885+0000","last_undegraded":"2024-09-12T02:35:27.441885+0000","last_fullsized":"2024-09-12T02:35:27.441885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:24.397991+0000","last_clean_scrub_stamp":"2024-09-12T02:35:24.397991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.926893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":274,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T02:35:27.440871+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:35:27.440871+0000","last_peered":"2024-09-12T02:35:27.440871+0000","last_clean":"2024-09-12T02:35:27.440871+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:35:27.440871+0000","last_undegraded":"2024-09-12T02:35:27.440871+0000","last_fullsized":"2024-09-12T02:35:27.440871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509530,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1495040,"data_stored":971611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":901120,"data_stored":380719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509530,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":897024,"data_stored":380717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45972,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325868,"statfs":{"total":96636764160,"available":96589688832,"internally_reserved":0,"allocated":909312,"data_stored":386997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509530,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":382855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509531,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40972,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330868,"statfs":{"total":96636764160,"available":96594808832,"internally_reserved":0,"allocated":1486848,"data_stored":970995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542235,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":880640,"data_stored":373852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542234,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36208,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335632,"statfs":{"total":96636764160,"available":96599687168,"internally_reserved":0,"allocated":880640,"data_stored":373852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:29.711 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:35:29.712 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:35:29.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.854+0000 7f2e85b11640 1 Processor -- start 2024-09-12T02:35:29.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.854+0000 7f2e85b11640 1 -- start start 2024-09-12T02:35:29.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e85b11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e800cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e85b11640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2e800cfff0 0x7f2e80160080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e85b11640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e800d0410 con 0x7f2e80158d90 2024-09-12T02:35:29.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e85b11640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2e800b5020 con 0x7f2e800cfff0 2024-09-12T02:35:29.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e85b11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2e800b5300 con 0x7f2e800b4b60 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e7ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2e800cfff0 0x7f2e80160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e7effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e800cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e7f7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f2e80158d90 0x7f2e8015f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:55692/0 (socket says 172.21.15.181:55692) 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.855+0000 7f2e7f7fe640 1 -- 172.21.15.181:0/3164777068 learned_addr learned my addr 172.21.15.181:0/3164777068 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.856+0000 7f2e7effd640 1 -- 172.21.15.181:0/3164777068 >> v2:172.21.15.204:3300/0 conn(0x7f2e800cfff0 msgr2=0x7f2e80160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.856+0000 7f2e7effd640 1 --2- 172.21.15.181:0/3164777068 >> v2:172.21.15.204:3300/0 conn(0x7f2e800cfff0 0x7f2e80160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.856+0000 7f2e7effd640 1 -- 172.21.15.181:0/3164777068 >> v1:172.21.15.204:6789/0 conn(0x7f2e80158d90 legacy=0x7f2e8015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.856+0000 7f2e7effd640 1 -- 172.21.15.181:0/3164777068 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e800b55e0 con 0x7f2e800b4b60 2024-09-12T02:35:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.856+0000 7f2e7ffff640 1 --2- 172.21.15.181:0/3164777068 >> v2:172.21.15.204:3300/0 conn(0x7f2e800cfff0 0x7f2e80160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e7effd640 1 --2- 172.21.15.181:0/3164777068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e800cfab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e740097a0 tx=0x7f2e7402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cdd4afcf559802b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e7e7fc640 1 -- 172.21.15.181:0/3164777068 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74037070 con 0x7f2e800b4b60 2024-09-12T02:35:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e7e7fc640 1 -- 172.21.15.181:0/3164777068 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e74032440 con 0x7f2e800b4b60 2024-09-12T02:35:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e7e7fc640 1 -- 172.21.15.181:0/3164777068 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74032810 con 0x7f2e800b4b60 2024-09-12T02:35:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 -- 172.21.15.181:0/3164777068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 msgr2=0x7f2e800cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 --2- 172.21.15.181:0/3164777068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e800cfab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e740097a0 tx=0x7f2e7402a180 comp rx=0 tx=0).stop 2024-09-12T02:35:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 -- 172.21.15.181:0/3164777068 shutdown_connections 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 --2- 172.21.15.181:0/3164777068 >> v2:172.21.15.204:3300/0 conn(0x7f2e800cfff0 0x7f2e80160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 --2- 172.21.15.181:0/3164777068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e800cfab0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 -- 172.21.15.181:0/3164777068 >> 172.21.15.181:0/3164777068 conn(0x7f2e800b1600 msgr2=0x7f2e800b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 -- 172.21.15.181:0/3164777068 shutdown_connections 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.857+0000 7f2e85b11640 1 -- 172.21.15.181:0/3164777068 wait complete. 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 Processor -- start 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 -- start start 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e80149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e800cfff0 0x7f2e80145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e80158d90 0x7f2e8015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801605c0 con 0x7f2e80158d90 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2e800b5ba0 con 0x7f2e800cfff0 2024-09-12T02:35:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.859+0000 7f2e85b11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2e80160740 con 0x7f2e800b4b60 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e80158d90 0x7f2e8015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e80158d90 0x7f2e8015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40950/0 (socket says 172.21.15.181:40950) 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 -- 172.21.15.181:0/2892964110 learned_addr learned my addr 172.21.15.181:0/2892964110 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7f7fe640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e80149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7effd640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e800cfff0 0x7f2e80145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 -- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 msgr2=0x7f2e80149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e80149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 -- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e800cfff0 msgr2=0x7f2e80145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e800cfff0 0x7f2e80145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 -- 172.21.15.181:0/2892964110 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80146750 con 0x7f2e80158d90 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e7ffff640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e80158d90 0x7f2e8015d950 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800efc0 tx=0x7f2e78009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e67fff640 1 -- 172.21.15.181:0/2892964110 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78018030 con 0x7f2e80158d90 2024-09-12T02:35:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e67fff640 1 -- 172.21.15.181:0/2892964110 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7800cde0 con 0x7f2e80158d90 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e80146a30 con 0x7f2e80158d90 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e67fff640 1 -- 172.21.15.181:0/2892964110 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78003bb0 con 0x7f2e80158d90 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.860+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e80146ff0 con 0x7f2e80158d90 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.861+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e800af3c0 con 0x7f2e80158d90 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.862+0000 7f2e67fff640 1 -- 172.21.15.181:0/2892964110 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e78005d10 con 0x7f2e80158d90 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.862+0000 7f2e67fff640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e6c06be30 0x7f2e6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.862+0000 7f2e7f7fe640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e6c06be30 0x7f2e6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.862+0000 7f2e67fff640 1 -- 172.21.15.181:0/2892964110 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f2e7808b6f0 con 0x7f2e80158d90 2024-09-12T02:35:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.863+0000 7f2e7f7fe640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e6c06be30 0x7f2e6c06e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007fd0 tx=0x7f2e70007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:29.867+0000 7f2e67fff640 1 -- 172.21.15.181:0/2892964110 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e800af3c0 con 0x7f2e80158d90 2024-09-12T02:35:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.093+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2e80161ed0 con 0x7f2e80158d90 2024-09-12T02:35:30.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.096+0000 7f2e67fff640 1 -- 172.21.15.181:0/2892964110 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f2e78022070 con 0x7f2e80158d90 2024-09-12T02:35:30.096 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-12T02:35:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg== 2024-09-12T02:35:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: caps mds = "allow" 2024-09-12T02:35:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: caps mon = "allow r" 2024-09-12T02:35:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:35:30.097 INFO:teuthology.orchestra.run.smithi181.stderr:updated caps for client.0 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e6c06be30 msgr2=0x7f2e6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e6c06be30 0x7f2e6c06e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007fd0 tx=0x7f2e70007e80 comp rx=0 tx=0).stop 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e80158d90 msgr2=0x7f2e8015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e80158d90 0x7f2e8015d950 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800efc0 tx=0x7f2e78009f90 comp rx=0 tx=0).stop 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 shutdown_connections 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2e6c06be30 0x7f2e6c06e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e800cfff0 0x7f2e80145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e80158d90 0x7f2e8015d950 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 --2- 172.21.15.181:0/2892964110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e800b4b60 0x7f2e80149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 >> 172.21.15.181:0/2892964110 conn(0x7f2e800b1600 msgr2=0x7f2e80157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 shutdown_connections 2024-09-12T02:35:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.098+0000 7f2e85b11640 1 -- 172.21.15.181:0/2892964110 wait complete. 2024-09-12T02:35:30.110 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.207+0000 7fcd2d596640 1 Processor -- start 2024-09-12T02:35:30.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.207+0000 7fcd2d596640 1 -- start start 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd2d596640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcd28143bb0 0x7fcd2815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd2d596640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd280b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd2d596640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd280b3a40 con 0x7fcd280d0510 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd2d596640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fcd280b2820 con 0x7fcd28143bb0 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd2d596640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcd280b2b00 con 0x7fcd280b30f0 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd267fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcd280d0510 0x7fcd280b1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53568/0 (socket says 172.21.15.181:53568) 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd267fc640 1 -- 172.21.15.181:0/842862342 learned_addr learned my addr 172.21.15.181:0/842862342 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd26ffd640 1 --2- 172.21.15.181:0/842862342 >> v2:172.21.15.204:3300/0 conn(0x7fcd28143bb0 0x7fcd2815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd277fe640 1 --2- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd280b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd25ffb640 1 -- 172.21.15.181:0/842862342 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788968460 0 0) 0x7fcd1c001110 con 0x7fcd280d0510 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.208+0000 7fcd25ffb640 1 -- 172.21.15.181:0/842862342 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd10003520 con 0x7fcd280d0510 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.209+0000 7fcd26ffd640 1 -- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 msgr2=0x7fcd280b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.209+0000 7fcd26ffd640 1 --2- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd280b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.209+0000 7fcd26ffd640 1 -- 172.21.15.181:0/842862342 >> v1:172.21.15.181:6789/0 conn(0x7fcd280d0510 legacy=0x7fcd280b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.209+0000 7fcd26ffd640 1 -- 172.21.15.181:0/842862342 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd28141730 con 0x7fcd28143bb0 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.209+0000 7fcd277fe640 1 --2- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd280b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.209+0000 7fcd26ffd640 1 --2- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 0x7fcd2815ef90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd180097a0 tx=0x7fcd1802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4baecb35d284b3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.209+0000 7fcd25ffb640 1 -- 172.21.15.181:0/842862342 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18037070 con 0x7fcd28143bb0 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd25ffb640 1 -- 172.21.15.181:0/842862342 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd18032440 con 0x7fcd28143bb0 2024-09-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd25ffb640 1 -- 172.21.15.181:0/842862342 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18032810 con 0x7fcd28143bb0 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 -- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 msgr2=0x7fcd2815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 --2- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 0x7fcd2815ef90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd180097a0 tx=0x7fcd1802a180 comp rx=0 tx=0).stop 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 -- 172.21.15.181:0/842862342 shutdown_connections 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 --2- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd280b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 --2- 172.21.15.181:0/842862342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 0x7fcd2815ef90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 -- 172.21.15.181:0/842862342 >> 172.21.15.181:0/842862342 conn(0x7fcd2806bc10 msgr2=0x7fcd2806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 -- 172.21.15.181:0/842862342 shutdown_connections 2024-09-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.210+0000 7fcd2d596640 1 -- 172.21.15.181:0/842862342 wait complete. 2024-09-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.211+0000 7fcd2d596640 1 Processor -- start 2024-09-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.211+0000 7fcd2d596640 1 -- start start 2024-09-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd2d596640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd2813fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd2d596640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd280d0510 0x7fcd280b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd2d596640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 0x7fcd281f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd2d596640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcd280d0980 con 0x7fcd280d0510 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd2d596640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fcd28144320 con 0x7fcd28143bb0 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd2d596640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcd280d0b00 con 0x7fcd280b30f0 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd267fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd280d0510 0x7fcd280b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd267fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd280d0510 0x7fcd280b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40960/0 (socket says 172.21.15.181:40960) 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd267fc640 1 -- 172.21.15.181:0/2108312779 learned_addr learned my addr 172.21.15.181:0/2108312779 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd26ffd640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd2813fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.212+0000 7fcd277fe640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 0x7fcd281f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd267fc640 1 -- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 msgr2=0x7fcd2813fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd267fc640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd2813fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd267fc640 1 -- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 msgr2=0x7fcd281f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd267fc640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 0x7fcd281f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd267fc640 1 -- 172.21.15.181:0/2108312779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd280acba0 con 0x7fcd280d0510 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd267fc640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd280d0510 0x7fcd280b15a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c760 tx=0x7fcd1c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd0f7fe640 1 -- 172.21.15.181:0/2108312779 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c017070 con 0x7fcd280d0510 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd0f7fe640 1 -- 172.21.15.181:0/2108312779 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1c005ad0 con 0x7fcd280d0510 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd280ace80 con 0x7fcd280d0510 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd0f7fe640 1 -- 172.21.15.181:0/2108312779 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c007e20 con 0x7fcd280d0510 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.213+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd280ad440 con 0x7fcd280d0510 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.214+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd28142d60 con 0x7fcd280d0510 2024-09-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.214+0000 7fcd0f7fe640 1 -- 172.21.15.181:0/2108312779 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd1c01a070 con 0x7fcd280d0510 2024-09-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.215+0000 7fcd0f7fe640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.215+0000 7fcd26ffd640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.215+0000 7fcd0f7fe640 1 -- 172.21.15.181:0/2108312779 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7fcd1c08a070 con 0x7fcd280d0510 2024-09-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.216+0000 7fcd26ffd640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcd1406be30 0x7fcd1406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034000 tx=0x7fcd1802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.219+0000 7fcd0f7fe640 1 -- 172.21.15.181:0/2108312779 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd280b3a40 con 0x7fcd280d0510 2024-09-12T02:35:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.418+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd280b5290 con 0x7fcd280d0510 2024-09-12T02:35:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.419+0000 7fcd0f7fe640 1 -- 172.21.15.181:0/2108312779 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5234 (secure 0 0 0) 0x7fcd1c0583e0 con 0x7fcd280d0510 2024-09-12T02:35:30.420 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:30.420 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"btime":"2024-09-12T02:35:28:436708+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:25.750512+0000","modified":"2024-09-12T02:35:27.765241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6834/1682794667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1682794667},{"type":"v1","addr":"172.21.15.204:6834","nonce":1682794667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6780,"qdb_cluster":[6780]},"id":5}]} 2024-09-12T02:35:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 63 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcd1406be30 msgr2=0x7fcd1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcd1406be30 0x7fcd1406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034000 tx=0x7fcd1802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd280d0510 msgr2=0x7fcd280b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd280d0510 0x7fcd280b15a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c760 tx=0x7fcd1c00cb60 comp rx=0 tx=0).stop 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 shutdown_connections 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcd28143bb0 0x7fcd281f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd280d0510 0x7fcd280b15a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 --2- 172.21.15.181:0/2108312779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcd280b30f0 0x7fcd2813fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 >> 172.21.15.181:0/2108312779 conn(0x7fcd2806bc10 msgr2=0x7fcd280b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 shutdown_connections 2024-09-12T02:35:30.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.421+0000 7fcd2d596640 1 -- 172.21.15.181:0/2108312779 wait complete. 2024-09-12T02:35:30.836 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:35:25.750512+0000', 'modified': '2024-09-12T02:35:27.765241+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6780}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6780': {'gid': 6780, 'name': 'b', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6834/1682794667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6832', 'nonce': 1682794667}, {'type': 'v1', 'addr': '172.21.15.204:6834', 'nonce': 1682794667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6780, 'qdb_cluster': [6780]} 2024-09-12T02:35:30.836 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:35:30.836 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.937+0000 7f01c1237640 1 Processor -- start 2024-09-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.938+0000 7f01c1237640 1 -- start start 2024-09-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.938+0000 7f01c1237640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f01bc0b3800 0x7f01bc15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.938+0000 7f01c1237640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01bc0b2820 con 0x7f01bc0d08f0 2024-09-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.938+0000 7f01c1237640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01bc0b2b00 con 0x7f01bc0d0510 2024-09-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.938+0000 7f01c1237640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f01bc141730 con 0x7f01bc0b3800 2024-09-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01ba59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f01bc0b3800 0x7f01bc15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01bb59e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f01bc0d08f0 0x7f01bc072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53582/0 (socket says 172.21.15.181:53582) 2024-09-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01bb59e640 1 -- 172.21.15.181:0/657056312 learned_addr learned my addr 172.21.15.181:0/657056312 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01b9d9b640 1 -- 172.21.15.181:0/657056312 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191601496 0 0) 0x7f01bc0b2820 con 0x7f01bc0d08f0 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01b9d9b640 1 -- 172.21.15.181:0/657056312 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01a8003520 con 0x7f01bc0d08f0 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01ba59c640 1 -- 172.21.15.181:0/657056312 >> v1:172.21.15.204:6789/0 conn(0x7f01bc0d0510 legacy=0x7f01bc0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01ba59c640 1 -- 172.21.15.181:0/657056312 >> v1:172.21.15.181:6789/0 conn(0x7f01bc0d08f0 legacy=0x7f01bc072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.939+0000 7f01ba59c640 1 -- 172.21.15.181:0/657056312 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc144320 con 0x7f01bc0b3800 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01ba59c640 1 --2- 172.21.15.181:0/657056312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc15ef90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0097a0 tx=0x7f01ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00ac8f3e7f6bae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01b9d9b640 1 -- 172.21.15.181:0/657056312 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac037070 con 0x7f01bc0b3800 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01b9d9b640 1 -- 172.21.15.181:0/657056312 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac032440 con 0x7f01bc0b3800 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01b9d9b640 1 -- 172.21.15.181:0/657056312 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0327f0 con 0x7f01bc0b3800 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01c1237640 1 -- 172.21.15.181:0/657056312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 msgr2=0x7f01bc15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01c1237640 1 --2- 172.21.15.181:0/657056312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc15ef90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0097a0 tx=0x7f01ac02a230 comp rx=0 tx=0).stop 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01c1237640 1 -- 172.21.15.181:0/657056312 shutdown_connections 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01c1237640 1 --2- 172.21.15.181:0/657056312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc15ef90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01c1237640 1 -- 172.21.15.181:0/657056312 >> 172.21.15.181:0/657056312 conn(0x7f01bc06bc10 msgr2=0x7f01bc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01c1237640 1 -- 172.21.15.181:0/657056312 shutdown_connections 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.940+0000 7f01c1237640 1 -- 172.21.15.181:0/657056312 wait complete. 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.942+0000 7f01c1237640 1 Processor -- start 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.942+0000 7f01c1237640 1 -- start start 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.942+0000 7f01c1237640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.942+0000 7f01c1237640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01bc0d0510 0x7f01bc136e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.942+0000 7f01c1237640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01bc0d08f0 0x7f01bc0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01c1237640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc143bb0 con 0x7f01bc0b3800 2024-09-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01c1237640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc142e70 con 0x7f01bc0d0510 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01c1237640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f01bc143d30 con 0x7f01bc0d08f0 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc1572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40964/0 (socket says 172.21.15.181:40964) 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 -- 172.21.15.181:0/1611827718 learned_addr learned my addr 172.21.15.181:0/1611827718 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01ba59c640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01bc0d0510 0x7f01bc136e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bb59e640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01bc0d08f0 0x7f01bc0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 -- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01bc0d08f0 msgr2=0x7f01bc0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01bc0d08f0 0x7f01bc0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 -- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01bc0d0510 msgr2=0x7f01bc136e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01bc0d0510 0x7f01bc136e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 -- 172.21.15.181:0/1611827718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc15a3d0 con 0x7f01bc0b3800 2024-09-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bb59e640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01bc0d08f0 0x7f01bc0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01bad9d640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc1572f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c430 tx=0x7f01a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01b37fe640 1 -- 172.21.15.181:0/1611827718 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a40052d0 con 0x7f01bc0b3800 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01b37fe640 1 -- 172.21.15.181:0/1611827718 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a4005490 con 0x7f01bc0b3800 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01bc15a130 con 0x7f01bc0b3800 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01b37fe640 1 -- 172.21.15.181:0/1611827718 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4007260 con 0x7f01bc0b3800 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.943+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01bc138bc0 con 0x7f01bc0b3800 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.945+0000 7f01b37fe640 1 -- 172.21.15.181:0/1611827718 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01a4007400 con 0x7f01bc0b3800 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.945+0000 7f01b37fe640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f019c06be60 0x7f019c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.945+0000 7f01ba59c640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f019c06be60 0x7f019c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.945+0000 7f01b37fe640 1 -- 172.21.15.181:0/1611827718 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f01a408a2a0 con 0x7f01bc0b3800 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.946+0000 7f01ba59c640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f019c06be60 0x7f019c06e320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f01ac034000 tx=0x7f01ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.946+0000 7f01c3fcf740 1 Processor -- start 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01c3fcf740 1 -- start start 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f99a80 0x557537f9c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537f968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557537efe520 con 0x557537f99a80 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x557537ea63e0 con 0x557537f9c2c0 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x557537efa4e0 con 0x557537f9da50 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01ba59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f99a80 0x557537f9c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01ba59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f99a80 0x557537f9c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40966/0 (socket says 172.21.15.181:40966) 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.947+0000 7f01ba59c640 1 -- 172.21.15.181:0/3111436504 learned_addr learned my addr 172.21.15.181:0/3111436504 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01ba59c640 1 -- 172.21.15.181:0/3111436504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 msgr2=0x557537f968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01ba59c640 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537f968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01ba59c640 1 -- 172.21.15.181:0/3111436504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 msgr2=0x557537fe1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01bad9d640 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01ba59c640 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01ba59c640 1 -- 172.21.15.181:0/3111436504 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557537ec12f0 con 0x557537f99a80 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01ba59c640 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f99a80 0x557537f9c6a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009890 tx=0x7f01ac02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c33f057bb1bce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01b0ff9640 1 -- 172.21.15.181:0/3111436504 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac041030 con 0x557537f99a80 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01b0ff9640 1 -- 172.21.15.181:0/3111436504 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac04d070 con 0x557537f99a80 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.948+0000 7f01b0ff9640 1 -- 172.21.15.181:0/3111436504 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac037050 con 0x557537f99a80 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3111436504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f99a80 msgr2=0x557537f9c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f99a80 0x557537f9c6a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009890 tx=0x7f01ac02c000 comp rx=0 tx=0).stop 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3111436504 shutdown_connections 2024-09-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537f968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f99a80 0x557537f9c6a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3111436504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3111436504 >> 172.21.15.181:0/3111436504 conn(0x557537f98a80 msgr2=0x557537fe0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3111436504 shutdown_connections 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3111436504 wait complete. 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 -- start start 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.949+0000 7f01c3fcf740 1 Processor -- start 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9c2c0 0x557537fc49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fde480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537fbef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557537f97f20 con 0x557537fdb110 2024-09-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x557537e87450 con 0x557537f9da50 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x557537fe2290 con 0x557537f9c2c0 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01c3fcf740 10 client.0 _ll_register_callbacks cb 0x557537c10ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537fbef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537fbef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40978/0 (socket says 172.21.15.181:40978) 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 -- 172.21.15.181:0/2253709394 learned_addr learned my addr 172.21.15.181:0/2253709394 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01ba59c640 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fde480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bad9d640 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9c2c0 0x557537fc49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 -- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9c2c0 msgr2=0x557537fc49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9c2c0 0x557537fc49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 -- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 msgr2=0x557537fde480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fde480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.950+0000 7f01bb59e640 1 -- 172.21.15.181:0/2253709394 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557537c112d0 con 0x557537fdb110 2024-09-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01bb59e640 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537fbef60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f01b400e710 tx=0x7f01b400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ba40e7c50ee4e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f0199ffb640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f0199ffb640 1 -- 172.21.15.181:0/2253709394 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b400ee20 con 0x557537fdb110 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f0199ffb640 1 -- 172.21.15.181:0/2253709394 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f01b400c870 con 0x557537fdb110 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01ac04d070 con 0x557537fdb110 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f0199ffb640 1 -- 172.21.15.181:0/2253709394 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f01b4020050 con 0x557537fdb110 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 10 client.6888 fetch_fsmap learned FSMap version 63 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x557537cdb6b0 con 0x557537fdb110 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f0199ffb640 1 -- 172.21.15.181:0/2253709394 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac04d070 con 0x557537fdb110 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f0199ffb640 1 -- 172.21.15.181:0/2253709394 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f01b4023020 con 0x557537fdb110 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 10 client.6888 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 10 client.6888 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 20 client.6888 populate_metadata read hostname 'smithi181' 2024-09-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x557537f97200 0x557537ff4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 4 client.6888 mds_command: new command op to 6780 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 --> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557537f0bc50 con 0x557537f97200 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.951+0000 7f01bad9d640 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x557537f97200 0x557537ff4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.952+0000 7f01bad9d640 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x557537f97200 0x557537ff4620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dd38d84409412e server_cookie=db4e7e320f4781e5 in_seq=0 out_seq=0 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.952+0000 7f0199ffb640 10 client.6888 ms_handle_connect on v2:172.21.15.204:6832/1682794667 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.952+0000 7f0199ffb640 1 -- 172.21.15.181:0/2253709394 <== mds.0 v2:172.21.15.204:6832/1682794667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557537f0bc50 con 0x557537f97200 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.952+0000 7f0199ffb640 10 client.6888 handle_command_reply: tid=0 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 client.6888 shutdown 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 msgr2=0x557537fbef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537fbef60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f01b400e710 tx=0x7f01b400ebd0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 shutdown_connections 2024-09-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x557537f97200 0x557537ff4620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fde480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537fbef60 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f0199ffb640 0 client.6888 ms_handle_reset on v2:172.21.15.204:6832/1682794667 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/2253709394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9c2c0 0x557537fc49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 >> 172.21.15.181:0/2253709394 conn(0x557537f99a80 msgr2=0x557537fe0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 shutdown_connections 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 1 -- 172.21.15.181:0/2253709394 wait complete. 2024-09-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.953+0000 7f01c3fcf740 20 client.6888 trim_cache size 0 max 16384 2024-09-12T02:35:30.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.970+0000 7f01c3fcf740 1 Processor -- start 2024-09-12T02:35:30.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.970+0000 7f01c3fcf740 1 -- start start 2024-09-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537fe1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537ff2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc1ffab0 con 0x557537fdb110 2024-09-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc071090 con 0x557537f9c2c0 2024-09-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f01bc0716e0 con 0x557537f9da50 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537ff2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537ff2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40986/0 (socket says 172.21.15.181:40986) 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 -- 172.21.15.181:0/1021524773 learned_addr learned my addr 172.21.15.181:0/1021524773 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bad9d640 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01ba59c640 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537fe1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 -- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 msgr2=0x557537fe1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537fe1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 -- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 msgr2=0x557537fe0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 -- 172.21.15.181:0/1021524773 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557537f91470 con 0x557537fdb110 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bad9d640 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01ba59c640 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537fe1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f01bb59e640 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537ff2ff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f01b4001ab0 tx=0x7f01b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f73e711e6bf631e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.971+0000 7f019bfff640 1 -- 172.21.15.181:0/1021524773 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b400ee20 con 0x557537fdb110 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f019bfff640 1 -- 172.21.15.181:0/1021524773 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b4018070 con 0x557537fdb110 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f019bfff640 1 -- 172.21.15.181:0/1021524773 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b400cdf0 con 0x557537fdb110 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 -- 172.21.15.181:0/1021524773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 msgr2=0x557537ff2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537ff2ff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f01b4001ab0 tx=0x7f01b4012000 comp rx=0 tx=0).stop 2024-09-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 -- 172.21.15.181:0/1021524773 shutdown_connections 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537fdb110 0x557537ff2ff0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537f9da50 0x557537fe1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/1021524773 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9c2c0 0x557537fe0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 -- 172.21.15.181:0/1021524773 >> 172.21.15.181:0/1021524773 conn(0x557537f99a80 msgr2=0x557537fc4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 -- 172.21.15.181:0/1021524773 shutdown_connections 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.972+0000 7f01c3fcf740 1 -- 172.21.15.181:0/1021524773 wait complete. 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 -- start start 2024-09-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 Processor -- start 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f9c2c0 0x557537fef650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fe0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537fdb110 0x557538067140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557537f97080 con 0x557537f9c2c0 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x557537fc5000 con 0x557537f9da50 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x557537fdb560 con 0x557537fdb110 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.973+0000 7f01c3fcf740 10 client.0 _ll_register_callbacks cb 0x7f01b40019d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f9c2c0 0x557537fef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f9c2c0 0x557537fef650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40996/0 (socket says 172.21.15.181:40996) 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 -- 172.21.15.181:0/3697242151 learned_addr learned my addr 172.21.15.181:0/3697242151 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01ba59c640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fe0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bb59e640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537fdb110 0x557538067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 -- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537fdb110 msgr2=0x557538067140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537fdb110 0x557538067140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 -- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 msgr2=0x557537fe0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fe0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 -- 172.21.15.181:0/3697242151 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557537fd9960 con 0x557537f9c2c0 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bb59e640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537fdb110 0x557538067140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01bad9d640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f9c2c0 0x557537fef650 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f01a4054a90 tx=0x7f01a400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1440a417eea80d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f0199ffb640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f0199ffb640 1 -- 172.21.15.181:0/3697242151 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4054ca0 con 0x557537f9c2c0 2024-09-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f0199ffb640 1 -- 172.21.15.181:0/3697242151 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f01a4088b90 con 0x557537f9c2c0 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01b4018070 con 0x557537f9c2c0 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f0199ffb640 1 -- 172.21.15.181:0/3697242151 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f01a4075050 con 0x557537f9c2c0 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 10 client.6894 fetch_fsmap learned FSMap version 63 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x557537fda260 con 0x557537f9c2c0 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f0199ffb640 1 -- 172.21.15.181:0/3697242151 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b4018070 con 0x557537f9c2c0 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f0199ffb640 1 -- 172.21.15.181:0/3697242151 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f01a4057a80 con 0x557537f9c2c0 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 10 client.6894 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 10 client.6894 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 20 client.6894 populate_metadata read hostname 'smithi181' 2024-09-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x55753806ba70 0x557537ff2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 4 client.6894 mds_command: new command op to 6780 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.974+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 --> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] -- command(tid 0: {"prefix": "status"}) -- 0x557537f05fa0 con 0x55753806ba70 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01ba59c640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x55753806ba70 0x557537ff2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f0199ffb640 10 client.6894 ms_handle_connect on v2:172.21.15.204:6832/1682794667 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01ba59c640 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x55753806ba70 0x557537ff2ff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4531c14ff64f1eb3 server_cookie=215c81a5fb161181 in_seq=0 out_seq=0 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f0199ffb640 1 -- 172.21.15.181:0/3697242151 <== mds.0 v2:172.21.15.204:6832/1682794667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x557537f05fa0 con 0x55753806ba70 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f0199ffb640 10 client.6894 handle_command_reply: tid=0 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 client.6894 shutdown 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f9c2c0 msgr2=0x557537fef650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f9c2c0 0x557537fef650 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f01a4054a90 tx=0x7f01a400a000 comp rx=0 tx=0).stop 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 shutdown_connections 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:6832/1682794667,v1:172.21.15.204:6834/1682794667] conn(0x55753806ba70 0x557537ff2ff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x557537f9da50 0x557537fe0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f0199ffb640 0 client.6894 ms_handle_reset on v2:172.21.15.204:6832/1682794667 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x557537fdb110 0x557538067140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 --2- 172.21.15.181:0/3697242151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557537f9c2c0 0x557537fef650 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 >> 172.21.15.181:0/3697242151 conn(0x557537f99a80 msgr2=0x557537fc4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 shutdown_connections 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.975+0000 7f01c3fcf740 1 -- 172.21.15.181:0/3697242151 wait complete. 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c3fcf740 20 client.6894 trim_cache size 0 max 16384 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6780, 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 4.546102243, 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 63, 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 75, 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 75, 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 8.6292768849999995 2024-09-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f019c06be60 msgr2=0x7f019c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f019c06be60 0x7f019c06e320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f01ac034000 tx=0x7f01ac02e000 comp rx=0 tx=0).stop 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 msgr2=0x7f01bc1572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc1572f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c430 tx=0x7f01a400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 shutdown_connections 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f019c06be60 0x7f019c06e320 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01bc0d0510 0x7f01bc136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01bc0d08f0 0x7f01bc0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 --2- 172.21.15.181:0/1611827718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01bc0b3800 0x7f01bc1572f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 >> 172.21.15.181:0/1611827718 conn(0x7f01bc06bc10 msgr2=0x7f01bc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 shutdown_connections 2024-09-12T02:35:30.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:30.976+0000 7f01c1237640 1 -- 172.21.15.181:0/1611827718 wait complete. 2024-09-12T02:35:30.991 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:35:31.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.089+0000 7f8e47d23640 1 Processor -- start 2024-09-12T02:35:31.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.089+0000 7f8e47d23640 1 -- start start 2024-09-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.090+0000 7f8e47d23640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 0x7f8e400cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.090+0000 7f8e47d23640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e400d0a30 con 0x7f8e4015c4a0 2024-09-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.090+0000 7f8e47d23640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e400b76f0 con 0x7f8e400b47a0 2024-09-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.090+0000 7f8e47d23640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8e400d0d30 con 0x7f8e400d2da0 2024-09-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.090+0000 7f8e45abf640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8e4015c4a0 0x7f8e400b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53592/0 (socket says 172.21.15.181:53592) 2024-09-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.090+0000 7f8e45abf640 1 -- 172.21.15.181:0/3663817011 learned_addr learned my addr 172.21.15.181:0/3663817011 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996603791 0 0) 0x7f8e400d0a30 con 0x7f8e4015c4a0 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e2c003520 con 0x7f8e4015c4a0 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e462c0640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 0x7f8e400cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4020015898 0 0) 0x7f8e2c003520 con 0x7f8e4015c4a0 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 msgr2=0x7f8e400cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 0x7f8e400cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 >> v1:172.21.15.204:6789/0 conn(0x7f8e400b47a0 legacy=0x7f8e40164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e40073710 con 0x7f8e4015c4a0 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f8e3c0019f0 con 0x7f8e4015c4a0 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 >> v1:172.21.15.181:6789/0 conn(0x7f8e4015c4a0 legacy=0x7f8e400b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e2c0039e0 0x7f8e2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 0x7f8e2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c004d40 0x7f8e2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8e400d0d30 con 0x7f8e2c0039e0 2024-09-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c00baf0 con 0x7f8e2c004d40 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2c00bcf0 con 0x7f8e400d2da0 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e45abf640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e2c0039e0 0x7f8e2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e462c0640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c004d40 0x7f8e2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e452be640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 0x7f8e2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e45abf640 1 -- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 msgr2=0x7f8e2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e45abf640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e400d2da0 0x7f8e2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e45abf640 1 -- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c004d40 msgr2=0x7f8e2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e45abf640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c004d40 0x7f8e2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.091+0000 7f8e45abf640 1 -- 172.21.15.181:0/3663817011 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2c003520 con 0x7f8e2c0039e0 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.092+0000 7f8e45abf640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e2c0039e0 0x7f8e2c003e00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00a850 tx=0x7f8e2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb69170b532f4f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.092+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00a4a0 con 0x7f8e2c0039e0 2024-09-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.092+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3c02f070 con 0x7f8e2c0039e0 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.092+0000 7f8e44abd640 1 -- 172.21.15.181:0/3663817011 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c02bc20 con 0x7f8e2c0039e0 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.093+0000 7f8e47d23640 1 -- 172.21.15.181:0/3663817011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e2c0039e0 msgr2=0x7f8e2c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.093+0000 7f8e47d23640 1 --2- 172.21.15.181:0/3663817011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e2c0039e0 0x7f8e2c003e00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00a850 tx=0x7f8e2c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.093+0000 7f8e462c0640 1 -- 172.21.15.181:0/3663817011 reap_dead start 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.093+0000 7f8e47d23640 1 -- 172.21.15.181:0/3663817011 shutdown_connections 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.093+0000 7f8e47d23640 1 -- 172.21.15.181:0/3663817011 >> 172.21.15.181:0/3663817011 conn(0x7f8e40067950 msgr2=0x7f8e40067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.093+0000 7f8e47d23640 1 -- 172.21.15.181:0/3663817011 shutdown_connections 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.093+0000 7f8e47d23640 1 -- 172.21.15.181:0/3663817011 wait complete. 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.094+0000 7f8e47d23640 1 Processor -- start 2024-09-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.094+0000 7f8e47d23640 1 -- start start 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e47d23640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c0039e0 0x7f8e40149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e47d23640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e40153fa0 0x7f8e40154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e47d23640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e4015a950 0x7f8e4015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e47d23640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8e400cff80 con 0x7f8e40153fa0 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e47d23640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8e400d28e0 con 0x7f8e2c0039e0 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e47d23640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8e400d0100 con 0x7f8e4015a950 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e40153fa0 0x7f8e40154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e40153fa0 0x7f8e40154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41006/0 (socket says 172.21.15.181:41006) 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 -- 172.21.15.181:0/33191560 learned_addr learned my addr 172.21.15.181:0/33191560 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 -- 172.21.15.181:0/33191560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e4015a950 msgr2=0x7f8e4015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e4015a950 0x7f8e4015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 -- 172.21.15.181:0/33191560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c0039e0 msgr2=0x7f8e40149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c0039e0 0x7f8e40149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 -- 172.21.15.181:0/33191560 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e40154a20 con 0x7f8e40153fa0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e452be640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e40153fa0 0x7f8e40154420 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000f820 tx=0x7f8e3000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e367fc640 1 -- 172.21.15.181:0/33191560 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e300050d0 con 0x7f8e40153fa0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.095+0000 7f8e367fc640 1 -- 172.21.15.181:0/33191560 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e30018070 con 0x7f8e40153fa0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.096+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e40154d00 con 0x7f8e40153fa0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.096+0000 7f8e367fc640 1 -- 172.21.15.181:0/33191560 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30005490 con 0x7f8e40153fa0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.096+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e401552c0 con 0x7f8e40153fa0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.096+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4015b310 con 0x7f8e40153fa0 2024-09-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.097+0000 7f8e367fc640 1 -- 172.21.15.181:0/33191560 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e3000d6b0 con 0x7f8e40153fa0 2024-09-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.097+0000 7f8e367fc640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e2406be60 0x7f8e2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.098+0000 7f8e367fc640 1 -- 172.21.15.181:0/33191560 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f8e3008acc0 con 0x7f8e40153fa0 2024-09-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.098+0000 7f8e45abf640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e2406be60 0x7f8e2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.098+0000 7f8e45abf640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e2406be60 0x7f8e2406e320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c033000 tx=0x7f8e3c038040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.102+0000 7f8e367fc640 1 -- 172.21.15.181:0/33191560 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e30059670 con 0x7f8e40153fa0 2024-09-12T02:35:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.302+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8e4015c880 con 0x7f8e40153fa0 2024-09-12T02:35:31.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.303+0000 7f8e367fc640 1 -- 172.21.15.181:0/33191560 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) ==== 53+0+73 (secure 0 0 0) 0x7f8e30058f70 con 0x7f8e40153fa0 2024-09-12T02:35:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:35:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e2406be60 msgr2=0x7f8e2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e2406be60 0x7f8e2406e320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c033000 tx=0x7f8e3c038040 comp rx=0 tx=0).stop 2024-09-12T02:35:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e40153fa0 msgr2=0x7f8e40154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e40153fa0 0x7f8e40154420 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000f820 tx=0x7f8e3000fce0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 shutdown_connections 2024-09-12T02:35:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8e2406be60 0x7f8e2406e320 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e4015a950 0x7f8e4015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e40153fa0 0x7f8e40154420 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 --2- 172.21.15.181:0/33191560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e2c0039e0 0x7f8e40149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 >> 172.21.15.181:0/33191560 conn(0x7f8e40067950 msgr2=0x7f8e400b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 shutdown_connections 2024-09-12T02:35:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31.305+0000 7f8e47d23640 1 -- 172.21.15.181:0/33191560 wait complete. 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:35:31.317 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:31.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:31.318 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:35:31.334 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42312sec preferred_lft 42312sec 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:35:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:31.337 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:35:31.397 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:35:31.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:31.399 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:35:31.455 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:35:31.455 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:35:31.455 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:35:31.456 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:35:31.456 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:35:31.456 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:31.456 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:35:31.456 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:35:31.456 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:35:31.456 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:35:31.456 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:35:31.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:31.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:31.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:31.582 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:35:31.597 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:35:31.598 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:35:31.598 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:31.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:31.598 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:35:31.663 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:35:31.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:31.663 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:31.718 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:31.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:31.718 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:31.774 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:35:31.839 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:35:31.895 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:31.896 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:35:31.897 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:35:31.897 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:35:31.897 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:35:31.897 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:35:31.897 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:35:31.897 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:35:31.901 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:31.901 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:31.901 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:31.901 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:31.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:31.902 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:35:31.951 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:35:31.951 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:35:31.994 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:35:32.018 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:32.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:32.078 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:35:32.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:35:32.076+0000 7f6148a0b480 -1 init, newargv = 0x560964bce9e0 newargc=15 2024-09-12T02:35:32.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[62178]: starting ceph client 2024-09-12T02:35:32.081 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[62178]: starting fuse 2024-09-12T02:35:32.093 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:35:32.093 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:35:32.094 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:35:32.095 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:35:32.210 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.62178.asok 2024-09-12T02:35:32.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:32.221 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.62178.asok 2024-09-12T02:35:32.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:32.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.62178.asok status 2024-09-12T02:35:32.354 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:32.354 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:35:32.354 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:35:32.354 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "62178", 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6909, 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 6909 2024-09-12T02:35:32.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3413866975 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3413866975 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.6909 192.168.0.1:0/3413866975", 2024-09-12T02:35:32.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/3413866975", 2024-09-12T02:35:32.357 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:35:32.357 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 63, 2024-09-12T02:35:32.357 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 75, 2024-09-12T02:35:32.357 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:35:32.357 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:35:32.357 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:35:32.357 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:32.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:32.363 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:35:32.363 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:32.378 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:35:32.378 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:32.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:32.379 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:32.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:32.444 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch foo) 2024-09-12T02:35:32.506 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:32.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.644+0000 7ff0b9111640 1 Processor -- start 2024-09-12T02:35:32.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.644+0000 7ff0b9111640 1 -- start start 2024-09-12T02:35:32.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b9111640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 0x7ff0b415ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b9111640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff0b40b3800 0x7ff0b4072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b9111640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b40b2820 con 0x7ff0b40d08f0 2024-09-12T02:35:32.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b9111640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b40b2b00 con 0x7ff0b40b3800 2024-09-12T02:35:32.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b9111640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b4141730 con 0x7ff0b40d0510 2024-09-12T02:35:32.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b259c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff0b40d08f0 0x7ff0b40b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53602/0 (socket says 172.21.15.181:53602) 2024-09-12T02:35:32.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b259c640 1 -- 172.21.15.181:0/1342968030 learned_addr learned my addr 172.21.15.181:0/1342968030 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:32.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b359e640 1 --2- 172.21.15.181:0/1342968030 >> v2:172.21.15.204:3300/0 conn(0x7ff0b40b3800 0x7ff0b4072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678389080 0 0) 0x7ff0b40b2820 con 0x7ff0b40d08f0 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b2d9d640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 0x7ff0b415ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c003520 con 0x7ff0b40d08f0 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2671623909 0 0) 0x7ff09c003520 con 0x7ff0b40d08f0 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 msgr2=0x7ff0b415ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 0x7ff0b415ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 >> v2:172.21.15.204:3300/0 conn(0x7ff0b40b3800 msgr2=0x7ff0b4072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 --2- 172.21.15.181:0/1342968030 >> v2:172.21.15.204:3300/0 conn(0x7ff0b40b3800 0x7ff0b4072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b4144320 con 0x7ff0b40d08f0 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7ff0a8001670 con 0x7ff0b40d08f0 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.645+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 >> v1:172.21.15.181:6789/0 conn(0x7ff0b40d08f0 legacy=0x7ff0b40b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b1d9b640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 0x7ff09c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b1d9b640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff09c003f30 0x7ff09c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b1d9b640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff09c004d40 0x7ff09c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b40b2b00 con 0x7ff09c003f30 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b4141730 con 0x7ff09c004d40 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c00cad0 con 0x7ff0b40d0510 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b259c640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff09c003f30 0x7ff09c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b2d9d640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 0x7ff09c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b359e640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff09c004d40 0x7ff09c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b259c640 1 -- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 msgr2=0x7ff09c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b259c640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 0x7ff09c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b259c640 1 -- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff09c004d40 msgr2=0x7ff09c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:32.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b259c640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff09c004d40 0x7ff09c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b259c640 1 -- 172.21.15.181:0/1342968030 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c003520 con 0x7ff09c003f30 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.646+0000 7ff0b2d9d640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0b40d0510 0x7ff09c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b259c640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff09c003f30 0x7ff09c004800 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8001050 tx=0x7ff09c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bb853d1d650f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8007d70 con 0x7ff09c003f30 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a8005af0 con 0x7ff09c003f30 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b1d9b640 1 -- 172.21.15.181:0/1342968030 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8007070 con 0x7ff09c003f30 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b9111640 1 -- 172.21.15.181:0/1342968030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff09c003f30 msgr2=0x7ff09c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b9111640 1 --2- 172.21.15.181:0/1342968030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff09c003f30 0x7ff09c004800 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8001050 tx=0x7ff09c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b359e640 1 -- 172.21.15.181:0/1342968030 reap_dead start 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b9111640 1 -- 172.21.15.181:0/1342968030 shutdown_connections 2024-09-12T02:35:32.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b9111640 1 -- 172.21.15.181:0/1342968030 >> 172.21.15.181:0/1342968030 conn(0x7ff0b406bc10 msgr2=0x7ff0b406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:32.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b9111640 1 -- 172.21.15.181:0/1342968030 shutdown_connections 2024-09-12T02:35:32.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.647+0000 7ff0b9111640 1 -- 172.21.15.181:0/1342968030 wait complete. 2024-09-12T02:35:32.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.649+0000 7ff0b9111640 1 Processor -- start 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.649+0000 7ff0b9111640 1 -- start start 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff09c003f30 0x7ff0b4070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b413ee60 0x7ff0b415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0b4071390 0x7ff0b415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b415ef90 con 0x7ff0b413ee60 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b4143dc0 con 0x7ff0b4071390 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b415f110 con 0x7ff09c003f30 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b413ee60 0x7ff0b415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b413ee60 0x7ff0b415cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41020/0 (socket says 172.21.15.181:41020) 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 -- 172.21.15.181:0/1442463096 learned_addr learned my addr 172.21.15.181:0/1442463096 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b2d9d640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff09c003f30 0x7ff0b4070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b359e640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0b4071390 0x7ff0b415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 -- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff09c003f30 msgr2=0x7ff0b4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff09c003f30 0x7ff0b4070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 -- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0b4071390 msgr2=0x7ff0b415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0b4071390 0x7ff0b415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 -- 172.21.15.181:0/1442463096 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b40718a0 con 0x7ff0b413ee60 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b2d9d640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff09c003f30 0x7ff0b4070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b359e640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0b4071390 0x7ff0b415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b259c640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b413ee60 0x7ff0b415cb30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff0a802ae20 tx=0x7ff0a8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:32.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff09b7fe640 1 -- 172.21.15.181:0/1442463096 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8042070 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff09b7fe640 1 -- 172.21.15.181:0/1442463096 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a8007480 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b4071b80 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff09b7fe640 1 -- 172.21.15.181:0/1442463096 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8007d50 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.650+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b4071e60 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.651+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b40b30f0 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.652+0000 7ff09b7fe640 1 -- 172.21.15.181:0/1442463096 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0a8045070 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.652+0000 7ff09b7fe640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0a006be30 0x7ff0a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.652+0000 7ff09b7fe640 1 -- 172.21.15.181:0/1442463096 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7ff0a80ab960 con 0x7ff0b413ee60 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.652+0000 7ff0b2d9d640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0a006be30 0x7ff0a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.653+0000 7ff0b2d9d640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0a006be30 0x7ff0a006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40099f0 tx=0x7ff0a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:32.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.657+0000 7ff09b7fe640 1 -- 172.21.15.181:0/1442463096 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0a804c030 con 0x7ff0b413ee60 2024-09-12T02:35:32.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.855+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0b4072a30 con 0x7ff0b413ee60 2024-09-12T02:35:32.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.856+0000 7ff09b7fe640 1 -- 172.21.15.181:0/1442463096 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5234 (secure 0 0 0) 0x7ff0a803c340 con 0x7ff0b413ee60 2024-09-12T02:35:32.857 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:32.857 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"btime":"2024-09-12T02:35:28:436708+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:25.750512+0000","modified":"2024-09-12T02:35:27.765241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6834/1682794667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1682794667},{"type":"v1","addr":"172.21.15.204:6834","nonce":1682794667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6780,"qdb_cluster":[6780]},"id":5}]} 2024-09-12T02:35:32.857 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 63 2024-09-12T02:35:32.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0a006be30 msgr2=0x7ff0a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0a006be30 0x7ff0a006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40099f0 tx=0x7ff0a4008040 comp rx=0 tx=0).stop 2024-09-12T02:35:32.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b413ee60 msgr2=0x7ff0b415cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b413ee60 0x7ff0b415cb30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff0a802ae20 tx=0x7ff0a8000fe0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 shutdown_connections 2024-09-12T02:35:32.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff0a006be30 0x7ff0a006e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0b4071390 0x7ff0b415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0b413ee60 0x7ff0b415cb30 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 --2- 172.21.15.181:0/1442463096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff09c003f30 0x7ff0b4070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 >> 172.21.15.181:0/1442463096 conn(0x7ff0b406bc10 msgr2=0x7ff0b4140550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:32.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 shutdown_connections 2024-09-12T02:35:32.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:32.858+0000 7ff0b9111640 1 -- 172.21.15.181:0/1442463096 wait complete. 2024-09-12T02:35:32.870 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-12T02:35:33.002 INFO:teuthology.orchestra.run.smithi204.stdout:{"message":"","return_code":0} 2024-09-12T02:35:33.003 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T02:35:33.003 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-12T02:35:33.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.044+0000 7f5a57ad3280 1 -- start start 2024-09-12T02:35:33.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.044+0000 7f5a57ad3280 1 Processor -- start 2024-09-12T02:35:33.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c46ae2c00 0x562c46b5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c46ae3800 0x562c46b5eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c46ae3c00 0x562c46b5f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562c479b0180 con 0x562c46ae3c00 2024-09-12T02:35:33.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562c479b0300 con 0x562c46ae2c00 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562c479b0480 con 0x562c46ae3800 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c46ae3c00 0x562c46b5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c46ae3c00 0x562c46b5f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41038/0 (socket says 172.21.15.181:41038) 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 -- 172.21.15.181:0/3589987489 learned_addr learned my addr 172.21.15.181:0/3589987489 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a55a79640 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c46ae3800 0x562c46b5eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a5627a640 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c46ae2c00 0x562c46b5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 -- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c46ae3800 msgr2=0x562c46b5eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c46ae3800 0x562c46b5eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 -- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c46ae2c00 msgr2=0x562c46b5e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c46ae2c00 0x562c46b5e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.045+0000 7f5a56a7b640 1 -- 172.21.15.181:0/3589987489 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c46b1a780 con 0x562c46ae3c00 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a56a7b640 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c46ae3c00 0x562c46b5f080 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x562c479152f0 tx=0x562c47886180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbc2f973ac3cb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a53a75640 1 -- 172.21.15.181:0/3589987489 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562c46b08680 con 0x562c46ae3c00 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a53a75640 1 -- 172.21.15.181:0/3589987489 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562c46b0efc0 con 0x562c46ae3c00 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a53a75640 1 -- 172.21.15.181:0/3589987489 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562c46b08b60 con 0x562c46ae3c00 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a57ad3280 1 -- 172.21.15.181:0/3589987489 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c46b1a3c0 con 0x562c46ae3c00 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a57ad3280 1 -- 172.21.15.181:0/3589987489 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562c46b1b680 con 0x562c46ae3c00 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a57ad3280 4 waiting for MDS map... 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a53a75640 1 -- 172.21.15.181:0/3589987489 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x562c479d4600 con 0x562c46ae3c00 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a53a75640 1 -- 172.21.15.181:0/3589987489 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x562c46b3d180 con 0x562c46ae3c00 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a57ad3280 4 Got MDS map 63 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a57ad3280 10 main: main 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.046+0000 7f5a57ad3280 4 main: connecting to RADOS... 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 Processor -- start 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 -- start start 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bb400 0x562c46b5f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bbc00 0x562c46b60100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562c479b0600 con 0x562c479bbc00 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562c479b0780 con 0x562c479bb800 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562c479b0900 con 0x562c479bb400 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.047+0000 7f5a55a79640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bbc00 0x562c46b60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bbc00 0x562c46b60100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41046/0 (socket says 172.21.15.181:41046) 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 -- 172.21.15.181:0/27371935 learned_addr learned my addr 172.21.15.181:0/27371935 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a5627a640 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bb400 0x562c46b5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 -- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bb400 msgr2=0x562c46b5f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bb400 0x562c46b5f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 -- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 msgr2=0x562c46b5fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b5fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 -- 172.21.15.181:0/27371935 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c46b1b4a0 con 0x562c479bbc00 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a55a79640 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bbc00 0x562c46b60100 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x562c479e48d0 tx=0x562c479e6cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea408e973fa43f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a51a71640 1 -- 172.21.15.181:0/27371935 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562c46b08680 con 0x562c479bbc00 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a51a71640 1 -- 172.21.15.181:0/27371935 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562c46b0ea80 con 0x562c479bbc00 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a51a71640 1 -- 172.21.15.181:0/27371935 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562c46b08b60 con 0x562c479bbc00 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 -- 172.21.15.181:0/27371935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bbc00 msgr2=0x562c46b60100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bbc00 0x562c46b60100 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x562c479e48d0 tx=0x562c479e6cc0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 -- 172.21.15.181:0/27371935 shutdown_connections 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b5fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bbc00 0x562c46b60100 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/27371935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bb400 0x562c46b5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 -- 172.21.15.181:0/27371935 >> 172.21.15.181:0/27371935 conn(0x562c479bb000 msgr2=0x562c46bcf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 -- 172.21.15.181:0/27371935 shutdown_connections 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.048+0000 7f5a57ad3280 1 -- 172.21.15.181:0/27371935 wait complete. 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 Processor -- start 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 -- start start 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bb400 0x562c46b61180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b60c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bbc00 0x562c46b60680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562c479b0d80 con 0x562c479bb400 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562c479b0f00 con 0x562c479bb800 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.049+0000 7f5a57ad3280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562c479b1080 con 0x562c479bbc00 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bb400 0x562c46b61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bb400 0x562c46b61180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41052/0 (socket says 172.21.15.181:41052) 2024-09-12T02:35:33.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 -- 172.21.15.181:0/2119029275 learned_addr learned my addr 172.21.15.181:0/2119029275 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a5627a640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b60c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bbc00 0x562c46b60680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 -- 172.21.15.181:0/2119029275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bbc00 msgr2=0x562c46b60680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c479bbc00 0x562c46b60680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 -- 172.21.15.181:0/2119029275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 msgr2=0x562c46b60c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b60c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 -- 172.21.15.181:0/2119029275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c46b1a780 con 0x562c479bb400 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a5627a640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c479bb800 0x562c46b60c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a55a79640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bb400 0x562c46b61180 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x562c479e5590 tx=0x562c47886240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a5026e640 1 -- 172.21.15.181:0/2119029275 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562c46b084e0 con 0x562c479bb400 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a5026e640 1 -- 172.21.15.181:0/2119029275 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562c46b0ee00 con 0x562c479bb400 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c46b1a3c0 con 0x562c479bb400 2024-09-12T02:35:33.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a5026e640 1 -- 172.21.15.181:0/2119029275 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562c46b08680 con 0x562c479bb400 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c46b1a000 con 0x562c479bb400 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.050+0000 7f5a57ad3280 4 main: resolving pool 10 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.051+0000 7f5a5026e640 1 -- 172.21.15.181:0/2119029275 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562c478f4c00 con 0x562c479bb400 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a5026e640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562c478ecc00 0x562c46b61700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a5026e640 1 -- 172.21.15.181:0/2119029275 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x562c478f2a00 con 0x562c479bb400 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a57ad3280 4 main: creating IoCtx.. 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a5627a640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562c478ecc00 0x562c46b61700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562c478ed000 0x562c46b60100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x562c478ed400 con 0x562c478ed000 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a55a79640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562c478ed000 0x562c46b60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a5627a640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562c478ecc00 0x562c46b61700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x562c46b3eea0 tx=0x562c47884ae0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.052+0000 7f5a55a79640 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562c478ed000 0x562c46b60100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a55a79640 1 -- 172.21.15.181:0/2119029275 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x562c46bee000 con 0x562c478ed000 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 2, 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: "inotable": { 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: "projected_free": [ 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511628777, 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511626775 2024-09-12T02:35:33.061 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: "free": [ 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511628777, 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511626775 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.062 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562c478ed000 msgr2=0x562c46b60100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562c478ed000 0x562c46b60100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562c478ecc00 msgr2=0x562c46b61700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562c478ecc00 0x562c46b61700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x562c46b3eea0 tx=0x562c47884ae0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bb400 msgr2=0x562c46b61180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/2119029275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c479bb400 0x562c46b61180 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x562c479e5590 tx=0x562c47886240 comp rx=0 tx=0).stop 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a5627a640 1 -- 172.21.15.181:0/2119029275 reap_dead start 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 shutdown_connections 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 >> 172.21.15.181:0/2119029275 conn(0x562c479bb000 msgr2=0x562c46bcf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 shutdown_connections 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/2119029275 wait complete. 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/3589987489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c46ae3c00 msgr2=0x562c46b5f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c46ae3c00 0x562c46b5f080 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x562c479152f0 tx=0x562c47886180 comp rx=0 tx=0).stop 2024-09-12T02:35:33.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/3589987489 shutdown_connections 2024-09-12T02:35:33.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c46ae3c00 0x562c46b5f080 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562c46ae3800 0x562c46b5eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 --2- 172.21.15.181:0/3589987489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562c46ae2c00 0x562c46b5e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/3589987489 >> 172.21.15.181:0/3589987489 conn(0x562c46ae3000 msgr2=0x562c46bce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/3589987489 shutdown_connections 2024-09-12T02:35:33.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.053+0000 7f5a57ad3280 1 -- 172.21.15.181:0/3589987489 wait complete. 2024-09-12T02:35:33.066 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.063272, result: { "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-09-12T02:35:33.066 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-09-12T02:35:33.066 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-12T02:35:33.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.145+0000 7f269d729280 1 -- start start 2024-09-12T02:35:33.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.145+0000 7f269d729280 1 Processor -- start 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269d729280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1d9660c00 0x55b1d96dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269d729280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1d9661800 0x55b1d96dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269d729280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1d9661c00 0x55b1d96dd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269d729280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b1da520180 con 0x55b1d9660c00 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269d729280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b1da520300 con 0x55b1d9661c00 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269d729280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b1da520480 con 0x55b1d9661800 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1d9660c00 0x55b1d96dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1d9660c00 0x55b1d96dc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41066/0 (socket says 172.21.15.181:41066) 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 -- 172.21.15.181:0/4130511264 learned_addr learned my addr 172.21.15.181:0/4130511264 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269bc88640 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1d9661c00 0x55b1d96dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269ac86640 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1d9661800 0x55b1d96dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 -- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1d9661800 msgr2=0x55b1d96dcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1d9661800 0x55b1d96dcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 -- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1d9661c00 msgr2=0x55b1d96dd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1d9661c00 0x55b1d96dd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269b487640 1 -- 172.21.15.181:0/4130511264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d9698780 con 0x55b1d9660c00 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.146+0000 7f269bc88640 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1d9661c00 0x55b1d96dd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f269b487640 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1d9660c00 0x55b1d96dc580 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x55b1da48f350 tx=0x55b1da4042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43ff10bb2d7457e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f2698c82640 1 -- 172.21.15.181:0/4130511264 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b1d9686680 con 0x55b1d9660c00 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f2698c82640 1 -- 172.21.15.181:0/4130511264 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b1d968c700 con 0x55b1d9660c00 2024-09-12T02:35:33.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f2698c82640 1 -- 172.21.15.181:0/4130511264 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b1d9686b60 con 0x55b1d9660c00 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f269d729280 1 -- 172.21.15.181:0/4130511264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d96994a0 con 0x55b1d9660c00 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f269d729280 1 -- 172.21.15.181:0/4130511264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b1d9698000 con 0x55b1d9660c00 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f269d729280 4 waiting for MDS map... 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f2698c82640 1 -- 172.21.15.181:0/4130511264 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55b1da53e600 con 0x55b1d9660c00 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f2698c82640 1 -- 172.21.15.181:0/4130511264 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x55b1d96bb180 con 0x55b1d9660c00 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f269d729280 4 Got MDS map 63 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f269d729280 10 main: main 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.147+0000 7f269d729280 4 main: connecting to RADOS... 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 Processor -- start 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 -- start start 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543400 0x55b1d96dd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543c00 0x55b1d96de100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b1da520600 con 0x55b1da543800 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b1da520780 con 0x55b1da543400 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269d729280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b1da520900 con 0x55b1da543c00 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269b487640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269bc88640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543400 0x55b1d96dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269b487640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96ddb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41074/0 (socket says 172.21.15.181:41074) 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269b487640 1 -- 172.21.15.181:0/3643960592 learned_addr learned my addr 172.21.15.181:0/3643960592 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.148+0000 7f269ac86640 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543c00 0x55b1d96de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269b487640 1 -- 172.21.15.181:0/3643960592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543c00 msgr2=0x55b1d96de100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269b487640 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543c00 0x55b1d96de100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269b487640 1 -- 172.21.15.181:0/3643960592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543400 msgr2=0x55b1d96dd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269b487640 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543400 0x55b1d96dd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269b487640 1 -- 172.21.15.181:0/3643960592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d96983c0 con 0x55b1da543800 2024-09-12T02:35:33.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269b487640 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96ddb80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55b1da550690 tx=0x55b1d971d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe491608676a8eed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f2696c7e640 1 -- 172.21.15.181:0/3643960592 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b1d9686820 con 0x55b1da543800 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f2696c7e640 1 -- 172.21.15.181:0/3643960592 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b1d968cfc0 con 0x55b1da543800 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f2696c7e640 1 -- 172.21.15.181:0/3643960592 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b1d9686680 con 0x55b1da543800 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 -- 172.21.15.181:0/3643960592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 msgr2=0x55b1d96ddb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96ddb80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55b1da550690 tx=0x55b1d971d380 comp rx=0 tx=0).stop 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 -- 172.21.15.181:0/3643960592 shutdown_connections 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543c00 0x55b1d96de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96ddb80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 --2- 172.21.15.181:0/3643960592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543400 0x55b1d96dd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 -- 172.21.15.181:0/3643960592 >> 172.21.15.181:0/3643960592 conn(0x55b1da543000 msgr2=0x55b1d974d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 -- 172.21.15.181:0/3643960592 shutdown_connections 2024-09-12T02:35:33.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.149+0000 7f269d729280 1 -- 172.21.15.181:0/3643960592 wait complete. 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 Processor -- start 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 -- start start 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543400 0x55b1d96df180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543c00 0x55b1d96de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b1da521c80 con 0x55b1da543800 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b1da520a80 con 0x55b1da543c00 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.150+0000 7f269d729280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b1da521b00 con 0x55b1da543400 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96dec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41078/0 (socket says 172.21.15.181:41078) 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 -- 172.21.15.181:0/4069324246 learned_addr learned my addr 172.21.15.181:0/4069324246 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269ac86640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543c00 0x55b1d96de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269bc88640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543400 0x55b1d96df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 -- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543400 msgr2=0x55b1d96df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1da543400 0x55b1d96df180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 -- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543c00 msgr2=0x55b1d96de680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1da543c00 0x55b1d96de680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 -- 172.21.15.181:0/4069324246 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d9698780 con 0x55b1da543800 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269b487640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96dec00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x55b1da551350 tx=0x55b1da552c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269547b640 1 -- 172.21.15.181:0/4069324246 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b1d9686b60 con 0x55b1da543800 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269547b640 1 -- 172.21.15.181:0/4069324246 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b1d968ce00 con 0x55b1da543800 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1d96994a0 con 0x55b1da543800 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269547b640 1 -- 172.21.15.181:0/4069324246 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b1d96864e0 con 0x55b1da543800 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d9698960 con 0x55b1da543800 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.151+0000 7f269d729280 4 main: resolving pool 10 2024-09-12T02:35:33.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.152+0000 7f269547b640 1 -- 172.21.15.181:0/4069324246 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55b1da53cc00 con 0x55b1da543800 2024-09-12T02:35:33.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269547b640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b1da53b000 0x55b1d96df700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269547b640 1 -- 172.21.15.181:0/4069324246 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55b1da5b0600 con 0x55b1da543800 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269d729280 4 main: creating IoCtx.. 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269bc88640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b1da53b000 0x55b1d96df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269d729280 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55b1da53b400 0x55b1d96de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x55b1da53b800 con 0x55b1da53b400 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269ac86640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55b1da53b400 0x55b1d96de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269bc88640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b1da53b000 0x55b1d96df700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55b1da3ee780 tx=0x55b1da553380 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.153+0000 7f269ac86640 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55b1da53b400 0x55b1d96de100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269ac86640 1 -- 172.21.15.181:0/4069324246 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55b1da3ec000 con 0x55b1da53b400 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 1, 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "snapserver": { 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "last_snap": 1, 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "last_created": 1, 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "last_destroyed": 1, 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_noop": [], 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "snaps": [], 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "need_to_purge": {}, 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_update": [], 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_destroy": [] 2024-09-12T02:35:33.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.164 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.164 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.164 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55b1da53b400 msgr2=0x55b1d96de100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55b1da53b400 0x55b1d96de100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b1da53b000 msgr2=0x55b1d96df700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b1da53b000 0x55b1d96df700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55b1da3ee780 tx=0x55b1da553380 comp rx=0 tx=0).stop 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 msgr2=0x55b1d96dec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 --2- 172.21.15.181:0/4069324246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1da543800 0x55b1d96dec00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x55b1da551350 tx=0x55b1da552c00 comp rx=0 tx=0).stop 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269ac86640 1 -- 172.21.15.181:0/4069324246 reap_dead start 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 shutdown_connections 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 >> 172.21.15.181:0/4069324246 conn(0x55b1da543000 msgr2=0x55b1d974d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 shutdown_connections 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4069324246 wait complete. 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4130511264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1d9660c00 msgr2=0x55b1d96dc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1d9660c00 0x55b1d96dc580 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x55b1da48f350 tx=0x55b1da4042a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4130511264 shutdown_connections 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b1d9661c00 0x55b1d96dd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b1d9661800 0x55b1d96dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 --2- 172.21.15.181:0/4130511264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b1d9660c00 0x55b1d96dc580 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.154+0000 7f269d729280 1 -- 172.21.15.181:0/4130511264 >> 172.21.15.181:0/4130511264 conn(0x55b1d9661000 msgr2=0x55b1d974c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.155+0000 7f269d729280 1 -- 172.21.15.181:0/4130511264 shutdown_connections 2024-09-12T02:35:33.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.155+0000 7f269d729280 1 -- 172.21.15.181:0/4130511264 wait complete. 2024-09-12T02:35:33.168 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.101648, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-12T02:35:33.168 INFO:tasks.cephfs.test_journal_repair:{ "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-12T02:35:33.168 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-12T02:35:33.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.247+0000 7f9b261e8280 1 -- start start 2024-09-12T02:35:33.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.247+0000 7f9b261e8280 1 Processor -- start 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562621f0cc00 0x562621f88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562621f0d800 0x562621f88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562621f0dc00 0x562621f89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b261e8280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562622088780 con 0x562621f0dc00 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b261e8280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562622088600 con 0x562621f0d800 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b261e8280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562622088480 con 0x562621f0cc00 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562621f0dc00 0x562621f89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562621f0dc00 0x562621f89080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41100/0 (socket says 172.21.15.181:41100) 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 -- 172.21.15.181:0/3156778437 learned_addr learned my addr 172.21.15.181:0/3156778437 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b2418e640 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562621f0d800 0x562621f88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b2498f640 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562621f0cc00 0x562621f88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 -- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562621f0cc00 msgr2=0x562621f88580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562621f0cc00 0x562621f88580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 -- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562621f0d800 msgr2=0x562621f88b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562621f0d800 0x562621f88b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 -- 172.21.15.181:0/3156778437 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562621f44780 con 0x562621f0dc00 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.248+0000 7f9b25190640 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562621f0dc00 0x562621f89080 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x562622d2f290 tx=0x562622cae840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df2823240b9da78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b2218a640 1 -- 172.21.15.181:0/3156778437 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562621f329c0 con 0x562621f0dc00 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b2218a640 1 -- 172.21.15.181:0/3156778437 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562621f38fc0 con 0x562621f0dc00 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b2218a640 1 -- 172.21.15.181:0/3156778437 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562621f32680 con 0x562621f0dc00 2024-09-12T02:35:33.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 1 -- 172.21.15.181:0/3156778437 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562621f443c0 con 0x562621f0dc00 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 1 -- 172.21.15.181:0/3156778437 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562621f45680 con 0x562621f0dc00 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 4 waiting for MDS map... 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b2218a640 1 -- 172.21.15.181:0/3156778437 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x562622df0200 con 0x562621f0dc00 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b2218a640 1 -- 172.21.15.181:0/3156778437 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x562621f67180 con 0x562621f0dc00 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 4 Got MDS map 63 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 10 main: main 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 4 main: connecting to RADOS... 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 1 Processor -- start 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.249+0000 7f9b261e8280 1 -- start start 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 0x562621f89600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f89b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 0x562621f8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b261e8280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562622088300 con 0x562622e30400 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b261e8280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562622088000 con 0x562622e30000 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b261e8280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562621f6e900 con 0x562622e30800 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f89b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41110/0 (socket says 172.21.15.181:41110) 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 -- 172.21.15.181:0/3170776262 learned_addr learned my addr 172.21.15.181:0/3170776262 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2418e640 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 0x562621f89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2418e640 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 0x562621f8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 -- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 msgr2=0x562621f8a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 0x562621f8a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 -- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 msgr2=0x562621f89600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 0x562621f89600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.250+0000 7f9b2498f640 1 -- 172.21.15.181:0/3170776262 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562621f454a0 con 0x562622e30400 2024-09-12T02:35:33.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b2498f640 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f89b80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x562622d0e9c0 tx=0x562622df4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ae73b94ba5c559 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b20186640 1 -- 172.21.15.181:0/3170776262 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562621f329c0 con 0x562622e30400 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b20186640 1 -- 172.21.15.181:0/3170776262 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562621f38c40 con 0x562622e30400 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b20186640 1 -- 172.21.15.181:0/3170776262 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562621f32680 con 0x562622e30400 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 -- 172.21.15.181:0/3170776262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 msgr2=0x562621f89b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f89b80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x562622d0e9c0 tx=0x562622df4d20 comp rx=0 tx=0).stop 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 -- 172.21.15.181:0/3170776262 shutdown_connections 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 0x562621f8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f89b80 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3170776262 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 0x562621f89600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 -- 172.21.15.181:0/3170776262 >> 172.21.15.181:0/3170776262 conn(0x562622cf5c00 msgr2=0x562621ff9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 -- 172.21.15.181:0/3170776262 shutdown_connections 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.251+0000 7f9b261e8280 1 -- 172.21.15.181:0/3170776262 wait complete. 2024-09-12T02:35:33.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 Processor -- start 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 -- start start 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 0x562621f8b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f8ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 0x562621f8a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562622088000 con 0x562622e30400 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562622089500 con 0x562622e30000 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b261e8280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562622088300 con 0x562622e30800 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b2498f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f8ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b2498f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f8ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41118/0 (socket says 172.21.15.181:41118) 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b2498f640 1 -- 172.21.15.181:0/1171801183 learned_addr learned my addr 172.21.15.181:0/1171801183 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b2418e640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 0x562621f8b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.252+0000 7f9b2418e640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 0x562621f8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b2498f640 1 -- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 msgr2=0x562621f8a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b2498f640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562622e30800 0x562621f8a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b2498f640 1 -- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 msgr2=0x562621f8b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b2498f640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562622e30000 0x562621f8b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b2498f640 1 -- 172.21.15.181:0/1171801183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562621f44000 con 0x562622e30400 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b2498f640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f8ac00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x562622d0f680 tx=0x562622caea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b1e983640 1 -- 172.21.15.181:0/1171801183 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562621f324e0 con 0x562622e30400 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b1e983640 1 -- 172.21.15.181:0/1171801183 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562621f381c0 con 0x562622e30400 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562621f44960 con 0x562622e30400 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b1e983640 1 -- 172.21.15.181:0/1171801183 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562621f329c0 con 0x562622e30400 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562621f45860 con 0x562622e30400 2024-09-12T02:35:33.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.253+0000 7f9b261e8280 4 main: resolving pool 10 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.254+0000 7f9b1e983640 1 -- 172.21.15.181:0/1171801183 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562622e56c00 con 0x562622e30400 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.254+0000 7f9b1e983640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56262228e000 0x562621f8b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.254+0000 7f9b1e983640 1 -- 172.21.15.181:0/1171801183 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x562622e4ea00 con 0x562622e30400 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.254+0000 7f9b2418e640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56262228e000 0x562621f8b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b261e8280 4 main: creating IoCtx.. 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b261e8280 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x562622e30c00 0x562621f8a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x562622e31000 con 0x562622e30c00 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b2418e640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x562622e30c00 0x562621f8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b2418e640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56262228e000 0x562621f8b700 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x562622d0f500 tx=0x562622cb0240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b2418e640 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x562622e30c00 0x562621f8a100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b2418e640 1 -- 172.21.15.181:0/1171801183 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x562622c98000 con 0x562622e30c00 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.255+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x56262228f000 con 0x562622e30c00 2024-09-12T02:35:33.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b2418e640 1 -- 172.21.15.181:0/1171801183 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=473b] v0'0 uv3 ondisk = 0) ==== 159+0+473 (crc 0 0 0) 0x562622c98000 con 0x562622e30c00 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:3 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x56262228f400 con 0x562622e30c00 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b2418e640 1 -- 172.21.15.181:0/1171801183 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x562622c98000 con 0x562622e30c00 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions": [ 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6909, 2024-09-12T02:35:33.266 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": { 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 6909 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "any", 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3413866975 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "open", 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "num_leases": 0, 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "num_caps": 0, 2024-09-12T02:35:33.267 INFO:teuthology.orchestra.run.smithi181.stdout: "request_load_avg": 0, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 0, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "requests_in_flight": 0, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "num_completed_requests": 2, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "num_completed_flushes": 0, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "reconnecting": false, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "recall_caps": { 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 60 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "release_caps": { 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.268 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 60 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "recall_caps_throttle": { 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 1.5 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "recall_caps_throttle2o": { 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 0.5 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "session_cache_liveness": { 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 300 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.269 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition": { 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 30 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "last_trim_completed_requests_tid": 0, 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "delegated_inos": [], 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": "client.6909 192.168.0.1:0/3413866975", 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "completed_requests": [ 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2, 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: "created_ino": "0x0" 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 7, 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "created_ino": "0x10000000000" 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "prealloc_inos": [ 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "start": "0x10000000001", 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "length": 1000 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "client_metadata": { 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "client_features": { 2024-09-12T02:35:33.271 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_bits": "0x00000000003fffff" 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "metric_spec": { 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "metric_flags": { 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_bits": "0x000000000000ffff" 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "62178", 2024-09-12T02:35:33.272 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.273 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x562622e30c00 msgr2=0x562621f8a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x562622e30c00 0x562621f8a100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56262228e000 msgr2=0x562621f8b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x56262228e000 0x562621f8b700 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x562622d0f500 tx=0x562622cb0240 comp rx=0 tx=0).stop 2024-09-12T02:35:33.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 msgr2=0x562621f8ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 --2- 172.21.15.181:0/1171801183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562622e30400 0x562621f8ac00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x562622d0f680 tx=0x562622caea80 comp rx=0 tx=0).stop 2024-09-12T02:35:33.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b2498f640 1 -- 172.21.15.181:0/1171801183 reap_dead start 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 shutdown_connections 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 >> 172.21.15.181:0/1171801183 conn(0x562622cf5c00 msgr2=0x562621ff9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 shutdown_connections 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/1171801183 wait complete. 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/3156778437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562621f0dc00 msgr2=0x562621f89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562621f0dc00 0x562621f89080 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x562622d2f290 tx=0x562622cae840 comp rx=0 tx=0).stop 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/3156778437 shutdown_connections 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562621f0d800 0x562621f88b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562621f0dc00 0x562621f89080 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 --2- 172.21.15.181:0/3156778437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562621f0cc00 0x562621f88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/3156778437 >> 172.21.15.181:0/3156778437 conn(0x562621f0d000 msgr2=0x562621ff8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/3156778437 shutdown_connections 2024-09-12T02:35:33.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.256+0000 7f9b261e8280 1 -- 172.21.15.181:0/3156778437 wait complete. 2024-09-12T02:35:33.277 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.108376, result: { "0": { "data": { "sessions": [ { "id": 6909, "entity": { "name": { "type": "client", "num": 6909 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3413866975 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6909 192.168.0.1:0/3413866975", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 7, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "entity_id": "0", "hostname": "smithi181", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "62178", "root": "/" } } ] }, "result": 0 } } 2024-09-12T02:35:33.277 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "sessions": [ { "id": 6909, "entity": { "name": { "type": "client", "num": 6909 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3413866975 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6909 192.168.0.1:0/3413866975", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 7, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "entity_id": "0", "hostname": "smithi181", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "62178", "root": "/" } } ] }, "result": 0 } } 2024-09-12T02:35:33.277 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-12T02:35:33.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 -- start start 2024-09-12T02:35:33.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 Processor -- start 2024-09-12T02:35:33.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55902499ec00 0x559024a1a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55902499f800 0x559024a1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55902499fc00 0x559024a1b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559024b1a600 con 0x55902499ec00 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559024b1a480 con 0x55902499fc00 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2ef1669280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559024b1a300 con 0x55902499f800 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2eefe0e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55902499ec00 0x559024a1a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2eefe0e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55902499ec00 0x559024a1a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41136/0 (socket says 172.21.15.181:41136) 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.355+0000 7f2eefe0e640 1 -- 172.21.15.181:0/3052228506 learned_addr learned my addr 172.21.15.181:0/3052228506 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2ef060f640 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55902499fc00 0x559024a1b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eef60d640 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55902499f800 0x559024a1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eefe0e640 1 -- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55902499f800 msgr2=0x559024a1ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55902499f800 0x559024a1ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eefe0e640 1 -- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55902499fc00 msgr2=0x559024a1b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55902499fc00 0x559024a1b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eefe0e640 1 -- 172.21.15.181:0/3052228506 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590249d6780 con 0x55902499ec00 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eef60d640 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55902499f800 0x559024a1ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55902499ec00 0x559024a1a580 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x5590257bea80 tx=0x559025740840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294fdfbed095d63d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eed609640 1 -- 172.21.15.181:0/3052228506 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5590249c49c0 con 0x55902499ec00 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eed609640 1 -- 172.21.15.181:0/3052228506 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5590249cae00 con 0x55902499ec00 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eed609640 1 -- 172.21.15.181:0/3052228506 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5590249c4680 con 0x55902499ec00 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2ef1669280 1 -- 172.21.15.181:0/3052228506 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590249d63c0 con 0x55902499ec00 2024-09-12T02:35:33.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2ef1669280 1 -- 172.21.15.181:0/3052228506 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5590249d7680 con 0x55902499ec00 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2ef1669280 4 waiting for MDS map... 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eed609640 1 -- 172.21.15.181:0/3052228506 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x559025878200 con 0x55902499ec00 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2eed609640 1 -- 172.21.15.181:0/3052228506 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x5590249f9180 con 0x55902499ec00 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2ef1669280 4 Got MDS map 63 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.356+0000 7f2ef1669280 10 main: main 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.357+0000 7f2ef1669280 4 main: connecting to RADOS... 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.357+0000 7f2ef1669280 1 Processor -- start 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.357+0000 7f2ef1669280 1 -- start start 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.357+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc000 0x559024a1b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.357+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc400 0x559024a1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.357+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc800 0x559024a1c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2ef1669280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559024b1a180 con 0x5590258cc400 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2ef1669280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559024a00480 con 0x5590258cc800 2024-09-12T02:35:33.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2ef1669280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559024a00900 con 0x5590258cc000 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc400 0x559024a1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc400 0x559024a1bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41144/0 (socket says 172.21.15.181:41144) 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 -- 172.21.15.181:0/2909657969 learned_addr learned my addr 172.21.15.181:0/2909657969 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eef60d640 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc800 0x559024a1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2ef060f640 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc000 0x559024a1b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 -- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc000 msgr2=0x559024a1b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc000 0x559024a1b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 -- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc800 msgr2=0x559024a1c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc800 0x559024a1c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 -- 172.21.15.181:0/2909657969 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590249d74a0 con 0x5590258cc400 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc400 0x559024a1bb80 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x5590257bf890 tx=0x559024a5af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84788fe47c7dd8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eeb605640 1 -- 172.21.15.181:0/2909657969 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5590249c4b60 con 0x5590258cc400 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eeb605640 1 -- 172.21.15.181:0/2909657969 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5590249cac40 con 0x5590258cc400 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.358+0000 7f2eeb605640 1 -- 172.21.15.181:0/2909657969 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5590249c4820 con 0x5590258cc400 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 -- 172.21.15.181:0/2909657969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc400 msgr2=0x559024a1bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc400 0x559024a1bb80 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x5590257bf890 tx=0x559024a5af00 comp rx=0 tx=0).stop 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 -- 172.21.15.181:0/2909657969 shutdown_connections 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc800 0x559024a1c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc400 0x559024a1bb80 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 --2- 172.21.15.181:0/2909657969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc000 0x559024a1b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 -- 172.21.15.181:0/2909657969 >> 172.21.15.181:0/2909657969 conn(0x55902577fc00 msgr2=0x559024a88800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 -- 172.21.15.181:0/2909657969 shutdown_connections 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 -- 172.21.15.181:0/2909657969 wait complete. 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 Processor -- start 2024-09-12T02:35:33.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.359+0000 7f2ef1669280 1 -- start start 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc000 0x559024a1d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc400 0x559024a1cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef1669280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc800 0x559024a1c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef1669280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559024b1ac00 con 0x5590258cc000 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef1669280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559024b1aa80 con 0x5590258cc400 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef1669280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559024b1b380 con 0x5590258cc800 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc000 0x559024a1d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc000 0x559024a1d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41152/0 (socket says 172.21.15.181:41152) 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 -- 172.21.15.181:0/773376297 learned_addr learned my addr 172.21.15.181:0/773376297 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc400 0x559024a1cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2eef60d640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc800 0x559024a1c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 -- 172.21.15.181:0/773376297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc800 msgr2=0x559024a1c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5590258cc800 0x559024a1c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 -- 172.21.15.181:0/773376297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc400 msgr2=0x559024a1cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5590258cc400 0x559024a1cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 -- 172.21.15.181:0/773376297 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590249d6000 con 0x5590258cc000 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef060f640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc000 0x559024a1d180 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x559025797650 tx=0x559025880cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ee9e02640 1 -- 172.21.15.181:0/773376297 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5590249c4b60 con 0x5590258cc000 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ee9e02640 1 -- 172.21.15.181:0/773376297 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5590249ca8c0 con 0x5590258cc000 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ee9e02640 1 -- 172.21.15.181:0/773376297 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5590249c4820 con 0x5590258cc000 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.360+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590249d6960 con 0x5590258cc000 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.361+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590249d7860 con 0x5590258cc000 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.361+0000 7f2ef1669280 4 main: resolving pool 10 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2ee9e02640 1 -- 172.21.15.181:0/773376297 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5590258d4c00 con 0x5590258cc000 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2ee9e02640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5590258f0c00 0x559024a1d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2ee9e02640 1 -- 172.21.15.181:0/773376297 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x5590258d3000 con 0x5590258cc000 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2ef1669280 4 main: creating IoCtx.. 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5590258f0c00 0x559024a1d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2ef1669280 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5590258ccc00 0x559024a1c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x5590258cd000 con 0x5590258ccc00 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2eef60d640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5590258ccc00 0x559024a1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2eefe0e640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5590258f0c00 0x559024a1d700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x5590257bf890 tx=0x5590257407e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.362+0000 7f2eef60d640 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5590258ccc00 0x559024a1c100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2eef60d640 1 -- 172.21.15.181:0/773376297 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55902572a000 con 0x5590258ccc00 2024-09-12T02:35:33.373 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 2, 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "inotable": { 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "projected_free": [ 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511628777, 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511626775 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "free": [ 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511628777, 2024-09-12T02:35:33.374 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511626775 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.375 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5590258ccc00 msgr2=0x559024a1c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5590258ccc00 0x559024a1c100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5590258f0c00 msgr2=0x559024a1d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5590258f0c00 0x559024a1d700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x5590257bf890 tx=0x5590257407e0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc000 msgr2=0x559024a1d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 --2- 172.21.15.181:0/773376297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5590258cc000 0x559024a1d180 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x559025797650 tx=0x559025880cc0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2eef60d640 1 -- 172.21.15.181:0/773376297 reap_dead start 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 shutdown_connections 2024-09-12T02:35:33.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 >> 172.21.15.181:0/773376297 conn(0x55902577fc00 msgr2=0x559024a88800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 shutdown_connections 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/773376297 wait complete. 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/3052228506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55902499ec00 msgr2=0x559024a1a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55902499ec00 0x559024a1a580 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x5590257bea80 tx=0x559025740840 comp rx=0 tx=0).stop 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/3052228506 shutdown_connections 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55902499fc00 0x559024a1b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55902499f800 0x559024a1ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 --2- 172.21.15.181:0/3052228506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55902499ec00 0x559024a1a580 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/3052228506 >> 172.21.15.181:0/3052228506 conn(0x55902499f000 msgr2=0x559024a89000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/3052228506 shutdown_connections 2024-09-12T02:35:33.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.363+0000 7f2ef1669280 1 -- 172.21.15.181:0/3052228506 wait complete. 2024-09-12T02:35:33.378 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.101535, result: { "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-09-12T02:35:33.379 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-12T02:35:33.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.458+0000 7f6d9ed52280 1 -- start start 2024-09-12T02:35:33.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.458+0000 7f6d9ed52280 1 Processor -- start 2024-09-12T02:35:33.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4be298c00 0x55a4be314580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4be299800 0x55a4be314b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4be299c00 0x55a4be315080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a4be414600 con 0x55a4be299c00 2024-09-12T02:35:33.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a4be414480 con 0x55a4be299800 2024-09-12T02:35:33.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a4be414300 con 0x55a4be298c00 2024-09-12T02:35:33.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4be299c00 0x55a4be315080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4be299c00 0x55a4be315080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41160/0 (socket says 172.21.15.181:41160) 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 -- 172.21.15.181:0/825628163 learned_addr learned my addr 172.21.15.181:0/825628163 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4be299800 0x55a4be314b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9d4f7640 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4be298c00 0x55a4be314580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 -- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4be298c00 msgr2=0x55a4be314580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4be298c00 0x55a4be314580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 -- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4be299800 msgr2=0x55a4be314b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4be299800 0x55a4be314b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 -- 172.21.15.181:0/825628163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4be2d0780 con 0x55a4be299c00 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9dcf8640 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4be299c00 0x55a4be315080 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x55a4bf0bd320 tx=0x55a4bf03c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3d6ada4372857b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9acf2640 1 -- 172.21.15.181:0/825628163 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a4be2be680 con 0x55a4be299c00 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9acf2640 1 -- 172.21.15.181:0/825628163 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a4be2c4700 con 0x55a4be299c00 2024-09-12T02:35:33.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9acf2640 1 -- 172.21.15.181:0/825628163 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a4be2beb60 con 0x55a4be299c00 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.459+0000 7f6d9ed52280 1 -- 172.21.15.181:0/825628163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4be2d03c0 con 0x55a4be299c00 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9ed52280 1 -- 172.21.15.181:0/825628163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a4be2d1680 con 0x55a4be299c00 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9ed52280 4 waiting for MDS map... 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9acf2640 1 -- 172.21.15.181:0/825628163 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55a4bf178a00 con 0x55a4be299c00 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9acf2640 1 -- 172.21.15.181:0/825628163 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x55a4be2f3180 con 0x55a4be299c00 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9ed52280 4 Got MDS map 63 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9ed52280 10 main: main 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9ed52280 4 main: connecting to RADOS... 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9ed52280 1 Processor -- start 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.460+0000 7f6d9ed52280 1 -- start start 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be315600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 0x55a4be315b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 0x55a4be316100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a4be414180 con 0x55a4bf06f400 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a4be2fa480 con 0x55a4bf06fc00 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a4be2fa900 con 0x55a4bf06f800 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be315600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9d4f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 0x55a4be315b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be315600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41164/0 (socket says 172.21.15.181:41164) 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/2923376133 learned_addr learned my addr 172.21.15.181:0/2923376133 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 0x55a4be316100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/2923376133 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 msgr2=0x55a4be315b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 0x55a4be315b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/2923376133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 msgr2=0x55a4be316100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 0x55a4be316100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.461+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/2923376133 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4be2d14a0 con 0x55a4bf06f400 2024-09-12T02:35:33.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be315600 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x55a4bf17a7e0 tx=0x55a4bf03a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abee3f0e1d252198 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d98cee640 1 -- 172.21.15.181:0/2923376133 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a4be2be9c0 con 0x55a4bf06f400 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d98cee640 1 -- 172.21.15.181:0/2923376133 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a4be2c4e00 con 0x55a4bf06f400 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d98cee640 1 -- 172.21.15.181:0/2923376133 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a4be2be680 con 0x55a4bf06f400 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 -- 172.21.15.181:0/2923376133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 msgr2=0x55a4be315600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be315600 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x55a4bf17a7e0 tx=0x55a4bf03a540 comp rx=0 tx=0).stop 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 -- 172.21.15.181:0/2923376133 shutdown_connections 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 0x55a4be316100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 0x55a4be315b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/2923376133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be315600 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 -- 172.21.15.181:0/2923376133 >> 172.21.15.181:0/2923376133 conn(0x55a4bf06f000 msgr2=0x55a4be38e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 -- 172.21.15.181:0/2923376133 shutdown_connections 2024-09-12T02:35:33.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.462+0000 7f6d9ed52280 1 -- 172.21.15.181:0/2923376133 wait complete. 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 Processor -- start 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 -- start start 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be317180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 0x55a4be316c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 0x55a4be316680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a4be415980 con 0x55a4bf06f400 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a4be414180 con 0x55a4bf06fc00 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ed52280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a4be415800 con 0x55a4bf06f800 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ccf6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be317180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ccf6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be317180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41178/0 (socket says 172.21.15.181:41178) 2024-09-12T02:35:33.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/1524891140 learned_addr learned my addr 172.21.15.181:0/1524891140 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.463+0000 7f6d9d4f7640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 0x55a4be316c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 0x55a4be316680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 msgr2=0x55a4be316c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4bf06f800 0x55a4be316c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 msgr2=0x55a4be316680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4bf06fc00 0x55a4be316680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/1524891140 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4be2d0780 con 0x55a4bf06f400 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be317180 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x55a4bf17ab10 tx=0x55a4bf03a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d974eb640 1 -- 172.21.15.181:0/1524891140 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a4be2beb60 con 0x55a4bf06f400 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d974eb640 1 -- 172.21.15.181:0/1524891140 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a4be2c4c40 con 0x55a4bf06f400 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4be2d03c0 con 0x55a4bf06f400 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d974eb640 1 -- 172.21.15.181:0/1524891140 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a4be2be4e0 con 0x55a4bf06f400 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4be2d0000 con 0x55a4bf06f400 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.464+0000 7f6d9ed52280 4 main: resolving pool 10 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.465+0000 7f6d974eb640 1 -- 172.21.15.181:0/1524891140 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a4bf1dec00 con 0x55a4bf06f400 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.465+0000 7f6d974eb640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a4be62a000 0x55a4be317700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.465+0000 7f6d974eb640 1 -- 172.21.15.181:0/1524891140 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55a4bf1f4600 con 0x55a4bf06f400 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9ed52280 4 main: creating IoCtx.. 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9d4f7640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a4be62a000 0x55a4be317700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a4be62a400 0x55a4be316100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x55a4be62a800 con 0x55a4be62a400 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a4be62a400 0x55a4be316100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9d4f7640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a4be62a000 0x55a4be317700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55a4bf024870 tx=0x55a4bf17d1a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9ccf6640 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a4be62a400 0x55a4be316100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.466+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/1524891140 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55a4bf02a000 con 0x55a4be62a400 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x55a4be62ac00 con 0x55a4be62a400 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/1524891140 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=473b] v0'0 uv3 ondisk = 0) ==== 159+0+473 (crc 0 0 0) 0x55a4bf02a000 con 0x55a4be62a400 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:3 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x55a4be62b000 con 0x55a4be62a400 2024-09-12T02:35:33.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ccf6640 1 -- 172.21.15.181:0/1524891140 <== osd.6 v2:172.21.15.204:6800/2226411884 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55a4bf02a000 con 0x55a4be62a400 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions": [ 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 6909, 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": { 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:35:33.477 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 6909 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "any", 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 3413866975 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "open", 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "num_leases": 0, 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "num_caps": 0, 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "request_load_avg": 0, 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 0, 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "requests_in_flight": 0, 2024-09-12T02:35:33.478 INFO:teuthology.orchestra.run.smithi181.stdout: "num_completed_requests": 2, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "num_completed_flushes": 0, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "reconnecting": false, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "recall_caps": { 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 60 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "release_caps": { 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 60 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "recall_caps_throttle": { 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 1.5 2024-09-12T02:35:33.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "recall_caps_throttle2o": { 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 0.5 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "session_cache_liveness": { 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 300 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition": { 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "value": 0, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "halflife": 30 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "last_trim_completed_requests_tid": 0, 2024-09-12T02:35:33.480 INFO:teuthology.orchestra.run.smithi181.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "delegated_inos": [], 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": "client.6909 192.168.0.1:0/3413866975", 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "completed_requests": [ 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2, 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "created_ino": "0x0" 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 7, 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "created_ino": "0x10000000000" 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: "prealloc_inos": [ 2024-09-12T02:35:33.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "start": "0x10000000001", 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "length": 1000 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "client_metadata": { 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "client_features": { 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_bits": "0x00000000003fffff" 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "metric_spec": { 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "metric_flags": { 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_bits": "0x000000000000ffff" 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "62178", 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.483 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.484 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a4be62a400 msgr2=0x55a4be316100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a4be62a400 0x55a4be316100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a4be62a000 msgr2=0x55a4be317700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a4be62a000 0x55a4be317700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55a4bf024870 tx=0x55a4bf17d1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 msgr2=0x55a4be317180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/1524891140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4bf06f400 0x55a4be317180 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x55a4bf17ab10 tx=0x55a4bf03a5a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9d4f7640 1 -- 172.21.15.181:0/1524891140 reap_dead start 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 shutdown_connections 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 >> 172.21.15.181:0/1524891140 conn(0x55a4bf06f000 msgr2=0x55a4be38e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 shutdown_connections 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.467+0000 7f6d9ed52280 1 -- 172.21.15.181:0/1524891140 wait complete. 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 -- 172.21.15.181:0/825628163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4be299c00 msgr2=0x55a4be315080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4be299c00 0x55a4be315080 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x55a4bf0bd320 tx=0x55a4bf03c2a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 -- 172.21.15.181:0/825628163 shutdown_connections 2024-09-12T02:35:33.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a4be299800 0x55a4be314b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4be299c00 0x55a4be315080 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 --2- 172.21.15.181:0/825628163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a4be298c00 0x55a4be314580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 -- 172.21.15.181:0/825628163 >> 172.21.15.181:0/825628163 conn(0x55a4be299000 msgr2=0x55a4be38f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 -- 172.21.15.181:0/825628163 shutdown_connections 2024-09-12T02:35:33.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.468+0000 7f6d9ed52280 1 -- 172.21.15.181:0/825628163 wait complete. 2024-09-12T02:35:33.488 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.108853, result: { "0": { "data": { "sessions": [ { "id": 6909, "entity": { "name": { "type": "client", "num": 6909 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3413866975 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6909 192.168.0.1:0/3413866975", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 7, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "entity_id": "0", "hostname": "smithi181", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "62178", "root": "/" } } ] }, "result": 0 } } 2024-09-12T02:35:33.488 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-12T02:35:33.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.566+0000 7fbf67e62280 1 -- start start 2024-09-12T02:35:33.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.566+0000 7fbf67e62280 1 Processor -- start 2024-09-12T02:35:33.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a774218c00 0x55a774294580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a774219800 0x55a774294b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a774219c00 0x55a774295080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf67e62280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7750ce180 con 0x55a774218c00 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf67e62280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a7750ce300 con 0x55a774219c00 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf67e62280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a7750ce480 con 0x55a774219800 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a774218c00 0x55a774294580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a774218c00 0x55a774294580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41204/0 (socket says 172.21.15.181:41204) 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 -- 172.21.15.181:0/378467807 learned_addr learned my addr 172.21.15.181:0/378467807 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf65e06640 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a774219800 0x55a774294b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66e08640 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a774219c00 0x55a774295080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 -- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a774219800 msgr2=0x55a774294b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a774219800 0x55a774294b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 -- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a774219c00 msgr2=0x55a774295080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a774219c00 0x55a774295080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66607640 1 -- 172.21.15.181:0/378467807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a774250780 con 0x55a774218c00 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf66e08640 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a774219c00 0x55a774295080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.567+0000 7fbf65e06640 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a774219800 0x55a774294b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf66607640 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a774218c00 0x55a774294580 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x55a775039320 tx=0x55a774fbc180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c3ebac983e1a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf63e02640 1 -- 172.21.15.181:0/378467807 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a77423e680 con 0x55a774218c00 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf63e02640 1 -- 172.21.15.181:0/378467807 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a774244a80 con 0x55a774218c00 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf63e02640 1 -- 172.21.15.181:0/378467807 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a77423eb60 con 0x55a774218c00 2024-09-12T02:35:33.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf67e62280 1 -- 172.21.15.181:0/378467807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7742503c0 con 0x55a774218c00 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf67e62280 1 -- 172.21.15.181:0/378467807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a774251680 con 0x55a774218c00 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf67e62280 4 waiting for MDS map... 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf63e02640 1 -- 172.21.15.181:0/378467807 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55a7750e8600 con 0x55a774218c00 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf63e02640 1 -- 172.21.15.181:0/378467807 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x55a774273180 con 0x55a774218c00 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf67e62280 4 Got MDS map 63 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf67e62280 10 main: main 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.568+0000 7fbf67e62280 4 main: connecting to RADOS... 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 Processor -- start 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 -- start start 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750ed400 0x55a774295600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774295b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750edc00 0x55a774296100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7750ce600 con 0x55a7750ed800 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a7750ce780 con 0x55a7750edc00 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf67e62280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a7750ce900 con 0x55a7750ed400 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf66607640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774295b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf66607640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774295b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41220/0 (socket says 172.21.15.181:41220) 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.569+0000 7fbf66607640 1 -- 172.21.15.181:0/3586744686 learned_addr learned my addr 172.21.15.181:0/3586744686 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf65e06640 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750edc00 0x55a774296100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66e08640 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750ed400 0x55a774295600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66607640 1 -- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750ed400 msgr2=0x55a774295600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66607640 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750ed400 0x55a774295600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66607640 1 -- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750edc00 msgr2=0x55a774296100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66607640 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750edc00 0x55a774296100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66607640 1 -- 172.21.15.181:0/3586744686 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7742514a0 con 0x55a7750ed800 2024-09-12T02:35:33.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66e08640 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750ed400 0x55a774295600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf66607640 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774295b80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x55a775102660 tx=0x55a7742d5440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc30f87bf56e09c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf61dfe640 1 -- 172.21.15.181:0/3586744686 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a77423e820 con 0x55a7750ed800 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf61dfe640 1 -- 172.21.15.181:0/3586744686 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a774244fc0 con 0x55a7750ed800 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf61dfe640 1 -- 172.21.15.181:0/3586744686 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a77423e680 con 0x55a7750ed800 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 -- 172.21.15.181:0/3586744686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 msgr2=0x55a774295b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774295b80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x55a775102660 tx=0x55a7742d5440 comp rx=0 tx=0).stop 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 -- 172.21.15.181:0/3586744686 shutdown_connections 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750edc00 0x55a774296100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774295b80 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 --2- 172.21.15.181:0/3586744686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750ed400 0x55a774295600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 -- 172.21.15.181:0/3586744686 >> 172.21.15.181:0/3586744686 conn(0x55a7750ed000 msgr2=0x55a774305000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 -- 172.21.15.181:0/3586744686 shutdown_connections 2024-09-12T02:35:33.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.570+0000 7fbf67e62280 1 -- 172.21.15.181:0/3586744686 wait complete. 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.571+0000 7fbf67e62280 1 Processor -- start 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.571+0000 7fbf67e62280 1 -- start start 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750ed400 0x55a774297180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774296c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750edc00 0x55a774296680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7750cfc80 con 0x55a7750ed800 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a7750cea80 con 0x55a7750ed400 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a7750cfb00 con 0x55a7750edc00 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774296c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774296c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41230/0 (socket says 172.21.15.181:41230) 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 -- 172.21.15.181:0/2161803358 learned_addr learned my addr 172.21.15.181:0/2161803358 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66e08640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750ed400 0x55a774297180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf65e06640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750edc00 0x55a774296680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 -- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750edc00 msgr2=0x55a774296680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750edc00 0x55a774296680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 -- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750ed400 msgr2=0x55a774297180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a7750ed400 0x55a774297180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 -- 172.21.15.181:0/2161803358 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a774250780 con 0x55a7750ed800 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf65e06640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a7750edc00 0x55a774296680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf66607640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774296c00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x55a775103320 tx=0x55a775106c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf605fb640 1 -- 172.21.15.181:0/2161803358 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a77423eb60 con 0x55a7750ed800 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf605fb640 1 -- 172.21.15.181:0/2161803358 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a774244e00 con 0x55a7750ed800 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7742503c0 con 0x55a7750ed800 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf605fb640 1 -- 172.21.15.181:0/2161803358 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a77423e4e0 con 0x55a7750ed800 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a774251680 con 0x55a7750ed800 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.572+0000 7fbf67e62280 4 main: resolving pool 10 2024-09-12T02:35:33.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.573+0000 7fbf605fb640 1 -- 172.21.15.181:0/2161803358 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a7750dcc00 con 0x55a7750ed800 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf605fb640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a77500b000 0x55a774297700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf605fb640 1 -- 172.21.15.181:0/2161803358 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55a775166600 con 0x55a7750ed800 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf67e62280 4 main: creating IoCtx.. 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf66e08640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a77500b000 0x55a774297700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf67e62280 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a77500b400 0x55a774296100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x55a77500b800 con 0x55a77500b400 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf65e06640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a77500b400 0x55a774296100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf66e08640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a77500b000 0x55a774297700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55a774fa66f0 tx=0x55a775107380 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.574+0000 7fbf65e06640 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a77500b400 0x55a774296100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf65e06640 1 -- 172.21.15.181:0/2161803358 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55a774fa4000 con 0x55a77500b400 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 1, 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "snapserver": { 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "last_snap": 1, 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "last_created": 1, 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "last_destroyed": 1, 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_noop": [], 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "snaps": [], 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "need_to_purge": {}, 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_update": [], 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_destroy": [] 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:33.585 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.586 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.586 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a77500b400 msgr2=0x55a774296100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a77500b400 0x55a774296100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a77500b000 msgr2=0x55a774297700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a77500b000 0x55a774297700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55a774fa66f0 tx=0x55a775107380 comp rx=0 tx=0).stop 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 msgr2=0x55a774296c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 --2- 172.21.15.181:0/2161803358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7750ed800 0x55a774296c00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x55a775103320 tx=0x55a775106c00 comp rx=0 tx=0).stop 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf65e06640 1 -- 172.21.15.181:0/2161803358 reap_dead start 2024-09-12T02:35:33.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 shutdown_connections 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 >> 172.21.15.181:0/2161803358 conn(0x55a7750ed000 msgr2=0x55a774305000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 shutdown_connections 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/2161803358 wait complete. 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/378467807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a774218c00 msgr2=0x55a774294580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a774218c00 0x55a774294580 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x55a775039320 tx=0x55a774fbc180 comp rx=0 tx=0).stop 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/378467807 shutdown_connections 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a774219c00 0x55a774295080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a774219800 0x55a774294b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 --2- 172.21.15.181:0/378467807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a774218c00 0x55a774294580 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/378467807 >> 172.21.15.181:0/378467807 conn(0x55a774219000 msgr2=0x55a774304800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/378467807 shutdown_connections 2024-09-12T02:35:33.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.575+0000 7fbf67e62280 1 -- 172.21.15.181:0/378467807 wait complete. 2024-09-12T02:35:33.590 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.101759, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-12T02:35:33.590 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset session 2024-09-12T02:35:33.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.668+0000 7f5c8ad74280 1 -- start start 2024-09-12T02:35:33.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.668+0000 7f5c8ad74280 1 Processor -- start 2024-09-12T02:35:33.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20bf8800 0x558f1fe77b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20bf9c00 0x558f1fe77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20bf9400 0x558f1fe76b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558f20bfe480 con 0x558f20bf9c00 2024-09-12T02:35:33.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558f20bfe600 con 0x558f20bf8800 2024-09-12T02:35:33.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558f20bfe780 con 0x558f20bf9400 2024-09-12T02:35:33.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20bf9c00 0x558f1fe77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20bf9c00 0x558f1fe77080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41240/0 (socket says 172.21.15.181:41240) 2024-09-12T02:35:33.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 -- 172.21.15.181:0/4086451673 learned_addr learned my addr 172.21.15.181:0/4086451673 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c89519640 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20bf8800 0x558f1fe77b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c89d1a640 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20bf9400 0x558f1fe76b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 -- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20bf9400 msgr2=0x558f1fe76b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20bf9400 0x558f1fe76b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 -- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20bf8800 msgr2=0x558f1fe77b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20bf8800 0x558f1fe77b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 -- 172.21.15.181:0/4086451673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f1fe32780 con 0x558f20bf9c00 2024-09-12T02:35:33.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c88d18640 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20bf9c00 0x558f1fe77080 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x558f20c3d110 tx=0x558f20b9e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbb98d0d76fef39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c86d14640 1 -- 172.21.15.181:0/4086451673 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558f1fe20d00 con 0x558f20bf9c00 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c86d14640 1 -- 172.21.15.181:0/4086451673 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558f1fe26700 con 0x558f20bf9c00 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c86d14640 1 -- 172.21.15.181:0/4086451673 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558f1fe20680 con 0x558f20bf9c00 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 -- 172.21.15.181:0/4086451673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f1fe32000 con 0x558f20bf9c00 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 1 -- 172.21.15.181:0/4086451673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x558f1fe33680 con 0x558f20bf9c00 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.669+0000 7f5c8ad74280 4 waiting for MDS map... 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.670+0000 7f5c86d14640 1 -- 172.21.15.181:0/4086451673 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x558f20cde600 con 0x558f20bf9c00 2024-09-12T02:35:33.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.670+0000 7f5c86d14640 1 -- 172.21.15.181:0/4086451673 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x558f1fe55180 con 0x558f20bf9c00 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.670+0000 7f5c8ad74280 4 Got MDS map 63 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.670+0000 7f5c8ad74280 10 main: main 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.670+0000 7f5c8ad74280 4 main: connecting to RADOS... 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.670+0000 7f5c8ad74280 1 Processor -- start 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.670+0000 7f5c8ad74280 1 -- start start 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558f1fe5c180 con 0x558f20ce1800 2024-09-12T02:35:33.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558f20bff680 con 0x558f20ce1000 2024-09-12T02:35:33.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558f20bff500 con 0x558f20ce1400 2024-09-12T02:35:33.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41250/0 (socket says 172.21.15.181:41250) 2024-09-12T02:35:33.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 -- 172.21.15.181:0/2076090538 learned_addr learned my addr 172.21.15.181:0/2076090538 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c89519640 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c89d1a640 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 -- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 msgr2=0x558f1fe78680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 -- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1000 msgr2=0x558f1fe78100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 -- 172.21.15.181:0/2076090538 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f1fe33c20 con 0x558f20ce1800 2024-09-12T02:35:33.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c89d1a640 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c88d18640 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x558f20cf8600 tx=0x558f20b9c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53dfae7bb52583a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.671+0000 7f5c84d10640 1 -- 172.21.15.181:0/2076090538 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558f1fe20d00 con 0x558f20ce1800 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c84d10640 1 -- 172.21.15.181:0/2076090538 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558f1fe26fc0 con 0x558f20ce1800 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c84d10640 1 -- 172.21.15.181:0/2076090538 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558f1fe20680 con 0x558f20ce1800 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 -- 172.21.15.181:0/2076090538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1800 msgr2=0x558f1fe78c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x558f20cf8600 tx=0x558f20b9c6c0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 -- 172.21.15.181:0/2076090538 shutdown_connections 2024-09-12T02:35:33.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/2076090538 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 -- 172.21.15.181:0/2076090538 >> 172.21.15.181:0/2076090538 conn(0x558f20bf9800 msgr2=0x558f1fee7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 -- 172.21.15.181:0/2076090538 shutdown_connections 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 -- 172.21.15.181:0/2076090538 wait complete. 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.672+0000 7f5c8ad74280 1 Processor -- start 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c8ad74280 1 -- start start 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c8ad74280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558f20bfe900 con 0x558f20ce1000 2024-09-12T02:35:33.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x558f20bfea80 con 0x558f20ce1800 2024-09-12T02:35:33.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c8ad74280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x558f20bfe180 con 0x558f20ce1400 2024-09-12T02:35:33.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41264/0 (socket says 172.21.15.181:41264) 2024-09-12T02:35:33.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 -- 172.21.15.181:0/1892076511 learned_addr learned my addr 172.21.15.181:0/1892076511 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c88d18640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89519640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 -- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 msgr2=0x558f1fe78680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 -- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1800 msgr2=0x558f1fe78c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.673+0000 7f5c89d1a640 1 -- 172.21.15.181:0/1892076511 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f1fe334a0 con 0x558f20ce1000 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.674+0000 7f5c89d1a640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1000 0x558f1fe78100 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x558f1fe57f20 tx=0x558f20b9cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.674+0000 7f5c8350d640 1 -- 172.21.15.181:0/1892076511 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558f1fe20b60 con 0x558f20ce1000 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.674+0000 7f5c8350d640 1 -- 172.21.15.181:0/1892076511 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558f1fe26e00 con 0x558f20ce1000 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.674+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f1fe32960 con 0x558f20ce1000 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.674+0000 7f5c8350d640 1 -- 172.21.15.181:0/1892076511 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558f1fe20d00 con 0x558f20ce1000 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.674+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f1fe32780 con 0x558f20ce1000 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.674+0000 7f5c8ad74280 4 main: resolving pool 10 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.675+0000 7f5c8350d640 1 -- 172.21.15.181:0/1892076511 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x558f20d4ec00 con 0x558f20ce1000 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.675+0000 7f5c8350d640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558f20d47000 0x558f1fe79700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.675+0000 7f5c8350d640 1 -- 172.21.15.181:0/1892076511 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x558f20d54800 con 0x558f20ce1000 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.675+0000 7f5c89519640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558f20d47000 0x558f1fe79700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.675+0000 7f5c8ad74280 4 main: creating IoCtx.. 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.675+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x558f20ce1c00 0x558f1fe79180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.675+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75) -- 0x558f20d47400 con 0x558f20ce1c00 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.676+0000 7f5c88d18640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x558f20ce1c00 0x558f1fe79180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.676+0000 7f5c89519640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558f20d47000 0x558f1fe79700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x558f1ff087e0 tx=0x558f20cfb3e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.676+0000 7f5c88d18640 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x558f20ce1c00 0x558f1fe79180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c88d18640 1 -- 172.21.15.181:0/1892076511 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v75'4 uv4 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x558f1ff06000 con 0x558f20ce1c00 2024-09-12T02:35:33.691 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.691 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:33.691 INFO:teuthology.orchestra.run.smithi181.stdout: "data": {}, 2024-09-12T02:35:33.691 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.691 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.691 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x558f20ce1c00 msgr2=0x558f1fe79180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x558f20ce1c00 0x558f1fe79180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558f20d47000 msgr2=0x558f1fe79700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558f20d47000 0x558f1fe79700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x558f1ff087e0 tx=0x558f20cfb3e0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1000 msgr2=0x558f1fe78100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1000 0x558f1fe78100 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x558f1fe57f20 tx=0x558f20b9cba0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 shutdown_connections 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c89519640 1 -- 172.21.15.181:0/1892076511 reap_dead start 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x558f20ce1c00 0x558f1fe79180 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x558f20d47000 0x558f1fe79700 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20ce1800 0x558f1fe78c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20ce1400 0x558f1fe78680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/1892076511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20ce1000 0x558f1fe78100 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 >> 172.21.15.181:0/1892076511 conn(0x558f20bf9800 msgr2=0x558f1fee7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 shutdown_connections 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.677+0000 7f5c8ad74280 1 -- 172.21.15.181:0/1892076511 wait complete. 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 -- 172.21.15.181:0/4086451673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20bf9c00 msgr2=0x558f1fe77080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20bf9c00 0x558f1fe77080 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x558f20c3d110 tx=0x558f20b9e0c0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 -- 172.21.15.181:0/4086451673 shutdown_connections 2024-09-12T02:35:33.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x558f20bf9400 0x558f1fe76b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558f20bf9c00 0x558f1fe77080 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 --2- 172.21.15.181:0/4086451673 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x558f20bf8800 0x558f1fe77b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 -- 172.21.15.181:0/4086451673 >> 172.21.15.181:0/4086451673 conn(0x558f1fdfb000 msgr2=0x558f1fee7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 -- 172.21.15.181:0/4086451673 shutdown_connections 2024-09-12T02:35:33.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.678+0000 7f5c8ad74280 1 -- 172.21.15.181:0/4086451673 wait complete. 2024-09-12T02:35:33.695 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'session'] in time 0:00:00.105351, result: { "0": { "data": {}, "result": 0 } } 2024-09-12T02:35:33.695 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset inode 2024-09-12T02:35:33.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.773+0000 7f044c72f280 1 -- start start 2024-09-12T02:35:33.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.773+0000 7f044c72f280 1 Processor -- start 2024-09-12T02:35:33.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4d0d4c00 0x562a4d150580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4d0d5800 0x562a4d150b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4d0d5c00 0x562a4d151080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a4dec0600 con 0x562a4d0d5c00 2024-09-12T02:35:33.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562a4dec0480 con 0x562a4d0d5800 2024-09-12T02:35:33.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562a4dec0300 con 0x562a4d0d4c00 2024-09-12T02:35:33.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4d0d5c00 0x562a4d151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4d0d5c00 0x562a4d151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41270/0 (socket says 172.21.15.181:41270) 2024-09-12T02:35:33.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 -- 172.21.15.181:0/3595934473 learned_addr learned my addr 172.21.15.181:0/3595934473 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f0449dba640 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4d0d5800 0x562a4d150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044a5bb640 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4d0d4c00 0x562a4d150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 -- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4d0d4c00 msgr2=0x562a4d150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4d0d4c00 0x562a4d150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 -- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4d0d5800 msgr2=0x562a4d150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4d0d5800 0x562a4d150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 -- 172.21.15.181:0/3595934473 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4d10c780 con 0x562a4d0d5c00 2024-09-12T02:35:33.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044adbc640 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4d0d5c00 0x562a4d151080 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x562a4df07320 tx=0x562a4de782a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a388d1a4496d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f0447db6640 1 -- 172.21.15.181:0/3595934473 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562a4d0fa680 con 0x562a4d0d5c00 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f0447db6640 1 -- 172.21.15.181:0/3595934473 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562a4d100e00 con 0x562a4d0d5c00 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f0447db6640 1 -- 172.21.15.181:0/3595934473 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562a4d0fa9c0 con 0x562a4d0d5c00 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 -- 172.21.15.181:0/3595934473 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4d10c3c0 con 0x562a4d0d5c00 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 1 -- 172.21.15.181:0/3595934473 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562a4d10d860 con 0x562a4d0d5c00 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.774+0000 7f044c72f280 4 waiting for MDS map... 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.775+0000 7f0447db6640 1 -- 172.21.15.181:0/3595934473 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x562a4dfb2400 con 0x562a4d0d5c00 2024-09-12T02:35:33.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.775+0000 7f0447db6640 1 -- 172.21.15.181:0/3595934473 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x562a4d12f180 con 0x562a4d0d5c00 2024-09-12T02:35:33.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.775+0000 7f044c72f280 4 Got MDS map 63 2024-09-12T02:35:33.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.775+0000 7f044c72f280 10 main: main 2024-09-12T02:35:33.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.775+0000 7f044c72f280 4 main: connecting to RADOS... 2024-09-12T02:35:33.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.775+0000 7f044c72f280 1 Processor -- start 2024-09-12T02:35:33.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.775+0000 7f044c72f280 1 -- start start 2024-09-12T02:35:33.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f044c72f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debd400 0x562a4d151600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f044c72f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd800 0x562a4d151b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f044c72f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debdc00 0x562a4d152100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f044c72f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a4dec0180 con 0x562a4debd400 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f044c72f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562a4d136480 con 0x562a4debd800 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f044c72f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562a4d136900 con 0x562a4debdc00 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debd400 0x562a4d151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debd400 0x562a4d151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41276/0 (socket says 172.21.15.181:41276) 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 -- 172.21.15.181:0/1137651118 learned_addr learned my addr 172.21.15.181:0/1137651118 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f044a5bb640 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd800 0x562a4d151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debdc00 0x562a4d152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 -- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debdc00 msgr2=0x562a4d152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debdc00 0x562a4d152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 -- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd800 msgr2=0x562a4d151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd800 0x562a4d151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 -- 172.21.15.181:0/1137651118 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4d10d680 con 0x562a4debd400 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0449dba640 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debd400 0x562a4d151600 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x562a4dfc8840 tx=0x562a4de76b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902e503860727945 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0445db2640 1 -- 172.21.15.181:0/1137651118 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562a4d0fa680 con 0x562a4debd400 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0445db2640 1 -- 172.21.15.181:0/1137651118 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562a4d100c40 con 0x562a4debd400 2024-09-12T02:35:33.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.776+0000 7f0445db2640 1 -- 172.21.15.181:0/1137651118 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562a4d0fa9c0 con 0x562a4debd400 2024-09-12T02:35:33.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 -- 172.21.15.181:0/1137651118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debd400 msgr2=0x562a4d151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debd400 0x562a4d151600 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x562a4dfc8840 tx=0x562a4de76b40 comp rx=0 tx=0).stop 2024-09-12T02:35:33.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 -- 172.21.15.181:0/1137651118 shutdown_connections 2024-09-12T02:35:33.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd800 0x562a4d151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debdc00 0x562a4d152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 --2- 172.21.15.181:0/1137651118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debd400 0x562a4d151600 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 -- 172.21.15.181:0/1137651118 >> 172.21.15.181:0/1137651118 conn(0x562a4debd000 msgr2=0x562a4d1be800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 -- 172.21.15.181:0/1137651118 shutdown_connections 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 -- 172.21.15.181:0/1137651118 wait complete. 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 Processor -- start 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.777+0000 7f044c72f280 1 -- start start 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f044c72f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd400 0x562a4d153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f044c72f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debd800 0x562a4d152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f044c72f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debdc00 0x562a4d152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f044c72f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a4dec1980 con 0x562a4debdc00 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f044c72f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562a4dec0180 con 0x562a4debd400 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f044c72f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562a4dec1800 con 0x562a4debd800 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debdc00 0x562a4d152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debdc00 0x562a4d152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41290/0 (socket says 172.21.15.181:41290) 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 -- 172.21.15.181:0/3901944332 learned_addr learned my addr 172.21.15.181:0/3901944332 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd400 0x562a4d153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f044a5bb640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debd800 0x562a4d152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 -- 172.21.15.181:0/3901944332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debd800 msgr2=0x562a4d152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4debd800 0x562a4d152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 -- 172.21.15.181:0/3901944332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd400 msgr2=0x562a4d153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4debd400 0x562a4d153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 -- 172.21.15.181:0/3901944332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4d10c000 con 0x562a4debdc00 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.778+0000 7f0449dba640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debdc00 0x562a4d152680 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x562a4dfc8b70 tx=0x562a4de765a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.779+0000 7f04445af640 1 -- 172.21.15.181:0/3901944332 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562a4d0fa680 con 0x562a4debdc00 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.779+0000 7f04445af640 1 -- 172.21.15.181:0/3901944332 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562a4d1001c0 con 0x562a4debdc00 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.779+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a4d10c780 con 0x562a4debdc00 2024-09-12T02:35:33.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.779+0000 7f04445af640 1 -- 172.21.15.181:0/3901944332 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562a4d0fa9c0 con 0x562a4debdc00 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.779+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4d10c3c0 con 0x562a4debdc00 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.779+0000 7f044c72f280 4 main: resolving pool 10 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f04445af640 1 -- 172.21.15.181:0/3901944332 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562a4e018c00 con 0x562a4debdc00 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f04445af640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562a4d464000 0x562a4d153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f04445af640 1 -- 172.21.15.181:0/3901944332 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x562a4e030600 con 0x562a4debdc00 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f044c72f280 4 main: creating IoCtx.. 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f044a5bb640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562a4d464000 0x562a4d153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f044c72f280 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562a4d464400 0x562a4d152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75) -- 0x562a4d464800 con 0x562a4d464400 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.780+0000 7f0449dba640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562a4d464400 0x562a4d152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.781+0000 7f044a5bb640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562a4d464000 0x562a4d153700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x562a4de62840 tx=0x562a4dfcd1a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.781+0000 7f0449dba640 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562a4d464400 0x562a4d152100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f0449dba640 1 -- 172.21.15.181:0/3901944332 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v75'4 uv4 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x562a4de60000 con 0x562a4d464400 2024-09-12T02:35:33.796 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.796 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:33.796 INFO:teuthology.orchestra.run.smithi181.stdout: "data": {}, 2024-09-12T02:35:33.796 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:33.796 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.797 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562a4d464400 msgr2=0x562a4d152100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x562a4d464400 0x562a4d152100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562a4d464000 msgr2=0x562a4d153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x562a4d464000 0x562a4d153700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x562a4de62840 tx=0x562a4dfcd1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debdc00 msgr2=0x562a4d152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 --2- 172.21.15.181:0/3901944332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4debdc00 0x562a4d152680 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x562a4dfc8b70 tx=0x562a4de765a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044a5bb640 1 -- 172.21.15.181:0/3901944332 reap_dead start 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 shutdown_connections 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 >> 172.21.15.181:0/3901944332 conn(0x562a4debd000 msgr2=0x562a4d1be800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 shutdown_connections 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3901944332 wait complete. 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3595934473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4d0d5c00 msgr2=0x562a4d151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4d0d5c00 0x562a4d151080 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x562a4df07320 tx=0x562a4de782a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 -- 172.21.15.181:0/3595934473 shutdown_connections 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562a4d0d5800 0x562a4d150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a4d0d5c00 0x562a4d151080 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.782+0000 7f044c72f280 1 --2- 172.21.15.181:0/3595934473 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562a4d0d4c00 0x562a4d150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.783+0000 7f044c72f280 1 -- 172.21.15.181:0/3595934473 >> 172.21.15.181:0/3595934473 conn(0x562a4d0d5000 msgr2=0x562a4d1bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.783+0000 7f044c72f280 1 -- 172.21.15.181:0/3595934473 shutdown_connections 2024-09-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.783+0000 7f044c72f280 1 -- 172.21.15.181:0/3595934473 wait complete. 2024-09-12T02:35:33.801 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'inode'] in time 0:00:00.105331, result: { "0": { "data": {}, "result": 0 } } 2024-09-12T02:35:33.801 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset snap 2024-09-12T02:35:33.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.879+0000 7f42ccf99280 1 -- start start 2024-09-12T02:35:33.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.879+0000 7f42ccf99280 1 Processor -- start 2024-09-12T02:35:33.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed5c16c00 0x559ed5c93b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed5c17800 0x559ed5c93600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed5c17c00 0x559ed5c93080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42ccf99280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559ed5d92180 con 0x559ed5c17c00 2024-09-12T02:35:33.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42ccf99280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559ed5c78900 con 0x559ed5c17800 2024-09-12T02:35:33.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42ccf99280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559ed5c78480 con 0x559ed5c16c00 2024-09-12T02:35:33.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed5c17c00 0x559ed5c93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed5c17c00 0x559ed5c93080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41302/0 (socket says 172.21.15.181:41302) 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 -- 172.21.15.181:0/3866723869 learned_addr learned my addr 172.21.15.181:0/3866723869 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42caf3d640 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed5c17800 0x559ed5c93600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cb73e640 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed5c16c00 0x559ed5c93b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 -- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed5c16c00 msgr2=0x559ed5c93b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed5c16c00 0x559ed5c93b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 -- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed5c17800 msgr2=0x559ed5c93600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed5c17800 0x559ed5c93600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 -- 172.21.15.181:0/3866723869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed5c4e780 con 0x559ed5c17c00 2024-09-12T02:35:33.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42cbf3f640 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed5c17c00 0x559ed5c93080 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x559ed6a352f0 tx=0x559ed69ba2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1e8936810e6200 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42c8f39640 1 -- 172.21.15.181:0/3866723869 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ed5c3c680 con 0x559ed5c17c00 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42c8f39640 1 -- 172.21.15.181:0/3866723869 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ed5c42700 con 0x559ed5c17c00 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42c8f39640 1 -- 172.21.15.181:0/3866723869 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ed5c3cb60 con 0x559ed5c17c00 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.880+0000 7f42ccf99280 1 -- 172.21.15.181:0/3866723869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed5c4f4a0 con 0x559ed5c17c00 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42ccf99280 1 -- 172.21.15.181:0/3866723869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559ed5c4e000 con 0x559ed5c17c00 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42ccf99280 4 waiting for MDS map... 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42c8f39640 1 -- 172.21.15.181:0/3866723869 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x559ed6af2600 con 0x559ed5c17c00 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42c8f39640 1 -- 172.21.15.181:0/3866723869 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x559ed5c71180 con 0x559ed5c17c00 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42ccf99280 4 Got MDS map 63 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42ccf99280 10 main: main 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42ccf99280 4 main: connecting to RADOS... 2024-09-12T02:35:33.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42ccf99280 1 Processor -- start 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.881+0000 7f42ccf99280 1 -- start start 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9c00 0x559ed5c94100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42ccf99280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559ed5c78180 con 0x559ed69e9400 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42ccf99280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559ed5d93500 con 0x559ed69e9800 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42ccf99280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559ed5d93380 con 0x559ed69e9c00 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41316/0 (socket says 172.21.15.181:41316) 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 -- 172.21.15.181:0/3833870994 learned_addr learned my addr 172.21.15.181:0/3833870994 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42cb73e640 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9c00 0x559ed5c94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 -- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9c00 msgr2=0x559ed5c94100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9c00 0x559ed5c94100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 -- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9800 msgr2=0x559ed5c92580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 -- 172.21.15.181:0/3833870994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed5c4e3c0 con 0x559ed69e9400 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42cb73e640 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42caf3d640 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x559ed6b0c6c0 tx=0x559ed69b8600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fe6962697a4673 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.882+0000 7f42c6f35640 1 -- 172.21.15.181:0/3833870994 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ed5c3c9c0 con 0x559ed69e9400 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42c6f35640 1 -- 172.21.15.181:0/3833870994 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ed5c42fc0 con 0x559ed69e9400 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42c6f35640 1 -- 172.21.15.181:0/3833870994 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ed5c3c680 con 0x559ed69e9400 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 -- 172.21.15.181:0/3833870994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9400 msgr2=0x559ed5c92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x559ed6b0c6c0 tx=0x559ed69b8600 comp rx=0 tx=0).stop 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 -- 172.21.15.181:0/3833870994 shutdown_connections 2024-09-12T02:35:33.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9c00 0x559ed5c94100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3833870994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 -- 172.21.15.181:0/3833870994 >> 172.21.15.181:0/3833870994 conn(0x559ed69e9000 msgr2=0x559ed5d0f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 -- 172.21.15.181:0/3833870994 shutdown_connections 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 -- 172.21.15.181:0/3833870994 wait complete. 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.883+0000 7f42ccf99280 1 Processor -- start 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42ccf99280 1 -- start start 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42ccf99280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9c00 0x559ed5c94100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42ccf99280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559ed5d92780 con 0x559ed69e9c00 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42ccf99280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559ed5d92900 con 0x559ed69e9400 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42ccf99280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559ed5d92600 con 0x559ed69e9800 2024-09-12T02:35:33.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9c00 0x559ed5c94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9c00 0x559ed5c94100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41330/0 (socket says 172.21.15.181:41330) 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 -- 172.21.15.181:0/1306310954 learned_addr learned my addr 172.21.15.181:0/1306310954 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42cb73e640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 -- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9800 msgr2=0x559ed5c92580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed69e9800 0x559ed5c92580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 -- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9400 msgr2=0x559ed5c92b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.884+0000 7f42caf3d640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed69e9400 0x559ed5c92b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42caf3d640 1 -- 172.21.15.181:0/1306310954 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed5c4e780 con 0x559ed69e9c00 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42caf3d640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9c00 0x559ed5c94100 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x559ed6b0d380 tx=0x559ed5cd2d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42c5732640 1 -- 172.21.15.181:0/1306310954 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ed5c3cb60 con 0x559ed69e9c00 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42c5732640 1 -- 172.21.15.181:0/1306310954 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ed5c42e00 con 0x559ed69e9c00 2024-09-12T02:35:33.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42c5732640 1 -- 172.21.15.181:0/1306310954 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ed5c3c4e0 con 0x559ed69e9c00 2024-09-12T02:35:33.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ed5c4f4a0 con 0x559ed69e9c00 2024-09-12T02:35:33.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed5c4e960 con 0x559ed69e9c00 2024-09-12T02:35:33.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.885+0000 7f42ccf99280 4 main: resolving pool 10 2024-09-12T02:35:33.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.886+0000 7f42c5732640 1 -- 172.21.15.181:0/1306310954 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x559ed6b50c00 con 0x559ed69e9c00 2024-09-12T02:35:33.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.886+0000 7f42c5732640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ed5f90000 0x559ed5f96000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.886+0000 7f42c5732640 1 -- 172.21.15.181:0/1306310954 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x559ed6a14600 con 0x559ed69e9c00 2024-09-12T02:35:33.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.886+0000 7f42ccf99280 4 main: creating IoCtx.. 2024-09-12T02:35:33.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.886+0000 7f42cb73e640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ed5f90000 0x559ed5f96000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.886+0000 7f42ccf99280 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ed5f90400 0x559ed5c94680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.886+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75) -- 0x559ed5f90800 con 0x559ed5f90400 2024-09-12T02:35:33.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.887+0000 7f42caf3d640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ed5f90400 0x559ed5c94680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.887+0000 7f42cb73e640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ed5f90000 0x559ed5f96000 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x559ed69a27e0 tx=0x559ed6ae71a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.887+0000 7f42caf3d640 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ed5f90400 0x559ed5c94680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42caf3d640 1 -- 172.21.15.181:0/1306310954 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v75'2 uv2 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x559ed69a8000 con 0x559ed5f90400 2024-09-12T02:35:33.897 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:33.897 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:33.897 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:33.898 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:33.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ed5f90400 msgr2=0x559ed5c94680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x559ed5f90400 0x559ed5c94680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ed5f90000 msgr2=0x559ed5f96000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559ed5f90000 0x559ed5f96000 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x559ed69a27e0 tx=0x559ed6ae71a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9c00 msgr2=0x559ed5c94100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 --2- 172.21.15.181:0/1306310954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed69e9c00 0x559ed5c94100 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x559ed6b0d380 tx=0x559ed5cd2d20 comp rx=0 tx=0).stop 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42cb73e640 1 -- 172.21.15.181:0/1306310954 reap_dead start 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 shutdown_connections 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 >> 172.21.15.181:0/1306310954 conn(0x559ed69e9000 msgr2=0x559ed5d0f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 shutdown_connections 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.888+0000 7f42ccf99280 1 -- 172.21.15.181:0/1306310954 wait complete. 2024-09-12T02:35:33.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 -- 172.21.15.181:0/3866723869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed5c17c00 msgr2=0x559ed5c93080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed5c17c00 0x559ed5c93080 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x559ed6a352f0 tx=0x559ed69ba2a0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 -- 172.21.15.181:0/3866723869 shutdown_connections 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559ed5c17800 0x559ed5c93600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ed5c17c00 0x559ed5c93080 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 --2- 172.21.15.181:0/3866723869 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559ed5c16c00 0x559ed5c93b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 -- 172.21.15.181:0/3866723869 >> 172.21.15.181:0/3866723869 conn(0x559ed5c17000 msgr2=0x559ed5d0e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 -- 172.21.15.181:0/3866723869 shutdown_connections 2024-09-12T02:35:33.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.889+0000 7f42ccf99280 1 -- 172.21.15.181:0/3866723869 wait complete. 2024-09-12T02:35:33.903 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'snap'] in time 0:00:00.101751, result: { "result": 0 } 2024-09-12T02:35:33.903 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-12T02:35:33.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.983+0000 7f996db21280 1 -- start start 2024-09-12T02:35:33.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.983+0000 7f996db21280 1 Processor -- start 2024-09-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996db21280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c82fac00 0x5560c8376580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996db21280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c82fb800 0x5560c8376b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996db21280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c82fbc00 0x5560c8377080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996db21280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5560c91c4180 con 0x5560c82fbc00 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996db21280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5560c91c4300 con 0x5560c82fb800 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996db21280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5560c91c4480 con 0x5560c82fac00 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c82fbc00 0x5560c8377080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c82fbc00 0x5560c8377080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41354/0 (socket says 172.21.15.181:41354) 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 -- 172.21.15.181:0/3357269789 learned_addr learned my addr 172.21.15.181:0/3357269789 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996b85f640 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c82fac00 0x5560c8376580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996b05e640 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c82fb800 0x5560c8376b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 -- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c82fac00 msgr2=0x5560c8376580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c82fac00 0x5560c8376580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 -- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c82fb800 msgr2=0x5560c8376b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c82fb800 0x5560c8376b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 -- 172.21.15.181:0/3357269789 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c8332780 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.984+0000 7f996c060640 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c82fbc00 0x5560c8377080 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x5560c9133350 tx=0x5560c909e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4175731a05dadd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996905a640 1 -- 172.21.15.181:0/3357269789 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560c8320680 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996905a640 1 -- 172.21.15.181:0/3357269789 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5560c8326a80 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996905a640 1 -- 172.21.15.181:0/3357269789 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560c8320b60 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996db21280 1 -- 172.21.15.181:0/3357269789 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c83334a0 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996db21280 1 -- 172.21.15.181:0/3357269789 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5560c8332000 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996db21280 4 waiting for MDS map... 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996905a640 1 -- 172.21.15.181:0/3357269789 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x5560c91e6a00 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996905a640 1 -- 172.21.15.181:0/3357269789 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x5560c8355180 con 0x5560c82fbc00 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996db21280 4 Got MDS map 63 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996db21280 10 main: main 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996db21280 4 main: connecting to RADOS... 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.985+0000 7f996db21280 1 Processor -- start 2024-09-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996db21280 1 -- start start 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996db21280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cf400 0x5560c8377600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996db21280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8377b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996db21280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cfc00 0x5560c8378100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996db21280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5560c91c4600 con 0x5560c91cf800 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996db21280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5560c91c4780 con 0x5560c91cf400 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996db21280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5560c91c4900 con 0x5560c91cfc00 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8377b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8377b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41356/0 (socket says 172.21.15.181:41356) 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 -- 172.21.15.181:0/74134819 learned_addr learned my addr 172.21.15.181:0/74134819 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b05e640 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cf400 0x5560c8377600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b05e640 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cfc00 0x5560c8378100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 -- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cfc00 msgr2=0x5560c8378100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cfc00 0x5560c8378100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 -- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cf400 msgr2=0x5560c8377600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cf400 0x5560c8377600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.986+0000 7f996b85f640 1 -- 172.21.15.181:0/74134819 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c83323c0 con 0x5560c91cf800 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996b85f640 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8377b80 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x5560c91f0660 tx=0x5560c91f2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbdbd6804c9122c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f9967056640 1 -- 172.21.15.181:0/74134819 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560c8320680 con 0x5560c91cf800 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f9967056640 1 -- 172.21.15.181:0/74134819 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5560c8326fc0 con 0x5560c91cf800 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f9967056640 1 -- 172.21.15.181:0/74134819 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560c8320b60 con 0x5560c91cf800 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 -- 172.21.15.181:0/74134819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 msgr2=0x5560c8377b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8377b80 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x5560c91f0660 tx=0x5560c91f2c00 comp rx=0 tx=0).stop 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 -- 172.21.15.181:0/74134819 shutdown_connections 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cfc00 0x5560c8378100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8377b80 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 --2- 172.21.15.181:0/74134819 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cf400 0x5560c8377600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 -- 172.21.15.181:0/74134819 >> 172.21.15.181:0/74134819 conn(0x5560c91cf000 msgr2=0x5560c83f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 -- 172.21.15.181:0/74134819 shutdown_connections 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.987+0000 7f996db21280 1 -- 172.21.15.181:0/74134819 wait complete. 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 Processor -- start 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 -- start start 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cf400 0x5560c8379180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8378c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cfc00 0x5560c8378680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5560c91c5c80 con 0x5560c91cf800 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5560c91c4c00 con 0x5560c91cfc00 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996db21280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5560c91c4d80 con 0x5560c91cf400 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996b85f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8378c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996b85f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8378c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41366/0 (socket says 172.21.15.181:41366) 2024-09-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996b85f640 1 -- 172.21.15.181:0/549626694 learned_addr learned my addr 172.21.15.181:0/549626694 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996b05e640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cf400 0x5560c8379180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.988+0000 7f996b05e640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cfc00 0x5560c8378680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996b85f640 1 -- 172.21.15.181:0/549626694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cf400 msgr2=0x5560c8379180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996b85f640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c91cf400 0x5560c8379180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996b85f640 1 -- 172.21.15.181:0/549626694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cfc00 msgr2=0x5560c8378680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996b85f640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cfc00 0x5560c8378680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996b85f640 1 -- 172.21.15.181:0/549626694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c8332780 con 0x5560c91cf800 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996b05e640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c91cfc00 0x5560c8378680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996b85f640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8378c00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x5560c91f1320 tx=0x5560c909c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f9965853640 1 -- 172.21.15.181:0/549626694 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560c83204e0 con 0x5560c91cf800 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f9965853640 1 -- 172.21.15.181:0/549626694 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5560c8326e00 con 0x5560c91cf800 2024-09-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f9965853640 1 -- 172.21.15.181:0/549626694 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560c8320680 con 0x5560c91cf800 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560c83334a0 con 0x5560c91cf800 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c8332960 con 0x5560c91cf800 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.989+0000 7f996db21280 4 main: resolving pool 10 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.990+0000 7f9965853640 1 -- 172.21.15.181:0/549626694 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5560c91e2c00 con 0x5560c91cf800 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f9965853640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5560c9244c00 0x5560c8379700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f9965853640 1 -- 172.21.15.181:0/549626694 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x5560c9246a00 con 0x5560c91cf800 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f996db21280 4 main: creating IoCtx.. 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f996b05e640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5560c9244c00 0x5560c8379700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f996db21280 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5560c9245000 0x5560c8378100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x5560c9245400 con 0x5560c9245000 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f996b05e640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5560c9245000 0x5560c8378100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f996b05e640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5560c9244c00 0x5560c8379700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x5560c91329f0 tx=0x5560c909c600 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.991+0000 7f996b05e640 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5560c9245000 0x5560c8378100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996b05e640 1 -- 172.21.15.181:0/549626694 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x5560c908c000 con 0x5560c9245000 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 1, 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: "inotable": { 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: "projected_free": [ 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627776, 2024-09-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627776 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: "free": [ 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627776, 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627776 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:34.002 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5560c9245000 msgr2=0x5560c8378100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5560c9245000 0x5560c8378100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5560c9244c00 msgr2=0x5560c8379700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5560c9244c00 0x5560c8379700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x5560c91329f0 tx=0x5560c909c600 comp rx=0 tx=0).stop 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 msgr2=0x5560c8378c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 --2- 172.21.15.181:0/549626694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c91cf800 0x5560c8378c00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x5560c91f1320 tx=0x5560c909c960 comp rx=0 tx=0).stop 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996b85f640 1 -- 172.21.15.181:0/549626694 reap_dead start 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 shutdown_connections 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 >> 172.21.15.181:0/549626694 conn(0x5560c91cf000 msgr2=0x5560c83f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 shutdown_connections 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/549626694 wait complete. 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/3357269789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c82fbc00 msgr2=0x5560c8377080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c82fbc00 0x5560c8377080 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x5560c9133350 tx=0x5560c909e2a0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/3357269789 shutdown_connections 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x5560c82fb800 0x5560c8376b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5560c82fbc00 0x5560c8377080 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 --2- 172.21.15.181:0/3357269789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x5560c82fac00 0x5560c8376580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/3357269789 >> 172.21.15.181:0/3357269789 conn(0x5560c82fb000 msgr2=0x5560c83f2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/3357269789 shutdown_connections 2024-09-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:33.992+0000 7f996db21280 1 -- 172.21.15.181:0/3357269789 wait complete. 2024-09-12T02:35:34.005 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.102246, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-12T02:35:34.005 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-12T02:35:34.005 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-12T02:35:34.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.083+0000 7f2857069280 1 -- start start 2024-09-12T02:35:34.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.083+0000 7f2857069280 1 Processor -- start 2024-09-12T02:35:34.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2857069280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565153db6c00 0x565153e32580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2857069280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565153db7800 0x565153e32b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2857069280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565153db7c00 0x565153e33080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2857069280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565154ba2600 con 0x565153db7c00 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2857069280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x565154ba2480 con 0x565153db6c00 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2857069280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x565154ba2300 con 0x565153db7800 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2855810640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565153db6c00 0x565153e32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f285500f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565153db7800 0x565153e32b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2855810640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565153db6c00 0x565153e32580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:49878/0 (socket says 172.21.15.181:49878) 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2855810640 1 -- 172.21.15.181:0/1526516182 learned_addr learned my addr 172.21.15.181:0/1526516182 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2856011640 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565153db7c00 0x565153e33080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2856011640 1 -- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565153db7800 msgr2=0x565153e32b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2856011640 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565153db7800 0x565153e32b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2856011640 1 -- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565153db6c00 msgr2=0x565153e32580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2856011640 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565153db6c00 0x565153e32580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2856011640 1 -- 172.21.15.181:0/1526516182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565153dee780 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f285500f640 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565153db7800 0x565153e32b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2855810640 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565153db6c00 0x565153e32580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.084+0000 7f2856011640 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565153db7c00 0x565153e33080 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x565154be09f0 tx=0x565154b5a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6247ef4b386463 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f285300b640 1 -- 172.21.15.181:0/1526516182 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565153ddc9c0 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f285300b640 1 -- 172.21.15.181:0/1526516182 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x565153de2c40 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f285300b640 1 -- 172.21.15.181:0/1526516182 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565153ddc680 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f2857069280 1 -- 172.21.15.181:0/1526516182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565153dee3c0 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f2857069280 1 -- 172.21.15.181:0/1526516182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x565153def680 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f2857069280 4 waiting for MDS map... 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f285300b640 1 -- 172.21.15.181:0/1526516182 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x565154ca0200 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f285300b640 1 -- 172.21.15.181:0/1526516182 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x565153e11180 con 0x565153db7c00 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f2857069280 4 Got MDS map 63 2024-09-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f2857069280 10 main: main 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.085+0000 7f2857069280 4 main: connecting to RADOS... 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 Processor -- start 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 -- start start 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e33600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e33b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565154ba2180 con 0x565154ca4c00 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x565153e18480 con 0x565154ca5000 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2857069280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x565153e18900 con 0x565154ca4800 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e33b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e33b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41400/0 (socket says 172.21.15.181:41400) 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 -- 172.21.15.181:0/2326965274 learned_addr learned my addr 172.21.15.181:0/2326965274 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f285500f640 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e33600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f285500f640 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 -- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 msgr2=0x565153e33600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e33600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 -- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 msgr2=0x565153e34100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.086+0000 7f2855810640 1 -- 172.21.15.181:0/2326965274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565153def4a0 con 0x565154ca4c00 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f285500f640 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e33600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2855810640 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e33b80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x565154bb8b10 tx=0x565154ca6d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbe4a67ed181fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2851007640 1 -- 172.21.15.181:0/2326965274 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565153ddc9c0 con 0x565154ca4c00 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2851007640 1 -- 172.21.15.181:0/2326965274 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x565153de2700 con 0x565154ca4c00 2024-09-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2851007640 1 -- 172.21.15.181:0/2326965274 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565153ddc680 con 0x565154ca4c00 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 -- 172.21.15.181:0/2326965274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 msgr2=0x565153e33b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e33b80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x565154bb8b10 tx=0x565154ca6d20 comp rx=0 tx=0).stop 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 -- 172.21.15.181:0/2326965274 shutdown_connections 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e33b80 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 --2- 172.21.15.181:0/2326965274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e33600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 -- 172.21.15.181:0/2326965274 >> 172.21.15.181:0/2326965274 conn(0x565154ca4400 msgr2=0x565153ea0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 -- 172.21.15.181:0/2326965274 shutdown_connections 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.087+0000 7f2857069280 1 -- 172.21.15.181:0/2326965274 wait complete. 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 Processor -- start 2024-09-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 -- start start 2024-09-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e35180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e34c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565154ba3380 con 0x565154ca4c00 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x565154ba2180 con 0x565154ca5000 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2857069280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x565154ba2c00 con 0x565154ca4800 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2855810640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e34c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2855810640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e34c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41408/0 (socket says 172.21.15.181:41408) 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f2855810640 1 -- 172.21.15.181:0/2114690919 learned_addr learned my addr 172.21.15.181:0/2114690919 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.088+0000 7f285500f640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e35180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f285500f640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2855810640 1 -- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 msgr2=0x565153e35180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2855810640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565154ca4800 0x565153e35180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2855810640 1 -- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 msgr2=0x565153e34680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2855810640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2855810640 1 -- 172.21.15.181:0/2114690919 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565153dee000 con 0x565154ca4c00 2024-09-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f285500f640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565154ca5000 0x565153e34680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2855810640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e34c00 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x565154bb97d0 tx=0x565154b58660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f284f804640 1 -- 172.21.15.181:0/2114690919 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565153ddc4e0 con 0x565154ca4c00 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f284f804640 1 -- 172.21.15.181:0/2114690919 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x565153de28c0 con 0x565154ca4c00 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f284f804640 1 -- 172.21.15.181:0/2114690919 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x565153ddc9c0 con 0x565154ca4c00 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565153dee960 con 0x565154ca4c00 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565153def860 con 0x565154ca4c00 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.089+0000 7f2857069280 4 main: resolving pool 10 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.090+0000 7f284f804640 1 -- 172.21.15.181:0/2114690919 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x565154cf0c00 con 0x565154ca4c00 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.090+0000 7f284f804640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x565154136000 0x565153e35700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.090+0000 7f284f804640 1 -- 172.21.15.181:0/2114690919 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x565154ceea00 con 0x565154ca4c00 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.091+0000 7f2857069280 4 main: creating IoCtx.. 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.091+0000 7f285500f640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x565154136000 0x565153e35700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.091+0000 7f2857069280 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x565154136400 0x565153e34100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.091+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x565154136800 con 0x565154136400 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.091+0000 7f285500f640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x565154136400 0x565153e34100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.091+0000 7f285500f640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x565154136000 0x565153e35700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x565154bb96e0 tx=0x565154ca6d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.091+0000 7f285500f640 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x565154136400 0x565153e34100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f285500f640 1 -- 172.21.15.181:0/2114690919 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv2 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x565153ec2000 con 0x565154136400 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 1, 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stdout: "snapserver": { 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stdout: "last_snap": 1, 2024-09-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi181.stdout: "last_created": 1, 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: "last_destroyed": 1, 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_noop": [], 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: "snaps": [], 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: "need_to_purge": {}, 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_update": [], 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_destroy": [] 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x565154136400 msgr2=0x565153e34100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x565154136400 0x565153e34100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x565154136000 msgr2=0x565153e35700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x565154136000 0x565153e35700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x565154bb96e0 tx=0x565154ca6d80 comp rx=0 tx=0).stop 2024-09-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 msgr2=0x565153e34c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 --2- 172.21.15.181:0/2114690919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565154ca4c00 0x565153e34c00 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x565154bb97d0 tx=0x565154b58660 comp rx=0 tx=0).stop 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2855810640 1 -- 172.21.15.181:0/2114690919 reap_dead start 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 shutdown_connections 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 >> 172.21.15.181:0/2114690919 conn(0x565154ca4400 msgr2=0x565153ea0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 shutdown_connections 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/2114690919 wait complete. 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/1526516182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565153db7c00 msgr2=0x565153e33080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565153db7c00 0x565153e33080 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x565154be09f0 tx=0x565154b5a180 comp rx=0 tx=0).stop 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/1526516182 shutdown_connections 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565153db7c00 0x565153e33080 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x565153db7800 0x565153e32b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 --2- 172.21.15.181:0/1526516182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x565153db6c00 0x565153e32580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/1526516182 >> 172.21.15.181:0/1526516182 conn(0x565153db7000 msgr2=0x565153ea1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/1526516182 shutdown_connections 2024-09-12T02:35:34.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.092+0000 7f2857069280 1 -- 172.21.15.181:0/1526516182 wait complete. 2024-09-12T02:35:34.104 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.098565, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-12T02:35:34.104 INFO:tasks.cephfs.test_journal_repair:{ "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-12T02:35:34.104 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-12T02:35:34.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.182+0000 7f2042bb7280 1 -- start start 2024-09-12T02:35:34.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.182+0000 7f2042bb7280 1 Processor -- start 2024-09-12T02:35:34.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775231ec00 0x55775239a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775231f800 0x55775239ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775231fc00 0x55775239b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5577531f4180 con 0x55775231f800 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5577531f4300 con 0x55775231fc00 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5577531f4480 con 0x55775231ec00 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775231f800 0x55775239ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775231f800 0x55775239ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41420/0 (socket says 172.21.15.181:41420) 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 -- 172.21.15.181:0/2898573678 learned_addr learned my addr 172.21.15.181:0/2898573678 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2041b5d640 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775231fc00 0x55775239b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f204135c640 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775231ec00 0x55775239a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 -- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775231ec00 msgr2=0x55775239a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775231ec00 0x55775239a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 -- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775231fc00 msgr2=0x55775239b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775231fc00 0x55775239b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 -- 172.21.15.181:0/2898573678 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557752356780 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2041b5d640 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775231fc00 0x55775239b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2040b5b640 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775231f800 0x55775239ab00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x557753159320 tx=0x5577530c22a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53345ee9d9f1017 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f203eb57640 1 -- 172.21.15.181:0/2898573678 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557752344680 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f203eb57640 1 -- 172.21.15.181:0/2898573678 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55775234a700 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 -- 172.21.15.181:0/2898573678 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577523563c0 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 1 -- 172.21.15.181:0/2898573678 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x557752357680 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f2042bb7280 4 waiting for MDS map... 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.183+0000 7f203eb57640 1 -- 172.21.15.181:0/2898573678 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557752344b60 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.184+0000 7f203eb57640 1 -- 172.21.15.181:0/2898573678 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x557753206600 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.184+0000 7f203eb57640 1 -- 172.21.15.181:0/2898573678 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x557752379180 con 0x55775231f800 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.184+0000 7f2042bb7280 4 Got MDS map 63 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.184+0000 7f2042bb7280 10 main: main 2024-09-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.184+0000 7f2042bb7280 4 main: connecting to RADOS... 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.184+0000 7f2042bb7280 1 Processor -- start 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.184+0000 7f2042bb7280 1 -- start start 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320b400 0x55775239b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320bc00 0x55775239c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2042bb7280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5577531f4600 con 0x55775320b400 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2042bb7280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5577531f4780 con 0x55775320bc00 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2042bb7280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5577531f4900 con 0x55775320b800 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320b400 0x55775239b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320b400 0x55775239b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41426/0 (socket says 172.21.15.181:41426) 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 -- 172.21.15.181:0/1249825264 learned_addr learned my addr 172.21.15.181:0/1249825264 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2040b5b640 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320bc00 0x55775239c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f204135c640 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 -- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 msgr2=0x55775239bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 -- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320bc00 msgr2=0x55775239c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320bc00 0x55775239c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 -- 172.21.15.181:0/1249825264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577523574a0 con 0x55775320b400 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f204135c640 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.185+0000 7f2041b5d640 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320b400 0x55775239b600 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x557753224660 tx=0x557753226c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c25dea403e2b31e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f203cb53640 1 -- 172.21.15.181:0/1249825264 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557752344680 con 0x55775320b400 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f203cb53640 1 -- 172.21.15.181:0/1249825264 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55775234ae00 con 0x55775320b400 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f203cb53640 1 -- 172.21.15.181:0/1249825264 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557752344b60 con 0x55775320b400 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 -- 172.21.15.181:0/1249825264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320b400 msgr2=0x55775239b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320b400 0x55775239b600 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x557753224660 tx=0x557753226c00 comp rx=0 tx=0).stop 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 -- 172.21.15.181:0/1249825264 shutdown_connections 2024-09-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320bc00 0x55775239c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 --2- 172.21.15.181:0/1249825264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320b400 0x55775239b600 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 -- 172.21.15.181:0/1249825264 >> 172.21.15.181:0/1249825264 conn(0x55775320b000 msgr2=0x557752417000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 -- 172.21.15.181:0/1249825264 shutdown_connections 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 -- 172.21.15.181:0/1249825264 wait complete. 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.186+0000 7f2042bb7280 1 Processor -- start 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2042bb7280 1 -- start start 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320b400 0x55775239d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2042bb7280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320bc00 0x55775239c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2042bb7280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5577531f4900 con 0x55775320bc00 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2042bb7280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5577531f4a80 con 0x55775320b400 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2042bb7280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5577531f4780 con 0x55775320b800 2024-09-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320bc00 0x55775239c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320bc00 0x55775239c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41428/0 (socket says 172.21.15.181:41428) 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 -- 172.21.15.181:0/3251689358 learned_addr learned my addr 172.21.15.181:0/3251689358 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2041b5d640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320b400 0x55775239d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f204135c640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 -- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 msgr2=0x55775239cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775320b800 0x55775239cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 -- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320b400 msgr2=0x55775239d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775320b400 0x55775239d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.187+0000 7f2040b5b640 1 -- 172.21.15.181:0/3251689358 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557752356780 con 0x55775320bc00 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.188+0000 7f2040b5b640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320bc00 0x55775239c680 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x557753225350 tx=0x5577523db380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.188+0000 7f203b350640 1 -- 172.21.15.181:0/3251689358 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557752344820 con 0x55775320bc00 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.188+0000 7f203b350640 1 -- 172.21.15.181:0/3251689358 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55775234afc0 con 0x55775320bc00 2024-09-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.188+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577523563c0 con 0x55775320bc00 2024-09-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.188+0000 7f203b350640 1 -- 172.21.15.181:0/3251689358 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557752344680 con 0x55775320bc00 2024-09-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.188+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557752357680 con 0x55775320bc00 2024-09-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.188+0000 7f2042bb7280 4 main: resolving pool 10 2024-09-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.189+0000 7f203b350640 1 -- 172.21.15.181:0/3251689358 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x557753274c00 con 0x55775320bc00 2024-09-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.189+0000 7f203b350640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x557753277c00 0x55775239d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.189+0000 7f203b350640 1 -- 172.21.15.181:0/3251689358 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x557753272c00 con 0x55775320bc00 2024-09-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.189+0000 7f2042bb7280 4 main: creating IoCtx.. 2024-09-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.189+0000 7f2041b5d640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x557753277c00 0x55775239d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.189+0000 7f2042bb7280 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5577526b8000 0x55775239c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.189+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x5577526b8400 con 0x5577526b8000 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.190+0000 7f204135c640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5577526b8000 0x55775239c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.190+0000 7f2041b5d640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x557753277c00 0x55775239d700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x557753224660 tx=0x5577530c0ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.190+0000 7f204135c640 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5577526b8000 0x55775239c100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.190+0000 7f204135c640 1 -- 172.21.15.181:0/3251689358 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv4 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x5577530b0000 con 0x5577526b8000 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.190+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x5577526b8800 con 0x5577526b8000 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f204135c640 1 -- 172.21.15.181:0/3251689358 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x5577530b0000 con 0x5577526b8000 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions": [] 2024-09-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5577526b8000 msgr2=0x55775239c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x5577526b8000 0x55775239c100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x557753277c00 msgr2=0x55775239d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x557753277c00 0x55775239d700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x557753224660 tx=0x5577530c0ba0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320bc00 msgr2=0x55775239c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 --2- 172.21.15.181:0/3251689358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775320bc00 0x55775239c680 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x557753225350 tx=0x5577523db380 comp rx=0 tx=0).stop 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f204135c640 1 -- 172.21.15.181:0/3251689358 reap_dead start 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 shutdown_connections 2024-09-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 >> 172.21.15.181:0/3251689358 conn(0x55775320b000 msgr2=0x557752417000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 shutdown_connections 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/3251689358 wait complete. 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/2898573678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775231f800 msgr2=0x55775239ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775231f800 0x55775239ab00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x557753159320 tx=0x5577530c22a0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/2898573678 shutdown_connections 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55775231fc00 0x55775239b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55775231f800 0x55775239ab00 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 --2- 172.21.15.181:0/2898573678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55775231ec00 0x55775239a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/2898573678 >> 172.21.15.181:0/2898573678 conn(0x55775231f000 msgr2=0x557752416800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/2898573678 shutdown_connections 2024-09-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.191+0000 7f2042bb7280 1 -- 172.21.15.181:0/2898573678 wait complete. 2024-09-12T02:35:34.202 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.098521, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-12T02:35:34.203 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-12T02:35:34.203 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-12T02:35:34.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 -- start start 2024-09-12T02:35:34.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 Processor -- start 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393806400 0x564392a97600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807000 0x564392a96b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807400 0x564392a97080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5643938ee000 con 0x564393807000 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5643938ee180 con 0x564393807400 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f5620331280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5643938ee300 con 0x564393806400 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f561e2d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807000 0x564392a96b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f561e2d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807000 0x564392a96b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41434/0 (socket says 172.21.15.181:41434) 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f561e2d7640 1 -- 172.21.15.181:0/1682638325 learned_addr learned my addr 172.21.15.181:0/1682638325 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f561f2d9640 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807400 0x564392a97080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.282+0000 7f561ead8640 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393806400 0x564392a97600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561e2d7640 1 -- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393806400 msgr2=0x564392a97600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561e2d7640 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393806400 0x564392a97600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561e2d7640 1 -- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807400 msgr2=0x564392a97080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561e2d7640 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807400 0x564392a97080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561e2d7640 1 -- 172.21.15.181:0/1682638325 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564392a52780 con 0x564393807000 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561e2d7640 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807000 0x564392a96b00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x56439385d3b0 tx=0x5643937befc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d263af27d378126 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561c2d3640 1 -- 172.21.15.181:0/1682638325 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564392a40b60 con 0x564393807000 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561c2d3640 1 -- 172.21.15.181:0/1682638325 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564392a46e00 con 0x564393807000 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561c2d3640 1 -- 172.21.15.181:0/1682638325 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564392a40d00 con 0x564393807000 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f5620331280 1 -- 172.21.15.181:0/1682638325 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564392a52000 con 0x564393807000 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f5620331280 1 -- 172.21.15.181:0/1682638325 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564392a53a40 con 0x564393807000 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f5620331280 4 waiting for MDS map... 2024-09-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561c2d3640 1 -- 172.21.15.181:0/1682638325 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x5643938f0000 con 0x564393807000 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f561c2d3640 1 -- 172.21.15.181:0/1682638325 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x564392a75180 con 0x564393807000 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f5620331280 4 Got MDS map 63 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f5620331280 10 main: main 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.283+0000 7f5620331280 4 main: connecting to RADOS... 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 Processor -- start 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 -- start start 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807c00 0x564392a96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393912400 0x564392a98100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393912800 0x564392a98680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5643938ee480 con 0x564393912800 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5643938ee600 con 0x564393807c00 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.284+0000 7f5620331280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5643938ee780 con 0x564393912400 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393912800 0x564392a98680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393912800 0x564392a98680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41448/0 (socket says 172.21.15.181:41448) 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 -- 172.21.15.181:0/403996200 learned_addr learned my addr 172.21.15.181:0/403996200 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561f2d9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807c00 0x564392a96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561ead8640 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393912400 0x564392a98100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 -- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393912400 msgr2=0x564392a98100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393912400 0x564392a98100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 -- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807c00 msgr2=0x564392a96580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807c00 0x564392a96580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 -- 172.21.15.181:0/403996200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564392a53860 con 0x564393912800 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561ead8640 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393912400 0x564392a98100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561e2d7640 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393912800 0x564392a98680 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x564393908270 tx=0x5643937bf080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1024e85a0d918a3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561a2cf640 1 -- 172.21.15.181:0/403996200 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564392a40680 con 0x564393912800 2024-09-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561a2cf640 1 -- 172.21.15.181:0/403996200 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564392a46c40 con 0x564393912800 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f561a2cf640 1 -- 172.21.15.181:0/403996200 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564392a40820 con 0x564393912800 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f5620331280 1 -- 172.21.15.181:0/403996200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393912800 msgr2=0x564392a98680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f5620331280 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393912800 0x564392a98680 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x564393908270 tx=0x5643937bf080 comp rx=0 tx=0).stop 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f5620331280 1 -- 172.21.15.181:0/403996200 shutdown_connections 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f5620331280 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393912800 0x564392a98680 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f5620331280 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393912400 0x564392a98100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f5620331280 1 --2- 172.21.15.181:0/403996200 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807c00 0x564392a96580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.285+0000 7f5620331280 1 -- 172.21.15.181:0/403996200 >> 172.21.15.181:0/403996200 conn(0x564393807800 msgr2=0x564392b29000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.286+0000 7f5620331280 1 -- 172.21.15.181:0/403996200 shutdown_connections 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.286+0000 7f5620331280 1 -- 172.21.15.181:0/403996200 wait complete. 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.286+0000 7f5620331280 1 Processor -- start 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.286+0000 7f5620331280 1 -- start start 2024-09-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807800 0x564392a99700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393913400 0x564392a99180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393913000 0x564392a98c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5643938efb00 con 0x564393807800 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x5643938ef980 con 0x564393913400 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x5643938eec00 con 0x564393913000 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807800 0x564392a99700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807800 0x564392a99700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41456/0 (socket says 172.21.15.181:41456) 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 -- 172.21.15.181:0/2337627168 learned_addr learned my addr 172.21.15.181:0/2337627168 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561ead8640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393913400 0x564392a99180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561e2d7640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393913000 0x564392a98c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 -- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393913000 msgr2=0x564392a98c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393913000 0x564392a98c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 -- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393913400 msgr2=0x564392a99180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393913400 0x564392a99180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 -- 172.21.15.181:0/2337627168 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564392a53680 con 0x564393807800 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f561f2d9640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807800 0x564392a99700 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x564393909830 tx=0x564393914c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5618acc640 1 -- 172.21.15.181:0/2337627168 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564392a40680 con 0x564393807800 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5618acc640 1 -- 172.21.15.181:0/2337627168 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564392a46700 con 0x564393807800 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564392a523c0 con 0x564393807800 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5618acc640 1 -- 172.21.15.181:0/2337627168 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564392a40820 con 0x564393807800 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564392a53c20 con 0x564393807800 2024-09-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.287+0000 7f5620331280 4 main: resolving pool 10 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.288+0000 7f5618acc640 1 -- 172.21.15.181:0/2337627168 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x564393818c00 con 0x564393807800 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f5618acc640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564393970c00 0x564392db6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f5618acc640 1 -- 172.21.15.181:0/2337627168 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x564393972a00 con 0x564393807800 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f5620331280 4 main: creating IoCtx.. 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f561ead8640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564393970c00 0x564392db6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f5620331280 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x564393912c00 0x564392a98680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x564393912800 con 0x564393912c00 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f561e2d7640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x564393912c00 0x564392a98680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.289+0000 7f561ead8640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564393970c00 0x564392db6000 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5643937b4a80 tx=0x564393914ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f561e2d7640 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x564393912c00 0x564392a98680 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f561e2d7640 1 -- 172.21.15.181:0/2337627168 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv4 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x56439379a000 con 0x564393912c00 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x564393912400 con 0x564393912c00 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f561e2d7640 1 -- 172.21.15.181:0/2337627168 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x56439379a000 con 0x564393912c00 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions": [] 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:34.299 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x564393912c00 msgr2=0x564392a98680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x564393912c00 0x564392a98680 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564393970c00 msgr2=0x564392db6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x564393970c00 0x564392db6000 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5643937b4a80 tx=0x564393914ea0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807800 msgr2=0x564392a99700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 --2- 172.21.15.181:0/2337627168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807800 0x564392a99700 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x564393909830 tx=0x564393914c00 comp rx=0 tx=0).stop 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f561ead8640 1 -- 172.21.15.181:0/2337627168 reap_dead start 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 shutdown_connections 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 >> 172.21.15.181:0/2337627168 conn(0x564393807c00 msgr2=0x564392b29000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 shutdown_connections 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.290+0000 7f5620331280 1 -- 172.21.15.181:0/2337627168 wait complete. 2024-09-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 -- 172.21.15.181:0/1682638325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807000 msgr2=0x564392a96b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807000 0x564392a96b00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x56439385d3b0 tx=0x5643937befc0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 -- 172.21.15.181:0/1682638325 shutdown_connections 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x564393807400 0x564392a97080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564393807000 0x564392a96b00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 --2- 172.21.15.181:0/1682638325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x564393806400 0x564392a97600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 -- 172.21.15.181:0/1682638325 >> 172.21.15.181:0/1682638325 conn(0x564392a1b000 msgr2=0x564392b28800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 -- 172.21.15.181:0/1682638325 shutdown_connections 2024-09-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.291+0000 7f5620331280 1 -- 172.21.15.181:0/1682638325 wait complete. 2024-09-12T02:35:34.302 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.099543, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-12T02:35:34.302 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-12T02:35:34.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.379+0000 7f55e4c0e280 1 -- start start 2024-09-12T02:35:34.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.379+0000 7f55e4c0e280 1 Processor -- start 2024-09-12T02:35:34.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559613746c00 0x5596137c2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559613747800 0x5596137c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559613747c00 0x5596137c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559614600180 con 0x559613747c00 2024-09-12T02:35:34.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559614600300 con 0x559613747800 2024-09-12T02:35:34.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559614600480 con 0x559613746c00 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559613747c00 0x5596137c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559613747c00 0x5596137c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41482/0 (socket says 172.21.15.181:41482) 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 -- 172.21.15.181:0/1475854153 learned_addr learned my addr 172.21.15.181:0/1475854153 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2726640 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559613746c00 0x5596137c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e1f25640 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559613747800 0x5596137c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 -- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559613746c00 msgr2=0x5596137c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559613746c00 0x5596137c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 -- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559613747800 msgr2=0x5596137c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559613747800 0x5596137c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.380+0000 7f55e2f27640 1 -- 172.21.15.181:0/1475854153 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961377e780 con 0x559613747c00 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55e2f27640 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559613747c00 0x5596137c3080 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x559614565350 tx=0x5596144ea2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a4040537790a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55dff21640 1 -- 172.21.15.181:0/1475854153 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55961376c680 con 0x559613747c00 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55dff21640 1 -- 172.21.15.181:0/1475854153 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559613772700 con 0x559613747c00 2024-09-12T02:35:34.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55dff21640 1 -- 172.21.15.181:0/1475854153 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55961376cb60 con 0x559613747c00 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55e4c0e280 1 -- 172.21.15.181:0/1475854153 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961377f4a0 con 0x559613747c00 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55e4c0e280 1 -- 172.21.15.181:0/1475854153 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55961377e000 con 0x559613747c00 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55e4c0e280 4 waiting for MDS map... 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55dff21640 1 -- 172.21.15.181:0/1475854153 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x559614634600 con 0x559613747c00 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55dff21640 1 -- 172.21.15.181:0/1475854153 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x5596137a1180 con 0x559613747c00 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55e4c0e280 4 Got MDS map 63 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55e4c0e280 10 main: main 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.381+0000 7f55e4c0e280 4 main: connecting to RADOS... 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 Processor -- start 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 -- start start 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 0x5596137c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559614600600 con 0x55961462b400 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559614600780 con 0x55961462bc00 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559614600900 con 0x55961462b800 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e1f25640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e1f25640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41490/0 (socket says 172.21.15.181:41490) 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e1f25640 1 -- 172.21.15.181:0/599646639 learned_addr learned my addr 172.21.15.181:0/599646639 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e2726640 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.382+0000 7f55e1f25640 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 0x5596137c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e1f25640 1 -- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 msgr2=0x5596137c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e1f25640 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e1f25640 1 -- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 msgr2=0x5596137c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e1f25640 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 0x5596137c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e1f25640 1 -- 172.21.15.181:0/599646639 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961377e3c0 con 0x55961462b400 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e1f25640 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c3600 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x55961453a690 tx=0x55961453ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87318e8bf0472eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55ddf1d640 1 -- 172.21.15.181:0/599646639 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55961376c680 con 0x55961462b400 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55ddf1d640 1 -- 172.21.15.181:0/599646639 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559613772fc0 con 0x55961462b400 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55ddf1d640 1 -- 172.21.15.181:0/599646639 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55961376cb60 con 0x55961462b400 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 -- 172.21.15.181:0/599646639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 msgr2=0x5596137c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c3600 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x55961453a690 tx=0x55961453ccc0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 -- 172.21.15.181:0/599646639 shutdown_connections 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 0x5596137c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/599646639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c3600 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 -- 172.21.15.181:0/599646639 >> 172.21.15.181:0/599646639 conn(0x55961462b000 msgr2=0x55961383f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.383+0000 7f55e4c0e280 1 -- 172.21.15.181:0/599646639 shutdown_connections 2024-09-12T02:35:34.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.384+0000 7f55e4c0e280 1 -- 172.21.15.181:0/599646639 wait complete. 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.384+0000 7f55e4c0e280 1 Processor -- start 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.384+0000 7f55e4c0e280 1 -- start start 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 0x5596137c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559614601c80 con 0x55961462b400 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x559614600c00 con 0x55961462bc00 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x559614600d80 con 0x55961462b800 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41506/0 (socket says 172.21.15.181:41506) 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 -- 172.21.15.181:0/2237451598 learned_addr learned my addr 172.21.15.181:0/2237451598 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e2726640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 0x5596137c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 -- 172.21.15.181:0/2237451598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 msgr2=0x5596137c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 -- 172.21.15.181:0/2237451598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 msgr2=0x5596137c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55961462bc00 0x5596137c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 -- 172.21.15.181:0/2237451598 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961377e780 con 0x55961462b400 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e2726640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55961462b800 0x5596137c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e1f25640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c5180 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x55961453b350 tx=0x55961453cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55dc71a640 1 -- 172.21.15.181:0/2237451598 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55961376c4e0 con 0x55961462b400 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55dc71a640 1 -- 172.21.15.181:0/2237451598 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559613772e00 con 0x55961462b400 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55961377f4a0 con 0x55961462b400 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55dc71a640 1 -- 172.21.15.181:0/2237451598 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55961376c680 con 0x55961462b400 2024-09-12T02:35:34.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961377e960 con 0x55961462b400 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.385+0000 7f55e4c0e280 4 main: resolving pool 10 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.386+0000 7f55dc71a640 1 -- 172.21.15.181:0/2237451598 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55961469cc00 con 0x55961462b400 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55dc71a640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559614698c00 0x5596137c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55dc71a640 1 -- 172.21.15.181:0/2237451598 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55961469aa00 con 0x55961462b400 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e4c0e280 4 main: creating IoCtx.. 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e2726640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559614698c00 0x5596137c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559614699000 0x5596137c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x559614699400 con 0x559614699000 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e1f25640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559614699000 0x5596137c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e2726640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559614698c00 0x5596137c5700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5596137a2ea0 tx=0x5596144e8b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e1f25640 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559614699000 0x5596137c4100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.387+0000 7f55e1f25640 1 -- 172.21.15.181:0/2237451598 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x5596144d8000 con 0x559614699000 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 1, 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: "inotable": { 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: "projected_free": [ 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627776, 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627776 2024-09-12T02:35:34.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: "free": [ 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627776, 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627776 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:34.397 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:34.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559614699000 msgr2=0x5596137c4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x559614699000 0x5596137c4100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559614698c00 msgr2=0x5596137c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x559614698c00 0x5596137c5700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5596137a2ea0 tx=0x5596144e8b40 comp rx=0 tx=0).stop 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 msgr2=0x5596137c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/2237451598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55961462b400 0x5596137c5180 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x55961453b350 tx=0x55961453cc00 comp rx=0 tx=0).stop 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e2726640 1 -- 172.21.15.181:0/2237451598 reap_dead start 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 shutdown_connections 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 >> 172.21.15.181:0/2237451598 conn(0x55961462b000 msgr2=0x55961383f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 shutdown_connections 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/2237451598 wait complete. 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/1475854153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559613747c00 msgr2=0x5596137c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559613747c00 0x5596137c3080 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x559614565350 tx=0x5596144ea2a0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/1475854153 shutdown_connections 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x559613747800 0x5596137c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559613747c00 0x5596137c3080 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 --2- 172.21.15.181:0/1475854153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x559613746c00 0x5596137c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/1475854153 >> 172.21.15.181:0/1475854153 conn(0x559613747000 msgr2=0x55961383e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/1475854153 shutdown_connections 2024-09-12T02:35:34.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.388+0000 7f55e4c0e280 1 -- 172.21.15.181:0/1475854153 wait complete. 2024-09-12T02:35:34.401 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.098586, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-12T02:35:34.401 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-12T02:35:34.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.479+0000 7f7296a3b280 1 -- start start 2024-09-12T02:35:34.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.479+0000 7f7296a3b280 1 Processor -- start 2024-09-12T02:35:34.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b68c8000 0x55a8b5b61080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b5ae5c00 0x55a8b5b61b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b68c8800 0x55a8b5b61600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f7296a3b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a8b68ca480 con 0x55a8b68c8800 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f7296a3b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a8b68ca600 con 0x55a8b68c8000 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f7296a3b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a8b68ca780 con 0x55a8b5ae5c00 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b68c8800 0x55a8b5b61600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b68c8800 0x55a8b5b61600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41518/0 (socket says 172.21.15.181:41518) 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 -- 172.21.15.181:0/2448838194 learned_addr learned my addr 172.21.15.181:0/2448838194 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72951e0640 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b68c8000 0x55a8b5b61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72949df640 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b5ae5c00 0x55a8b5b61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 -- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b5ae5c00 msgr2=0x55a8b5b61b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b5ae5c00 0x55a8b5b61b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 -- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b68c8000 msgr2=0x55a8b5b61080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b68c8000 0x55a8b5b61080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.480+0000 7f72959e1640 1 -- 172.21.15.181:0/2448838194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8b5b1c780 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f72959e1640 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b68c8800 0x55a8b5b61600 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x55a8b691d110 tx=0x55a8b68880c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e3787c44694517 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f72929db640 1 -- 172.21.15.181:0/2448838194 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a8b5b0ad00 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f72929db640 1 -- 172.21.15.181:0/2448838194 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a8b5b10700 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f72929db640 1 -- 172.21.15.181:0/2448838194 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a8b5b0a680 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f7296a3b280 1 -- 172.21.15.181:0/2448838194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8b5b1c000 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f7296a3b280 1 -- 172.21.15.181:0/2448838194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a8b5b1da40 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f7296a3b280 4 waiting for MDS map... 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f72929db640 1 -- 172.21.15.181:0/2448838194 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55a8b69d8600 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f72929db640 1 -- 172.21.15.181:0/2448838194 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x55a8b5b3f180 con 0x55a8b68c8800 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f7296a3b280 4 Got MDS map 63 2024-09-12T02:35:34.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f7296a3b280 10 main: main 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.481+0000 7f7296a3b280 4 main: connecting to RADOS... 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 Processor -- start 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 -- start start 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a8b5b46180 con 0x55a8b69d1400 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a8b68cb680 con 0x55a8b69d1000 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f7296a3b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a8b68cb500 con 0x55a8b69d0c00 2024-09-12T02:35:34.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72949df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72951e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72949df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41522/0 (socket says 172.21.15.181:41522) 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72949df640 1 -- 172.21.15.181:0/101450033 learned_addr learned my addr 172.21.15.181:0/101450033 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72951e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:50026/0 (socket says 172.21.15.181:50026) 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72949df640 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72949df640 1 -- 172.21.15.181:0/101450033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d0c00 msgr2=0x55a8b5b60b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.482+0000 7f72949df640 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f72949df640 1 -- 172.21.15.181:0/101450033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1000 msgr2=0x55a8b5b62100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f72949df640 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f72949df640 1 -- 172.21.15.181:0/101450033 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8b5b1d860 con 0x55a8b69d1400 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f72949df640 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x55a8b69c86f0 tx=0x55a8b69c6cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0ca89115eb8cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f72909d7640 1 -- 172.21.15.181:0/101450033 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a8b5b0ad00 con 0x55a8b69d1400 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f72909d7640 1 -- 172.21.15.181:0/101450033 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a8b5b10e00 con 0x55a8b69d1400 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f72909d7640 1 -- 172.21.15.181:0/101450033 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a8b5b0a680 con 0x55a8b69d1400 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 -- 172.21.15.181:0/101450033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d1400 msgr2=0x55a8b5b62680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x55a8b69c86f0 tx=0x55a8b69c6cc0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 -- 172.21.15.181:0/101450033 shutdown_connections 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 --2- 172.21.15.181:0/101450033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 -- 172.21.15.181:0/101450033 >> 172.21.15.181:0/101450033 conn(0x55a8b68c8400 msgr2=0x55a8b5bd1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 -- 172.21.15.181:0/101450033 shutdown_connections 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.483+0000 7f7296a3b280 1 -- 172.21.15.181:0/101450033 wait complete. 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 Processor -- start 2024-09-12T02:35:34.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 -- start start 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a8b68ca900 con 0x55a8b69d0c00 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55a8b68caa80 con 0x55a8b69d1400 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f7296a3b280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55a8b68ca180 con 0x55a8b69d1000 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f72949df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f72949df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41536/0 (socket says 172.21.15.181:41536) 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.484+0000 7f72949df640 1 -- 172.21.15.181:0/2348563599 learned_addr learned my addr 172.21.15.181:0/2348563599 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72951e0640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72949df640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72949df640 1 -- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d1000 msgr2=0x55a8b5b62100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72949df640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72949df640 1 -- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1400 msgr2=0x55a8b5b62680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72949df640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72949df640 1 -- 172.21.15.181:0/2348563599 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8b5b1d4a0 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f72949df640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x55a8b69c93b0 tx=0x55a8b69c6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f728f1d4640 1 -- 172.21.15.181:0/2348563599 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a8b5b0a820 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f728f1d4640 1 -- 172.21.15.181:0/2348563599 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a8b5b10c40 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8b5b1c960 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f728f1d4640 1 -- 172.21.15.181:0/2348563599 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a8b5b0ad00 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8b5b1c780 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.485+0000 7f7296a3b280 4 main: resolving pool 10 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.486+0000 7f728f1d4640 1 -- 172.21.15.181:0/2348563599 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a8b6a48c00 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.486+0000 7f728f1d4640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a8b6a40c00 0x55a8b5b63700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.486+0000 7f728f1d4640 1 -- 172.21.15.181:0/2348563599 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x55a8b6a4c400 con 0x55a8b69d0c00 2024-09-12T02:35:34.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.487+0000 7f7296a3b280 4 main: creating IoCtx.. 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.487+0000 7f72951e0640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a8b6a40c00 0x55a8b5b63700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.487+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a8b69d1800 0x55a8b5b62c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.487+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) -- 0x55a8b69d1c00 con 0x55a8b69d1800 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.487+0000 7f72949df640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a8b69d1800 0x55a8b5b62c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.487+0000 7f72951e0640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a8b6a40c00 0x55a8b5b63700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55a8b5bf2b10 tx=0x55a8b5ba1080 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.487+0000 7f72949df640 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a8b69d1800 0x55a8b5b62c00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f72949df640 1 -- 172.21.15.181:0/2348563599 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv2 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55a8b5bf0000 con 0x55a8b69d1800 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:34.496 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 1, 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "snapserver": { 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "last_snap": 1, 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "last_created": 1, 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "last_destroyed": 1, 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_noop": [], 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "snaps": [], 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "need_to_purge": {}, 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_update": [], 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "pending_destroy": [] 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:34.497 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:34.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a8b69d1800 msgr2=0x55a8b5b62c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a8b69d1800 0x55a8b5b62c00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a8b6a40c00 msgr2=0x55a8b5b63700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a8b6a40c00 0x55a8b5b63700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55a8b5bf2b10 tx=0x55a8b5ba1080 comp rx=0 tx=0).stop 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d0c00 msgr2=0x55a8b5b60b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x55a8b69c93b0 tx=0x55a8b69c6c00 comp rx=0 tx=0).stop 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 shutdown_connections 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x55a8b69d1800 0x55a8b5b62c00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55a8b6a40c00 0x55a8b5b63700 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f72951e0640 1 -- 172.21.15.181:0/2348563599 reap_dead start 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b69d1400 0x55a8b5b62680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b69d1000 0x55a8b5b62100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2348563599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b69d0c00 0x55a8b5b60b00 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 >> 172.21.15.181:0/2348563599 conn(0x55a8b68c8400 msgr2=0x55a8b5bd1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 shutdown_connections 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2348563599 wait complete. 2024-09-12T02:35:34.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2448838194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b68c8800 msgr2=0x55a8b5b61600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b68c8800 0x55a8b5b61600 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x55a8b691d110 tx=0x55a8b68880c0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2448838194 shutdown_connections 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8b68c8800 0x55a8b5b61600 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55a8b5ae5c00 0x55a8b5b61b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 --2- 172.21.15.181:0/2448838194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55a8b68c8000 0x55a8b5b61080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2448838194 >> 172.21.15.181:0/2448838194 conn(0x55a8b5ae5000 msgr2=0x55a8b5bd1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2448838194 shutdown_connections 2024-09-12T02:35:34.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.488+0000 7f7296a3b280 1 -- 172.21.15.181:0/2448838194 wait complete. 2024-09-12T02:35:34.501 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.100061, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-12T02:35:34.501 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:35:34.502 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:34.586 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:34.626 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:35:34.627 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:34.627 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:34.627 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:34.643 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:35:34.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.780+0000 7f26779a6640 1 Processor -- start 2024-09-12T02:35:34.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.781+0000 7f26779a6640 1 -- start start 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.781+0000 7f26779a6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f26700cdfc0 0x7f26700b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f26779a6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26700b22c0 0x7f2670071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f26779a6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26700ce4f0 con 0x7f267015b2e0 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f26779a6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f267015b6c0 con 0x7f26700cdfc0 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f26779a6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f26700b4430 con 0x7f26700b22c0 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2674f41640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f26700cdfc0 0x7f26700b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2675742640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f267015b2e0 0x7f26700b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53688/0 (socket says 172.21.15.181:53688) 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2675742640 1 -- 172.21.15.181:0/2622214336 learned_addr learned my addr 172.21.15.181:0/2622214336 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2674f41640 1 -- 172.21.15.181:0/2622214336 >> v2:172.21.15.204:3300/0 conn(0x7f26700b22c0 msgr2=0x7f2670071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2674f41640 1 --2- 172.21.15.181:0/2622214336 >> v2:172.21.15.204:3300/0 conn(0x7f26700b22c0 0x7f2670071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2674f41640 1 -- 172.21.15.181:0/2622214336 >> v1:172.21.15.181:6789/0 conn(0x7f267015b2e0 legacy=0x7f26700b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2667fff640 1 -- 172.21.15.181:0/2622214336 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455123324 0 0) 0x7f26700ce4f0 con 0x7f267015b2e0 2024-09-12T02:35:34.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.782+0000 7f2674f41640 1 -- 172.21.15.181:0/2622214336 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26700ce7d0 con 0x7f26700cdfc0 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f2674f41640 1 --2- 172.21.15.181:0/2622214336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700cdfc0 0x7f26700b1d80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f26700b5590 tx=0x7f266002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216652de83fc7560 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f2667fff640 1 -- 172.21.15.181:0/2622214336 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660037070 con 0x7f26700cdfc0 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f2667fff640 1 -- 172.21.15.181:0/2622214336 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2660032440 con 0x7f26700cdfc0 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f2667fff640 1 -- 172.21.15.181:0/2622214336 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660032810 con 0x7f26700cdfc0 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f26779a6640 1 -- 172.21.15.181:0/2622214336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700cdfc0 msgr2=0x7f26700b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f26779a6640 1 --2- 172.21.15.181:0/2622214336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700cdfc0 0x7f26700b1d80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f26700b5590 tx=0x7f266002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f26779a6640 1 -- 172.21.15.181:0/2622214336 shutdown_connections 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f26779a6640 1 --2- 172.21.15.181:0/2622214336 >> v2:172.21.15.204:3300/0 conn(0x7f26700b22c0 0x7f2670071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f26779a6640 1 --2- 172.21.15.181:0/2622214336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700cdfc0 0x7f26700b1d80 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.783+0000 7f26779a6640 1 -- 172.21.15.181:0/2622214336 >> 172.21.15.181:0/2622214336 conn(0x7f267006bc10 msgr2=0x7f267006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.784+0000 7f26779a6640 1 -- 172.21.15.181:0/2622214336 shutdown_connections 2024-09-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.784+0000 7f26779a6640 1 -- 172.21.15.181:0/2622214336 wait complete. 2024-09-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 Processor -- start 2024-09-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 -- start start 2024-09-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700b22c0 0x7f2670151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26700cdfc0 0x7f267015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f267015b2e0 0x7f267015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2670071130 con 0x7f26700b22c0 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f26700ced90 con 0x7f267015b2e0 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f26779a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f26700712b0 con 0x7f26700cdfc0 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f2675742640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700b22c0 0x7f2670151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f2675742640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700b22c0 0x7f2670151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41552/0 (socket says 172.21.15.181:41552) 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.785+0000 7f2675742640 1 -- 172.21.15.181:0/1469057450 learned_addr learned my addr 172.21.15.181:0/1469057450 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2675f43640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f267015b2e0 0x7f267015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2674f41640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26700cdfc0 0x7f267015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2675742640 1 -- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26700cdfc0 msgr2=0x7f267015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2675742640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26700cdfc0 0x7f267015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2675742640 1 -- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f267015b2e0 msgr2=0x7f267015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2675742640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f267015b2e0 0x7f267015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2675742640 1 -- 172.21.15.181:0/1469057450 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267015d450 con 0x7f26700b22c0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2675742640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700b22c0 0x7f2670151c00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c430 tx=0x7f266c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2665ffb640 1 -- 172.21.15.181:0/1469057450 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c0074e0 con 0x7f26700b22c0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2665ffb640 1 -- 172.21.15.181:0/1469057450 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0047e0 con 0x7f26700b22c0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26701f2e80 con 0x7f26700b22c0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f2665ffb640 1 -- 172.21.15.181:0/1469057450 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c004bd0 con 0x7f26700b22c0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.786+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26701e37a0 con 0x7f26700b22c0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.787+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26700b1d80 con 0x7f26700b22c0 2024-09-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.787+0000 7f2665ffb640 1 -- 172.21.15.181:0/1469057450 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f266c011070 con 0x7f26700b22c0 2024-09-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.788+0000 7f2665ffb640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f265406be60 0x7f265406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.788+0000 7f2674f41640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f265406be60 0x7f265406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.788+0000 7f2665ffb640 1 -- 172.21.15.181:0/1469057450 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f266c08a940 con 0x7f26700b22c0 2024-09-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.788+0000 7f2674f41640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f265406be60 0x7f265406e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2660034000 tx=0x7f266002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:34.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.793+0000 7f2665ffb640 1 -- 172.21.15.181:0/1469057450 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f266c059380 con 0x7f26700b22c0 2024-09-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.968+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f26700cfac0 con 0x7f26700b22c0 2024-09-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.968+0000 7f2665ffb640 1 -- 172.21.15.181:0/1469057450 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f266c058c80 con 0x7f26700b22c0 2024-09-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f265406be60 msgr2=0x7f265406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f265406be60 0x7f265406e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2660034000 tx=0x7f266002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700b22c0 msgr2=0x7f2670151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700b22c0 0x7f2670151c00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c430 tx=0x7f266c00c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 shutdown_connections 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f265406be60 0x7f265406e320 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f267015b2e0 0x7f267015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26700cdfc0 0x7f267015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 --2- 172.21.15.181:0/1469057450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26700b22c0 0x7f2670151c00 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 >> 172.21.15.181:0/1469057450 conn(0x7f267006bc10 msgr2=0x7f26700af980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 shutdown_connections 2024-09-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:34.970+0000 7f26779a6640 1 -- 172.21.15.181:0/1469057450 wait complete. 2024-09-12T02:35:34.982 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:35:34.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:34.982 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:35.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[62178]: fuse finished with error 0 and tester_r 0 2024-09-12T02:35:35.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:35.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:35.007 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:35:35.065 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:35.066 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:35.066 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:35.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:35.085 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:35:35.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:35.086 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:35:35.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:35.144 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-12T02:35:35.144 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:35.145 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:35.145 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:35.161 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:35.161 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:35.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:35.161 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:35:35.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:35.216 INFO:teuthology.orchestra.run.smithi181.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T02:35:35.216 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:35.216 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:35.217 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:35.235 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:35.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:35:35.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:35.236 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:35:35.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:35.294 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T02:35:35.295 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:35.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea62ee6640 1 Processor -- start 2024-09-12T02:35:35.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea62ee6640 1 -- start start 2024-09-12T02:35:35.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea62ee6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fea5c15e640 0x7fea5c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea62ee6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fea5c0cf0e0 0x7fea5c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea62ee6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5c15ea20 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea62ee6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fea5c0b2860 con 0x7fea5c0cf0e0 2024-09-12T02:35:35.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea62ee6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fea5c0b1c50 con 0x7fea5c15e640 2024-09-12T02:35:35.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.392+0000 7fea5bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fea5c0cf0e0 0x7fea5c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.393+0000 7fea5bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fea5c0cf0e0 0x7fea5c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41554/0 (socket says 172.21.15.181:41554) 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.393+0000 7fea5bfff640 1 -- 172.21.15.181:0/2892001224 learned_addr learned my addr 172.21.15.181:0/2892001224 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.393+0000 7fea5bfff640 1 -- 172.21.15.181:0/2892001224 >> v2:172.21.15.204:3300/0 conn(0x7fea5c15e640 msgr2=0x7fea5c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.393+0000 7fea5bfff640 1 --2- 172.21.15.181:0/2892001224 >> v2:172.21.15.204:3300/0 conn(0x7fea5c15e640 0x7fea5c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.393+0000 7fea5bfff640 1 -- 172.21.15.181:0/2892001224 >> v1:172.21.15.204:6789/0 conn(0x7fea5c0b2cf0 legacy=0x7fea5c0b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.393+0000 7fea5bfff640 1 -- 172.21.15.181:0/2892001224 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c0b1f30 con 0x7fea5c0cf0e0 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.393+0000 7fea5bfff640 1 --2- 172.21.15.181:0/2892001224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c0cf550 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0cb580 tx=0x7fea5002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c322d0c8b8ea4c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea5b7fe640 1 -- 172.21.15.181:0/2892001224 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50036070 con 0x7fea5c0cf0e0 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea5b7fe640 1 -- 172.21.15.181:0/2892001224 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea50031600 con 0x7fea5c0cf0e0 2024-09-12T02:35:35.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea5b7fe640 1 -- 172.21.15.181:0/2892001224 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea500319d0 con 0x7fea5c0cf0e0 2024-09-12T02:35:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 -- 172.21.15.181:0/2892001224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0cf0e0 msgr2=0x7fea5c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2892001224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c0cf550 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0cb580 tx=0x7fea5002a640 comp rx=0 tx=0).stop 2024-09-12T02:35:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 -- 172.21.15.181:0/2892001224 shutdown_connections 2024-09-12T02:35:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2892001224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c0cf550 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2892001224 >> v2:172.21.15.204:3300/0 conn(0x7fea5c15e640 0x7fea5c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 -- 172.21.15.181:0/2892001224 >> 172.21.15.181:0/2892001224 conn(0x7fea5c09d820 msgr2=0x7fea5c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 -- 172.21.15.181:0/2892001224 shutdown_connections 2024-09-12T02:35:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.394+0000 7fea62ee6640 1 -- 172.21.15.181:0/2892001224 wait complete. 2024-09-12T02:35:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.395+0000 7fea62ee6640 1 Processor -- start 2024-09-12T02:35:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.395+0000 7fea62ee6640 1 -- start start 2024-09-12T02:35:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea62ee6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0b2cf0 0x7fea5c159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea62ee6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c1e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea62ee6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea5c15e640 0x7fea5c1e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea62ee6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c0cfe40 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea62ee6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c0b24f0 con 0x7fea5c0cf0e0 2024-09-12T02:35:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea62ee6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c0b73a0 con 0x7fea5c15e640 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea60c82640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0b2cf0 0x7fea5c159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea60c82640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0b2cf0 0x7fea5c159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41568/0 (socket says 172.21.15.181:41568) 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea60c82640 1 -- 172.21.15.181:0/2443277663 learned_addr learned my addr 172.21.15.181:0/2443277663 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.396+0000 7fea5bfff640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c1e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea61483640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea5c15e640 0x7fea5c1e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea60c82640 1 -- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea5c15e640 msgr2=0x7fea5c1e90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea60c82640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea5c15e640 0x7fea5c1e90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea60c82640 1 -- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea5c0cf0e0 msgr2=0x7fea5c1e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea60c82640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c1e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea60c82640 1 -- 172.21.15.181:0/2443277663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c15ab80 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea5bfff640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c1e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea60c82640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0b2cf0 0x7fea5c159880 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00b4a0 tx=0x7fea4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea597fa640 1 -- 172.21.15.181:0/2443277663 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c014070 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea597fa640 1 -- 172.21.15.181:0/2443277663 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c010610 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c15ae60 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea597fa640 1 -- 172.21.15.181:0/2443277663 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c010a00 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.397+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c159fa0 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.398+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5c068eb0 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.398+0000 7fea597fa640 1 -- 172.21.15.181:0/2443277663 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea4c017070 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.399+0000 7fea597fa640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fea4806be60 0x7fea4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.399+0000 7fea597fa640 1 -- 172.21.15.181:0/2443277663 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7fea4c08a840 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.399+0000 7fea5bfff640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fea4806be60 0x7fea4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.399+0000 7fea5bfff640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fea4806be60 0x7fea4806e320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fea50033000 tx=0x7fea50009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.403+0000 7fea597fa640 1 -- 172.21.15.181:0/2443277663 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea4c059280 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.604+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea5c0ceba0 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.605+0000 7fea597fa640 1 -- 172.21.15.181:0/2443277663 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5234 (secure 0 0 0) 0x7fea4c058b80 con 0x7fea5c0b2cf0 2024-09-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"btime":"2024-09-12T02:35:28:436708+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:25.750512+0000","modified":"2024-09-12T02:35:27.765241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6834/1682794667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1682794667},{"type":"v1","addr":"172.21.15.204:6834","nonce":1682794667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6780,"qdb_cluster":[6780]},"id":5}]} 2024-09-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 63 2024-09-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.606+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fea4806be60 msgr2=0x7fea4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.606+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fea4806be60 0x7fea4806e320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fea50033000 tx=0x7fea50009000 comp rx=0 tx=0).stop 2024-09-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0b2cf0 msgr2=0x7fea5c159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0b2cf0 0x7fea5c159880 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00b4a0 tx=0x7fea4c00b960 comp rx=0 tx=0).stop 2024-09-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 shutdown_connections 2024-09-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fea4806be60 0x7fea4806e320 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fea5c0cf0e0 0x7fea5c1e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fea5c15e640 0x7fea5c1e90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 --2- 172.21.15.181:0/2443277663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea5c0b2cf0 0x7fea5c159880 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 >> 172.21.15.181:0/2443277663 conn(0x7fea5c09d820 msgr2=0x7fea5c06cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 shutdown_connections 2024-09-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.607+0000 7fea62ee6640 1 -- 172.21.15.181:0/2443277663 wait complete. 2024-09-12T02:35:35.619 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:35.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.717+0000 7f72f97e4640 1 Processor -- start 2024-09-12T02:35:35.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.717+0000 7f72f97e4640 1 -- start start 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.717+0000 7f72f97e4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f72f40cf2b0 0x7f72f40d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.717+0000 7f72f97e4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f72f40cf720 0x7f72f40d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.717+0000 7f72f97e4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f415ea20 con 0x7f72f415e640 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.717+0000 7f72f97e4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f72f40b3d00 con 0x7f72f40cf2b0 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.717+0000 7f72f97e4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f72f40b2860 con 0x7f72f40cf720 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f27fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f72f40cf2b0 0x7f72f40d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f2ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f72f415e640 0x7f72f40ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53690/0 (socket says 172.21.15.181:53690) 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f2ffd640 1 -- 172.21.15.181:0/873206435 learned_addr learned my addr 172.21.15.181:0/873206435 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f37fe640 1 --2- 172.21.15.181:0/873206435 >> v2:172.21.15.204:3300/0 conn(0x7f72f40cf720 0x7f72f40d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f27fc640 1 -- 172.21.15.181:0/873206435 >> v2:172.21.15.204:3300/0 conn(0x7f72f40cf720 msgr2=0x7f72f40d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f27fc640 1 --2- 172.21.15.181:0/873206435 >> v2:172.21.15.204:3300/0 conn(0x7f72f40cf720 0x7f72f40d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f27fc640 1 -- 172.21.15.181:0/873206435 >> v1:172.21.15.181:6789/0 conn(0x7f72f415e640 legacy=0x7f72f40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f27fc640 1 -- 172.21.15.181:0/873206435 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f40b1c50 con 0x7f72f40cf2b0 2024-09-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f1ffb640 1 -- 172.21.15.181:0/873206435 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801272195 0 0) 0x7f72f415ea20 con 0x7f72f415e640 2024-09-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.718+0000 7f72f37fe640 1 --2- 172.21.15.181:0/873206435 >> v2:172.21.15.204:3300/0 conn(0x7f72f40cf720 0x7f72f40d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f27fc640 1 --2- 172.21.15.181:0/873206435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf2b0 0x7f72f40d2650 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f72f415ebf0 tx=0x7f72e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803c10f1ce0ac963 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f1ffb640 1 -- 172.21.15.181:0/873206435 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8037070 con 0x7f72f40cf2b0 2024-09-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f1ffb640 1 -- 172.21.15.181:0/873206435 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8032440 con 0x7f72f40cf2b0 2024-09-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f1ffb640 1 -- 172.21.15.181:0/873206435 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e802ae60 con 0x7f72f40cf2b0 2024-09-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 -- 172.21.15.181:0/873206435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf2b0 msgr2=0x7f72f40d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 --2- 172.21.15.181:0/873206435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf2b0 0x7f72f40d2650 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f72f415ebf0 tx=0x7f72e802a110 comp rx=0 tx=0).stop 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 -- 172.21.15.181:0/873206435 shutdown_connections 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 --2- 172.21.15.181:0/873206435 >> v2:172.21.15.204:3300/0 conn(0x7f72f40cf720 0x7f72f40d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 --2- 172.21.15.181:0/873206435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf2b0 0x7f72f40d2650 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 -- 172.21.15.181:0/873206435 >> 172.21.15.181:0/873206435 conn(0x7f72f409d820 msgr2=0x7f72f40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 -- 172.21.15.181:0/873206435 shutdown_connections 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.719+0000 7f72f97e4640 1 -- 172.21.15.181:0/873206435 wait complete. 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 Processor -- start 2024-09-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 -- start start 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f40cf2b0 0x7f72f41f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf720 0x7f72f415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72f415e640 0x7f72f41610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40b24f0 con 0x7f72f40cf720 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40b2210 con 0x7f72f40cf2b0 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.721+0000 7f72f97e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f72f40cfe40 con 0x7f72f415e640 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf720 0x7f72f415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf720 0x7f72f415b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41580/0 (socket says 172.21.15.181:41580) 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 -- 172.21.15.181:0/321565706 learned_addr learned my addr 172.21.15.181:0/321565706 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f2ffd640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f40cf2b0 0x7f72f41f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f37fe640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72f415e640 0x7f72f41610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 -- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72f415e640 msgr2=0x7f72f41610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72f415e640 0x7f72f41610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 -- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f40cf2b0 msgr2=0x7f72f41f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f40cf2b0 0x7f72f41f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 -- 172.21.15.181:0/321565706 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f41f49b0 con 0x7f72f40cf720 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f27fc640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf720 0x7f72f415b3a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72db7fe640 1 -- 172.21.15.181:0/321565706 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8037050 con 0x7f72f40cf720 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72db7fe640 1 -- 172.21.15.181:0/321565706 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8038040 con 0x7f72f40cf720 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72db7fe640 1 -- 172.21.15.181:0/321565706 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8004450 con 0x7f72f40cf720 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f41f4c90 con 0x7f72f40cf720 2024-09-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.722+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f40b55e0 con 0x7f72f40cf720 2024-09-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.723+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f4068eb0 con 0x7f72f40cf720 2024-09-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.724+0000 7f72db7fe640 1 -- 172.21.15.181:0/321565706 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72e8030980 con 0x7f72f40cf720 2024-09-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.724+0000 7f72db7fe640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f72e006be60 0x7f72e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.724+0000 7f72db7fe640 1 -- 172.21.15.181:0/321565706 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f72e80aba90 con 0x7f72f40cf720 2024-09-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.724+0000 7f72f2ffd640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f72e006be60 0x7f72e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.725+0000 7f72f2ffd640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f72e006be60 0x7f72e006e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f72e40012e0 tx=0x7f72e4001700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.728+0000 7f72db7fe640 1 -- 172.21.15.181:0/321565706 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72e8079fa0 con 0x7f72f40cf720 2024-09-12T02:35:35.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.926+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72f40b73a0 con 0x7f72f40cf720 2024-09-12T02:35:35.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.927+0000 7f72db7fe640 1 -- 172.21.15.181:0/321565706 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5234 (secure 0 0 0) 0x7f72e807e2a0 con 0x7f72f40cf720 2024-09-12T02:35:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:35.928 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"btime":"2024-09-12T02:35:28:436708+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:25.750512+0000","modified":"2024-09-12T02:35:27.765241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6834/1682794667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1682794667},{"type":"v1","addr":"172.21.15.204:6834","nonce":1682794667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6780,"qdb_cluster":[6780]},"id":5}]} 2024-09-12T02:35:35.928 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 63 2024-09-12T02:35:35.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f72e006be60 msgr2=0x7f72e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f72e006be60 0x7f72e006e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f72e40012e0 tx=0x7f72e4001700 comp rx=0 tx=0).stop 2024-09-12T02:35:35.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf720 msgr2=0x7f72f415b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf720 0x7f72f415b3a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e80046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 shutdown_connections 2024-09-12T02:35:35.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f72e006be60 0x7f72e006e320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72f415e640 0x7f72f41610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72f40cf720 0x7f72f415b3a0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 --2- 172.21.15.181:0/321565706 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72f40cf2b0 0x7f72f41f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 >> 172.21.15.181:0/321565706 conn(0x7f72f409d820 msgr2=0x7f72f40ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:35.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 shutdown_connections 2024-09-12T02:35:35.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:35.929+0000 7f72f97e4640 1 -- 172.21.15.181:0/321565706 wait complete. 2024-09-12T02:35:35.941 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:36.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.038+0000 7f859a40a640 1 Processor -- start 2024-09-12T02:35:36.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.038+0000 7f859a40a640 1 -- start start 2024-09-12T02:35:36.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f859a40a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f85940cd880 0x7f85940b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f859a40a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f859415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f859a40a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85940b2710 con 0x7f8594156990 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f859a40a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8594156d70 con 0x7f85940cd880 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f859a40a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f85940cea90 con 0x7f85940b22c0 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f85937fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f85940cd880 0x7f85940b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f8593fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8594156990 0x7f85940cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53706/0 (socket says 172.21.15.181:53706) 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f8593fff640 1 -- 172.21.15.181:0/209349735 learned_addr learned my addr 172.21.15.181:0/209349735 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.039+0000 7f85989a7640 1 --2- 172.21.15.181:0/209349735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f859415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f85937fe640 1 -- 172.21.15.181:0/209349735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 msgr2=0x7f859415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f85937fe640 1 --2- 172.21.15.181:0/209349735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f859415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f85937fe640 1 -- 172.21.15.181:0/209349735 >> v1:172.21.15.181:6789/0 conn(0x7f8594156990 legacy=0x7f85940cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f85937fe640 1 -- 172.21.15.181:0/209349735 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85940731f0 con 0x7f85940cd880 2024-09-12T02:35:36.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f85937fe640 1 --2- 172.21.15.181:0/209349735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85940cd880 0x7f85940b1d80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f85880097a0 tx=0x7f858802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac8dd128733cfc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f8592ffd640 1 -- 172.21.15.181:0/209349735 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588037070 con 0x7f85940cd880 2024-09-12T02:35:36.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f8592ffd640 1 -- 172.21.15.181:0/209349735 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f858802ae50 con 0x7f85940cd880 2024-09-12T02:35:36.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.040+0000 7f8592ffd640 1 -- 172.21.15.181:0/209349735 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588032660 con 0x7f85940cd880 2024-09-12T02:35:36.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 -- 172.21.15.181:0/209349735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85940cd880 msgr2=0x7f85940b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 --2- 172.21.15.181:0/209349735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85940cd880 0x7f85940b1d80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f85880097a0 tx=0x7f858802a100 comp rx=0 tx=0).stop 2024-09-12T02:35:36.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 -- 172.21.15.181:0/209349735 shutdown_connections 2024-09-12T02:35:36.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 --2- 172.21.15.181:0/209349735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f859415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 --2- 172.21.15.181:0/209349735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85940cd880 0x7f85940b1d80 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 -- 172.21.15.181:0/209349735 >> 172.21.15.181:0/209349735 conn(0x7f859406bc10 msgr2=0x7f859406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 -- 172.21.15.181:0/209349735 shutdown_connections 2024-09-12T02:35:36.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.041+0000 7f859a40a640 1 -- 172.21.15.181:0/209349735 wait complete. 2024-09-12T02:35:36.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.042+0000 7f859a40a640 1 Processor -- start 2024-09-12T02:35:36.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.042+0000 7f859a40a640 1 -- start start 2024-09-12T02:35:36.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f859a40a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f8594145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f859a40a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85940cd880 0x7f85941f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f859a40a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8594156990 0x7f85941f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f859a40a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f85940ce720 con 0x7f8594156990 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f859a40a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f85940ce440 con 0x7f85940cd880 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f859a40a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f85940cef20 con 0x7f85940b22c0 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8594156990 0x7f85941f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8594156990 0x7f85941f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41594/0 (socket says 172.21.15.181:41594) 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 -- 172.21.15.181:0/880611324 learned_addr learned my addr 172.21.15.181:0/880611324 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85937fe640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85940cd880 0x7f85941f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f8593fff640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f8594145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 -- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 msgr2=0x7f8594145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f8594145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 -- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85940cd880 msgr2=0x7f85941f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85940cd880 0x7f85941f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.043+0000 7f85989a7640 1 -- 172.21.15.181:0/880611324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85940b1490 con 0x7f8594156990 2024-09-12T02:35:36.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.044+0000 7f85989a7640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8594156990 0x7f85941f6400 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f858c007e60 tx=0x7f858c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.044+0000 7f8590ff9640 1 -- 172.21.15.181:0/880611324 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c014420 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.044+0000 7f8590ff9640 1 -- 172.21.15.181:0/880611324 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f858c019070 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.044+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85940b0ed0 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.044+0000 7f8590ff9640 1 -- 172.21.15.181:0/880611324 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c014820 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.044+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8594157030 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.045+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85940b1d80 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.045+0000 7f8590ff9640 1 -- 172.21.15.181:0/880611324 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f858c0149c0 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.046+0000 7f8590ff9640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f858006be30 0x7f858006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.046+0000 7f8590ff9640 1 -- 172.21.15.181:0/880611324 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f858c08b5b0 con 0x7f8594156990 2024-09-12T02:35:36.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.046+0000 7f8593fff640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f858006be30 0x7f858006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.046+0000 7f8593fff640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f858006be30 0x7f858006e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8584000f60 tx=0x7f8584009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.050+0000 7f8590ff9640 1 -- 172.21.15.181:0/880611324 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f858c0599a0 con 0x7f8594156990 2024-09-12T02:35:36.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.213+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85940cfae0 con 0x7f8594156990 2024-09-12T02:35:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.215+0000 7f8590ff9640 1 -- 172.21.15.181:0/880611324 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16800 (secure 0 0 0) 0x7f858c05dca0 con 0x7f8594156990 2024-09-12T02:35:36.216 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:36.216 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":75,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:27.429904+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:24.367784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:24.724437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f858006be30 msgr2=0x7f858006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f858006be30 0x7f858006e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8584000f60 tx=0x7f8584009040 comp rx=0 tx=0).stop 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8594156990 msgr2=0x7f85941f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8594156990 0x7f85941f6400 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f858c007e60 tx=0x7f858c00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 shutdown_connections 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f858006be30 0x7f858006e2f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85940cd880 0x7f85941f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8594156990 0x7f85941f6400 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 --2- 172.21.15.181:0/880611324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85940b22c0 0x7f8594145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 >> 172.21.15.181:0/880611324 conn(0x7f859406bc10 msgr2=0x7f85941e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 shutdown_connections 2024-09-12T02:35:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.217+0000 7f859a40a640 1 -- 172.21.15.181:0/880611324 wait complete. 2024-09-12T02:35:36.229 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:35:36.229 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:36.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.326+0000 7fc4d305c640 1 Processor -- start 2024-09-12T02:35:36.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.326+0000 7fc4d305c640 1 -- start start 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.327+0000 7fc4d305c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0b3800 0x7fc4cc15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.327+0000 7fc4d305c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc4cc0d08f0 0x7fc4cc072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.327+0000 7fc4d305c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4cc0b2820 con 0x7fc4cc0d0510 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.327+0000 7fc4d305c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fc4cc0b2b00 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.327+0000 7fc4d305c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc4cc141730 con 0x7fc4cc0b3800 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.327+0000 7fc4c3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0b3800 0x7fc4cc15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4d15f9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc4cc0d08f0 0x7fc4cc072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4c3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0b3800 0x7fc4cc15ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:59334/0 (socket says 172.21.15.181:59334) 2024-09-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4c3fff640 1 -- 172.21.15.181:0/2081362584 learned_addr learned my addr 172.21.15.181:0/2081362584 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4d0df8640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fc4cc0d0510 0x7fc4cc0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:55836/0 (socket says 172.21.15.181:55836) 2024-09-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4c3fff640 1 -- 172.21.15.181:0/2081362584 >> v2:172.21.15.204:3300/0 conn(0x7fc4cc0d08f0 msgr2=0x7fc4cc072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4c3fff640 1 --2- 172.21.15.181:0/2081362584 >> v2:172.21.15.204:3300/0 conn(0x7fc4cc0d08f0 0x7fc4cc072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4c3fff640 1 -- 172.21.15.181:0/2081362584 >> v1:172.21.15.204:6789/0 conn(0x7fc4cc0d0510 legacy=0x7fc4cc0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4c3fff640 1 -- 172.21.15.181:0/2081362584 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc144320 con 0x7fc4cc0b3800 2024-09-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.328+0000 7fc4d15f9640 1 --2- 172.21.15.181:0/2081362584 >> v2:172.21.15.204:3300/0 conn(0x7fc4cc0d08f0 0x7fc4cc072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:36.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4c3fff640 1 --2- 172.21.15.181:0/2081362584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0b3800 0x7fc4cc15ef90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00aa10 tx=0x7fc4bc02b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51072d5c188815f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4c37fe640 1 -- 172.21.15.181:0/2081362584 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00b040 con 0x7fc4cc0b3800 2024-09-12T02:35:36.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4c37fe640 1 -- 172.21.15.181:0/2081362584 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc030710 con 0x7fc4cc0b3800 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4c37fe640 1 -- 172.21.15.181:0/2081362584 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc030ae0 con 0x7fc4cc0b3800 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 -- 172.21.15.181:0/2081362584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0b3800 msgr2=0x7fc4cc15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2081362584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0b3800 0x7fc4cc15ef90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00aa10 tx=0x7fc4bc02b610 comp rx=0 tx=0).stop 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 -- 172.21.15.181:0/2081362584 shutdown_connections 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2081362584 >> v2:172.21.15.204:3300/0 conn(0x7fc4cc0d08f0 0x7fc4cc072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2081362584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0b3800 0x7fc4cc15ef90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 -- 172.21.15.181:0/2081362584 >> 172.21.15.181:0/2081362584 conn(0x7fc4cc06bc10 msgr2=0x7fc4cc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 -- 172.21.15.181:0/2081362584 shutdown_connections 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.329+0000 7fc4d305c640 1 -- 172.21.15.181:0/2081362584 wait complete. 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.331+0000 7fc4d305c640 1 Processor -- start 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.331+0000 7fc4d305c640 1 -- start start 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4cc0b3800 0x7fc4cc153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0d0510 0x7fc4cc0c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4cc0d08f0 0x7fc4cc1f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc0b1df0 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc143e40 con 0x7fc4cc0b3800 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc4cc0b1f70 con 0x7fc4cc0d0510 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4cc0d08f0 0x7fc4cc1f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4cc0d08f0 0x7fc4cc1f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41596/0 (socket says 172.21.15.181:41596) 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 -- 172.21.15.181:0/2860348769 learned_addr learned my addr 172.21.15.181:0/2860348769 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4c3fff640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0d0510 0x7fc4cc0c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d0df8640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4cc0b3800 0x7fc4cc153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 -- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0d0510 msgr2=0x7fc4cc0c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0d0510 0x7fc4cc0c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 -- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4cc0b3800 msgr2=0x7fc4cc153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4cc0b3800 0x7fc4cc153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 -- 172.21.15.181:0/2860348769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc0caf60 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d15f9640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4cc0d08f0 0x7fc4cc1f3a30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009e10 tx=0x7fc4c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4c17fa640 1 -- 172.21.15.181:0/2860348769 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4018020 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4c17fa640 1 -- 172.21.15.181:0/2860348769 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4014480 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc1f3f70 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4c17fa640 1 -- 172.21.15.181:0/2860348769 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4014850 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.332+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc0c5ac0 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.333+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc0b23d0 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.334+0000 7fc4c17fa640 1 -- 172.21.15.181:0/2860348769 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4c4005d10 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.334+0000 7fc4c17fa640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.334+0000 7fc4c17fa640 1 -- 172.21.15.181:0/2860348769 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7fc4c408bac0 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.334+0000 7fc4d0df8640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.335+0000 7fc4d0df8640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc4b806be30 0x7fc4b806e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000f60 tx=0x7fc4c8007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.339+0000 7fc4c17fa640 1 -- 172.21.15.181:0/2860348769 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4c4022030 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.539+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4cc0cfb10 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.540+0000 7fc4c17fa640 1 -- 172.21.15.181:0/2860348769 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5234 (secure 0 0 0) 0x7fc4cc0caf60 con 0x7fc4cc0d08f0 2024-09-12T02:35:36.541 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:36.541 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"btime":"2024-09-12T02:35:28:436708+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:25.750512+0000","modified":"2024-09-12T02:35:27.765241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6834/1682794667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1682794667},{"type":"v1","addr":"172.21.15.204:6834","nonce":1682794667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6780,"qdb_cluster":[6780]},"id":5}]} 2024-09-12T02:35:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 63 2024-09-12T02:35:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc4b806be30 msgr2=0x7fc4b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc4b806be30 0x7fc4b806e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000f60 tx=0x7fc4c8007cc0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4cc0d08f0 msgr2=0x7fc4cc1f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4cc0d08f0 0x7fc4cc1f3a30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009e10 tx=0x7fc4c400c490 comp rx=0 tx=0).stop 2024-09-12T02:35:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 shutdown_connections 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4cc0d08f0 0x7fc4cc1f3a30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc4cc0d0510 0x7fc4cc0c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 --2- 172.21.15.181:0/2860348769 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc4cc0b3800 0x7fc4cc153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 >> 172.21.15.181:0/2860348769 conn(0x7fc4cc06bc10 msgr2=0x7fc4cc0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 shutdown_connections 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.542+0000 7fc4d305c640 1 -- 172.21.15.181:0/2860348769 wait complete. 2024-09-12T02:35:36.553 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:36.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.651+0000 7f7b2ef11640 1 Processor -- start 2024-09-12T02:35:36.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.651+0000 7f7b2ef11640 1 -- start start 2024-09-12T02:35:36.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2ef11640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7b2815c480 0x7f7b280cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2ef11640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7b280cf800 0x7f7b280b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2ef11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280b23c0 0x7f7b280cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2ef11640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7b280cf100 con 0x7f7b280cf800 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2ef11640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7b280cfc40 con 0x7f7b2815c480 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2ef11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7b280ce060 con 0x7f7b280b23c0 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7b280cf800 0x7f7b280b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7b280cf800 0x7f7b280b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41610/0 (socket says 172.21.15.181:41610) 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 -- 172.21.15.181:0/1440978362 learned_addr learned my addr 172.21.15.181:0/1440978362 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2ccad640 1 --2- 172.21.15.181:0/1440978362 >> v2:172.21.15.204:3300/0 conn(0x7f7b2815c480 0x7f7b280cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b2d4ae640 1 --2- 172.21.15.181:0/1440978362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280b23c0 0x7f7b280cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 -- 172.21.15.181:0/1440978362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280b23c0 msgr2=0x7f7b280cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 --2- 172.21.15.181:0/1440978362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280b23c0 0x7f7b280cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 -- 172.21.15.181:0/1440978362 >> v2:172.21.15.204:3300/0 conn(0x7f7b2815c480 msgr2=0x7f7b280cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 --2- 172.21.15.181:0/1440978362 >> v2:172.21.15.204:3300/0 conn(0x7f7b2815c480 0x7f7b280cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.652+0000 7f7b27fff640 1 -- 172.21.15.181:0/1440978362 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b280ce340 con 0x7f7b280cf800 2024-09-12T02:35:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.653+0000 7f7b27fff640 1 --2- 172.21.15.181:0/1440978362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b280cf800 0x7f7b280b1e80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7b280d1130 tx=0x7f7b1802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51228b1c215f271 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.653+0000 7f7b277fe640 1 -- 172.21.15.181:0/1440978362 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18036070 con 0x7f7b280cf800 2024-09-12T02:35:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.653+0000 7f7b277fe640 1 -- 172.21.15.181:0/1440978362 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18031600 con 0x7f7b280cf800 2024-09-12T02:35:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.653+0000 7f7b277fe640 1 -- 172.21.15.181:0/1440978362 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b180319d0 con 0x7f7b280cf800 2024-09-12T02:35:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 -- 172.21.15.181:0/1440978362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b280cf800 msgr2=0x7f7b280b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/1440978362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b280cf800 0x7f7b280b1e80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7b280d1130 tx=0x7f7b1802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 -- 172.21.15.181:0/1440978362 shutdown_connections 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/1440978362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280b23c0 0x7f7b280cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/1440978362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b280cf800 0x7f7b280b1e80 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/1440978362 >> v2:172.21.15.204:3300/0 conn(0x7f7b2815c480 0x7f7b280cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 -- 172.21.15.181:0/1440978362 >> 172.21.15.181:0/1440978362 conn(0x7f7b2806bc10 msgr2=0x7f7b2806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 -- 172.21.15.181:0/1440978362 shutdown_connections 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.654+0000 7f7b2ef11640 1 -- 172.21.15.181:0/1440978362 wait complete. 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.655+0000 7f7b2ef11640 1 Processor -- start 2024-09-12T02:35:36.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.655+0000 7f7b2ef11640 1 -- start start 2024-09-12T02:35:36.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2ef11640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b280b23c0 0x7f7b281f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2ef11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280cf800 0x7f7b280b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2ef11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b2815c480 0x7f7b280b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2ef11640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7b280cebe0 con 0x7f7b2815c480 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2ef11640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7b280ce900 con 0x7f7b280b23c0 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2ef11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7b280b2850 con 0x7f7b280cf800 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b2815c480 0x7f7b280b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b2815c480 0x7f7b280b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41616/0 (socket says 172.21.15.181:41616) 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 -- 172.21.15.181:0/4115881579 learned_addr learned my addr 172.21.15.181:0/4115881579 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2ccad640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b280b23c0 0x7f7b281f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b27fff640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280cf800 0x7f7b280b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 -- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280cf800 msgr2=0x7f7b280b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280cf800 0x7f7b280b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 -- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b280b23c0 msgr2=0x7f7b281f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b280b23c0 0x7f7b281f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.656+0000 7f7b2d4ae640 1 -- 172.21.15.181:0/4115881579 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b281e5980 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.657+0000 7f7b2d4ae640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b2815c480 0x7f7b280b0680 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000d800 tx=0x7f7b1000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.657+0000 7f7b257fa640 1 -- 172.21.15.181:0/4115881579 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000b6c0 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.657+0000 7f7b257fa640 1 -- 172.21.15.181:0/4115881579 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b10019070 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.657+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b280ac5e0 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.657+0000 7f7b257fa640 1 -- 172.21.15.181:0/4115881579 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000bac0 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.657+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b280acba0 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.658+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b280b1e80 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.658+0000 7f7b257fa640 1 -- 172.21.15.181:0/4115881579 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b1000bc60 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.658+0000 7f7b257fa640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7b0806be30 0x7f7b0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.659+0000 7f7b257fa640 1 -- 172.21.15.181:0/4115881579 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f7b1008b240 con 0x7f7b2815c480 2024-09-12T02:35:36.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.659+0000 7f7b2ccad640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7b0806be30 0x7f7b0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.659+0000 7f7b2ccad640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7b0806be30 0x7f7b0806e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007920 tx=0x7f7b20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.663+0000 7f7b257fa640 1 -- 172.21.15.181:0/4115881579 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b10059bf0 con 0x7f7b2815c480 2024-09-12T02:35:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.864+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b280732a0 con 0x7f7b2815c480 2024-09-12T02:35:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.864+0000 7f7b257fa640 1 -- 172.21.15.181:0/4115881579 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5234 (secure 0 0 0) 0x7f7b100594f0 con 0x7f7b2815c480 2024-09-12T02:35:36.865 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:36.866 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":63,"btime":"2024-09-12T02:35:28:436708+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:25.750512+0000","modified":"2024-09-12T02:35:27.765241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6834/1682794667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":1682794667},{"type":"v1","addr":"172.21.15.204:6834","nonce":1682794667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6780,"qdb_cluster":[6780]},"id":5}]} 2024-09-12T02:35:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 63 2024-09-12T02:35:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.866+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7b0806be30 msgr2=0x7f7b0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.866+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7b0806be30 0x7f7b0806e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007920 tx=0x7f7b20008040 comp rx=0 tx=0).stop 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.866+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b2815c480 msgr2=0x7f7b280b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.866+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b2815c480 0x7f7b280b0680 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000d800 tx=0x7f7b1000dcc0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 shutdown_connections 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7b0806be30 0x7f7b0806e2f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b2815c480 0x7f7b280b0680 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b280cf800 0x7f7b280b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 --2- 172.21.15.181:0/4115881579 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b280b23c0 0x7f7b281f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 >> 172.21.15.181:0/4115881579 conn(0x7f7b2806bc10 msgr2=0x7f7b28072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 shutdown_connections 2024-09-12T02:35:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.867+0000 7f7b2ef11640 1 -- 172.21.15.181:0/4115881579 wait complete. 2024-09-12T02:35:36.878 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:36.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.977+0000 7fdc5d9a6640 1 Processor -- start 2024-09-12T02:35:36.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.977+0000 7fdc5d9a6640 1 -- start start 2024-09-12T02:35:36.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc5d9a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc580ceaf0 0x7fdc580cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc5d9a6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc580b5320 0x7fdc580b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc5d9a6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc580731d0 con 0x7fdc5815e670 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc5d9a6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdc580d0040 con 0x7fdc580b5320 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc5d9a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdc580cf490 con 0x7fdc580ceaf0 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc577fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc580b5320 0x7fdc580b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc577fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdc580b5320 0x7fdc580b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41622/0 (socket says 172.21.15.181:41622) 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc56ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdc5815e670 0x7fdc58070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53716/0 (socket says 172.21.15.181:53716) 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc577fe640 1 -- 172.21.15.181:0/3252754343 learned_addr learned my addr 172.21.15.181:0/3252754343 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc567fc640 1 --2- 172.21.15.181:0/3252754343 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc580ceaf0 0x7fdc580cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc577fe640 1 -- 172.21.15.181:0/3252754343 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc580ceaf0 msgr2=0x7fdc580cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc577fe640 1 --2- 172.21.15.181:0/3252754343 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc580ceaf0 0x7fdc580cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc577fe640 1 -- 172.21.15.181:0/3252754343 >> v1:172.21.15.181:6789/0 conn(0x7fdc5815e670 legacy=0x7fdc58070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc55ffb640 1 -- 172.21.15.181:0/3252754343 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3358502242 0 0) 0x7fdc580731d0 con 0x7fdc5815e670 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.978+0000 7fdc577fe640 1 -- 172.21.15.181:0/3252754343 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580734b0 con 0x7fdc580b5320 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.979+0000 7fdc577fe640 1 --2- 172.21.15.181:0/3252754343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580b5320 0x7fdc580b57d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009870 tx=0x7fdc5002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3049fb43d0f8ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.979+0000 7fdc55ffb640 1 -- 172.21.15.181:0/3252754343 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50037070 con 0x7fdc580b5320 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.979+0000 7fdc55ffb640 1 -- 172.21.15.181:0/3252754343 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5002ae50 con 0x7fdc580b5320 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.979+0000 7fdc55ffb640 1 -- 172.21.15.181:0/3252754343 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50032860 con 0x7fdc580b5320 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/3252754343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580b5320 msgr2=0x7fdc580b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/3252754343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580b5320 0x7fdc580b57d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009870 tx=0x7fdc5002a300 comp rx=0 tx=0).stop 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/3252754343 shutdown_connections 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/3252754343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580b5320 0x7fdc580b57d0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/3252754343 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc580ceaf0 0x7fdc580cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/3252754343 >> 172.21.15.181:0/3252754343 conn(0x7fdc5806f400 msgr2=0x7fdc5806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/3252754343 shutdown_connections 2024-09-12T02:35:36.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.980+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/3252754343 wait complete. 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.981+0000 7fdc5d9a6640 1 Processor -- start 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.981+0000 7fdc5d9a6640 1 -- start start 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc5d9a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc580b5320 0x7fdc581518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc5d9a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580ceaf0 0x7fdc580d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc5d9a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5815e670 0x7fdc58160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc5d9a6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58072f80 con 0x7fdc580ceaf0 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc5d9a6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815fa60 con 0x7fdc580b5320 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc5d9a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdc58073de0 con 0x7fdc5815e670 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580ceaf0 0x7fdc580d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580ceaf0 0x7fdc580d1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41630/0 (socket says 172.21.15.181:41630) 2024-09-12T02:35:36.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 -- 172.21.15.181:0/82479724 learned_addr learned my addr 172.21.15.181:0/82479724 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc56ffd640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc580b5320 0x7fdc581518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc577fe640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5815e670 0x7fdc58160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 -- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5815e670 msgr2=0x7fdc58160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5815e670 0x7fdc58160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 -- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc580b5320 msgr2=0x7fdc581518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc580b5320 0x7fdc581518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 -- 172.21.15.181:0/82479724 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc58151e30 con 0x7fdc580ceaf0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc567fc640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580ceaf0 0x7fdc580d1bd0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00d7d0 tx=0x7fdc4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc3ffff640 1 -- 172.21.15.181:0/82479724 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c004020 con 0x7fdc580ceaf0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc3ffff640 1 -- 172.21.15.181:0/82479724 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0041e0 con 0x7fdc580ceaf0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.982+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc580d24b0 con 0x7fdc580ceaf0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.983+0000 7fdc3ffff640 1 -- 172.21.15.181:0/82479724 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0043d0 con 0x7fdc580ceaf0 2024-09-12T02:35:36.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.983+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc580aed90 con 0x7fdc580ceaf0 2024-09-12T02:35:36.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.984+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc580ae8a0 con 0x7fdc580ceaf0 2024-09-12T02:35:36.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.984+0000 7fdc3ffff640 1 -- 172.21.15.181:0/82479724 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc4c01b020 con 0x7fdc580ceaf0 2024-09-12T02:35:36.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.984+0000 7fdc3ffff640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc4406be30 0x7fdc4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.985+0000 7fdc3ffff640 1 -- 172.21.15.181:0/82479724 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7fdc4c08aaa0 con 0x7fdc580ceaf0 2024-09-12T02:35:36.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.985+0000 7fdc56ffd640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc4406be30 0x7fdc4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.985+0000 7fdc56ffd640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc4406be30 0x7fdc4406e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdc480012e0 tx=0x7fdc48001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:36.989+0000 7fdc3ffff640 1 -- 172.21.15.181:0/82479724 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc4c058e90 con 0x7fdc580ceaf0 2024-09-12T02:35:37.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.156+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc580b1bf0 con 0x7fdc580ceaf0 2024-09-12T02:35:37.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.157+0000 7fdc3ffff640 1 -- 172.21.15.181:0/82479724 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16800 (secure 0 0 0) 0x7fdc4c05d190 con 0x7fdc580ceaf0 2024-09-12T02:35:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:37.158 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":75,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:27.429904+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:24.367784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:24.724437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:37.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc4406be30 msgr2=0x7fdc4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc4406be30 0x7fdc4406e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdc480012e0 tx=0x7fdc48001630 comp rx=0 tx=0).stop 2024-09-12T02:35:37.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580ceaf0 msgr2=0x7fdc580d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580ceaf0 0x7fdc580d1bd0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00d7d0 tx=0x7fdc4c00dc90 comp rx=0 tx=0).stop 2024-09-12T02:35:37.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 shutdown_connections 2024-09-12T02:35:37.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdc4406be30 0x7fdc4406e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5815e670 0x7fdc58160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc580ceaf0 0x7fdc580d1bd0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 --2- 172.21.15.181:0/82479724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc580b5320 0x7fdc581518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 >> 172.21.15.181:0/82479724 conn(0x7fdc5806f400 msgr2=0x7fdc580b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 shutdown_connections 2024-09-12T02:35:37.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.159+0000 7fdc5d9a6640 1 -- 172.21.15.181:0/82479724 wait complete. 2024-09-12T02:35:37.172 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:35:37.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.269+0000 7f4598de8640 1 Processor -- start 2024-09-12T02:35:37.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.269+0000 7f4598de8640 1 -- start start 2024-09-12T02:35:37.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.270+0000 7f4598de8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940afc70 0x7f459415f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.270+0000 7f4598de8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f45940cf200 0x7f45940cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.270+0000 7f4598de8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45940ce430 con 0x7f45940ce020 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.270+0000 7f4598de8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f459415f950 con 0x7f45940cf200 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.270+0000 7f4598de8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f45940cf780 con 0x7f45940afc70 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f4592d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f45940ce020 0x7f4594154c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53732/0 (socket says 172.21.15.181:53732) 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f4592d9d640 1 -- 172.21.15.181:0/4256486552 learned_addr learned my addr 172.21.15.181:0/4256486552 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f4591d9b640 1 --2- 172.21.15.181:0/4256486552 >> v2:172.21.15.204:3300/0 conn(0x7f45940cf200 0x7f45940cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f459259c640 1 --2- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940afc70 0x7f459415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f459159a640 1 -- 172.21.15.181:0/4256486552 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698801828 0 0) 0x7f458c001490 con 0x7f45940ce020 2024-09-12T02:35:37.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f459159a640 1 -- 172.21.15.181:0/4256486552 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f457c003520 con 0x7f45940ce020 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f4591d9b640 1 -- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940afc70 msgr2=0x7f459415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f4591d9b640 1 --2- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940afc70 0x7f459415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f4591d9b640 1 -- 172.21.15.181:0/4256486552 >> v1:172.21.15.181:6789/0 conn(0x7f45940ce020 legacy=0x7f4594154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.271+0000 7f4591d9b640 1 -- 172.21.15.181:0/4256486552 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45940cfa60 con 0x7f45940cf200 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.272+0000 7f4591d9b640 1 --2- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 0x7f45940cdae0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f45880097a0 tx=0x7f458802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7794ceecb6e8da6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.272+0000 7f459159a640 1 -- 172.21.15.181:0/4256486552 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588037070 con 0x7f45940cf200 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.272+0000 7f459159a640 1 -- 172.21.15.181:0/4256486552 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4588032440 con 0x7f45940cf200 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.272+0000 7f459159a640 1 -- 172.21.15.181:0/4256486552 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880327f0 con 0x7f45940cf200 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.272+0000 7f4598de8640 1 -- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 msgr2=0x7f45940cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.272+0000 7f4598de8640 1 --2- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 0x7f45940cdae0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f45880097a0 tx=0x7f458802a180 comp rx=0 tx=0).stop 2024-09-12T02:35:37.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.273+0000 7f4598de8640 1 -- 172.21.15.181:0/4256486552 shutdown_connections 2024-09-12T02:35:37.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.273+0000 7f4598de8640 1 --2- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 0x7f45940cdae0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.273+0000 7f4598de8640 1 --2- 172.21.15.181:0/4256486552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940afc70 0x7f459415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.273+0000 7f4598de8640 1 -- 172.21.15.181:0/4256486552 >> 172.21.15.181:0/4256486552 conn(0x7f45940b1770 msgr2=0x7f45940b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.273+0000 7f4598de8640 1 -- 172.21.15.181:0/4256486552 shutdown_connections 2024-09-12T02:35:37.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.273+0000 7f4598de8640 1 -- 172.21.15.181:0/4256486552 wait complete. 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.274+0000 7f4598de8640 1 Processor -- start 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.274+0000 7f4598de8640 1 -- start start 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45940afc70 0x7f4594147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940ce020 0x7f45940ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 0x7f45940adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45940d0300 con 0x7f45940afc70 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f45940d0020 con 0x7f45940cf200 2024-09-12T02:35:37.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f45940b0050 con 0x7f45940ce020 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45940afc70 0x7f4594147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45940afc70 0x7f4594147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41638/0 (socket says 172.21.15.181:41638) 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 -- 172.21.15.181:0/3216809124 learned_addr learned my addr 172.21.15.181:0/3216809124 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4591d9b640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940ce020 0x7f45940ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4592d9d640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 0x7f45940adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 -- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940ce020 msgr2=0x7f45940ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940ce020 0x7f45940ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 -- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 msgr2=0x7f45940adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 0x7f45940adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 -- 172.21.15.181:0/3216809124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45940ab630 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f459259c640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45940afc70 0x7f4594147920 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f458400e870 tx=0x7f458400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4582ffd640 1 -- 172.21.15.181:0/3216809124 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4584017070 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4582ffd640 1 -- 172.21.15.181:0/3216809124 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458400c940 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45940ab910 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4582ffd640 1 -- 172.21.15.181:0/3216809124 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458400cd30 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.275+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45940abed0 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.276+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459415e840 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.277+0000 7f4582ffd640 1 -- 172.21.15.181:0/3216809124 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f458401a070 con 0x7f45940afc70 2024-09-12T02:35:37.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.277+0000 7f4582ffd640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f457406be30 0x7f457406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.277+0000 7f4582ffd640 1 -- 172.21.15.181:0/3216809124 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f458408b040 con 0x7f45940afc70 2024-09-12T02:35:37.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.277+0000 7f4591d9b640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f457406be30 0x7f457406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.278+0000 7f4591d9b640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f457406be30 0x7f457406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4588034000 tx=0x7f458802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.281+0000 7f4582ffd640 1 -- 172.21.15.181:0/3216809124 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f459415e840 con 0x7f45940afc70 2024-09-12T02:35:37.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.480+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4594069ac0 con 0x7f45940afc70 2024-09-12T02:35:37.481 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:35:37.481+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:35:37.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.482+0000 7f4582ffd640 1 -- 172.21.15.181:0/3216809124 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7f4594069ac0 con 0x7f45940afc70 2024-09-12T02:35:37.483 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:35:37.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f457406be30 msgr2=0x7f457406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f457406be30 0x7f457406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4588034000 tx=0x7f458802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:37.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45940afc70 msgr2=0x7f4594147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45940afc70 0x7f4594147920 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f458400e870 tx=0x7f458400ed30 comp rx=0 tx=0).stop 2024-09-12T02:35:37.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 shutdown_connections 2024-09-12T02:35:37.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f457406be30 0x7f457406e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45940cf200 0x7f45940adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45940ce020 0x7f45940ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 --2- 172.21.15.181:0/3216809124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45940afc70 0x7f4594147920 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 >> 172.21.15.181:0/3216809124 conn(0x7f45940b1770 msgr2=0x7f45941617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 shutdown_connections 2024-09-12T02:35:37.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.485+0000 7f4598de8640 1 -- 172.21.15.181:0/3216809124 wait complete. 2024-09-12T02:35:37.487 INFO:tasks.ceph.mds.b.smithi204.stderr: -1404> 2024-09-12T02:35:27.680+0000 7f94dcb1b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:35:37.497 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:35:37.517 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:35:37.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.596+0000 7f932be3c640 1 Processor -- start 2024-09-12T02:35:37.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.596+0000 7f932be3c640 1 -- start start 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.597+0000 7f932be3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f932406fd20 0x7f932415b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.597+0000 7f932be3c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f932415be80 0x7f93240b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.597+0000 7f932be3c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93240b6120 con 0x7f93240b5d40 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.597+0000 7f932be3c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f93240729a0 con 0x7f932415be80 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.597+0000 7f932be3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9324072070 con 0x7f932406fd20 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.597+0000 7f9329bd8640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f93240b5d40 0x7f932406f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53738/0 (socket says 172.21.15.181:53738) 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.597+0000 7f9329bd8640 1 -- 172.21.15.181:0/2012281402 learned_addr learned my addr 172.21.15.181:0/2012281402 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f932a3d9640 1 --2- 172.21.15.181:0/2012281402 >> v2:172.21.15.204:3300/0 conn(0x7f932415be80 0x7f93240b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f9328bd6640 1 -- 172.21.15.181:0/2012281402 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782983883 0 0) 0x7f9320001110 con 0x7f93240b5d40 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f93293d7640 1 --2- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f932406fd20 0x7f932415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f9328bd6640 1 -- 172.21.15.181:0/2012281402 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9310003520 con 0x7f93240b5d40 2024-09-12T02:35:37.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f932a3d9640 1 -- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f932406fd20 msgr2=0x7f932415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:37.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f932a3d9640 1 --2- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f932406fd20 0x7f932415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f932a3d9640 1 -- 172.21.15.181:0/2012281402 >> v1:172.21.15.181:6789/0 conn(0x7f93240b5d40 legacy=0x7f932406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f9328bd6640 1 -- 172.21.15.181:0/2012281402 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4041330779 0 0) 0x7f9310003520 con 0x7f93240b5d40 2024-09-12T02:35:37.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.598+0000 7f932a3d9640 1 -- 172.21.15.181:0/2012281402 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9324072350 con 0x7f932415be80 2024-09-12T02:35:37.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f932a3d9640 1 --2- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932415be80 0x7f93240b42a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f931c00bfa0 tx=0x7f931c02c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fbc6207b29fe786 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f9328bd6640 1 -- 172.21.15.181:0/2012281402 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c038070 con 0x7f932415be80 2024-09-12T02:35:37.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f9328bd6640 1 -- 172.21.15.181:0/2012281402 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c00b2e0 con 0x7f932415be80 2024-09-12T02:35:37.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f9328bd6640 1 -- 172.21.15.181:0/2012281402 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320001840 con 0x7f932415be80 2024-09-12T02:35:37.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f932be3c640 1 -- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932415be80 msgr2=0x7f93240b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f932be3c640 1 --2- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932415be80 0x7f93240b42a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f931c00bfa0 tx=0x7f931c02c7f0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f932be3c640 1 -- 172.21.15.181:0/2012281402 shutdown_connections 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f932be3c640 1 --2- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932415be80 0x7f93240b42a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f932be3c640 1 --2- 172.21.15.181:0/2012281402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f932406fd20 0x7f932415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.599+0000 7f932be3c640 1 -- 172.21.15.181:0/2012281402 >> 172.21.15.181:0/2012281402 conn(0x7f93240b2fa0 msgr2=0x7f93240b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.600+0000 7f932be3c640 1 -- 172.21.15.181:0/2012281402 shutdown_connections 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.600+0000 7f932be3c640 1 -- 172.21.15.181:0/2012281402 wait complete. 2024-09-12T02:35:37.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 Processor -- start 2024-09-12T02:35:37.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 -- start start 2024-09-12T02:35:37.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932406fd20 0x7f932415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93240b5d40 0x7f93240b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932415be80 0x7f93240b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9324072e30 con 0x7f932415be80 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f932415c330 con 0x7f932406fd20 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.601+0000 7f932be3c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f93240b0160 con 0x7f93240b5d40 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932415be80 0x7f93240b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932415be80 0x7f93240b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41644/0 (socket says 172.21.15.181:41644) 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 -- 172.21.15.181:0/3278796656 learned_addr learned my addr 172.21.15.181:0/3278796656 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f9329bd8640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932406fd20 0x7f932415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f93293d7640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93240b5d40 0x7f93240b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 -- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93240b5d40 msgr2=0x7f93240b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93240b5d40 0x7f93240b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 -- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932406fd20 msgr2=0x7f932415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932406fd20 0x7f932415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 -- 172.21.15.181:0/3278796656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93240afe80 con 0x7f932415be80 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f9329bd8640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932406fd20 0x7f932415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932a3d9640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932415be80 0x7f93240b24f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f931c036040 tx=0x7f931c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f931a7fc640 1 -- 172.21.15.181:0/3278796656 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c038050 con 0x7f932415be80 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f931a7fc640 1 -- 172.21.15.181:0/3278796656 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c039040 con 0x7f932415be80 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93240acdf0 con 0x7f932415be80 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f931a7fc640 1 -- 172.21.15.181:0/3278796656 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c00b660 con 0x7f932415be80 2024-09-12T02:35:37.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.602+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93240ad3b0 con 0x7f932415be80 2024-09-12T02:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.603+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f932415b940 con 0x7f932415be80 2024-09-12T02:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.604+0000 7f931a7fc640 1 -- 172.21.15.181:0/3278796656 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f931c046020 con 0x7f932415be80 2024-09-12T02:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.604+0000 7f931a7fc640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f930806be30 0x7f930806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.604+0000 7f9329bd8640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f930806be30 0x7f930806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.604+0000 7f931a7fc640 1 -- 172.21.15.181:0/3278796656 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5795+0+0 (secure 0 0 0) 0x7f931c0acf70 con 0x7f932415be80 2024-09-12T02:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.605+0000 7f9329bd8640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f930806be30 0x7f930806e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9320000f60 tx=0x7f93200016b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.609+0000 7f931a7fc640 1 -- 172.21.15.181:0/3278796656 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f931c04d020 con 0x7f932415be80 2024-09-12T02:35:37.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:37.809+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9324072fb0 con 0x7f932415be80 2024-09-12T02:35:38.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.486+0000 7f931a7fc640 1 -- 172.21.15.181:0/3278796656 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7f931c07b300 con 0x7f932415be80 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f930806be30 msgr2=0x7f930806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f930806be30 0x7f930806e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9320000f60 tx=0x7f93200016b0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932415be80 msgr2=0x7f93240b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932415be80 0x7f93240b24f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f931c036040 tx=0x7f931c004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 shutdown_connections 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f930806be30 0x7f930806e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932415be80 0x7f93240b24f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f93240b5d40 0x7f93240b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 --2- 172.21.15.181:0/3278796656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f932406fd20 0x7f932415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 >> 172.21.15.181:0/3278796656 conn(0x7f93240b2fa0 msgr2=0x7f93240b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:38.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 shutdown_connections 2024-09-12T02:35:38.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.489+0000 7f932be3c640 1 -- 172.21.15.181:0/3278796656 wait complete. 2024-09-12T02:35:38.503 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:35:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.611+0000 7f491ec2e640 1 Processor -- start 2024-09-12T02:35:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.611+0000 7f491ec2e640 1 -- start start 2024-09-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491ec2e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f491815e6b0 0x7f49180d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491ec2e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f49180b3fb0 0x7f49180b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491ec2e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491806db30 con 0x7f491806d630 2024-09-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491ec2e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f49180d0490 con 0x7f491815e6b0 2024-09-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491ec2e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f49180d0770 con 0x7f49180b3fb0 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491c9ca640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f491815e6b0 0x7f49180d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f490ffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f491806d630 0x7f4918073b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53748/0 (socket says 172.21.15.181:53748) 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f490ffff640 1 -- 172.21.15.181:0/689679140 learned_addr learned my addr 172.21.15.181:0/689679140 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491c9ca640 1 -- 172.21.15.181:0/689679140 >> v2:172.21.15.204:3300/0 conn(0x7f49180b3fb0 msgr2=0x7f49180b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491c9ca640 1 --2- 172.21.15.181:0/689679140 >> v2:172.21.15.204:3300/0 conn(0x7f49180b3fb0 0x7f49180b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491c9ca640 1 -- 172.21.15.181:0/689679140 >> v1:172.21.15.181:6789/0 conn(0x7f491806d630 legacy=0x7f4918073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f491c9ca640 1 -- 172.21.15.181:0/689679140 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49180d0180 con 0x7f491815e6b0 2024-09-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.612+0000 7f490f7fe640 1 -- 172.21.15.181:0/689679140 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222047369 0 0) 0x7f491806db30 con 0x7f491806d630 2024-09-12T02:35:38.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.613+0000 7f491c9ca640 1 --2- 172.21.15.181:0/689679140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f49180d0f70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f49180b4b90 tx=0x7f491402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b4e9f7c206482e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.613+0000 7f490f7fe640 1 -- 172.21.15.181:0/689679140 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914037070 con 0x7f491815e6b0 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.613+0000 7f490f7fe640 1 -- 172.21.15.181:0/689679140 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4914032440 con 0x7f491815e6b0 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.613+0000 7f490f7fe640 1 -- 172.21.15.181:0/689679140 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914032810 con 0x7f491815e6b0 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 -- 172.21.15.181:0/689679140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 msgr2=0x7f49180d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 --2- 172.21.15.181:0/689679140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f49180d0f70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f49180b4b90 tx=0x7f491402a230 comp rx=0 tx=0).stop 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 -- 172.21.15.181:0/689679140 shutdown_connections 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 --2- 172.21.15.181:0/689679140 >> v2:172.21.15.204:3300/0 conn(0x7f49180b3fb0 0x7f49180b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 --2- 172.21.15.181:0/689679140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f49180d0f70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 -- 172.21.15.181:0/689679140 >> 172.21.15.181:0/689679140 conn(0x7f4918067950 msgr2=0x7f4918067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 -- 172.21.15.181:0/689679140 shutdown_connections 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.614+0000 7f491ec2e640 1 -- 172.21.15.181:0/689679140 wait complete. 2024-09-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.615+0000 7f491ec2e640 1 Processor -- start 2024-09-12T02:35:38.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.615+0000 7f491ec2e640 1 -- start start 2024-09-12T02:35:38.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491ec2e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f491806d630 0x7f49181f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491ec2e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49180b3fb0 0x7f4918155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491ec2e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f491814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491ec2e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49180b5320 con 0x7f491815e6b0 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491ec2e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f49180d14b0 con 0x7f49180b3fb0 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491ec2e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f49180b54a0 con 0x7f491806d630 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f491814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f491814a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41660/0 (socket says 172.21.15.181:41660) 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 -- 172.21.15.181:0/4274449231 learned_addr learned my addr 172.21.15.181:0/4274449231 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f490ffff640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49180b3fb0 0x7f4918155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491c9ca640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f491806d630 0x7f49181f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 -- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f491806d630 msgr2=0x7f49181f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f491806d630 0x7f49181f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 -- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49180b3fb0 msgr2=0x7f4918155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49180b3fb0 0x7f4918155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 -- 172.21.15.181:0/4274449231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49181f56c0 con 0x7f491815e6b0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.616+0000 7f491d1cb640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f491814a6c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f491000b970 tx=0x7f491000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.617+0000 7f490d7fa640 1 -- 172.21.15.181:0/4274449231 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910019070 con 0x7f491815e6b0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.617+0000 7f490d7fa640 1 -- 172.21.15.181:0/4274449231 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491000cb60 con 0x7f491815e6b0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.617+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4918160210 con 0x7f491815e6b0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.617+0000 7f490d7fa640 1 -- 172.21.15.181:0/4274449231 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910014440 con 0x7f491815e6b0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.617+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49181607d0 con 0x7f491815e6b0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.618+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49180b3dd0 con 0x7f491815e6b0 2024-09-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.618+0000 7f490d7fa640 1 -- 172.21.15.181:0/4274449231 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f491001c070 con 0x7f491815e6b0 2024-09-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.618+0000 7f490d7fa640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f490406be60 0x7f490406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.619+0000 7f490d7fa640 1 -- 172.21.15.181:0/4274449231 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5795+0+0 (secure 0 0 0) 0x7f491008aab0 con 0x7f491815e6b0 2024-09-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.619+0000 7f491c9ca640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f490406be60 0x7f490406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.619+0000 7f491c9ca640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f490406be60 0x7f490406e320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4914034000 tx=0x7f491402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.623+0000 7f490d7fa640 1 -- 172.21.15.181:0/4274449231 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49180b3dd0 con 0x7f491815e6b0 2024-09-12T02:35:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:38.788+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49180d0f50 con 0x7f491815e6b0 2024-09-12T02:35:39.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.488+0000 7f490d7fa640 1 -- 172.21.15.181:0/4274449231 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f4910058e40 con 0x7f491815e6b0 2024-09-12T02:35:39.489 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f490406be60 msgr2=0x7f490406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f490406be60 0x7f490406e320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4914034000 tx=0x7f491402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 msgr2=0x7f491814a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f491814a6c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f491000b970 tx=0x7f491000be30 comp rx=0 tx=0).stop 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 shutdown_connections 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f490406be60 0x7f490406e320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49180b3fb0 0x7f4918155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f491815e6b0 0x7f491814a6c0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 --2- 172.21.15.181:0/4274449231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f491806d630 0x7f49181f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 >> 172.21.15.181:0/4274449231 conn(0x7f4918067950 msgr2=0x7f4918073050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 shutdown_connections 2024-09-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.491+0000 7f491ec2e640 1 -- 172.21.15.181:0/4274449231 wait complete. 2024-09-12T02:35:39.505 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:35:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.608+0000 7fd96eed0640 1 Processor -- start 2024-09-12T02:35:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.608+0000 7fd96eed0640 1 -- start start 2024-09-12T02:35:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96eed0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd96815b230 0x7fd9680b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96eed0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd96815f580 0x7fd968071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96eed0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd968070fc0 con 0x7fd9680b3ff0 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96eed0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd9680718b0 con 0x7fd96815b230 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96eed0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd96815fb80 con 0x7fd96815f580 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96cc6c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd96815b230 0x7fd9680b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96cc6c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd96815b230 0x7fd9680b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37654/0 (socket says 172.21.15.181:37654) 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96cc6c640 1 -- 172.21.15.181:0/3700761375 learned_addr learned my addr 172.21.15.181:0/3700761375 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96cc6c640 1 -- 172.21.15.181:0/3700761375 >> v2:172.21.15.204:3300/0 conn(0x7fd96815f580 msgr2=0x7fd968071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96cc6c640 1 --2- 172.21.15.181:0/3700761375 >> v2:172.21.15.204:3300/0 conn(0x7fd96815f580 0x7fd968071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96cc6c640 1 -- 172.21.15.181:0/3700761375 >> v1:172.21.15.204:6789/0 conn(0x7fd9680b3ff0 legacy=0x7fd96815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.609+0000 7fd96cc6c640 1 -- 172.21.15.181:0/3700761375 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd968071260 con 0x7fd96815b230 2024-09-12T02:35:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.610+0000 7fd96cc6c640 1 --2- 172.21.15.181:0/3700761375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9680b3ab0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd9680d1130 tx=0x7fd95002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcdee63ca862e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.610+0000 7fd9677fe640 1 -- 172.21.15.181:0/3700761375 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950037070 con 0x7fd96815b230 2024-09-12T02:35:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.610+0000 7fd9677fe640 1 -- 172.21.15.181:0/3700761375 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd950032440 con 0x7fd96815b230 2024-09-12T02:35:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.610+0000 7fd9677fe640 1 -- 172.21.15.181:0/3700761375 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950032810 con 0x7fd96815b230 2024-09-12T02:35:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 -- 172.21.15.181:0/3700761375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 msgr2=0x7fd9680b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 --2- 172.21.15.181:0/3700761375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9680b3ab0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd9680d1130 tx=0x7fd95002a230 comp rx=0 tx=0).stop 2024-09-12T02:35:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 -- 172.21.15.181:0/3700761375 shutdown_connections 2024-09-12T02:35:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 --2- 172.21.15.181:0/3700761375 >> v2:172.21.15.204:3300/0 conn(0x7fd96815f580 0x7fd968071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 --2- 172.21.15.181:0/3700761375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9680b3ab0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 -- 172.21.15.181:0/3700761375 >> 172.21.15.181:0/3700761375 conn(0x7fd96806bc10 msgr2=0x7fd96806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 -- 172.21.15.181:0/3700761375 shutdown_connections 2024-09-12T02:35:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.611+0000 7fd96eed0640 1 -- 172.21.15.181:0/3700761375 wait complete. 2024-09-12T02:35:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.612+0000 7fd96eed0640 1 Processor -- start 2024-09-12T02:35:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.612+0000 7fd96eed0640 1 -- start start 2024-09-12T02:35:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96eed0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9680b3ff0 0x7fd9680c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96eed0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9681f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96eed0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd96815f580 0x7fd968157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96eed0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd96815b610 con 0x7fd96815b230 2024-09-12T02:35:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96eed0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd9680b4410 con 0x7fd9680b3ff0 2024-09-12T02:35:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96eed0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd968072280 con 0x7fd96815f580 2024-09-12T02:35:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9681f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9681f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37658/0 (socket says 172.21.15.181:37658) 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 -- 172.21.15.181:0/2268913799 learned_addr learned my addr 172.21.15.181:0/2268913799 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96cc6c640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9680b3ff0 0x7fd9680c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd96d46d640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd96815f580 0x7fd968157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 -- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd96815f580 msgr2=0x7fd968157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd96815f580 0x7fd968157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 -- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9680b3ff0 msgr2=0x7fd9680c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9680b3ff0 0x7fd9680c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.613+0000 7fd967fff640 1 -- 172.21.15.181:0/2268913799 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9680c5610 con 0x7fd96815b230 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.614+0000 7fd967fff640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9681f65c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c7a0 tx=0x7fd95800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.614+0000 7fd9657fa640 1 -- 172.21.15.181:0/2268913799 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958017070 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.614+0000 7fd9657fa640 1 -- 172.21.15.181:0/2268913799 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd958003da0 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.614+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9680c5aa0 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.614+0000 7fd9657fa640 1 -- 172.21.15.181:0/2268913799 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580052b0 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.614+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd968158260 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.615+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd968069170 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.615+0000 7fd9657fa640 1 -- 172.21.15.181:0/2268913799 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd95801a070 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.616+0000 7fd9657fa640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.616+0000 7fd96cc6c640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.616+0000 7fd9657fa640 1 -- 172.21.15.181:0/2268913799 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5357+0+0 (secure 0 0 0) 0x7fd95808a2f0 con 0x7fd96815b230 2024-09-12T02:35:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.616+0000 7fd96cc6c640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd950034000 tx=0x7fd95002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.620+0000 7fd9657fa640 1 -- 172.21.15.181:0/2268913799 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd958058840 con 0x7fd96815b230 2024-09-12T02:35:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:39.785+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd9680b3ab0 con 0x7fd96815b230 2024-09-12T02:35:40.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.493+0000 7fd9657fa640 1 -- 172.21.15.181:0/2268913799 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7fd95805cb40 con 0x7fd96815b230 2024-09-12T02:35:40.494 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' removed 2024-09-12T02:35:40.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 msgr2=0x7fd94806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd950034000 tx=0x7fd95002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:40.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 msgr2=0x7fd9681f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9681f65c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c7a0 tx=0x7fd95800cc60 comp rx=0 tx=0).stop 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 shutdown_connections 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd94806be30 0x7fd94806e2f0 secure :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd950034000 tx=0x7fd95002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd96815f580 0x7fd968157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96815b230 0x7fd9681f65c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 --2- 172.21.15.181:0/2268913799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9680b3ff0 0x7fd9680c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 >> 172.21.15.181:0/2268913799 conn(0x7fd96806bc10 msgr2=0x7fd9680ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 shutdown_connections 2024-09-12T02:35:40.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.496+0000 7fd96eed0640 1 -- 172.21.15.181:0/2268913799 wait complete. 2024-09-12T02:35:40.511 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:35:40.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.615+0000 7f4371a17640 1 Processor -- start 2024-09-12T02:35:40.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.615+0000 7f4371a17640 1 -- start start 2024-09-12T02:35:40.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.615+0000 7f4371a17640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f436c15e640 0x7f436c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.615+0000 7f4371a17640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f436c0cef60 0x7f436c0d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.615+0000 7f4371a17640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436c0b39d0 con 0x7f436c0d33c0 2024-09-12T02:35:40.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.615+0000 7f4371a17640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f436c0cf520 con 0x7f436c15e640 2024-09-12T02:35:40.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.615+0000 7f4371a17640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f436c0cf800 con 0x7f436c0cef60 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f436c15e640 0x7f436c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436affd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f436c15e640 0x7f436c0b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37668/0 (socket says 172.21.15.181:37668) 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436affd640 1 -- 172.21.15.181:0/3379150797 learned_addr learned my addr 172.21.15.181:0/3379150797 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436b7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f436c0d33c0 0x7f436c0d4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51118/0 (socket says 172.21.15.181:51118) 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436a7fc640 1 --2- 172.21.15.181:0/3379150797 >> v2:172.21.15.204:3300/0 conn(0x7f436c0cef60 0x7f436c0d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436affd640 1 -- 172.21.15.181:0/3379150797 >> v2:172.21.15.204:3300/0 conn(0x7f436c0cef60 msgr2=0x7f436c0d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436affd640 1 --2- 172.21.15.181:0/3379150797 >> v2:172.21.15.204:3300/0 conn(0x7f436c0cef60 0x7f436c0d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436affd640 1 -- 172.21.15.181:0/3379150797 >> v1:172.21.15.181:6789/0 conn(0x7f436c0d33c0 legacy=0x7f436c0d4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.616+0000 7f436affd640 1 -- 172.21.15.181:0/3379150797 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436c0cfae0 con 0x7f436c15e640 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f436affd640 1 --2- 172.21.15.181:0/3379150797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0b3bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f436c0d23e0 tx=0x7f435c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bae2c50c13c497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4369ffb640 1 -- 172.21.15.181:0/3379150797 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c037070 con 0x7f436c15e640 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4369ffb640 1 -- 172.21.15.181:0/3379150797 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c032440 con 0x7f436c15e640 2024-09-12T02:35:40.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4369ffb640 1 -- 172.21.15.181:0/3379150797 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c032810 con 0x7f436c15e640 2024-09-12T02:35:40.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 -- 172.21.15.181:0/3379150797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 msgr2=0x7f436c0b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 --2- 172.21.15.181:0/3379150797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0b3bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f436c0d23e0 tx=0x7f435c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 -- 172.21.15.181:0/3379150797 shutdown_connections 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 --2- 172.21.15.181:0/3379150797 >> v2:172.21.15.204:3300/0 conn(0x7f436c0cef60 0x7f436c0d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 --2- 172.21.15.181:0/3379150797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0b3bf0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 -- 172.21.15.181:0/3379150797 >> 172.21.15.181:0/3379150797 conn(0x7f436c067d70 msgr2=0x7f436c068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 -- 172.21.15.181:0/3379150797 shutdown_connections 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.617+0000 7f4371a17640 1 -- 172.21.15.181:0/3379150797 wait complete. 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.618+0000 7f4371a17640 1 Processor -- start 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f4371a17640 1 -- start start 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f4371a17640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f436c0cef60 0x7f436c1f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f4371a17640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f436c0d33c0 0x7f436c1f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f4371a17640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f4371a17640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f436c0d4e20 con 0x7f436c15e640 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f4371a17640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f436c15ea20 con 0x7f436c0cef60 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f4371a17640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f436c0d4fa0 con 0x7f436c0d33c0 2024-09-12T02:35:40.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f436b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.619+0000 7f436b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37680/0 (socket says 172.21.15.181:37680) 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436b7fe640 1 -- 172.21.15.181:0/3008903294 learned_addr learned my addr 172.21.15.181:0/3008903294 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436affd640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f436c0cef60 0x7f436c1f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436a7fc640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f436c0d33c0 0x7f436c1f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436b7fe640 1 -- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f436c0d33c0 msgr2=0x7f436c1f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436b7fe640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f436c0d33c0 0x7f436c1f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436b7fe640 1 -- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f436c0cef60 msgr2=0x7f436c1f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436b7fe640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f436c0cef60 0x7f436c1f7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436b7fe640 1 -- 172.21.15.181:0/3008903294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436c15b390 con 0x7f436c15e640 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436a7fc640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f436c0d33c0 0x7f436c1f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f436b7fe640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0c9520 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f436400c730 tx=0x7f436400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f4353fff640 1 -- 172.21.15.181:0/3008903294 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364018070 con 0x7f436c15e640 2024-09-12T02:35:40.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f4353fff640 1 -- 172.21.15.181:0/3008903294 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364004d60 con 0x7f436c15e640 2024-09-12T02:35:40.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f4353fff640 1 -- 172.21.15.181:0/3008903294 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436400a840 con 0x7f436c15e640 2024-09-12T02:35:40.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f436c15b670 con 0x7f436c15e640 2024-09-12T02:35:40.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.620+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f436c15bf10 con 0x7f436c15e640 2024-09-12T02:35:40.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.621+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f436c15b840 con 0x7f436c15e640 2024-09-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.622+0000 7f4353fff640 1 -- 172.21.15.181:0/3008903294 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f436401b070 con 0x7f436c15e640 2024-09-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.622+0000 7f4353fff640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f435806be30 0x7f435806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.622+0000 7f436affd640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f435806be30 0x7f435806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.622+0000 7f4353fff640 1 -- 172.21.15.181:0/3008903294 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4943+0+0 (secure 0 0 0) 0x7f436408a280 con 0x7f436c15e640 2024-09-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.623+0000 7f436affd640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f435806be30 0x7f435806e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f435c034000 tx=0x7f435c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.627+0000 7f4353fff640 1 -- 172.21.15.181:0/3008903294 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f436c0b39d0 con 0x7f436c15e640 2024-09-12T02:35:40.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.792+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f436c0d2e80 con 0x7f436c15e640 2024-09-12T02:35:40.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.796+0000 7f4353fff640 1 -- 172.21.15.181:0/3008903294 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f4364058f30 con 0x7f436c15e640 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f435806be30 msgr2=0x7f435806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f435806be30 0x7f435806e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f435c034000 tx=0x7f435c02e000 comp rx=0 tx=0).stop 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 msgr2=0x7f436c0c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0c9520 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f436400c730 tx=0x7f436400cbf0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 shutdown_connections 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f435806be30 0x7f435806e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f436c15e640 0x7f436c0c9520 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f436c0d33c0 0x7f436c1f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 --2- 172.21.15.181:0/3008903294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f436c0cef60 0x7f436c1f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 >> 172.21.15.181:0/3008903294 conn(0x7f436c067d70 msgr2=0x7f436c0b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 shutdown_connections 2024-09-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.798+0000 7f4371a17640 1 -- 172.21.15.181:0/3008903294 wait complete. 2024-09-12T02:35:40.810 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool' 2024-09-12T02:35:40.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.907+0000 7fef9434b640 1 Processor -- start 2024-09-12T02:35:40.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.907+0000 7fef9434b640 1 -- start start 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.908+0000 7fef9434b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 0x7fef8c0cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.908+0000 7fef9434b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8c0d0a30 con 0x7fef8c0b47a0 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.908+0000 7fef9434b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8c0b76f0 con 0x7fef8c15c4a0 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.908+0000 7fef9434b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fef8c0d0d30 con 0x7fef8c0d2da0 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.908+0000 7fef918e6640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fef8c0b47a0 0x7fef8c164020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51132/0 (socket says 172.21.15.181:51132) 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.908+0000 7fef918e6640 1 -- 172.21.15.181:0/2658025305 learned_addr learned my addr 172.21.15.181:0/2658025305 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef928e8640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 0x7fef8c0cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952029195 0 0) 0x7fef8c0d0a30 con 0x7fef8c0b47a0 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef74003520 con 0x7fef8c0b47a0 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2037144760 0 0) 0x7fef74003520 con 0x7fef8c0b47a0 2024-09-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 msgr2=0x7fef8c0cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 0x7fef8c0cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 >> v1:172.21.15.204:6789/0 conn(0x7fef8c15c4a0 legacy=0x7fef8c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c073710 con 0x7fef8c0b47a0 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fef80001670 con 0x7fef8c0b47a0 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 >> v1:172.21.15.181:6789/0 conn(0x7fef8c0b47a0 legacy=0x7fef8c164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 0x7fef740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef74003f60 0x7fef74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef74004d40 0x7fef740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c0d0d30 con 0x7fef74004d40 2024-09-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fef7400bb50 con 0x7fef74003f60 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fef7400bd50 con 0x7fef8c0d2da0 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef928e8640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef74004d40 0x7fef740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef918e6640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef74003f60 0x7fef74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef920e7640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 0x7fef740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef928e8640 1 -- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 msgr2=0x7fef740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef928e8640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef8c0d2da0 0x7fef740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef928e8640 1 -- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef74003f60 msgr2=0x7fef74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef928e8640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef74003f60 0x7fef74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.909+0000 7fef928e8640 1 -- 172.21.15.181:0/2658025305 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef74003520 con 0x7fef74004d40 2024-09-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.910+0000 7fef928e8640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef74004d40 0x7fef740051c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fef84009a90 tx=0x7fef74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60c8cb76ba651a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.910+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84036070 con 0x7fef74004d40 2024-09-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.910+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef84031400 con 0x7fef74004d40 2024-09-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.910+0000 7fef910e5640 1 -- 172.21.15.181:0/2658025305 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84009690 con 0x7fef74004d40 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.911+0000 7fef9434b640 1 -- 172.21.15.181:0/2658025305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef74004d40 msgr2=0x7fef740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.911+0000 7fef9434b640 1 --2- 172.21.15.181:0/2658025305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef74004d40 0x7fef740051c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fef84009a90 tx=0x7fef74005830 comp rx=0 tx=0).stop 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.911+0000 7fef928e8640 1 -- 172.21.15.181:0/2658025305 reap_dead start 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.911+0000 7fef9434b640 1 -- 172.21.15.181:0/2658025305 shutdown_connections 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.911+0000 7fef9434b640 1 -- 172.21.15.181:0/2658025305 >> 172.21.15.181:0/2658025305 conn(0x7fef8c067950 msgr2=0x7fef8c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.911+0000 7fef9434b640 1 -- 172.21.15.181:0/2658025305 shutdown_connections 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.911+0000 7fef9434b640 1 -- 172.21.15.181:0/2658025305 wait complete. 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.912+0000 7fef9434b640 1 Processor -- start 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.912+0000 7fef9434b640 1 -- start start 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef9434b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef74004d40 0x7fef8c0b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef9434b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef8c0b56e0 0x7fef8c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef9434b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8c157a90 0x7fef8c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef9434b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c0cff80 con 0x7fef8c0b56e0 2024-09-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef9434b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c0d28e0 con 0x7fef8c157a90 2024-09-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef9434b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fef8c0d0100 con 0x7fef74004d40 2024-09-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef8c0b56e0 0x7fef8c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef8c0b56e0 0x7fef8c157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37692/0 (socket says 172.21.15.181:37692) 2024-09-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 -- 172.21.15.181:0/553507855 learned_addr learned my addr 172.21.15.181:0/553507855 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef920e7640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef74004d40 0x7fef8c0b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef928e8640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8c157a90 0x7fef8c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 -- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef74004d40 msgr2=0x7fef8c0b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef74004d40 0x7fef8c0b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 -- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8c157a90 msgr2=0x7fef8c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8c157a90 0x7fef8c15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 -- 172.21.15.181:0/553507855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c0b5bc0 con 0x7fef8c0b56e0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.913+0000 7fef918e6640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef8c0b56e0 0x7fef8c157550 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fef800017e0 tx=0x7fef80007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.914+0000 7fef8affd640 1 -- 172.21.15.181:0/553507855 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8000fa20 con 0x7fef8c0b56e0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.914+0000 7fef8affd640 1 -- 172.21.15.181:0/553507855 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef80018070 con 0x7fef8c0b56e0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.914+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c0b5ea0 con 0x7fef8c0b56e0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.914+0000 7fef8affd640 1 -- 172.21.15.181:0/553507855 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8000fe00 con 0x7fef8c0b56e0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.914+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c0b6460 con 0x7fef8c0b56e0 2024-09-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.915+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef8c157ea0 con 0x7fef8c0b56e0 2024-09-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.915+0000 7fef8affd640 1 -- 172.21.15.181:0/553507855 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef8001d460 con 0x7fef8c0b56e0 2024-09-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.916+0000 7fef8affd640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef7806be30 0x7fef7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.916+0000 7fef920e7640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef7806be30 0x7fef7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.916+0000 7fef8affd640 1 -- 172.21.15.181:0/553507855 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4943+0+0 (secure 0 0 0) 0x7fef8008ae20 con 0x7fef8c0b56e0 2024-09-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.916+0000 7fef920e7640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef7806be30 0x7fef7806e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fef7c003fb0 tx=0x7fef7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:40.920+0000 7fef8affd640 1 -- 172.21.15.181:0/553507855 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef8c157ea0 con 0x7fef8c0b56e0 2024-09-12T02:35:41.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.152+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]} v 0) -- 0x7fef8c15c880 con 0x7fef8c0b56e0 2024-09-12T02:35:41.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.494+0000 7fef8affd640 1 -- 172.21.15.181:0/553507855 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]}]=0 v316) ==== 145+0+0 (secure 0 0 0) 0x7fef80059ad0 con 0x7fef8c0b56e0 2024-09-12T02:35:41.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef7806be30 msgr2=0x7fef7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef7806be30 0x7fef7806e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fef7c003fb0 tx=0x7fef7c009040 comp rx=0 tx=0).stop 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef8c0b56e0 msgr2=0x7fef8c157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef8c0b56e0 0x7fef8c157550 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fef800017e0 tx=0x7fef80007720 comp rx=0 tx=0).stop 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 shutdown_connections 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fef7806be30 0x7fef7806e2f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef8c157a90 0x7fef8c15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef8c0b56e0 0x7fef8c157550 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 --2- 172.21.15.181:0/553507855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef74004d40 0x7fef8c0b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 >> 172.21.15.181:0/553507855 conn(0x7fef8c067950 msgr2=0x7fef8c0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 shutdown_connections 2024-09-12T02:35:41.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.496+0000 7fef9434b640 1 -- 172.21.15.181:0/553507855 wait complete. 2024-09-12T02:35:41.509 INFO:tasks.cephfs_test_runner:test_table_tool (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-09-12T02:35:41.509 INFO:tasks.cephfs_test_runner:Starting test: test_table_tool_take_inos (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-12T02:35:41.509 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:41.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.607+0000 7efe2eb11640 1 Processor -- start 2024-09-12T02:35:41.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.607+0000 7efe2eb11640 1 -- start start 2024-09-12T02:35:41.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.607+0000 7efe2eb11640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe2815e4e0 0x7efe280b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.607+0000 7efe2eb11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2815e8c0 0x7efe280b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.607+0000 7efe2eb11640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe2806cec0 con 0x7efe280d1fc0 2024-09-12T02:35:41.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.607+0000 7efe2eb11640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7efe280d2d40 con 0x7efe2815e4e0 2024-09-12T02:35:41.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.607+0000 7efe2eb11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efe280b7250 con 0x7efe2815e8c0 2024-09-12T02:35:41.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe27fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2815e8c0 0x7efe280b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe2c8ad640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe2815e4e0 0x7efe280b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe27fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2815e8c0 0x7efe280b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:60454/0 (socket says 172.21.15.181:60454) 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe2c8ad640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe2815e4e0 0x7efe280b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:46070/0 (socket says 172.21.15.181:46070) 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe27fff640 1 -- 172.21.15.181:0/13210826 learned_addr learned my addr 172.21.15.181:0/13210826 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe2d0ae640 1 --1- 172.21.15.181:0/13210826 >> v1:172.21.15.204:6789/0 conn(0x7efe280d1fc0 0x7efe280d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:50082/0 (socket says 172.21.15.181:50082) 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe27fff640 1 -- 172.21.15.181:0/13210826 >> v2:172.21.15.204:3300/0 conn(0x7efe2815e4e0 msgr2=0x7efe280b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe27fff640 1 --2- 172.21.15.181:0/13210826 >> v2:172.21.15.204:3300/0 conn(0x7efe2815e4e0 0x7efe280b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe27fff640 1 -- 172.21.15.181:0/13210826 >> v1:172.21.15.204:6789/0 conn(0x7efe280d1fc0 legacy=0x7efe280d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe27fff640 1 -- 172.21.15.181:0/13210826 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2806d160 con 0x7efe2815e8c0 2024-09-12T02:35:41.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.608+0000 7efe2c8ad640 1 --2- 172.21.15.181:0/13210826 >> v2:172.21.15.204:3300/0 conn(0x7efe2815e4e0 0x7efe280b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.609+0000 7efe27fff640 1 --2- 172.21.15.181:0/13210826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2815e8c0 0x7efe280b6d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe18009e50 tx=0x7efe1802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=625c70ec3c83155b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.609+0000 7efe277fe640 1 -- 172.21.15.181:0/13210826 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18036070 con 0x7efe2815e8c0 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.609+0000 7efe277fe640 1 -- 172.21.15.181:0/13210826 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe18031600 con 0x7efe2815e8c0 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.609+0000 7efe277fe640 1 -- 172.21.15.181:0/13210826 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180319d0 con 0x7efe2815e8c0 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 -- 172.21.15.181:0/13210826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2815e8c0 msgr2=0x7efe280b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 --2- 172.21.15.181:0/13210826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2815e8c0 0x7efe280b6d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe18009e50 tx=0x7efe1802a710 comp rx=0 tx=0).stop 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 -- 172.21.15.181:0/13210826 shutdown_connections 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 --2- 172.21.15.181:0/13210826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2815e8c0 0x7efe280b6d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 --2- 172.21.15.181:0/13210826 >> v2:172.21.15.204:3300/0 conn(0x7efe2815e4e0 0x7efe280b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 -- 172.21.15.181:0/13210826 >> 172.21.15.181:0/13210826 conn(0x7efe2806f400 msgr2=0x7efe2806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:41.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 -- 172.21.15.181:0/13210826 shutdown_connections 2024-09-12T02:35:41.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.610+0000 7efe2eb11640 1 -- 172.21.15.181:0/13210826 wait complete. 2024-09-12T02:35:41.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.611+0000 7efe2eb11640 1 Processor -- start 2024-09-12T02:35:41.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.611+0000 7efe2eb11640 1 -- start start 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2eb11640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe280d1fc0 0x7efe28150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2eb11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2815e4e0 0x7efe2814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2eb11640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe2815e8c0 0x7efe2814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2eb11640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efe2806dc40 con 0x7efe2815e4e0 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2eb11640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7efe2806d720 con 0x7efe2815e8c0 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2eb11640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7efe2806ddc0 con 0x7efe280d1fc0 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2815e4e0 0x7efe2814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2815e4e0 0x7efe2814d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37696/0 (socket says 172.21.15.181:37696) 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 -- 172.21.15.181:0/1461549888 learned_addr learned my addr 172.21.15.181:0/1461549888 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:41.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2d0ae640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe2815e8c0 0x7efe2814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe2c8ad640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe280d1fc0 0x7efe28150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 -- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe280d1fc0 msgr2=0x7efe28150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe280d1fc0 0x7efe28150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 -- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe2815e8c0 msgr2=0x7efe2814e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe2815e8c0 0x7efe2814e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.612+0000 7efe27fff640 1 -- 172.21.15.181:0/1461549888 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe28155870 con 0x7efe2815e4e0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.613+0000 7efe27fff640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2815e4e0 0x7efe2814d290 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7efe18034040 tx=0x7efe18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.613+0000 7efe257fa640 1 -- 172.21.15.181:0/1461549888 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18036050 con 0x7efe2815e4e0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.613+0000 7efe257fa640 1 -- 172.21.15.181:0/1461549888 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe18042070 con 0x7efe2815e4e0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.613+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe28150770 con 0x7efe2815e4e0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.613+0000 7efe257fa640 1 -- 172.21.15.181:0/1461549888 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18009510 con 0x7efe2815e4e0 2024-09-12T02:35:41.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.613+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe28155b10 con 0x7efe2815e4e0 2024-09-12T02:35:41.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.614+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe280d2470 con 0x7efe2815e4e0 2024-09-12T02:35:41.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.614+0000 7efe257fa640 1 -- 172.21.15.181:0/1461549888 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe18007c70 con 0x7efe2815e4e0 2024-09-12T02:35:41.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.615+0000 7efe257fa640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efe0806be30 0x7efe0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.615+0000 7efe257fa640 1 -- 172.21.15.181:0/1461549888 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4943+0+0 (secure 0 0 0) 0x7efe180ab7a0 con 0x7efe2815e4e0 2024-09-12T02:35:41.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.615+0000 7efe2c8ad640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efe0806be30 0x7efe0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.615+0000 7efe2c8ad640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efe0806be30 0x7efe0806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efe20009560 tx=0x7efe20009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.619+0000 7efe257fa640 1 -- 172.21.15.181:0/1461549888 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe18079e90 con 0x7efe2815e4e0 2024-09-12T02:35:41.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.788+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe28150c90 con 0x7efe2815e4e0 2024-09-12T02:35:41.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.788+0000 7efe257fa640 1 -- 172.21.15.181:0/1461549888 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13107 (secure 0 0 0) 0x7efe1807e190 con 0x7efe2815e4e0 2024-09-12T02:35:41.789 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:41.789 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":78,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:40.489553+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.204:6834/1682794667":"2024-09-13T02:35:37.481907+0000","172.21.15.204:6832/1682794667":"2024-09-13T02:35:37.481907+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:41.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efe0806be30 msgr2=0x7efe0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efe0806be30 0x7efe0806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efe20009560 tx=0x7efe20009190 comp rx=0 tx=0).stop 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2815e4e0 msgr2=0x7efe2814d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2815e4e0 0x7efe2814d290 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7efe18034040 tx=0x7efe18004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 shutdown_connections 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7efe0806be30 0x7efe0806e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe2815e8c0 0x7efe2814e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2815e4e0 0x7efe2814d290 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 --2- 172.21.15.181:0/1461549888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe280d1fc0 0x7efe28150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 >> 172.21.15.181:0/1461549888 conn(0x7efe2806f400 msgr2=0x7efe2815cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 shutdown_connections 2024-09-12T02:35:41.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.790+0000 7efe2eb11640 1 -- 172.21.15.181:0/1461549888 wait complete. 2024-09-12T02:35:41.803 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:28:11.641634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:35:41.803 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:35:41.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.903+0000 7f8dedfd6640 1 Processor -- start 2024-09-12T02:35:41.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.903+0000 7f8dedfd6640 1 -- start start 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8dedfd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8de80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8dedfd6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de80cf360 con 0x7f8de80d00a0 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8dedfd6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de80cf5e0 con 0x7f8de806bc10 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8dedfd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8de80cfc10 con 0x7f8de815f340 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8de6ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8de80d00a0 0x7f8de815ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51140/0 (socket says 172.21.15.181:51140) 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8de6ffd640 1 -- 172.21.15.181:0/2405967556 learned_addr learned my addr 172.21.15.181:0/2405967556 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8de7fff640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8de80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427747499 0 0) 0x7f8ddc001110 con 0x7f8de80d00a0 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dd0003520 con 0x7f8de80d00a0 2024-09-12T02:35:41.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.904+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680264399 0 0) 0x7f8de80cf5e0 con 0x7f8de806bc10 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ddc001110 con 0x7f8de806bc10 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2444950051 0 0) 0x7f8dd0003520 con 0x7f8de80d00a0 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 msgr2=0x7f8de80ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8de80ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 >> v1:172.21.15.204:6789/0 conn(0x7f8de806bc10 legacy=0x7f8de806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de815f9b0 con 0x7f8de80d00a0 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f8ddc001840 con 0x7f8de80d00a0 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de7fff640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8de80ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 >> v1:172.21.15.181:6789/0 conn(0x7f8de80d00a0 legacy=0x7f8de815ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8dd0003b70 0x7f8dd0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8dd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8dd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8de80cfc10 con 0x7f8dd0004d40 2024-09-12T02:35:41.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd000ba70 con 0x7f8dd0003b70 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd000bc20 con 0x7f8de815f340 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de7fff640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8dd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de77fe640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8dd0003b70 0x7f8dd0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de6ffd640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8dd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de7fff640 1 -- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 msgr2=0x7f8dd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de7fff640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8dd0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de7fff640 1 -- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8dd0003b70 msgr2=0x7f8dd0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de7fff640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8dd0003b70 0x7f8dd0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de7fff640 1 -- 172.21.15.181:0/2405967556 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd0003520 con 0x7f8dd0004d40 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.905+0000 7f8de6ffd640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815f340 0x7f8dd0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8de7fff640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8dd00051c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8de000e350 tx=0x7f8dd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a39992bae0837af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0033070 con 0x7f8dd0004d40 2024-09-12T02:35:41.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de002f660 con 0x7f8dd0004d40 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8de67fc640 1 -- 172.21.15.181:0/2405967556 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0009de0 con 0x7f8dd0004d40 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8dedfd6640 1 -- 172.21.15.181:0/2405967556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 msgr2=0x7f8dd00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8dedfd6640 1 --2- 172.21.15.181:0/2405967556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8dd00051c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8de000e350 tx=0x7f8dd0005830 comp rx=0 tx=0).stop 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8de7fff640 1 -- 172.21.15.181:0/2405967556 reap_dead start 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8dedfd6640 1 -- 172.21.15.181:0/2405967556 shutdown_connections 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8dedfd6640 1 -- 172.21.15.181:0/2405967556 >> 172.21.15.181:0/2405967556 conn(0x7f8de80b2360 msgr2=0x7f8de80b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8dedfd6640 1 -- 172.21.15.181:0/2405967556 shutdown_connections 2024-09-12T02:35:41.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.906+0000 7f8dedfd6640 1 -- 172.21.15.181:0/2405967556 wait complete. 2024-09-12T02:35:41.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 Processor -- start 2024-09-12T02:35:41.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 -- start start 2024-09-12T02:35:41.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8de80b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de81591e0 0x7f8de815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de8159660 0x7f8de815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8de80ae8a0 con 0x7f8dd0004d40 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8de8159060 con 0x7f8de81591e0 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.908+0000 7f8dedfd6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8de80aea20 con 0x7f8de8159660 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8de80b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8de80b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37724/0 (socket says 172.21.15.181:37724) 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 -- 172.21.15.181:0/1784485921 learned_addr learned my addr 172.21.15.181:0/1784485921 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de7fff640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de8159660 0x7f8de815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de6ffd640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de81591e0 0x7f8de815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 -- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de8159660 msgr2=0x7f8de815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de8159660 0x7f8de815da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 -- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de81591e0 msgr2=0x7f8de815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de81591e0 0x7f8de815d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 -- 172.21.15.181:0/1784485921 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de8159c30 con 0x7f8dd0004d40 2024-09-12T02:35:41.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8de77fe640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8de80b09b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800f7a0 tx=0x7f8dd800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8dcffff640 1 -- 172.21.15.181:0/1784485921 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800fe50 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8dcffff640 1 -- 172.21.15.181:0/1784485921 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd8018070 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8dcffff640 1 -- 172.21.15.181:0/1784485921 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800d730 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de8159f10 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.909+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de814ea40 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.910+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de8068cf0 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.911+0000 7f8dcffff640 1 -- 172.21.15.181:0/1784485921 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8dd800d8d0 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.911+0000 7f8dcffff640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dd406be60 0x7f8dd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.911+0000 7f8dcffff640 1 -- 172.21.15.181:0/1784485921 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4943+0+0 (secure 0 0 0) 0x7f8dd808ab00 con 0x7f8dd0004d40 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.911+0000 7f8de6ffd640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dd406be60 0x7f8dd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.912+0000 7f8de6ffd640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dd406be60 0x7f8dd406e320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0013d0 tx=0x7f8ddc0012e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:41.916+0000 7f8dcffff640 1 -- 172.21.15.181:0/1784485921 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8dd801a310 con 0x7f8dd0004d40 2024-09-12T02:35:42.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.080+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8de80cf5e0 con 0x7f8dd0004d40 2024-09-12T02:35:42.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.080+0000 7f8dcffff640 1 -- 172.21.15.181:0/1784485921 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f8dd80597b0 con 0x7f8dd0004d40 2024-09-12T02:35:42.081 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 1 2024-09-12T02:35:42.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dd406be60 msgr2=0x7f8dd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dd406be60 0x7f8dd406e320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0013d0 tx=0x7f8ddc0012e0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 msgr2=0x7f8de80b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8de80b09b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800f7a0 tx=0x7f8dd800fc60 comp rx=0 tx=0).stop 2024-09-12T02:35:42.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 shutdown_connections 2024-09-12T02:35:42.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dd406be60 0x7f8dd406e320 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de81591e0 0x7f8de815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de8159660 0x7f8de815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 --2- 172.21.15.181:0/1784485921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8dd0004d40 0x7f8de80b09b0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 >> 172.21.15.181:0/1784485921 conn(0x7f8de80b2360 msgr2=0x7f8de8157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:42.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 shutdown_connections 2024-09-12T02:35:42.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.082+0000 7f8dedfd6640 1 -- 172.21.15.181:0/1784485921 wait complete. 2024-09-12T02:35:42.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos' 2024-09-12T02:35:42.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.192+0000 7f251128b640 1 Processor -- start 2024-09-12T02:35:42.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.192+0000 7f251128b640 1 -- start start 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f251128b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f250c161c60 0x7f250c0d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f251128b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f250c06cd90 0x7f250c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f251128b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f250c0d3040 con 0x7f250c0d0e20 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f251128b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f250c0d2df0 con 0x7f250c06cd90 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f251128b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f250c073050 con 0x7f250c161c60 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f25027fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f250c06cd90 0x7f250c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f25027fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f250c06cd90 0x7f250c06d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37738/0 (socket says 172.21.15.181:37738) 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f250b7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f250c0d0e20 0x7f250c0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51154/0 (socket says 172.21.15.181:51154) 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f25027fc640 1 -- 172.21.15.181:0/1640894129 learned_addr learned my addr 172.21.15.181:0/1640894129 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:42.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f250affd640 1 --2- 172.21.15.181:0/1640894129 >> v2:172.21.15.204:3300/0 conn(0x7f250c161c60 0x7f250c0d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f25027fc640 1 -- 172.21.15.181:0/1640894129 >> v2:172.21.15.204:3300/0 conn(0x7f250c161c60 msgr2=0x7f250c0d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f25027fc640 1 --2- 172.21.15.181:0/1640894129 >> v2:172.21.15.204:3300/0 conn(0x7f250c161c60 0x7f250c0d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f25027fc640 1 -- 172.21.15.181:0/1640894129 >> v1:172.21.15.181:6789/0 conn(0x7f250c0d0e20 legacy=0x7f250c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f250a7fc640 1 -- 172.21.15.181:0/1640894129 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787624790 0 0) 0x7f250c0d3040 con 0x7f250c0d0e20 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.193+0000 7f25027fc640 1 -- 172.21.15.181:0/1640894129 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c073330 con 0x7f250c06cd90 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.194+0000 7f25027fc640 1 --2- 172.21.15.181:0/1640894129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c06d730 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f250c0cfef0 tx=0x7f24f402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224bf4ad4829e77c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.194+0000 7f250a7fc640 1 -- 172.21.15.181:0/1640894129 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4037070 con 0x7f250c06cd90 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.194+0000 7f250a7fc640 1 -- 172.21.15.181:0/1640894129 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f4032440 con 0x7f250c06cd90 2024-09-12T02:35:42.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.194+0000 7f250a7fc640 1 -- 172.21.15.181:0/1640894129 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4032810 con 0x7f250c06cd90 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 -- 172.21.15.181:0/1640894129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 msgr2=0x7f250c06d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 --2- 172.21.15.181:0/1640894129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c06d730 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f250c0cfef0 tx=0x7f24f402a150 comp rx=0 tx=0).stop 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 -- 172.21.15.181:0/1640894129 shutdown_connections 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 --2- 172.21.15.181:0/1640894129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c06d730 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 --2- 172.21.15.181:0/1640894129 >> v2:172.21.15.204:3300/0 conn(0x7f250c161c60 0x7f250c0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 -- 172.21.15.181:0/1640894129 >> 172.21.15.181:0/1640894129 conn(0x7f250c067950 msgr2=0x7f250c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 -- 172.21.15.181:0/1640894129 shutdown_connections 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.195+0000 7f251128b640 1 -- 172.21.15.181:0/1640894129 wait complete. 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.196+0000 7f251128b640 1 Processor -- start 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.196+0000 7f251128b640 1 -- start start 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f250c0d0e20 0x7f250c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f250c161c60 0x7f250c1f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f250c06dc70 con 0x7f250c06cd90 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f250c074100 con 0x7f250c0d0e20 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f250c0b47a0 con 0x7f250c161c60 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c1550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37748/0 (socket says 172.21.15.181:37748) 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 -- 172.21.15.181:0/971755480 learned_addr learned my addr 172.21.15.181:0/971755480 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f25027fc640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f250c0d0e20 0x7f250c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250b7fe640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f250c161c60 0x7f250c1f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 -- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f250c161c60 msgr2=0x7f250c1f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f250c161c60 0x7f250c1f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 -- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f250c0d0e20 msgr2=0x7f250c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f250c0d0e20 0x7f250c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 -- 172.21.15.181:0/971755480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c1f7b20 con 0x7f250c06cd90 2024-09-12T02:35:42.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f250affd640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c1550b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00d5f0 tx=0x7f24fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:42.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f2503fff640 1 -- 172.21.15.181:0/971755480 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0125f0 con 0x7f250c06cd90 2024-09-12T02:35:42.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f2503fff640 1 -- 172.21.15.181:0/971755480 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc019070 con 0x7f250c06cd90 2024-09-12T02:35:42.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c155700 con 0x7f250c06cd90 2024-09-12T02:35:42.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f2503fff640 1 -- 172.21.15.181:0/971755480 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0129d0 con 0x7f250c06cd90 2024-09-12T02:35:42.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.197+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c155cc0 con 0x7f250c06cd90 2024-09-12T02:35:42.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.199+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c06d730 con 0x7f250c06cd90 2024-09-12T02:35:42.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.199+0000 7f2503fff640 1 -- 172.21.15.181:0/971755480 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24fc012b70 con 0x7f250c06cd90 2024-09-12T02:35:42.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.199+0000 7f2503fff640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24ec06be60 0x7f24ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.199+0000 7f2503fff640 1 -- 172.21.15.181:0/971755480 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4943+0+0 (secure 0 0 0) 0x7f24fc08ae80 con 0x7f250c06cd90 2024-09-12T02:35:42.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.199+0000 7f25027fc640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24ec06be60 0x7f24ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.200+0000 7f25027fc640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24ec06be60 0x7f24ec06e320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:42.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.204+0000 7f2503fff640 1 -- 172.21.15.181:0/971755480 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24fc059bc0 con 0x7f250c06cd90 2024-09-12T02:35:42.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.435+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]} v 0) -- 0x7f250c0b4580 con 0x7f250c06cd90 2024-09-12T02:35:42.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.498+0000 7f2503fff640 1 -- 172.21.15.181:0/971755480 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]}]=0 v317) ==== 158+0+0 (secure 0 0 0) 0x7f24fc0594c0 con 0x7f250c06cd90 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24ec06be60 msgr2=0x7f24ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24ec06be60 0x7f24ec06e320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f24f4034000 tx=0x7f24f402e000 comp rx=0 tx=0).stop 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 msgr2=0x7f250c1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c1550b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00d5f0 tx=0x7f24fc00dab0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 shutdown_connections 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f24ec06be60 0x7f24ec06e320 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f250c0d0e20 0x7f250c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f250c161c60 0x7f250c1f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 --2- 172.21.15.181:0/971755480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f250c06cd90 0x7f250c1550b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 >> 172.21.15.181:0/971755480 conn(0x7f250c067950 msgr2=0x7f250c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:42.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 shutdown_connections 2024-09-12T02:35:42.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.501+0000 7f251128b640 1 -- 172.21.15.181:0/971755480 wait complete. 2024-09-12T02:35:42.513 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:35:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.613+0000 7f8be1065640 1 Processor -- start 2024-09-12T02:35:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.614+0000 7f8be1065640 1 -- start start 2024-09-12T02:35:42.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.614+0000 7f8be1065640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8bdc073870 0x7f8bdc15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.614+0000 7f8be1065640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc160750 con 0x7f8bdc160250 2024-09-12T02:35:42.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.614+0000 7f8be1065640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc160a30 con 0x7f8bdc0ce8f0 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.614+0000 7f8be1065640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8bdc160d10 con 0x7f8bdc073870 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.614+0000 7f8bda59c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8bdc160250 0x7f8bdc073160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51160/0 (socket says 172.21.15.181:51160) 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.614+0000 7f8bda59c640 1 -- 172.21.15.181:0/4161577596 learned_addr learned my addr 172.21.15.181:0/4161577596 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198466484 0 0) 0x7f8bdc160750 con 0x7f8bdc160250 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc8003520 con 0x7f8bdc160250 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdb59e640 1 --2- 172.21.15.181:0/4161577596 >> v2:172.21.15.204:3300/0 conn(0x7f8bdc073870 0x7f8bdc15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1344964641 0 0) 0x7f8bc8003520 con 0x7f8bdc160250 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 >> v2:172.21.15.204:3300/0 conn(0x7f8bdc073870 msgr2=0x7f8bdc15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 --2- 172.21.15.181:0/4161577596 >> v2:172.21.15.204:3300/0 conn(0x7f8bdc073870 0x7f8bdc15cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 >> v1:172.21.15.204:6789/0 conn(0x7f8bdc0ce8f0 legacy=0x7f8bdc0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc160ff0 con 0x7f8bdc160250 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f8bc4001670 con 0x7f8bdc160250 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 >> v1:172.21.15.181:6789/0 conn(0x7f8bdc160250 legacy=0x7f8bdc073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc8004800 0x7f8bc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc80051c0 0x7f8bc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc160d10 con 0x7f8bc80039b0 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc800c160 con 0x7f8bc80051c0 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc800c360 con 0x7f8bc8004800 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdad9d640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bda59c640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc8004800 0x7f8bc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdb59e640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc80051c0 0x7f8bc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdad9d640 1 -- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc8004800 msgr2=0x7f8bc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdad9d640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc8004800 0x7f8bc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdad9d640 1 -- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc80051c0 msgr2=0x7f8bc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdad9d640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc80051c0 0x7f8bc800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdad9d640 1 -- 172.21.15.181:0/4161577596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc8003520 con 0x7f8bc80039b0 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.615+0000 7f8bdb59e640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc80051c0 0x7f8bc800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.616+0000 7f8bdb59e640 1 -- 172.21.15.181:0/4161577596 reap_dead start 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.616+0000 7f8bdad9d640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bc8003dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4001750 tx=0x7f8bc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f22ce9a8fcad476 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.616+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4001370 con 0x7f8bc80039b0 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.616+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd40052d0 con 0x7f8bc80039b0 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.616+0000 7f8bd9d9b640 1 -- 172.21.15.181:0/4161577596 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd402abc0 con 0x7f8bc80039b0 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.617+0000 7f8be1065640 1 -- 172.21.15.181:0/4161577596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 msgr2=0x7f8bc8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.617+0000 7f8be1065640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bc8003dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4001750 tx=0x7f8bc8005830 comp rx=0 tx=0).stop 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.617+0000 7f8be1065640 1 -- 172.21.15.181:0/4161577596 shutdown_connections 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.617+0000 7f8be1065640 1 --2- 172.21.15.181:0/4161577596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bc8003dd0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.617+0000 7f8be1065640 1 -- 172.21.15.181:0/4161577596 >> 172.21.15.181:0/4161577596 conn(0x7f8bdc0d2570 msgr2=0x7f8bdc0d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.617+0000 7f8be1065640 1 -- 172.21.15.181:0/4161577596 shutdown_connections 2024-09-12T02:35:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.617+0000 7f8be1065640 1 -- 172.21.15.181:0/4161577596 wait complete. 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.618+0000 7f8be1065640 1 Processor -- start 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.618+0000 7f8be1065640 1 -- start start 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8be1065640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bdc148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8be1065640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bdc0c8d20 0x7f8bdc145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8be1065640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bdc0c7450 0x7f8bdc0b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8be1065640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc0d3250 con 0x7f8bc80039b0 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8be1065640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc0d30d0 con 0x7f8bdc0c7450 2024-09-12T02:35:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8be1065640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8bdc15cc10 con 0x7f8bdc0c8d20 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8bdad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bdc148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8bdad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bdc148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37758/0 (socket says 172.21.15.181:37758) 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8bdad9d640 1 -- 172.21.15.181:0/2572573653 learned_addr learned my addr 172.21.15.181:0/2572573653 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8bda59c640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bdc0c8d20 0x7f8bdc145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.619+0000 7f8bdb59e640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bdc0c7450 0x7f8bdc0b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bdad9d640 1 -- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bdc0c8d20 msgr2=0x7f8bdc145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bdad9d640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bdc0c8d20 0x7f8bdc145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bdad9d640 1 -- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bdc0c7450 msgr2=0x7f8bdc0b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bdad9d640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bdc0c7450 0x7f8bdc0b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bdad9d640 1 -- 172.21.15.181:0/2572573653 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc145fa0 con 0x7f8bc80039b0 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bda59c640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bdc0c8d20 0x7f8bdc145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bdb59e640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bdc0c7450 0x7f8bdc0b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bdad9d640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bdc148f40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005040 tx=0x7f8bd4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bd37fe640 1 -- 172.21.15.181:0/2572573653 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4037040 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bd37fe640 1 -- 172.21.15.181:0/2572573653 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd4005480 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc0c7c80 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8bd37fe640 1 -- 172.21.15.181:0/2572573653 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4001370 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.620+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bdc0c8240 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.621+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bdc15fde0 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.622+0000 7f8bd37fe640 1 -- 172.21.15.181:0/2572573653 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bd4044020 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.622+0000 7f8bd37fe640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bbc06be60 0x7f8bbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.622+0000 7f8bd37fe640 1 -- 172.21.15.181:0/2572573653 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4943+0+0 (secure 0 0 0) 0x7f8bd4007640 con 0x7f8bc80039b0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.622+0000 7f8bda59c640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bbc06be60 0x7f8bbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.622+0000 7f8bda59c640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bbc06be60 0x7f8bbc06e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc1f5df0 tx=0x7f8bc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.626+0000 7f8bd37fe640 1 -- 172.21.15.181:0/2572573653 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bdc15fde0 con 0x7f8bc80039b0 2024-09-12T02:35:42.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.792+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8bdc15d6d0 con 0x7f8bc80039b0 2024-09-12T02:35:42.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.795+0000 7f8bd37fe640 1 -- 172.21.15.181:0/2572573653 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f8bd4079760 con 0x7f8bc80039b0 2024-09-12T02:35:42.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bbc06be60 msgr2=0x7f8bbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bbc06be60 0x7f8bbc06e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc1f5df0 tx=0x7f8bc4009040 comp rx=0 tx=0).stop 2024-09-12T02:35:42.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 msgr2=0x7f8bdc148f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bdc148f40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005040 tx=0x7f8bd4001120 comp rx=0 tx=0).stop 2024-09-12T02:35:42.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 shutdown_connections 2024-09-12T02:35:42.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8bbc06be60 0x7f8bbc06e320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bdc0c7450 0x7f8bdc0b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bdc0c8d20 0x7f8bdc145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 --2- 172.21.15.181:0/2572573653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8bc80039b0 0x7f8bdc148f40 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 >> 172.21.15.181:0/2572573653 conn(0x7f8bdc0d2570 msgr2=0x7f8bdc15dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:42.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 shutdown_connections 2024-09-12T02:35:42.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:42.797+0000 7f8be1065640 1 -- 172.21.15.181:0/2572573653 wait complete. 2024-09-12T02:35:42.810 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:35:42.810 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:42.854 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:42.904 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:35:42.904 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:42.905 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:42.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:42.920 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:42.920 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:42.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:42.939 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:42.939 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:42.976 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:42.976 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:42.976 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:42.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:42.997 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:35:42.997 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:43.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.115+0000 7fe60b077640 1 Processor -- start 2024-09-12T02:35:43.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.115+0000 7fe60b077640 1 -- start start 2024-09-12T02:35:43.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe60b077640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe6040cd880 0x7fe6040b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe60b077640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe60415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe60b077640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6040b2710 con 0x7fe604156990 2024-09-12T02:35:43.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe60b077640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe604156d70 con 0x7fe6040cd880 2024-09-12T02:35:43.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe60b077640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040cea90 con 0x7fe6040b22c0 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe609614640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe60415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe5fbfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe6040cd880 0x7fe6040b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe609614640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe60415c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:60536/0 (socket says 172.21.15.181:60536) 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.116+0000 7fe609614640 1 -- 172.21.15.181:0/3552971064 learned_addr learned my addr 172.21.15.181:0/3552971064 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.117+0000 7fe609614640 1 -- 172.21.15.181:0/3552971064 >> v2:172.21.15.204:3300/0 conn(0x7fe6040cd880 msgr2=0x7fe6040b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.117+0000 7fe609614640 1 --2- 172.21.15.181:0/3552971064 >> v2:172.21.15.204:3300/0 conn(0x7fe6040cd880 0x7fe6040b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.117+0000 7fe609614640 1 -- 172.21.15.181:0/3552971064 >> v1:172.21.15.204:6789/0 conn(0x7fe604156990 legacy=0x7fe6040cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.117+0000 7fe609614640 1 -- 172.21.15.181:0/3552971064 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6040731f0 con 0x7fe6040b22c0 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.117+0000 7fe5fb7fe640 1 -- 172.21.15.181:0/3552971064 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094886457 0 0) 0x7fe6040b2710 con 0x7fe604156990 2024-09-12T02:35:43.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.117+0000 7fe5fbfff640 1 --2- 172.21.15.181:0/3552971064 >> v2:172.21.15.204:3300/0 conn(0x7fe6040cd880 0x7fe6040b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:43.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.117+0000 7fe609614640 1 --2- 172.21.15.181:0/3552971064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe60415c8d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b42e64d9d30da2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe5fb7fe640 1 -- 172.21.15.181:0/3552971064 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc037070 con 0x7fe6040b22c0 2024-09-12T02:35:43.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe5fb7fe640 1 -- 172.21.15.181:0/3552971064 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5fc032440 con 0x7fe6040b22c0 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe5fb7fe640 1 -- 172.21.15.181:0/3552971064 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc032810 con 0x7fe6040b22c0 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 -- 172.21.15.181:0/3552971064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 msgr2=0x7fe60415c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 --2- 172.21.15.181:0/3552971064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe60415c8d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 -- 172.21.15.181:0/3552971064 shutdown_connections 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 --2- 172.21.15.181:0/3552971064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe60415c8d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 --2- 172.21.15.181:0/3552971064 >> v2:172.21.15.204:3300/0 conn(0x7fe6040cd880 0x7fe6040b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 -- 172.21.15.181:0/3552971064 >> 172.21.15.181:0/3552971064 conn(0x7fe60406bc10 msgr2=0x7fe60406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:43.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 -- 172.21.15.181:0/3552971064 shutdown_connections 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.118+0000 7fe60b077640 1 -- 172.21.15.181:0/3552971064 wait complete. 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.119+0000 7fe60b077640 1 Processor -- start 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.119+0000 7fe60b077640 1 -- start start 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe60b077640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe6041f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe60b077640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cd880 0x7fe6040ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe60b077640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe604156990 0x7fe6041f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe60b077640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040ce720 con 0x7fe6040cd880 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe60b077640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040ce440 con 0x7fe604156990 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe60b077640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040cef20 con 0x7fe6040b22c0 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe5fbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cd880 0x7fe6040ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe5fbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cd880 0x7fe6040ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37762/0 (socket says 172.21.15.181:37762) 2024-09-12T02:35:43.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe5fbfff640 1 -- 172.21.15.181:0/15669770 learned_addr learned my addr 172.21.15.181:0/15669770 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe608e13640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe6041f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.120+0000 7fe609614640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe604156990 0x7fe6041f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5fbfff640 1 -- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 msgr2=0x7fe6041f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5fbfff640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe6041f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5fbfff640 1 -- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe604156990 msgr2=0x7fe6041f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5fbfff640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe604156990 0x7fe6041f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5fbfff640 1 -- 172.21.15.181:0/15669770 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6041f1ee0 con 0x7fe6040cd880 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5fbfff640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cd880 0x7fe6040ab240 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400e930 tx=0x7fe5f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5f97fa640 1 -- 172.21.15.181:0/15669770 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4017070 con 0x7fe6040cd880 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5f97fa640 1 -- 172.21.15.181:0/15669770 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f400ca00 con 0x7fe6040cd880 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe5f97fa640 1 -- 172.21.15.181:0/15669770 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400cdf0 con 0x7fe6040cd880 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6041f5c40 con 0x7fe6040cd880 2024-09-12T02:35:43.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.121+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6041f6200 con 0x7fe6040cd880 2024-09-12T02:35:43.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.122+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6040b1d80 con 0x7fe6040cd880 2024-09-12T02:35:43.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.123+0000 7fe5f97fa640 1 -- 172.21.15.181:0/15669770 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5f401a070 con 0x7fe6040cd880 2024-09-12T02:35:43.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.123+0000 7fe5f97fa640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5f006be30 0x7fe5f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.123+0000 7fe5f97fa640 1 -- 172.21.15.181:0/15669770 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4943+0+0 (secure 0 0 0) 0x7fe5f408a900 con 0x7fe6040cd880 2024-09-12T02:35:43.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.123+0000 7fe608e13640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5f006be30 0x7fe5f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.124+0000 7fe608e13640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5f006be30 0x7fe5f006e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe6000012e0 tx=0x7fe600009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.127+0000 7fe5f97fa640 1 -- 172.21.15.181:0/15669770 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5f4058ff0 con 0x7fe6040cd880 2024-09-12T02:35:43.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.325+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe60415b110 con 0x7fe6040cd880 2024-09-12T02:35:43.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.325+0000 7fe5f97fa640 1 -- 172.21.15.181:0/15669770 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3920 (secure 0 0 0) 0x7fe5f405d2f0 con 0x7fe6040cd880 2024-09-12T02:35:43.326 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:43.327 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":65,"btime":"2024-09-12T02:35:38:483922+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/3094445853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3094445853},{"type":"v1","addr":"172.21.15.204:6834","nonce":3094445853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6286,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/908024810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":908024810},{"type":"v1","addr":"172.21.15.204:6835","nonce":908024810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2217999152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2217999152},{"type":"v1","addr":"172.21.15.181:6836","nonce":2217999152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2485800077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":2485800077},{"type":"v1","addr":"172.21.15.181:6837","nonce":2485800077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[]} 2024-09-12T02:35:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 65 2024-09-12T02:35:43.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5f006be30 msgr2=0x7fe5f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5f006be30 0x7fe5f006e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe6000012e0 tx=0x7fe600009040 comp rx=0 tx=0).stop 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cd880 msgr2=0x7fe6040ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cd880 0x7fe6040ab240 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400e930 tx=0x7fe5f400edf0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 shutdown_connections 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe5f006be30 0x7fe5f006e2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe604156990 0x7fe6041f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6040cd880 0x7fe6040ab240 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.327+0000 7fe60b077640 1 --2- 172.21.15.181:0/15669770 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6040b22c0 0x7fe6041f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.328+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 >> 172.21.15.181:0/15669770 conn(0x7fe60406bc10 msgr2=0x7fe6040d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:43.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.328+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 shutdown_connections 2024-09-12T02:35:43.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.328+0000 7fe60b077640 1 -- 172.21.15.181:0/15669770 wait complete. 2024-09-12T02:35:43.340 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:35:43.340 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:35:43.340 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:35:43.340 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:43.340 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:35:43.340 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:35:43.341 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:35:43.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:43.341 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:35:43.341 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:35:43.341 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:35:43.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:43.341 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:35:43.341 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:35:43.342 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:35:43.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:43.350 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:35:43.350 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:35:43.350 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:35:43.351 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:35:43.353 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:35:43.353 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:35:43.354 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:35:43.354 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:35:43.392 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:35:43.393 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:43.393 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:35:43.393 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:43.395 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:35:43.396 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:43.396 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:35:43.397 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:43.397 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:35:43.466 INFO:tasks.ceph.mds.a.smithi181.stdout:starting mds.a at 2024-09-12T02:35:43.467 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-09-12T02:35:43.479 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-09-12T02:35:43.480 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:35:43.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.501+0000 7f4ff93f1640 1 Processor -- start 2024-09-12T02:35:43.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.501+0000 7f4ff93f1640 1 -- start start 2024-09-12T02:35:43.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.502+0000 7f4ff93f1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4ff4158d80 0x7f4ff415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.502+0000 7f4ff93f1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff4070280 con 0x7f4ff40b53f0 2024-09-12T02:35:43.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.502+0000 7f4ff2ffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4ff4158d80 0x7f4ff415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.502+0000 7f4ff37fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4ff40b53f0 0x7f4ff406fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51192/0 (socket says 172.21.15.181:51192) 2024-09-12T02:35:43.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.502+0000 7f4ff37fe640 1 -- 172.21.15.181:0/2619952783 learned_addr learned my addr 172.21.15.181:0/2619952783 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:43.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.502+0000 7f4ff93f1640 1 -- 172.21.15.181:0/2619952783 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff415c5f0 con 0x7f4ff406de30 2024-09-12T02:35:43.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.502+0000 7f4ff93f1640 1 -- 172.21.15.181:0/2619952783 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff4072190 con 0x7f4ff4158d80 2024-09-12T02:35:43.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.503+0000 7f4ff2ffd640 1 -- 172.21.15.181:0/2619952783 >> v1:172.21.15.204:6789/0 conn(0x7f4ff406de30 legacy=0x7f4ff406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.503+0000 7f4ff2ffd640 1 -- 172.21.15.181:0/2619952783 >> v1:172.21.15.181:6789/0 conn(0x7f4ff40b53f0 legacy=0x7f4ff406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.503+0000 7f4ff2ffd640 1 -- 172.21.15.181:0/2619952783 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff4072470 con 0x7f4ff4158d80 2024-09-12T02:35:43.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.503+0000 7f4ff2ffd640 1 --2- 172.21.15.181:0/2619952783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff4158d80 0x7f4ff415c0b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40097d0 tx=0x7f4fe402c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e799c95aa6a0eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.503+0000 7f4ff1ffb640 1 -- 172.21.15.181:0/2619952783 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4039070 con 0x7f4ff4158d80 2024-09-12T02:35:43.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.503+0000 7f4ff1ffb640 1 -- 172.21.15.181:0/2619952783 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe4034640 con 0x7f4ff4158d80 2024-09-12T02:35:43.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.503+0000 7f4ff1ffb640 1 -- 172.21.15.181:0/2619952783 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4034a10 con 0x7f4ff4158d80 2024-09-12T02:35:43.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.504+0000 7f4ff93f1640 1 -- 172.21.15.181:0/2619952783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff4158d80 msgr2=0x7f4ff415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.504+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/2619952783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff4158d80 0x7f4ff415c0b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40097d0 tx=0x7f4fe402c3d0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.504+0000 7f4ff93f1640 1 -- 172.21.15.181:0/2619952783 shutdown_connections 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.504+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/2619952783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff4158d80 0x7f4ff415c0b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.504+0000 7f4ff93f1640 1 -- 172.21.15.181:0/2619952783 >> 172.21.15.181:0/2619952783 conn(0x7f4ff40b2fe0 msgr2=0x7f4ff40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.504+0000 7f4ff93f1640 1 -- 172.21.15.181:0/2619952783 shutdown_connections 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.504+0000 7f4ff93f1640 1 -- 172.21.15.181:0/2619952783 wait complete. 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.505+0000 7f4ff93f1640 1 Processor -- start 2024-09-12T02:35:43.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.506+0000 7f4ff93f1640 1 -- start start 2024-09-12T02:35:43.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.506+0000 7f4ff93f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ff406de30 0x7f4ff40acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.506+0000 7f4ff93f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff40b53f0 0x7f4ff415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.506+0000 7f4ff93f1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ff4158d80 0x7f4ff41467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.506+0000 7f4ff2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ff406de30 0x7f4ff40acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.506+0000 7f4ff27fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff40b53f0 0x7f4ff415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.506+0000 7f4ff2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ff406de30 0x7f4ff40acd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:60602/0 (socket says 172.21.15.181:60602) 2024-09-12T02:35:43.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff27fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff40b53f0 0x7f4ff415a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37824/0 (socket says 172.21.15.181:37824) 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff2ffd640 1 -- 172.21.15.181:0/768210539 learned_addr learned my addr 172.21.15.181:0/768210539 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4071e10 con 0x7f4ff40b53f0 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4072a30 con 0x7f4ff4158d80 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff40b5fa0 con 0x7f4ff406de30 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff37fe640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ff4158d80 0x7f4ff41467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff2ffd640 1 -- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ff4158d80 msgr2=0x7f4ff41467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff2ffd640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ff4158d80 0x7f4ff41467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff2ffd640 1 -- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff40b53f0 msgr2=0x7f4ff415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff2ffd640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff40b53f0 0x7f4ff415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff2ffd640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff40abcf0 con 0x7f4ff406de30 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff27fc640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff40b53f0 0x7f4ff415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:43.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff37fe640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ff4158d80 0x7f4ff41467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:43.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.507+0000 7f4ff2ffd640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ff406de30 0x7f4ff40acd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098f0 tx=0x7f4fe40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.514+0000 7f4fdb7fe640 1 -- 172.21.15.181:0/768210539 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4039070 con 0x7f4ff406de30 2024-09-12T02:35:43.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.514+0000 7f4fdb7fe640 1 -- 172.21.15.181:0/768210539 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe4032900 con 0x7f4ff406de30 2024-09-12T02:35:43.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.514+0000 7f4fdb7fe640 1 -- 172.21.15.181:0/768210539 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4032cf0 con 0x7f4ff406de30 2024-09-12T02:35:43.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.514+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff40abfd0 con 0x7f4ff406de30 2024-09-12T02:35:43.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.515+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff40ac590 con 0x7f4ff406de30 2024-09-12T02:35:43.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.516+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff415c0b0 con 0x7f4ff406de30 2024-09-12T02:35:43.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.518+0000 7f4fdb7fe640 1 -- 172.21.15.181:0/768210539 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fe403f440 con 0x7f4ff406de30 2024-09-12T02:35:43.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.519+0000 7f4fdb7fe640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4fe006be80 0x7f4fe006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.519+0000 7f4fdb7fe640 1 -- 172.21.15.181:0/768210539 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7f4fe40abfb0 con 0x7f4ff406de30 2024-09-12T02:35:43.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.519+0000 7f4ff27fc640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4fe006be80 0x7f4fe006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.519+0000 7f4ff27fc640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4fe006be80 0x7f4fe006e340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40b0530 tx=0x7f4fe8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.524+0000 7f4fdb7fe640 1 -- 172.21.15.181:0/768210539 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fe40dad50 con 0x7f4ff406de30 2024-09-12T02:35:43.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:43.700+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4ff4068480 con 0x7f4ff406de30 2024-09-12T02:35:44.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.530+0000 7f4fdb7fe640 1 -- 172.21.15.181:0/768210539 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) ==== 97+0+0 (secure 0 0 0) 0x7f4fe407a5f0 con 0x7f4ff406de30 2024-09-12T02:35:44.531 INFO:teuthology.orchestra.run.smithi181.stderr: removed all blocklist entries 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4fe006be80 msgr2=0x7f4fe006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4fe006be80 0x7f4fe006e340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40b0530 tx=0x7f4fe8009040 comp rx=0 tx=0).stop 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ff406de30 msgr2=0x7f4ff40acd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ff406de30 0x7f4ff40acd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098f0 tx=0x7f4fe40046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 shutdown_connections 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4fe006be80 0x7f4fe006e340 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4ff4158d80 0x7f4ff41467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff40b53f0 0x7f4ff415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 --2- 172.21.15.181:0/768210539 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4ff406de30 0x7f4ff40acd90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 >> 172.21.15.181:0/768210539 conn(0x7f4ff40b2fe0 msgr2=0x7f4ff415d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:44.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 shutdown_connections 2024-09-12T02:35:44.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.532+0000 7f4ff93f1640 1 -- 172.21.15.181:0/768210539 wait complete. 2024-09-12T02:35:44.545 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:35:44.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.644+0000 7fad14de4640 1 Processor -- start 2024-09-12T02:35:44.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.645+0000 7fad14de4640 1 -- start start 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.645+0000 7fad14de4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad1015e640 0x7fad100ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.645+0000 7fad14de4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad100cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.645+0000 7fad14de4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1015ea20 con 0x7fad100cf0e0 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.645+0000 7fad14de4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fad100b2860 con 0x7fad1015e640 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.645+0000 7fad14de4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fad100b1c50 con 0x7fad100d3660 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0e59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad1015e640 0x7fad100ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0dd9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fad100cf0e0 0x7fad100b2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51208/0 (socket says 172.21.15.181:51208) 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0dd9b640 1 -- 172.21.15.181:0/3905631093 learned_addr learned my addr 172.21.15.181:0/3905631093 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:44.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0e59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad1015e640 0x7fad100ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37826/0 (socket says 172.21.15.181:37826) 2024-09-12T02:35:44.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0ed9d640 1 --2- 172.21.15.181:0/3905631093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad100cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:44.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0e59c640 1 -- 172.21.15.181:0/3905631093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 msgr2=0x7fad100cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:44.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0e59c640 1 --2- 172.21.15.181:0/3905631093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad100cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0e59c640 1 -- 172.21.15.181:0/3905631093 >> v1:172.21.15.181:6789/0 conn(0x7fad100cf0e0 legacy=0x7fad100b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0d59a640 1 -- 172.21.15.181:0/3905631093 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485148601 0 0) 0x7fad1015ea20 con 0x7fad100cf0e0 2024-09-12T02:35:44.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.646+0000 7fad0e59c640 1 -- 172.21.15.181:0/3905631093 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad100b1f30 con 0x7fad1015e640 2024-09-12T02:35:44.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad0e59c640 1 --2- 172.21.15.181:0/3905631093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad1015e640 0x7fad100ceba0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fad000097a0 tx=0x7fad0002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5884cab18a4616a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad0d59a640 1 -- 172.21.15.181:0/3905631093 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00037070 con 0x7fad1015e640 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad0d59a640 1 -- 172.21.15.181:0/3905631093 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0002ae50 con 0x7fad1015e640 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad0d59a640 1 -- 172.21.15.181:0/3905631093 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00032660 con 0x7fad1015e640 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 -- 172.21.15.181:0/3905631093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad1015e640 msgr2=0x7fad100ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 --2- 172.21.15.181:0/3905631093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad1015e640 0x7fad100ceba0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fad000097a0 tx=0x7fad0002a100 comp rx=0 tx=0).stop 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 -- 172.21.15.181:0/3905631093 shutdown_connections 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 --2- 172.21.15.181:0/3905631093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad100cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 --2- 172.21.15.181:0/3905631093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad1015e640 0x7fad100ceba0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 -- 172.21.15.181:0/3905631093 >> 172.21.15.181:0/3905631093 conn(0x7fad1009d820 msgr2=0x7fad100d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 -- 172.21.15.181:0/3905631093 shutdown_connections 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.647+0000 7fad14de4640 1 -- 172.21.15.181:0/3905631093 wait complete. 2024-09-12T02:35:44.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 Processor -- start 2024-09-12T02:35:44.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 -- start start 2024-09-12T02:35:44.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad100cf0e0 0x7fad1015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:44.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad1014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:44.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad1015e640 0x7fad1014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:44.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fad100cfe40 con 0x7fad100cf0e0 2024-09-12T02:35:44.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fad100b24f0 con 0x7fad1015e640 2024-09-12T02:35:44.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.649+0000 7fad14de4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fad100b73a0 con 0x7fad100d3660 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad100cf0e0 0x7fad1015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad100cf0e0 0x7fad1015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37842/0 (socket says 172.21.15.181:37842) 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 -- 172.21.15.181:0/2291633381 learned_addr learned my addr 172.21.15.181:0/2291633381 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0dd9b640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad1014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0ed9d640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad1015e640 0x7fad1014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 -- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 msgr2=0x7fad1014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad1014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 -- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad1015e640 msgr2=0x7fad1014ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad1015e640 0x7fad1014ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 -- 172.21.15.181:0/2291633381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad100cc5f0 con 0x7fad100cf0e0 2024-09-12T02:35:44.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad0e59c640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad100cf0e0 0x7fad1015cf00 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fad00035040 tx=0x7fad000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad06ffd640 1 -- 172.21.15.181:0/2291633381 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00041070 con 0x7fad100cf0e0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad06ffd640 1 -- 172.21.15.181:0/2291633381 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0003c670 con 0x7fad100cf0e0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad06ffd640 1 -- 172.21.15.181:0/2291633381 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00037040 con 0x7fad100cf0e0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad100cb830 con 0x7fad100cf0e0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.650+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad100cbdf0 con 0x7fad100cf0e0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.651+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad10068eb0 con 0x7fad100cf0e0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.652+0000 7fad06ffd640 1 -- 172.21.15.181:0/2291633381 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad0003a070 con 0x7fad100cf0e0 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.652+0000 7fad06ffd640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7facf006be30 0x7facf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:44.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.652+0000 7fad06ffd640 1 -- 172.21.15.181:0/2291633381 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7fad000aae40 con 0x7fad100cf0e0 2024-09-12T02:35:44.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.652+0000 7fad0dd9b640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7facf006be30 0x7facf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:44.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.653+0000 7fad0dd9b640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7facf006be30 0x7facf006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7facf8000f60 tx=0x7facf8007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:44.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.656+0000 7fad06ffd640 1 -- 172.21.15.181:0/2291633381 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad00079b40 con 0x7fad100cf0e0 2024-09-12T02:35:44.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.887+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fad1006c7a0 con 0x7fad100cf0e0 2024-09-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.888+0000 7fad06ffd640 1 -- 172.21.15.181:0/2291633381 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7fad00079440 con 0x7fad100cf0e0 2024-09-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi181.stdout: "auth_dump": [ 2024-09-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.a", 2024-09-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmgqStABAAuR5/mEmoQ93BJ/aXTfZ3Vg==", 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.b", 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmHB1xDBAA9v9urEvVrgq4ujbl1dq0ow==", 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.c", 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmA6uoBxAAsY99fp7CzedZ/yS6xKV3Ww==", 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mds.d", 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmSVuPExAA2lIlASsgadRjRVyKwAD+ig==", 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.0", 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCJUeJmXm6kMxAAhxzDDmGdbM/mLqwsr2z0qw==", 2024-09-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.1", 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCNUeJm3UvvNBAAiZKHPj471Ql3u3MDU+vYrg==", 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.2", 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCRUeJm6pZuJxAABApQFY9e5yj6ehNZsZcerA==", 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.3", 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCVUeJm5e9GKBAA0ZoeZyPDkw7vRVjKLRZIZQ==", 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.4", 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCcUeJmd20TMhAA0MSq5FoRha+jFQ6aJbfs/A==", 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.5", 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCgUeJmcgSVMxAAFDsp8jmrJ2uco7rmn4q9XQ==", 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.6", 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCkUeJmTwSWNBAApWkWkCbc9Mpk7VGR27a4+Q==", 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "osd.7", 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCoUeJmVts/NRAAQ3JpiLZSmnd2VbHLmZyXJQ==", 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow profile osd", 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile osd", 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.0", 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg==", 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow r", 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.1", 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm8f6AIBAA96HxvzttXuXOClAGiYwh7g==", 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.2", 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJm/+dGHRAAw3bdTqnuOcV2umDd/1577Q==", 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.3", 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCGUeJmCFcdJhAAEpU/Swkitc8CXjG0SKzeLQ==", 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow", 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow r", 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow rw", 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow rwx" 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "client.admin", 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmD708IBAAP+FE49F+D1d43sRbMVLBlQ==", 2024-09-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": "allow *", 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow *", 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.x", 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmmPEKORAAtnB+3V0qg1BS1zEVF5qImQ==", 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: "entity": "mgr.y", 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: "key": "AQCFUeJmMrTWNBAAVU9k50mu969QuqrLSsdtGw==", 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": { 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": "allow *", 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": "allow profile mgr", 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": "allow *" 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7facf006be30 msgr2=0x7facf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7facf006be30 0x7facf006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7facf8000f60 tx=0x7facf8007c00 comp rx=0 tx=0).stop 2024-09-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad100cf0e0 msgr2=0x7fad1015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad100cf0e0 0x7fad1015cf00 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fad00035040 tx=0x7fad000046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 shutdown_connections 2024-09-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7facf006be30 0x7facf006e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad1015e640 0x7fad1014ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad100d3660 0x7fad1014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 --2- 172.21.15.181:0/2291633381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad100cf0e0 0x7fad1015cf00 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.890+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 >> 172.21.15.181:0/2291633381 conn(0x7fad1009d820 msgr2=0x7fad100cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.891+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 shutdown_connections 2024-09-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:44.891+0000 7fad14de4640 1 -- 172.21.15.181:0/2291633381 wait complete. 2024-09-12T02:35:44.905 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:35:45.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.003+0000 7fd32cceb640 1 Processor -- start 2024-09-12T02:35:45.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.003+0000 7fd32cceb640 1 -- start start 2024-09-12T02:35:45.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.004+0000 7fd32cceb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd3280d2da0 0x7fd3280cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.004+0000 7fd32cceb640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3280d0a30 con 0x7fd32815c4a0 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.004+0000 7fd32cceb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3280b76f0 con 0x7fd3280b47a0 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.004+0000 7fd32cceb640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd3280d0d30 con 0x7fd3280d2da0 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd326d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd3280d2da0 0x7fd3280cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd326d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd3280d2da0 0x7fd3280cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37848/0 (socket says 172.21.15.181:37848) 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd326d9d640 1 -- 172.21.15.181:0/417299018 learned_addr learned my addr 172.21.15.181:0/417299018 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd32659c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd32815c4a0 0x7fd3280b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51222/0 (socket says 172.21.15.181:51222) 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd326d9d640 1 -- 172.21.15.181:0/417299018 >> v1:172.21.15.204:6789/0 conn(0x7fd3280b47a0 legacy=0x7fd328164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd326d9d640 1 -- 172.21.15.181:0/417299018 >> v1:172.21.15.181:6789/0 conn(0x7fd32815c4a0 legacy=0x7fd3280b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd32559a640 1 -- 172.21.15.181:0/417299018 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564748572 0 0) 0x7fd3280d0a30 con 0x7fd32815c4a0 2024-09-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.005+0000 7fd326d9d640 1 -- 172.21.15.181:0/417299018 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd328073710 con 0x7fd3280d2da0 2024-09-12T02:35:45.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd326d9d640 1 --2- 172.21.15.181:0/417299018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280d2da0 0x7fd3280cff80 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd320009e50 tx=0x7fd32002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23209b1fd6ce9cef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32559a640 1 -- 172.21.15.181:0/417299018 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320036070 con 0x7fd3280d2da0 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32559a640 1 -- 172.21.15.181:0/417299018 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd320031600 con 0x7fd3280d2da0 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32559a640 1 -- 172.21.15.181:0/417299018 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3200319d0 con 0x7fd3280d2da0 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32cceb640 1 -- 172.21.15.181:0/417299018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280d2da0 msgr2=0x7fd3280cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32cceb640 1 --2- 172.21.15.181:0/417299018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280d2da0 0x7fd3280cff80 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd320009e50 tx=0x7fd32002a6d0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32cceb640 1 -- 172.21.15.181:0/417299018 shutdown_connections 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32cceb640 1 --2- 172.21.15.181:0/417299018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280d2da0 0x7fd3280cff80 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32cceb640 1 -- 172.21.15.181:0/417299018 >> 172.21.15.181:0/417299018 conn(0x7fd328067950 msgr2=0x7fd328067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32cceb640 1 -- 172.21.15.181:0/417299018 shutdown_connections 2024-09-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.006+0000 7fd32cceb640 1 -- 172.21.15.181:0/417299018 wait complete. 2024-09-12T02:35:45.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 Processor -- start 2024-09-12T02:35:45.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 -- start start 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b47a0 0x7fd328154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3280d2da0 0x7fd3281f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd32815c4a0 0x7fd328145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd32815c880 con 0x7fd3280b47a0 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd3280d28e0 con 0x7fd3280d2da0 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32cceb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd32815ca00 con 0x7fd32815c4a0 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.008+0000 7fd32659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b47a0 0x7fd328154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b47a0 0x7fd328154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37852/0 (socket says 172.21.15.181:37852) 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 -- 172.21.15.181:0/2559705273 learned_addr learned my addr 172.21.15.181:0/2559705273 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd325d9b640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3280d2da0 0x7fd3281f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd326d9d640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd32815c4a0 0x7fd328145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 -- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd32815c4a0 msgr2=0x7fd328145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd32815c4a0 0x7fd328145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 -- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3280d2da0 msgr2=0x7fd3281f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3280d2da0 0x7fd3281f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 -- 172.21.15.181:0/2559705273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3281f5b10 con 0x7fd3280b47a0 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32659c640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b47a0 0x7fd328154a40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd31800c460 tx=0x7fd31800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd31effd640 1 -- 172.21.15.181:0/2559705273 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318018070 con 0x7fd3280b47a0 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd31effd640 1 -- 172.21.15.181:0/2559705273 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd318007500 con 0x7fd3280b47a0 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd31effd640 1 -- 172.21.15.181:0/2559705273 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318004a20 con 0x7fd3280b47a0 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3281f5df0 con 0x7fd3280b47a0 2024-09-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.009+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3281468c0 con 0x7fd3280b47a0 2024-09-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.010+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3280cff80 con 0x7fd3280b47a0 2024-09-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.011+0000 7fd31effd640 1 -- 172.21.15.181:0/2559705273 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd31801b070 con 0x7fd3280b47a0 2024-09-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.011+0000 7fd31effd640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30806be30 0x7fd30806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.011+0000 7fd31effd640 1 -- 172.21.15.181:0/2559705273 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7fd318089dc0 con 0x7fd3280b47a0 2024-09-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.011+0000 7fd325d9b640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30806be30 0x7fd30806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.012+0000 7fd325d9b640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30806be30 0x7fd30806e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd328159000 tx=0x7fd310009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.015+0000 7fd31effd640 1 -- 172.21.15.181:0/2559705273 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd318058ac0 con 0x7fd3280b47a0 2024-09-12T02:35:45.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.180+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd328158a70 con 0x7fd3280b47a0 2024-09-12T02:35:45.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.180+0000 7fd31effd640 1 -- 172.21.15.181:0/2559705273 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) ==== 84+0+65 (secure 0 0 0) 0x7fd3180583c0 con 0x7fd3280b47a0 2024-09-12T02:35:45.181 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:45.181 INFO:teuthology.orchestra.run.smithi181.stdout:[ 2024-09-12T02:35:45.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:45.182 INFO:teuthology.orchestra.run.smithi181.stdout: "poolnum": 1, 2024-09-12T02:35:45.182 INFO:teuthology.orchestra.run.smithi181.stdout: "poolname": ".mgr" 2024-09-12T02:35:45.182 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:45.182 INFO:teuthology.orchestra.run.smithi181.stdout:] 2024-09-12T02:35:45.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30806be30 msgr2=0x7fd30806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30806be30 0x7fd30806e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd328159000 tx=0x7fd310009040 comp rx=0 tx=0).stop 2024-09-12T02:35:45.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b47a0 msgr2=0x7fd328154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b47a0 0x7fd328154a40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd31800c460 tx=0x7fd31800c920 comp rx=0 tx=0).stop 2024-09-12T02:35:45.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 shutdown_connections 2024-09-12T02:35:45.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30806be30 0x7fd30806e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd3280d2da0 0x7fd3281f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd32815c4a0 0x7fd328145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 --2- 172.21.15.181:0/2559705273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3280b47a0 0x7fd328154a40 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 >> 172.21.15.181:0/2559705273 conn(0x7fd328067950 msgr2=0x7fd3280b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:45.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 shutdown_connections 2024-09-12T02:35:45.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.182+0000 7fd32cceb640 1 -- 172.21.15.181:0/2559705273 wait complete. 2024-09-12T02:35:45.194 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:35:45.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:35:45.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.296+0000 7fe033435640 1 Processor -- start 2024-09-12T02:35:45.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.296+0000 7fe033435640 1 -- start start 2024-09-12T02:35:45.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe033435640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe02c147610 0x7fe02c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe033435640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c0b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe033435640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe02c0b5010 0x7fe02c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe033435640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0b3a30 con 0x7fe02c0b5010 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe033435640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0b3d10 con 0x7fe02c147610 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe033435640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe02c0b3ff0 con 0x7fe02c0af920 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe0319d2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe02c0b5010 0x7fe02c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe0319d2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe02c0b5010 0x7fe02c0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37864/0 (socket says 172.21.15.181:37864) 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe0319d2640 1 -- 172.21.15.181:0/4290665220 learned_addr learned my addr 172.21.15.181:0/4290665220 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe0309d0640 1 --2- 172.21.15.181:0/4290665220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c0b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.297+0000 7fe0311d1640 1 --2- 172.21.15.181:0/4290665220 >> v2:172.21.15.204:3300/0 conn(0x7fe02c147610 0x7fe02c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0319d2640 1 -- 172.21.15.181:0/4290665220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 msgr2=0x7fe02c0b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:45.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0319d2640 1 --2- 172.21.15.181:0/4290665220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c0b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0319d2640 1 -- 172.21.15.181:0/4290665220 >> v2:172.21.15.204:3300/0 conn(0x7fe02c147610 msgr2=0x7fe02c0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0319d2640 1 --2- 172.21.15.181:0/4290665220 >> v2:172.21.15.204:3300/0 conn(0x7fe02c147610 0x7fe02c0b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0319d2640 1 -- 172.21.15.181:0/4290665220 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0b42d0 con 0x7fe02c0b5010 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0311d1640 1 --2- 172.21.15.181:0/4290665220 >> v2:172.21.15.204:3300/0 conn(0x7fe02c147610 0x7fe02c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0309d0640 1 --2- 172.21.15.181:0/4290665220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c0b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe0319d2640 1 --2- 172.21.15.181:0/4290665220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c0b5010 0x7fe02c0710f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe02c06cf70 tx=0x7fe02402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c642c21f78b8d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe023fff640 1 -- 172.21.15.181:0/4290665220 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024036070 con 0x7fe02c0b5010 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe023fff640 1 -- 172.21.15.181:0/4290665220 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024031600 con 0x7fe02c0b5010 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.298+0000 7fe023fff640 1 -- 172.21.15.181:0/4290665220 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0240319d0 con 0x7fe02c0b5010 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 -- 172.21.15.181:0/4290665220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c0b5010 msgr2=0x7fe02c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 --2- 172.21.15.181:0/4290665220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c0b5010 0x7fe02c0710f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe02c06cf70 tx=0x7fe02402a730 comp rx=0 tx=0).stop 2024-09-12T02:35:45.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 -- 172.21.15.181:0/4290665220 shutdown_connections 2024-09-12T02:35:45.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 --2- 172.21.15.181:0/4290665220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c0b5010 0x7fe02c0710f0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 --2- 172.21.15.181:0/4290665220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c0b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 --2- 172.21.15.181:0/4290665220 >> v2:172.21.15.204:3300/0 conn(0x7fe02c147610 0x7fe02c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 -- 172.21.15.181:0/4290665220 >> 172.21.15.181:0/4290665220 conn(0x7fe02c0b2150 msgr2=0x7fe02c0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:45.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 -- 172.21.15.181:0/4290665220 shutdown_connections 2024-09-12T02:35:45.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.299+0000 7fe033435640 1 -- 172.21.15.181:0/4290665220 wait complete. 2024-09-12T02:35:45.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.300+0000 7fe033435640 1 Processor -- start 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.300+0000 7fe033435640 1 -- start start 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe033435640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe033435640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe02c0b5010 0x7fe02c1e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe033435640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c147610 0x7fe02c1e5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe033435640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c0afec0 con 0x7fe02c147610 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe033435640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c0afd40 con 0x7fe02c0b5010 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe033435640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe02c071630 con 0x7fe02c0af920 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c147610 0x7fe02c1e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c147610 0x7fe02c1e5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37872/0 (socket says 172.21.15.181:37872) 2024-09-12T02:35:45.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 -- 172.21.15.181:0/3278499800 learned_addr learned my addr 172.21.15.181:0/3278499800 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0309d0640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe02c0b5010 0x7fe02c1e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0311d1640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 -- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 msgr2=0x7fe02c06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c06ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 -- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe02c0b5010 msgr2=0x7fe02c1e6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe02c0b5010 0x7fe02c1e6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 -- 172.21.15.181:0/3278499800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c1e4860 con 0x7fe02c147610 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.301+0000 7fe0319d2640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c147610 0x7fe02c1e5620 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe024034040 tx=0x7fe024004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.302+0000 7fe021ffb640 1 -- 172.21.15.181:0/3278499800 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024036050 con 0x7fe02c147610 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.302+0000 7fe021ffb640 1 -- 172.21.15.181:0/3278499800 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024042070 con 0x7fe02c147610 2024-09-12T02:35:45.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.302+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c1e4b40 con 0x7fe02c147610 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.302+0000 7fe021ffb640 1 -- 172.21.15.181:0/3278499800 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024009510 con 0x7fe02c147610 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.302+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c1e5100 con 0x7fe02c147610 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.303+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c0710f0 con 0x7fe02c147610 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.304+0000 7fe021ffb640 1 -- 172.21.15.181:0/3278499800 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe024007bf0 con 0x7fe02c147610 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.304+0000 7fe021ffb640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe01006be30 0x7fe01006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.304+0000 7fe021ffb640 1 -- 172.21.15.181:0/3278499800 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7fe0240ab910 con 0x7fe02c147610 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.304+0000 7fe0311d1640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe01006be30 0x7fe01006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.304+0000 7fe0311d1640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe01006be30 0x7fe01006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe028006fd0 tx=0x7fe028008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.308+0000 7fe021ffb640 1 -- 172.21.15.181:0/3278499800 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe02407a610 con 0x7fe02c147610 2024-09-12T02:35:45.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.474+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe02c0b02a0 con 0x7fe02c147610 2024-09-12T02:35:45.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.532+0000 7fe021ffb640 1 -- 172.21.15.181:0/3278499800 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) ==== 138+0+0 (secure 0 0 0) 0x7fe024079f10 con 0x7fe02c147610 2024-09-12T02:35:45.533 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' created 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe01006be30 msgr2=0x7fe01006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe01006be30 0x7fe01006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe028006fd0 tx=0x7fe028008040 comp rx=0 tx=0).stop 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c147610 msgr2=0x7fe02c1e5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c147610 0x7fe02c1e5620 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe024034040 tx=0x7fe024004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 shutdown_connections 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe01006be30 0x7fe01006e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe02c0b5010 0x7fe02c1e6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c147610 0x7fe02c1e5620 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 --2- 172.21.15.181:0/3278499800 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe02c0af920 0x7fe02c06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 >> 172.21.15.181:0/3278499800 conn(0x7fe02c0b2150 msgr2=0x7fe02c145300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:45.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 shutdown_connections 2024-09-12T02:35:45.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.535+0000 7fe033435640 1 -- 172.21.15.181:0/3278499800 wait complete. 2024-09-12T02:35:45.550 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:35:45.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.654+0000 7fbb14d03640 1 Processor -- start 2024-09-12T02:35:45.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.654+0000 7fbb14d03640 1 -- start start 2024-09-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb14d03640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb1015f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb14d03640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbb100d01c0 0x7fbb10160080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb14d03640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1015fb50 con 0x7fbb100b4b60 2024-09-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb14d03640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fbb100b5020 con 0x7fbb100d01c0 2024-09-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb14d03640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbb100b5300 con 0x7fbb10158d90 2024-09-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb0e59c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb1015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb0ed9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbb100d01c0 0x7fbb10160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.655+0000 7fbb0dd9b640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fbb100b4b60 0x7fbb100cfab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.181:50138/0 (socket says 172.21.15.181:50138) 2024-09-12T02:35:45.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0dd9b640 1 -- 172.21.15.181:0/3066660826 learned_addr learned my addr 172.21.15.181:0/3066660826 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:45.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0d59a640 1 -- 172.21.15.181:0/3066660826 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020281529 0 0) 0x7fbb04001110 con 0x7fbb100b4b60 2024-09-12T02:35:45.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0d59a640 1 -- 172.21.15.181:0/3066660826 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf8003520 con 0x7fbb100b4b60 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0e59c640 1 -- 172.21.15.181:0/3066660826 >> v2:172.21.15.204:3300/0 conn(0x7fbb100d01c0 msgr2=0x7fbb10160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0e59c640 1 --2- 172.21.15.181:0/3066660826 >> v2:172.21.15.204:3300/0 conn(0x7fbb100d01c0 0x7fbb10160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0e59c640 1 -- 172.21.15.181:0/3066660826 >> v1:172.21.15.204:6789/0 conn(0x7fbb100b4b60 legacy=0x7fbb100cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0e59c640 1 -- 172.21.15.181:0/3066660826 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb100b55e0 con 0x7fbb10158d90 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.656+0000 7fbb0ed9d640 1 --2- 172.21.15.181:0/3066660826 >> v2:172.21.15.204:3300/0 conn(0x7fbb100d01c0 0x7fbb10160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb0e59c640 1 --2- 172.21.15.181:0/3066660826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb1015f610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009d90 tx=0x7fbb0002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31dc315116e36adb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb0d59a640 1 -- 172.21.15.181:0/3066660826 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00007740 con 0x7fbb10158d90 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb0d59a640 1 -- 172.21.15.181:0/3066660826 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb000078e0 con 0x7fbb10158d90 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb0d59a640 1 -- 172.21.15.181:0/3066660826 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00007c90 con 0x7fbb10158d90 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 -- 172.21.15.181:0/3066660826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 msgr2=0x7fbb1015f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 --2- 172.21.15.181:0/3066660826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb1015f610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009d90 tx=0x7fbb0002a660 comp rx=0 tx=0).stop 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 -- 172.21.15.181:0/3066660826 shutdown_connections 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 --2- 172.21.15.181:0/3066660826 >> v2:172.21.15.204:3300/0 conn(0x7fbb100d01c0 0x7fbb10160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 --2- 172.21.15.181:0/3066660826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb1015f610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 -- 172.21.15.181:0/3066660826 >> 172.21.15.181:0/3066660826 conn(0x7fbb100b1600 msgr2=0x7fbb100b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 -- 172.21.15.181:0/3066660826 shutdown_connections 2024-09-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.657+0000 7fbb14d03640 1 -- 172.21.15.181:0/3066660826 wait complete. 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 Processor -- start 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 -- start start 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb100b4b60 0x7fbb1013fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100d01c0 0x7fbb1013e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb10160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101605c0 con 0x7fbb100d01c0 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbb100b5ba0 con 0x7fbb100b4b60 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.659+0000 7fbb14d03640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbb10160740 con 0x7fbb10158d90 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100d01c0 0x7fbb1013e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100d01c0 0x7fbb1013e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37880/0 (socket says 172.21.15.181:37880) 2024-09-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 -- 172.21.15.181:0/765862264 learned_addr learned my addr 172.21.15.181:0/765862264 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0ed9d640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb10160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0e59c640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb100b4b60 0x7fbb1013fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 -- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 msgr2=0x7fbb10160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb10160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 -- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb100b4b60 msgr2=0x7fbb1013fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb100b4b60 0x7fbb1013fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 -- 172.21.15.181:0/765862264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1013ff40 con 0x7fbb100d01c0 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0ed9d640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb10160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb0dd9b640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100d01c0 0x7fbb1013e110 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c730 tx=0x7fbb0400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbafeffd640 1 -- 172.21.15.181:0/765862264 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04017070 con 0x7fbb100d01c0 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbafeffd640 1 -- 172.21.15.181:0/765862264 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb04005ad0 con 0x7fbb100d01c0 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1013e9c0 con 0x7fbb100d01c0 2024-09-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbafeffd640 1 -- 172.21.15.181:0/765862264 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04007e20 con 0x7fbb100d01c0 2024-09-12T02:35:45.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.660+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1013f200 con 0x7fbb100d01c0 2024-09-12T02:35:45.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.661+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb101ea1f0 con 0x7fbb100d01c0 2024-09-12T02:35:45.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.662+0000 7fbafeffd640 1 -- 172.21.15.181:0/765862264 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb0401a070 con 0x7fbb100d01c0 2024-09-12T02:35:45.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.662+0000 7fbafeffd640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbaf006be30 0x7fbaf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.662+0000 7fbafeffd640 1 -- 172.21.15.181:0/765862264 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5227+0+0 (secure 0 0 0) 0x7fbb04089ee0 con 0x7fbb100d01c0 2024-09-12T02:35:45.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.662+0000 7fbb0e59c640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbaf006be30 0x7fbaf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.663+0000 7fbb0e59c640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbaf006be30 0x7fbaf006e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbb00034000 tx=0x7fbb0002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.667+0000 7fbafeffd640 1 -- 172.21.15.181:0/765862264 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb1013e9c0 con 0x7fbb100d01c0 2024-09-12T02:35:45.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:45.835+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbb100b1bf0 con 0x7fbb100d01c0 2024-09-12T02:35:46.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.538+0000 7fbafeffd640 1 -- 172.21.15.181:0/765862264 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7fbb1015fb50 con 0x7fbb100d01c0 2024-09-12T02:35:46.539 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' created 2024-09-12T02:35:46.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbaf006be30 msgr2=0x7fbaf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbaf006be30 0x7fbaf006e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbb00034000 tx=0x7fbb0002f000 comp rx=0 tx=0).stop 2024-09-12T02:35:46.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100d01c0 msgr2=0x7fbb1013e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100d01c0 0x7fbb1013e110 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c730 tx=0x7fbb0400cb30 comp rx=0 tx=0).stop 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 shutdown_connections 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbaf006be30 0x7fbaf006e2f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb10158d90 0x7fbb10160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100d01c0 0x7fbb1013e110 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 --2- 172.21.15.181:0/765862264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb100b4b60 0x7fbb1013fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 >> 172.21.15.181:0/765862264 conn(0x7fbb100b1600 msgr2=0x7fbb100cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 shutdown_connections 2024-09-12T02:35:46.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.541+0000 7fbb14d03640 1 -- 172.21.15.181:0/765862264 wait complete. 2024-09-12T02:35:46.570 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:35:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.676+0000 7f6ed7352640 1 Processor -- start 2024-09-12T02:35:46.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.676+0000 7f6ed7352640 1 -- start start 2024-09-12T02:35:46.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed7352640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ed00cedd0 0x7f6ed00d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:46.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed7352640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00b75a0 0x7f6ed00d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:46.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed7352640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed00d2790 con 0x7f6ed00b3490 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed7352640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed00b6c10 con 0x7f6ed00cedd0 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed7352640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed00d2a70 con 0x7f6ed00b75a0 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed50ee640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ed00cedd0 0x7f6ed00d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed50ee640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ed00cedd0 0x7f6ed00d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37884/0 (socket says 172.21.15.181:37884) 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed48ed640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6ed00b3490 0x7f6ed00cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51236/0 (socket says 172.21.15.181:51236) 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed50ee640 1 -- 172.21.15.181:0/3802053947 learned_addr learned my addr 172.21.15.181:0/3802053947 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed58ef640 1 --2- 172.21.15.181:0/3802053947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00b75a0 0x7f6ed00d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed50ee640 1 -- 172.21.15.181:0/3802053947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00b75a0 msgr2=0x7f6ed00d3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed50ee640 1 --2- 172.21.15.181:0/3802053947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00b75a0 0x7f6ed00d3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed50ee640 1 -- 172.21.15.181:0/3802053947 >> v1:172.21.15.181:6789/0 conn(0x7f6ed00b3490 legacy=0x7f6ed00cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ed50ee640 1 -- 172.21.15.181:0/3802053947 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed00d2d50 con 0x7f6ed00cedd0 2024-09-12T02:35:46.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.677+0000 7f6ec7fff640 1 -- 172.21.15.181:0/3802053947 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415148747 0 0) 0x7f6ed00d2790 con 0x7f6ed00b3490 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.678+0000 7f6ed50ee640 1 --2- 172.21.15.181:0/3802053947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00cedd0 0x7f6ed00d2090 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009870 tx=0x7f6ecc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8069908926d680 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.678+0000 7f6ec7fff640 1 -- 172.21.15.181:0/3802053947 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc037070 con 0x7f6ed00cedd0 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.678+0000 7f6ec7fff640 1 -- 172.21.15.181:0/3802053947 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ecc032440 con 0x7f6ed00cedd0 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.678+0000 7f6ec7fff640 1 -- 172.21.15.181:0/3802053947 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc032810 con 0x7f6ed00cedd0 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 -- 172.21.15.181:0/3802053947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00cedd0 msgr2=0x7f6ed00d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 --2- 172.21.15.181:0/3802053947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00cedd0 0x7f6ed00d2090 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009870 tx=0x7f6ecc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 -- 172.21.15.181:0/3802053947 shutdown_connections 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 --2- 172.21.15.181:0/3802053947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00b75a0 0x7f6ed00d3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 --2- 172.21.15.181:0/3802053947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00cedd0 0x7f6ed00d2090 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 -- 172.21.15.181:0/3802053947 >> 172.21.15.181:0/3802053947 conn(0x7f6ed00d0f40 msgr2=0x7f6ed00d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 -- 172.21.15.181:0/3802053947 shutdown_connections 2024-09-12T02:35:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.679+0000 7f6ed7352640 1 -- 172.21.15.181:0/3802053947 wait complete. 2024-09-12T02:35:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.680+0000 7f6ed7352640 1 Processor -- start 2024-09-12T02:35:46.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.680+0000 7f6ed7352640 1 -- start start 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed7352640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed00b3490 0x7f6ed014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed7352640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00b75a0 0x7f6ed0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed7352640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00cedd0 0x7f6ed0152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed7352640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed015e720 con 0x7f6ed00b75a0 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed7352640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00d3310 con 0x7f6ed00b3490 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed7352640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed015e8a0 con 0x7f6ed00cedd0 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00b75a0 0x7f6ed0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00b75a0 0x7f6ed0151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37890/0 (socket says 172.21.15.181:37890) 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 -- 172.21.15.181:0/626534699 learned_addr learned my addr 172.21.15.181:0/626534699 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed50ee640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed00b3490 0x7f6ed014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed58ef640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00cedd0 0x7f6ed0152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 -- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00cedd0 msgr2=0x7f6ed0152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00cedd0 0x7f6ed0152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 -- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed00b3490 msgr2=0x7f6ed014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed00b3490 0x7f6ed014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 -- 172.21.15.181:0/626534699 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed01506b0 con 0x7f6ed00b75a0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.681+0000 7f6ed48ed640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00b75a0 0x7f6ed0151470 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c4a0 tx=0x7f6ec000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.682+0000 7f6ec5ffb640 1 -- 172.21.15.181:0/626534699 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0018070 con 0x7f6ed00b75a0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.682+0000 7f6ec5ffb640 1 -- 172.21.15.181:0/626534699 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec00074e0 con 0x7f6ed00b75a0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.682+0000 7f6ec5ffb640 1 -- 172.21.15.181:0/626534699 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0004a20 con 0x7f6ed00b75a0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.682+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed0150990 con 0x7f6ed00b75a0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.682+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed0153460 con 0x7f6ed00b75a0 2024-09-12T02:35:46.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.683+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed00b7a30 con 0x7f6ed00b75a0 2024-09-12T02:35:46.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.683+0000 7f6ec5ffb640 1 -- 172.21.15.181:0/626534699 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ec001b070 con 0x7f6ed00b75a0 2024-09-12T02:35:46.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.684+0000 7f6ec5ffb640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6eb406be60 0x7f6eb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:46.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.684+0000 7f6ec5ffb640 1 -- 172.21.15.181:0/626534699 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5609+0+0 (secure 0 0 0) 0x7f6ec008a060 con 0x7f6ed00b75a0 2024-09-12T02:35:46.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.684+0000 7f6ed50ee640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6eb406be60 0x7f6eb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:46.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.684+0000 7f6ed50ee640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6eb406be60 0x7f6eb406e320 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc034000 tx=0x7f6ecc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:46.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.688+0000 7f6ec5ffb640 1 -- 172.21.15.181:0/626534699 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ec0058b00 con 0x7f6ed00b75a0 2024-09-12T02:35:46.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:46.887+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6ed015cb50 con 0x7f6ed00b75a0 2024-09-12T02:35:47.303 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:47.306 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:47.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.540+0000 7f6ec5ffb640 1 -- 172.21.15.181:0/626534699 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v67) ==== 174+0+0 (secure 0 0 0) 0x7f6ec0058400 con 0x7f6ed00b75a0 2024-09-12T02:35:47.541 INFO:teuthology.orchestra.run.smithi181.stderr:new fs with metadata pool 12 and data pool 13 2024-09-12T02:35:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6eb406be60 msgr2=0x7f6eb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6eb406be60 0x7f6eb406e320 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc034000 tx=0x7f6ecc02e000 comp rx=0 tx=0).stop 2024-09-12T02:35:47.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00b75a0 msgr2=0x7f6ed0151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00b75a0 0x7f6ed0151470 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c4a0 tx=0x7f6ec000c960 comp rx=0 tx=0).stop 2024-09-12T02:35:47.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 shutdown_connections 2024-09-12T02:35:47.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6eb406be60 0x7f6eb406e320 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ed00cedd0 0x7f6ed0152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ed00b75a0 0x7f6ed0151470 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 --2- 172.21.15.181:0/626534699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ed00b3490 0x7f6ed014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.543+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 >> 172.21.15.181:0/626534699 conn(0x7f6ed00d0f40 msgr2=0x7f6ed00b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:47.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.544+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 shutdown_connections 2024-09-12T02:35:47.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.544+0000 7f6ed7352640 1 -- 172.21.15.181:0/626534699 wait complete. 2024-09-12T02:35:47.572 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.671+0000 7f9043503640 1 Processor -- start 2024-09-12T02:35:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.672+0000 7f9043503640 1 -- start start 2024-09-12T02:35:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.672+0000 7f9043503640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f903c15b2e0 0x7f903c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.672+0000 7f9043503640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c0ce4f0 con 0x7f903c0b2490 2024-09-12T02:35:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.672+0000 7f9043503640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c0ce7d0 con 0x7f903c0cdfc0 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.672+0000 7f9043503640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f903c15b6c0 con 0x7f903c15b2e0 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9041aa0640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f903c0b2490 0x7f903c071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51248/0 (socket says 172.21.15.181:51248) 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9041aa0640 1 -- 172.21.15.181:0/2329361550 learned_addr learned my addr 172.21.15.181:0/2329361550 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993471090 0 0) 0x7f903c0ce4f0 con 0x7f903c0b2490 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f904129f640 1 --2- 172.21.15.181:0/2329361550 >> v2:172.21.15.204:3300/0 conn(0x7f903c15b2e0 0x7f903c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9028003520 con 0x7f903c0b2490 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3443975133 0 0) 0x7f9028003520 con 0x7f903c0b2490 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 >> v2:172.21.15.204:3300/0 conn(0x7f903c15b2e0 msgr2=0x7f903c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 --2- 172.21.15.181:0/2329361550 >> v2:172.21.15.204:3300/0 conn(0x7f903c15b2e0 0x7f903c0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 >> v1:172.21.15.204:6789/0 conn(0x7f903c0cdfc0 legacy=0x7f903c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c0ceab0 con 0x7f903c0b2490 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f90340019f0 con 0x7f903c0b2490 2024-09-12T02:35:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 >> v1:172.21.15.181:6789/0 conn(0x7f903c0b2490 legacy=0x7f903c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f9028003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9028004800 0x7f9028004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90280051c0 0x7f902800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f902800c130 con 0x7f90280039b0 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f902800c2e0 con 0x7f90280051c0 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f902800c4e0 con 0x7f9028004800 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f904129f640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f9028003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9040a9e640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9028004800 0x7f9028004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.673+0000 7f9041aa0640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90280051c0 0x7f902800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f904129f640 1 -- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9028004800 msgr2=0x7f9028004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f904129f640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9028004800 0x7f9028004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f904129f640 1 -- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90280051c0 msgr2=0x7f902800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f904129f640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90280051c0 0x7f902800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f904129f640 1 -- 172.21.15.181:0/2329361550 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9028003520 con 0x7f90280039b0 2024-09-12T02:35:47.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f9041aa0640 1 -- 172.21.15.181:0/2329361550 reap_dead start 2024-09-12T02:35:47.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f904129f640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f9028003dd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f9038009ac0 tx=0x7f9028005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936608b251f43dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:47.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038036070 con 0x7f90280039b0 2024-09-12T02:35:47.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9038031400 con 0x7f90280039b0 2024-09-12T02:35:47.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.674+0000 7f9033fff640 1 -- 172.21.15.181:0/2329361550 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038009690 con 0x7f90280039b0 2024-09-12T02:35:47.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.675+0000 7f9043503640 1 -- 172.21.15.181:0/2329361550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 msgr2=0x7f9028003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.675+0000 7f9043503640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f9028003dd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f9038009ac0 tx=0x7f9028005830 comp rx=0 tx=0).stop 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.675+0000 7f9043503640 1 -- 172.21.15.181:0/2329361550 shutdown_connections 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.675+0000 7f9043503640 1 --2- 172.21.15.181:0/2329361550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f9028003dd0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.675+0000 7f9043503640 1 -- 172.21.15.181:0/2329361550 >> 172.21.15.181:0/2329361550 conn(0x7f903c06bc10 msgr2=0x7f903c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.675+0000 7f9043503640 1 -- 172.21.15.181:0/2329361550 shutdown_connections 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.675+0000 7f9043503640 1 -- 172.21.15.181:0/2329361550 wait complete. 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.677+0000 7f9043503640 1 Processor -- start 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.677+0000 7f9043503640 1 -- start start 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9043503640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f903c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9043503640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c0b3360 0x7f903c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9043503640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903c0b37e0 0x7f903c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9043503640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0712b0 con 0x7f90280039b0 2024-09-12T02:35:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9043503640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f903c071130 con 0x7f903c0b3360 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9043503640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f903c0b1d80 con 0x7f903c0b37e0 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f903c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f903c15dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37904/0 (socket says 172.21.15.181:37904) 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 -- 172.21.15.181:0/2573239086 learned_addr learned my addr 172.21.15.181:0/2573239086 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9040a9e640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c0b3360 0x7f903c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f9041aa0640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903c0b37e0 0x7f903c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 -- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903c0b37e0 msgr2=0x7f903c14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903c0b37e0 0x7f903c14f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 -- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c0b3360 msgr2=0x7f903c14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c0b3360 0x7f903c14eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 -- 172.21.15.181:0/2573239086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c15c6e0 con 0x7f90280039b0 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.678+0000 7f904129f640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f903c15dfa0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9038034040 tx=0x7f9038004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.679+0000 7f9031ffb640 1 -- 172.21.15.181:0/2573239086 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903803f020 con 0x7f90280039b0 2024-09-12T02:35:47.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.679+0000 7f9031ffb640 1 -- 172.21.15.181:0/2573239086 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9038037040 con 0x7f90280039b0 2024-09-12T02:35:47.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.679+0000 7f9031ffb640 1 -- 172.21.15.181:0/2573239086 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038036070 con 0x7f90280039b0 2024-09-12T02:35:47.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.679+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c15c9c0 con 0x7f90280039b0 2024-09-12T02:35:47.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.679+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c071f50 con 0x7f90280039b0 2024-09-12T02:35:47.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.680+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c0b2110 con 0x7f90280039b0 2024-09-12T02:35:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.680+0000 7f9031ffb640 1 -- 172.21.15.181:0/2573239086 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9038042020 con 0x7f90280039b0 2024-09-12T02:35:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.681+0000 7f9031ffb640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f902006be30 0x7f902006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.681+0000 7f9031ffb640 1 -- 172.21.15.181:0/2573239086 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f90380aade0 con 0x7f90280039b0 2024-09-12T02:35:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.681+0000 7f9040a9e640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f902006be30 0x7f902006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.681+0000 7f9040a9e640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f902006be30 0x7f902006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f902c000c00 tx=0x7f902c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:47.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.685+0000 7f9031ffb640 1 -- 172.21.15.181:0/2573239086 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9038049030 con 0x7f90280039b0 2024-09-12T02:35:47.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.855+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f903c0b0780 con 0x7f90280039b0 2024-09-12T02:35:47.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.856+0000 7f9031ffb640 1 -- 172.21.15.181:0/2573239086 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16805 (secure 0 0 0) 0x7f90380790a0 con 0x7f90280039b0 2024-09-12T02:35:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:47.858 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":86,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:46.889052+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:45.493049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:45.855137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f902006be30 msgr2=0x7f902006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f902006be30 0x7f902006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f902c000c00 tx=0x7f902c009040 comp rx=0 tx=0).stop 2024-09-12T02:35:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 msgr2=0x7f903c15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f903c15dfa0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9038034040 tx=0x7f9038004730 comp rx=0 tx=0).stop 2024-09-12T02:35:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 shutdown_connections 2024-09-12T02:35:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f902006be30 0x7f902006e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c0b3360 0x7f903c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f903c0b37e0 0x7f903c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 --2- 172.21.15.181:0/2573239086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90280039b0 0x7f903c15dfa0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 >> 172.21.15.181:0/2573239086 conn(0x7f903c06bc10 msgr2=0x7f903c150110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 shutdown_connections 2024-09-12T02:35:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.858+0000 7f9043503640 1 -- 172.21.15.181:0/2573239086 wait complete. 2024-09-12T02:35:47.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:47.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.972+0000 7f495dc8b640 1 Processor -- start 2024-09-12T02:35:47.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.973+0000 7f495dc8b640 1 -- start start 2024-09-12T02:35:47.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.973+0000 7f495dc8b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f495815c4a0 0x7f49580cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.973+0000 7f495dc8b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f49580d2da0 0x7f495815c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.973+0000 7f495dc8b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49580b4090 0x7f49580b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.973+0000 7f495dc8b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f49580d0d30 con 0x7f49580b4090 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.973+0000 7f495dc8b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f49580d0a30 con 0x7f49580d2da0 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.973+0000 7f495dc8b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f49580b76f0 con 0x7f495815c4a0 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49580b4090 0x7f49580b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49580b4090 0x7f49580b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37918/0 (socket says 172.21.15.181:37918) 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 -- 172.21.15.181:0/4294691572 learned_addr learned my addr 172.21.15.181:0/4294691572 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4956ffd640 1 --2- 172.21.15.181:0/4294691572 >> v2:172.21.15.204:3300/0 conn(0x7f49580d2da0 0x7f495815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f49577fe640 1 --2- 172.21.15.181:0/4294691572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f495815c4a0 0x7f49580cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 -- 172.21.15.181:0/4294691572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f495815c4a0 msgr2=0x7f49580cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 --2- 172.21.15.181:0/4294691572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f495815c4a0 0x7f49580cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 -- 172.21.15.181:0/4294691572 >> v2:172.21.15.204:3300/0 conn(0x7f49580d2da0 msgr2=0x7f495815c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:47.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 --2- 172.21.15.181:0/4294691572 >> v2:172.21.15.204:3300/0 conn(0x7f49580d2da0 0x7f495815c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.974+0000 7f4957fff640 1 -- 172.21.15.181:0/4294691572 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4958073710 con 0x7f49580b4090 2024-09-12T02:35:47.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f4957fff640 1 --2- 172.21.15.181:0/4294691572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49580b4090 0x7f49580b4540 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4958070fc0 tx=0x7f495002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59be01712baae1f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:47.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f49567fc640 1 -- 172.21.15.181:0/4294691572 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950036070 con 0x7f49580b4090 2024-09-12T02:35:47.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f49567fc640 1 -- 172.21.15.181:0/4294691572 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950031600 con 0x7f49580b4090 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f49567fc640 1 -- 172.21.15.181:0/4294691572 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49500319d0 con 0x7f49580b4090 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 -- 172.21.15.181:0/4294691572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49580b4090 msgr2=0x7f49580b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 --2- 172.21.15.181:0/4294691572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49580b4090 0x7f49580b4540 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4958070fc0 tx=0x7f495002a610 comp rx=0 tx=0).stop 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 -- 172.21.15.181:0/4294691572 shutdown_connections 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 --2- 172.21.15.181:0/4294691572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49580b4090 0x7f49580b4540 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 --2- 172.21.15.181:0/4294691572 >> v2:172.21.15.204:3300/0 conn(0x7f49580d2da0 0x7f495815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 --2- 172.21.15.181:0/4294691572 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f495815c4a0 0x7f49580cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 -- 172.21.15.181:0/4294691572 >> 172.21.15.181:0/4294691572 conn(0x7f4958067950 msgr2=0x7f4958067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 -- 172.21.15.181:0/4294691572 shutdown_connections 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.975+0000 7f495dc8b640 1 -- 172.21.15.181:0/4294691572 wait complete. 2024-09-12T02:35:47.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 Processor -- start 2024-09-12T02:35:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 -- start start 2024-09-12T02:35:47.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49580b4090 0x7f4958146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49580d2da0 0x7f4958158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495815c4a0 0x7f49580b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4958165020 con 0x7f495815c4a0 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f49580d28e0 con 0x7f49580b4090 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.977+0000 7f495dc8b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f49581651a0 con 0x7f49580d2da0 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495815c4a0 0x7f49580b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495815c4a0 0x7f49580b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37926/0 (socket says 172.21.15.181:37926) 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 -- 172.21.15.181:0/1407190016 learned_addr learned my addr 172.21.15.181:0/1407190016 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4956ffd640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49580d2da0 0x7f4958158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f49577fe640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49580b4090 0x7f4958146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 -- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49580d2da0 msgr2=0x7f4958158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49580d2da0 0x7f4958158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 -- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49580b4090 msgr2=0x7f4958146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49580b4090 0x7f4958146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 -- 172.21.15.181:0/1407190016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4958156960 con 0x7f495815c4a0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f4957fff640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495815c4a0 0x7f49580b06d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4950009f40 tx=0x7f4950004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f493ffff640 1 -- 172.21.15.181:0/1407190016 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950041020 con 0x7f495815c4a0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f493ffff640 1 -- 172.21.15.181:0/1407190016 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950007820 con 0x7f495815c4a0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f493ffff640 1 -- 172.21.15.181:0/1407190016 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950036040 con 0x7f495815c4a0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4958156c30 con 0x7f495815c4a0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.978+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49581571f0 con 0x7f495815c4a0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.979+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495815c880 con 0x7f495815c4a0 2024-09-12T02:35:47.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.980+0000 7f493ffff640 1 -- 172.21.15.181:0/1407190016 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4950044020 con 0x7f495815c4a0 2024-09-12T02:35:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.980+0000 7f493ffff640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f494406be30 0x7f494406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.980+0000 7f493ffff640 1 -- 172.21.15.181:0/1407190016 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f49500ab8c0 con 0x7f495815c4a0 2024-09-12T02:35:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.980+0000 7f49577fe640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f494406be30 0x7f494406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:47.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.981+0000 7f49577fe640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f494406be30 0x7f494406e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f494c009ac0 tx=0x7f494c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:47.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:47.988+0000 7f493ffff640 1 -- 172.21.15.181:0/1407190016 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f495004b030 con 0x7f495815c4a0 2024-09-12T02:35:48.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.180+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49580b6640 con 0x7f495815c4a0 2024-09-12T02:35:48.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.181+0000 7f493ffff640 1 -- 172.21.15.181:0/1407190016 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16805 (secure 0 0 0) 0x7f4950079c20 con 0x7f495815c4a0 2024-09-12T02:35:48.181 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:48.181 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":86,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:46.889052+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:45.493049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:45.855137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:48.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f494406be30 msgr2=0x7f494406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f494406be30 0x7f494406e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f494c009ac0 tx=0x7f494c009190 comp rx=0 tx=0).stop 2024-09-12T02:35:48.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495815c4a0 msgr2=0x7f49580b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495815c4a0 0x7f49580b06d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4950009f40 tx=0x7f4950004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:48.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 shutdown_connections 2024-09-12T02:35:48.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f494406be30 0x7f494406e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495815c4a0 0x7f49580b06d0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f49580d2da0 0x7f4958158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 --2- 172.21.15.181:0/1407190016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f49580b4090 0x7f4958146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 >> 172.21.15.181:0/1407190016 conn(0x7f4958067950 msgr2=0x7f49580b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 shutdown_connections 2024-09-12T02:35:48.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.183+0000 7f495dc8b640 1 -- 172.21.15.181:0/1407190016 wait complete. 2024-09-12T02:35:48.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:35:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.297+0000 7f91097cf640 1 Processor -- start 2024-09-12T02:35:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.297+0000 7f91097cf640 1 -- start start 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.298+0000 7f91097cf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9104160250 0x7f910415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.298+0000 7f91097cf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9104160750 con 0x7f91040ce8f0 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.298+0000 7f91097cf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9104160a30 con 0x7f9104073160 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.298+0000 7f91097cf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f9104160d10 con 0x7f9104160250 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.298+0000 7f9102ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f91040ce8f0 0x7f91040708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51262/0 (socket says 172.21.15.181:51262) 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.298+0000 7f9102ffd640 1 -- 172.21.15.181:0/3030485093 learned_addr learned my addr 172.21.15.181:0/3030485093 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 --2- 172.21.15.181:0/3030485093 >> v2:172.21.15.204:3300/0 conn(0x7f9104160250 0x7f910415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000821457 0 0) 0x7f9104160750 con 0x7f91040ce8f0 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f0003520 con 0x7f91040ce8f0 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 404714561 0 0) 0x7f90f0003520 con 0x7f91040ce8f0 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 >> v2:172.21.15.204:3300/0 conn(0x7f9104160250 msgr2=0x7f910415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 --2- 172.21.15.181:0/3030485093 >> v2:172.21.15.204:3300/0 conn(0x7f9104160250 0x7f910415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 >> v1:172.21.15.204:6789/0 conn(0x7f9104073160 legacy=0x7f9104073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9104160ff0 con 0x7f91040ce8f0 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f90f4001670 con 0x7f91040ce8f0 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 --2- 172.21.15.181:0/3030485093 >> v2:172.21.15.204:3300/0 conn(0x7f9104160250 0x7f910415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 >> v1:172.21.15.181:6789/0 conn(0x7f91040ce8f0 legacy=0x7f91040708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90f00039b0 0x7f90f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90f0004800 0x7f90f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f00051c0 0x7f90f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9104160d10 con 0x7f90f0004800 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f90f000c160 con 0x7f90f00051c0 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f90f000c360 con 0x7f90f00039b0 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90f0004800 0x7f90f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f9102ffd640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90f00039b0 0x7f90f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91037fe640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f00051c0 0x7f90f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 -- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90f00039b0 msgr2=0x7f90f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90f00039b0 0x7f90f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 -- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f00051c0 msgr2=0x7f90f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f00051c0 0x7f90f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f91037fe640 1 -- 172.21.15.181:0/3030485093 reap_dead start 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f90fbfff640 1 -- 172.21.15.181:0/3030485093 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f0003520 con 0x7f90f0004800 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.299+0000 7f9102ffd640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90f00039b0 0x7f90f0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.300+0000 7f90fbfff640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90f0004800 0x7f90f0004c80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009c60 tx=0x7f90f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb6f664a2fb5377 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.300+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec036070 con 0x7f90f0004800 2024-09-12T02:35:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ec031400 con 0x7f90f0004800 2024-09-12T02:35:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91027fc640 1 -- 172.21.15.181:0/3030485093 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec009860 con 0x7f90f0004800 2024-09-12T02:35:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91097cf640 1 -- 172.21.15.181:0/3030485093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90f0004800 msgr2=0x7f90f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91097cf640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90f0004800 0x7f90f0004c80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009c60 tx=0x7f90f0005830 comp rx=0 tx=0).stop 2024-09-12T02:35:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91097cf640 1 -- 172.21.15.181:0/3030485093 shutdown_connections 2024-09-12T02:35:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91097cf640 1 --2- 172.21.15.181:0/3030485093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90f0004800 0x7f90f0004c80 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91097cf640 1 -- 172.21.15.181:0/3030485093 >> 172.21.15.181:0/3030485093 conn(0x7f91040d2570 msgr2=0x7f91040d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91097cf640 1 -- 172.21.15.181:0/3030485093 shutdown_connections 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.301+0000 7f91097cf640 1 -- 172.21.15.181:0/3030485093 wait complete. 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.302+0000 7f91097cf640 1 Processor -- start 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.302+0000 7f91097cf640 1 -- start start 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91097cf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f0004800 0x7f910415f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91097cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91041585b0 0x7f91041e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91097cf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91040b2c90 0x7f91040b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91097cf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f91040d3250 con 0x7f91040b2c90 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91097cf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f91040d30d0 con 0x7f90f0004800 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91097cf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f910415cc10 con 0x7f91041585b0 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91037fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91040b2c90 0x7f91040b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91037fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91040b2c90 0x7f91040b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37944/0 (socket says 172.21.15.181:37944) 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f91037fe640 1 -- 172.21.15.181:0/3799822858 learned_addr learned my addr 172.21.15.181:0/3799822858 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f90fbfff640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91041585b0 0x7f91041e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.303+0000 7f9102ffd640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f0004800 0x7f910415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91037fe640 1 -- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91041585b0 msgr2=0x7f91041e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91037fe640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91041585b0 0x7f91041e6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91037fe640 1 -- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f0004800 msgr2=0x7f910415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91037fe640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f0004800 0x7f910415f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91037fe640 1 -- 172.21.15.181:0/3799822858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91041e6f90 con 0x7f91040b2c90 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91037fe640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91040b2c90 0x7f91040b3110 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9104075b30 tx=0x7f90fc00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f90fb7fe640 1 -- 172.21.15.181:0/3799822858 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc01a070 con 0x7f91040b2c90 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f90fb7fe640 1 -- 172.21.15.181:0/3799822858 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90fc006d60 con 0x7f91040b2c90 2024-09-12T02:35:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f90fb7fe640 1 -- 172.21.15.181:0/3799822858 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc003bb0 con 0x7f91040b2c90 2024-09-12T02:35:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91041e7260 con 0x7f91040b2c90 2024-09-12T02:35:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.304+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91041e7820 con 0x7f91040b2c90 2024-09-12T02:35:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.305+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91040d0090 con 0x7f91040b2c90 2024-09-12T02:35:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.306+0000 7f90fb7fe640 1 -- 172.21.15.181:0/3799822858 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90fc01d070 con 0x7f91040b2c90 2024-09-12T02:35:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.306+0000 7f90fb7fe640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f90e406be30 0x7f90e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.306+0000 7f90fb7fe640 1 -- 172.21.15.181:0/3799822858 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f90fc08a3f0 con 0x7f91040b2c90 2024-09-12T02:35:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.306+0000 7f9102ffd640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f90e406be30 0x7f90e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.307+0000 7f9102ffd640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f90e406be30 0x7f90e406e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f91040cd690 tx=0x7f90f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.314+0000 7f90fb7fe640 1 -- 172.21.15.181:0/3799822858 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90fc058e30 con 0x7f91040b2c90 2024-09-12T02:35:48.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.518+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9104158990 con 0x7f91040b2c90 2024-09-12T02:35:48.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.554+0000 7f90fb7fe640 1 -- 172.21.15.181:0/3799822858 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) ==== 118+0+0 (secure 0 0 0) 0x7f90fc058730 con 0x7f91040b2c90 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f90e406be30 msgr2=0x7f90e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f90e406be30 0x7f90e406e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f91040cd690 tx=0x7f90f4009040 comp rx=0 tx=0).stop 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91040b2c90 msgr2=0x7f91040b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91040b2c90 0x7f91040b3110 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9104075b30 tx=0x7f90fc00fc90 comp rx=0 tx=0).stop 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 shutdown_connections 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f90e406be30 0x7f90e406e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91040b2c90 0x7f91040b3110 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91041585b0 0x7f91041e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 --2- 172.21.15.181:0/3799822858 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90f0004800 0x7f910415f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 >> 172.21.15.181:0/3799822858 conn(0x7f91040d2570 msgr2=0x7f91040cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 shutdown_connections 2024-09-12T02:35:48.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.557+0000 7f91097cf640 1 -- 172.21.15.181:0/3799822858 wait complete. 2024-09-12T02:35:48.570 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:35:48.570 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:35:48.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.671+0000 7fb63a48d640 1 Processor -- start 2024-09-12T02:35:48.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.672+0000 7fb63a48d640 1 -- start start 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.672+0000 7fb63a48d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.672+0000 7fb63a48d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb6340b54e0 0x7fb634073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.672+0000 7fb63a48d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63415ec10 con 0x7fb63415e830 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.672+0000 7fb63a48d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb634071b10 con 0x7fb6340b54e0 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.672+0000 7fb63a48d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340cc500 con 0x7fb6340d2190 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.672+0000 7fb638a2a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb6340b54e0 0x7fb634073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb633fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb63415e830 0x7fb6340d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:51264/0 (socket says 172.21.15.181:51264) 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb633fff640 1 -- 172.21.15.181:0/565858174 learned_addr learned my addr 172.21.15.181:0/565858174 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb638a2a640 1 --2- 172.21.15.181:0/565858174 >> v2:172.21.15.181:3300/0 conn(0x7fb6340b54e0 0x7fb634073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37948/0 (socket says 172.21.15.181:37948) 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb6337fe640 1 --2- 172.21.15.181:0/565858174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb638a2a640 1 -- 172.21.15.181:0/565858174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 msgr2=0x7fb6340b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:48.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb638a2a640 1 --2- 172.21.15.181:0/565858174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb638a2a640 1 -- 172.21.15.181:0/565858174 >> v1:172.21.15.181:6789/0 conn(0x7fb63415e830 legacy=0x7fb6340d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb638a2a640 1 -- 172.21.15.181:0/565858174 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6340cc7e0 con 0x7fb6340b54e0 2024-09-12T02:35:48.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.673+0000 7fb638a2a640 1 --2- 172.21.15.181:0/565858174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6340b54e0 0x7fb634073440 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009d90 tx=0x7fb62c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c22fe480a3cb753 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb632ffd640 1 -- 172.21.15.181:0/565858174 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c031600 con 0x7fb6340b54e0 2024-09-12T02:35:48.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb632ffd640 1 -- 172.21.15.181:0/565858174 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c0317a0 con 0x7fb6340b54e0 2024-09-12T02:35:48.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb632ffd640 1 -- 172.21.15.181:0/565858174 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c031b70 con 0x7fb6340b54e0 2024-09-12T02:35:48.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 -- 172.21.15.181:0/565858174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6340b54e0 msgr2=0x7fb634073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 --2- 172.21.15.181:0/565858174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6340b54e0 0x7fb634073440 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009d90 tx=0x7fb62c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 -- 172.21.15.181:0/565858174 shutdown_connections 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 --2- 172.21.15.181:0/565858174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6340b54e0 0x7fb634073440 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 --2- 172.21.15.181:0/565858174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 -- 172.21.15.181:0/565858174 >> 172.21.15.181:0/565858174 conn(0x7fb6340d2570 msgr2=0x7fb6340d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 -- 172.21.15.181:0/565858174 shutdown_connections 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.674+0000 7fb63a48d640 1 -- 172.21.15.181:0/565858174 wait complete. 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.675+0000 7fb63a48d640 1 Processor -- start 2024-09-12T02:35:48.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb63a48d640 1 -- start start 2024-09-12T02:35:48.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb63a48d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6340b54e0 0x7fb6340ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb63a48d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb63a48d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb63415e830 0x7fb63415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb63a48d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340cc1b0 con 0x7fb63415e830 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb63a48d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340717a0 con 0x7fb6340b54e0 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb63a48d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340d1b20 con 0x7fb6340d2190 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb638a2a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb63415e830 0x7fb63415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb638a2a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb63415e830 0x7fb63415ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:37960/0 (socket says 172.21.15.181:37960) 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.676+0000 7fb638a2a640 1 -- 172.21.15.181:0/3372203528 learned_addr learned my addr 172.21.15.181:0/3372203528 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb6337fe640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb633fff640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6340b54e0 0x7fb6340ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb638a2a640 1 -- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 msgr2=0x7fb6340b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb638a2a640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb638a2a640 1 -- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6340b54e0 msgr2=0x7fb6340ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb638a2a640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6340b54e0 0x7fb6340ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb638a2a640 1 -- 172.21.15.181:0/3372203528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63415faa0 con 0x7fb63415e830 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb638a2a640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb63415e830 0x7fb63415ee20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02abc0 tx=0x7fb62c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb630ff9640 1 -- 172.21.15.181:0/3372203528 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c040070 con 0x7fb63415e830 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb630ff9640 1 -- 172.21.15.181:0/3372203528 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c030b60 con 0x7fb63415e830 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6340cd5c0 con 0x7fb63415e830 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb630ff9640 1 -- 172.21.15.181:0/3372203528 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c009450 con 0x7fb63415e830 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.677+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6340cdb80 con 0x7fb63415e830 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.678+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6340b1ad0 con 0x7fb63415e830 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.679+0000 7fb630ff9640 1 -- 172.21.15.181:0/3372203528 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb62c039040 con 0x7fb63415e830 2024-09-12T02:35:48.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.679+0000 7fb630ff9640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.679+0000 7fb633fff640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.679+0000 7fb630ff9640 1 -- 172.21.15.181:0/3372203528 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fb62c0ac440 con 0x7fb63415e830 2024-09-12T02:35:48.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.680+0000 7fb633fff640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb61406be30 0x7fb61406e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb634161910 tx=0x7fb624007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.684+0000 7fb630ff9640 1 -- 172.21.15.181:0/3372203528 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb62c07a7a0 con 0x7fb63415e830 2024-09-12T02:35:48.803 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-09-12T02:35:48.803+0000 7fe74e590640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:35:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:48.890+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb6340cdd50 con 0x7fb63415e830 2024-09-12T02:35:49.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.561+0000 7fb630ff9640 1 -- 172.21.15.181:0/3372203528 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) ==== 122+0+0 (secure 0 0 0) 0x7fb62c07eaa0 con 0x7fb63415e830 2024-09-12T02:35:49.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb61406be30 msgr2=0x7fb61406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb61406be30 0x7fb61406e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb634161910 tx=0x7fb624007e80 comp rx=0 tx=0).stop 2024-09-12T02:35:49.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb63415e830 msgr2=0x7fb63415ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb63415e830 0x7fb63415ee20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02abc0 tx=0x7fb62c004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:49.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 shutdown_connections 2024-09-12T02:35:49.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb63415e830 0x7fb63415ee20 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6340d2190 0x7fb6340b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 --2- 172.21.15.181:0/3372203528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6340b54e0 0x7fb6340ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 >> 172.21.15.181:0/3372203528 conn(0x7fb6340d2570 msgr2=0x7fb6340cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 shutdown_connections 2024-09-12T02:35:49.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.563+0000 7fb63a48d640 1 -- 172.21.15.181:0/3372203528 wait complete. 2024-09-12T02:35:49.576 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:35:49.576 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:49.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.674+0000 7fb874fd8640 1 Processor -- start 2024-09-12T02:35:49.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.674+0000 7fb874fd8640 1 -- start start 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb874fd8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb8700b2490 0x7fb870165db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb874fd8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8700ce480 con 0x7fb87015b1e0 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb874fd8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8700ce760 con 0x7fb8700cdfc0 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb874fd8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb8700cea40 con 0x7fb8700b2490 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86e59c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb87015b1e0 0x7fb8700b3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47172/0 (socket says 172.21.15.181:47172) 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86e59c640 1 -- 172.21.15.181:0/3336878762 learned_addr learned my addr 172.21.15.181:0/3336878762 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86ed9d640 1 --2- 172.21.15.181:0/3336878762 >> v2:172.21.15.204:3300/0 conn(0x7fb8700b2490 0x7fb870165db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469097551 0 0) 0x7fb8700ce480 con 0x7fb87015b1e0 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb85c003520 con 0x7fb87015b1e0 2024-09-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2055482173 0 0) 0x7fb85c003520 con 0x7fb87015b1e0 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 >> v2:172.21.15.204:3300/0 conn(0x7fb8700b2490 msgr2=0x7fb870165db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86dd9b640 1 --2- 172.21.15.181:0/3336878762 >> v2:172.21.15.204:3300/0 conn(0x7fb8700b2490 0x7fb870165db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.675+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 >> v1:172.21.15.204:6789/0 conn(0x7fb8700cdfc0 legacy=0x7fb8700b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8700ced20 con 0x7fb87015b1e0 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fb860001670 con 0x7fb87015b1e0 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 >> v1:172.21.15.181:6789/0 conn(0x7fb87015b1e0 legacy=0x7fb8700b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0039b0 0x7fb85c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb85c0043b0 0x7fb85c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c005080 0x7fb85c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb8700cea40 con 0x7fb85c0039b0 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c00bfe0 con 0x7fb85c005080 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c00c1e0 con 0x7fb85c0043b0 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86e59c640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0039b0 0x7fb85c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86ed9d640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c005080 0x7fb85c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb865d9b640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb85c0043b0 0x7fb85c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86e59c640 1 -- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb85c0043b0 msgr2=0x7fb85c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86e59c640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb85c0043b0 0x7fb85c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86e59c640 1 -- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c005080 msgr2=0x7fb85c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86e59c640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c005080 0x7fb85c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86ed9d640 1 -- 172.21.15.181:0/3336878762 reap_dead start 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb86e59c640 1 -- 172.21.15.181:0/3336878762 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c003520 con 0x7fb85c0039b0 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.676+0000 7fb865d9b640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb85c0043b0 0x7fb85c004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb86e59c640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0039b0 0x7fb85c003d90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c240 tx=0x7fb85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e059bc924572f077 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860007d10 con 0x7fb85c0039b0 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb860005ad0 con 0x7fb85c0039b0 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb86dd9b640 1 -- 172.21.15.181:0/3336878762 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860007070 con 0x7fb85c0039b0 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb874fd8640 1 -- 172.21.15.181:0/3336878762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0039b0 msgr2=0x7fb85c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb874fd8640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0039b0 0x7fb85c003d90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c240 tx=0x7fb85c005830 comp rx=0 tx=0).stop 2024-09-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb874fd8640 1 -- 172.21.15.181:0/3336878762 shutdown_connections 2024-09-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb874fd8640 1 --2- 172.21.15.181:0/3336878762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb85c0039b0 0x7fb85c003d90 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb874fd8640 1 -- 172.21.15.181:0/3336878762 >> 172.21.15.181:0/3336878762 conn(0x7fb87006bc10 msgr2=0x7fb87006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb874fd8640 1 -- 172.21.15.181:0/3336878762 shutdown_connections 2024-09-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.677+0000 7fb874fd8640 1 -- 172.21.15.181:0/3336878762 wait complete. 2024-09-12T02:35:49.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.679+0000 7fb874fd8640 1 Processor -- start 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.679+0000 7fb874fd8640 1 -- start start 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb874fd8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c0039b0 0x7fb87015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb874fd8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870071f90 0x7fb8701efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb874fd8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8701f01a0 0x7fb8701f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb874fd8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb8700b1d80 con 0x7fb870071f90 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb874fd8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb870071130 con 0x7fb85c0039b0 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb874fd8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb8700b1f00 con 0x7fb8701f01a0 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870071f90 0x7fb8701efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870071f90 0x7fb8701efc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33126/0 (socket says 172.21.15.181:33126) 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 -- 172.21.15.181:0/2472479515 learned_addr learned my addr 172.21.15.181:0/2472479515 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb86e59c640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c0039b0 0x7fb87015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb86ed9d640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8701f01a0 0x7fb8701f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 -- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8701f01a0 msgr2=0x7fb8701f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8701f01a0 0x7fb8701f0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 -- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c0039b0 msgr2=0x7fb87015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c0039b0 0x7fb87015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 -- 172.21.15.181:0/2472479515 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8701f0b60 con 0x7fb870071f90 2024-09-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb865d9b640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870071f90 0x7fb8701efc60 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb85800e550 tx=0x7fb85800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb8677fe640 1 -- 172.21.15.181:0/2472479515 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580052e0 con 0x7fb870071f90 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb8677fe640 1 -- 172.21.15.181:0/2472479515 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb858018070 con 0x7fb870071f90 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87015e5e0 con 0x7fb870071f90 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.680+0000 7fb8677fe640 1 -- 172.21.15.181:0/2472479515 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858003830 con 0x7fb870071f90 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.681+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb870072830 con 0x7fb870071f90 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.681+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb87006dd50 con 0x7fb870071f90 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.682+0000 7fb8677fe640 1 -- 172.21.15.181:0/2472479515 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8580039d0 con 0x7fb870071f90 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.682+0000 7fb8677fe640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb85006be60 0x7fb85006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.682+0000 7fb86e59c640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb85006be60 0x7fb85006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.683+0000 7fb8677fe640 1 -- 172.21.15.181:0/2472479515 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fb85808aa20 con 0x7fb870071f90 2024-09-12T02:35:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.683+0000 7fb86e59c640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb85006be60 0x7fb85006e320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb860032000 tx=0x7fb860009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.687+0000 7fb8677fe640 1 -- 172.21.15.181:0/2472479515 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb858058e40 con 0x7fb870071f90 2024-09-12T02:35:49.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.888+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb870068480 con 0x7fb870071f90 2024-09-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.888+0000 7fb8677fe640 1 -- 172.21.15.181:0/2472479515 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7fb85805d140 con 0x7fb870071f90 2024-09-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":69,"btime":"2024-09-12T02:35:49:556212+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4144308809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4144308809},{"type":"v1","addr":"172.21.15.204:6834","nonce":4144308809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6676,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/73375387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":73375387},{"type":"v1","addr":"172.21.15.181:6837","nonce":73375387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3782132497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3782132497},{"type":"v1","addr":"172.21.15.181:6836","nonce":3782132497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:46.889359+0000","modified":"2024-09-12T02:35:48.892202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/3487360283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3487360283},{"type":"v1","addr":"172.21.15.204:6835","nonce":3487360283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":6}]} 2024-09-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 69 2024-09-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb85006be60 msgr2=0x7fb85006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb85006be60 0x7fb85006e320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb860032000 tx=0x7fb860009030 comp rx=0 tx=0).stop 2024-09-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870071f90 msgr2=0x7fb8701efc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870071f90 0x7fb8701efc60 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb85800e550 tx=0x7fb85800ea10 comp rx=0 tx=0).stop 2024-09-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 shutdown_connections 2024-09-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb85006be60 0x7fb85006e320 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8701f01a0 0x7fb8701f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb870071f90 0x7fb8701efc60 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 --2- 172.21.15.181:0/2472479515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb85c0039b0 0x7fb87015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 >> 172.21.15.181:0/2472479515 conn(0x7fb87006bc10 msgr2=0x7fb8701583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 shutdown_connections 2024-09-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.890+0000 7fb874fd8640 1 -- 172.21.15.181:0/2472479515 wait complete. 2024-09-12T02:35:49.902 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:50.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.999+0000 7f8f40677640 1 Processor -- start 2024-09-12T02:35:50.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:49.999+0000 7f8f40677640 1 -- start start 2024-09-12T02:35:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f40677640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8f3815b1e0 0x7f8f380b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f40677640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380b41d0 0x7f8f380b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f40677640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8f380cdfc0 0x7f8f380b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f40677640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8f380ce480 con 0x7f8f380cdfc0 2024-09-12T02:35:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f40677640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8f380ce760 con 0x7f8f3815b1e0 2024-09-12T02:35:50.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f40677640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8f380cea40 con 0x7f8f380b41d0 2024-09-12T02:35:50.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8f380cdfc0 0x7f8f380b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8f380cdfc0 0x7f8f380b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33138/0 (socket says 172.21.15.181:33138) 2024-09-12T02:35:50.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 -- 172.21.15.181:0/1743502378 learned_addr learned my addr 172.21.15.181:0/1743502378 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:50.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 -- 172.21.15.181:0/1743502378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380b41d0 msgr2=0x7f8f380b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:50.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 --2- 172.21.15.181:0/1743502378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380b41d0 0x7f8f380b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 -- 172.21.15.181:0/1743502378 >> v2:172.21.15.204:3300/0 conn(0x7f8f3815b1e0 msgr2=0x7f8f380b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:50.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3e413640 1 --2- 172.21.15.181:0/1743502378 >> v2:172.21.15.204:3300/0 conn(0x7f8f3815b1e0 0x7f8f380b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 --2- 172.21.15.181:0/1743502378 >> v2:172.21.15.204:3300/0 conn(0x7f8f3815b1e0 0x7f8f380b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.000+0000 7f8f3ec14640 1 -- 172.21.15.181:0/1743502378 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f380ced20 con 0x7f8f380cdfc0 2024-09-12T02:35:50.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.001+0000 7f8f3ec14640 1 --2- 172.21.15.181:0/1743502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380cdfc0 0x7f8f380b22c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8f38069550 tx=0x7f8f3002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f98387726e6f21c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.001+0000 7f8f3d411640 1 -- 172.21.15.181:0/1743502378 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30036070 con 0x7f8f380cdfc0 2024-09-12T02:35:50.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.001+0000 7f8f3d411640 1 -- 172.21.15.181:0/1743502378 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30031600 con 0x7f8f380cdfc0 2024-09-12T02:35:50.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.001+0000 7f8f3d411640 1 -- 172.21.15.181:0/1743502378 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300319d0 con 0x7f8f380cdfc0 2024-09-12T02:35:50.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 -- 172.21.15.181:0/1743502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380cdfc0 msgr2=0x7f8f380b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 --2- 172.21.15.181:0/1743502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380cdfc0 0x7f8f380b22c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8f38069550 tx=0x7f8f3002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 -- 172.21.15.181:0/1743502378 shutdown_connections 2024-09-12T02:35:50.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 --2- 172.21.15.181:0/1743502378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380cdfc0 0x7f8f380b22c0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 --2- 172.21.15.181:0/1743502378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380b41d0 0x7f8f380b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 --2- 172.21.15.181:0/1743502378 >> v2:172.21.15.204:3300/0 conn(0x7f8f3815b1e0 0x7f8f380b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 -- 172.21.15.181:0/1743502378 >> 172.21.15.181:0/1743502378 conn(0x7f8f3806bc10 msgr2=0x7f8f3806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 -- 172.21.15.181:0/1743502378 shutdown_connections 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.002+0000 7f8f40677640 1 -- 172.21.15.181:0/1743502378 wait complete. 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.003+0000 7f8f40677640 1 Processor -- start 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.003+0000 7f8f40677640 1 -- start start 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f40677640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380b41d0 0x7f8f3814eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f40677640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380cdfc0 0x7f8f38157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f40677640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f3815b1e0 0x7f8f381578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f40677640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8f380ccad0 con 0x7f8f380b41d0 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f40677640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38071130 con 0x7f8f3815b1e0 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f40677640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8f380ccc50 con 0x7f8f380cdfc0 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380b41d0 0x7f8f3814eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380b41d0 0x7f8f3814eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33140/0 (socket says 172.21.15.181:33140) 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 -- 172.21.15.181:0/3265127318 learned_addr learned my addr 172.21.15.181:0/3265127318 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3dc12640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380cdfc0 0x7f8f38157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3ec14640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f3815b1e0 0x7f8f381578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 -- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380cdfc0 msgr2=0x7f8f38157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380cdfc0 0x7f8f38157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 -- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f3815b1e0 msgr2=0x7f8f381578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f3815b1e0 0x7f8f381578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 -- 172.21.15.181:0/3265127318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f38150380 con 0x7f8f380b41d0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.004+0000 7f8f3e413640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380b41d0 0x7f8f3814eb40 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c820 tx=0x7f8f3400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.005+0000 7f8f2effd640 1 -- 172.21.15.181:0/3265127318 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34015070 con 0x7f8f380b41d0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.005+0000 7f8f2effd640 1 -- 172.21.15.181:0/3265127318 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f34004220 con 0x7f8f380b41d0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.005+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f38150660 con 0x7f8f380b41d0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.005+0000 7f8f2effd640 1 -- 172.21.15.181:0/3265127318 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34007620 con 0x7f8f380b41d0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.005+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f38150c20 con 0x7f8f380b41d0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.006+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f380b3c90 con 0x7f8f380b41d0 2024-09-12T02:35:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.006+0000 7f8f2effd640 1 -- 172.21.15.181:0/3265127318 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f340077c0 con 0x7f8f380b41d0 2024-09-12T02:35:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.007+0000 7f8f2effd640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8f1c06be30 0x7f8f1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.007+0000 7f8f2effd640 1 -- 172.21.15.181:0/3265127318 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f8f3408aa80 con 0x7f8f380b41d0 2024-09-12T02:35:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.007+0000 7f8f3dc12640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8f1c06be30 0x7f8f1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.007+0000 7f8f3dc12640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8f1c06be30 0x7f8f1c06e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f381f5600 tx=0x7f8f28009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.011+0000 7f8f2effd640 1 -- 172.21.15.181:0/3265127318 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f34058e70 con 0x7f8f380b41d0 2024-09-12T02:35:50.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.178+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f38073f50 con 0x7f8f380b41d0 2024-09-12T02:35:50.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.179+0000 7f8f2effd640 1 -- 172.21.15.181:0/3265127318 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16792 (secure 0 0 0) 0x7f8f3405d170 con 0x7f8f380b41d0 2024-09-12T02:35:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:50.180 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":87,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:48.548645+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:45.493049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:45.855137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:50.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8f1c06be30 msgr2=0x7f8f1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8f1c06be30 0x7f8f1c06e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f381f5600 tx=0x7f8f28009110 comp rx=0 tx=0).stop 2024-09-12T02:35:50.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380b41d0 msgr2=0x7f8f3814eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380b41d0 0x7f8f3814eb40 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c820 tx=0x7f8f3400cc20 comp rx=0 tx=0).stop 2024-09-12T02:35:50.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 shutdown_connections 2024-09-12T02:35:50.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8f1c06be30 0x7f8f1c06e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8f3815b1e0 0x7f8f381578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8f380cdfc0 0x7f8f38157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 --2- 172.21.15.181:0/3265127318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f380b41d0 0x7f8f3814eb40 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 >> 172.21.15.181:0/3265127318 conn(0x7f8f3806bc10 msgr2=0x7f8f38073840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 shutdown_connections 2024-09-12T02:35:50.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.181+0000 7f8f40677640 1 -- 172.21.15.181:0/3265127318 wait complete. 2024-09-12T02:35:50.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:35:50.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:50.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.291+0000 7f8c0cd31640 1 Processor -- start 2024-09-12T02:35:50.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.291+0000 7f8c0cd31640 1 -- start start 2024-09-12T02:35:50.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c0cd31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0815ec50 0x7f8c080ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c0cd31640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c080aede0 0x7f8c080b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c0cd31640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0815f150 con 0x7f8c0815c2f0 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c0cd31640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8c080af230 con 0x7f8c080aede0 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c0cd31640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8c080b34c0 con 0x7f8c0815ec50 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c06d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c080aede0 0x7f8c080b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c06d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c080aede0 0x7f8c080b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33144/0 (socket says 172.21.15.181:33144) 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c06d9d640 1 -- 172.21.15.181:0/3027994124 learned_addr learned my addr 172.21.15.181:0/3027994124 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8bfdd9b640 1 --2- 172.21.15.181:0/3027994124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0815ec50 0x7f8c080ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c06d9d640 1 -- 172.21.15.181:0/3027994124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0815ec50 msgr2=0x7f8c080ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c06d9d640 1 --2- 172.21.15.181:0/3027994124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0815ec50 0x7f8c080ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c06d9d640 1 -- 172.21.15.181:0/3027994124 >> v1:172.21.15.204:6789/0 conn(0x7f8c0815c2f0 legacy=0x7f8c080af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.292+0000 7f8c06d9d640 1 -- 172.21.15.181:0/3027994124 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0815f430 con 0x7f8c080aede0 2024-09-12T02:35:50.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c06d9d640 1 --2- 172.21.15.181:0/3027994124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c080aede0 0x7f8c080b3950 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009e50 tx=0x7f8c0002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4149791d7c3f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c05d9b640 1 -- 172.21.15.181:0/3027994124 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00036070 con 0x7f8c080aede0 2024-09-12T02:35:50.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c05d9b640 1 -- 172.21.15.181:0/3027994124 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00031600 con 0x7f8c080aede0 2024-09-12T02:35:50.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c05d9b640 1 -- 172.21.15.181:0/3027994124 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c000319d0 con 0x7f8c080aede0 2024-09-12T02:35:50.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c0cd31640 1 -- 172.21.15.181:0/3027994124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c080aede0 msgr2=0x7f8c080b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/3027994124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c080aede0 0x7f8c080b3950 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009e50 tx=0x7f8c0002a710 comp rx=0 tx=0).stop 2024-09-12T02:35:50.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c0cd31640 1 -- 172.21.15.181:0/3027994124 shutdown_connections 2024-09-12T02:35:50.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/3027994124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c080aede0 0x7f8c080b3950 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/3027994124 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c0815ec50 0x7f8c080ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.293+0000 7f8c0cd31640 1 -- 172.21.15.181:0/3027994124 >> 172.21.15.181:0/3027994124 conn(0x7f8c080b21c0 msgr2=0x7f8c080b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.294+0000 7f8c0cd31640 1 -- 172.21.15.181:0/3027994124 shutdown_connections 2024-09-12T02:35:50.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.294+0000 7f8c0cd31640 1 -- 172.21.15.181:0/3027994124 wait complete. 2024-09-12T02:35:50.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.295+0000 7f8c0cd31640 1 Processor -- start 2024-09-12T02:35:50.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.295+0000 7f8c0cd31640 1 -- start start 2024-09-12T02:35:50.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0cd31640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c080aede0 0x7f8c0815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0cd31640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c0815c2f0 0x7f8c080cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0cd31640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0815ec50 0x7f8c08160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0cd31640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c080b3e90 con 0x7f8c0815c2f0 2024-09-12T02:35:50.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0cd31640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0815f9f0 con 0x7f8c0815ec50 2024-09-12T02:35:50.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0cd31640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8c080b4010 con 0x7f8c080aede0 2024-09-12T02:35:50.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c0815c2f0 0x7f8c080cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c0815c2f0 0x7f8c080cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33154/0 (socket says 172.21.15.181:33154) 2024-09-12T02:35:50.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 -- 172.21.15.181:0/720711751 learned_addr learned my addr 172.21.15.181:0/720711751 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:50.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c06d9d640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0815ec50 0x7f8c08160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0659c640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c080aede0 0x7f8c0815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 -- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c080aede0 msgr2=0x7f8c0815d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c080aede0 0x7f8c0815d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 -- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0815ec50 msgr2=0x7f8c08160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0815ec50 0x7f8c08160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 -- 172.21.15.181:0/720711751 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c080cea30 con 0x7f8c0815c2f0 2024-09-12T02:35:50.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bfdd9b640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c0815c2f0 0x7f8c080cf7f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000d5c0 tx=0x7f8bf000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bff7fe640 1 -- 172.21.15.181:0/720711751 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00125f0 con 0x7f8c0815c2f0 2024-09-12T02:35:50.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8bff7fe640 1 -- 172.21.15.181:0/720711751 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf0019070 con 0x7f8c0815c2f0 2024-09-12T02:35:50.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.296+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c080ced10 con 0x7f8c0815c2f0 2024-09-12T02:35:50.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.297+0000 7f8bff7fe640 1 -- 172.21.15.181:0/720711751 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00129d0 con 0x7f8c0815c2f0 2024-09-12T02:35:50.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.297+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c080cfd30 con 0x7f8c0815c2f0 2024-09-12T02:35:50.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.298+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c080d02f0 con 0x7f8c0815c2f0 2024-09-12T02:35:50.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.298+0000 7f8bff7fe640 1 -- 172.21.15.181:0/720711751 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bf0012b70 con 0x7f8c0815c2f0 2024-09-12T02:35:50.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.298+0000 7f8bff7fe640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8be806be30 0x7f8be806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.299+0000 7f8bff7fe640 1 -- 172.21.15.181:0/720711751 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f8bf008b080 con 0x7f8c0815c2f0 2024-09-12T02:35:50.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.299+0000 7f8c0659c640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8be806be30 0x7f8be806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.299+0000 7f8c0659c640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8be806be30 0x7f8be806e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8001780 tx=0x7f8bf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.303+0000 7f8bff7fe640 1 -- 172.21.15.181:0/720711751 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bf0059470 con 0x7f8c0815c2f0 2024-09-12T02:35:50.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.462+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c0815dfc0 con 0x7f8be806be30 2024-09-12T02:35:50.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.468+0000 7f8bff7fe640 1 -- 172.21.15.181:0/720711751 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251037 (secure 0 0 0) 0x7f8c0815dfc0 con 0x7f8be806be30 2024-09-12T02:35:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:50.473 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8be806be30 msgr2=0x7f8be806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8be806be30 0x7f8be806e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8001780 tx=0x7f8bf8009040 comp rx=0 tx=0).stop 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c0815c2f0 msgr2=0x7f8c080cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c0815c2f0 0x7f8c080cf7f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000d5c0 tx=0x7f8bf000da80 comp rx=0 tx=0).stop 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 shutdown_connections 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8be806be30 0x7f8be806e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c0815ec50 0x7f8c08160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c0815c2f0 0x7f8c080cf7f0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 --2- 172.21.15.181:0/720711751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c080aede0 0x7f8c0815d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 >> 172.21.15.181:0/720711751 conn(0x7f8c080b21c0 msgr2=0x7f8c080b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.471+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 shutdown_connections 2024-09-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.472+0000 7f8c0cd31640 1 -- 172.21.15.181:0/720711751 wait complete. 2024-09-12T02:35:50.483 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-12T02:35:49.708220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285164,"kb_used_data":9256,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689556,"statfs":{"total":773094113280,"available":772802105344,"internally_reserved":0,"allocated":9478144,"data_stored":4714591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.174349"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568596+0000","last_change":"2024-09-12T02:35:47.563930+0000","last_active":"2024-09-12T02:35:47.568596+0000","last_peered":"2024-09-12T02:35:47.568596+0000","last_clean":"2024-09-12T02:35:47.568596+0000","last_became_active":"2024-09-12T02:35:47.562924+0000","last_became_peered":"2024-09-12T02:35:47.562924+0000","last_unstale":"2024-09-12T02:35:47.568596+0000","last_undegraded":"2024-09-12T02:35:47.568596+0000","last_fullsized":"2024-09-12T02:35:47.568596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566368+0000","last_change":"2024-09-12T02:35:47.565295+0000","last_active":"2024-09-12T02:35:47.566368+0000","last_peered":"2024-09-12T02:35:47.566368+0000","last_clean":"2024-09-12T02:35:47.566368+0000","last_became_active":"2024-09-12T02:35:47.565057+0000","last_became_peered":"2024-09-12T02:35:47.565057+0000","last_unstale":"2024-09-12T02:35:47.566368+0000","last_undegraded":"2024-09-12T02:35:47.566368+0000","last_fullsized":"2024-09-12T02:35:47.566368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:51.213622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573780+0000","last_change":"2024-09-12T02:35:47.570484+0000","last_active":"2024-09-12T02:35:47.573780+0000","last_peered":"2024-09-12T02:35:47.573780+0000","last_clean":"2024-09-12T02:35:47.573780+0000","last_became_active":"2024-09-12T02:35:47.570214+0000","last_became_peered":"2024-09-12T02:35:47.570214+0000","last_unstale":"2024-09-12T02:35:47.573780+0000","last_undegraded":"2024-09-12T02:35:47.573780+0000","last_fullsized":"2024-09-12T02:35:47.573780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:21.256870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.550694+0000","last_change":"2024-09-12T02:35:46.550694+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.550694+0000","last_undegraded":"2024-09-12T02:35:46.550694+0000","last_fullsized":"2024-09-12T02:35:46.550694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552531+0000","last_change":"2024-09-12T02:35:47.550460+0000","last_active":"2024-09-12T02:35:47.552531+0000","last_peered":"2024-09-12T02:35:47.552531+0000","last_clean":"2024-09-12T02:35:47.552531+0000","last_became_active":"2024-09-12T02:35:47.550185+0000","last_became_peered":"2024-09-12T02:35:47.550185+0000","last_unstale":"2024-09-12T02:35:47.552531+0000","last_undegraded":"2024-09-12T02:35:47.552531+0000","last_fullsized":"2024-09-12T02:35:47.552531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571418+0000","last_change":"2024-09-12T02:35:47.568596+0000","last_active":"2024-09-12T02:35:47.571418+0000","last_peered":"2024-09-12T02:35:47.571418+0000","last_clean":"2024-09-12T02:35:47.571418+0000","last_became_active":"2024-09-12T02:35:47.568345+0000","last_became_peered":"2024-09-12T02:35:47.568345+0000","last_unstale":"2024-09-12T02:35:47.571418+0000","last_undegraded":"2024-09-12T02:35:47.571418+0000","last_fullsized":"2024-09-12T02:35:47.571418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.549015+0000","last_change":"2024-09-12T02:35:46.549015+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.549015+0000","last_undegraded":"2024-09-12T02:35:46.549015+0000","last_fullsized":"2024-09-12T02:35:46.549015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571412+0000","last_change":"2024-09-12T02:35:47.568454+0000","last_active":"2024-09-12T02:35:47.571412+0000","last_peered":"2024-09-12T02:35:47.571412+0000","last_clean":"2024-09-12T02:35:47.571412+0000","last_became_active":"2024-09-12T02:35:47.568201+0000","last_became_peered":"2024-09-12T02:35:47.568201+0000","last_unstale":"2024-09-12T02:35:47.571412+0000","last_undegraded":"2024-09-12T02:35:47.571412+0000","last_fullsized":"2024-09-12T02:35:47.571412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:27.277743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563608+0000","last_change":"2024-09-12T02:35:47.561792+0000","last_active":"2024-09-12T02:35:47.563608+0000","last_peered":"2024-09-12T02:35:47.563608+0000","last_clean":"2024-09-12T02:35:47.563608+0000","last_became_active":"2024-09-12T02:35:47.560908+0000","last_became_peered":"2024-09-12T02:35:47.560908+0000","last_unstale":"2024-09-12T02:35:47.563608+0000","last_undegraded":"2024-09-12T02:35:47.563608+0000","last_fullsized":"2024-09-12T02:35:47.563608+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559720+0000","last_change":"2024-09-12T02:35:47.557935+0000","last_active":"2024-09-12T02:35:47.559720+0000","last_peered":"2024-09-12T02:35:47.559720+0000","last_clean":"2024-09-12T02:35:47.559720+0000","last_became_active":"2024-09-12T02:35:47.557463+0000","last_became_peered":"2024-09-12T02:35:47.557463+0000","last_unstale":"2024-09-12T02:35:47.559720+0000","last_undegraded":"2024-09-12T02:35:47.559720+0000","last_fullsized":"2024-09-12T02:35:47.559720+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566757+0000","last_change":"2024-09-12T02:35:47.564524+0000","last_active":"2024-09-12T02:35:47.566757+0000","last_peered":"2024-09-12T02:35:47.566757+0000","last_clean":"2024-09-12T02:35:47.566757+0000","last_became_active":"2024-09-12T02:35:47.562298+0000","last_became_peered":"2024-09-12T02:35:47.562298+0000","last_unstale":"2024-09-12T02:35:47.566757+0000","last_undegraded":"2024-09-12T02:35:47.566757+0000","last_fullsized":"2024-09-12T02:35:47.566757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:34.272059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560684+0000","last_change":"2024-09-12T02:35:47.559543+0000","last_active":"2024-09-12T02:35:47.560684+0000","last_peered":"2024-09-12T02:35:47.560684+0000","last_clean":"2024-09-12T02:35:47.560684+0000","last_became_active":"2024-09-12T02:35:47.558672+0000","last_became_peered":"2024-09-12T02:35:47.558672+0000","last_unstale":"2024-09-12T02:35:47.560684+0000","last_undegraded":"2024-09-12T02:35:47.560684+0000","last_fullsized":"2024-09-12T02:35:47.560684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568927+0000","last_change":"2024-09-12T02:35:47.566022+0000","last_active":"2024-09-12T02:35:47.568927+0000","last_peered":"2024-09-12T02:35:47.568927+0000","last_clean":"2024-09-12T02:35:47.568927+0000","last_became_active":"2024-09-12T02:35:47.565722+0000","last_became_peered":"2024-09-12T02:35:47.565722+0000","last_unstale":"2024-09-12T02:35:47.568927+0000","last_undegraded":"2024-09-12T02:35:47.568927+0000","last_fullsized":"2024-09-12T02:35:47.568927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.551574+0000","last_change":"2024-09-12T02:35:46.551574+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.551574+0000","last_undegraded":"2024-09-12T02:35:46.551574+0000","last_fullsized":"2024-09-12T02:35:46.551574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.547222+0000","last_change":"2024-09-12T02:35:46.547222+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.547222+0000","last_undegraded":"2024-09-12T02:35:46.547222+0000","last_fullsized":"2024-09-12T02:35:46.547222+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563349+0000","last_change":"2024-09-12T02:35:47.558932+0000","last_active":"2024-09-12T02:35:47.563349+0000","last_peered":"2024-09-12T02:35:47.563349+0000","last_clean":"2024-09-12T02:35:47.563349+0000","last_became_active":"2024-09-12T02:35:47.558677+0000","last_became_peered":"2024-09-12T02:35:47.558677+0000","last_unstale":"2024-09-12T02:35:47.563349+0000","last_undegraded":"2024-09-12T02:35:47.563349+0000","last_fullsized":"2024-09-12T02:35:47.563349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560413+0000","last_change":"2024-09-12T02:35:47.557164+0000","last_active":"2024-09-12T02:35:47.560413+0000","last_peered":"2024-09-12T02:35:47.560413+0000","last_clean":"2024-09-12T02:35:47.560413+0000","last_became_active":"2024-09-12T02:35:47.556845+0000","last_became_peered":"2024-09-12T02:35:47.556845+0000","last_unstale":"2024-09-12T02:35:47.560413+0000","last_undegraded":"2024-09-12T02:35:47.560413+0000","last_fullsized":"2024-09-12T02:35:47.560413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548757+0000","last_change":"2024-09-12T02:35:46.548757+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548757+0000","last_undegraded":"2024-09-12T02:35:46.548757+0000","last_fullsized":"2024-09-12T02:35:46.548757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556748+0000","last_change":"2024-09-12T02:35:47.551849+0000","last_active":"2024-09-12T02:35:47.556748+0000","last_peered":"2024-09-12T02:35:47.556748+0000","last_clean":"2024-09-12T02:35:47.556748+0000","last_became_active":"2024-09-12T02:35:47.551596+0000","last_became_peered":"2024-09-12T02:35:47.551596+0000","last_unstale":"2024-09-12T02:35:47.556748+0000","last_undegraded":"2024-09-12T02:35:47.556748+0000","last_fullsized":"2024-09-12T02:35:47.556748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.550253+0000","last_change":"2024-09-12T02:35:46.550253+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.550253+0000","last_undegraded":"2024-09-12T02:35:46.550253+0000","last_fullsized":"2024-09-12T02:35:46.550253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548734+0000","last_change":"2024-09-12T02:35:46.548734+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548734+0000","last_undegraded":"2024-09-12T02:35:46.548734+0000","last_fullsized":"2024-09-12T02:35:46.548734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560912+0000","last_change":"2024-09-12T02:35:47.552647+0000","last_active":"2024-09-12T02:35:47.560912+0000","last_peered":"2024-09-12T02:35:47.560912+0000","last_clean":"2024-09-12T02:35:47.560912+0000","last_became_active":"2024-09-12T02:35:47.552352+0000","last_became_peered":"2024-09-12T02:35:47.552352+0000","last_unstale":"2024-09-12T02:35:47.560912+0000","last_undegraded":"2024-09-12T02:35:47.560912+0000","last_fullsized":"2024-09-12T02:35:47.560912+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559610+0000","last_change":"2024-09-12T02:35:47.558637+0000","last_active":"2024-09-12T02:35:47.559610+0000","last_peered":"2024-09-12T02:35:47.559610+0000","last_clean":"2024-09-12T02:35:47.559610+0000","last_became_active":"2024-09-12T02:35:47.558335+0000","last_became_peered":"2024-09-12T02:35:47.558335+0000","last_unstale":"2024-09-12T02:35:47.559610+0000","last_undegraded":"2024-09-12T02:35:47.559610+0000","last_fullsized":"2024-09-12T02:35:47.559610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548117+0000","last_change":"2024-09-12T02:35:46.548117+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548117+0000","last_undegraded":"2024-09-12T02:35:46.548117+0000","last_fullsized":"2024-09-12T02:35:46.548117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566334+0000","last_change":"2024-09-12T02:35:47.565021+0000","last_active":"2024-09-12T02:35:47.566334+0000","last_peered":"2024-09-12T02:35:47.566334+0000","last_clean":"2024-09-12T02:35:47.566334+0000","last_became_active":"2024-09-12T02:35:47.564686+0000","last_became_peered":"2024-09-12T02:35:47.564686+0000","last_unstale":"2024-09-12T02:35:47.566334+0000","last_undegraded":"2024-09-12T02:35:47.566334+0000","last_fullsized":"2024-09-12T02:35:47.566334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:07.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569210+0000","last_change":"2024-09-12T02:35:47.567786+0000","last_active":"2024-09-12T02:35:47.569210+0000","last_peered":"2024-09-12T02:35:47.569210+0000","last_clean":"2024-09-12T02:35:47.569210+0000","last_became_active":"2024-09-12T02:35:47.567479+0000","last_became_peered":"2024-09-12T02:35:47.567479+0000","last_unstale":"2024-09-12T02:35:47.569210+0000","last_undegraded":"2024-09-12T02:35:47.569210+0000","last_fullsized":"2024-09-12T02:35:47.569210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560303+0000","last_change":"2024-09-12T02:35:47.554685+0000","last_active":"2024-09-12T02:35:47.560303+0000","last_peered":"2024-09-12T02:35:47.560303+0000","last_clean":"2024-09-12T02:35:47.560303+0000","last_became_active":"2024-09-12T02:35:47.554170+0000","last_became_peered":"2024-09-12T02:35:47.554170+0000","last_unstale":"2024-09-12T02:35:47.560303+0000","last_undegraded":"2024-09-12T02:35:47.560303+0000","last_fullsized":"2024-09-12T02:35:47.560303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566806+0000","last_change":"2024-09-12T02:35:47.561906+0000","last_active":"2024-09-12T02:35:47.566806+0000","last_peered":"2024-09-12T02:35:47.566806+0000","last_clean":"2024-09-12T02:35:47.566806+0000","last_became_active":"2024-09-12T02:35:47.561625+0000","last_became_peered":"2024-09-12T02:35:47.561625+0000","last_unstale":"2024-09-12T02:35:47.566806+0000","last_undegraded":"2024-09-12T02:35:47.566806+0000","last_fullsized":"2024-09-12T02:35:47.566806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560656+0000","last_change":"2024-09-12T02:35:47.552719+0000","last_active":"2024-09-12T02:35:47.560656+0000","last_peered":"2024-09-12T02:35:47.560656+0000","last_clean":"2024-09-12T02:35:47.560656+0000","last_became_active":"2024-09-12T02:35:47.552428+0000","last_became_peered":"2024-09-12T02:35:47.552428+0000","last_unstale":"2024-09-12T02:35:47.560656+0000","last_undegraded":"2024-09-12T02:35:47.560656+0000","last_fullsized":"2024-09-12T02:35:47.560656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.738029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565716+0000","last_change":"2024-09-12T02:35:47.559405+0000","last_active":"2024-09-12T02:35:47.565716+0000","last_peered":"2024-09-12T02:35:47.565716+0000","last_clean":"2024-09-12T02:35:47.565716+0000","last_became_active":"2024-09-12T02:35:47.556745+0000","last_became_peered":"2024-09-12T02:35:47.556745+0000","last_unstale":"2024-09-12T02:35:47.565716+0000","last_undegraded":"2024-09-12T02:35:47.565716+0000","last_fullsized":"2024-09-12T02:35:47.565716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.934159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551211+0000","last_change":"2024-09-12T02:35:47.549673+0000","last_active":"2024-09-12T02:35:47.551211+0000","last_peered":"2024-09-12T02:35:47.551211+0000","last_clean":"2024-09-12T02:35:47.551211+0000","last_became_active":"2024-09-12T02:35:47.549408+0000","last_became_peered":"2024-09-12T02:35:47.549408+0000","last_unstale":"2024-09-12T02:35:47.551211+0000","last_undegraded":"2024-09-12T02:35:47.551211+0000","last_fullsized":"2024-09-12T02:35:47.551211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564795+0000","last_change":"2024-09-12T02:35:47.561157+0000","last_active":"2024-09-12T02:35:47.564795+0000","last_peered":"2024-09-12T02:35:47.564795+0000","last_clean":"2024-09-12T02:35:47.564795+0000","last_became_active":"2024-09-12T02:35:47.560870+0000","last_became_peered":"2024-09-12T02:35:47.560870+0000","last_unstale":"2024-09-12T02:35:47.564795+0000","last_undegraded":"2024-09-12T02:35:47.564795+0000","last_fullsized":"2024-09-12T02:35:47.564795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562746+0000","last_change":"2024-09-12T02:35:47.559676+0000","last_active":"2024-09-12T02:35:47.562746+0000","last_peered":"2024-09-12T02:35:47.562746+0000","last_clean":"2024-09-12T02:35:47.562746+0000","last_became_active":"2024-09-12T02:35:47.559394+0000","last_became_peered":"2024-09-12T02:35:47.559394+0000","last_unstale":"2024-09-12T02:35:47.562746+0000","last_undegraded":"2024-09-12T02:35:47.562746+0000","last_fullsized":"2024-09-12T02:35:47.562746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568168+0000","last_change":"2024-09-12T02:35:46.561281+0000","last_active":"2024-09-12T02:35:47.568168+0000","last_peered":"2024-09-12T02:35:47.568168+0000","last_clean":"2024-09-12T02:35:47.568168+0000","last_became_active":"2024-09-12T02:35:46.561013+0000","last_became_peered":"2024-09-12T02:35:46.561013+0000","last_unstale":"2024-09-12T02:35:47.568168+0000","last_undegraded":"2024-09-12T02:35:47.568168+0000","last_fullsized":"2024-09-12T02:35:47.568168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568619+0000","last_change":"2024-09-12T02:35:47.564156+0000","last_active":"2024-09-12T02:35:47.568619+0000","last_peered":"2024-09-12T02:35:47.568619+0000","last_clean":"2024-09-12T02:35:47.568619+0000","last_became_active":"2024-09-12T02:35:47.563648+0000","last_became_peered":"2024-09-12T02:35:47.563648+0000","last_unstale":"2024-09-12T02:35:47.568619+0000","last_undegraded":"2024-09-12T02:35:47.568619+0000","last_fullsized":"2024-09-12T02:35:47.568619+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569335+0000","last_change":"2024-09-12T02:35:46.554200+0000","last_active":"2024-09-12T02:35:47.569335+0000","last_peered":"2024-09-12T02:35:47.569335+0000","last_clean":"2024-09-12T02:35:47.569335+0000","last_became_active":"2024-09-12T02:35:46.553896+0000","last_became_peered":"2024-09-12T02:35:46.553896+0000","last_unstale":"2024-09-12T02:35:47.569335+0000","last_undegraded":"2024-09-12T02:35:47.569335+0000","last_fullsized":"2024-09-12T02:35:47.569335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560489+0000","last_change":"2024-09-12T02:35:47.559318+0000","last_active":"2024-09-12T02:35:47.560489+0000","last_peered":"2024-09-12T02:35:47.560489+0000","last_clean":"2024-09-12T02:35:47.560489+0000","last_became_active":"2024-09-12T02:35:47.559060+0000","last_became_peered":"2024-09-12T02:35:47.559060+0000","last_unstale":"2024-09-12T02:35:47.560489+0000","last_undegraded":"2024-09-12T02:35:47.560489+0000","last_fullsized":"2024-09-12T02:35:47.560489+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565869+0000","last_change":"2024-09-12T02:35:46.554539+0000","last_active":"2024-09-12T02:35:47.565869+0000","last_peered":"2024-09-12T02:35:47.565869+0000","last_clean":"2024-09-12T02:35:47.565869+0000","last_became_active":"2024-09-12T02:35:46.554102+0000","last_became_peered":"2024-09-12T02:35:46.554102+0000","last_unstale":"2024-09-12T02:35:47.565869+0000","last_undegraded":"2024-09-12T02:35:47.565869+0000","last_fullsized":"2024-09-12T02:35:47.565869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:36.743023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567197+0000","last_change":"2024-09-12T02:35:47.564826+0000","last_active":"2024-09-12T02:35:47.567197+0000","last_peered":"2024-09-12T02:35:47.567197+0000","last_clean":"2024-09-12T02:35:47.567197+0000","last_became_active":"2024-09-12T02:35:47.564507+0000","last_became_peered":"2024-09-12T02:35:47.564507+0000","last_unstale":"2024-09-12T02:35:47.567197+0000","last_undegraded":"2024-09-12T02:35:47.567197+0000","last_fullsized":"2024-09-12T02:35:47.567197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:37.750492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564906+0000","last_change":"2024-09-12T02:35:46.556651+0000","last_active":"2024-09-12T02:35:47.564906+0000","last_peered":"2024-09-12T02:35:47.564906+0000","last_clean":"2024-09-12T02:35:47.564906+0000","last_became_active":"2024-09-12T02:35:46.556327+0000","last_became_peered":"2024-09-12T02:35:46.556327+0000","last_unstale":"2024-09-12T02:35:47.564906+0000","last_undegraded":"2024-09-12T02:35:47.564906+0000","last_fullsized":"2024-09-12T02:35:47.564906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.949797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565760+0000","last_change":"2024-09-12T02:35:47.560250+0000","last_active":"2024-09-12T02:35:47.565760+0000","last_peered":"2024-09-12T02:35:47.565760+0000","last_clean":"2024-09-12T02:35:47.565760+0000","last_became_active":"2024-09-12T02:35:47.559558+0000","last_became_peered":"2024-09-12T02:35:47.559558+0000","last_unstale":"2024-09-12T02:35:47.565760+0000","last_undegraded":"2024-09-12T02:35:47.565760+0000","last_fullsized":"2024-09-12T02:35:47.565760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:00.188617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567045+0000","last_change":"2024-09-12T02:35:46.554241+0000","last_active":"2024-09-12T02:35:47.567045+0000","last_peered":"2024-09-12T02:35:47.567045+0000","last_clean":"2024-09-12T02:35:47.567045+0000","last_became_active":"2024-09-12T02:35:46.553958+0000","last_became_peered":"2024-09-12T02:35:46.553958+0000","last_unstale":"2024-09-12T02:35:47.567045+0000","last_undegraded":"2024-09-12T02:35:47.567045+0000","last_fullsized":"2024-09-12T02:35:47.567045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.561379+0000","last_change":"2024-09-12T02:35:47.559441+0000","last_active":"2024-09-12T02:35:47.561379+0000","last_peered":"2024-09-12T02:35:47.561379+0000","last_clean":"2024-09-12T02:35:47.561379+0000","last_became_active":"2024-09-12T02:35:47.559046+0000","last_became_peered":"2024-09-12T02:35:47.559046+0000","last_unstale":"2024-09-12T02:35:47.561379+0000","last_undegraded":"2024-09-12T02:35:47.561379+0000","last_fullsized":"2024-09-12T02:35:47.561379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563705+0000","last_change":"2024-09-12T02:35:46.558161+0000","last_active":"2024-09-12T02:35:47.563705+0000","last_peered":"2024-09-12T02:35:47.563705+0000","last_clean":"2024-09-12T02:35:47.563705+0000","last_became_active":"2024-09-12T02:35:46.557836+0000","last_became_peered":"2024-09-12T02:35:46.557836+0000","last_unstale":"2024-09-12T02:35:47.563705+0000","last_undegraded":"2024-09-12T02:35:47.563705+0000","last_fullsized":"2024-09-12T02:35:47.563705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568890+0000","last_change":"2024-09-12T02:35:47.565152+0000","last_active":"2024-09-12T02:35:47.568890+0000","last_peered":"2024-09-12T02:35:47.568890+0000","last_clean":"2024-09-12T02:35:47.568890+0000","last_became_active":"2024-09-12T02:35:47.563838+0000","last_became_peered":"2024-09-12T02:35:47.563838+0000","last_unstale":"2024-09-12T02:35:47.568890+0000","last_undegraded":"2024-09-12T02:35:47.568890+0000","last_fullsized":"2024-09-12T02:35:47.568890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:31.526030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548082+0000","last_change":"2024-09-12T02:35:46.554449+0000","last_active":"2024-09-12T02:35:47.548082+0000","last_peered":"2024-09-12T02:35:47.548082+0000","last_clean":"2024-09-12T02:35:47.548082+0000","last_became_active":"2024-09-12T02:35:46.553756+0000","last_became_peered":"2024-09-12T02:35:46.553756+0000","last_unstale":"2024-09-12T02:35:47.548082+0000","last_undegraded":"2024-09-12T02:35:47.548082+0000","last_fullsized":"2024-09-12T02:35:47.548082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:26.270274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.546787+0000","last_change":"2024-09-12T02:35:46.546787+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.546787+0000","last_undegraded":"2024-09-12T02:35:46.546787+0000","last_fullsized":"2024-09-12T02:35:46.546787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.543449+0000","last_change":"2024-09-12T02:35:46.559650+0000","last_active":"2024-09-12T02:35:47.543449+0000","last_peered":"2024-09-12T02:35:47.543449+0000","last_clean":"2024-09-12T02:35:47.543449+0000","last_became_active":"2024-09-12T02:35:46.559382+0000","last_became_peered":"2024-09-12T02:35:46.559382+0000","last_unstale":"2024-09-12T02:35:47.543449+0000","last_undegraded":"2024-09-12T02:35:47.543449+0000","last_fullsized":"2024-09-12T02:35:47.543449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:10.746279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.546029+0000","last_change":"2024-09-12T02:35:46.546029+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.546029+0000","last_undegraded":"2024-09-12T02:35:46.546029+0000","last_fullsized":"2024-09-12T02:35:46.546029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552223+0000","last_change":"2024-09-12T02:35:46.557154+0000","last_active":"2024-09-12T02:35:47.552223+0000","last_peered":"2024-09-12T02:35:47.552223+0000","last_clean":"2024-09-12T02:35:47.552223+0000","last_became_active":"2024-09-12T02:35:46.556451+0000","last_became_peered":"2024-09-12T02:35:46.556451+0000","last_unstale":"2024-09-12T02:35:47.552223+0000","last_undegraded":"2024-09-12T02:35:47.552223+0000","last_fullsized":"2024-09-12T02:35:47.552223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571357+0000","last_change":"2024-09-12T02:35:47.567600+0000","last_active":"2024-09-12T02:35:47.571357+0000","last_peered":"2024-09-12T02:35:47.571357+0000","last_clean":"2024-09-12T02:35:47.571357+0000","last_became_active":"2024-09-12T02:35:47.567311+0000","last_became_peered":"2024-09-12T02:35:47.567311+0000","last_unstale":"2024-09-12T02:35:47.571357+0000","last_undegraded":"2024-09-12T02:35:47.571357+0000","last_fullsized":"2024-09-12T02:35:47.571357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:28.803475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551780+0000","last_change":"2024-09-12T02:35:46.554852+0000","last_active":"2024-09-12T02:35:47.551780+0000","last_peered":"2024-09-12T02:35:47.551780+0000","last_clean":"2024-09-12T02:35:47.551780+0000","last_became_active":"2024-09-12T02:35:46.554514+0000","last_became_peered":"2024-09-12T02:35:46.554514+0000","last_unstale":"2024-09-12T02:35:47.551780+0000","last_undegraded":"2024-09-12T02:35:47.551780+0000","last_fullsized":"2024-09-12T02:35:47.551780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567148+0000","last_change":"2024-09-12T02:35:47.562737+0000","last_active":"2024-09-12T02:35:47.567148+0000","last_peered":"2024-09-12T02:35:47.567148+0000","last_clean":"2024-09-12T02:35:47.567148+0000","last_became_active":"2024-09-12T02:35:47.562421+0000","last_became_peered":"2024-09-12T02:35:47.562421+0000","last_unstale":"2024-09-12T02:35:47.567148+0000","last_undegraded":"2024-09-12T02:35:47.567148+0000","last_fullsized":"2024-09-12T02:35:47.567148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562082+0000","last_change":"2024-09-12T02:35:46.559638+0000","last_active":"2024-09-12T02:35:47.562082+0000","last_peered":"2024-09-12T02:35:47.562082+0000","last_clean":"2024-09-12T02:35:47.562082+0000","last_became_active":"2024-09-12T02:35:46.559442+0000","last_became_peered":"2024-09-12T02:35:46.559442+0000","last_unstale":"2024-09-12T02:35:47.562082+0000","last_undegraded":"2024-09-12T02:35:47.562082+0000","last_fullsized":"2024-09-12T02:35:47.562082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:44.377608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560122+0000","last_change":"2024-09-12T02:35:47.552392+0000","last_active":"2024-09-12T02:35:47.560122+0000","last_peered":"2024-09-12T02:35:47.560122+0000","last_clean":"2024-09-12T02:35:47.560122+0000","last_became_active":"2024-09-12T02:35:47.551877+0000","last_became_peered":"2024-09-12T02:35:47.551877+0000","last_unstale":"2024-09-12T02:35:47.560122+0000","last_undegraded":"2024-09-12T02:35:47.560122+0000","last_fullsized":"2024-09-12T02:35:47.560122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573921+0000","last_change":"2024-09-12T02:35:46.555192+0000","last_active":"2024-09-12T02:35:47.573921+0000","last_peered":"2024-09-12T02:35:47.573921+0000","last_clean":"2024-09-12T02:35:47.573921+0000","last_became_active":"2024-09-12T02:35:46.554874+0000","last_became_peered":"2024-09-12T02:35:46.554874+0000","last_unstale":"2024-09-12T02:35:47.573921+0000","last_undegraded":"2024-09-12T02:35:47.573921+0000","last_fullsized":"2024-09-12T02:35:47.573921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:39.001935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567032+0000","last_change":"2024-09-12T02:35:47.561844+0000","last_active":"2024-09-12T02:35:47.567032+0000","last_peered":"2024-09-12T02:35:47.567032+0000","last_clean":"2024-09-12T02:35:47.567032+0000","last_became_active":"2024-09-12T02:35:47.561576+0000","last_became_peered":"2024-09-12T02:35:47.561576+0000","last_unstale":"2024-09-12T02:35:47.567032+0000","last_undegraded":"2024-09-12T02:35:47.567032+0000","last_fullsized":"2024-09-12T02:35:47.567032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567429+0000","last_change":"2024-09-12T02:35:46.557645+0000","last_active":"2024-09-12T02:35:47.567429+0000","last_peered":"2024-09-12T02:35:47.567429+0000","last_clean":"2024-09-12T02:35:47.567429+0000","last_became_active":"2024-09-12T02:35:46.557388+0000","last_became_peered":"2024-09-12T02:35:46.557388+0000","last_unstale":"2024-09-12T02:35:47.567429+0000","last_undegraded":"2024-09-12T02:35:47.567429+0000","last_fullsized":"2024-09-12T02:35:47.567429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:13.920180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567136+0000","last_change":"2024-09-12T02:35:47.563938+0000","last_active":"2024-09-12T02:35:47.567136+0000","last_peered":"2024-09-12T02:35:47.567136+0000","last_clean":"2024-09-12T02:35:47.567136+0000","last_became_active":"2024-09-12T02:35:47.563607+0000","last_became_peered":"2024-09-12T02:35:47.563607+0000","last_unstale":"2024-09-12T02:35:47.567136+0000","last_undegraded":"2024-09-12T02:35:47.567136+0000","last_fullsized":"2024-09-12T02:35:47.567136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:31.957266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555958+0000","last_change":"2024-09-12T02:35:46.554473+0000","last_active":"2024-09-12T02:35:46.555958+0000","last_peered":"2024-09-12T02:35:46.555958+0000","last_clean":"2024-09-12T02:35:46.555958+0000","last_became_active":"2024-09-12T02:35:46.554153+0000","last_became_peered":"2024-09-12T02:35:46.554153+0000","last_unstale":"2024-09-12T02:35:46.555958+0000","last_undegraded":"2024-09-12T02:35:46.555958+0000","last_fullsized":"2024-09-12T02:35:46.555958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:17.059148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560733+0000","last_change":"2024-09-12T02:35:47.557330+0000","last_active":"2024-09-12T02:35:47.560733+0000","last_peered":"2024-09-12T02:35:47.560733+0000","last_clean":"2024-09-12T02:35:47.560733+0000","last_became_active":"2024-09-12T02:35:47.557105+0000","last_became_peered":"2024-09-12T02:35:47.557105+0000","last_unstale":"2024-09-12T02:35:47.560733+0000","last_undegraded":"2024-09-12T02:35:47.560733+0000","last_fullsized":"2024-09-12T02:35:47.560733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:06.934622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.555099+0000","last_change":"2024-09-12T02:35:46.551757+0000","last_active":"2024-09-12T02:35:47.555099+0000","last_peered":"2024-09-12T02:35:47.555099+0000","last_clean":"2024-09-12T02:35:47.555099+0000","last_became_active":"2024-09-12T02:35:46.551465+0000","last_became_peered":"2024-09-12T02:35:46.551465+0000","last_unstale":"2024-09-12T02:35:47.555099+0000","last_undegraded":"2024-09-12T02:35:47.555099+0000","last_fullsized":"2024-09-12T02:35:47.555099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:59.913044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568033+0000","last_change":"2024-09-12T02:35:47.565375+0000","last_active":"2024-09-12T02:35:47.568033+0000","last_peered":"2024-09-12T02:35:47.568033+0000","last_clean":"2024-09-12T02:35:47.568033+0000","last_became_active":"2024-09-12T02:35:47.565111+0000","last_became_peered":"2024-09-12T02:35:47.565111+0000","last_unstale":"2024-09-12T02:35:47.568033+0000","last_undegraded":"2024-09-12T02:35:47.568033+0000","last_fullsized":"2024-09-12T02:35:47.568033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:07.767848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564890+0000","last_change":"2024-09-12T02:35:46.553376+0000","last_active":"2024-09-12T02:35:47.564890+0000","last_peered":"2024-09-12T02:35:47.564890+0000","last_clean":"2024-09-12T02:35:47.564890+0000","last_became_active":"2024-09-12T02:35:46.552720+0000","last_became_peered":"2024-09-12T02:35:46.552720+0000","last_unstale":"2024-09-12T02:35:47.564890+0000","last_undegraded":"2024-09-12T02:35:47.564890+0000","last_fullsized":"2024-09-12T02:35:47.564890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.187005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567171+0000","last_change":"2024-09-12T02:35:47.564398+0000","last_active":"2024-09-12T02:35:47.567171+0000","last_peered":"2024-09-12T02:35:47.567171+0000","last_clean":"2024-09-12T02:35:47.567171+0000","last_became_active":"2024-09-12T02:35:47.564149+0000","last_became_peered":"2024-09-12T02:35:47.564149+0000","last_unstale":"2024-09-12T02:35:47.567171+0000","last_undegraded":"2024-09-12T02:35:47.567171+0000","last_fullsized":"2024-09-12T02:35:47.567171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:49.428222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569596+0000","last_change":"2024-09-12T02:35:46.556394+0000","last_active":"2024-09-12T02:35:47.569596+0000","last_peered":"2024-09-12T02:35:47.569596+0000","last_clean":"2024-09-12T02:35:47.569596+0000","last_became_active":"2024-09-12T02:35:46.555836+0000","last_became_peered":"2024-09-12T02:35:46.555836+0000","last_unstale":"2024-09-12T02:35:47.569596+0000","last_undegraded":"2024-09-12T02:35:47.569596+0000","last_fullsized":"2024-09-12T02:35:47.569596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569270+0000","last_change":"2024-09-12T02:35:47.565967+0000","last_active":"2024-09-12T02:35:47.569270+0000","last_peered":"2024-09-12T02:35:47.569270+0000","last_clean":"2024-09-12T02:35:47.569270+0000","last_became_active":"2024-09-12T02:35:47.565712+0000","last_became_peered":"2024-09-12T02:35:47.565712+0000","last_unstale":"2024-09-12T02:35:47.569270+0000","last_undegraded":"2024-09-12T02:35:47.569270+0000","last_fullsized":"2024-09-12T02:35:47.569270+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565154+0000","last_change":"2024-09-12T02:35:46.557610+0000","last_active":"2024-09-12T02:35:47.565154+0000","last_peered":"2024-09-12T02:35:47.565154+0000","last_clean":"2024-09-12T02:35:47.565154+0000","last_became_active":"2024-09-12T02:35:46.557342+0000","last_became_peered":"2024-09-12T02:35:46.557342+0000","last_unstale":"2024-09-12T02:35:47.565154+0000","last_undegraded":"2024-09-12T02:35:47.565154+0000","last_fullsized":"2024-09-12T02:35:47.565154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:30.518562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560280+0000","last_change":"2024-09-12T02:35:47.554450+0000","last_active":"2024-09-12T02:35:47.560280+0000","last_peered":"2024-09-12T02:35:47.560280+0000","last_clean":"2024-09-12T02:35:47.560280+0000","last_became_active":"2024-09-12T02:35:47.553796+0000","last_became_peered":"2024-09-12T02:35:47.553796+0000","last_unstale":"2024-09-12T02:35:47.560280+0000","last_undegraded":"2024-09-12T02:35:47.560280+0000","last_fullsized":"2024-09-12T02:35:47.560280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549398+0000","last_change":"2024-09-12T02:35:46.554498+0000","last_active":"2024-09-12T02:35:47.549398+0000","last_peered":"2024-09-12T02:35:47.549398+0000","last_clean":"2024-09-12T02:35:47.549398+0000","last_became_active":"2024-09-12T02:35:46.553952+0000","last_became_peered":"2024-09-12T02:35:46.553952+0000","last_unstale":"2024-09-12T02:35:47.549398+0000","last_undegraded":"2024-09-12T02:35:47.549398+0000","last_fullsized":"2024-09-12T02:35:47.549398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:48.420754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.551160+0000","last_change":"2024-09-12T02:35:46.551160+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.551160+0000","last_undegraded":"2024-09-12T02:35:46.551160+0000","last_fullsized":"2024-09-12T02:35:46.551160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555994+0000","last_change":"2024-09-12T02:35:46.554380+0000","last_active":"2024-09-12T02:35:46.555994+0000","last_peered":"2024-09-12T02:35:46.555994+0000","last_clean":"2024-09-12T02:35:46.555994+0000","last_became_active":"2024-09-12T02:35:46.554101+0000","last_became_peered":"2024-09-12T02:35:46.554101+0000","last_unstale":"2024-09-12T02:35:46.555994+0000","last_undegraded":"2024-09-12T02:35:46.555994+0000","last_fullsized":"2024-09-12T02:35:46.555994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:41.768841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566799+0000","last_change":"2024-09-12T02:35:47.564388+0000","last_active":"2024-09-12T02:35:47.566799+0000","last_peered":"2024-09-12T02:35:47.566799+0000","last_clean":"2024-09-12T02:35:47.566799+0000","last_became_active":"2024-09-12T02:35:47.564109+0000","last_became_peered":"2024-09-12T02:35:47.564109+0000","last_unstale":"2024-09-12T02:35:47.566799+0000","last_undegraded":"2024-09-12T02:35:47.566799+0000","last_fullsized":"2024-09-12T02:35:47.566799+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:14.539957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.559043+0000","last_change":"2024-09-12T02:35:46.557363+0000","last_active":"2024-09-12T02:35:46.559043+0000","last_peered":"2024-09-12T02:35:46.559043+0000","last_clean":"2024-09-12T02:35:46.559043+0000","last_became_active":"2024-09-12T02:35:46.557054+0000","last_became_peered":"2024-09-12T02:35:46.557054+0000","last_unstale":"2024-09-12T02:35:46.559043+0000","last_undegraded":"2024-09-12T02:35:46.559043+0000","last_fullsized":"2024-09-12T02:35:46.559043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:53.395029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.547655+0000","last_change":"2024-09-12T02:35:46.547655+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.547655+0000","last_undegraded":"2024-09-12T02:35:46.547655+0000","last_fullsized":"2024-09-12T02:35:46.547655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.561475+0000","last_change":"2024-09-12T02:35:46.560646+0000","last_active":"2024-09-12T02:35:46.561475+0000","last_peered":"2024-09-12T02:35:46.561475+0000","last_clean":"2024-09-12T02:35:46.561475+0000","last_became_active":"2024-09-12T02:35:46.560281+0000","last_became_peered":"2024-09-12T02:35:46.560281+0000","last_unstale":"2024-09-12T02:35:46.561475+0000","last_undegraded":"2024-09-12T02:35:46.561475+0000","last_fullsized":"2024-09-12T02:35:46.561475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:15.293030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563636+0000","last_change":"2024-09-12T02:35:47.561258+0000","last_active":"2024-09-12T02:35:47.563636+0000","last_peered":"2024-09-12T02:35:47.563636+0000","last_clean":"2024-09-12T02:35:47.563636+0000","last_became_active":"2024-09-12T02:35:47.560964+0000","last_became_peered":"2024-09-12T02:35:47.560964+0000","last_unstale":"2024-09-12T02:35:47.563636+0000","last_undegraded":"2024-09-12T02:35:47.563636+0000","last_fullsized":"2024-09-12T02:35:47.563636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555480+0000","last_change":"2024-09-12T02:35:46.552700+0000","last_active":"2024-09-12T02:35:46.555480+0000","last_peered":"2024-09-12T02:35:46.555480+0000","last_clean":"2024-09-12T02:35:46.555480+0000","last_became_active":"2024-09-12T02:35:46.552416+0000","last_became_peered":"2024-09-12T02:35:46.552416+0000","last_unstale":"2024-09-12T02:35:46.555480+0000","last_undegraded":"2024-09-12T02:35:46.555480+0000","last_fullsized":"2024-09-12T02:35:46.555480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:16.091618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566209+0000","last_change":"2024-09-12T02:35:47.564929+0000","last_active":"2024-09-12T02:35:47.566209+0000","last_peered":"2024-09-12T02:35:47.566209+0000","last_clean":"2024-09-12T02:35:47.566209+0000","last_became_active":"2024-09-12T02:35:47.564632+0000","last_became_peered":"2024-09-12T02:35:47.564632+0000","last_unstale":"2024-09-12T02:35:47.566209+0000","last_undegraded":"2024-09-12T02:35:47.566209+0000","last_fullsized":"2024-09-12T02:35:47.566209+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565602+0000","last_change":"2024-09-12T02:35:46.550057+0000","last_active":"2024-09-12T02:35:47.565602+0000","last_peered":"2024-09-12T02:35:47.565602+0000","last_clean":"2024-09-12T02:35:47.565602+0000","last_became_active":"2024-09-12T02:35:46.549620+0000","last_became_peered":"2024-09-12T02:35:46.549620+0000","last_unstale":"2024-09-12T02:35:47.565602+0000","last_undegraded":"2024-09-12T02:35:47.565602+0000","last_fullsized":"2024-09-12T02:35:47.565602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:08.703290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573748+0000","last_change":"2024-09-12T02:35:47.570041+0000","last_active":"2024-09-12T02:35:47.573748+0000","last_peered":"2024-09-12T02:35:47.573748+0000","last_clean":"2024-09-12T02:35:47.573748+0000","last_became_active":"2024-09-12T02:35:47.569745+0000","last_became_peered":"2024-09-12T02:35:47.569745+0000","last_unstale":"2024-09-12T02:35:47.573748+0000","last_undegraded":"2024-09-12T02:35:47.573748+0000","last_fullsized":"2024-09-12T02:35:47.573748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.544098+0000","last_change":"2024-09-12T02:35:46.556974+0000","last_active":"2024-09-12T02:35:47.544098+0000","last_peered":"2024-09-12T02:35:47.544098+0000","last_clean":"2024-09-12T02:35:47.544098+0000","last_became_active":"2024-09-12T02:35:46.556679+0000","last_became_peered":"2024-09-12T02:35:46.556679+0000","last_unstale":"2024-09-12T02:35:47.544098+0000","last_undegraded":"2024-09-12T02:35:47.544098+0000","last_fullsized":"2024-09-12T02:35:47.544098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:04.764613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566829+0000","last_change":"2024-09-12T02:35:47.562760+0000","last_active":"2024-09-12T02:35:47.566829+0000","last_peered":"2024-09-12T02:35:47.566829+0000","last_clean":"2024-09-12T02:35:47.566829+0000","last_became_active":"2024-09-12T02:35:47.562486+0000","last_became_peered":"2024-09-12T02:35:47.562486+0000","last_unstale":"2024-09-12T02:35:47.566829+0000","last_undegraded":"2024-09-12T02:35:47.566829+0000","last_fullsized":"2024-09-12T02:35:47.566829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549761+0000","last_change":"2024-09-12T02:35:46.560913+0000","last_active":"2024-09-12T02:35:47.549761+0000","last_peered":"2024-09-12T02:35:47.549761+0000","last_clean":"2024-09-12T02:35:47.549761+0000","last_became_active":"2024-09-12T02:35:46.560622+0000","last_became_peered":"2024-09-12T02:35:46.560622+0000","last_unstale":"2024-09-12T02:35:47.549761+0000","last_undegraded":"2024-09-12T02:35:47.549761+0000","last_fullsized":"2024-09-12T02:35:47.549761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.269933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560072+0000","last_change":"2024-09-12T02:35:47.552179+0000","last_active":"2024-09-12T02:35:47.560072+0000","last_peered":"2024-09-12T02:35:47.560072+0000","last_clean":"2024-09-12T02:35:47.560072+0000","last_became_active":"2024-09-12T02:35:47.551519+0000","last_became_peered":"2024-09-12T02:35:47.551519+0000","last_unstale":"2024-09-12T02:35:47.560072+0000","last_undegraded":"2024-09-12T02:35:47.560072+0000","last_fullsized":"2024-09-12T02:35:47.560072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551345+0000","last_change":"2024-09-12T02:35:46.556235+0000","last_active":"2024-09-12T02:35:47.551345+0000","last_peered":"2024-09-12T02:35:47.551345+0000","last_clean":"2024-09-12T02:35:47.551345+0000","last_became_active":"2024-09-12T02:35:46.555843+0000","last_became_peered":"2024-09-12T02:35:46.555843+0000","last_unstale":"2024-09-12T02:35:47.551345+0000","last_undegraded":"2024-09-12T02:35:47.551345+0000","last_fullsized":"2024-09-12T02:35:47.551345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565776+0000","last_change":"2024-09-12T02:35:47.562441+0000","last_active":"2024-09-12T02:35:47.565776+0000","last_peered":"2024-09-12T02:35:47.565776+0000","last_clean":"2024-09-12T02:35:47.565776+0000","last_became_active":"2024-09-12T02:35:47.562116+0000","last_became_peered":"2024-09-12T02:35:47.562116+0000","last_unstale":"2024-09-12T02:35:47.565776+0000","last_undegraded":"2024-09-12T02:35:47.565776+0000","last_fullsized":"2024-09-12T02:35:47.565776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548999+0000","last_change":"2024-09-12T02:35:46.554033+0000","last_active":"2024-09-12T02:35:47.548999+0000","last_peered":"2024-09-12T02:35:47.548999+0000","last_clean":"2024-09-12T02:35:47.548999+0000","last_became_active":"2024-09-12T02:35:46.553741+0000","last_became_peered":"2024-09-12T02:35:46.553741+0000","last_unstale":"2024-09-12T02:35:47.548999+0000","last_undegraded":"2024-09-12T02:35:47.548999+0000","last_fullsized":"2024-09-12T02:35:47.548999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556909+0000","last_change":"2024-09-12T02:35:47.552427+0000","last_active":"2024-09-12T02:35:47.556909+0000","last_peered":"2024-09-12T02:35:47.556909+0000","last_clean":"2024-09-12T02:35:47.556909+0000","last_became_active":"2024-09-12T02:35:47.552172+0000","last_became_peered":"2024-09-12T02:35:47.552172+0000","last_unstale":"2024-09-12T02:35:47.556909+0000","last_undegraded":"2024-09-12T02:35:47.556909+0000","last_fullsized":"2024-09-12T02:35:47.556909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.545577+0000","last_change":"2024-09-12T02:35:46.557520+0000","last_active":"2024-09-12T02:35:47.545577+0000","last_peered":"2024-09-12T02:35:47.545577+0000","last_clean":"2024-09-12T02:35:47.545577+0000","last_became_active":"2024-09-12T02:35:46.557248+0000","last_became_peered":"2024-09-12T02:35:46.557248+0000","last_unstale":"2024-09-12T02:35:47.545577+0000","last_undegraded":"2024-09-12T02:35:47.545577+0000","last_fullsized":"2024-09-12T02:35:47.545577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569216+0000","last_change":"2024-09-12T02:35:47.568444+0000","last_active":"2024-09-12T02:35:47.569216+0000","last_peered":"2024-09-12T02:35:47.569216+0000","last_clean":"2024-09-12T02:35:47.569216+0000","last_became_active":"2024-09-12T02:35:47.568168+0000","last_became_peered":"2024-09-12T02:35:47.568168+0000","last_unstale":"2024-09-12T02:35:47.569216+0000","last_undegraded":"2024-09-12T02:35:47.569216+0000","last_fullsized":"2024-09-12T02:35:47.569216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549710+0000","last_change":"2024-09-12T02:35:46.556913+0000","last_active":"2024-09-12T02:35:47.549710+0000","last_peered":"2024-09-12T02:35:47.549710+0000","last_clean":"2024-09-12T02:35:47.549710+0000","last_became_active":"2024-09-12T02:35:46.555900+0000","last_became_peered":"2024-09-12T02:35:46.555900+0000","last_unstale":"2024-09-12T02:35:47.549710+0000","last_undegraded":"2024-09-12T02:35:47.549710+0000","last_fullsized":"2024-09-12T02:35:47.549710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:26.550563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566577+0000","last_change":"2024-09-12T02:35:47.562581+0000","last_active":"2024-09-12T02:35:47.566577+0000","last_peered":"2024-09-12T02:35:47.566577+0000","last_clean":"2024-09-12T02:35:47.566577+0000","last_became_active":"2024-09-12T02:35:47.562297+0000","last_became_peered":"2024-09-12T02:35:47.562297+0000","last_unstale":"2024-09-12T02:35:47.566577+0000","last_undegraded":"2024-09-12T02:35:47.566577+0000","last_fullsized":"2024-09-12T02:35:47.566577+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.547634+0000","last_change":"2024-09-12T02:35:46.551656+0000","last_active":"2024-09-12T02:35:47.547634+0000","last_peered":"2024-09-12T02:35:47.547634+0000","last_clean":"2024-09-12T02:35:47.547634+0000","last_became_active":"2024-09-12T02:35:46.551361+0000","last_became_peered":"2024-09-12T02:35:46.551361+0000","last_unstale":"2024-09-12T02:35:47.547634+0000","last_undegraded":"2024-09-12T02:35:47.547634+0000","last_fullsized":"2024-09-12T02:35:47.547634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.574291+0000","last_change":"2024-09-12T02:35:47.568904+0000","last_active":"2024-09-12T02:35:47.574291+0000","last_peered":"2024-09-12T02:35:47.574291+0000","last_clean":"2024-09-12T02:35:47.574291+0000","last_became_active":"2024-09-12T02:35:47.568611+0000","last_became_peered":"2024-09-12T02:35:47.568611+0000","last_unstale":"2024-09-12T02:35:47.574291+0000","last_undegraded":"2024-09-12T02:35:47.574291+0000","last_fullsized":"2024-09-12T02:35:47.574291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:46.102884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567096+0000","last_change":"2024-09-12T02:35:46.550127+0000","last_active":"2024-09-12T02:35:47.567096+0000","last_peered":"2024-09-12T02:35:47.567096+0000","last_clean":"2024-09-12T02:35:47.567096+0000","last_became_active":"2024-09-12T02:35:46.548956+0000","last_became_peered":"2024-09-12T02:35:46.548956+0000","last_unstale":"2024-09-12T02:35:47.567096+0000","last_undegraded":"2024-09-12T02:35:47.567096+0000","last_fullsized":"2024-09-12T02:35:47.567096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":294,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.557318+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:35:47.557318+0000","last_peered":"2024-09-12T02:35:47.557318+0000","last_clean":"2024-09-12T02:35:47.557318+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:35:47.557318+0000","last_undegraded":"2024-09-12T02:35:47.557318+0000","last_fullsized":"2024-09-12T02:35:47.557318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1060864,"data_stored":449836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46088,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325752,"statfs":{"total":96636764160,"available":96589570048,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41104,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330736,"statfs":{"total":96636764160,"available":96594673664,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542239,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1024000,"data_stored":436092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542238,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1024000,"data_stored":436092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:50.544 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:50.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.643+0000 7fa4f3ed7640 1 Processor -- start 2024-09-12T02:35:50.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.643+0000 7fa4f3ed7640 1 -- start start 2024-09-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f3ed7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa4ec156770 0x7fa4ec160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f3ed7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa4ec0afec0 0x7fa4ec0cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f3ed7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4ec160d50 con 0x7fa4ec0b0350 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f3ed7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa4ec0b61b0 con 0x7fa4ec156770 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f3ed7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa4ec0b6490 con 0x7fa4ec0afec0 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f1c73640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa4ec156770 0x7fa4ec160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f1c73640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa4ec156770 0x7fa4ec160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33156/0 (socket says 172.21.15.181:33156) 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.644+0000 7fa4f1c73640 1 -- 172.21.15.181:0/2328355613 learned_addr learned my addr 172.21.15.181:0/2328355613 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f1472640 1 --2- 172.21.15.181:0/2328355613 >> v2:172.21.15.204:3300/0 conn(0x7fa4ec0afec0 0x7fa4ec0cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f1c73640 1 -- 172.21.15.181:0/2328355613 >> v2:172.21.15.204:3300/0 conn(0x7fa4ec0afec0 msgr2=0x7fa4ec0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f1c73640 1 --2- 172.21.15.181:0/2328355613 >> v2:172.21.15.204:3300/0 conn(0x7fa4ec0afec0 0x7fa4ec0cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f1c73640 1 -- 172.21.15.181:0/2328355613 >> v1:172.21.15.204:6789/0 conn(0x7fa4ec0b0350 legacy=0x7fa4ec06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f1c73640 1 -- 172.21.15.181:0/2328355613 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec0b6770 con 0x7fa4ec156770 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f1472640 1 --2- 172.21.15.181:0/2328355613 >> v2:172.21.15.204:3300/0 conn(0x7fa4ec0afec0 0x7fa4ec0cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f1c73640 1 --2- 172.21.15.181:0/2328355613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec160810 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec070160 tx=0x7fa4e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd3e14a218b5ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f0c71640 1 -- 172.21.15.181:0/2328355613 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8037070 con 0x7fa4ec156770 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f0c71640 1 -- 172.21.15.181:0/2328355613 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8032440 con 0x7fa4ec156770 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.645+0000 7fa4f0c71640 1 -- 172.21.15.181:0/2328355613 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8032810 con 0x7fa4ec156770 2024-09-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/2328355613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 msgr2=0x7fa4ec160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/2328355613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec160810 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec070160 tx=0x7fa4e802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/2328355613 shutdown_connections 2024-09-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/2328355613 >> v2:172.21.15.204:3300/0 conn(0x7fa4ec0afec0 0x7fa4ec0cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/2328355613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec160810 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/2328355613 >> 172.21.15.181:0/2328355613 conn(0x7fa4ec0b1770 msgr2=0x7fa4ec0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/2328355613 shutdown_connections 2024-09-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.646+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/2328355613 wait complete. 2024-09-12T02:35:50.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.647+0000 7fa4f3ed7640 1 Processor -- start 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.647+0000 7fa4f3ed7640 1 -- start start 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f3ed7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4ec0afec0 0x7fa4ec159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f3ed7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4ec0b0350 0x7fa4ec1428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f3ed7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f3ed7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec156cd0 con 0x7fa4ec156770 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f3ed7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec156b50 con 0x7fa4ec0afec0 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f3ed7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec0cfd60 con 0x7fa4ec0b0350 2024-09-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec0aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33158/0 (socket says 172.21.15.181:33158) 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 -- 172.21.15.181:0/4034398354 learned_addr learned my addr 172.21.15.181:0/4034398354 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f1c73640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4ec0afec0 0x7fa4ec159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f1472640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4ec0b0350 0x7fa4ec1428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 -- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4ec0b0350 msgr2=0x7fa4ec1428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4ec0b0350 0x7fa4ec1428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 -- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4ec0afec0 msgr2=0x7fa4ec159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4ec0afec0 0x7fa4ec159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.648+0000 7fa4f2474640 1 -- 172.21.15.181:0/4034398354 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec143390 con 0x7fa4ec156770 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.649+0000 7fa4f2474640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec0aa490 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400c7b0 tx=0x7fa4e400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.649+0000 7fa4e27fc640 1 -- 172.21.15.181:0/4034398354 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4004b60 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.649+0000 7fa4e27fc640 1 -- 172.21.15.181:0/4034398354 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e4004d00 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.649+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ec143670 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.649+0000 7fa4e27fc640 1 -- 172.21.15.181:0/4034398354 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400aa90 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.649+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ec143c30 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.650+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ec0d00f0 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.650+0000 7fa4e27fc640 1 -- 172.21.15.181:0/4034398354 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4e400ac30 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.651+0000 7fa4e27fc640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa4d006be30 0x7fa4d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.651+0000 7fa4e27fc640 1 -- 172.21.15.181:0/4034398354 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fa4e408af60 con 0x7fa4ec156770 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.651+0000 7fa4f1c73640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa4d006be30 0x7fa4d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.651+0000 7fa4f1c73640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa4d006be30 0x7fa4d006e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8034000 tx=0x7fa4e802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.655+0000 7fa4e27fc640 1 -- 172.21.15.181:0/4034398354 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4e4020070 con 0x7fa4ec156770 2024-09-12T02:35:50.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.816+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4ec0cd3f0 con 0x7fa4d006be30 2024-09-12T02:35:50.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.822+0000 7fa4e27fc640 1 -- 172.21.15.181:0/4034398354 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251037 (secure 0 0 0) 0x7fa4ec0cd3f0 con 0x7fa4d006be30 2024-09-12T02:35:50.826 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:35:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa4d006be30 msgr2=0x7fa4d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa4d006be30 0x7fa4d006e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8034000 tx=0x7fa4e802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 msgr2=0x7fa4ec0aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec0aa490 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400c7b0 tx=0x7fa4e400cc70 comp rx=0 tx=0).stop 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 shutdown_connections 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fa4d006be30 0x7fa4d006e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4ec156770 0x7fa4ec0aa490 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4ec0b0350 0x7fa4ec1428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 --2- 172.21.15.181:0/4034398354 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4ec0afec0 0x7fa4ec159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 >> 172.21.15.181:0/4034398354 conn(0x7fa4ec0b1770 msgr2=0x7fa4ec1e5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 shutdown_connections 2024-09-12T02:35:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.825+0000 7fa4f3ed7640 1 -- 172.21.15.181:0/4034398354 wait complete. 2024-09-12T02:35:50.836 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-12T02:35:49.708220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285164,"kb_used_data":9256,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689556,"statfs":{"total":773094113280,"available":772802105344,"internally_reserved":0,"allocated":9478144,"data_stored":4714591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.174349"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568596+0000","last_change":"2024-09-12T02:35:47.563930+0000","last_active":"2024-09-12T02:35:47.568596+0000","last_peered":"2024-09-12T02:35:47.568596+0000","last_clean":"2024-09-12T02:35:47.568596+0000","last_became_active":"2024-09-12T02:35:47.562924+0000","last_became_peered":"2024-09-12T02:35:47.562924+0000","last_unstale":"2024-09-12T02:35:47.568596+0000","last_undegraded":"2024-09-12T02:35:47.568596+0000","last_fullsized":"2024-09-12T02:35:47.568596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566368+0000","last_change":"2024-09-12T02:35:47.565295+0000","last_active":"2024-09-12T02:35:47.566368+0000","last_peered":"2024-09-12T02:35:47.566368+0000","last_clean":"2024-09-12T02:35:47.566368+0000","last_became_active":"2024-09-12T02:35:47.565057+0000","last_became_peered":"2024-09-12T02:35:47.565057+0000","last_unstale":"2024-09-12T02:35:47.566368+0000","last_undegraded":"2024-09-12T02:35:47.566368+0000","last_fullsized":"2024-09-12T02:35:47.566368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:51.213622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573780+0000","last_change":"2024-09-12T02:35:47.570484+0000","last_active":"2024-09-12T02:35:47.573780+0000","last_peered":"2024-09-12T02:35:47.573780+0000","last_clean":"2024-09-12T02:35:47.573780+0000","last_became_active":"2024-09-12T02:35:47.570214+0000","last_became_peered":"2024-09-12T02:35:47.570214+0000","last_unstale":"2024-09-12T02:35:47.573780+0000","last_undegraded":"2024-09-12T02:35:47.573780+0000","last_fullsized":"2024-09-12T02:35:47.573780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:21.256870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.550694+0000","last_change":"2024-09-12T02:35:46.550694+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.550694+0000","last_undegraded":"2024-09-12T02:35:46.550694+0000","last_fullsized":"2024-09-12T02:35:46.550694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552531+0000","last_change":"2024-09-12T02:35:47.550460+0000","last_active":"2024-09-12T02:35:47.552531+0000","last_peered":"2024-09-12T02:35:47.552531+0000","last_clean":"2024-09-12T02:35:47.552531+0000","last_became_active":"2024-09-12T02:35:47.550185+0000","last_became_peered":"2024-09-12T02:35:47.550185+0000","last_unstale":"2024-09-12T02:35:47.552531+0000","last_undegraded":"2024-09-12T02:35:47.552531+0000","last_fullsized":"2024-09-12T02:35:47.552531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571418+0000","last_change":"2024-09-12T02:35:47.568596+0000","last_active":"2024-09-12T02:35:47.571418+0000","last_peered":"2024-09-12T02:35:47.571418+0000","last_clean":"2024-09-12T02:35:47.571418+0000","last_became_active":"2024-09-12T02:35:47.568345+0000","last_became_peered":"2024-09-12T02:35:47.568345+0000","last_unstale":"2024-09-12T02:35:47.571418+0000","last_undegraded":"2024-09-12T02:35:47.571418+0000","last_fullsized":"2024-09-12T02:35:47.571418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.549015+0000","last_change":"2024-09-12T02:35:46.549015+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.549015+0000","last_undegraded":"2024-09-12T02:35:46.549015+0000","last_fullsized":"2024-09-12T02:35:46.549015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571412+0000","last_change":"2024-09-12T02:35:47.568454+0000","last_active":"2024-09-12T02:35:47.571412+0000","last_peered":"2024-09-12T02:35:47.571412+0000","last_clean":"2024-09-12T02:35:47.571412+0000","last_became_active":"2024-09-12T02:35:47.568201+0000","last_became_peered":"2024-09-12T02:35:47.568201+0000","last_unstale":"2024-09-12T02:35:47.571412+0000","last_undegraded":"2024-09-12T02:35:47.571412+0000","last_fullsized":"2024-09-12T02:35:47.571412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:27.277743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563608+0000","last_change":"2024-09-12T02:35:47.561792+0000","last_active":"2024-09-12T02:35:47.563608+0000","last_peered":"2024-09-12T02:35:47.563608+0000","last_clean":"2024-09-12T02:35:47.563608+0000","last_became_active":"2024-09-12T02:35:47.560908+0000","last_became_peered":"2024-09-12T02:35:47.560908+0000","last_unstale":"2024-09-12T02:35:47.563608+0000","last_undegraded":"2024-09-12T02:35:47.563608+0000","last_fullsized":"2024-09-12T02:35:47.563608+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559720+0000","last_change":"2024-09-12T02:35:47.557935+0000","last_active":"2024-09-12T02:35:47.559720+0000","last_peered":"2024-09-12T02:35:47.559720+0000","last_clean":"2024-09-12T02:35:47.559720+0000","last_became_active":"2024-09-12T02:35:47.557463+0000","last_became_peered":"2024-09-12T02:35:47.557463+0000","last_unstale":"2024-09-12T02:35:47.559720+0000","last_undegraded":"2024-09-12T02:35:47.559720+0000","last_fullsized":"2024-09-12T02:35:47.559720+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566757+0000","last_change":"2024-09-12T02:35:47.564524+0000","last_active":"2024-09-12T02:35:47.566757+0000","last_peered":"2024-09-12T02:35:47.566757+0000","last_clean":"2024-09-12T02:35:47.566757+0000","last_became_active":"2024-09-12T02:35:47.562298+0000","last_became_peered":"2024-09-12T02:35:47.562298+0000","last_unstale":"2024-09-12T02:35:47.566757+0000","last_undegraded":"2024-09-12T02:35:47.566757+0000","last_fullsized":"2024-09-12T02:35:47.566757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:34.272059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560684+0000","last_change":"2024-09-12T02:35:47.559543+0000","last_active":"2024-09-12T02:35:47.560684+0000","last_peered":"2024-09-12T02:35:47.560684+0000","last_clean":"2024-09-12T02:35:47.560684+0000","last_became_active":"2024-09-12T02:35:47.558672+0000","last_became_peered":"2024-09-12T02:35:47.558672+0000","last_unstale":"2024-09-12T02:35:47.560684+0000","last_undegraded":"2024-09-12T02:35:47.560684+0000","last_fullsized":"2024-09-12T02:35:47.560684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568927+0000","last_change":"2024-09-12T02:35:47.566022+0000","last_active":"2024-09-12T02:35:47.568927+0000","last_peered":"2024-09-12T02:35:47.568927+0000","last_clean":"2024-09-12T02:35:47.568927+0000","last_became_active":"2024-09-12T02:35:47.565722+0000","last_became_peered":"2024-09-12T02:35:47.565722+0000","last_unstale":"2024-09-12T02:35:47.568927+0000","last_undegraded":"2024-09-12T02:35:47.568927+0000","last_fullsized":"2024-09-12T02:35:47.568927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.551574+0000","last_change":"2024-09-12T02:35:46.551574+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.551574+0000","last_undegraded":"2024-09-12T02:35:46.551574+0000","last_fullsized":"2024-09-12T02:35:46.551574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.547222+0000","last_change":"2024-09-12T02:35:46.547222+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.547222+0000","last_undegraded":"2024-09-12T02:35:46.547222+0000","last_fullsized":"2024-09-12T02:35:46.547222+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563349+0000","last_change":"2024-09-12T02:35:47.558932+0000","last_active":"2024-09-12T02:35:47.563349+0000","last_peered":"2024-09-12T02:35:47.563349+0000","last_clean":"2024-09-12T02:35:47.563349+0000","last_became_active":"2024-09-12T02:35:47.558677+0000","last_became_peered":"2024-09-12T02:35:47.558677+0000","last_unstale":"2024-09-12T02:35:47.563349+0000","last_undegraded":"2024-09-12T02:35:47.563349+0000","last_fullsized":"2024-09-12T02:35:47.563349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560413+0000","last_change":"2024-09-12T02:35:47.557164+0000","last_active":"2024-09-12T02:35:47.560413+0000","last_peered":"2024-09-12T02:35:47.560413+0000","last_clean":"2024-09-12T02:35:47.560413+0000","last_became_active":"2024-09-12T02:35:47.556845+0000","last_became_peered":"2024-09-12T02:35:47.556845+0000","last_unstale":"2024-09-12T02:35:47.560413+0000","last_undegraded":"2024-09-12T02:35:47.560413+0000","last_fullsized":"2024-09-12T02:35:47.560413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548757+0000","last_change":"2024-09-12T02:35:46.548757+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548757+0000","last_undegraded":"2024-09-12T02:35:46.548757+0000","last_fullsized":"2024-09-12T02:35:46.548757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556748+0000","last_change":"2024-09-12T02:35:47.551849+0000","last_active":"2024-09-12T02:35:47.556748+0000","last_peered":"2024-09-12T02:35:47.556748+0000","last_clean":"2024-09-12T02:35:47.556748+0000","last_became_active":"2024-09-12T02:35:47.551596+0000","last_became_peered":"2024-09-12T02:35:47.551596+0000","last_unstale":"2024-09-12T02:35:47.556748+0000","last_undegraded":"2024-09-12T02:35:47.556748+0000","last_fullsized":"2024-09-12T02:35:47.556748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.550253+0000","last_change":"2024-09-12T02:35:46.550253+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.550253+0000","last_undegraded":"2024-09-12T02:35:46.550253+0000","last_fullsized":"2024-09-12T02:35:46.550253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548734+0000","last_change":"2024-09-12T02:35:46.548734+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548734+0000","last_undegraded":"2024-09-12T02:35:46.548734+0000","last_fullsized":"2024-09-12T02:35:46.548734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560912+0000","last_change":"2024-09-12T02:35:47.552647+0000","last_active":"2024-09-12T02:35:47.560912+0000","last_peered":"2024-09-12T02:35:47.560912+0000","last_clean":"2024-09-12T02:35:47.560912+0000","last_became_active":"2024-09-12T02:35:47.552352+0000","last_became_peered":"2024-09-12T02:35:47.552352+0000","last_unstale":"2024-09-12T02:35:47.560912+0000","last_undegraded":"2024-09-12T02:35:47.560912+0000","last_fullsized":"2024-09-12T02:35:47.560912+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559610+0000","last_change":"2024-09-12T02:35:47.558637+0000","last_active":"2024-09-12T02:35:47.559610+0000","last_peered":"2024-09-12T02:35:47.559610+0000","last_clean":"2024-09-12T02:35:47.559610+0000","last_became_active":"2024-09-12T02:35:47.558335+0000","last_became_peered":"2024-09-12T02:35:47.558335+0000","last_unstale":"2024-09-12T02:35:47.559610+0000","last_undegraded":"2024-09-12T02:35:47.559610+0000","last_fullsized":"2024-09-12T02:35:47.559610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548117+0000","last_change":"2024-09-12T02:35:46.548117+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548117+0000","last_undegraded":"2024-09-12T02:35:46.548117+0000","last_fullsized":"2024-09-12T02:35:46.548117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566334+0000","last_change":"2024-09-12T02:35:47.565021+0000","last_active":"2024-09-12T02:35:47.566334+0000","last_peered":"2024-09-12T02:35:47.566334+0000","last_clean":"2024-09-12T02:35:47.566334+0000","last_became_active":"2024-09-12T02:35:47.564686+0000","last_became_peered":"2024-09-12T02:35:47.564686+0000","last_unstale":"2024-09-12T02:35:47.566334+0000","last_undegraded":"2024-09-12T02:35:47.566334+0000","last_fullsized":"2024-09-12T02:35:47.566334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:07.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569210+0000","last_change":"2024-09-12T02:35:47.567786+0000","last_active":"2024-09-12T02:35:47.569210+0000","last_peered":"2024-09-12T02:35:47.569210+0000","last_clean":"2024-09-12T02:35:47.569210+0000","last_became_active":"2024-09-12T02:35:47.567479+0000","last_became_peered":"2024-09-12T02:35:47.567479+0000","last_unstale":"2024-09-12T02:35:47.569210+0000","last_undegraded":"2024-09-12T02:35:47.569210+0000","last_fullsized":"2024-09-12T02:35:47.569210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560303+0000","last_change":"2024-09-12T02:35:47.554685+0000","last_active":"2024-09-12T02:35:47.560303+0000","last_peered":"2024-09-12T02:35:47.560303+0000","last_clean":"2024-09-12T02:35:47.560303+0000","last_became_active":"2024-09-12T02:35:47.554170+0000","last_became_peered":"2024-09-12T02:35:47.554170+0000","last_unstale":"2024-09-12T02:35:47.560303+0000","last_undegraded":"2024-09-12T02:35:47.560303+0000","last_fullsized":"2024-09-12T02:35:47.560303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566806+0000","last_change":"2024-09-12T02:35:47.561906+0000","last_active":"2024-09-12T02:35:47.566806+0000","last_peered":"2024-09-12T02:35:47.566806+0000","last_clean":"2024-09-12T02:35:47.566806+0000","last_became_active":"2024-09-12T02:35:47.561625+0000","last_became_peered":"2024-09-12T02:35:47.561625+0000","last_unstale":"2024-09-12T02:35:47.566806+0000","last_undegraded":"2024-09-12T02:35:47.566806+0000","last_fullsized":"2024-09-12T02:35:47.566806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560656+0000","last_change":"2024-09-12T02:35:47.552719+0000","last_active":"2024-09-12T02:35:47.560656+0000","last_peered":"2024-09-12T02:35:47.560656+0000","last_clean":"2024-09-12T02:35:47.560656+0000","last_became_active":"2024-09-12T02:35:47.552428+0000","last_became_peered":"2024-09-12T02:35:47.552428+0000","last_unstale":"2024-09-12T02:35:47.560656+0000","last_undegraded":"2024-09-12T02:35:47.560656+0000","last_fullsized":"2024-09-12T02:35:47.560656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.738029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565716+0000","last_change":"2024-09-12T02:35:47.559405+0000","last_active":"2024-09-12T02:35:47.565716+0000","last_peered":"2024-09-12T02:35:47.565716+0000","last_clean":"2024-09-12T02:35:47.565716+0000","last_became_active":"2024-09-12T02:35:47.556745+0000","last_became_peered":"2024-09-12T02:35:47.556745+0000","last_unstale":"2024-09-12T02:35:47.565716+0000","last_undegraded":"2024-09-12T02:35:47.565716+0000","last_fullsized":"2024-09-12T02:35:47.565716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.934159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551211+0000","last_change":"2024-09-12T02:35:47.549673+0000","last_active":"2024-09-12T02:35:47.551211+0000","last_peered":"2024-09-12T02:35:47.551211+0000","last_clean":"2024-09-12T02:35:47.551211+0000","last_became_active":"2024-09-12T02:35:47.549408+0000","last_became_peered":"2024-09-12T02:35:47.549408+0000","last_unstale":"2024-09-12T02:35:47.551211+0000","last_undegraded":"2024-09-12T02:35:47.551211+0000","last_fullsized":"2024-09-12T02:35:47.551211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564795+0000","last_change":"2024-09-12T02:35:47.561157+0000","last_active":"2024-09-12T02:35:47.564795+0000","last_peered":"2024-09-12T02:35:47.564795+0000","last_clean":"2024-09-12T02:35:47.564795+0000","last_became_active":"2024-09-12T02:35:47.560870+0000","last_became_peered":"2024-09-12T02:35:47.560870+0000","last_unstale":"2024-09-12T02:35:47.564795+0000","last_undegraded":"2024-09-12T02:35:47.564795+0000","last_fullsized":"2024-09-12T02:35:47.564795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562746+0000","last_change":"2024-09-12T02:35:47.559676+0000","last_active":"2024-09-12T02:35:47.562746+0000","last_peered":"2024-09-12T02:35:47.562746+0000","last_clean":"2024-09-12T02:35:47.562746+0000","last_became_active":"2024-09-12T02:35:47.559394+0000","last_became_peered":"2024-09-12T02:35:47.559394+0000","last_unstale":"2024-09-12T02:35:47.562746+0000","last_undegraded":"2024-09-12T02:35:47.562746+0000","last_fullsized":"2024-09-12T02:35:47.562746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568168+0000","last_change":"2024-09-12T02:35:46.561281+0000","last_active":"2024-09-12T02:35:47.568168+0000","last_peered":"2024-09-12T02:35:47.568168+0000","last_clean":"2024-09-12T02:35:47.568168+0000","last_became_active":"2024-09-12T02:35:46.561013+0000","last_became_peered":"2024-09-12T02:35:46.561013+0000","last_unstale":"2024-09-12T02:35:47.568168+0000","last_undegraded":"2024-09-12T02:35:47.568168+0000","last_fullsized":"2024-09-12T02:35:47.568168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568619+0000","last_change":"2024-09-12T02:35:47.564156+0000","last_active":"2024-09-12T02:35:47.568619+0000","last_peered":"2024-09-12T02:35:47.568619+0000","last_clean":"2024-09-12T02:35:47.568619+0000","last_became_active":"2024-09-12T02:35:47.563648+0000","last_became_peered":"2024-09-12T02:35:47.563648+0000","last_unstale":"2024-09-12T02:35:47.568619+0000","last_undegraded":"2024-09-12T02:35:47.568619+0000","last_fullsized":"2024-09-12T02:35:47.568619+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569335+0000","last_change":"2024-09-12T02:35:46.554200+0000","last_active":"2024-09-12T02:35:47.569335+0000","last_peered":"2024-09-12T02:35:47.569335+0000","last_clean":"2024-09-12T02:35:47.569335+0000","last_became_active":"2024-09-12T02:35:46.553896+0000","last_became_peered":"2024-09-12T02:35:46.553896+0000","last_unstale":"2024-09-12T02:35:47.569335+0000","last_undegraded":"2024-09-12T02:35:47.569335+0000","last_fullsized":"2024-09-12T02:35:47.569335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560489+0000","last_change":"2024-09-12T02:35:47.559318+0000","last_active":"2024-09-12T02:35:47.560489+0000","last_peered":"2024-09-12T02:35:47.560489+0000","last_clean":"2024-09-12T02:35:47.560489+0000","last_became_active":"2024-09-12T02:35:47.559060+0000","last_became_peered":"2024-09-12T02:35:47.559060+0000","last_unstale":"2024-09-12T02:35:47.560489+0000","last_undegraded":"2024-09-12T02:35:47.560489+0000","last_fullsized":"2024-09-12T02:35:47.560489+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565869+0000","last_change":"2024-09-12T02:35:46.554539+0000","last_active":"2024-09-12T02:35:47.565869+0000","last_peered":"2024-09-12T02:35:47.565869+0000","last_clean":"2024-09-12T02:35:47.565869+0000","last_became_active":"2024-09-12T02:35:46.554102+0000","last_became_peered":"2024-09-12T02:35:46.554102+0000","last_unstale":"2024-09-12T02:35:47.565869+0000","last_undegraded":"2024-09-12T02:35:47.565869+0000","last_fullsized":"2024-09-12T02:35:47.565869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:36.743023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567197+0000","last_change":"2024-09-12T02:35:47.564826+0000","last_active":"2024-09-12T02:35:47.567197+0000","last_peered":"2024-09-12T02:35:47.567197+0000","last_clean":"2024-09-12T02:35:47.567197+0000","last_became_active":"2024-09-12T02:35:47.564507+0000","last_became_peered":"2024-09-12T02:35:47.564507+0000","last_unstale":"2024-09-12T02:35:47.567197+0000","last_undegraded":"2024-09-12T02:35:47.567197+0000","last_fullsized":"2024-09-12T02:35:47.567197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:37.750492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564906+0000","last_change":"2024-09-12T02:35:46.556651+0000","last_active":"2024-09-12T02:35:47.564906+0000","last_peered":"2024-09-12T02:35:47.564906+0000","last_clean":"2024-09-12T02:35:47.564906+0000","last_became_active":"2024-09-12T02:35:46.556327+0000","last_became_peered":"2024-09-12T02:35:46.556327+0000","last_unstale":"2024-09-12T02:35:47.564906+0000","last_undegraded":"2024-09-12T02:35:47.564906+0000","last_fullsized":"2024-09-12T02:35:47.564906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.949797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565760+0000","last_change":"2024-09-12T02:35:47.560250+0000","last_active":"2024-09-12T02:35:47.565760+0000","last_peered":"2024-09-12T02:35:47.565760+0000","last_clean":"2024-09-12T02:35:47.565760+0000","last_became_active":"2024-09-12T02:35:47.559558+0000","last_became_peered":"2024-09-12T02:35:47.559558+0000","last_unstale":"2024-09-12T02:35:47.565760+0000","last_undegraded":"2024-09-12T02:35:47.565760+0000","last_fullsized":"2024-09-12T02:35:47.565760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:00.188617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567045+0000","last_change":"2024-09-12T02:35:46.554241+0000","last_active":"2024-09-12T02:35:47.567045+0000","last_peered":"2024-09-12T02:35:47.567045+0000","last_clean":"2024-09-12T02:35:47.567045+0000","last_became_active":"2024-09-12T02:35:46.553958+0000","last_became_peered":"2024-09-12T02:35:46.553958+0000","last_unstale":"2024-09-12T02:35:47.567045+0000","last_undegraded":"2024-09-12T02:35:47.567045+0000","last_fullsized":"2024-09-12T02:35:47.567045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.561379+0000","last_change":"2024-09-12T02:35:47.559441+0000","last_active":"2024-09-12T02:35:47.561379+0000","last_peered":"2024-09-12T02:35:47.561379+0000","last_clean":"2024-09-12T02:35:47.561379+0000","last_became_active":"2024-09-12T02:35:47.559046+0000","last_became_peered":"2024-09-12T02:35:47.559046+0000","last_unstale":"2024-09-12T02:35:47.561379+0000","last_undegraded":"2024-09-12T02:35:47.561379+0000","last_fullsized":"2024-09-12T02:35:47.561379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563705+0000","last_change":"2024-09-12T02:35:46.558161+0000","last_active":"2024-09-12T02:35:47.563705+0000","last_peered":"2024-09-12T02:35:47.563705+0000","last_clean":"2024-09-12T02:35:47.563705+0000","last_became_active":"2024-09-12T02:35:46.557836+0000","last_became_peered":"2024-09-12T02:35:46.557836+0000","last_unstale":"2024-09-12T02:35:47.563705+0000","last_undegraded":"2024-09-12T02:35:47.563705+0000","last_fullsized":"2024-09-12T02:35:47.563705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568890+0000","last_change":"2024-09-12T02:35:47.565152+0000","last_active":"2024-09-12T02:35:47.568890+0000","last_peered":"2024-09-12T02:35:47.568890+0000","last_clean":"2024-09-12T02:35:47.568890+0000","last_became_active":"2024-09-12T02:35:47.563838+0000","last_became_peered":"2024-09-12T02:35:47.563838+0000","last_unstale":"2024-09-12T02:35:47.568890+0000","last_undegraded":"2024-09-12T02:35:47.568890+0000","last_fullsized":"2024-09-12T02:35:47.568890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:31.526030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548082+0000","last_change":"2024-09-12T02:35:46.554449+0000","last_active":"2024-09-12T02:35:47.548082+0000","last_peered":"2024-09-12T02:35:47.548082+0000","last_clean":"2024-09-12T02:35:47.548082+0000","last_became_active":"2024-09-12T02:35:46.553756+0000","last_became_peered":"2024-09-12T02:35:46.553756+0000","last_unstale":"2024-09-12T02:35:47.548082+0000","last_undegraded":"2024-09-12T02:35:47.548082+0000","last_fullsized":"2024-09-12T02:35:47.548082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:26.270274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.546787+0000","last_change":"2024-09-12T02:35:46.546787+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.546787+0000","last_undegraded":"2024-09-12T02:35:46.546787+0000","last_fullsized":"2024-09-12T02:35:46.546787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.543449+0000","last_change":"2024-09-12T02:35:46.559650+0000","last_active":"2024-09-12T02:35:47.543449+0000","last_peered":"2024-09-12T02:35:47.543449+0000","last_clean":"2024-09-12T02:35:47.543449+0000","last_became_active":"2024-09-12T02:35:46.559382+0000","last_became_peered":"2024-09-12T02:35:46.559382+0000","last_unstale":"2024-09-12T02:35:47.543449+0000","last_undegraded":"2024-09-12T02:35:47.543449+0000","last_fullsized":"2024-09-12T02:35:47.543449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:10.746279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.546029+0000","last_change":"2024-09-12T02:35:46.546029+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.546029+0000","last_undegraded":"2024-09-12T02:35:46.546029+0000","last_fullsized":"2024-09-12T02:35:46.546029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552223+0000","last_change":"2024-09-12T02:35:46.557154+0000","last_active":"2024-09-12T02:35:47.552223+0000","last_peered":"2024-09-12T02:35:47.552223+0000","last_clean":"2024-09-12T02:35:47.552223+0000","last_became_active":"2024-09-12T02:35:46.556451+0000","last_became_peered":"2024-09-12T02:35:46.556451+0000","last_unstale":"2024-09-12T02:35:47.552223+0000","last_undegraded":"2024-09-12T02:35:47.552223+0000","last_fullsized":"2024-09-12T02:35:47.552223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571357+0000","last_change":"2024-09-12T02:35:47.567600+0000","last_active":"2024-09-12T02:35:47.571357+0000","last_peered":"2024-09-12T02:35:47.571357+0000","last_clean":"2024-09-12T02:35:47.571357+0000","last_became_active":"2024-09-12T02:35:47.567311+0000","last_became_peered":"2024-09-12T02:35:47.567311+0000","last_unstale":"2024-09-12T02:35:47.571357+0000","last_undegraded":"2024-09-12T02:35:47.571357+0000","last_fullsized":"2024-09-12T02:35:47.571357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:28.803475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551780+0000","last_change":"2024-09-12T02:35:46.554852+0000","last_active":"2024-09-12T02:35:47.551780+0000","last_peered":"2024-09-12T02:35:47.551780+0000","last_clean":"2024-09-12T02:35:47.551780+0000","last_became_active":"2024-09-12T02:35:46.554514+0000","last_became_peered":"2024-09-12T02:35:46.554514+0000","last_unstale":"2024-09-12T02:35:47.551780+0000","last_undegraded":"2024-09-12T02:35:47.551780+0000","last_fullsized":"2024-09-12T02:35:47.551780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567148+0000","last_change":"2024-09-12T02:35:47.562737+0000","last_active":"2024-09-12T02:35:47.567148+0000","last_peered":"2024-09-12T02:35:47.567148+0000","last_clean":"2024-09-12T02:35:47.567148+0000","last_became_active":"2024-09-12T02:35:47.562421+0000","last_became_peered":"2024-09-12T02:35:47.562421+0000","last_unstale":"2024-09-12T02:35:47.567148+0000","last_undegraded":"2024-09-12T02:35:47.567148+0000","last_fullsized":"2024-09-12T02:35:47.567148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562082+0000","last_change":"2024-09-12T02:35:46.559638+0000","last_active":"2024-09-12T02:35:47.562082+0000","last_peered":"2024-09-12T02:35:47.562082+0000","last_clean":"2024-09-12T02:35:47.562082+0000","last_became_active":"2024-09-12T02:35:46.559442+0000","last_became_peered":"2024-09-12T02:35:46.559442+0000","last_unstale":"2024-09-12T02:35:47.562082+0000","last_undegraded":"2024-09-12T02:35:47.562082+0000","last_fullsized":"2024-09-12T02:35:47.562082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:44.377608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560122+0000","last_change":"2024-09-12T02:35:47.552392+0000","last_active":"2024-09-12T02:35:47.560122+0000","last_peered":"2024-09-12T02:35:47.560122+0000","last_clean":"2024-09-12T02:35:47.560122+0000","last_became_active":"2024-09-12T02:35:47.551877+0000","last_became_peered":"2024-09-12T02:35:47.551877+0000","last_unstale":"2024-09-12T02:35:47.560122+0000","last_undegraded":"2024-09-12T02:35:47.560122+0000","last_fullsized":"2024-09-12T02:35:47.560122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573921+0000","last_change":"2024-09-12T02:35:46.555192+0000","last_active":"2024-09-12T02:35:47.573921+0000","last_peered":"2024-09-12T02:35:47.573921+0000","last_clean":"2024-09-12T02:35:47.573921+0000","last_became_active":"2024-09-12T02:35:46.554874+0000","last_became_peered":"2024-09-12T02:35:46.554874+0000","last_unstale":"2024-09-12T02:35:47.573921+0000","last_undegraded":"2024-09-12T02:35:47.573921+0000","last_fullsized":"2024-09-12T02:35:47.573921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:39.001935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567032+0000","last_change":"2024-09-12T02:35:47.561844+0000","last_active":"2024-09-12T02:35:47.567032+0000","last_peered":"2024-09-12T02:35:47.567032+0000","last_clean":"2024-09-12T02:35:47.567032+0000","last_became_active":"2024-09-12T02:35:47.561576+0000","last_became_peered":"2024-09-12T02:35:47.561576+0000","last_unstale":"2024-09-12T02:35:47.567032+0000","last_undegraded":"2024-09-12T02:35:47.567032+0000","last_fullsized":"2024-09-12T02:35:47.567032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567429+0000","last_change":"2024-09-12T02:35:46.557645+0000","last_active":"2024-09-12T02:35:47.567429+0000","last_peered":"2024-09-12T02:35:47.567429+0000","last_clean":"2024-09-12T02:35:47.567429+0000","last_became_active":"2024-09-12T02:35:46.557388+0000","last_became_peered":"2024-09-12T02:35:46.557388+0000","last_unstale":"2024-09-12T02:35:47.567429+0000","last_undegraded":"2024-09-12T02:35:47.567429+0000","last_fullsized":"2024-09-12T02:35:47.567429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:13.920180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567136+0000","last_change":"2024-09-12T02:35:47.563938+0000","last_active":"2024-09-12T02:35:47.567136+0000","last_peered":"2024-09-12T02:35:47.567136+0000","last_clean":"2024-09-12T02:35:47.567136+0000","last_became_active":"2024-09-12T02:35:47.563607+0000","last_became_peered":"2024-09-12T02:35:47.563607+0000","last_unstale":"2024-09-12T02:35:47.567136+0000","last_undegraded":"2024-09-12T02:35:47.567136+0000","last_fullsized":"2024-09-12T02:35:47.567136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:31.957266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555958+0000","last_change":"2024-09-12T02:35:46.554473+0000","last_active":"2024-09-12T02:35:46.555958+0000","last_peered":"2024-09-12T02:35:46.555958+0000","last_clean":"2024-09-12T02:35:46.555958+0000","last_became_active":"2024-09-12T02:35:46.554153+0000","last_became_peered":"2024-09-12T02:35:46.554153+0000","last_unstale":"2024-09-12T02:35:46.555958+0000","last_undegraded":"2024-09-12T02:35:46.555958+0000","last_fullsized":"2024-09-12T02:35:46.555958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:17.059148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560733+0000","last_change":"2024-09-12T02:35:47.557330+0000","last_active":"2024-09-12T02:35:47.560733+0000","last_peered":"2024-09-12T02:35:47.560733+0000","last_clean":"2024-09-12T02:35:47.560733+0000","last_became_active":"2024-09-12T02:35:47.557105+0000","last_became_peered":"2024-09-12T02:35:47.557105+0000","last_unstale":"2024-09-12T02:35:47.560733+0000","last_undegraded":"2024-09-12T02:35:47.560733+0000","last_fullsized":"2024-09-12T02:35:47.560733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:06.934622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.555099+0000","last_change":"2024-09-12T02:35:46.551757+0000","last_active":"2024-09-12T02:35:47.555099+0000","last_peered":"2024-09-12T02:35:47.555099+0000","last_clean":"2024-09-12T02:35:47.555099+0000","last_became_active":"2024-09-12T02:35:46.551465+0000","last_became_peered":"2024-09-12T02:35:46.551465+0000","last_unstale":"2024-09-12T02:35:47.555099+0000","last_undegraded":"2024-09-12T02:35:47.555099+0000","last_fullsized":"2024-09-12T02:35:47.555099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:59.913044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568033+0000","last_change":"2024-09-12T02:35:47.565375+0000","last_active":"2024-09-12T02:35:47.568033+0000","last_peered":"2024-09-12T02:35:47.568033+0000","last_clean":"2024-09-12T02:35:47.568033+0000","last_became_active":"2024-09-12T02:35:47.565111+0000","last_became_peered":"2024-09-12T02:35:47.565111+0000","last_unstale":"2024-09-12T02:35:47.568033+0000","last_undegraded":"2024-09-12T02:35:47.568033+0000","last_fullsized":"2024-09-12T02:35:47.568033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:07.767848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564890+0000","last_change":"2024-09-12T02:35:46.553376+0000","last_active":"2024-09-12T02:35:47.564890+0000","last_peered":"2024-09-12T02:35:47.564890+0000","last_clean":"2024-09-12T02:35:47.564890+0000","last_became_active":"2024-09-12T02:35:46.552720+0000","last_became_peered":"2024-09-12T02:35:46.552720+0000","last_unstale":"2024-09-12T02:35:47.564890+0000","last_undegraded":"2024-09-12T02:35:47.564890+0000","last_fullsized":"2024-09-12T02:35:47.564890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.187005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567171+0000","last_change":"2024-09-12T02:35:47.564398+0000","last_active":"2024-09-12T02:35:47.567171+0000","last_peered":"2024-09-12T02:35:47.567171+0000","last_clean":"2024-09-12T02:35:47.567171+0000","last_became_active":"2024-09-12T02:35:47.564149+0000","last_became_peered":"2024-09-12T02:35:47.564149+0000","last_unstale":"2024-09-12T02:35:47.567171+0000","last_undegraded":"2024-09-12T02:35:47.567171+0000","last_fullsized":"2024-09-12T02:35:47.567171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:49.428222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569596+0000","last_change":"2024-09-12T02:35:46.556394+0000","last_active":"2024-09-12T02:35:47.569596+0000","last_peered":"2024-09-12T02:35:47.569596+0000","last_clean":"2024-09-12T02:35:47.569596+0000","last_became_active":"2024-09-12T02:35:46.555836+0000","last_became_peered":"2024-09-12T02:35:46.555836+0000","last_unstale":"2024-09-12T02:35:47.569596+0000","last_undegraded":"2024-09-12T02:35:47.569596+0000","last_fullsized":"2024-09-12T02:35:47.569596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569270+0000","last_change":"2024-09-12T02:35:47.565967+0000","last_active":"2024-09-12T02:35:47.569270+0000","last_peered":"2024-09-12T02:35:47.569270+0000","last_clean":"2024-09-12T02:35:47.569270+0000","last_became_active":"2024-09-12T02:35:47.565712+0000","last_became_peered":"2024-09-12T02:35:47.565712+0000","last_unstale":"2024-09-12T02:35:47.569270+0000","last_undegraded":"2024-09-12T02:35:47.569270+0000","last_fullsized":"2024-09-12T02:35:47.569270+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565154+0000","last_change":"2024-09-12T02:35:46.557610+0000","last_active":"2024-09-12T02:35:47.565154+0000","last_peered":"2024-09-12T02:35:47.565154+0000","last_clean":"2024-09-12T02:35:47.565154+0000","last_became_active":"2024-09-12T02:35:46.557342+0000","last_became_peered":"2024-09-12T02:35:46.557342+0000","last_unstale":"2024-09-12T02:35:47.565154+0000","last_undegraded":"2024-09-12T02:35:47.565154+0000","last_fullsized":"2024-09-12T02:35:47.565154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:30.518562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560280+0000","last_change":"2024-09-12T02:35:47.554450+0000","last_active":"2024-09-12T02:35:47.560280+0000","last_peered":"2024-09-12T02:35:47.560280+0000","last_clean":"2024-09-12T02:35:47.560280+0000","last_became_active":"2024-09-12T02:35:47.553796+0000","last_became_peered":"2024-09-12T02:35:47.553796+0000","last_unstale":"2024-09-12T02:35:47.560280+0000","last_undegraded":"2024-09-12T02:35:47.560280+0000","last_fullsized":"2024-09-12T02:35:47.560280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549398+0000","last_change":"2024-09-12T02:35:46.554498+0000","last_active":"2024-09-12T02:35:47.549398+0000","last_peered":"2024-09-12T02:35:47.549398+0000","last_clean":"2024-09-12T02:35:47.549398+0000","last_became_active":"2024-09-12T02:35:46.553952+0000","last_became_peered":"2024-09-12T02:35:46.553952+0000","last_unstale":"2024-09-12T02:35:47.549398+0000","last_undegraded":"2024-09-12T02:35:47.549398+0000","last_fullsized":"2024-09-12T02:35:47.549398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:48.420754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.551160+0000","last_change":"2024-09-12T02:35:46.551160+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.551160+0000","last_undegraded":"2024-09-12T02:35:46.551160+0000","last_fullsized":"2024-09-12T02:35:46.551160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555994+0000","last_change":"2024-09-12T02:35:46.554380+0000","last_active":"2024-09-12T02:35:46.555994+0000","last_peered":"2024-09-12T02:35:46.555994+0000","last_clean":"2024-09-12T02:35:46.555994+0000","last_became_active":"2024-09-12T02:35:46.554101+0000","last_became_peered":"2024-09-12T02:35:46.554101+0000","last_unstale":"2024-09-12T02:35:46.555994+0000","last_undegraded":"2024-09-12T02:35:46.555994+0000","last_fullsized":"2024-09-12T02:35:46.555994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:41.768841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566799+0000","last_change":"2024-09-12T02:35:47.564388+0000","last_active":"2024-09-12T02:35:47.566799+0000","last_peered":"2024-09-12T02:35:47.566799+0000","last_clean":"2024-09-12T02:35:47.566799+0000","last_became_active":"2024-09-12T02:35:47.564109+0000","last_became_peered":"2024-09-12T02:35:47.564109+0000","last_unstale":"2024-09-12T02:35:47.566799+0000","last_undegraded":"2024-09-12T02:35:47.566799+0000","last_fullsized":"2024-09-12T02:35:47.566799+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:14.539957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.559043+0000","last_change":"2024-09-12T02:35:46.557363+0000","last_active":"2024-09-12T02:35:46.559043+0000","last_peered":"2024-09-12T02:35:46.559043+0000","last_clean":"2024-09-12T02:35:46.559043+0000","last_became_active":"2024-09-12T02:35:46.557054+0000","last_became_peered":"2024-09-12T02:35:46.557054+0000","last_unstale":"2024-09-12T02:35:46.559043+0000","last_undegraded":"2024-09-12T02:35:46.559043+0000","last_fullsized":"2024-09-12T02:35:46.559043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:53.395029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.547655+0000","last_change":"2024-09-12T02:35:46.547655+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.547655+0000","last_undegraded":"2024-09-12T02:35:46.547655+0000","last_fullsized":"2024-09-12T02:35:46.547655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.561475+0000","last_change":"2024-09-12T02:35:46.560646+0000","last_active":"2024-09-12T02:35:46.561475+0000","last_peered":"2024-09-12T02:35:46.561475+0000","last_clean":"2024-09-12T02:35:46.561475+0000","last_became_active":"2024-09-12T02:35:46.560281+0000","last_became_peered":"2024-09-12T02:35:46.560281+0000","last_unstale":"2024-09-12T02:35:46.561475+0000","last_undegraded":"2024-09-12T02:35:46.561475+0000","last_fullsized":"2024-09-12T02:35:46.561475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:15.293030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563636+0000","last_change":"2024-09-12T02:35:47.561258+0000","last_active":"2024-09-12T02:35:47.563636+0000","last_peered":"2024-09-12T02:35:47.563636+0000","last_clean":"2024-09-12T02:35:47.563636+0000","last_became_active":"2024-09-12T02:35:47.560964+0000","last_became_peered":"2024-09-12T02:35:47.560964+0000","last_unstale":"2024-09-12T02:35:47.563636+0000","last_undegraded":"2024-09-12T02:35:47.563636+0000","last_fullsized":"2024-09-12T02:35:47.563636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555480+0000","last_change":"2024-09-12T02:35:46.552700+0000","last_active":"2024-09-12T02:35:46.555480+0000","last_peered":"2024-09-12T02:35:46.555480+0000","last_clean":"2024-09-12T02:35:46.555480+0000","last_became_active":"2024-09-12T02:35:46.552416+0000","last_became_peered":"2024-09-12T02:35:46.552416+0000","last_unstale":"2024-09-12T02:35:46.555480+0000","last_undegraded":"2024-09-12T02:35:46.555480+0000","last_fullsized":"2024-09-12T02:35:46.555480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:16.091618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566209+0000","last_change":"2024-09-12T02:35:47.564929+0000","last_active":"2024-09-12T02:35:47.566209+0000","last_peered":"2024-09-12T02:35:47.566209+0000","last_clean":"2024-09-12T02:35:47.566209+0000","last_became_active":"2024-09-12T02:35:47.564632+0000","last_became_peered":"2024-09-12T02:35:47.564632+0000","last_unstale":"2024-09-12T02:35:47.566209+0000","last_undegraded":"2024-09-12T02:35:47.566209+0000","last_fullsized":"2024-09-12T02:35:47.566209+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565602+0000","last_change":"2024-09-12T02:35:46.550057+0000","last_active":"2024-09-12T02:35:47.565602+0000","last_peered":"2024-09-12T02:35:47.565602+0000","last_clean":"2024-09-12T02:35:47.565602+0000","last_became_active":"2024-09-12T02:35:46.549620+0000","last_became_peered":"2024-09-12T02:35:46.549620+0000","last_unstale":"2024-09-12T02:35:47.565602+0000","last_undegraded":"2024-09-12T02:35:47.565602+0000","last_fullsized":"2024-09-12T02:35:47.565602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:08.703290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573748+0000","last_change":"2024-09-12T02:35:47.570041+0000","last_active":"2024-09-12T02:35:47.573748+0000","last_peered":"2024-09-12T02:35:47.573748+0000","last_clean":"2024-09-12T02:35:47.573748+0000","last_became_active":"2024-09-12T02:35:47.569745+0000","last_became_peered":"2024-09-12T02:35:47.569745+0000","last_unstale":"2024-09-12T02:35:47.573748+0000","last_undegraded":"2024-09-12T02:35:47.573748+0000","last_fullsized":"2024-09-12T02:35:47.573748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.544098+0000","last_change":"2024-09-12T02:35:46.556974+0000","last_active":"2024-09-12T02:35:47.544098+0000","last_peered":"2024-09-12T02:35:47.544098+0000","last_clean":"2024-09-12T02:35:47.544098+0000","last_became_active":"2024-09-12T02:35:46.556679+0000","last_became_peered":"2024-09-12T02:35:46.556679+0000","last_unstale":"2024-09-12T02:35:47.544098+0000","last_undegraded":"2024-09-12T02:35:47.544098+0000","last_fullsized":"2024-09-12T02:35:47.544098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:04.764613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566829+0000","last_change":"2024-09-12T02:35:47.562760+0000","last_active":"2024-09-12T02:35:47.566829+0000","last_peered":"2024-09-12T02:35:47.566829+0000","last_clean":"2024-09-12T02:35:47.566829+0000","last_became_active":"2024-09-12T02:35:47.562486+0000","last_became_peered":"2024-09-12T02:35:47.562486+0000","last_unstale":"2024-09-12T02:35:47.566829+0000","last_undegraded":"2024-09-12T02:35:47.566829+0000","last_fullsized":"2024-09-12T02:35:47.566829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549761+0000","last_change":"2024-09-12T02:35:46.560913+0000","last_active":"2024-09-12T02:35:47.549761+0000","last_peered":"2024-09-12T02:35:47.549761+0000","last_clean":"2024-09-12T02:35:47.549761+0000","last_became_active":"2024-09-12T02:35:46.560622+0000","last_became_peered":"2024-09-12T02:35:46.560622+0000","last_unstale":"2024-09-12T02:35:47.549761+0000","last_undegraded":"2024-09-12T02:35:47.549761+0000","last_fullsized":"2024-09-12T02:35:47.549761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.269933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560072+0000","last_change":"2024-09-12T02:35:47.552179+0000","last_active":"2024-09-12T02:35:47.560072+0000","last_peered":"2024-09-12T02:35:47.560072+0000","last_clean":"2024-09-12T02:35:47.560072+0000","last_became_active":"2024-09-12T02:35:47.551519+0000","last_became_peered":"2024-09-12T02:35:47.551519+0000","last_unstale":"2024-09-12T02:35:47.560072+0000","last_undegraded":"2024-09-12T02:35:47.560072+0000","last_fullsized":"2024-09-12T02:35:47.560072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551345+0000","last_change":"2024-09-12T02:35:46.556235+0000","last_active":"2024-09-12T02:35:47.551345+0000","last_peered":"2024-09-12T02:35:47.551345+0000","last_clean":"2024-09-12T02:35:47.551345+0000","last_became_active":"2024-09-12T02:35:46.555843+0000","last_became_peered":"2024-09-12T02:35:46.555843+0000","last_unstale":"2024-09-12T02:35:47.551345+0000","last_undegraded":"2024-09-12T02:35:47.551345+0000","last_fullsized":"2024-09-12T02:35:47.551345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565776+0000","last_change":"2024-09-12T02:35:47.562441+0000","last_active":"2024-09-12T02:35:47.565776+0000","last_peered":"2024-09-12T02:35:47.565776+0000","last_clean":"2024-09-12T02:35:47.565776+0000","last_became_active":"2024-09-12T02:35:47.562116+0000","last_became_peered":"2024-09-12T02:35:47.562116+0000","last_unstale":"2024-09-12T02:35:47.565776+0000","last_undegraded":"2024-09-12T02:35:47.565776+0000","last_fullsized":"2024-09-12T02:35:47.565776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548999+0000","last_change":"2024-09-12T02:35:46.554033+0000","last_active":"2024-09-12T02:35:47.548999+0000","last_peered":"2024-09-12T02:35:47.548999+0000","last_clean":"2024-09-12T02:35:47.548999+0000","last_became_active":"2024-09-12T02:35:46.553741+0000","last_became_peered":"2024-09-12T02:35:46.553741+0000","last_unstale":"2024-09-12T02:35:47.548999+0000","last_undegraded":"2024-09-12T02:35:47.548999+0000","last_fullsized":"2024-09-12T02:35:47.548999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556909+0000","last_change":"2024-09-12T02:35:47.552427+0000","last_active":"2024-09-12T02:35:47.556909+0000","last_peered":"2024-09-12T02:35:47.556909+0000","last_clean":"2024-09-12T02:35:47.556909+0000","last_became_active":"2024-09-12T02:35:47.552172+0000","last_became_peered":"2024-09-12T02:35:47.552172+0000","last_unstale":"2024-09-12T02:35:47.556909+0000","last_undegraded":"2024-09-12T02:35:47.556909+0000","last_fullsized":"2024-09-12T02:35:47.556909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.545577+0000","last_change":"2024-09-12T02:35:46.557520+0000","last_active":"2024-09-12T02:35:47.545577+0000","last_peered":"2024-09-12T02:35:47.545577+0000","last_clean":"2024-09-12T02:35:47.545577+0000","last_became_active":"2024-09-12T02:35:46.557248+0000","last_became_peered":"2024-09-12T02:35:46.557248+0000","last_unstale":"2024-09-12T02:35:47.545577+0000","last_undegraded":"2024-09-12T02:35:47.545577+0000","last_fullsized":"2024-09-12T02:35:47.545577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569216+0000","last_change":"2024-09-12T02:35:47.568444+0000","last_active":"2024-09-12T02:35:47.569216+0000","last_peered":"2024-09-12T02:35:47.569216+0000","last_clean":"2024-09-12T02:35:47.569216+0000","last_became_active":"2024-09-12T02:35:47.568168+0000","last_became_peered":"2024-09-12T02:35:47.568168+0000","last_unstale":"2024-09-12T02:35:47.569216+0000","last_undegraded":"2024-09-12T02:35:47.569216+0000","last_fullsized":"2024-09-12T02:35:47.569216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549710+0000","last_change":"2024-09-12T02:35:46.556913+0000","last_active":"2024-09-12T02:35:47.549710+0000","last_peered":"2024-09-12T02:35:47.549710+0000","last_clean":"2024-09-12T02:35:47.549710+0000","last_became_active":"2024-09-12T02:35:46.555900+0000","last_became_peered":"2024-09-12T02:35:46.555900+0000","last_unstale":"2024-09-12T02:35:47.549710+0000","last_undegraded":"2024-09-12T02:35:47.549710+0000","last_fullsized":"2024-09-12T02:35:47.549710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:26.550563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566577+0000","last_change":"2024-09-12T02:35:47.562581+0000","last_active":"2024-09-12T02:35:47.566577+0000","last_peered":"2024-09-12T02:35:47.566577+0000","last_clean":"2024-09-12T02:35:47.566577+0000","last_became_active":"2024-09-12T02:35:47.562297+0000","last_became_peered":"2024-09-12T02:35:47.562297+0000","last_unstale":"2024-09-12T02:35:47.566577+0000","last_undegraded":"2024-09-12T02:35:47.566577+0000","last_fullsized":"2024-09-12T02:35:47.566577+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.547634+0000","last_change":"2024-09-12T02:35:46.551656+0000","last_active":"2024-09-12T02:35:47.547634+0000","last_peered":"2024-09-12T02:35:47.547634+0000","last_clean":"2024-09-12T02:35:47.547634+0000","last_became_active":"2024-09-12T02:35:46.551361+0000","last_became_peered":"2024-09-12T02:35:46.551361+0000","last_unstale":"2024-09-12T02:35:47.547634+0000","last_undegraded":"2024-09-12T02:35:47.547634+0000","last_fullsized":"2024-09-12T02:35:47.547634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.574291+0000","last_change":"2024-09-12T02:35:47.568904+0000","last_active":"2024-09-12T02:35:47.574291+0000","last_peered":"2024-09-12T02:35:47.574291+0000","last_clean":"2024-09-12T02:35:47.574291+0000","last_became_active":"2024-09-12T02:35:47.568611+0000","last_became_peered":"2024-09-12T02:35:47.568611+0000","last_unstale":"2024-09-12T02:35:47.574291+0000","last_undegraded":"2024-09-12T02:35:47.574291+0000","last_fullsized":"2024-09-12T02:35:47.574291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:46.102884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567096+0000","last_change":"2024-09-12T02:35:46.550127+0000","last_active":"2024-09-12T02:35:47.567096+0000","last_peered":"2024-09-12T02:35:47.567096+0000","last_clean":"2024-09-12T02:35:47.567096+0000","last_became_active":"2024-09-12T02:35:46.548956+0000","last_became_peered":"2024-09-12T02:35:46.548956+0000","last_unstale":"2024-09-12T02:35:47.567096+0000","last_undegraded":"2024-09-12T02:35:47.567096+0000","last_fullsized":"2024-09-12T02:35:47.567096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":294,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.557318+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:35:47.557318+0000","last_peered":"2024-09-12T02:35:47.557318+0000","last_clean":"2024-09-12T02:35:47.557318+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:35:47.557318+0000","last_undegraded":"2024-09-12T02:35:47.557318+0000","last_fullsized":"2024-09-12T02:35:47.557318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1060864,"data_stored":449836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46088,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325752,"statfs":{"total":96636764160,"available":96589570048,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41104,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330736,"statfs":{"total":96636764160,"available":96594673664,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542239,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1024000,"data_stored":436092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542238,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1024000,"data_stored":436092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:50.840 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:50.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.974+0000 7f9209630640 1 Processor -- start 2024-09-12T02:35:50.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.974+0000 7f9209630640 1 -- start start 2024-09-12T02:35:50.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f9209630640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f92040d3c00 0x7f92040d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f9209630640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92040b7e60 con 0x7f920415e840 2024-09-12T02:35:50.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f9209630640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92040cf800 con 0x7f92040b3720 2024-09-12T02:35:50.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f9209630640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f920415ec20 con 0x7f92040d3c00 2024-09-12T02:35:50.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f92037fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f92040d3c00 0x7f92040d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f9202ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f920415e840 0x7f92040cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47186/0 (socket says 172.21.15.181:47186) 2024-09-12T02:35:50.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f9202ffd640 1 -- 172.21.15.181:0/2932617329 learned_addr learned my addr 172.21.15.181:0/2932617329 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:50.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f92037fe640 1 -- 172.21.15.181:0/2932617329 >> v1:172.21.15.204:6789/0 conn(0x7f92040b3720 legacy=0x7f92040b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:50.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f92037fe640 1 -- 172.21.15.181:0/2932617329 >> v1:172.21.15.181:6789/0 conn(0x7f920415e840 legacy=0x7f92040cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f9201ffb640 1 -- 172.21.15.181:0/2932617329 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551093798 0 0) 0x7f91f4001110 con 0x7f920415e840 2024-09-12T02:35:50.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.975+0000 7f92037fe640 1 -- 172.21.15.181:0/2932617329 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92040cfae0 con 0x7f92040d3c00 2024-09-12T02:35:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.976+0000 7f92037fe640 1 --2- 172.21.15.181:0/2932617329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040d3c00 0x7f92040d4090 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7742a7df980e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.976+0000 7f9201ffb640 1 -- 172.21.15.181:0/2932617329 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc007740 con 0x7f92040d3c00 2024-09-12T02:35:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.976+0000 7f9201ffb640 1 -- 172.21.15.181:0/2932617329 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc0078e0 con 0x7f92040d3c00 2024-09-12T02:35:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.976+0000 7f9201ffb640 1 -- 172.21.15.181:0/2932617329 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc007cb0 con 0x7f92040d3c00 2024-09-12T02:35:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.977+0000 7f9209630640 1 -- 172.21.15.181:0/2932617329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040d3c00 msgr2=0x7f92040d4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.977+0000 7f9209630640 1 --2- 172.21.15.181:0/2932617329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040d3c00 0x7f92040d4090 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc02a730 comp rx=0 tx=0).stop 2024-09-12T02:35:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.977+0000 7f9209630640 1 -- 172.21.15.181:0/2932617329 shutdown_connections 2024-09-12T02:35:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.977+0000 7f9209630640 1 --2- 172.21.15.181:0/2932617329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040d3c00 0x7f92040d4090 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.977+0000 7f9209630640 1 -- 172.21.15.181:0/2932617329 >> 172.21.15.181:0/2932617329 conn(0x7f92040d4930 msgr2=0x7f92040d4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.977+0000 7f9209630640 1 -- 172.21.15.181:0/2932617329 shutdown_connections 2024-09-12T02:35:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.977+0000 7f9209630640 1 -- 172.21.15.181:0/2932617329 wait complete. 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.978+0000 7f9209630640 1 Processor -- start 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.978+0000 7f9209630640 1 -- start start 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040b3720 0x7f92041602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92040d3c00 0x7f92041f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f920415e840 0x7f9204157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92040d27e0 con 0x7f92040b3720 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f92040cfdc0 con 0x7f92040d3c00 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f92040d2d00 con 0x7f920415e840 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040b3720 0x7f92041602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040b3720 0x7f92041602f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33174/0 (socket says 172.21.15.181:33174) 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 -- 172.21.15.181:0/2650228415 learned_addr learned my addr 172.21.15.181:0/2650228415 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f92027fc640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92040d3c00 0x7f92041f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f92037fe640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f920415e840 0x7f9204157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 -- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f920415e840 msgr2=0x7f9204157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f920415e840 0x7f9204157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 -- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92040d3c00 msgr2=0x7f92041f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92040d3c00 0x7f92041f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 -- 172.21.15.181:0/2650228415 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920415db30 con 0x7f92040b3720 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9202ffd640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040b3720 0x7f92041602f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c430 tx=0x7f91f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f91eb7fe640 1 -- 172.21.15.181:0/2650228415 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f40074e0 con 0x7f92040b3720 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f91eb7fe640 1 -- 172.21.15.181:0/2650228415 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f40047e0 con 0x7f92040b3720 2024-09-12T02:35:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92040cca40 con 0x7f92040b3720 2024-09-12T02:35:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f91eb7fe640 1 -- 172.21.15.181:0/2650228415 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4004bd0 con 0x7f92040b3720 2024-09-12T02:35:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.979+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920415d790 con 0x7f92040b3720 2024-09-12T02:35:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.981+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92040d4090 con 0x7f92040b3720 2024-09-12T02:35:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.981+0000 7f91eb7fe640 1 -- 172.21.15.181:0/2650228415 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91f4011070 con 0x7f92040b3720 2024-09-12T02:35:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.981+0000 7f91eb7fe640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.981+0000 7f91eb7fe640 1 -- 172.21.15.181:0/2650228415 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f91f408aaf0 con 0x7f92040b3720 2024-09-12T02:35:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.981+0000 7f92027fc640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.982+0000 7f92027fc640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f91f006be30 0x7f91f006e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92041ea410 tx=0x7f91f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:50.986+0000 7f91eb7fe640 1 -- 172.21.15.181:0/2650228415 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92040b7e60 con 0x7f92040b3720 2024-09-12T02:35:51.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.148+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92040b3500 con 0x7f91f006be30 2024-09-12T02:35:51.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.153+0000 7f91eb7fe640 1 -- 172.21.15.181:0/2650228415 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251037 (secure 0 0 0) 0x7f92040b3500 con 0x7f91f006be30 2024-09-12T02:35:51.157 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:51.158 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f91f006be30 msgr2=0x7f91f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f91f006be30 0x7f91f006e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92041ea410 tx=0x7f91f8009040 comp rx=0 tx=0).stop 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040b3720 msgr2=0x7f92041602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040b3720 0x7f92041602f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c430 tx=0x7f91f400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 shutdown_connections 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92040d3c00 0x7f92041f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f920415e840 0x7f9204157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 --2- 172.21.15.181:0/2650228415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92040b3720 0x7f92041602f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 >> 172.21.15.181:0/2650228415 conn(0x7f92040d4930 msgr2=0x7f9204074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:51.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 shutdown_connections 2024-09-12T02:35:51.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.157+0000 7f9209630640 1 -- 172.21.15.181:0/2650228415 wait complete. 2024-09-12T02:35:51.168 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-12T02:35:49.708220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285164,"kb_used_data":9256,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689556,"statfs":{"total":773094113280,"available":772802105344,"internally_reserved":0,"allocated":9478144,"data_stored":4714591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.174349"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568596+0000","last_change":"2024-09-12T02:35:47.563930+0000","last_active":"2024-09-12T02:35:47.568596+0000","last_peered":"2024-09-12T02:35:47.568596+0000","last_clean":"2024-09-12T02:35:47.568596+0000","last_became_active":"2024-09-12T02:35:47.562924+0000","last_became_peered":"2024-09-12T02:35:47.562924+0000","last_unstale":"2024-09-12T02:35:47.568596+0000","last_undegraded":"2024-09-12T02:35:47.568596+0000","last_fullsized":"2024-09-12T02:35:47.568596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566368+0000","last_change":"2024-09-12T02:35:47.565295+0000","last_active":"2024-09-12T02:35:47.566368+0000","last_peered":"2024-09-12T02:35:47.566368+0000","last_clean":"2024-09-12T02:35:47.566368+0000","last_became_active":"2024-09-12T02:35:47.565057+0000","last_became_peered":"2024-09-12T02:35:47.565057+0000","last_unstale":"2024-09-12T02:35:47.566368+0000","last_undegraded":"2024-09-12T02:35:47.566368+0000","last_fullsized":"2024-09-12T02:35:47.566368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:51.213622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573780+0000","last_change":"2024-09-12T02:35:47.570484+0000","last_active":"2024-09-12T02:35:47.573780+0000","last_peered":"2024-09-12T02:35:47.573780+0000","last_clean":"2024-09-12T02:35:47.573780+0000","last_became_active":"2024-09-12T02:35:47.570214+0000","last_became_peered":"2024-09-12T02:35:47.570214+0000","last_unstale":"2024-09-12T02:35:47.573780+0000","last_undegraded":"2024-09-12T02:35:47.573780+0000","last_fullsized":"2024-09-12T02:35:47.573780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:21.256870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.550694+0000","last_change":"2024-09-12T02:35:46.550694+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.550694+0000","last_undegraded":"2024-09-12T02:35:46.550694+0000","last_fullsized":"2024-09-12T02:35:46.550694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552531+0000","last_change":"2024-09-12T02:35:47.550460+0000","last_active":"2024-09-12T02:35:47.552531+0000","last_peered":"2024-09-12T02:35:47.552531+0000","last_clean":"2024-09-12T02:35:47.552531+0000","last_became_active":"2024-09-12T02:35:47.550185+0000","last_became_peered":"2024-09-12T02:35:47.550185+0000","last_unstale":"2024-09-12T02:35:47.552531+0000","last_undegraded":"2024-09-12T02:35:47.552531+0000","last_fullsized":"2024-09-12T02:35:47.552531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571418+0000","last_change":"2024-09-12T02:35:47.568596+0000","last_active":"2024-09-12T02:35:47.571418+0000","last_peered":"2024-09-12T02:35:47.571418+0000","last_clean":"2024-09-12T02:35:47.571418+0000","last_became_active":"2024-09-12T02:35:47.568345+0000","last_became_peered":"2024-09-12T02:35:47.568345+0000","last_unstale":"2024-09-12T02:35:47.571418+0000","last_undegraded":"2024-09-12T02:35:47.571418+0000","last_fullsized":"2024-09-12T02:35:47.571418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.549015+0000","last_change":"2024-09-12T02:35:46.549015+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.549015+0000","last_undegraded":"2024-09-12T02:35:46.549015+0000","last_fullsized":"2024-09-12T02:35:46.549015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571412+0000","last_change":"2024-09-12T02:35:47.568454+0000","last_active":"2024-09-12T02:35:47.571412+0000","last_peered":"2024-09-12T02:35:47.571412+0000","last_clean":"2024-09-12T02:35:47.571412+0000","last_became_active":"2024-09-12T02:35:47.568201+0000","last_became_peered":"2024-09-12T02:35:47.568201+0000","last_unstale":"2024-09-12T02:35:47.571412+0000","last_undegraded":"2024-09-12T02:35:47.571412+0000","last_fullsized":"2024-09-12T02:35:47.571412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:27.277743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563608+0000","last_change":"2024-09-12T02:35:47.561792+0000","last_active":"2024-09-12T02:35:47.563608+0000","last_peered":"2024-09-12T02:35:47.563608+0000","last_clean":"2024-09-12T02:35:47.563608+0000","last_became_active":"2024-09-12T02:35:47.560908+0000","last_became_peered":"2024-09-12T02:35:47.560908+0000","last_unstale":"2024-09-12T02:35:47.563608+0000","last_undegraded":"2024-09-12T02:35:47.563608+0000","last_fullsized":"2024-09-12T02:35:47.563608+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559720+0000","last_change":"2024-09-12T02:35:47.557935+0000","last_active":"2024-09-12T02:35:47.559720+0000","last_peered":"2024-09-12T02:35:47.559720+0000","last_clean":"2024-09-12T02:35:47.559720+0000","last_became_active":"2024-09-12T02:35:47.557463+0000","last_became_peered":"2024-09-12T02:35:47.557463+0000","last_unstale":"2024-09-12T02:35:47.559720+0000","last_undegraded":"2024-09-12T02:35:47.559720+0000","last_fullsized":"2024-09-12T02:35:47.559720+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566757+0000","last_change":"2024-09-12T02:35:47.564524+0000","last_active":"2024-09-12T02:35:47.566757+0000","last_peered":"2024-09-12T02:35:47.566757+0000","last_clean":"2024-09-12T02:35:47.566757+0000","last_became_active":"2024-09-12T02:35:47.562298+0000","last_became_peered":"2024-09-12T02:35:47.562298+0000","last_unstale":"2024-09-12T02:35:47.566757+0000","last_undegraded":"2024-09-12T02:35:47.566757+0000","last_fullsized":"2024-09-12T02:35:47.566757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:34.272059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560684+0000","last_change":"2024-09-12T02:35:47.559543+0000","last_active":"2024-09-12T02:35:47.560684+0000","last_peered":"2024-09-12T02:35:47.560684+0000","last_clean":"2024-09-12T02:35:47.560684+0000","last_became_active":"2024-09-12T02:35:47.558672+0000","last_became_peered":"2024-09-12T02:35:47.558672+0000","last_unstale":"2024-09-12T02:35:47.560684+0000","last_undegraded":"2024-09-12T02:35:47.560684+0000","last_fullsized":"2024-09-12T02:35:47.560684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568927+0000","last_change":"2024-09-12T02:35:47.566022+0000","last_active":"2024-09-12T02:35:47.568927+0000","last_peered":"2024-09-12T02:35:47.568927+0000","last_clean":"2024-09-12T02:35:47.568927+0000","last_became_active":"2024-09-12T02:35:47.565722+0000","last_became_peered":"2024-09-12T02:35:47.565722+0000","last_unstale":"2024-09-12T02:35:47.568927+0000","last_undegraded":"2024-09-12T02:35:47.568927+0000","last_fullsized":"2024-09-12T02:35:47.568927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.551574+0000","last_change":"2024-09-12T02:35:46.551574+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.551574+0000","last_undegraded":"2024-09-12T02:35:46.551574+0000","last_fullsized":"2024-09-12T02:35:46.551574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.547222+0000","last_change":"2024-09-12T02:35:46.547222+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.547222+0000","last_undegraded":"2024-09-12T02:35:46.547222+0000","last_fullsized":"2024-09-12T02:35:46.547222+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563349+0000","last_change":"2024-09-12T02:35:47.558932+0000","last_active":"2024-09-12T02:35:47.563349+0000","last_peered":"2024-09-12T02:35:47.563349+0000","last_clean":"2024-09-12T02:35:47.563349+0000","last_became_active":"2024-09-12T02:35:47.558677+0000","last_became_peered":"2024-09-12T02:35:47.558677+0000","last_unstale":"2024-09-12T02:35:47.563349+0000","last_undegraded":"2024-09-12T02:35:47.563349+0000","last_fullsized":"2024-09-12T02:35:47.563349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560413+0000","last_change":"2024-09-12T02:35:47.557164+0000","last_active":"2024-09-12T02:35:47.560413+0000","last_peered":"2024-09-12T02:35:47.560413+0000","last_clean":"2024-09-12T02:35:47.560413+0000","last_became_active":"2024-09-12T02:35:47.556845+0000","last_became_peered":"2024-09-12T02:35:47.556845+0000","last_unstale":"2024-09-12T02:35:47.560413+0000","last_undegraded":"2024-09-12T02:35:47.560413+0000","last_fullsized":"2024-09-12T02:35:47.560413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548757+0000","last_change":"2024-09-12T02:35:46.548757+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548757+0000","last_undegraded":"2024-09-12T02:35:46.548757+0000","last_fullsized":"2024-09-12T02:35:46.548757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556748+0000","last_change":"2024-09-12T02:35:47.551849+0000","last_active":"2024-09-12T02:35:47.556748+0000","last_peered":"2024-09-12T02:35:47.556748+0000","last_clean":"2024-09-12T02:35:47.556748+0000","last_became_active":"2024-09-12T02:35:47.551596+0000","last_became_peered":"2024-09-12T02:35:47.551596+0000","last_unstale":"2024-09-12T02:35:47.556748+0000","last_undegraded":"2024-09-12T02:35:47.556748+0000","last_fullsized":"2024-09-12T02:35:47.556748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.550253+0000","last_change":"2024-09-12T02:35:46.550253+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.550253+0000","last_undegraded":"2024-09-12T02:35:46.550253+0000","last_fullsized":"2024-09-12T02:35:46.550253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548734+0000","last_change":"2024-09-12T02:35:46.548734+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548734+0000","last_undegraded":"2024-09-12T02:35:46.548734+0000","last_fullsized":"2024-09-12T02:35:46.548734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560912+0000","last_change":"2024-09-12T02:35:47.552647+0000","last_active":"2024-09-12T02:35:47.560912+0000","last_peered":"2024-09-12T02:35:47.560912+0000","last_clean":"2024-09-12T02:35:47.560912+0000","last_became_active":"2024-09-12T02:35:47.552352+0000","last_became_peered":"2024-09-12T02:35:47.552352+0000","last_unstale":"2024-09-12T02:35:47.560912+0000","last_undegraded":"2024-09-12T02:35:47.560912+0000","last_fullsized":"2024-09-12T02:35:47.560912+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559610+0000","last_change":"2024-09-12T02:35:47.558637+0000","last_active":"2024-09-12T02:35:47.559610+0000","last_peered":"2024-09-12T02:35:47.559610+0000","last_clean":"2024-09-12T02:35:47.559610+0000","last_became_active":"2024-09-12T02:35:47.558335+0000","last_became_peered":"2024-09-12T02:35:47.558335+0000","last_unstale":"2024-09-12T02:35:47.559610+0000","last_undegraded":"2024-09-12T02:35:47.559610+0000","last_fullsized":"2024-09-12T02:35:47.559610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.548117+0000","last_change":"2024-09-12T02:35:46.548117+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.548117+0000","last_undegraded":"2024-09-12T02:35:46.548117+0000","last_fullsized":"2024-09-12T02:35:46.548117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566334+0000","last_change":"2024-09-12T02:35:47.565021+0000","last_active":"2024-09-12T02:35:47.566334+0000","last_peered":"2024-09-12T02:35:47.566334+0000","last_clean":"2024-09-12T02:35:47.566334+0000","last_became_active":"2024-09-12T02:35:47.564686+0000","last_became_peered":"2024-09-12T02:35:47.564686+0000","last_unstale":"2024-09-12T02:35:47.566334+0000","last_undegraded":"2024-09-12T02:35:47.566334+0000","last_fullsized":"2024-09-12T02:35:47.566334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:07.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569210+0000","last_change":"2024-09-12T02:35:47.567786+0000","last_active":"2024-09-12T02:35:47.569210+0000","last_peered":"2024-09-12T02:35:47.569210+0000","last_clean":"2024-09-12T02:35:47.569210+0000","last_became_active":"2024-09-12T02:35:47.567479+0000","last_became_peered":"2024-09-12T02:35:47.567479+0000","last_unstale":"2024-09-12T02:35:47.569210+0000","last_undegraded":"2024-09-12T02:35:47.569210+0000","last_fullsized":"2024-09-12T02:35:47.569210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560303+0000","last_change":"2024-09-12T02:35:47.554685+0000","last_active":"2024-09-12T02:35:47.560303+0000","last_peered":"2024-09-12T02:35:47.560303+0000","last_clean":"2024-09-12T02:35:47.560303+0000","last_became_active":"2024-09-12T02:35:47.554170+0000","last_became_peered":"2024-09-12T02:35:47.554170+0000","last_unstale":"2024-09-12T02:35:47.560303+0000","last_undegraded":"2024-09-12T02:35:47.560303+0000","last_fullsized":"2024-09-12T02:35:47.560303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566806+0000","last_change":"2024-09-12T02:35:47.561906+0000","last_active":"2024-09-12T02:35:47.566806+0000","last_peered":"2024-09-12T02:35:47.566806+0000","last_clean":"2024-09-12T02:35:47.566806+0000","last_became_active":"2024-09-12T02:35:47.561625+0000","last_became_peered":"2024-09-12T02:35:47.561625+0000","last_unstale":"2024-09-12T02:35:47.566806+0000","last_undegraded":"2024-09-12T02:35:47.566806+0000","last_fullsized":"2024-09-12T02:35:47.566806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560656+0000","last_change":"2024-09-12T02:35:47.552719+0000","last_active":"2024-09-12T02:35:47.560656+0000","last_peered":"2024-09-12T02:35:47.560656+0000","last_clean":"2024-09-12T02:35:47.560656+0000","last_became_active":"2024-09-12T02:35:47.552428+0000","last_became_peered":"2024-09-12T02:35:47.552428+0000","last_unstale":"2024-09-12T02:35:47.560656+0000","last_undegraded":"2024-09-12T02:35:47.560656+0000","last_fullsized":"2024-09-12T02:35:47.560656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.738029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565716+0000","last_change":"2024-09-12T02:35:47.559405+0000","last_active":"2024-09-12T02:35:47.565716+0000","last_peered":"2024-09-12T02:35:47.565716+0000","last_clean":"2024-09-12T02:35:47.565716+0000","last_became_active":"2024-09-12T02:35:47.556745+0000","last_became_peered":"2024-09-12T02:35:47.556745+0000","last_unstale":"2024-09-12T02:35:47.565716+0000","last_undegraded":"2024-09-12T02:35:47.565716+0000","last_fullsized":"2024-09-12T02:35:47.565716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.934159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551211+0000","last_change":"2024-09-12T02:35:47.549673+0000","last_active":"2024-09-12T02:35:47.551211+0000","last_peered":"2024-09-12T02:35:47.551211+0000","last_clean":"2024-09-12T02:35:47.551211+0000","last_became_active":"2024-09-12T02:35:47.549408+0000","last_became_peered":"2024-09-12T02:35:47.549408+0000","last_unstale":"2024-09-12T02:35:47.551211+0000","last_undegraded":"2024-09-12T02:35:47.551211+0000","last_fullsized":"2024-09-12T02:35:47.551211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564795+0000","last_change":"2024-09-12T02:35:47.561157+0000","last_active":"2024-09-12T02:35:47.564795+0000","last_peered":"2024-09-12T02:35:47.564795+0000","last_clean":"2024-09-12T02:35:47.564795+0000","last_became_active":"2024-09-12T02:35:47.560870+0000","last_became_peered":"2024-09-12T02:35:47.560870+0000","last_unstale":"2024-09-12T02:35:47.564795+0000","last_undegraded":"2024-09-12T02:35:47.564795+0000","last_fullsized":"2024-09-12T02:35:47.564795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562746+0000","last_change":"2024-09-12T02:35:47.559676+0000","last_active":"2024-09-12T02:35:47.562746+0000","last_peered":"2024-09-12T02:35:47.562746+0000","last_clean":"2024-09-12T02:35:47.562746+0000","last_became_active":"2024-09-12T02:35:47.559394+0000","last_became_peered":"2024-09-12T02:35:47.559394+0000","last_unstale":"2024-09-12T02:35:47.562746+0000","last_undegraded":"2024-09-12T02:35:47.562746+0000","last_fullsized":"2024-09-12T02:35:47.562746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568168+0000","last_change":"2024-09-12T02:35:46.561281+0000","last_active":"2024-09-12T02:35:47.568168+0000","last_peered":"2024-09-12T02:35:47.568168+0000","last_clean":"2024-09-12T02:35:47.568168+0000","last_became_active":"2024-09-12T02:35:46.561013+0000","last_became_peered":"2024-09-12T02:35:46.561013+0000","last_unstale":"2024-09-12T02:35:47.568168+0000","last_undegraded":"2024-09-12T02:35:47.568168+0000","last_fullsized":"2024-09-12T02:35:47.568168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568619+0000","last_change":"2024-09-12T02:35:47.564156+0000","last_active":"2024-09-12T02:35:47.568619+0000","last_peered":"2024-09-12T02:35:47.568619+0000","last_clean":"2024-09-12T02:35:47.568619+0000","last_became_active":"2024-09-12T02:35:47.563648+0000","last_became_peered":"2024-09-12T02:35:47.563648+0000","last_unstale":"2024-09-12T02:35:47.568619+0000","last_undegraded":"2024-09-12T02:35:47.568619+0000","last_fullsized":"2024-09-12T02:35:47.568619+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569335+0000","last_change":"2024-09-12T02:35:46.554200+0000","last_active":"2024-09-12T02:35:47.569335+0000","last_peered":"2024-09-12T02:35:47.569335+0000","last_clean":"2024-09-12T02:35:47.569335+0000","last_became_active":"2024-09-12T02:35:46.553896+0000","last_became_peered":"2024-09-12T02:35:46.553896+0000","last_unstale":"2024-09-12T02:35:47.569335+0000","last_undegraded":"2024-09-12T02:35:47.569335+0000","last_fullsized":"2024-09-12T02:35:47.569335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560489+0000","last_change":"2024-09-12T02:35:47.559318+0000","last_active":"2024-09-12T02:35:47.560489+0000","last_peered":"2024-09-12T02:35:47.560489+0000","last_clean":"2024-09-12T02:35:47.560489+0000","last_became_active":"2024-09-12T02:35:47.559060+0000","last_became_peered":"2024-09-12T02:35:47.559060+0000","last_unstale":"2024-09-12T02:35:47.560489+0000","last_undegraded":"2024-09-12T02:35:47.560489+0000","last_fullsized":"2024-09-12T02:35:47.560489+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565869+0000","last_change":"2024-09-12T02:35:46.554539+0000","last_active":"2024-09-12T02:35:47.565869+0000","last_peered":"2024-09-12T02:35:47.565869+0000","last_clean":"2024-09-12T02:35:47.565869+0000","last_became_active":"2024-09-12T02:35:46.554102+0000","last_became_peered":"2024-09-12T02:35:46.554102+0000","last_unstale":"2024-09-12T02:35:47.565869+0000","last_undegraded":"2024-09-12T02:35:47.565869+0000","last_fullsized":"2024-09-12T02:35:47.565869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:36.743023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567197+0000","last_change":"2024-09-12T02:35:47.564826+0000","last_active":"2024-09-12T02:35:47.567197+0000","last_peered":"2024-09-12T02:35:47.567197+0000","last_clean":"2024-09-12T02:35:47.567197+0000","last_became_active":"2024-09-12T02:35:47.564507+0000","last_became_peered":"2024-09-12T02:35:47.564507+0000","last_unstale":"2024-09-12T02:35:47.567197+0000","last_undegraded":"2024-09-12T02:35:47.567197+0000","last_fullsized":"2024-09-12T02:35:47.567197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:37.750492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564906+0000","last_change":"2024-09-12T02:35:46.556651+0000","last_active":"2024-09-12T02:35:47.564906+0000","last_peered":"2024-09-12T02:35:47.564906+0000","last_clean":"2024-09-12T02:35:47.564906+0000","last_became_active":"2024-09-12T02:35:46.556327+0000","last_became_peered":"2024-09-12T02:35:46.556327+0000","last_unstale":"2024-09-12T02:35:47.564906+0000","last_undegraded":"2024-09-12T02:35:47.564906+0000","last_fullsized":"2024-09-12T02:35:47.564906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.949797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565760+0000","last_change":"2024-09-12T02:35:47.560250+0000","last_active":"2024-09-12T02:35:47.565760+0000","last_peered":"2024-09-12T02:35:47.565760+0000","last_clean":"2024-09-12T02:35:47.565760+0000","last_became_active":"2024-09-12T02:35:47.559558+0000","last_became_peered":"2024-09-12T02:35:47.559558+0000","last_unstale":"2024-09-12T02:35:47.565760+0000","last_undegraded":"2024-09-12T02:35:47.565760+0000","last_fullsized":"2024-09-12T02:35:47.565760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:00.188617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567045+0000","last_change":"2024-09-12T02:35:46.554241+0000","last_active":"2024-09-12T02:35:47.567045+0000","last_peered":"2024-09-12T02:35:47.567045+0000","last_clean":"2024-09-12T02:35:47.567045+0000","last_became_active":"2024-09-12T02:35:46.553958+0000","last_became_peered":"2024-09-12T02:35:46.553958+0000","last_unstale":"2024-09-12T02:35:47.567045+0000","last_undegraded":"2024-09-12T02:35:47.567045+0000","last_fullsized":"2024-09-12T02:35:47.567045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.561379+0000","last_change":"2024-09-12T02:35:47.559441+0000","last_active":"2024-09-12T02:35:47.561379+0000","last_peered":"2024-09-12T02:35:47.561379+0000","last_clean":"2024-09-12T02:35:47.561379+0000","last_became_active":"2024-09-12T02:35:47.559046+0000","last_became_peered":"2024-09-12T02:35:47.559046+0000","last_unstale":"2024-09-12T02:35:47.561379+0000","last_undegraded":"2024-09-12T02:35:47.561379+0000","last_fullsized":"2024-09-12T02:35:47.561379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563705+0000","last_change":"2024-09-12T02:35:46.558161+0000","last_active":"2024-09-12T02:35:47.563705+0000","last_peered":"2024-09-12T02:35:47.563705+0000","last_clean":"2024-09-12T02:35:47.563705+0000","last_became_active":"2024-09-12T02:35:46.557836+0000","last_became_peered":"2024-09-12T02:35:46.557836+0000","last_unstale":"2024-09-12T02:35:47.563705+0000","last_undegraded":"2024-09-12T02:35:47.563705+0000","last_fullsized":"2024-09-12T02:35:47.563705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568890+0000","last_change":"2024-09-12T02:35:47.565152+0000","last_active":"2024-09-12T02:35:47.568890+0000","last_peered":"2024-09-12T02:35:47.568890+0000","last_clean":"2024-09-12T02:35:47.568890+0000","last_became_active":"2024-09-12T02:35:47.563838+0000","last_became_peered":"2024-09-12T02:35:47.563838+0000","last_unstale":"2024-09-12T02:35:47.568890+0000","last_undegraded":"2024-09-12T02:35:47.568890+0000","last_fullsized":"2024-09-12T02:35:47.568890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:31.526030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548082+0000","last_change":"2024-09-12T02:35:46.554449+0000","last_active":"2024-09-12T02:35:47.548082+0000","last_peered":"2024-09-12T02:35:47.548082+0000","last_clean":"2024-09-12T02:35:47.548082+0000","last_became_active":"2024-09-12T02:35:46.553756+0000","last_became_peered":"2024-09-12T02:35:46.553756+0000","last_unstale":"2024-09-12T02:35:47.548082+0000","last_undegraded":"2024-09-12T02:35:47.548082+0000","last_fullsized":"2024-09-12T02:35:47.548082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:26.270274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.546787+0000","last_change":"2024-09-12T02:35:46.546787+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.546787+0000","last_undegraded":"2024-09-12T02:35:46.546787+0000","last_fullsized":"2024-09-12T02:35:46.546787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.543449+0000","last_change":"2024-09-12T02:35:46.559650+0000","last_active":"2024-09-12T02:35:47.543449+0000","last_peered":"2024-09-12T02:35:47.543449+0000","last_clean":"2024-09-12T02:35:47.543449+0000","last_became_active":"2024-09-12T02:35:46.559382+0000","last_became_peered":"2024-09-12T02:35:46.559382+0000","last_unstale":"2024-09-12T02:35:47.543449+0000","last_undegraded":"2024-09-12T02:35:47.543449+0000","last_fullsized":"2024-09-12T02:35:47.543449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:10.746279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.546029+0000","last_change":"2024-09-12T02:35:46.546029+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.546029+0000","last_undegraded":"2024-09-12T02:35:46.546029+0000","last_fullsized":"2024-09-12T02:35:46.546029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552223+0000","last_change":"2024-09-12T02:35:46.557154+0000","last_active":"2024-09-12T02:35:47.552223+0000","last_peered":"2024-09-12T02:35:47.552223+0000","last_clean":"2024-09-12T02:35:47.552223+0000","last_became_active":"2024-09-12T02:35:46.556451+0000","last_became_peered":"2024-09-12T02:35:46.556451+0000","last_unstale":"2024-09-12T02:35:47.552223+0000","last_undegraded":"2024-09-12T02:35:47.552223+0000","last_fullsized":"2024-09-12T02:35:47.552223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571357+0000","last_change":"2024-09-12T02:35:47.567600+0000","last_active":"2024-09-12T02:35:47.571357+0000","last_peered":"2024-09-12T02:35:47.571357+0000","last_clean":"2024-09-12T02:35:47.571357+0000","last_became_active":"2024-09-12T02:35:47.567311+0000","last_became_peered":"2024-09-12T02:35:47.567311+0000","last_unstale":"2024-09-12T02:35:47.571357+0000","last_undegraded":"2024-09-12T02:35:47.571357+0000","last_fullsized":"2024-09-12T02:35:47.571357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:28.803475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551780+0000","last_change":"2024-09-12T02:35:46.554852+0000","last_active":"2024-09-12T02:35:47.551780+0000","last_peered":"2024-09-12T02:35:47.551780+0000","last_clean":"2024-09-12T02:35:47.551780+0000","last_became_active":"2024-09-12T02:35:46.554514+0000","last_became_peered":"2024-09-12T02:35:46.554514+0000","last_unstale":"2024-09-12T02:35:47.551780+0000","last_undegraded":"2024-09-12T02:35:47.551780+0000","last_fullsized":"2024-09-12T02:35:47.551780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567148+0000","last_change":"2024-09-12T02:35:47.562737+0000","last_active":"2024-09-12T02:35:47.567148+0000","last_peered":"2024-09-12T02:35:47.567148+0000","last_clean":"2024-09-12T02:35:47.567148+0000","last_became_active":"2024-09-12T02:35:47.562421+0000","last_became_peered":"2024-09-12T02:35:47.562421+0000","last_unstale":"2024-09-12T02:35:47.567148+0000","last_undegraded":"2024-09-12T02:35:47.567148+0000","last_fullsized":"2024-09-12T02:35:47.567148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562082+0000","last_change":"2024-09-12T02:35:46.559638+0000","last_active":"2024-09-12T02:35:47.562082+0000","last_peered":"2024-09-12T02:35:47.562082+0000","last_clean":"2024-09-12T02:35:47.562082+0000","last_became_active":"2024-09-12T02:35:46.559442+0000","last_became_peered":"2024-09-12T02:35:46.559442+0000","last_unstale":"2024-09-12T02:35:47.562082+0000","last_undegraded":"2024-09-12T02:35:47.562082+0000","last_fullsized":"2024-09-12T02:35:47.562082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:44.377608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560122+0000","last_change":"2024-09-12T02:35:47.552392+0000","last_active":"2024-09-12T02:35:47.560122+0000","last_peered":"2024-09-12T02:35:47.560122+0000","last_clean":"2024-09-12T02:35:47.560122+0000","last_became_active":"2024-09-12T02:35:47.551877+0000","last_became_peered":"2024-09-12T02:35:47.551877+0000","last_unstale":"2024-09-12T02:35:47.560122+0000","last_undegraded":"2024-09-12T02:35:47.560122+0000","last_fullsized":"2024-09-12T02:35:47.560122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573921+0000","last_change":"2024-09-12T02:35:46.555192+0000","last_active":"2024-09-12T02:35:47.573921+0000","last_peered":"2024-09-12T02:35:47.573921+0000","last_clean":"2024-09-12T02:35:47.573921+0000","last_became_active":"2024-09-12T02:35:46.554874+0000","last_became_peered":"2024-09-12T02:35:46.554874+0000","last_unstale":"2024-09-12T02:35:47.573921+0000","last_undegraded":"2024-09-12T02:35:47.573921+0000","last_fullsized":"2024-09-12T02:35:47.573921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:39.001935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567032+0000","last_change":"2024-09-12T02:35:47.561844+0000","last_active":"2024-09-12T02:35:47.567032+0000","last_peered":"2024-09-12T02:35:47.567032+0000","last_clean":"2024-09-12T02:35:47.567032+0000","last_became_active":"2024-09-12T02:35:47.561576+0000","last_became_peered":"2024-09-12T02:35:47.561576+0000","last_unstale":"2024-09-12T02:35:47.567032+0000","last_undegraded":"2024-09-12T02:35:47.567032+0000","last_fullsized":"2024-09-12T02:35:47.567032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567429+0000","last_change":"2024-09-12T02:35:46.557645+0000","last_active":"2024-09-12T02:35:47.567429+0000","last_peered":"2024-09-12T02:35:47.567429+0000","last_clean":"2024-09-12T02:35:47.567429+0000","last_became_active":"2024-09-12T02:35:46.557388+0000","last_became_peered":"2024-09-12T02:35:46.557388+0000","last_unstale":"2024-09-12T02:35:47.567429+0000","last_undegraded":"2024-09-12T02:35:47.567429+0000","last_fullsized":"2024-09-12T02:35:47.567429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:13.920180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567136+0000","last_change":"2024-09-12T02:35:47.563938+0000","last_active":"2024-09-12T02:35:47.567136+0000","last_peered":"2024-09-12T02:35:47.567136+0000","last_clean":"2024-09-12T02:35:47.567136+0000","last_became_active":"2024-09-12T02:35:47.563607+0000","last_became_peered":"2024-09-12T02:35:47.563607+0000","last_unstale":"2024-09-12T02:35:47.567136+0000","last_undegraded":"2024-09-12T02:35:47.567136+0000","last_fullsized":"2024-09-12T02:35:47.567136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:31.957266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555958+0000","last_change":"2024-09-12T02:35:46.554473+0000","last_active":"2024-09-12T02:35:46.555958+0000","last_peered":"2024-09-12T02:35:46.555958+0000","last_clean":"2024-09-12T02:35:46.555958+0000","last_became_active":"2024-09-12T02:35:46.554153+0000","last_became_peered":"2024-09-12T02:35:46.554153+0000","last_unstale":"2024-09-12T02:35:46.555958+0000","last_undegraded":"2024-09-12T02:35:46.555958+0000","last_fullsized":"2024-09-12T02:35:46.555958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:17.059148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560733+0000","last_change":"2024-09-12T02:35:47.557330+0000","last_active":"2024-09-12T02:35:47.560733+0000","last_peered":"2024-09-12T02:35:47.560733+0000","last_clean":"2024-09-12T02:35:47.560733+0000","last_became_active":"2024-09-12T02:35:47.557105+0000","last_became_peered":"2024-09-12T02:35:47.557105+0000","last_unstale":"2024-09-12T02:35:47.560733+0000","last_undegraded":"2024-09-12T02:35:47.560733+0000","last_fullsized":"2024-09-12T02:35:47.560733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:06.934622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.555099+0000","last_change":"2024-09-12T02:35:46.551757+0000","last_active":"2024-09-12T02:35:47.555099+0000","last_peered":"2024-09-12T02:35:47.555099+0000","last_clean":"2024-09-12T02:35:47.555099+0000","last_became_active":"2024-09-12T02:35:46.551465+0000","last_became_peered":"2024-09-12T02:35:46.551465+0000","last_unstale":"2024-09-12T02:35:47.555099+0000","last_undegraded":"2024-09-12T02:35:47.555099+0000","last_fullsized":"2024-09-12T02:35:47.555099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:59.913044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568033+0000","last_change":"2024-09-12T02:35:47.565375+0000","last_active":"2024-09-12T02:35:47.568033+0000","last_peered":"2024-09-12T02:35:47.568033+0000","last_clean":"2024-09-12T02:35:47.568033+0000","last_became_active":"2024-09-12T02:35:47.565111+0000","last_became_peered":"2024-09-12T02:35:47.565111+0000","last_unstale":"2024-09-12T02:35:47.568033+0000","last_undegraded":"2024-09-12T02:35:47.568033+0000","last_fullsized":"2024-09-12T02:35:47.568033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:07.767848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564890+0000","last_change":"2024-09-12T02:35:46.553376+0000","last_active":"2024-09-12T02:35:47.564890+0000","last_peered":"2024-09-12T02:35:47.564890+0000","last_clean":"2024-09-12T02:35:47.564890+0000","last_became_active":"2024-09-12T02:35:46.552720+0000","last_became_peered":"2024-09-12T02:35:46.552720+0000","last_unstale":"2024-09-12T02:35:47.564890+0000","last_undegraded":"2024-09-12T02:35:47.564890+0000","last_fullsized":"2024-09-12T02:35:47.564890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.187005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567171+0000","last_change":"2024-09-12T02:35:47.564398+0000","last_active":"2024-09-12T02:35:47.567171+0000","last_peered":"2024-09-12T02:35:47.567171+0000","last_clean":"2024-09-12T02:35:47.567171+0000","last_became_active":"2024-09-12T02:35:47.564149+0000","last_became_peered":"2024-09-12T02:35:47.564149+0000","last_unstale":"2024-09-12T02:35:47.567171+0000","last_undegraded":"2024-09-12T02:35:47.567171+0000","last_fullsized":"2024-09-12T02:35:47.567171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:49.428222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569596+0000","last_change":"2024-09-12T02:35:46.556394+0000","last_active":"2024-09-12T02:35:47.569596+0000","last_peered":"2024-09-12T02:35:47.569596+0000","last_clean":"2024-09-12T02:35:47.569596+0000","last_became_active":"2024-09-12T02:35:46.555836+0000","last_became_peered":"2024-09-12T02:35:46.555836+0000","last_unstale":"2024-09-12T02:35:47.569596+0000","last_undegraded":"2024-09-12T02:35:47.569596+0000","last_fullsized":"2024-09-12T02:35:47.569596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569270+0000","last_change":"2024-09-12T02:35:47.565967+0000","last_active":"2024-09-12T02:35:47.569270+0000","last_peered":"2024-09-12T02:35:47.569270+0000","last_clean":"2024-09-12T02:35:47.569270+0000","last_became_active":"2024-09-12T02:35:47.565712+0000","last_became_peered":"2024-09-12T02:35:47.565712+0000","last_unstale":"2024-09-12T02:35:47.569270+0000","last_undegraded":"2024-09-12T02:35:47.569270+0000","last_fullsized":"2024-09-12T02:35:47.569270+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565154+0000","last_change":"2024-09-12T02:35:46.557610+0000","last_active":"2024-09-12T02:35:47.565154+0000","last_peered":"2024-09-12T02:35:47.565154+0000","last_clean":"2024-09-12T02:35:47.565154+0000","last_became_active":"2024-09-12T02:35:46.557342+0000","last_became_peered":"2024-09-12T02:35:46.557342+0000","last_unstale":"2024-09-12T02:35:47.565154+0000","last_undegraded":"2024-09-12T02:35:47.565154+0000","last_fullsized":"2024-09-12T02:35:47.565154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:30.518562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560280+0000","last_change":"2024-09-12T02:35:47.554450+0000","last_active":"2024-09-12T02:35:47.560280+0000","last_peered":"2024-09-12T02:35:47.560280+0000","last_clean":"2024-09-12T02:35:47.560280+0000","last_became_active":"2024-09-12T02:35:47.553796+0000","last_became_peered":"2024-09-12T02:35:47.553796+0000","last_unstale":"2024-09-12T02:35:47.560280+0000","last_undegraded":"2024-09-12T02:35:47.560280+0000","last_fullsized":"2024-09-12T02:35:47.560280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549398+0000","last_change":"2024-09-12T02:35:46.554498+0000","last_active":"2024-09-12T02:35:47.549398+0000","last_peered":"2024-09-12T02:35:47.549398+0000","last_clean":"2024-09-12T02:35:47.549398+0000","last_became_active":"2024-09-12T02:35:46.553952+0000","last_became_peered":"2024-09-12T02:35:46.553952+0000","last_unstale":"2024-09-12T02:35:47.549398+0000","last_undegraded":"2024-09-12T02:35:47.549398+0000","last_fullsized":"2024-09-12T02:35:47.549398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:48.420754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.551160+0000","last_change":"2024-09-12T02:35:46.551160+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.551160+0000","last_undegraded":"2024-09-12T02:35:46.551160+0000","last_fullsized":"2024-09-12T02:35:46.551160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555994+0000","last_change":"2024-09-12T02:35:46.554380+0000","last_active":"2024-09-12T02:35:46.555994+0000","last_peered":"2024-09-12T02:35:46.555994+0000","last_clean":"2024-09-12T02:35:46.555994+0000","last_became_active":"2024-09-12T02:35:46.554101+0000","last_became_peered":"2024-09-12T02:35:46.554101+0000","last_unstale":"2024-09-12T02:35:46.555994+0000","last_undegraded":"2024-09-12T02:35:46.555994+0000","last_fullsized":"2024-09-12T02:35:46.555994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:41.768841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566799+0000","last_change":"2024-09-12T02:35:47.564388+0000","last_active":"2024-09-12T02:35:47.566799+0000","last_peered":"2024-09-12T02:35:47.566799+0000","last_clean":"2024-09-12T02:35:47.566799+0000","last_became_active":"2024-09-12T02:35:47.564109+0000","last_became_peered":"2024-09-12T02:35:47.564109+0000","last_unstale":"2024-09-12T02:35:47.566799+0000","last_undegraded":"2024-09-12T02:35:47.566799+0000","last_fullsized":"2024-09-12T02:35:47.566799+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:14.539957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.559043+0000","last_change":"2024-09-12T02:35:46.557363+0000","last_active":"2024-09-12T02:35:46.559043+0000","last_peered":"2024-09-12T02:35:46.559043+0000","last_clean":"2024-09-12T02:35:46.559043+0000","last_became_active":"2024-09-12T02:35:46.557054+0000","last_became_peered":"2024-09-12T02:35:46.557054+0000","last_unstale":"2024-09-12T02:35:46.559043+0000","last_undegraded":"2024-09-12T02:35:46.559043+0000","last_fullsized":"2024-09-12T02:35:46.559043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:53.395029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-12T02:35:46.547655+0000","last_change":"2024-09-12T02:35:46.547655+0000","last_active":"2024-09-12T02:35:46.534099+0000","last_peered":"2024-09-12T02:35:46.534099+0000","last_clean":"2024-09-12T02:35:46.534099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:35:46.547655+0000","last_undegraded":"2024-09-12T02:35:46.547655+0000","last_fullsized":"2024-09-12T02:35:46.547655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.561475+0000","last_change":"2024-09-12T02:35:46.560646+0000","last_active":"2024-09-12T02:35:46.561475+0000","last_peered":"2024-09-12T02:35:46.561475+0000","last_clean":"2024-09-12T02:35:46.561475+0000","last_became_active":"2024-09-12T02:35:46.560281+0000","last_became_peered":"2024-09-12T02:35:46.560281+0000","last_unstale":"2024-09-12T02:35:46.561475+0000","last_undegraded":"2024-09-12T02:35:46.561475+0000","last_fullsized":"2024-09-12T02:35:46.561475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:15.293030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563636+0000","last_change":"2024-09-12T02:35:47.561258+0000","last_active":"2024-09-12T02:35:47.563636+0000","last_peered":"2024-09-12T02:35:47.563636+0000","last_clean":"2024-09-12T02:35:47.563636+0000","last_became_active":"2024-09-12T02:35:47.560964+0000","last_became_peered":"2024-09-12T02:35:47.560964+0000","last_unstale":"2024-09-12T02:35:47.563636+0000","last_undegraded":"2024-09-12T02:35:47.563636+0000","last_fullsized":"2024-09-12T02:35:47.563636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.555480+0000","last_change":"2024-09-12T02:35:46.552700+0000","last_active":"2024-09-12T02:35:46.555480+0000","last_peered":"2024-09-12T02:35:46.555480+0000","last_clean":"2024-09-12T02:35:46.555480+0000","last_became_active":"2024-09-12T02:35:46.552416+0000","last_became_peered":"2024-09-12T02:35:46.552416+0000","last_unstale":"2024-09-12T02:35:46.555480+0000","last_undegraded":"2024-09-12T02:35:46.555480+0000","last_fullsized":"2024-09-12T02:35:46.555480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:16.091618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566209+0000","last_change":"2024-09-12T02:35:47.564929+0000","last_active":"2024-09-12T02:35:47.566209+0000","last_peered":"2024-09-12T02:35:47.566209+0000","last_clean":"2024-09-12T02:35:47.566209+0000","last_became_active":"2024-09-12T02:35:47.564632+0000","last_became_peered":"2024-09-12T02:35:47.564632+0000","last_unstale":"2024-09-12T02:35:47.566209+0000","last_undegraded":"2024-09-12T02:35:47.566209+0000","last_fullsized":"2024-09-12T02:35:47.566209+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565602+0000","last_change":"2024-09-12T02:35:46.550057+0000","last_active":"2024-09-12T02:35:47.565602+0000","last_peered":"2024-09-12T02:35:47.565602+0000","last_clean":"2024-09-12T02:35:47.565602+0000","last_became_active":"2024-09-12T02:35:46.549620+0000","last_became_peered":"2024-09-12T02:35:46.549620+0000","last_unstale":"2024-09-12T02:35:47.565602+0000","last_undegraded":"2024-09-12T02:35:47.565602+0000","last_fullsized":"2024-09-12T02:35:47.565602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:08.703290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573748+0000","last_change":"2024-09-12T02:35:47.570041+0000","last_active":"2024-09-12T02:35:47.573748+0000","last_peered":"2024-09-12T02:35:47.573748+0000","last_clean":"2024-09-12T02:35:47.573748+0000","last_became_active":"2024-09-12T02:35:47.569745+0000","last_became_peered":"2024-09-12T02:35:47.569745+0000","last_unstale":"2024-09-12T02:35:47.573748+0000","last_undegraded":"2024-09-12T02:35:47.573748+0000","last_fullsized":"2024-09-12T02:35:47.573748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.544098+0000","last_change":"2024-09-12T02:35:46.556974+0000","last_active":"2024-09-12T02:35:47.544098+0000","last_peered":"2024-09-12T02:35:47.544098+0000","last_clean":"2024-09-12T02:35:47.544098+0000","last_became_active":"2024-09-12T02:35:46.556679+0000","last_became_peered":"2024-09-12T02:35:46.556679+0000","last_unstale":"2024-09-12T02:35:47.544098+0000","last_undegraded":"2024-09-12T02:35:47.544098+0000","last_fullsized":"2024-09-12T02:35:47.544098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:04.764613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566829+0000","last_change":"2024-09-12T02:35:47.562760+0000","last_active":"2024-09-12T02:35:47.566829+0000","last_peered":"2024-09-12T02:35:47.566829+0000","last_clean":"2024-09-12T02:35:47.566829+0000","last_became_active":"2024-09-12T02:35:47.562486+0000","last_became_peered":"2024-09-12T02:35:47.562486+0000","last_unstale":"2024-09-12T02:35:47.566829+0000","last_undegraded":"2024-09-12T02:35:47.566829+0000","last_fullsized":"2024-09-12T02:35:47.566829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549761+0000","last_change":"2024-09-12T02:35:46.560913+0000","last_active":"2024-09-12T02:35:47.549761+0000","last_peered":"2024-09-12T02:35:47.549761+0000","last_clean":"2024-09-12T02:35:47.549761+0000","last_became_active":"2024-09-12T02:35:46.560622+0000","last_became_peered":"2024-09-12T02:35:46.560622+0000","last_unstale":"2024-09-12T02:35:47.549761+0000","last_undegraded":"2024-09-12T02:35:47.549761+0000","last_fullsized":"2024-09-12T02:35:47.549761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.269933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560072+0000","last_change":"2024-09-12T02:35:47.552179+0000","last_active":"2024-09-12T02:35:47.560072+0000","last_peered":"2024-09-12T02:35:47.560072+0000","last_clean":"2024-09-12T02:35:47.560072+0000","last_became_active":"2024-09-12T02:35:47.551519+0000","last_became_peered":"2024-09-12T02:35:47.551519+0000","last_unstale":"2024-09-12T02:35:47.560072+0000","last_undegraded":"2024-09-12T02:35:47.560072+0000","last_fullsized":"2024-09-12T02:35:47.560072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551345+0000","last_change":"2024-09-12T02:35:46.556235+0000","last_active":"2024-09-12T02:35:47.551345+0000","last_peered":"2024-09-12T02:35:47.551345+0000","last_clean":"2024-09-12T02:35:47.551345+0000","last_became_active":"2024-09-12T02:35:46.555843+0000","last_became_peered":"2024-09-12T02:35:46.555843+0000","last_unstale":"2024-09-12T02:35:47.551345+0000","last_undegraded":"2024-09-12T02:35:47.551345+0000","last_fullsized":"2024-09-12T02:35:47.551345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565776+0000","last_change":"2024-09-12T02:35:47.562441+0000","last_active":"2024-09-12T02:35:47.565776+0000","last_peered":"2024-09-12T02:35:47.565776+0000","last_clean":"2024-09-12T02:35:47.565776+0000","last_became_active":"2024-09-12T02:35:47.562116+0000","last_became_peered":"2024-09-12T02:35:47.562116+0000","last_unstale":"2024-09-12T02:35:47.565776+0000","last_undegraded":"2024-09-12T02:35:47.565776+0000","last_fullsized":"2024-09-12T02:35:47.565776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548999+0000","last_change":"2024-09-12T02:35:46.554033+0000","last_active":"2024-09-12T02:35:47.548999+0000","last_peered":"2024-09-12T02:35:47.548999+0000","last_clean":"2024-09-12T02:35:47.548999+0000","last_became_active":"2024-09-12T02:35:46.553741+0000","last_became_peered":"2024-09-12T02:35:46.553741+0000","last_unstale":"2024-09-12T02:35:47.548999+0000","last_undegraded":"2024-09-12T02:35:47.548999+0000","last_fullsized":"2024-09-12T02:35:47.548999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556909+0000","last_change":"2024-09-12T02:35:47.552427+0000","last_active":"2024-09-12T02:35:47.556909+0000","last_peered":"2024-09-12T02:35:47.556909+0000","last_clean":"2024-09-12T02:35:47.556909+0000","last_became_active":"2024-09-12T02:35:47.552172+0000","last_became_peered":"2024-09-12T02:35:47.552172+0000","last_unstale":"2024-09-12T02:35:47.556909+0000","last_undegraded":"2024-09-12T02:35:47.556909+0000","last_fullsized":"2024-09-12T02:35:47.556909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.545577+0000","last_change":"2024-09-12T02:35:46.557520+0000","last_active":"2024-09-12T02:35:47.545577+0000","last_peered":"2024-09-12T02:35:47.545577+0000","last_clean":"2024-09-12T02:35:47.545577+0000","last_became_active":"2024-09-12T02:35:46.557248+0000","last_became_peered":"2024-09-12T02:35:46.557248+0000","last_unstale":"2024-09-12T02:35:47.545577+0000","last_undegraded":"2024-09-12T02:35:47.545577+0000","last_fullsized":"2024-09-12T02:35:47.545577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569216+0000","last_change":"2024-09-12T02:35:47.568444+0000","last_active":"2024-09-12T02:35:47.569216+0000","last_peered":"2024-09-12T02:35:47.569216+0000","last_clean":"2024-09-12T02:35:47.569216+0000","last_became_active":"2024-09-12T02:35:47.568168+0000","last_became_peered":"2024-09-12T02:35:47.568168+0000","last_unstale":"2024-09-12T02:35:47.569216+0000","last_undegraded":"2024-09-12T02:35:47.569216+0000","last_fullsized":"2024-09-12T02:35:47.569216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549710+0000","last_change":"2024-09-12T02:35:46.556913+0000","last_active":"2024-09-12T02:35:47.549710+0000","last_peered":"2024-09-12T02:35:47.549710+0000","last_clean":"2024-09-12T02:35:47.549710+0000","last_became_active":"2024-09-12T02:35:46.555900+0000","last_became_peered":"2024-09-12T02:35:46.555900+0000","last_unstale":"2024-09-12T02:35:47.549710+0000","last_undegraded":"2024-09-12T02:35:47.549710+0000","last_fullsized":"2024-09-12T02:35:47.549710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:26.550563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566577+0000","last_change":"2024-09-12T02:35:47.562581+0000","last_active":"2024-09-12T02:35:47.566577+0000","last_peered":"2024-09-12T02:35:47.566577+0000","last_clean":"2024-09-12T02:35:47.566577+0000","last_became_active":"2024-09-12T02:35:47.562297+0000","last_became_peered":"2024-09-12T02:35:47.562297+0000","last_unstale":"2024-09-12T02:35:47.566577+0000","last_undegraded":"2024-09-12T02:35:47.566577+0000","last_fullsized":"2024-09-12T02:35:47.566577+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.547634+0000","last_change":"2024-09-12T02:35:46.551656+0000","last_active":"2024-09-12T02:35:47.547634+0000","last_peered":"2024-09-12T02:35:47.547634+0000","last_clean":"2024-09-12T02:35:47.547634+0000","last_became_active":"2024-09-12T02:35:46.551361+0000","last_became_peered":"2024-09-12T02:35:46.551361+0000","last_unstale":"2024-09-12T02:35:47.547634+0000","last_undegraded":"2024-09-12T02:35:47.547634+0000","last_fullsized":"2024-09-12T02:35:47.547634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.574291+0000","last_change":"2024-09-12T02:35:47.568904+0000","last_active":"2024-09-12T02:35:47.574291+0000","last_peered":"2024-09-12T02:35:47.574291+0000","last_clean":"2024-09-12T02:35:47.574291+0000","last_became_active":"2024-09-12T02:35:47.568611+0000","last_became_peered":"2024-09-12T02:35:47.568611+0000","last_unstale":"2024-09-12T02:35:47.574291+0000","last_undegraded":"2024-09-12T02:35:47.574291+0000","last_fullsized":"2024-09-12T02:35:47.574291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:46.102884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567096+0000","last_change":"2024-09-12T02:35:46.550127+0000","last_active":"2024-09-12T02:35:47.567096+0000","last_peered":"2024-09-12T02:35:47.567096+0000","last_clean":"2024-09-12T02:35:47.567096+0000","last_became_active":"2024-09-12T02:35:46.548956+0000","last_became_peered":"2024-09-12T02:35:46.548956+0000","last_unstale":"2024-09-12T02:35:47.567096+0000","last_undegraded":"2024-09-12T02:35:47.567096+0000","last_fullsized":"2024-09-12T02:35:47.567096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":294,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.557318+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:35:47.557318+0000","last_peered":"2024-09-12T02:35:47.557318+0000","last_clean":"2024-09-12T02:35:47.557318+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:35:47.557318+0000","last_undegraded":"2024-09-12T02:35:47.557318+0000","last_fullsized":"2024-09-12T02:35:47.557318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1060864,"data_stored":449836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46088,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325752,"statfs":{"total":96636764160,"available":96589570048,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41104,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330736,"statfs":{"total":96636764160,"available":96594673664,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542239,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1024000,"data_stored":436092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542238,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1024000,"data_stored":436092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:51.172 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-12T02:35:51.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.550694+0000', 'last_change': '2024-09-12T02:35:46.550694+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.550694+0000', 'last_undegraded': '2024-09-12T02:35:46.550694+0000', 'last_fullsized': '2024-09-12T02:35:46.550694+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.172 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-12T02:35:51.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.549015+0000', 'last_change': '2024-09-12T02:35:46.549015+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.549015+0000', 'last_undegraded': '2024-09-12T02:35:46.549015+0000', 'last_fullsized': '2024-09-12T02:35:46.549015+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:PG 13.32 is not active+clean 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.551574+0000', 'last_change': '2024-09-12T02:35:46.551574+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.551574+0000', 'last_undegraded': '2024-09-12T02:35:46.551574+0000', 'last_fullsized': '2024-09-12T02:35:46.551574+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.547222+0000', 'last_change': '2024-09-12T02:35:46.547222+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.547222+0000', 'last_undegraded': '2024-09-12T02:35:46.547222+0000', 'last_fullsized': '2024-09-12T02:35:46.547222+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2e is not active+clean 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.548757+0000', 'last_change': '2024-09-12T02:35:46.548757+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.548757+0000', 'last_undegraded': '2024-09-12T02:35:46.548757+0000', 'last_fullsized': '2024-09-12T02:35:46.548757+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2c is not active+clean 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.550253+0000', 'last_change': '2024-09-12T02:35:46.550253+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.550253+0000', 'last_undegraded': '2024-09-12T02:35:46.550253+0000', 'last_fullsized': '2024-09-12T02:35:46.550253+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2b is not active+clean 2024-09-12T02:35:51.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.548734+0000', 'last_change': '2024-09-12T02:35:46.548734+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.548734+0000', 'last_undegraded': '2024-09-12T02:35:46.548734+0000', 'last_fullsized': '2024-09-12T02:35:46.548734+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:PG 13.28 is not active+clean 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.548117+0000', 'last_change': '2024-09-12T02:35:46.548117+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.548117+0000', 'last_undegraded': '2024-09-12T02:35:46.548117+0000', 'last_fullsized': '2024-09-12T02:35:46.548117+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.546787+0000', 'last_change': '2024-09-12T02:35:46.546787+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.546787+0000', 'last_undegraded': '2024-09-12T02:35:46.546787+0000', 'last_fullsized': '2024-09-12T02:35:46.546787+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.546029+0000', 'last_change': '2024-09-12T02:35:46.546029+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.546029+0000', 'last_undegraded': '2024-09-12T02:35:46.546029+0000', 'last_fullsized': '2024-09-12T02:35:46.546029+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.551160+0000', 'last_change': '2024-09-12T02:35:46.551160+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.551160+0000', 'last_undegraded': '2024-09-12T02:35:46.551160+0000', 'last_fullsized': '2024-09-12T02:35:46.551160+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:PG 13.8 is not active+clean 2024-09-12T02:35:51.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:35:46.547655+0000', 'last_change': '2024-09-12T02:35:46.547655+0000', 'last_active': '2024-09-12T02:35:46.534099+0000', 'last_peered': '2024-09-12T02:35:46.534099+0000', 'last_clean': '2024-09-12T02:35:46.534099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:35:46.547655+0000', 'last_undegraded': '2024-09-12T02:35:46.547655+0000', 'last_fullsized': '2024-09-12T02:35:46.547655+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'last_clean_scrub_stamp': '2024-09-12T02:35:46.534099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:35:51.175 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:35:51.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.307+0000 7f3c3c480640 1 Processor -- start 2024-09-12T02:35:51.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.307+0000 7f3c3c480640 1 -- start start 2024-09-12T02:35:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3c480640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c340cf7c0 0x7f3c3415ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3c480640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c340b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3c480640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3c340ce380 0x7f3c340ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3c480640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3c340ced10 con 0x7f3c340ce380 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3c480640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f3c3406de00 con 0x7f3c340cf7c0 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3c480640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3406d280 con 0x7f3c340b4760 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3c340ce380 0x7f3c340ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3c340ce380 0x7f3c340ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33180/0 (socket says 172.21.15.181:33180) 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 -- 172.21.15.181:0/3665544337 learned_addr learned my addr 172.21.15.181:0/3665544337 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c39a1b640 1 --2- 172.21.15.181:0/3665544337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c340b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3a21c640 1 --2- 172.21.15.181:0/3665544337 >> v2:172.21.15.204:3300/0 conn(0x7f3c340cf7c0 0x7f3c3415ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 -- 172.21.15.181:0/3665544337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 msgr2=0x7f3c340b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 --2- 172.21.15.181:0/3665544337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c340b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 -- 172.21.15.181:0/3665544337 >> v2:172.21.15.204:3300/0 conn(0x7f3c340cf7c0 msgr2=0x7f3c3415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 --2- 172.21.15.181:0/3665544337 >> v2:172.21.15.204:3300/0 conn(0x7f3c340cf7c0 0x7f3c3415ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.308+0000 7f3c3aa1d640 1 -- 172.21.15.181:0/3665544337 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3406d560 con 0x7f3c340ce380 2024-09-12T02:35:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.309+0000 7f3c3aa1d640 1 --2- 172.21.15.181:0/3665544337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ce7d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3c3406f910 tx=0x7f3c2c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed79d0a7fb2d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.309+0000 7f3c3921a640 1 -- 172.21.15.181:0/3665544337 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c036070 con 0x7f3c340ce380 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.309+0000 7f3c3921a640 1 -- 172.21.15.181:0/3665544337 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c2c031600 con 0x7f3c340ce380 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.309+0000 7f3c3921a640 1 -- 172.21.15.181:0/3665544337 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0319d0 con 0x7f3c340ce380 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 -- 172.21.15.181:0/3665544337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 msgr2=0x7f3c340ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3665544337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ce7d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3c3406f910 tx=0x7f3c2c02a610 comp rx=0 tx=0).stop 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 -- 172.21.15.181:0/3665544337 shutdown_connections 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3665544337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ce7d0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3665544337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c340b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3665544337 >> v2:172.21.15.204:3300/0 conn(0x7f3c340cf7c0 0x7f3c3415ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 -- 172.21.15.181:0/3665544337 >> 172.21.15.181:0/3665544337 conn(0x7f3c3406bc10 msgr2=0x7f3c3406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 -- 172.21.15.181:0/3665544337 shutdown_connections 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.310+0000 7f3c3c480640 1 -- 172.21.15.181:0/3665544337 wait complete. 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.311+0000 7f3c3c480640 1 Processor -- start 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.311+0000 7f3c3c480640 1 -- start start 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3c480640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c34155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3c480640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3c480640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c340cf7c0 0x7f3c3415d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3c480640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3406cf50 con 0x7f3c340ce380 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3c480640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3406db20 con 0x7f3c340cf7c0 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3c480640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3415f1b0 con 0x7f3c340b4760 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33182/0 (socket says 172.21.15.181:33182) 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 -- 172.21.15.181:0/3199379552 learned_addr learned my addr 172.21.15.181:0/3199379552 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3aa1d640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c340cf7c0 0x7f3c3415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c3a21c640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c34155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 -- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 msgr2=0x7f3c34155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c34155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 -- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c340cf7c0 msgr2=0x7f3c3415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c340cf7c0 0x7f3c3415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 -- 172.21.15.181:0/3199379552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c340ae0f0 con 0x7f3c340ce380 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c39a1b640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ad680 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d5f0 tx=0x7f3c2400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.312+0000 7f3c2affd640 1 -- 172.21.15.181:0/3199379552 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c240125f0 con 0x7f3c340ce380 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.313+0000 7f3c2affd640 1 -- 172.21.15.181:0/3199379552 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c24019070 con 0x7f3c340ce380 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.313+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c340ae3d0 con 0x7f3c340ce380 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.313+0000 7f3c2affd640 1 -- 172.21.15.181:0/3199379552 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c240129d0 con 0x7f3c340ce380 2024-09-12T02:35:51.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.313+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c340ae990 con 0x7f3c340ce380 2024-09-12T02:35:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.314+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c340cfba0 con 0x7f3c340ce380 2024-09-12T02:35:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.314+0000 7f3c2affd640 1 -- 172.21.15.181:0/3199379552 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c24012b70 con 0x7f3c340ce380 2024-09-12T02:35:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.314+0000 7f3c2affd640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c1806be30 0x7f3c1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.314+0000 7f3c2affd640 1 -- 172.21.15.181:0/3199379552 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f3c2408b0f0 con 0x7f3c340ce380 2024-09-12T02:35:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.314+0000 7f3c3a21c640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c1806be30 0x7f3c1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.315+0000 7f3c3a21c640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c1806be30 0x7f3c1806e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3c30006fd0 tx=0x7f3c30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:51.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.319+0000 7f3c2affd640 1 -- 172.21.15.181:0/3199379552 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c24059450 con 0x7f3c340ce380 2024-09-12T02:35:51.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.547+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3c34074140 con 0x7f3c340ce380 2024-09-12T02:35:51.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.547+0000 7f3c2affd640 1 -- 172.21.15.181:0/3199379552 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1562 (secure 0 0 0) 0x7f3c2405d750 con 0x7f3c340ce380 2024-09-12T02:35:51.548 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:51.548 INFO:teuthology.orchestra.run.smithi181.stdout:{"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":472,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":87,"num_osds":8,"num_up_osds":8,"osd_up_since":1726108091,"num_in_osds":8,"osd_in_since":1726108081,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"creating+peering","count":12}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":292007936,"bytes_avail":772802105344,"bytes_total":773094113280,"inactive_pgs_ratio":0.12371134012937546,"write_bytes_sec":3434,"read_op_per_sec":0,"write_op_per_sec":10},"fsmap":{"epoch":69,"btime":"2024-09-12T02:35:49:556212+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7257}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-12T02:35:37.706321+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T02:35:51.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c1806be30 msgr2=0x7f3c1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c1806be30 0x7f3c1806e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3c30006fd0 tx=0x7f3c30008040 comp rx=0 tx=0).stop 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 msgr2=0x7f3c340ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ad680 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d5f0 tx=0x7f3c2400dab0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 shutdown_connections 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3c1806be30 0x7f3c1806e2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c340cf7c0 0x7f3c3415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c340ce380 0x7f3c340ad680 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 --2- 172.21.15.181:0/3199379552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c340b4760 0x7f3c34155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 >> 172.21.15.181:0/3199379552 conn(0x7f3c3406bc10 msgr2=0x7f3c34158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 shutdown_connections 2024-09-12T02:35:51.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.549+0000 7f3c3c480640 1 -- 172.21.15.181:0/3199379552 wait complete. 2024-09-12T02:35:51.561 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:35:51.562 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:51.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.659+0000 7f2d9065e640 1 Processor -- start 2024-09-12T02:35:51.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.659+0000 7f2d9065e640 1 -- start start 2024-09-12T02:35:51.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.660+0000 7f2d9065e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d88156950 0x7f2d8815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.660+0000 7f2d9065e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2d8806c320 0x7f2d880cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.660+0000 7f2d9065e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8806e240 con 0x7f2d8815fe70 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.660+0000 7f2d9065e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2d88156d30 con 0x7f2d8806c320 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.660+0000 7f2d9065e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2d88160380 con 0x7f2d88156950 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8ebfb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2d8806c320 0x7f2d880cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8ebfb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2d8806c320 0x7f2d880cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33198/0 (socket says 172.21.15.181:33198) 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8ebfb640 1 -- 172.21.15.181:0/3789662460 learned_addr learned my addr 172.21.15.181:0/3789662460 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8e3fa640 1 --2- 172.21.15.181:0/3789662460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d88156950 0x7f2d8815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8ebfb640 1 -- 172.21.15.181:0/3789662460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d88156950 msgr2=0x7f2d8815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8ebfb640 1 --2- 172.21.15.181:0/3789662460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d88156950 0x7f2d8815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8ebfb640 1 -- 172.21.15.181:0/3789662460 >> v1:172.21.15.204:6789/0 conn(0x7f2d8815fe70 legacy=0x7f2d8806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.661+0000 7f2d8ebfb640 1 -- 172.21.15.181:0/3789662460 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d88160660 con 0x7f2d8806c320 2024-09-12T02:35:51.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d8ebfb640 1 --2- 172.21.15.181:0/3789662460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d8806c320 0x7f2d880cf3e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009e50 tx=0x7f2d8002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daef11d01f3c48d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:51.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d8d3f8640 1 -- 172.21.15.181:0/3789662460 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80036070 con 0x7f2d8806c320 2024-09-12T02:35:51.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d8d3f8640 1 -- 172.21.15.181:0/3789662460 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d80031600 con 0x7f2d8806c320 2024-09-12T02:35:51.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d8d3f8640 1 -- 172.21.15.181:0/3789662460 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d800319d0 con 0x7f2d8806c320 2024-09-12T02:35:51.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 -- 172.21.15.181:0/3789662460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d8806c320 msgr2=0x7f2d880cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3789662460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d8806c320 0x7f2d880cf3e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009e50 tx=0x7f2d8002a710 comp rx=0 tx=0).stop 2024-09-12T02:35:51.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 -- 172.21.15.181:0/3789662460 shutdown_connections 2024-09-12T02:35:51.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3789662460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d8806c320 0x7f2d880cf3e0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3789662460 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d88156950 0x7f2d8815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 -- 172.21.15.181:0/3789662460 >> 172.21.15.181:0/3789662460 conn(0x7f2d88067b30 msgr2=0x7f2d8806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 -- 172.21.15.181:0/3789662460 shutdown_connections 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.662+0000 7f2d9065e640 1 -- 172.21.15.181:0/3789662460 wait complete. 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 Processor -- start 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 -- start start 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8806c320 0x7f2d88155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d88156950 0x7f2d8815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d8815fe70 0x7f2d881e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2d880cede0 con 0x7f2d88156950 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88160c20 con 0x7f2d8815fe70 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d9065e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2d880cef60 con 0x7f2d8806c320 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d8dbf9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d88156950 0x7f2d8815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d8dbf9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d88156950 0x7f2d8815ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33206/0 (socket says 172.21.15.181:33206) 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.664+0000 7f2d8dbf9640 1 -- 172.21.15.181:0/3604262754 learned_addr learned my addr 172.21.15.181:0/3604262754 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8ebfb640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d8815fe70 0x7f2d881e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8e3fa640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8806c320 0x7f2d88155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8dbf9640 1 -- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8806c320 msgr2=0x7f2d88155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8dbf9640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8806c320 0x7f2d88155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8dbf9640 1 -- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d8815fe70 msgr2=0x7f2d881e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8dbf9640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d8815fe70 0x7f2d881e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8dbf9640 1 -- 172.21.15.181:0/3604262754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8815c040 con 0x7f2d88156950 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d8dbf9640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d88156950 0x7f2d8815ad50 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c440 tx=0x7f2d8400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d7affd640 1 -- 172.21.15.181:0/3604262754 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d840052d0 con 0x7f2d88156950 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d7affd640 1 -- 172.21.15.181:0/3604262754 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d84005470 con 0x7f2d88156950 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8815b7a0 con 0x7f2d88156950 2024-09-12T02:35:51.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d7affd640 1 -- 172.21.15.181:0/3604262754 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d84007260 con 0x7f2d88156950 2024-09-12T02:35:51.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.665+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d8815bd60 con 0x7f2d88156950 2024-09-12T02:35:51.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.666+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d880b0c60 con 0x7f2d88156950 2024-09-12T02:35:51.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.667+0000 7f2d7affd640 1 -- 172.21.15.181:0/3604262754 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d840074c0 con 0x7f2d88156950 2024-09-12T02:35:51.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.667+0000 7f2d7affd640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2d6c06be30 0x7f2d6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:51.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.667+0000 7f2d7affd640 1 -- 172.21.15.181:0/3604262754 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f2d8408a250 con 0x7f2d88156950 2024-09-12T02:35:51.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.667+0000 7f2d8e3fa640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2d6c06be30 0x7f2d6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:51.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.668+0000 7f2d8e3fa640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2d6c06be30 0x7f2d6c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006fd0 tx=0x7f2d7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:51.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.671+0000 7f2d7affd640 1 -- 172.21.15.181:0/3604262754 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d8806e240 con 0x7f2d88156950 2024-09-12T02:35:51.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.837+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d8815d120 con 0x7f2d6c06be30 2024-09-12T02:35:51.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.843+0000 7f2d7affd640 1 -- 172.21.15.181:0/3604262754 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252030 (secure 0 0 0) 0x7f2d8815d120 con 0x7f2d6c06be30 2024-09-12T02:35:51.846 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:51.848 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:35:51.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2d6c06be30 msgr2=0x7f2d6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2d6c06be30 0x7f2d6c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006fd0 tx=0x7f2d7c008040 comp rx=0 tx=0).stop 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d88156950 msgr2=0x7f2d8815ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d88156950 0x7f2d8815ad50 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c440 tx=0x7f2d8400c900 comp rx=0 tx=0).stop 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 shutdown_connections 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f2d6c06be30 0x7f2d6c06e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d8815fe70 0x7f2d881e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d88156950 0x7f2d8815ad50 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 --2- 172.21.15.181:0/3604262754 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d8806c320 0x7f2d88155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 >> 172.21.15.181:0/3604262754 conn(0x7f2d88067b30 msgr2=0x7f2d880d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 shutdown_connections 2024-09-12T02:35:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:51.846+0000 7f2d9065e640 1 -- 172.21.15.181:0/3604262754 wait complete. 2024-09-12T02:35:51.859 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-12T02:35:51.708488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285252,"kb_used_data":9344,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689468,"statfs":{"total":773094113280,"available":772802015232,"internally_reserved":0,"allocated":9568256,"data_stored":4755485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000982"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568596+0000","last_change":"2024-09-12T02:35:47.563930+0000","last_active":"2024-09-12T02:35:47.568596+0000","last_peered":"2024-09-12T02:35:47.568596+0000","last_clean":"2024-09-12T02:35:47.568596+0000","last_became_active":"2024-09-12T02:35:47.562924+0000","last_became_peered":"2024-09-12T02:35:47.562924+0000","last_unstale":"2024-09-12T02:35:47.568596+0000","last_undegraded":"2024-09-12T02:35:47.568596+0000","last_fullsized":"2024-09-12T02:35:47.568596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566368+0000","last_change":"2024-09-12T02:35:47.565295+0000","last_active":"2024-09-12T02:35:47.566368+0000","last_peered":"2024-09-12T02:35:47.566368+0000","last_clean":"2024-09-12T02:35:47.566368+0000","last_became_active":"2024-09-12T02:35:47.565057+0000","last_became_peered":"2024-09-12T02:35:47.565057+0000","last_unstale":"2024-09-12T02:35:47.566368+0000","last_undegraded":"2024-09-12T02:35:47.566368+0000","last_fullsized":"2024-09-12T02:35:47.566368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:51.213622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573780+0000","last_change":"2024-09-12T02:35:47.570484+0000","last_active":"2024-09-12T02:35:47.573780+0000","last_peered":"2024-09-12T02:35:47.573780+0000","last_clean":"2024-09-12T02:35:47.573780+0000","last_became_active":"2024-09-12T02:35:47.570214+0000","last_became_peered":"2024-09-12T02:35:47.570214+0000","last_unstale":"2024-09-12T02:35:47.573780+0000","last_undegraded":"2024-09-12T02:35:47.573780+0000","last_fullsized":"2024-09-12T02:35:47.573780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:21.256870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709485+0000","last_change":"2024-09-12T02:35:47.558453+0000","last_active":"2024-09-12T02:35:48.709485+0000","last_peered":"2024-09-12T02:35:48.709485+0000","last_clean":"2024-09-12T02:35:48.709485+0000","last_became_active":"2024-09-12T02:35:47.557414+0000","last_became_peered":"2024-09-12T02:35:47.557414+0000","last_unstale":"2024-09-12T02:35:48.709485+0000","last_undegraded":"2024-09-12T02:35:48.709485+0000","last_fullsized":"2024-09-12T02:35:48.709485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:07.791203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552531+0000","last_change":"2024-09-12T02:35:47.550460+0000","last_active":"2024-09-12T02:35:47.552531+0000","last_peered":"2024-09-12T02:35:47.552531+0000","last_clean":"2024-09-12T02:35:47.552531+0000","last_became_active":"2024-09-12T02:35:47.550185+0000","last_became_peered":"2024-09-12T02:35:47.550185+0000","last_unstale":"2024-09-12T02:35:47.552531+0000","last_undegraded":"2024-09-12T02:35:47.552531+0000","last_fullsized":"2024-09-12T02:35:47.552531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571418+0000","last_change":"2024-09-12T02:35:47.568596+0000","last_active":"2024-09-12T02:35:47.571418+0000","last_peered":"2024-09-12T02:35:47.571418+0000","last_clean":"2024-09-12T02:35:47.571418+0000","last_became_active":"2024-09-12T02:35:47.568345+0000","last_became_peered":"2024-09-12T02:35:47.568345+0000","last_unstale":"2024-09-12T02:35:47.571418+0000","last_undegraded":"2024-09-12T02:35:47.571418+0000","last_fullsized":"2024-09-12T02:35:47.571418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709020+0000","last_change":"2024-09-12T02:35:47.564281+0000","last_active":"2024-09-12T02:35:48.709020+0000","last_peered":"2024-09-12T02:35:48.709020+0000","last_clean":"2024-09-12T02:35:48.709020+0000","last_became_active":"2024-09-12T02:35:47.564021+0000","last_became_peered":"2024-09-12T02:35:47.564021+0000","last_unstale":"2024-09-12T02:35:48.709020+0000","last_undegraded":"2024-09-12T02:35:48.709020+0000","last_fullsized":"2024-09-12T02:35:48.709020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:49.562922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571412+0000","last_change":"2024-09-12T02:35:47.568454+0000","last_active":"2024-09-12T02:35:47.571412+0000","last_peered":"2024-09-12T02:35:47.571412+0000","last_clean":"2024-09-12T02:35:47.571412+0000","last_became_active":"2024-09-12T02:35:47.568201+0000","last_became_peered":"2024-09-12T02:35:47.568201+0000","last_unstale":"2024-09-12T02:35:47.571412+0000","last_undegraded":"2024-09-12T02:35:47.571412+0000","last_fullsized":"2024-09-12T02:35:47.571412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:27.277743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563608+0000","last_change":"2024-09-12T02:35:47.561792+0000","last_active":"2024-09-12T02:35:47.563608+0000","last_peered":"2024-09-12T02:35:47.563608+0000","last_clean":"2024-09-12T02:35:47.563608+0000","last_became_active":"2024-09-12T02:35:47.560908+0000","last_became_peered":"2024-09-12T02:35:47.560908+0000","last_unstale":"2024-09-12T02:35:47.563608+0000","last_undegraded":"2024-09-12T02:35:47.563608+0000","last_fullsized":"2024-09-12T02:35:47.563608+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559720+0000","last_change":"2024-09-12T02:35:47.557935+0000","last_active":"2024-09-12T02:35:47.559720+0000","last_peered":"2024-09-12T02:35:47.559720+0000","last_clean":"2024-09-12T02:35:47.559720+0000","last_became_active":"2024-09-12T02:35:47.557463+0000","last_became_peered":"2024-09-12T02:35:47.557463+0000","last_unstale":"2024-09-12T02:35:47.559720+0000","last_undegraded":"2024-09-12T02:35:47.559720+0000","last_fullsized":"2024-09-12T02:35:47.559720+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566757+0000","last_change":"2024-09-12T02:35:47.564524+0000","last_active":"2024-09-12T02:35:47.566757+0000","last_peered":"2024-09-12T02:35:47.566757+0000","last_clean":"2024-09-12T02:35:47.566757+0000","last_became_active":"2024-09-12T02:35:47.562298+0000","last_became_peered":"2024-09-12T02:35:47.562298+0000","last_unstale":"2024-09-12T02:35:47.566757+0000","last_undegraded":"2024-09-12T02:35:47.566757+0000","last_fullsized":"2024-09-12T02:35:47.566757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:34.272059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560684+0000","last_change":"2024-09-12T02:35:47.559543+0000","last_active":"2024-09-12T02:35:47.560684+0000","last_peered":"2024-09-12T02:35:47.560684+0000","last_clean":"2024-09-12T02:35:47.560684+0000","last_became_active":"2024-09-12T02:35:47.558672+0000","last_became_peered":"2024-09-12T02:35:47.558672+0000","last_unstale":"2024-09-12T02:35:47.560684+0000","last_undegraded":"2024-09-12T02:35:47.560684+0000","last_fullsized":"2024-09-12T02:35:47.560684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568927+0000","last_change":"2024-09-12T02:35:47.566022+0000","last_active":"2024-09-12T02:35:47.568927+0000","last_peered":"2024-09-12T02:35:47.568927+0000","last_clean":"2024-09-12T02:35:47.568927+0000","last_became_active":"2024-09-12T02:35:47.565722+0000","last_became_peered":"2024-09-12T02:35:47.565722+0000","last_unstale":"2024-09-12T02:35:47.568927+0000","last_undegraded":"2024-09-12T02:35:47.568927+0000","last_fullsized":"2024-09-12T02:35:47.568927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709363+0000","last_change":"2024-09-12T02:35:47.567234+0000","last_active":"2024-09-12T02:35:48.709363+0000","last_peered":"2024-09-12T02:35:48.709363+0000","last_clean":"2024-09-12T02:35:48.709363+0000","last_became_active":"2024-09-12T02:35:47.566905+0000","last_became_peered":"2024-09-12T02:35:47.566905+0000","last_unstale":"2024-09-12T02:35:48.709363+0000","last_undegraded":"2024-09-12T02:35:48.709363+0000","last_fullsized":"2024-09-12T02:35:48.709363+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:27.510998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957833+0000","last_change":"2024-09-12T02:35:47.567913+0000","last_active":"2024-09-12T02:35:48.957833+0000","last_peered":"2024-09-12T02:35:48.957833+0000","last_clean":"2024-09-12T02:35:48.957833+0000","last_became_active":"2024-09-12T02:35:47.567478+0000","last_became_peered":"2024-09-12T02:35:47.567478+0000","last_unstale":"2024-09-12T02:35:48.957833+0000","last_undegraded":"2024-09-12T02:35:48.957833+0000","last_fullsized":"2024-09-12T02:35:48.957833+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:01.887113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563349+0000","last_change":"2024-09-12T02:35:47.558932+0000","last_active":"2024-09-12T02:35:47.563349+0000","last_peered":"2024-09-12T02:35:47.563349+0000","last_clean":"2024-09-12T02:35:47.563349+0000","last_became_active":"2024-09-12T02:35:47.558677+0000","last_became_peered":"2024-09-12T02:35:47.558677+0000","last_unstale":"2024-09-12T02:35:47.563349+0000","last_undegraded":"2024-09-12T02:35:47.563349+0000","last_fullsized":"2024-09-12T02:35:47.563349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560413+0000","last_change":"2024-09-12T02:35:47.557164+0000","last_active":"2024-09-12T02:35:47.560413+0000","last_peered":"2024-09-12T02:35:47.560413+0000","last_clean":"2024-09-12T02:35:47.560413+0000","last_became_active":"2024-09-12T02:35:47.556845+0000","last_became_peered":"2024-09-12T02:35:47.556845+0000","last_unstale":"2024-09-12T02:35:47.560413+0000","last_undegraded":"2024-09-12T02:35:47.560413+0000","last_fullsized":"2024-09-12T02:35:47.560413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709325+0000","last_change":"2024-09-12T02:35:47.563528+0000","last_active":"2024-09-12T02:35:48.709325+0000","last_peered":"2024-09-12T02:35:48.709325+0000","last_clean":"2024-09-12T02:35:48.709325+0000","last_became_active":"2024-09-12T02:35:47.563218+0000","last_became_peered":"2024-09-12T02:35:47.563218+0000","last_unstale":"2024-09-12T02:35:48.709325+0000","last_undegraded":"2024-09-12T02:35:48.709325+0000","last_fullsized":"2024-09-12T02:35:48.709325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:26.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556748+0000","last_change":"2024-09-12T02:35:47.551849+0000","last_active":"2024-09-12T02:35:47.556748+0000","last_peered":"2024-09-12T02:35:47.556748+0000","last_clean":"2024-09-12T02:35:47.556748+0000","last_became_active":"2024-09-12T02:35:47.551596+0000","last_became_peered":"2024-09-12T02:35:47.551596+0000","last_unstale":"2024-09-12T02:35:47.556748+0000","last_undegraded":"2024-09-12T02:35:47.556748+0000","last_fullsized":"2024-09-12T02:35:47.556748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709350+0000","last_change":"2024-09-12T02:35:47.555636+0000","last_active":"2024-09-12T02:35:48.709350+0000","last_peered":"2024-09-12T02:35:48.709350+0000","last_clean":"2024-09-12T02:35:48.709350+0000","last_became_active":"2024-09-12T02:35:47.555380+0000","last_became_peered":"2024-09-12T02:35:47.555380+0000","last_unstale":"2024-09-12T02:35:48.709350+0000","last_undegraded":"2024-09-12T02:35:48.709350+0000","last_fullsized":"2024-09-12T02:35:48.709350+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:24.329883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709166+0000","last_change":"2024-09-12T02:35:47.553056+0000","last_active":"2024-09-12T02:35:48.709166+0000","last_peered":"2024-09-12T02:35:48.709166+0000","last_clean":"2024-09-12T02:35:48.709166+0000","last_became_active":"2024-09-12T02:35:47.552812+0000","last_became_peered":"2024-09-12T02:35:47.552812+0000","last_unstale":"2024-09-12T02:35:48.709166+0000","last_undegraded":"2024-09-12T02:35:48.709166+0000","last_fullsized":"2024-09-12T02:35:48.709166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:05.894065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560912+0000","last_change":"2024-09-12T02:35:47.552647+0000","last_active":"2024-09-12T02:35:47.560912+0000","last_peered":"2024-09-12T02:35:47.560912+0000","last_clean":"2024-09-12T02:35:47.560912+0000","last_became_active":"2024-09-12T02:35:47.552352+0000","last_became_peered":"2024-09-12T02:35:47.552352+0000","last_unstale":"2024-09-12T02:35:47.560912+0000","last_undegraded":"2024-09-12T02:35:47.560912+0000","last_fullsized":"2024-09-12T02:35:47.560912+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.559610+0000","last_change":"2024-09-12T02:35:47.558637+0000","last_active":"2024-09-12T02:35:47.559610+0000","last_peered":"2024-09-12T02:35:47.559610+0000","last_clean":"2024-09-12T02:35:47.559610+0000","last_became_active":"2024-09-12T02:35:47.558335+0000","last_became_peered":"2024-09-12T02:35:47.558335+0000","last_unstale":"2024-09-12T02:35:47.559610+0000","last_undegraded":"2024-09-12T02:35:47.559610+0000","last_fullsized":"2024-09-12T02:35:47.559610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.708934+0000","last_change":"2024-09-12T02:35:47.556215+0000","last_active":"2024-09-12T02:35:48.708934+0000","last_peered":"2024-09-12T02:35:48.708934+0000","last_clean":"2024-09-12T02:35:48.708934+0000","last_became_active":"2024-09-12T02:35:47.555972+0000","last_became_peered":"2024-09-12T02:35:47.555972+0000","last_unstale":"2024-09-12T02:35:48.708934+0000","last_undegraded":"2024-09-12T02:35:48.708934+0000","last_fullsized":"2024-09-12T02:35:48.708934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.017308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566334+0000","last_change":"2024-09-12T02:35:47.565021+0000","last_active":"2024-09-12T02:35:47.566334+0000","last_peered":"2024-09-12T02:35:47.566334+0000","last_clean":"2024-09-12T02:35:47.566334+0000","last_became_active":"2024-09-12T02:35:47.564686+0000","last_became_peered":"2024-09-12T02:35:47.564686+0000","last_unstale":"2024-09-12T02:35:47.566334+0000","last_undegraded":"2024-09-12T02:35:47.566334+0000","last_fullsized":"2024-09-12T02:35:47.566334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:07.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569210+0000","last_change":"2024-09-12T02:35:47.567786+0000","last_active":"2024-09-12T02:35:47.569210+0000","last_peered":"2024-09-12T02:35:47.569210+0000","last_clean":"2024-09-12T02:35:47.569210+0000","last_became_active":"2024-09-12T02:35:47.567479+0000","last_became_peered":"2024-09-12T02:35:47.567479+0000","last_unstale":"2024-09-12T02:35:47.569210+0000","last_undegraded":"2024-09-12T02:35:47.569210+0000","last_fullsized":"2024-09-12T02:35:47.569210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560303+0000","last_change":"2024-09-12T02:35:47.554685+0000","last_active":"2024-09-12T02:35:47.560303+0000","last_peered":"2024-09-12T02:35:47.560303+0000","last_clean":"2024-09-12T02:35:47.560303+0000","last_became_active":"2024-09-12T02:35:47.554170+0000","last_became_peered":"2024-09-12T02:35:47.554170+0000","last_unstale":"2024-09-12T02:35:47.560303+0000","last_undegraded":"2024-09-12T02:35:47.560303+0000","last_fullsized":"2024-09-12T02:35:47.560303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566806+0000","last_change":"2024-09-12T02:35:47.561906+0000","last_active":"2024-09-12T02:35:47.566806+0000","last_peered":"2024-09-12T02:35:47.566806+0000","last_clean":"2024-09-12T02:35:47.566806+0000","last_became_active":"2024-09-12T02:35:47.561625+0000","last_became_peered":"2024-09-12T02:35:47.561625+0000","last_unstale":"2024-09-12T02:35:47.566806+0000","last_undegraded":"2024-09-12T02:35:47.566806+0000","last_fullsized":"2024-09-12T02:35:47.566806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:20.159388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560656+0000","last_change":"2024-09-12T02:35:47.552719+0000","last_active":"2024-09-12T02:35:47.560656+0000","last_peered":"2024-09-12T02:35:47.560656+0000","last_clean":"2024-09-12T02:35:47.560656+0000","last_became_active":"2024-09-12T02:35:47.552428+0000","last_became_peered":"2024-09-12T02:35:47.552428+0000","last_unstale":"2024-09-12T02:35:47.560656+0000","last_undegraded":"2024-09-12T02:35:47.560656+0000","last_fullsized":"2024-09-12T02:35:47.560656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:17.738029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565716+0000","last_change":"2024-09-12T02:35:47.559405+0000","last_active":"2024-09-12T02:35:47.565716+0000","last_peered":"2024-09-12T02:35:47.565716+0000","last_clean":"2024-09-12T02:35:47.565716+0000","last_became_active":"2024-09-12T02:35:47.556745+0000","last_became_peered":"2024-09-12T02:35:47.556745+0000","last_unstale":"2024-09-12T02:35:47.565716+0000","last_undegraded":"2024-09-12T02:35:47.565716+0000","last_fullsized":"2024-09-12T02:35:47.565716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.934159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551211+0000","last_change":"2024-09-12T02:35:47.549673+0000","last_active":"2024-09-12T02:35:47.551211+0000","last_peered":"2024-09-12T02:35:47.551211+0000","last_clean":"2024-09-12T02:35:47.551211+0000","last_became_active":"2024-09-12T02:35:47.549408+0000","last_became_peered":"2024-09-12T02:35:47.549408+0000","last_unstale":"2024-09-12T02:35:47.551211+0000","last_undegraded":"2024-09-12T02:35:47.551211+0000","last_fullsized":"2024-09-12T02:35:47.551211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564795+0000","last_change":"2024-09-12T02:35:47.561157+0000","last_active":"2024-09-12T02:35:47.564795+0000","last_peered":"2024-09-12T02:35:47.564795+0000","last_clean":"2024-09-12T02:35:47.564795+0000","last_became_active":"2024-09-12T02:35:47.560870+0000","last_became_peered":"2024-09-12T02:35:47.560870+0000","last_unstale":"2024-09-12T02:35:47.564795+0000","last_undegraded":"2024-09-12T02:35:47.564795+0000","last_fullsized":"2024-09-12T02:35:47.564795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562746+0000","last_change":"2024-09-12T02:35:47.559676+0000","last_active":"2024-09-12T02:35:47.562746+0000","last_peered":"2024-09-12T02:35:47.562746+0000","last_clean":"2024-09-12T02:35:47.562746+0000","last_became_active":"2024-09-12T02:35:47.559394+0000","last_became_peered":"2024-09-12T02:35:47.559394+0000","last_unstale":"2024-09-12T02:35:47.562746+0000","last_undegraded":"2024-09-12T02:35:47.562746+0000","last_fullsized":"2024-09-12T02:35:47.562746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568168+0000","last_change":"2024-09-12T02:35:46.561281+0000","last_active":"2024-09-12T02:35:47.568168+0000","last_peered":"2024-09-12T02:35:47.568168+0000","last_clean":"2024-09-12T02:35:47.568168+0000","last_became_active":"2024-09-12T02:35:46.561013+0000","last_became_peered":"2024-09-12T02:35:46.561013+0000","last_unstale":"2024-09-12T02:35:47.568168+0000","last_undegraded":"2024-09-12T02:35:47.568168+0000","last_fullsized":"2024-09-12T02:35:47.568168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568619+0000","last_change":"2024-09-12T02:35:47.564156+0000","last_active":"2024-09-12T02:35:47.568619+0000","last_peered":"2024-09-12T02:35:47.568619+0000","last_clean":"2024-09-12T02:35:47.568619+0000","last_became_active":"2024-09-12T02:35:47.563648+0000","last_became_peered":"2024-09-12T02:35:47.563648+0000","last_unstale":"2024-09-12T02:35:47.568619+0000","last_undegraded":"2024-09-12T02:35:47.568619+0000","last_fullsized":"2024-09-12T02:35:47.568619+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.402933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569335+0000","last_change":"2024-09-12T02:35:46.554200+0000","last_active":"2024-09-12T02:35:47.569335+0000","last_peered":"2024-09-12T02:35:47.569335+0000","last_clean":"2024-09-12T02:35:47.569335+0000","last_became_active":"2024-09-12T02:35:46.553896+0000","last_became_peered":"2024-09-12T02:35:46.553896+0000","last_unstale":"2024-09-12T02:35:47.569335+0000","last_undegraded":"2024-09-12T02:35:47.569335+0000","last_fullsized":"2024-09-12T02:35:47.569335+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560489+0000","last_change":"2024-09-12T02:35:47.559318+0000","last_active":"2024-09-12T02:35:47.560489+0000","last_peered":"2024-09-12T02:35:47.560489+0000","last_clean":"2024-09-12T02:35:47.560489+0000","last_became_active":"2024-09-12T02:35:47.559060+0000","last_became_peered":"2024-09-12T02:35:47.559060+0000","last_unstale":"2024-09-12T02:35:47.560489+0000","last_undegraded":"2024-09-12T02:35:47.560489+0000","last_fullsized":"2024-09-12T02:35:47.560489+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565869+0000","last_change":"2024-09-12T02:35:46.554539+0000","last_active":"2024-09-12T02:35:47.565869+0000","last_peered":"2024-09-12T02:35:47.565869+0000","last_clean":"2024-09-12T02:35:47.565869+0000","last_became_active":"2024-09-12T02:35:46.554102+0000","last_became_peered":"2024-09-12T02:35:46.554102+0000","last_unstale":"2024-09-12T02:35:47.565869+0000","last_undegraded":"2024-09-12T02:35:47.565869+0000","last_fullsized":"2024-09-12T02:35:47.565869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:36.743023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567197+0000","last_change":"2024-09-12T02:35:47.564826+0000","last_active":"2024-09-12T02:35:47.567197+0000","last_peered":"2024-09-12T02:35:47.567197+0000","last_clean":"2024-09-12T02:35:47.567197+0000","last_became_active":"2024-09-12T02:35:47.564507+0000","last_became_peered":"2024-09-12T02:35:47.564507+0000","last_unstale":"2024-09-12T02:35:47.567197+0000","last_undegraded":"2024-09-12T02:35:47.567197+0000","last_fullsized":"2024-09-12T02:35:47.567197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:37.750492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564906+0000","last_change":"2024-09-12T02:35:46.556651+0000","last_active":"2024-09-12T02:35:47.564906+0000","last_peered":"2024-09-12T02:35:47.564906+0000","last_clean":"2024-09-12T02:35:47.564906+0000","last_became_active":"2024-09-12T02:35:46.556327+0000","last_became_peered":"2024-09-12T02:35:46.556327+0000","last_unstale":"2024-09-12T02:35:47.564906+0000","last_undegraded":"2024-09-12T02:35:47.564906+0000","last_fullsized":"2024-09-12T02:35:47.564906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.949797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565760+0000","last_change":"2024-09-12T02:35:47.560250+0000","last_active":"2024-09-12T02:35:47.565760+0000","last_peered":"2024-09-12T02:35:47.565760+0000","last_clean":"2024-09-12T02:35:47.565760+0000","last_became_active":"2024-09-12T02:35:47.559558+0000","last_became_peered":"2024-09-12T02:35:47.559558+0000","last_unstale":"2024-09-12T02:35:47.565760+0000","last_undegraded":"2024-09-12T02:35:47.565760+0000","last_fullsized":"2024-09-12T02:35:47.565760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:00.188617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567045+0000","last_change":"2024-09-12T02:35:46.554241+0000","last_active":"2024-09-12T02:35:47.567045+0000","last_peered":"2024-09-12T02:35:47.567045+0000","last_clean":"2024-09-12T02:35:47.567045+0000","last_became_active":"2024-09-12T02:35:46.553958+0000","last_became_peered":"2024-09-12T02:35:46.553958+0000","last_unstale":"2024-09-12T02:35:47.567045+0000","last_undegraded":"2024-09-12T02:35:47.567045+0000","last_fullsized":"2024-09-12T02:35:47.567045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.561379+0000","last_change":"2024-09-12T02:35:47.559441+0000","last_active":"2024-09-12T02:35:47.561379+0000","last_peered":"2024-09-12T02:35:47.561379+0000","last_clean":"2024-09-12T02:35:47.561379+0000","last_became_active":"2024-09-12T02:35:47.559046+0000","last_became_peered":"2024-09-12T02:35:47.559046+0000","last_unstale":"2024-09-12T02:35:47.561379+0000","last_undegraded":"2024-09-12T02:35:47.561379+0000","last_fullsized":"2024-09-12T02:35:47.561379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563705+0000","last_change":"2024-09-12T02:35:46.558161+0000","last_active":"2024-09-12T02:35:47.563705+0000","last_peered":"2024-09-12T02:35:47.563705+0000","last_clean":"2024-09-12T02:35:47.563705+0000","last_became_active":"2024-09-12T02:35:46.557836+0000","last_became_peered":"2024-09-12T02:35:46.557836+0000","last_unstale":"2024-09-12T02:35:47.563705+0000","last_undegraded":"2024-09-12T02:35:47.563705+0000","last_fullsized":"2024-09-12T02:35:47.563705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568890+0000","last_change":"2024-09-12T02:35:47.565152+0000","last_active":"2024-09-12T02:35:47.568890+0000","last_peered":"2024-09-12T02:35:47.568890+0000","last_clean":"2024-09-12T02:35:47.568890+0000","last_became_active":"2024-09-12T02:35:47.563838+0000","last_became_peered":"2024-09-12T02:35:47.563838+0000","last_unstale":"2024-09-12T02:35:47.568890+0000","last_undegraded":"2024-09-12T02:35:47.568890+0000","last_fullsized":"2024-09-12T02:35:47.568890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:31.526030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548082+0000","last_change":"2024-09-12T02:35:46.554449+0000","last_active":"2024-09-12T02:35:47.548082+0000","last_peered":"2024-09-12T02:35:47.548082+0000","last_clean":"2024-09-12T02:35:47.548082+0000","last_became_active":"2024-09-12T02:35:46.553756+0000","last_became_peered":"2024-09-12T02:35:46.553756+0000","last_unstale":"2024-09-12T02:35:47.548082+0000","last_undegraded":"2024-09-12T02:35:47.548082+0000","last_fullsized":"2024-09-12T02:35:47.548082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:26.270274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957964+0000","last_change":"2024-09-12T02:35:47.567699+0000","last_active":"2024-09-12T02:35:48.957964+0000","last_peered":"2024-09-12T02:35:48.957964+0000","last_clean":"2024-09-12T02:35:48.957964+0000","last_became_active":"2024-09-12T02:35:47.567145+0000","last_became_peered":"2024-09-12T02:35:47.567145+0000","last_unstale":"2024-09-12T02:35:48.957964+0000","last_undegraded":"2024-09-12T02:35:48.957964+0000","last_fullsized":"2024-09-12T02:35:48.957964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:54.307129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.543449+0000","last_change":"2024-09-12T02:35:46.559650+0000","last_active":"2024-09-12T02:35:47.543449+0000","last_peered":"2024-09-12T02:35:47.543449+0000","last_clean":"2024-09-12T02:35:47.543449+0000","last_became_active":"2024-09-12T02:35:46.559382+0000","last_became_peered":"2024-09-12T02:35:46.559382+0000","last_unstale":"2024-09-12T02:35:47.543449+0000","last_undegraded":"2024-09-12T02:35:47.543449+0000","last_fullsized":"2024-09-12T02:35:47.543449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:10.746279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958003+0000","last_change":"2024-09-12T02:35:47.555322+0000","last_active":"2024-09-12T02:35:48.958003+0000","last_peered":"2024-09-12T02:35:48.958003+0000","last_clean":"2024-09-12T02:35:48.958003+0000","last_became_active":"2024-09-12T02:35:47.553505+0000","last_became_peered":"2024-09-12T02:35:47.553505+0000","last_unstale":"2024-09-12T02:35:48.958003+0000","last_undegraded":"2024-09-12T02:35:48.958003+0000","last_fullsized":"2024-09-12T02:35:48.958003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:19.611770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.552223+0000","last_change":"2024-09-12T02:35:46.557154+0000","last_active":"2024-09-12T02:35:47.552223+0000","last_peered":"2024-09-12T02:35:47.552223+0000","last_clean":"2024-09-12T02:35:47.552223+0000","last_became_active":"2024-09-12T02:35:46.556451+0000","last_became_peered":"2024-09-12T02:35:46.556451+0000","last_unstale":"2024-09-12T02:35:47.552223+0000","last_undegraded":"2024-09-12T02:35:47.552223+0000","last_fullsized":"2024-09-12T02:35:47.552223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.571357+0000","last_change":"2024-09-12T02:35:47.567600+0000","last_active":"2024-09-12T02:35:47.571357+0000","last_peered":"2024-09-12T02:35:47.571357+0000","last_clean":"2024-09-12T02:35:47.571357+0000","last_became_active":"2024-09-12T02:35:47.567311+0000","last_became_peered":"2024-09-12T02:35:47.567311+0000","last_unstale":"2024-09-12T02:35:47.571357+0000","last_undegraded":"2024-09-12T02:35:47.571357+0000","last_fullsized":"2024-09-12T02:35:47.571357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:28.803475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551780+0000","last_change":"2024-09-12T02:35:46.554852+0000","last_active":"2024-09-12T02:35:47.551780+0000","last_peered":"2024-09-12T02:35:47.551780+0000","last_clean":"2024-09-12T02:35:47.551780+0000","last_became_active":"2024-09-12T02:35:46.554514+0000","last_became_peered":"2024-09-12T02:35:46.554514+0000","last_unstale":"2024-09-12T02:35:47.551780+0000","last_undegraded":"2024-09-12T02:35:47.551780+0000","last_fullsized":"2024-09-12T02:35:47.551780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567148+0000","last_change":"2024-09-12T02:35:47.562737+0000","last_active":"2024-09-12T02:35:47.567148+0000","last_peered":"2024-09-12T02:35:47.567148+0000","last_clean":"2024-09-12T02:35:47.567148+0000","last_became_active":"2024-09-12T02:35:47.562421+0000","last_became_peered":"2024-09-12T02:35:47.562421+0000","last_unstale":"2024-09-12T02:35:47.567148+0000","last_undegraded":"2024-09-12T02:35:47.567148+0000","last_fullsized":"2024-09-12T02:35:47.567148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.562082+0000","last_change":"2024-09-12T02:35:46.559638+0000","last_active":"2024-09-12T02:35:47.562082+0000","last_peered":"2024-09-12T02:35:47.562082+0000","last_clean":"2024-09-12T02:35:47.562082+0000","last_became_active":"2024-09-12T02:35:46.559442+0000","last_became_peered":"2024-09-12T02:35:46.559442+0000","last_unstale":"2024-09-12T02:35:47.562082+0000","last_undegraded":"2024-09-12T02:35:47.562082+0000","last_fullsized":"2024-09-12T02:35:47.562082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:44.377608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560122+0000","last_change":"2024-09-12T02:35:47.552392+0000","last_active":"2024-09-12T02:35:47.560122+0000","last_peered":"2024-09-12T02:35:47.560122+0000","last_clean":"2024-09-12T02:35:47.560122+0000","last_became_active":"2024-09-12T02:35:47.551877+0000","last_became_peered":"2024-09-12T02:35:47.551877+0000","last_unstale":"2024-09-12T02:35:47.560122+0000","last_undegraded":"2024-09-12T02:35:47.560122+0000","last_fullsized":"2024-09-12T02:35:47.560122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:14.789736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573921+0000","last_change":"2024-09-12T02:35:46.555192+0000","last_active":"2024-09-12T02:35:47.573921+0000","last_peered":"2024-09-12T02:35:47.573921+0000","last_clean":"2024-09-12T02:35:47.573921+0000","last_became_active":"2024-09-12T02:35:46.554874+0000","last_became_peered":"2024-09-12T02:35:46.554874+0000","last_unstale":"2024-09-12T02:35:47.573921+0000","last_undegraded":"2024-09-12T02:35:47.573921+0000","last_fullsized":"2024-09-12T02:35:47.573921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:39.001935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567032+0000","last_change":"2024-09-12T02:35:47.561844+0000","last_active":"2024-09-12T02:35:47.567032+0000","last_peered":"2024-09-12T02:35:47.567032+0000","last_clean":"2024-09-12T02:35:47.567032+0000","last_became_active":"2024-09-12T02:35:47.561576+0000","last_became_peered":"2024-09-12T02:35:47.561576+0000","last_unstale":"2024-09-12T02:35:47.567032+0000","last_undegraded":"2024-09-12T02:35:47.567032+0000","last_fullsized":"2024-09-12T02:35:47.567032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567429+0000","last_change":"2024-09-12T02:35:46.557645+0000","last_active":"2024-09-12T02:35:47.567429+0000","last_peered":"2024-09-12T02:35:47.567429+0000","last_clean":"2024-09-12T02:35:47.567429+0000","last_became_active":"2024-09-12T02:35:46.557388+0000","last_became_peered":"2024-09-12T02:35:46.557388+0000","last_unstale":"2024-09-12T02:35:47.567429+0000","last_undegraded":"2024-09-12T02:35:47.567429+0000","last_fullsized":"2024-09-12T02:35:47.567429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:13.920180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567136+0000","last_change":"2024-09-12T02:35:47.563938+0000","last_active":"2024-09-12T02:35:47.567136+0000","last_peered":"2024-09-12T02:35:47.567136+0000","last_clean":"2024-09-12T02:35:47.567136+0000","last_became_active":"2024-09-12T02:35:47.563607+0000","last_became_peered":"2024-09-12T02:35:47.563607+0000","last_unstale":"2024-09-12T02:35:47.567136+0000","last_undegraded":"2024-09-12T02:35:47.567136+0000","last_fullsized":"2024-09-12T02:35:47.567136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:31.957266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957913+0000","last_change":"2024-09-12T02:35:46.554473+0000","last_active":"2024-09-12T02:35:48.957913+0000","last_peered":"2024-09-12T02:35:48.957913+0000","last_clean":"2024-09-12T02:35:48.957913+0000","last_became_active":"2024-09-12T02:35:46.554153+0000","last_became_peered":"2024-09-12T02:35:46.554153+0000","last_unstale":"2024-09-12T02:35:48.957913+0000","last_undegraded":"2024-09-12T02:35:48.957913+0000","last_fullsized":"2024-09-12T02:35:48.957913+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:40.131878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560733+0000","last_change":"2024-09-12T02:35:47.557330+0000","last_active":"2024-09-12T02:35:47.560733+0000","last_peered":"2024-09-12T02:35:47.560733+0000","last_clean":"2024-09-12T02:35:47.560733+0000","last_became_active":"2024-09-12T02:35:47.557105+0000","last_became_peered":"2024-09-12T02:35:47.557105+0000","last_unstale":"2024-09-12T02:35:47.560733+0000","last_undegraded":"2024-09-12T02:35:47.560733+0000","last_fullsized":"2024-09-12T02:35:47.560733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:06.934622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.555099+0000","last_change":"2024-09-12T02:35:46.551757+0000","last_active":"2024-09-12T02:35:47.555099+0000","last_peered":"2024-09-12T02:35:47.555099+0000","last_clean":"2024-09-12T02:35:47.555099+0000","last_became_active":"2024-09-12T02:35:46.551465+0000","last_became_peered":"2024-09-12T02:35:46.551465+0000","last_unstale":"2024-09-12T02:35:47.555099+0000","last_undegraded":"2024-09-12T02:35:47.555099+0000","last_fullsized":"2024-09-12T02:35:47.555099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:59.913044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.568033+0000","last_change":"2024-09-12T02:35:47.565375+0000","last_active":"2024-09-12T02:35:47.568033+0000","last_peered":"2024-09-12T02:35:47.568033+0000","last_clean":"2024-09-12T02:35:47.568033+0000","last_became_active":"2024-09-12T02:35:47.565111+0000","last_became_peered":"2024-09-12T02:35:47.565111+0000","last_unstale":"2024-09-12T02:35:47.568033+0000","last_undegraded":"2024-09-12T02:35:47.568033+0000","last_fullsized":"2024-09-12T02:35:47.568033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:07.767848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.564890+0000","last_change":"2024-09-12T02:35:46.553376+0000","last_active":"2024-09-12T02:35:47.564890+0000","last_peered":"2024-09-12T02:35:47.564890+0000","last_clean":"2024-09-12T02:35:47.564890+0000","last_became_active":"2024-09-12T02:35:46.552720+0000","last_became_peered":"2024-09-12T02:35:46.552720+0000","last_unstale":"2024-09-12T02:35:47.564890+0000","last_undegraded":"2024-09-12T02:35:47.564890+0000","last_fullsized":"2024-09-12T02:35:47.564890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.187005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567171+0000","last_change":"2024-09-12T02:35:47.564398+0000","last_active":"2024-09-12T02:35:47.567171+0000","last_peered":"2024-09-12T02:35:47.567171+0000","last_clean":"2024-09-12T02:35:47.567171+0000","last_became_active":"2024-09-12T02:35:47.564149+0000","last_became_peered":"2024-09-12T02:35:47.564149+0000","last_unstale":"2024-09-12T02:35:47.567171+0000","last_undegraded":"2024-09-12T02:35:47.567171+0000","last_fullsized":"2024-09-12T02:35:47.567171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:49.428222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569596+0000","last_change":"2024-09-12T02:35:46.556394+0000","last_active":"2024-09-12T02:35:47.569596+0000","last_peered":"2024-09-12T02:35:47.569596+0000","last_clean":"2024-09-12T02:35:47.569596+0000","last_became_active":"2024-09-12T02:35:46.555836+0000","last_became_peered":"2024-09-12T02:35:46.555836+0000","last_unstale":"2024-09-12T02:35:47.569596+0000","last_undegraded":"2024-09-12T02:35:47.569596+0000","last_fullsized":"2024-09-12T02:35:47.569596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569270+0000","last_change":"2024-09-12T02:35:47.565967+0000","last_active":"2024-09-12T02:35:47.569270+0000","last_peered":"2024-09-12T02:35:47.569270+0000","last_clean":"2024-09-12T02:35:47.569270+0000","last_became_active":"2024-09-12T02:35:47.565712+0000","last_became_peered":"2024-09-12T02:35:47.565712+0000","last_unstale":"2024-09-12T02:35:47.569270+0000","last_undegraded":"2024-09-12T02:35:47.569270+0000","last_fullsized":"2024-09-12T02:35:47.569270+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565154+0000","last_change":"2024-09-12T02:35:46.557610+0000","last_active":"2024-09-12T02:35:47.565154+0000","last_peered":"2024-09-12T02:35:47.565154+0000","last_clean":"2024-09-12T02:35:47.565154+0000","last_became_active":"2024-09-12T02:35:46.557342+0000","last_became_peered":"2024-09-12T02:35:46.557342+0000","last_unstale":"2024-09-12T02:35:47.565154+0000","last_undegraded":"2024-09-12T02:35:47.565154+0000","last_fullsized":"2024-09-12T02:35:47.565154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:30.518562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560280+0000","last_change":"2024-09-12T02:35:47.554450+0000","last_active":"2024-09-12T02:35:47.560280+0000","last_peered":"2024-09-12T02:35:47.560280+0000","last_clean":"2024-09-12T02:35:47.560280+0000","last_became_active":"2024-09-12T02:35:47.553796+0000","last_became_peered":"2024-09-12T02:35:47.553796+0000","last_unstale":"2024-09-12T02:35:47.560280+0000","last_undegraded":"2024-09-12T02:35:47.560280+0000","last_fullsized":"2024-09-12T02:35:47.560280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:41.682530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549398+0000","last_change":"2024-09-12T02:35:46.554498+0000","last_active":"2024-09-12T02:35:47.549398+0000","last_peered":"2024-09-12T02:35:47.549398+0000","last_clean":"2024-09-12T02:35:47.549398+0000","last_became_active":"2024-09-12T02:35:46.553952+0000","last_became_peered":"2024-09-12T02:35:46.553952+0000","last_unstale":"2024-09-12T02:35:47.549398+0000","last_undegraded":"2024-09-12T02:35:47.549398+0000","last_fullsized":"2024-09-12T02:35:47.549398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:48.420754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709399+0000","last_change":"2024-09-12T02:35:47.556763+0000","last_active":"2024-09-12T02:35:48.709399+0000","last_peered":"2024-09-12T02:35:48.709399+0000","last_clean":"2024-09-12T02:35:48.709399+0000","last_became_active":"2024-09-12T02:35:47.556518+0000","last_became_peered":"2024-09-12T02:35:47.556518+0000","last_unstale":"2024-09-12T02:35:48.709399+0000","last_undegraded":"2024-09-12T02:35:48.709399+0000","last_fullsized":"2024-09-12T02:35:48.709399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:12.527546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958371+0000","last_change":"2024-09-12T02:35:46.554380+0000","last_active":"2024-09-12T02:35:48.958371+0000","last_peered":"2024-09-12T02:35:48.958371+0000","last_clean":"2024-09-12T02:35:48.958371+0000","last_became_active":"2024-09-12T02:35:46.554101+0000","last_became_peered":"2024-09-12T02:35:46.554101+0000","last_unstale":"2024-09-12T02:35:48.958371+0000","last_undegraded":"2024-09-12T02:35:48.958371+0000","last_fullsized":"2024-09-12T02:35:48.958371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:17.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566799+0000","last_change":"2024-09-12T02:35:47.564388+0000","last_active":"2024-09-12T02:35:47.566799+0000","last_peered":"2024-09-12T02:35:47.566799+0000","last_clean":"2024-09-12T02:35:47.566799+0000","last_became_active":"2024-09-12T02:35:47.564109+0000","last_became_peered":"2024-09-12T02:35:47.564109+0000","last_unstale":"2024-09-12T02:35:47.566799+0000","last_undegraded":"2024-09-12T02:35:47.566799+0000","last_fullsized":"2024-09-12T02:35:47.566799+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:14.539957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709459+0000","last_change":"2024-09-12T02:35:46.557363+0000","last_active":"2024-09-12T02:35:48.709459+0000","last_peered":"2024-09-12T02:35:48.709459+0000","last_clean":"2024-09-12T02:35:48.709459+0000","last_became_active":"2024-09-12T02:35:46.557054+0000","last_became_peered":"2024-09-12T02:35:46.557054+0000","last_unstale":"2024-09-12T02:35:48.709459+0000","last_undegraded":"2024-09-12T02:35:48.709459+0000","last_fullsized":"2024-09-12T02:35:48.709459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709239+0000","last_change":"2024-09-12T02:35:47.566332+0000","last_active":"2024-09-12T02:35:48.709239+0000","last_peered":"2024-09-12T02:35:48.709239+0000","last_clean":"2024-09-12T02:35:48.709239+0000","last_became_active":"2024-09-12T02:35:47.565922+0000","last_became_peered":"2024-09-12T02:35:47.565922+0000","last_unstale":"2024-09-12T02:35:48.709239+0000","last_undegraded":"2024-09-12T02:35:48.709239+0000","last_fullsized":"2024-09-12T02:35:48.709239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:30.950883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709169+0000","last_change":"2024-09-12T02:35:46.560646+0000","last_active":"2024-09-12T02:35:48.709169+0000","last_peered":"2024-09-12T02:35:48.709169+0000","last_clean":"2024-09-12T02:35:48.709169+0000","last_became_active":"2024-09-12T02:35:46.560281+0000","last_became_peered":"2024-09-12T02:35:46.560281+0000","last_unstale":"2024-09-12T02:35:48.709169+0000","last_undegraded":"2024-09-12T02:35:48.709169+0000","last_fullsized":"2024-09-12T02:35:48.709169+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:47.590939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.563636+0000","last_change":"2024-09-12T02:35:47.561258+0000","last_active":"2024-09-12T02:35:47.563636+0000","last_peered":"2024-09-12T02:35:47.563636+0000","last_clean":"2024-09-12T02:35:47.563636+0000","last_became_active":"2024-09-12T02:35:47.560964+0000","last_became_peered":"2024-09-12T02:35:47.560964+0000","last_unstale":"2024-09-12T02:35:47.563636+0000","last_undegraded":"2024-09-12T02:35:47.563636+0000","last_fullsized":"2024-09-12T02:35:47.563636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.336027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957708+0000","last_change":"2024-09-12T02:35:46.552700+0000","last_active":"2024-09-12T02:35:48.957708+0000","last_peered":"2024-09-12T02:35:48.957708+0000","last_clean":"2024-09-12T02:35:48.957708+0000","last_became_active":"2024-09-12T02:35:46.552416+0000","last_became_peered":"2024-09-12T02:35:46.552416+0000","last_unstale":"2024-09-12T02:35:48.957708+0000","last_undegraded":"2024-09-12T02:35:48.957708+0000","last_fullsized":"2024-09-12T02:35:48.957708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:12.639310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566209+0000","last_change":"2024-09-12T02:35:47.564929+0000","last_active":"2024-09-12T02:35:47.566209+0000","last_peered":"2024-09-12T02:35:47.566209+0000","last_clean":"2024-09-12T02:35:47.566209+0000","last_became_active":"2024-09-12T02:35:47.564632+0000","last_became_peered":"2024-09-12T02:35:47.564632+0000","last_unstale":"2024-09-12T02:35:47.566209+0000","last_undegraded":"2024-09-12T02:35:47.566209+0000","last_fullsized":"2024-09-12T02:35:47.566209+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565602+0000","last_change":"2024-09-12T02:35:46.550057+0000","last_active":"2024-09-12T02:35:47.565602+0000","last_peered":"2024-09-12T02:35:47.565602+0000","last_clean":"2024-09-12T02:35:47.565602+0000","last_became_active":"2024-09-12T02:35:46.549620+0000","last_became_peered":"2024-09-12T02:35:46.549620+0000","last_unstale":"2024-09-12T02:35:47.565602+0000","last_undegraded":"2024-09-12T02:35:47.565602+0000","last_fullsized":"2024-09-12T02:35:47.565602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:08.703290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.573748+0000","last_change":"2024-09-12T02:35:47.570041+0000","last_active":"2024-09-12T02:35:47.573748+0000","last_peered":"2024-09-12T02:35:47.573748+0000","last_clean":"2024-09-12T02:35:47.573748+0000","last_became_active":"2024-09-12T02:35:47.569745+0000","last_became_peered":"2024-09-12T02:35:47.569745+0000","last_unstale":"2024-09-12T02:35:47.573748+0000","last_undegraded":"2024-09-12T02:35:47.573748+0000","last_fullsized":"2024-09-12T02:35:47.573748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.544098+0000","last_change":"2024-09-12T02:35:46.556974+0000","last_active":"2024-09-12T02:35:47.544098+0000","last_peered":"2024-09-12T02:35:47.544098+0000","last_clean":"2024-09-12T02:35:47.544098+0000","last_became_active":"2024-09-12T02:35:46.556679+0000","last_became_peered":"2024-09-12T02:35:46.556679+0000","last_unstale":"2024-09-12T02:35:47.544098+0000","last_undegraded":"2024-09-12T02:35:47.544098+0000","last_fullsized":"2024-09-12T02:35:47.544098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:04.764613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566829+0000","last_change":"2024-09-12T02:35:47.562760+0000","last_active":"2024-09-12T02:35:47.566829+0000","last_peered":"2024-09-12T02:35:47.566829+0000","last_clean":"2024-09-12T02:35:47.566829+0000","last_became_active":"2024-09-12T02:35:47.562486+0000","last_became_peered":"2024-09-12T02:35:47.562486+0000","last_unstale":"2024-09-12T02:35:47.566829+0000","last_undegraded":"2024-09-12T02:35:47.566829+0000","last_fullsized":"2024-09-12T02:35:47.566829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:00.920512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549761+0000","last_change":"2024-09-12T02:35:46.560913+0000","last_active":"2024-09-12T02:35:47.549761+0000","last_peered":"2024-09-12T02:35:47.549761+0000","last_clean":"2024-09-12T02:35:47.549761+0000","last_became_active":"2024-09-12T02:35:46.560622+0000","last_became_peered":"2024-09-12T02:35:46.560622+0000","last_unstale":"2024-09-12T02:35:47.549761+0000","last_undegraded":"2024-09-12T02:35:47.549761+0000","last_fullsized":"2024-09-12T02:35:47.549761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.269933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.560072+0000","last_change":"2024-09-12T02:35:47.552179+0000","last_active":"2024-09-12T02:35:47.560072+0000","last_peered":"2024-09-12T02:35:47.560072+0000","last_clean":"2024-09-12T02:35:47.560072+0000","last_became_active":"2024-09-12T02:35:47.551519+0000","last_became_peered":"2024-09-12T02:35:47.551519+0000","last_unstale":"2024-09-12T02:35:47.560072+0000","last_undegraded":"2024-09-12T02:35:47.560072+0000","last_fullsized":"2024-09-12T02:35:47.560072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.968537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.551345+0000","last_change":"2024-09-12T02:35:46.556235+0000","last_active":"2024-09-12T02:35:47.551345+0000","last_peered":"2024-09-12T02:35:47.551345+0000","last_clean":"2024-09-12T02:35:47.551345+0000","last_became_active":"2024-09-12T02:35:46.555843+0000","last_became_peered":"2024-09-12T02:35:46.555843+0000","last_unstale":"2024-09-12T02:35:47.551345+0000","last_undegraded":"2024-09-12T02:35:47.551345+0000","last_fullsized":"2024-09-12T02:35:47.551345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.565776+0000","last_change":"2024-09-12T02:35:47.562441+0000","last_active":"2024-09-12T02:35:47.565776+0000","last_peered":"2024-09-12T02:35:47.565776+0000","last_clean":"2024-09-12T02:35:47.565776+0000","last_became_active":"2024-09-12T02:35:47.562116+0000","last_became_peered":"2024-09-12T02:35:47.562116+0000","last_unstale":"2024-09-12T02:35:47.565776+0000","last_undegraded":"2024-09-12T02:35:47.565776+0000","last_fullsized":"2024-09-12T02:35:47.565776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.548999+0000","last_change":"2024-09-12T02:35:46.554033+0000","last_active":"2024-09-12T02:35:47.548999+0000","last_peered":"2024-09-12T02:35:47.548999+0000","last_clean":"2024-09-12T02:35:47.548999+0000","last_became_active":"2024-09-12T02:35:46.553741+0000","last_became_peered":"2024-09-12T02:35:46.553741+0000","last_unstale":"2024-09-12T02:35:47.548999+0000","last_undegraded":"2024-09-12T02:35:47.548999+0000","last_fullsized":"2024-09-12T02:35:47.548999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.556909+0000","last_change":"2024-09-12T02:35:47.552427+0000","last_active":"2024-09-12T02:35:47.556909+0000","last_peered":"2024-09-12T02:35:47.556909+0000","last_clean":"2024-09-12T02:35:47.556909+0000","last_became_active":"2024-09-12T02:35:47.552172+0000","last_became_peered":"2024-09-12T02:35:47.552172+0000","last_unstale":"2024-09-12T02:35:47.556909+0000","last_undegraded":"2024-09-12T02:35:47.556909+0000","last_fullsized":"2024-09-12T02:35:47.556909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.545577+0000","last_change":"2024-09-12T02:35:46.557520+0000","last_active":"2024-09-12T02:35:47.545577+0000","last_peered":"2024-09-12T02:35:47.545577+0000","last_clean":"2024-09-12T02:35:47.545577+0000","last_became_active":"2024-09-12T02:35:46.557248+0000","last_became_peered":"2024-09-12T02:35:46.557248+0000","last_unstale":"2024-09-12T02:35:47.545577+0000","last_undegraded":"2024-09-12T02:35:47.545577+0000","last_fullsized":"2024-09-12T02:35:47.545577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.569216+0000","last_change":"2024-09-12T02:35:47.568444+0000","last_active":"2024-09-12T02:35:47.569216+0000","last_peered":"2024-09-12T02:35:47.569216+0000","last_clean":"2024-09-12T02:35:47.569216+0000","last_became_active":"2024-09-12T02:35:47.568168+0000","last_became_peered":"2024-09-12T02:35:47.568168+0000","last_unstale":"2024-09-12T02:35:47.569216+0000","last_undegraded":"2024-09-12T02:35:47.569216+0000","last_fullsized":"2024-09-12T02:35:47.569216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.549710+0000","last_change":"2024-09-12T02:35:46.556913+0000","last_active":"2024-09-12T02:35:47.549710+0000","last_peered":"2024-09-12T02:35:47.549710+0000","last_clean":"2024-09-12T02:35:47.549710+0000","last_became_active":"2024-09-12T02:35:46.555900+0000","last_became_peered":"2024-09-12T02:35:46.555900+0000","last_unstale":"2024-09-12T02:35:47.549710+0000","last_undegraded":"2024-09-12T02:35:47.549710+0000","last_fullsized":"2024-09-12T02:35:47.549710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:26.550563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.566577+0000","last_change":"2024-09-12T02:35:47.562581+0000","last_active":"2024-09-12T02:35:47.566577+0000","last_peered":"2024-09-12T02:35:47.566577+0000","last_clean":"2024-09-12T02:35:47.566577+0000","last_became_active":"2024-09-12T02:35:47.562297+0000","last_became_peered":"2024-09-12T02:35:47.562297+0000","last_unstale":"2024-09-12T02:35:47.566577+0000","last_undegraded":"2024-09-12T02:35:47.566577+0000","last_fullsized":"2024-09-12T02:35:47.566577+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:40.009404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.547634+0000","last_change":"2024-09-12T02:35:46.551656+0000","last_active":"2024-09-12T02:35:47.547634+0000","last_peered":"2024-09-12T02:35:47.547634+0000","last_clean":"2024-09-12T02:35:47.547634+0000","last_became_active":"2024-09-12T02:35:46.551361+0000","last_became_peered":"2024-09-12T02:35:46.551361+0000","last_unstale":"2024-09-12T02:35:47.547634+0000","last_undegraded":"2024-09-12T02:35:47.547634+0000","last_fullsized":"2024-09-12T02:35:47.547634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.574291+0000","last_change":"2024-09-12T02:35:47.568904+0000","last_active":"2024-09-12T02:35:47.574291+0000","last_peered":"2024-09-12T02:35:47.574291+0000","last_clean":"2024-09-12T02:35:47.574291+0000","last_became_active":"2024-09-12T02:35:47.568611+0000","last_became_peered":"2024-09-12T02:35:47.568611+0000","last_unstale":"2024-09-12T02:35:47.574291+0000","last_undegraded":"2024-09-12T02:35:47.574291+0000","last_fullsized":"2024-09-12T02:35:47.574291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:46.102884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.567096+0000","last_change":"2024-09-12T02:35:46.550127+0000","last_active":"2024-09-12T02:35:47.567096+0000","last_peered":"2024-09-12T02:35:47.567096+0000","last_clean":"2024-09-12T02:35:47.567096+0000","last_became_active":"2024-09-12T02:35:46.548956+0000","last_became_peered":"2024-09-12T02:35:46.548956+0000","last_unstale":"2024-09-12T02:35:47.567096+0000","last_undegraded":"2024-09-12T02:35:47.567096+0000","last_fullsized":"2024-09-12T02:35:47.567096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":294,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T02:35:47.557318+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:35:47.557318+0000","last_peered":"2024-09-12T02:35:47.557318+0000","last_clean":"2024-09-12T02:35:47.557318+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:35:47.557318+0000","last_undegraded":"2024-09-12T02:35:47.557318+0000","last_fullsized":"2024-09-12T02:35:47.557318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1060864,"data_stored":449836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46088,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325752,"statfs":{"total":96636764160,"available":96589570048,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1036288,"data_stored":442367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41104,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330736,"statfs":{"total":96636764160,"available":96594673664,"internally_reserved":0,"allocated":1630208,"data_stored":1032735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542240,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1073152,"data_stored":457054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542239,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1064960,"data_stored":456024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:54.864 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:35:54.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.974+0000 7f5ad0b9f640 1 Processor -- start 2024-09-12T02:35:54.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.975+0000 7f5ad0b9f640 1 -- start start 2024-09-12T02:35:54.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.975+0000 7f5ad0b9f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5acc15e640 0x7f5acc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:54.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.975+0000 7f5ad0b9f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5acc0d3660 0x7f5acc0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:54.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.975+0000 7f5ad0b9f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc15ea20 con 0x7f5acc0cf0e0 2024-09-12T02:35:54.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.975+0000 7f5ad0b9f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5acc0b2860 con 0x7f5acc15e640 2024-09-12T02:35:54.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5ad0b9f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5acc0b1c50 con 0x7f5acc0d3660 2024-09-12T02:35:54.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5aca59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5acc15e640 0x7f5acc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5aca59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5acc15e640 0x7f5acc0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33214/0 (socket says 172.21.15.181:33214) 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5ac9d9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5acc0cf0e0 0x7f5acc0b2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47194/0 (socket says 172.21.15.181:47194) 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5aca59c640 1 -- 172.21.15.181:0/3577777290 learned_addr learned my addr 172.21.15.181:0/3577777290 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5acad9d640 1 --2- 172.21.15.181:0/3577777290 >> v2:172.21.15.204:3300/0 conn(0x7f5acc0d3660 0x7f5acc0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5aca59c640 1 -- 172.21.15.181:0/3577777290 >> v2:172.21.15.204:3300/0 conn(0x7f5acc0d3660 msgr2=0x7f5acc0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5aca59c640 1 --2- 172.21.15.181:0/3577777290 >> v2:172.21.15.204:3300/0 conn(0x7f5acc0d3660 0x7f5acc0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5aca59c640 1 -- 172.21.15.181:0/3577777290 >> v1:172.21.15.181:6789/0 conn(0x7f5acc0cf0e0 legacy=0x7f5acc0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5aca59c640 1 -- 172.21.15.181:0/3577777290 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc0b1f30 con 0x7f5acc15e640 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5ac959a640 1 -- 172.21.15.181:0/3577777290 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457311329 0 0) 0x7f5acc15ea20 con 0x7f5acc0cf0e0 2024-09-12T02:35:54.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.976+0000 7f5acad9d640 1 --2- 172.21.15.181:0/3577777290 >> v2:172.21.15.204:3300/0 conn(0x7f5acc0d3660 0x7f5acc0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:54.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.977+0000 7f5aca59c640 1 --2- 172.21.15.181:0/3577777290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc15e640 0x7f5acc0ceba0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0a23f0 tx=0x7f5abc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9227880a7a4a9fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:54.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.977+0000 7f5ac959a640 1 -- 172.21.15.181:0/3577777290 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc037070 con 0x7f5acc15e640 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.977+0000 7f5ac959a640 1 -- 172.21.15.181:0/3577777290 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc032440 con 0x7f5acc15e640 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.977+0000 7f5ac959a640 1 -- 172.21.15.181:0/3577777290 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc032810 con 0x7f5acc15e640 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.977+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3577777290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc15e640 msgr2=0x7f5acc0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.977+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3577777290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc15e640 0x7f5acc0ceba0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0a23f0 tx=0x7f5abc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.978+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3577777290 shutdown_connections 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.978+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3577777290 >> v2:172.21.15.204:3300/0 conn(0x7f5acc0d3660 0x7f5acc0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.978+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3577777290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc15e640 0x7f5acc0ceba0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.978+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3577777290 >> 172.21.15.181:0/3577777290 conn(0x7f5acc09d820 msgr2=0x7f5acc0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.978+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3577777290 shutdown_connections 2024-09-12T02:35:54.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.978+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3577777290 wait complete. 2024-09-12T02:35:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.979+0000 7f5ad0b9f640 1 Processor -- start 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.979+0000 7f5ad0b9f640 1 -- start start 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ad0b9f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5acc0cf0e0 0x7f5acc14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ad0b9f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0d3660 0x7f5acc0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ad0b9f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5acc15e640 0x7f5acc15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ad0b9f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc0cfe40 con 0x7f5acc0d3660 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ad0b9f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc0b24f0 con 0x7f5acc15e640 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ad0b9f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc0b73a0 con 0x7f5acc0cf0e0 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0d3660 0x7f5acc0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0d3660 0x7f5acc0cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33228/0 (socket says 172.21.15.181:33228) 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 -- 172.21.15.181:0/3571878584 learned_addr learned my addr 172.21.15.181:0/3571878584 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5aca59c640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5acc0cf0e0 0x7f5acc14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:54.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5acad9d640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5acc15e640 0x7f5acc15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 -- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5acc0cf0e0 msgr2=0x7f5acc14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5acc0cf0e0 0x7f5acc14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 -- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5acc15e640 msgr2=0x7f5acc15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5acc15e640 0x7f5acc15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 -- 172.21.15.181:0/3571878584 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc0cc070 con 0x7f5acc0d3660 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5ac9d9b640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0d3660 0x7f5acc0cb620 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000c440 tx=0x7f5ac000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5abaffd640 1 -- 172.21.15.181:0/3571878584 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0018070 con 0x7f5acc0d3660 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.980+0000 7f5abaffd640 1 -- 172.21.15.181:0/3571878584 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac00074a0 con 0x7f5acc0d3660 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.981+0000 7f5abaffd640 1 -- 172.21.15.181:0/3571878584 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0004a20 con 0x7f5acc0d3660 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.981+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5acc0cc350 con 0x7f5acc0d3660 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.981+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5acc0cc910 con 0x7f5acc0d3660 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.981+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5acc068eb0 con 0x7f5acc0d3660 2024-09-12T02:35:54.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.982+0000 7f5abaffd640 1 -- 172.21.15.181:0/3571878584 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ac001b070 con 0x7f5acc0d3660 2024-09-12T02:35:54.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.982+0000 7f5abaffd640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5aac06be30 0x7f5aac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:54.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.982+0000 7f5abaffd640 1 -- 172.21.15.181:0/3571878584 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f5ac0089fc0 con 0x7f5acc0d3660 2024-09-12T02:35:54.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.982+0000 7f5aca59c640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5aac06be30 0x7f5aac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:54.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.983+0000 7f5aca59c640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5aac06be30 0x7f5aac06e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5abc034000 tx=0x7f5abc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:54.987+0000 7f5abaffd640 1 -- 172.21.15.181:0/3571878584 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ac0007650 con 0x7f5acc0d3660 2024-09-12T02:35:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.147+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5acc06c650 con 0x7f5aac06be30 2024-09-12T02:35:55.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.153+0000 7f5abaffd640 1 -- 172.21.15.181:0/3571878584 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252050 (secure 0 0 0) 0x7f5acc06c650 con 0x7f5aac06be30 2024-09-12T02:35:55.156 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5aac06be30 msgr2=0x7f5aac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5aac06be30 0x7f5aac06e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5abc034000 tx=0x7f5abc02e000 comp rx=0 tx=0).stop 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0d3660 msgr2=0x7f5acc0cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0d3660 0x7f5acc0cb620 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000c440 tx=0x7f5ac000c900 comp rx=0 tx=0).stop 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 shutdown_connections 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f5aac06be30 0x7f5aac06e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5acc15e640 0x7f5acc15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5acc0d3660 0x7f5acc0cb620 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 --2- 172.21.15.181:0/3571878584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5acc0cf0e0 0x7f5acc14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 >> 172.21.15.181:0/3571878584 conn(0x7f5acc09d820 msgr2=0x7f5acc0cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 shutdown_connections 2024-09-12T02:35:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.156+0000 7f5ad0b9f640 1 -- 172.21.15.181:0/3571878584 wait complete. 2024-09-12T02:35:55.168 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-12T02:35:53.708915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285412,"kb_used_data":9512,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689308,"statfs":{"total":773094113280,"available":772801851392,"internally_reserved":0,"allocated":9740288,"data_stored":4829092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.168416"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562615+0000","last_change":"2024-09-12T02:35:47.563930+0000","last_active":"2024-09-12T02:35:48.562615+0000","last_peered":"2024-09-12T02:35:48.562615+0000","last_clean":"2024-09-12T02:35:48.562615+0000","last_became_active":"2024-09-12T02:35:47.562924+0000","last_became_peered":"2024-09-12T02:35:47.562924+0000","last_unstale":"2024-09-12T02:35:48.562615+0000","last_undegraded":"2024-09-12T02:35:48.562615+0000","last_fullsized":"2024-09-12T02:35:48.562615+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.959083+0000","last_change":"2024-09-12T02:35:47.565295+0000","last_active":"2024-09-12T02:35:48.959083+0000","last_peered":"2024-09-12T02:35:48.959083+0000","last_clean":"2024-09-12T02:35:48.959083+0000","last_became_active":"2024-09-12T02:35:47.565057+0000","last_became_peered":"2024-09-12T02:35:47.565057+0000","last_unstale":"2024-09-12T02:35:48.959083+0000","last_undegraded":"2024-09-12T02:35:48.959083+0000","last_fullsized":"2024-09-12T02:35:48.959083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:53.464411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559873+0000","last_change":"2024-09-12T02:35:47.570484+0000","last_active":"2024-09-12T02:35:48.559873+0000","last_peered":"2024-09-12T02:35:48.559873+0000","last_clean":"2024-09-12T02:35:48.559873+0000","last_became_active":"2024-09-12T02:35:47.570214+0000","last_became_peered":"2024-09-12T02:35:47.570214+0000","last_unstale":"2024-09-12T02:35:48.559873+0000","last_undegraded":"2024-09-12T02:35:48.559873+0000","last_fullsized":"2024-09-12T02:35:48.559873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:03.207128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709485+0000","last_change":"2024-09-12T02:35:47.558453+0000","last_active":"2024-09-12T02:35:48.709485+0000","last_peered":"2024-09-12T02:35:48.709485+0000","last_clean":"2024-09-12T02:35:48.709485+0000","last_became_active":"2024-09-12T02:35:47.557414+0000","last_became_peered":"2024-09-12T02:35:47.557414+0000","last_unstale":"2024-09-12T02:35:48.709485+0000","last_undegraded":"2024-09-12T02:35:48.709485+0000","last_fullsized":"2024-09-12T02:35:48.709485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:07.791203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563155+0000","last_change":"2024-09-12T02:35:47.550460+0000","last_active":"2024-09-12T02:35:48.563155+0000","last_peered":"2024-09-12T02:35:48.563155+0000","last_clean":"2024-09-12T02:35:48.563155+0000","last_became_active":"2024-09-12T02:35:47.550185+0000","last_became_peered":"2024-09-12T02:35:47.550185+0000","last_unstale":"2024-09-12T02:35:48.563155+0000","last_undegraded":"2024-09-12T02:35:48.563155+0000","last_fullsized":"2024-09-12T02:35:48.563155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:14.539957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958421+0000","last_change":"2024-09-12T02:35:47.568596+0000","last_active":"2024-09-12T02:35:48.958421+0000","last_peered":"2024-09-12T02:35:48.958421+0000","last_clean":"2024-09-12T02:35:48.958421+0000","last_became_active":"2024-09-12T02:35:47.568345+0000","last_became_peered":"2024-09-12T02:35:47.568345+0000","last_unstale":"2024-09-12T02:35:48.958421+0000","last_undegraded":"2024-09-12T02:35:48.958421+0000","last_fullsized":"2024-09-12T02:35:48.958421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709020+0000","last_change":"2024-09-12T02:35:47.564281+0000","last_active":"2024-09-12T02:35:48.709020+0000","last_peered":"2024-09-12T02:35:48.709020+0000","last_clean":"2024-09-12T02:35:48.709020+0000","last_became_active":"2024-09-12T02:35:47.564021+0000","last_became_peered":"2024-09-12T02:35:47.564021+0000","last_unstale":"2024-09-12T02:35:48.709020+0000","last_undegraded":"2024-09-12T02:35:48.709020+0000","last_fullsized":"2024-09-12T02:35:48.709020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:49.562922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958123+0000","last_change":"2024-09-12T02:35:47.568454+0000","last_active":"2024-09-12T02:35:48.958123+0000","last_peered":"2024-09-12T02:35:48.958123+0000","last_clean":"2024-09-12T02:35:48.958123+0000","last_became_active":"2024-09-12T02:35:47.568201+0000","last_became_peered":"2024-09-12T02:35:47.568201+0000","last_unstale":"2024-09-12T02:35:48.958123+0000","last_undegraded":"2024-09-12T02:35:48.958123+0000","last_fullsized":"2024-09-12T02:35:48.958123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:31.957266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958358+0000","last_change":"2024-09-12T02:35:47.561792+0000","last_active":"2024-09-12T02:35:48.958358+0000","last_peered":"2024-09-12T02:35:48.958358+0000","last_clean":"2024-09-12T02:35:48.958358+0000","last_became_active":"2024-09-12T02:35:47.560908+0000","last_became_peered":"2024-09-12T02:35:47.560908+0000","last_unstale":"2024-09-12T02:35:48.958358+0000","last_undegraded":"2024-09-12T02:35:48.958358+0000","last_fullsized":"2024-09-12T02:35:48.958358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563517+0000","last_change":"2024-09-12T02:35:47.557935+0000","last_active":"2024-09-12T02:35:48.563517+0000","last_peered":"2024-09-12T02:35:48.563517+0000","last_clean":"2024-09-12T02:35:48.563517+0000","last_became_active":"2024-09-12T02:35:47.557463+0000","last_became_peered":"2024-09-12T02:35:47.557463+0000","last_unstale":"2024-09-12T02:35:48.563517+0000","last_undegraded":"2024-09-12T02:35:48.563517+0000","last_fullsized":"2024-09-12T02:35:48.563517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:31.526030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958945+0000","last_change":"2024-09-12T02:35:47.564524+0000","last_active":"2024-09-12T02:35:48.958945+0000","last_peered":"2024-09-12T02:35:48.958945+0000","last_clean":"2024-09-12T02:35:48.958945+0000","last_became_active":"2024-09-12T02:35:47.562298+0000","last_became_peered":"2024-09-12T02:35:47.562298+0000","last_unstale":"2024-09-12T02:35:48.958945+0000","last_undegraded":"2024-09-12T02:35:48.958945+0000","last_fullsized":"2024-09-12T02:35:48.958945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:20.925244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562525+0000","last_change":"2024-09-12T02:35:47.559543+0000","last_active":"2024-09-12T02:35:48.562525+0000","last_peered":"2024-09-12T02:35:48.562525+0000","last_clean":"2024-09-12T02:35:48.562525+0000","last_became_active":"2024-09-12T02:35:47.558672+0000","last_became_peered":"2024-09-12T02:35:47.558672+0000","last_unstale":"2024-09-12T02:35:48.562525+0000","last_undegraded":"2024-09-12T02:35:48.562525+0000","last_fullsized":"2024-09-12T02:35:48.562525+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:28.803475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559915+0000","last_change":"2024-09-12T02:35:47.566022+0000","last_active":"2024-09-12T02:35:48.559915+0000","last_peered":"2024-09-12T02:35:48.559915+0000","last_clean":"2024-09-12T02:35:48.559915+0000","last_became_active":"2024-09-12T02:35:47.565722+0000","last_became_peered":"2024-09-12T02:35:47.565722+0000","last_unstale":"2024-09-12T02:35:48.559915+0000","last_undegraded":"2024-09-12T02:35:48.559915+0000","last_fullsized":"2024-09-12T02:35:48.559915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:55.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709363+0000","last_change":"2024-09-12T02:35:47.567234+0000","last_active":"2024-09-12T02:35:48.709363+0000","last_peered":"2024-09-12T02:35:48.709363+0000","last_clean":"2024-09-12T02:35:48.709363+0000","last_became_active":"2024-09-12T02:35:47.566905+0000","last_became_peered":"2024-09-12T02:35:47.566905+0000","last_unstale":"2024-09-12T02:35:48.709363+0000","last_undegraded":"2024-09-12T02:35:48.709363+0000","last_fullsized":"2024-09-12T02:35:48.709363+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:27.510998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957833+0000","last_change":"2024-09-12T02:35:47.567913+0000","last_active":"2024-09-12T02:35:48.957833+0000","last_peered":"2024-09-12T02:35:48.957833+0000","last_clean":"2024-09-12T02:35:48.957833+0000","last_became_active":"2024-09-12T02:35:47.567478+0000","last_became_peered":"2024-09-12T02:35:47.567478+0000","last_unstale":"2024-09-12T02:35:48.957833+0000","last_undegraded":"2024-09-12T02:35:48.957833+0000","last_fullsized":"2024-09-12T02:35:48.957833+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:01.887113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563134+0000","last_change":"2024-09-12T02:35:47.558932+0000","last_active":"2024-09-12T02:35:48.563134+0000","last_peered":"2024-09-12T02:35:48.563134+0000","last_clean":"2024-09-12T02:35:48.563134+0000","last_became_active":"2024-09-12T02:35:47.558677+0000","last_became_peered":"2024-09-12T02:35:47.558677+0000","last_unstale":"2024-09-12T02:35:48.563134+0000","last_undegraded":"2024-09-12T02:35:48.563134+0000","last_fullsized":"2024-09-12T02:35:48.563134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:28.803475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563769+0000","last_change":"2024-09-12T02:35:47.557164+0000","last_active":"2024-09-12T02:35:48.563769+0000","last_peered":"2024-09-12T02:35:48.563769+0000","last_clean":"2024-09-12T02:35:48.563769+0000","last_became_active":"2024-09-12T02:35:47.556845+0000","last_became_peered":"2024-09-12T02:35:47.556845+0000","last_unstale":"2024-09-12T02:35:48.563769+0000","last_undegraded":"2024-09-12T02:35:48.563769+0000","last_fullsized":"2024-09-12T02:35:48.563769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:50.012533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709325+0000","last_change":"2024-09-12T02:35:47.563528+0000","last_active":"2024-09-12T02:35:48.709325+0000","last_peered":"2024-09-12T02:35:48.709325+0000","last_clean":"2024-09-12T02:35:48.709325+0000","last_became_active":"2024-09-12T02:35:47.563218+0000","last_became_peered":"2024-09-12T02:35:47.563218+0000","last_unstale":"2024-09-12T02:35:48.709325+0000","last_undegraded":"2024-09-12T02:35:48.709325+0000","last_fullsized":"2024-09-12T02:35:48.709325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:26.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958925+0000","last_change":"2024-09-12T02:35:47.551849+0000","last_active":"2024-09-12T02:35:48.958925+0000","last_peered":"2024-09-12T02:35:48.958925+0000","last_clean":"2024-09-12T02:35:48.958925+0000","last_became_active":"2024-09-12T02:35:47.551596+0000","last_became_peered":"2024-09-12T02:35:47.551596+0000","last_unstale":"2024-09-12T02:35:48.958925+0000","last_undegraded":"2024-09-12T02:35:48.958925+0000","last_fullsized":"2024-09-12T02:35:48.958925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:28.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709350+0000","last_change":"2024-09-12T02:35:47.555636+0000","last_active":"2024-09-12T02:35:48.709350+0000","last_peered":"2024-09-12T02:35:48.709350+0000","last_clean":"2024-09-12T02:35:48.709350+0000","last_became_active":"2024-09-12T02:35:47.555380+0000","last_became_peered":"2024-09-12T02:35:47.555380+0000","last_unstale":"2024-09-12T02:35:48.709350+0000","last_undegraded":"2024-09-12T02:35:48.709350+0000","last_fullsized":"2024-09-12T02:35:48.709350+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:24.329883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709166+0000","last_change":"2024-09-12T02:35:47.553056+0000","last_active":"2024-09-12T02:35:48.709166+0000","last_peered":"2024-09-12T02:35:48.709166+0000","last_clean":"2024-09-12T02:35:48.709166+0000","last_became_active":"2024-09-12T02:35:47.552812+0000","last_became_peered":"2024-09-12T02:35:47.552812+0000","last_unstale":"2024-09-12T02:35:48.709166+0000","last_undegraded":"2024-09-12T02:35:48.709166+0000","last_fullsized":"2024-09-12T02:35:48.709166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:05.894065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958556+0000","last_change":"2024-09-12T02:35:47.552647+0000","last_active":"2024-09-12T02:35:48.958556+0000","last_peered":"2024-09-12T02:35:48.958556+0000","last_clean":"2024-09-12T02:35:48.958556+0000","last_became_active":"2024-09-12T02:35:47.552352+0000","last_became_peered":"2024-09-12T02:35:47.552352+0000","last_unstale":"2024-09-12T02:35:48.958556+0000","last_undegraded":"2024-09-12T02:35:48.958556+0000","last_fullsized":"2024-09-12T02:35:48.958556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:27.558031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562841+0000","last_change":"2024-09-12T02:35:47.558637+0000","last_active":"2024-09-12T02:35:48.562841+0000","last_peered":"2024-09-12T02:35:48.562841+0000","last_clean":"2024-09-12T02:35:48.562841+0000","last_became_active":"2024-09-12T02:35:47.558335+0000","last_became_peered":"2024-09-12T02:35:47.558335+0000","last_unstale":"2024-09-12T02:35:48.562841+0000","last_undegraded":"2024-09-12T02:35:48.562841+0000","last_fullsized":"2024-09-12T02:35:48.562841+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:31.957266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.708934+0000","last_change":"2024-09-12T02:35:47.556215+0000","last_active":"2024-09-12T02:35:48.708934+0000","last_peered":"2024-09-12T02:35:48.708934+0000","last_clean":"2024-09-12T02:35:48.708934+0000","last_became_active":"2024-09-12T02:35:47.555972+0000","last_became_peered":"2024-09-12T02:35:47.555972+0000","last_unstale":"2024-09-12T02:35:48.708934+0000","last_undegraded":"2024-09-12T02:35:48.708934+0000","last_fullsized":"2024-09-12T02:35:48.708934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.017308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958232+0000","last_change":"2024-09-12T02:35:47.565021+0000","last_active":"2024-09-12T02:35:48.958232+0000","last_peered":"2024-09-12T02:35:48.958232+0000","last_clean":"2024-09-12T02:35:48.958232+0000","last_became_active":"2024-09-12T02:35:47.564686+0000","last_became_peered":"2024-09-12T02:35:47.564686+0000","last_unstale":"2024-09-12T02:35:48.958232+0000","last_undegraded":"2024-09-12T02:35:48.958232+0000","last_fullsized":"2024-09-12T02:35:48.958232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:49.016526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559985+0000","last_change":"2024-09-12T02:35:47.567786+0000","last_active":"2024-09-12T02:35:48.559985+0000","last_peered":"2024-09-12T02:35:48.559985+0000","last_clean":"2024-09-12T02:35:48.559985+0000","last_became_active":"2024-09-12T02:35:47.567479+0000","last_became_peered":"2024-09-12T02:35:47.567479+0000","last_unstale":"2024-09-12T02:35:48.559985+0000","last_undegraded":"2024-09-12T02:35:48.559985+0000","last_fullsized":"2024-09-12T02:35:48.559985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:48.556332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.564063+0000","last_change":"2024-09-12T02:35:47.554685+0000","last_active":"2024-09-12T02:35:48.564063+0000","last_peered":"2024-09-12T02:35:48.564063+0000","last_clean":"2024-09-12T02:35:48.564063+0000","last_became_active":"2024-09-12T02:35:47.554170+0000","last_became_peered":"2024-09-12T02:35:47.554170+0000","last_unstale":"2024-09-12T02:35:48.564063+0000","last_undegraded":"2024-09-12T02:35:48.564063+0000","last_fullsized":"2024-09-12T02:35:48.564063+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:31.957266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562685+0000","last_change":"2024-09-12T02:35:47.561906+0000","last_active":"2024-09-12T02:35:48.562685+0000","last_peered":"2024-09-12T02:35:48.562685+0000","last_clean":"2024-09-12T02:35:48.562685+0000","last_became_active":"2024-09-12T02:35:47.561625+0000","last_became_peered":"2024-09-12T02:35:47.561625+0000","last_unstale":"2024-09-12T02:35:48.562685+0000","last_undegraded":"2024-09-12T02:35:48.562685+0000","last_fullsized":"2024-09-12T02:35:48.562685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958352+0000","last_change":"2024-09-12T02:35:47.552719+0000","last_active":"2024-09-12T02:35:48.958352+0000","last_peered":"2024-09-12T02:35:48.958352+0000","last_clean":"2024-09-12T02:35:48.958352+0000","last_became_active":"2024-09-12T02:35:47.552428+0000","last_became_peered":"2024-09-12T02:35:47.552428+0000","last_unstale":"2024-09-12T02:35:48.958352+0000","last_undegraded":"2024-09-12T02:35:48.958352+0000","last_fullsized":"2024-09-12T02:35:48.958352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:45.385077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958629+0000","last_change":"2024-09-12T02:35:47.559405+0000","last_active":"2024-09-12T02:35:48.958629+0000","last_peered":"2024-09-12T02:35:48.958629+0000","last_clean":"2024-09-12T02:35:48.958629+0000","last_became_active":"2024-09-12T02:35:47.556745+0000","last_became_peered":"2024-09-12T02:35:47.556745+0000","last_unstale":"2024-09-12T02:35:48.958629+0000","last_undegraded":"2024-09-12T02:35:48.958629+0000","last_fullsized":"2024-09-12T02:35:48.958629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:30.277402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563319+0000","last_change":"2024-09-12T02:35:47.549673+0000","last_active":"2024-09-12T02:35:48.563319+0000","last_peered":"2024-09-12T02:35:48.563319+0000","last_clean":"2024-09-12T02:35:48.563319+0000","last_became_active":"2024-09-12T02:35:47.549408+0000","last_became_peered":"2024-09-12T02:35:47.549408+0000","last_unstale":"2024-09-12T02:35:48.563319+0000","last_undegraded":"2024-09-12T02:35:48.563319+0000","last_fullsized":"2024-09-12T02:35:48.563319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:27.277743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562323+0000","last_change":"2024-09-12T02:35:47.561157+0000","last_active":"2024-09-12T02:35:48.562323+0000","last_peered":"2024-09-12T02:35:48.562323+0000","last_clean":"2024-09-12T02:35:48.562323+0000","last_became_active":"2024-09-12T02:35:47.560870+0000","last_became_peered":"2024-09-12T02:35:47.560870+0000","last_unstale":"2024-09-12T02:35:48.562323+0000","last_undegraded":"2024-09-12T02:35:48.562323+0000","last_fullsized":"2024-09-12T02:35:48.562323+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:14.539957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.564166+0000","last_change":"2024-09-12T02:35:47.559676+0000","last_active":"2024-09-12T02:35:48.564166+0000","last_peered":"2024-09-12T02:35:48.564166+0000","last_clean":"2024-09-12T02:35:48.564166+0000","last_became_active":"2024-09-12T02:35:47.559394+0000","last_became_peered":"2024-09-12T02:35:47.559394+0000","last_unstale":"2024-09-12T02:35:48.564166+0000","last_undegraded":"2024-09-12T02:35:48.564166+0000","last_fullsized":"2024-09-12T02:35:48.564166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:49.428222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563657+0000","last_change":"2024-09-12T02:35:46.561281+0000","last_active":"2024-09-12T02:35:48.563657+0000","last_peered":"2024-09-12T02:35:48.563657+0000","last_clean":"2024-09-12T02:35:48.563657+0000","last_became_active":"2024-09-12T02:35:46.561013+0000","last_became_peered":"2024-09-12T02:35:46.561013+0000","last_unstale":"2024-09-12T02:35:48.563657+0000","last_undegraded":"2024-09-12T02:35:48.563657+0000","last_fullsized":"2024-09-12T02:35:48.563657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563424+0000","last_change":"2024-09-12T02:35:47.564156+0000","last_active":"2024-09-12T02:35:48.563424+0000","last_peered":"2024-09-12T02:35:48.563424+0000","last_clean":"2024-09-12T02:35:48.563424+0000","last_became_active":"2024-09-12T02:35:47.563648+0000","last_became_peered":"2024-09-12T02:35:47.563648+0000","last_unstale":"2024-09-12T02:35:48.563424+0000","last_undegraded":"2024-09-12T02:35:48.563424+0000","last_fullsized":"2024-09-12T02:35:48.563424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:37.750492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.564296+0000","last_change":"2024-09-12T02:35:46.554200+0000","last_active":"2024-09-12T02:35:48.564296+0000","last_peered":"2024-09-12T02:35:48.564296+0000","last_clean":"2024-09-12T02:35:48.564296+0000","last_became_active":"2024-09-12T02:35:46.553896+0000","last_became_peered":"2024-09-12T02:35:46.553896+0000","last_unstale":"2024-09-12T02:35:48.564296+0000","last_undegraded":"2024-09-12T02:35:48.564296+0000","last_fullsized":"2024-09-12T02:35:48.564296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:52.456942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562719+0000","last_change":"2024-09-12T02:35:47.559318+0000","last_active":"2024-09-12T02:35:48.562719+0000","last_peered":"2024-09-12T02:35:48.562719+0000","last_clean":"2024-09-12T02:35:48.562719+0000","last_became_active":"2024-09-12T02:35:47.559060+0000","last_became_peered":"2024-09-12T02:35:47.559060+0000","last_unstale":"2024-09-12T02:35:48.562719+0000","last_undegraded":"2024-09-12T02:35:48.562719+0000","last_fullsized":"2024-09-12T02:35:48.562719+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:50.012533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958918+0000","last_change":"2024-09-12T02:35:46.554539+0000","last_active":"2024-09-12T02:35:48.958918+0000","last_peered":"2024-09-12T02:35:48.958918+0000","last_clean":"2024-09-12T02:35:48.958918+0000","last_became_active":"2024-09-12T02:35:46.554102+0000","last_became_peered":"2024-09-12T02:35:46.554102+0000","last_unstale":"2024-09-12T02:35:48.958918+0000","last_undegraded":"2024-09-12T02:35:48.958918+0000","last_fullsized":"2024-09-12T02:35:48.958918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:36.743023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559943+0000","last_change":"2024-09-12T02:35:47.564826+0000","last_active":"2024-09-12T02:35:48.559943+0000","last_peered":"2024-09-12T02:35:48.559943+0000","last_clean":"2024-09-12T02:35:48.559943+0000","last_became_active":"2024-09-12T02:35:47.564507+0000","last_became_peered":"2024-09-12T02:35:47.564507+0000","last_unstale":"2024-09-12T02:35:48.559943+0000","last_undegraded":"2024-09-12T02:35:48.559943+0000","last_fullsized":"2024-09-12T02:35:48.559943+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:43.934721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958597+0000","last_change":"2024-09-12T02:35:46.556651+0000","last_active":"2024-09-12T02:35:48.958597+0000","last_peered":"2024-09-12T02:35:48.958597+0000","last_clean":"2024-09-12T02:35:48.958597+0000","last_became_active":"2024-09-12T02:35:46.556327+0000","last_became_peered":"2024-09-12T02:35:46.556327+0000","last_unstale":"2024-09-12T02:35:48.958597+0000","last_undegraded":"2024-09-12T02:35:48.958597+0000","last_fullsized":"2024-09-12T02:35:48.958597+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.949797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958749+0000","last_change":"2024-09-12T02:35:47.560250+0000","last_active":"2024-09-12T02:35:48.958749+0000","last_peered":"2024-09-12T02:35:48.958749+0000","last_clean":"2024-09-12T02:35:48.958749+0000","last_became_active":"2024-09-12T02:35:47.559558+0000","last_became_peered":"2024-09-12T02:35:47.559558+0000","last_unstale":"2024-09-12T02:35:48.958749+0000","last_undegraded":"2024-09-12T02:35:48.958749+0000","last_fullsized":"2024-09-12T02:35:48.958749+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:43.847680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563695+0000","last_change":"2024-09-12T02:35:46.554241+0000","last_active":"2024-09-12T02:35:48.563695+0000","last_peered":"2024-09-12T02:35:48.563695+0000","last_clean":"2024-09-12T02:35:48.563695+0000","last_became_active":"2024-09-12T02:35:46.553958+0000","last_became_peered":"2024-09-12T02:35:46.553958+0000","last_unstale":"2024-09-12T02:35:48.563695+0000","last_undegraded":"2024-09-12T02:35:48.563695+0000","last_fullsized":"2024-09-12T02:35:48.563695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563538+0000","last_change":"2024-09-12T02:35:47.559441+0000","last_active":"2024-09-12T02:35:48.563538+0000","last_peered":"2024-09-12T02:35:48.563538+0000","last_clean":"2024-09-12T02:35:48.563538+0000","last_became_active":"2024-09-12T02:35:47.559046+0000","last_became_peered":"2024-09-12T02:35:47.559046+0000","last_unstale":"2024-09-12T02:35:48.563538+0000","last_undegraded":"2024-09-12T02:35:48.563538+0000","last_fullsized":"2024-09-12T02:35:48.563538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563119+0000","last_change":"2024-09-12T02:35:46.558161+0000","last_active":"2024-09-12T02:35:48.563119+0000","last_peered":"2024-09-12T02:35:48.563119+0000","last_clean":"2024-09-12T02:35:48.563119+0000","last_became_active":"2024-09-12T02:35:46.557836+0000","last_became_peered":"2024-09-12T02:35:46.557836+0000","last_unstale":"2024-09-12T02:35:48.563119+0000","last_undegraded":"2024-09-12T02:35:48.563119+0000","last_fullsized":"2024-09-12T02:35:48.563119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559654+0000","last_change":"2024-09-12T02:35:47.565152+0000","last_active":"2024-09-12T02:35:48.559654+0000","last_peered":"2024-09-12T02:35:48.559654+0000","last_clean":"2024-09-12T02:35:48.559654+0000","last_became_active":"2024-09-12T02:35:47.563838+0000","last_became_peered":"2024-09-12T02:35:47.563838+0000","last_unstale":"2024-09-12T02:35:48.559654+0000","last_undegraded":"2024-09-12T02:35:48.559654+0000","last_fullsized":"2024-09-12T02:35:48.559654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:34.949597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958468+0000","last_change":"2024-09-12T02:35:46.554449+0000","last_active":"2024-09-12T02:35:48.958468+0000","last_peered":"2024-09-12T02:35:48.958468+0000","last_clean":"2024-09-12T02:35:48.958468+0000","last_became_active":"2024-09-12T02:35:46.553756+0000","last_became_peered":"2024-09-12T02:35:46.553756+0000","last_unstale":"2024-09-12T02:35:48.958468+0000","last_undegraded":"2024-09-12T02:35:48.958468+0000","last_fullsized":"2024-09-12T02:35:48.958468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:26.270274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957964+0000","last_change":"2024-09-12T02:35:47.567699+0000","last_active":"2024-09-12T02:35:48.957964+0000","last_peered":"2024-09-12T02:35:48.957964+0000","last_clean":"2024-09-12T02:35:48.957964+0000","last_became_active":"2024-09-12T02:35:47.567145+0000","last_became_peered":"2024-09-12T02:35:47.567145+0000","last_unstale":"2024-09-12T02:35:48.957964+0000","last_undegraded":"2024-09-12T02:35:48.957964+0000","last_fullsized":"2024-09-12T02:35:48.957964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:54.307129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958344+0000","last_change":"2024-09-12T02:35:46.559650+0000","last_active":"2024-09-12T02:35:48.958344+0000","last_peered":"2024-09-12T02:35:48.958344+0000","last_clean":"2024-09-12T02:35:48.958344+0000","last_became_active":"2024-09-12T02:35:46.559382+0000","last_became_peered":"2024-09-12T02:35:46.559382+0000","last_unstale":"2024-09-12T02:35:48.958344+0000","last_undegraded":"2024-09-12T02:35:48.958344+0000","last_fullsized":"2024-09-12T02:35:48.958344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:10.746279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958003+0000","last_change":"2024-09-12T02:35:47.555322+0000","last_active":"2024-09-12T02:35:48.958003+0000","last_peered":"2024-09-12T02:35:48.958003+0000","last_clean":"2024-09-12T02:35:48.958003+0000","last_became_active":"2024-09-12T02:35:47.553505+0000","last_became_peered":"2024-09-12T02:35:47.553505+0000","last_unstale":"2024-09-12T02:35:48.958003+0000","last_undegraded":"2024-09-12T02:35:48.958003+0000","last_fullsized":"2024-09-12T02:35:48.958003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:19.611770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563761+0000","last_change":"2024-09-12T02:35:46.557154+0000","last_active":"2024-09-12T02:35:48.563761+0000","last_peered":"2024-09-12T02:35:48.563761+0000","last_clean":"2024-09-12T02:35:48.563761+0000","last_became_active":"2024-09-12T02:35:46.556451+0000","last_became_peered":"2024-09-12T02:35:46.556451+0000","last_unstale":"2024-09-12T02:35:48.563761+0000","last_undegraded":"2024-09-12T02:35:48.563761+0000","last_fullsized":"2024-09-12T02:35:48.563761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958424+0000","last_change":"2024-09-12T02:35:47.567600+0000","last_active":"2024-09-12T02:35:48.958424+0000","last_peered":"2024-09-12T02:35:48.958424+0000","last_clean":"2024-09-12T02:35:48.958424+0000","last_became_active":"2024-09-12T02:35:47.567311+0000","last_became_peered":"2024-09-12T02:35:47.567311+0000","last_unstale":"2024-09-12T02:35:48.958424+0000","last_undegraded":"2024-09-12T02:35:48.958424+0000","last_fullsized":"2024-09-12T02:35:48.958424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:38.301573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563613+0000","last_change":"2024-09-12T02:35:46.554852+0000","last_active":"2024-09-12T02:35:48.563613+0000","last_peered":"2024-09-12T02:35:48.563613+0000","last_clean":"2024-09-12T02:35:48.563613+0000","last_became_active":"2024-09-12T02:35:46.554514+0000","last_became_peered":"2024-09-12T02:35:46.554514+0000","last_unstale":"2024-09-12T02:35:48.563613+0000","last_undegraded":"2024-09-12T02:35:48.563613+0000","last_fullsized":"2024-09-12T02:35:48.563613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958658+0000","last_change":"2024-09-12T02:35:47.562737+0000","last_active":"2024-09-12T02:35:48.958658+0000","last_peered":"2024-09-12T02:35:48.958658+0000","last_clean":"2024-09-12T02:35:48.958658+0000","last_became_active":"2024-09-12T02:35:47.562421+0000","last_became_peered":"2024-09-12T02:35:47.562421+0000","last_unstale":"2024-09-12T02:35:48.958658+0000","last_undegraded":"2024-09-12T02:35:48.958658+0000","last_fullsized":"2024-09-12T02:35:48.958658+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:34.949597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562521+0000","last_change":"2024-09-12T02:35:46.559638+0000","last_active":"2024-09-12T02:35:48.562521+0000","last_peered":"2024-09-12T02:35:48.562521+0000","last_clean":"2024-09-12T02:35:48.562521+0000","last_became_active":"2024-09-12T02:35:46.559442+0000","last_became_peered":"2024-09-12T02:35:46.559442+0000","last_unstale":"2024-09-12T02:35:48.562521+0000","last_undegraded":"2024-09-12T02:35:48.562521+0000","last_fullsized":"2024-09-12T02:35:48.562521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:44.377608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.564156+0000","last_change":"2024-09-12T02:35:47.552392+0000","last_active":"2024-09-12T02:35:48.564156+0000","last_peered":"2024-09-12T02:35:48.564156+0000","last_clean":"2024-09-12T02:35:48.564156+0000","last_became_active":"2024-09-12T02:35:47.551877+0000","last_became_peered":"2024-09-12T02:35:47.551877+0000","last_unstale":"2024-09-12T02:35:48.564156+0000","last_undegraded":"2024-09-12T02:35:48.564156+0000","last_fullsized":"2024-09-12T02:35:48.564156+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:31.526030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958343+0000","last_change":"2024-09-12T02:35:46.555192+0000","last_active":"2024-09-12T02:35:48.958343+0000","last_peered":"2024-09-12T02:35:48.958343+0000","last_clean":"2024-09-12T02:35:48.958343+0000","last_became_active":"2024-09-12T02:35:46.554874+0000","last_became_peered":"2024-09-12T02:35:46.554874+0000","last_unstale":"2024-09-12T02:35:48.958343+0000","last_undegraded":"2024-09-12T02:35:48.958343+0000","last_fullsized":"2024-09-12T02:35:48.958343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:39.001935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958805+0000","last_change":"2024-09-12T02:35:47.561844+0000","last_active":"2024-09-12T02:35:48.958805+0000","last_peered":"2024-09-12T02:35:48.958805+0000","last_clean":"2024-09-12T02:35:48.958805+0000","last_became_active":"2024-09-12T02:35:47.561576+0000","last_became_peered":"2024-09-12T02:35:47.561576+0000","last_unstale":"2024-09-12T02:35:48.958805+0000","last_undegraded":"2024-09-12T02:35:48.958805+0000","last_fullsized":"2024-09-12T02:35:48.958805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:55.648014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958506+0000","last_change":"2024-09-12T02:35:46.557645+0000","last_active":"2024-09-12T02:35:48.958506+0000","last_peered":"2024-09-12T02:35:48.958506+0000","last_clean":"2024-09-12T02:35:48.958506+0000","last_became_active":"2024-09-12T02:35:46.557388+0000","last_became_peered":"2024-09-12T02:35:46.557388+0000","last_unstale":"2024-09-12T02:35:48.958506+0000","last_undegraded":"2024-09-12T02:35:48.958506+0000","last_fullsized":"2024-09-12T02:35:48.958506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:13.920180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559907+0000","last_change":"2024-09-12T02:35:47.563938+0000","last_active":"2024-09-12T02:35:48.559907+0000","last_peered":"2024-09-12T02:35:48.559907+0000","last_clean":"2024-09-12T02:35:48.559907+0000","last_became_active":"2024-09-12T02:35:47.563607+0000","last_became_peered":"2024-09-12T02:35:47.563607+0000","last_unstale":"2024-09-12T02:35:48.559907+0000","last_undegraded":"2024-09-12T02:35:48.559907+0000","last_fullsized":"2024-09-12T02:35:48.559907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:28.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957913+0000","last_change":"2024-09-12T02:35:46.554473+0000","last_active":"2024-09-12T02:35:48.957913+0000","last_peered":"2024-09-12T02:35:48.957913+0000","last_clean":"2024-09-12T02:35:48.957913+0000","last_became_active":"2024-09-12T02:35:46.554153+0000","last_became_peered":"2024-09-12T02:35:46.554153+0000","last_unstale":"2024-09-12T02:35:48.957913+0000","last_undegraded":"2024-09-12T02:35:48.957913+0000","last_fullsized":"2024-09-12T02:35:48.957913+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:40.131878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958257+0000","last_change":"2024-09-12T02:35:47.557330+0000","last_active":"2024-09-12T02:35:48.958257+0000","last_peered":"2024-09-12T02:35:48.958257+0000","last_clean":"2024-09-12T02:35:48.958257+0000","last_became_active":"2024-09-12T02:35:47.557105+0000","last_became_peered":"2024-09-12T02:35:47.557105+0000","last_unstale":"2024-09-12T02:35:48.958257+0000","last_undegraded":"2024-09-12T02:35:48.958257+0000","last_fullsized":"2024-09-12T02:35:48.958257+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.309643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958342+0000","last_change":"2024-09-12T02:35:46.551757+0000","last_active":"2024-09-12T02:35:48.958342+0000","last_peered":"2024-09-12T02:35:48.958342+0000","last_clean":"2024-09-12T02:35:48.958342+0000","last_became_active":"2024-09-12T02:35:46.551465+0000","last_became_peered":"2024-09-12T02:35:46.551465+0000","last_unstale":"2024-09-12T02:35:48.958342+0000","last_undegraded":"2024-09-12T02:35:48.958342+0000","last_fullsized":"2024-09-12T02:35:48.958342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:59.913044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957948+0000","last_change":"2024-09-12T02:35:47.565375+0000","last_active":"2024-09-12T02:35:48.957948+0000","last_peered":"2024-09-12T02:35:48.957948+0000","last_clean":"2024-09-12T02:35:48.957948+0000","last_became_active":"2024-09-12T02:35:47.565111+0000","last_became_peered":"2024-09-12T02:35:47.565111+0000","last_unstale":"2024-09-12T02:35:48.957948+0000","last_undegraded":"2024-09-12T02:35:48.957948+0000","last_fullsized":"2024-09-12T02:35:48.957948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:35.890936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958112+0000","last_change":"2024-09-12T02:35:46.553376+0000","last_active":"2024-09-12T02:35:48.958112+0000","last_peered":"2024-09-12T02:35:48.958112+0000","last_clean":"2024-09-12T02:35:48.958112+0000","last_became_active":"2024-09-12T02:35:46.552720+0000","last_became_peered":"2024-09-12T02:35:46.552720+0000","last_unstale":"2024-09-12T02:35:48.958112+0000","last_undegraded":"2024-09-12T02:35:48.958112+0000","last_fullsized":"2024-09-12T02:35:48.958112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.187005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559920+0000","last_change":"2024-09-12T02:35:47.564398+0000","last_active":"2024-09-12T02:35:48.559920+0000","last_peered":"2024-09-12T02:35:48.559920+0000","last_clean":"2024-09-12T02:35:48.559920+0000","last_became_active":"2024-09-12T02:35:47.564149+0000","last_became_peered":"2024-09-12T02:35:47.564149+0000","last_unstale":"2024-09-12T02:35:48.559920+0000","last_undegraded":"2024-09-12T02:35:48.559920+0000","last_fullsized":"2024-09-12T02:35:48.559920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:30.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563886+0000","last_change":"2024-09-12T02:35:46.556394+0000","last_active":"2024-09-12T02:35:48.563886+0000","last_peered":"2024-09-12T02:35:48.563886+0000","last_clean":"2024-09-12T02:35:48.563886+0000","last_became_active":"2024-09-12T02:35:46.555836+0000","last_became_peered":"2024-09-12T02:35:46.555836+0000","last_unstale":"2024-09-12T02:35:48.563886+0000","last_undegraded":"2024-09-12T02:35:48.563886+0000","last_fullsized":"2024-09-12T02:35:48.563886+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:53.085764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563569+0000","last_change":"2024-09-12T02:35:47.565967+0000","last_active":"2024-09-12T02:35:48.563569+0000","last_peered":"2024-09-12T02:35:48.563569+0000","last_clean":"2024-09-12T02:35:48.563569+0000","last_became_active":"2024-09-12T02:35:47.565712+0000","last_became_peered":"2024-09-12T02:35:47.565712+0000","last_unstale":"2024-09-12T02:35:48.563569+0000","last_undegraded":"2024-09-12T02:35:48.563569+0000","last_fullsized":"2024-09-12T02:35:48.563569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958027+0000","last_change":"2024-09-12T02:35:46.557610+0000","last_active":"2024-09-12T02:35:48.958027+0000","last_peered":"2024-09-12T02:35:48.958027+0000","last_clean":"2024-09-12T02:35:48.958027+0000","last_became_active":"2024-09-12T02:35:46.557342+0000","last_became_peered":"2024-09-12T02:35:46.557342+0000","last_unstale":"2024-09-12T02:35:48.958027+0000","last_undegraded":"2024-09-12T02:35:48.958027+0000","last_fullsized":"2024-09-12T02:35:48.958027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:30.518562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.564247+0000","last_change":"2024-09-12T02:35:47.554450+0000","last_active":"2024-09-12T02:35:48.564247+0000","last_peered":"2024-09-12T02:35:48.564247+0000","last_clean":"2024-09-12T02:35:48.564247+0000","last_became_active":"2024-09-12T02:35:47.553796+0000","last_became_peered":"2024-09-12T02:35:47.553796+0000","last_unstale":"2024-09-12T02:35:48.564247+0000","last_undegraded":"2024-09-12T02:35:48.564247+0000","last_fullsized":"2024-09-12T02:35:48.564247+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:38.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958700+0000","last_change":"2024-09-12T02:35:46.554498+0000","last_active":"2024-09-12T02:35:48.958700+0000","last_peered":"2024-09-12T02:35:48.958700+0000","last_clean":"2024-09-12T02:35:48.958700+0000","last_became_active":"2024-09-12T02:35:46.553952+0000","last_became_peered":"2024-09-12T02:35:46.553952+0000","last_unstale":"2024-09-12T02:35:48.958700+0000","last_undegraded":"2024-09-12T02:35:48.958700+0000","last_fullsized":"2024-09-12T02:35:48.958700+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:48.420754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709399+0000","last_change":"2024-09-12T02:35:47.556763+0000","last_active":"2024-09-12T02:35:48.709399+0000","last_peered":"2024-09-12T02:35:48.709399+0000","last_clean":"2024-09-12T02:35:48.709399+0000","last_became_active":"2024-09-12T02:35:47.556518+0000","last_became_peered":"2024-09-12T02:35:47.556518+0000","last_unstale":"2024-09-12T02:35:48.709399+0000","last_undegraded":"2024-09-12T02:35:48.709399+0000","last_fullsized":"2024-09-12T02:35:48.709399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:12.527546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958371+0000","last_change":"2024-09-12T02:35:46.554380+0000","last_active":"2024-09-12T02:35:48.958371+0000","last_peered":"2024-09-12T02:35:48.958371+0000","last_clean":"2024-09-12T02:35:48.958371+0000","last_became_active":"2024-09-12T02:35:46.554101+0000","last_became_peered":"2024-09-12T02:35:46.554101+0000","last_unstale":"2024-09-12T02:35:48.958371+0000","last_undegraded":"2024-09-12T02:35:48.958371+0000","last_fullsized":"2024-09-12T02:35:48.958371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:17.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958199+0000","last_change":"2024-09-12T02:35:47.564388+0000","last_active":"2024-09-12T02:35:48.958199+0000","last_peered":"2024-09-12T02:35:48.958199+0000","last_clean":"2024-09-12T02:35:48.958199+0000","last_became_active":"2024-09-12T02:35:47.564109+0000","last_became_peered":"2024-09-12T02:35:47.564109+0000","last_unstale":"2024-09-12T02:35:48.958199+0000","last_undegraded":"2024-09-12T02:35:48.958199+0000","last_fullsized":"2024-09-12T02:35:48.958199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:31.526030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709459+0000","last_change":"2024-09-12T02:35:46.557363+0000","last_active":"2024-09-12T02:35:48.709459+0000","last_peered":"2024-09-12T02:35:48.709459+0000","last_clean":"2024-09-12T02:35:48.709459+0000","last_became_active":"2024-09-12T02:35:46.557054+0000","last_became_peered":"2024-09-12T02:35:46.557054+0000","last_unstale":"2024-09-12T02:35:48.709459+0000","last_undegraded":"2024-09-12T02:35:48.709459+0000","last_fullsized":"2024-09-12T02:35:48.709459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709239+0000","last_change":"2024-09-12T02:35:47.566332+0000","last_active":"2024-09-12T02:35:48.709239+0000","last_peered":"2024-09-12T02:35:48.709239+0000","last_clean":"2024-09-12T02:35:48.709239+0000","last_became_active":"2024-09-12T02:35:47.565922+0000","last_became_peered":"2024-09-12T02:35:47.565922+0000","last_unstale":"2024-09-12T02:35:48.709239+0000","last_undegraded":"2024-09-12T02:35:48.709239+0000","last_fullsized":"2024-09-12T02:35:48.709239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:30.950883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.709169+0000","last_change":"2024-09-12T02:35:46.560646+0000","last_active":"2024-09-12T02:35:48.709169+0000","last_peered":"2024-09-12T02:35:48.709169+0000","last_clean":"2024-09-12T02:35:48.709169+0000","last_became_active":"2024-09-12T02:35:46.560281+0000","last_became_peered":"2024-09-12T02:35:46.560281+0000","last_unstale":"2024-09-12T02:35:48.709169+0000","last_undegraded":"2024-09-12T02:35:48.709169+0000","last_fullsized":"2024-09-12T02:35:48.709169+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:47.590939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958161+0000","last_change":"2024-09-12T02:35:47.561258+0000","last_active":"2024-09-12T02:35:48.958161+0000","last_peered":"2024-09-12T02:35:48.958161+0000","last_clean":"2024-09-12T02:35:48.958161+0000","last_became_active":"2024-09-12T02:35:47.560964+0000","last_became_peered":"2024-09-12T02:35:47.560964+0000","last_unstale":"2024-09-12T02:35:48.958161+0000","last_undegraded":"2024-09-12T02:35:48.958161+0000","last_fullsized":"2024-09-12T02:35:48.958161+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:49.428222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.957708+0000","last_change":"2024-09-12T02:35:46.552700+0000","last_active":"2024-09-12T02:35:48.957708+0000","last_peered":"2024-09-12T02:35:48.957708+0000","last_clean":"2024-09-12T02:35:48.957708+0000","last_became_active":"2024-09-12T02:35:46.552416+0000","last_became_peered":"2024-09-12T02:35:46.552416+0000","last_unstale":"2024-09-12T02:35:48.957708+0000","last_undegraded":"2024-09-12T02:35:48.957708+0000","last_fullsized":"2024-09-12T02:35:48.957708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:12.639310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.564173+0000","last_change":"2024-09-12T02:35:47.564929+0000","last_active":"2024-09-12T02:35:48.564173+0000","last_peered":"2024-09-12T02:35:48.564173+0000","last_clean":"2024-09-12T02:35:48.564173+0000","last_became_active":"2024-09-12T02:35:47.564632+0000","last_became_peered":"2024-09-12T02:35:47.564632+0000","last_unstale":"2024-09-12T02:35:48.564173+0000","last_undegraded":"2024-09-12T02:35:48.564173+0000","last_fullsized":"2024-09-12T02:35:48.564173+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:37.750492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958184+0000","last_change":"2024-09-12T02:35:46.550057+0000","last_active":"2024-09-12T02:35:48.958184+0000","last_peered":"2024-09-12T02:35:48.958184+0000","last_clean":"2024-09-12T02:35:48.958184+0000","last_became_active":"2024-09-12T02:35:46.549620+0000","last_became_peered":"2024-09-12T02:35:46.549620+0000","last_unstale":"2024-09-12T02:35:48.958184+0000","last_undegraded":"2024-09-12T02:35:48.958184+0000","last_fullsized":"2024-09-12T02:35:48.958184+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:08.703290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.560080+0000","last_change":"2024-09-12T02:35:47.570041+0000","last_active":"2024-09-12T02:35:48.560080+0000","last_peered":"2024-09-12T02:35:48.560080+0000","last_clean":"2024-09-12T02:35:48.560080+0000","last_became_active":"2024-09-12T02:35:47.569745+0000","last_became_peered":"2024-09-12T02:35:47.569745+0000","last_unstale":"2024-09-12T02:35:48.560080+0000","last_undegraded":"2024-09-12T02:35:48.560080+0000","last_fullsized":"2024-09-12T02:35:48.560080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:59.641585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"87'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958815+0000","last_change":"2024-09-12T02:35:46.556974+0000","last_active":"2024-09-12T02:35:48.958815+0000","last_peered":"2024-09-12T02:35:48.958815+0000","last_clean":"2024-09-12T02:35:48.958815+0000","last_became_active":"2024-09-12T02:35:46.556679+0000","last_became_peered":"2024-09-12T02:35:46.556679+0000","last_unstale":"2024-09-12T02:35:48.958815+0000","last_undegraded":"2024-09-12T02:35:48.958815+0000","last_fullsized":"2024-09-12T02:35:48.958815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:04.764613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562840+0000","last_change":"2024-09-12T02:35:47.562760+0000","last_active":"2024-09-12T02:35:48.562840+0000","last_peered":"2024-09-12T02:35:48.562840+0000","last_clean":"2024-09-12T02:35:48.562840+0000","last_became_active":"2024-09-12T02:35:47.562486+0000","last_became_peered":"2024-09-12T02:35:47.562486+0000","last_unstale":"2024-09-12T02:35:48.562840+0000","last_undegraded":"2024-09-12T02:35:48.562840+0000","last_fullsized":"2024-09-12T02:35:48.562840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:49.428222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562997+0000","last_change":"2024-09-12T02:35:46.560913+0000","last_active":"2024-09-12T02:35:48.562997+0000","last_peered":"2024-09-12T02:35:48.562997+0000","last_clean":"2024-09-12T02:35:48.562997+0000","last_became_active":"2024-09-12T02:35:46.560622+0000","last_became_peered":"2024-09-12T02:35:46.560622+0000","last_unstale":"2024-09-12T02:35:48.562997+0000","last_undegraded":"2024-09-12T02:35:48.562997+0000","last_fullsized":"2024-09-12T02:35:48.562997+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.269933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.564363+0000","last_change":"2024-09-12T02:35:47.552179+0000","last_active":"2024-09-12T02:35:48.564363+0000","last_peered":"2024-09-12T02:35:48.564363+0000","last_clean":"2024-09-12T02:35:48.564363+0000","last_became_active":"2024-09-12T02:35:47.551519+0000","last_became_peered":"2024-09-12T02:35:47.551519+0000","last_unstale":"2024-09-12T02:35:48.564363+0000","last_undegraded":"2024-09-12T02:35:48.564363+0000","last_fullsized":"2024-09-12T02:35:48.564363+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:40.232938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562806+0000","last_change":"2024-09-12T02:35:46.556235+0000","last_active":"2024-09-12T02:35:48.562806+0000","last_peered":"2024-09-12T02:35:48.562806+0000","last_clean":"2024-09-12T02:35:48.562806+0000","last_became_active":"2024-09-12T02:35:46.555843+0000","last_became_peered":"2024-09-12T02:35:46.555843+0000","last_unstale":"2024-09-12T02:35:48.562806+0000","last_undegraded":"2024-09-12T02:35:48.562806+0000","last_fullsized":"2024-09-12T02:35:48.562806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:42.840211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958201+0000","last_change":"2024-09-12T02:35:47.562441+0000","last_active":"2024-09-12T02:35:48.958201+0000","last_peered":"2024-09-12T02:35:48.958201+0000","last_clean":"2024-09-12T02:35:48.958201+0000","last_became_active":"2024-09-12T02:35:47.562116+0000","last_became_peered":"2024-09-12T02:35:47.562116+0000","last_unstale":"2024-09-12T02:35:48.958201+0000","last_undegraded":"2024-09-12T02:35:48.958201+0000","last_fullsized":"2024-09-12T02:35:48.958201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:37.750492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958434+0000","last_change":"2024-09-12T02:35:46.554033+0000","last_active":"2024-09-12T02:35:48.958434+0000","last_peered":"2024-09-12T02:35:48.958434+0000","last_clean":"2024-09-12T02:35:48.958434+0000","last_became_active":"2024-09-12T02:35:46.553741+0000","last_became_peered":"2024-09-12T02:35:46.553741+0000","last_unstale":"2024-09-12T02:35:48.958434+0000","last_undegraded":"2024-09-12T02:35:48.958434+0000","last_fullsized":"2024-09-12T02:35:48.958434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.958345+0000","last_change":"2024-09-12T02:35:47.552427+0000","last_active":"2024-09-12T02:35:48.958345+0000","last_peered":"2024-09-12T02:35:48.958345+0000","last_clean":"2024-09-12T02:35:48.958345+0000","last_became_active":"2024-09-12T02:35:47.552172+0000","last_became_peered":"2024-09-12T02:35:47.552172+0000","last_unstale":"2024-09-12T02:35:48.958345+0000","last_undegraded":"2024-09-12T02:35:48.958345+0000","last_fullsized":"2024-09-12T02:35:48.958345+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:22.044876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563232+0000","last_change":"2024-09-12T02:35:46.557520+0000","last_active":"2024-09-12T02:35:48.563232+0000","last_peered":"2024-09-12T02:35:48.563232+0000","last_clean":"2024-09-12T02:35:48.563232+0000","last_became_active":"2024-09-12T02:35:46.557248+0000","last_became_peered":"2024-09-12T02:35:46.557248+0000","last_unstale":"2024-09-12T02:35:48.563232+0000","last_undegraded":"2024-09-12T02:35:48.563232+0000","last_fullsized":"2024-09-12T02:35:48.563232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:19.917775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559646+0000","last_change":"2024-09-12T02:35:47.568444+0000","last_active":"2024-09-12T02:35:48.559646+0000","last_peered":"2024-09-12T02:35:48.559646+0000","last_clean":"2024-09-12T02:35:48.559646+0000","last_became_active":"2024-09-12T02:35:47.568168+0000","last_became_peered":"2024-09-12T02:35:47.568168+0000","last_unstale":"2024-09-12T02:35:48.559646+0000","last_undegraded":"2024-09-12T02:35:48.559646+0000","last_fullsized":"2024-09-12T02:35:48.559646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:22.044876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562693+0000","last_change":"2024-09-12T02:35:46.556913+0000","last_active":"2024-09-12T02:35:48.562693+0000","last_peered":"2024-09-12T02:35:48.562693+0000","last_clean":"2024-09-12T02:35:48.562693+0000","last_became_active":"2024-09-12T02:35:46.555900+0000","last_became_peered":"2024-09-12T02:35:46.555900+0000","last_unstale":"2024-09-12T02:35:48.562693+0000","last_undegraded":"2024-09-12T02:35:48.562693+0000","last_fullsized":"2024-09-12T02:35:48.562693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:26.550563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.562580+0000","last_change":"2024-09-12T02:35:47.562581+0000","last_active":"2024-09-12T02:35:48.562580+0000","last_peered":"2024-09-12T02:35:48.562580+0000","last_clean":"2024-09-12T02:35:48.562580+0000","last_became_active":"2024-09-12T02:35:47.562297+0000","last_became_peered":"2024-09-12T02:35:47.562297+0000","last_unstale":"2024-09-12T02:35:48.562580+0000","last_undegraded":"2024-09-12T02:35:48.562580+0000","last_fullsized":"2024-09-12T02:35:48.562580+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:27.277743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.563115+0000","last_change":"2024-09-12T02:35:46.551656+0000","last_active":"2024-09-12T02:35:48.563115+0000","last_peered":"2024-09-12T02:35:48.563115+0000","last_clean":"2024-09-12T02:35:48.563115+0000","last_became_active":"2024-09-12T02:35:46.551361+0000","last_became_peered":"2024-09-12T02:35:46.551361+0000","last_unstale":"2024-09-12T02:35:48.563115+0000","last_undegraded":"2024-09-12T02:35:48.563115+0000","last_fullsized":"2024-09-12T02:35:48.563115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.772752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.959208+0000","last_change":"2024-09-12T02:35:47.568904+0000","last_active":"2024-09-12T02:35:48.959208+0000","last_peered":"2024-09-12T02:35:48.959208+0000","last_clean":"2024-09-12T02:35:48.959208+0000","last_became_active":"2024-09-12T02:35:47.568611+0000","last_became_peered":"2024-09-12T02:35:47.568611+0000","last_unstale":"2024-09-12T02:35:48.959208+0000","last_undegraded":"2024-09-12T02:35:48.959208+0000","last_fullsized":"2024-09-12T02:35:48.959208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:46.534099+0000","last_clean_scrub_stamp":"2024-09-12T02:35:46.534099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:41.780221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.560073+0000","last_change":"2024-09-12T02:35:46.550127+0000","last_active":"2024-09-12T02:35:48.560073+0000","last_peered":"2024-09-12T02:35:48.560073+0000","last_clean":"2024-09-12T02:35:48.560073+0000","last_became_active":"2024-09-12T02:35:46.548956+0000","last_became_peered":"2024-09-12T02:35:46.548956+0000","last_unstale":"2024-09-12T02:35:48.560073+0000","last_undegraded":"2024-09-12T02:35:48.560073+0000","last_fullsized":"2024-09-12T02:35:48.560073+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:45.526631+0000","last_clean_scrub_stamp":"2024-09-12T02:35:45.526631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:49.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":296,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.559786+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:35:48.559786+0000","last_peered":"2024-09-12T02:35:48.559786+0000","last_clean":"2024-09-12T02:35:48.559786+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:35:48.559786+0000","last_undegraded":"2024-09-12T02:35:48.559786+0000","last_fullsized":"2024-09-12T02:35:48.559786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1658880,"data_stored":1045880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509535,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":456136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509535,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":457076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509535,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46120,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325720,"statfs":{"total":96636764160,"available":96589537280,"internally_reserved":0,"allocated":1060864,"data_stored":455442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":455636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509536,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41128,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330712,"statfs":{"total":96636764160,"available":96594649088,"internally_reserved":0,"allocated":1658880,"data_stored":1045844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542240,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1073152,"data_stored":457054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542239,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1064960,"data_stored":456024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:35:55.173 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:35:55.173 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:35:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.314+0000 7f4d1919f640 1 Processor -- start 2024-09-12T02:35:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.314+0000 7f4d1919f640 1 -- start start 2024-09-12T02:35:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1919f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140d1df0 0x7f4d1415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1919f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d1415d560 0x7f4d140b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1919f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d14160630 con 0x7f4d140b6ff0 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1919f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4d14160910 con 0x7f4d1415d560 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1919f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d14160bf0 con 0x7f4d140d1df0 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1359e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d1415d560 0x7f4d140b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d12d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4d140b6ff0 0x7f4d1415fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47210/0 (socket says 172.21.15.181:47210) 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d12d9d640 1 -- 172.21.15.181:0/2499813750 learned_addr learned my addr 172.21.15.181:0/2499813750 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1359e640 1 --2- 172.21.15.181:0/2499813750 >> v2:172.21.15.181:3300/0 conn(0x7f4d1415d560 0x7f4d140b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33244/0 (socket says 172.21.15.181:33244) 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d0a59c640 1 --2- 172.21.15.181:0/2499813750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140d1df0 0x7f4d1415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1359e640 1 -- 172.21.15.181:0/2499813750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140d1df0 msgr2=0x7f4d1415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1359e640 1 --2- 172.21.15.181:0/2499813750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140d1df0 0x7f4d1415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1359e640 1 -- 172.21.15.181:0/2499813750 >> v1:172.21.15.181:6789/0 conn(0x7f4d140b6ff0 legacy=0x7f4d1415fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1259c640 1 -- 172.21.15.181:0/2499813750 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687935174 0 0) 0x7f4d14160630 con 0x7f4d140b6ff0 2024-09-12T02:35:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.315+0000 7f4d1359e640 1 -- 172.21.15.181:0/2499813750 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1415cb00 con 0x7f4d1415d560 2024-09-12T02:35:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1359e640 1 --2- 172.21.15.181:0/2499813750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1415d560 0x7f4d140b5400 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009d90 tx=0x7f4d0c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4088993c8e0f495 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1259c640 1 -- 172.21.15.181:0/2499813750 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c007740 con 0x7f4d1415d560 2024-09-12T02:35:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1259c640 1 -- 172.21.15.181:0/2499813750 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0078e0 con 0x7f4d1415d560 2024-09-12T02:35:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1259c640 1 -- 172.21.15.181:0/2499813750 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c007cb0 con 0x7f4d1415d560 2024-09-12T02:35:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 -- 172.21.15.181:0/2499813750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1415d560 msgr2=0x7f4d140b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 --2- 172.21.15.181:0/2499813750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1415d560 0x7f4d140b5400 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009d90 tx=0x7f4d0c02a660 comp rx=0 tx=0).stop 2024-09-12T02:35:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 -- 172.21.15.181:0/2499813750 shutdown_connections 2024-09-12T02:35:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 --2- 172.21.15.181:0/2499813750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1415d560 0x7f4d140b5400 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 --2- 172.21.15.181:0/2499813750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140d1df0 0x7f4d1415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 -- 172.21.15.181:0/2499813750 >> 172.21.15.181:0/2499813750 conn(0x7f4d14068220 msgr2=0x7f4d140b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 -- 172.21.15.181:0/2499813750 shutdown_connections 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.316+0000 7f4d1919f640 1 -- 172.21.15.181:0/2499813750 wait complete. 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.318+0000 7f4d1919f640 1 Processor -- start 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.318+0000 7f4d1919f640 1 -- start start 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140b6ff0 0x7f4d140b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d140d1df0 0x7f4d140b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d1415d560 0x7f4d140cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d140b7550 con 0x7f4d140d1df0 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4d140b73d0 con 0x7f4d1415d560 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d140b5940 con 0x7f4d140b6ff0 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d140d1df0 0x7f4d140b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d140d1df0 0x7f4d140b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33254/0 (socket says 172.21.15.181:33254) 2024-09-12T02:35:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 -- 172.21.15.181:0/993624174 learned_addr learned my addr 172.21.15.181:0/993624174 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d12d9d640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140b6ff0 0x7f4d140b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1359e640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d1415d560 0x7f4d140cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 -- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140b6ff0 msgr2=0x7f4d140b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140b6ff0 0x7f4d140b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 -- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d1415d560 msgr2=0x7f4d140cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d1415d560 0x7f4d140cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 -- 172.21.15.181:0/993624174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d140b3270 con 0x7f4d140d1df0 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d12d9d640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140b6ff0 0x7f4d140b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0a59c640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d140d1df0 0x7f4d140b2bb0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00c820 tx=0x7f4cfc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0bfff640 1 -- 172.21.15.181:0/993624174 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc015070 con 0x7f4d140d1df0 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0bfff640 1 -- 172.21.15.181:0/993624174 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc004240 con 0x7f4d140d1df0 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d140b3550 con 0x7f4d140d1df0 2024-09-12T02:35:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d0bfff640 1 -- 172.21.15.181:0/993624174 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00ce10 con 0x7f4d140d1df0 2024-09-12T02:35:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.319+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d140cd330 con 0x7f4d140d1df0 2024-09-12T02:35:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.320+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d140b5cf0 con 0x7f4d140d1df0 2024-09-12T02:35:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.321+0000 7f4d0bfff640 1 -- 172.21.15.181:0/993624174 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cfc007830 con 0x7f4d140d1df0 2024-09-12T02:35:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.321+0000 7f4d0bfff640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cf406be30 0x7f4cf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.322+0000 7f4d12d9d640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cf406be30 0x7f4cf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.322+0000 7f4d0bfff640 1 -- 172.21.15.181:0/993624174 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f4cfc08ad40 con 0x7f4d140d1df0 2024-09-12T02:35:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.322+0000 7f4d12d9d640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cf406be30 0x7f4cf406e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000f60 tx=0x7f4d04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.326+0000 7f4d0bfff640 1 -- 172.21.15.181:0/993624174 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cfc059700 con 0x7f4d140d1df0 2024-09-12T02:35:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.552+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4d140b3720 con 0x7f4d140d1df0 2024-09-12T02:35:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.554+0000 7f4d0bfff640 1 -- 172.21.15.181:0/993624174 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f4cfc059000 con 0x7f4d140d1df0 2024-09-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCGUeJmG2CmFxAA2G5Svsg2SWta3Ui1Y6Flsg== 2024-09-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi181.stdout: caps mds = "allow" 2024-09-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi181.stdout: caps mon = "allow r" 2024-09-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi181.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:updated caps for client.0 2024-09-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cf406be30 msgr2=0x7f4cf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cf406be30 0x7f4cf406e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000f60 tx=0x7f4d04009040 comp rx=0 tx=0).stop 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d140d1df0 msgr2=0x7f4d140b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d140d1df0 0x7f4d140b2bb0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00c820 tx=0x7f4cfc00cce0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 shutdown_connections 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f4cf406be30 0x7f4cf406e2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d1415d560 0x7f4d140cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d140d1df0 0x7f4d140b2bb0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 --2- 172.21.15.181:0/993624174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d140b6ff0 0x7f4d140b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 >> 172.21.15.181:0/993624174 conn(0x7f4d14068220 msgr2=0x7f4d14073980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 shutdown_connections 2024-09-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.556+0000 7f4d1919f640 1 -- 172.21.15.181:0/993624174 wait complete. 2024-09-12T02:35:55.569 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:55.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.665+0000 7f8decd33640 1 Processor -- start 2024-09-12T02:35:55.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.665+0000 7f8decd33640 1 -- start start 2024-09-12T02:35:55.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8decd33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815c4a0 0x7f8de80cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8decd33640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8de80d2da0 0x7f8de815c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8decd33640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de80d0a30 con 0x7f8de80b4090 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8decd33640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8de80d0d30 con 0x7f8de80d2da0 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8decd33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8de80b76f0 con 0x7f8de815c4a0 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8dddd9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8de80d2da0 0x7f8de815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8dddd9b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8de80d2da0 0x7f8de815c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33260/0 (socket says 172.21.15.181:33260) 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.666+0000 7f8dddd9b640 1 -- 172.21.15.181:0/529701860 learned_addr learned my addr 172.21.15.181:0/529701860 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.667+0000 7f8de659c640 1 --2- 172.21.15.181:0/529701860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815c4a0 0x7f8de80cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.667+0000 7f8dddd9b640 1 -- 172.21.15.181:0/529701860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815c4a0 msgr2=0x7f8de80cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.667+0000 7f8dddd9b640 1 --2- 172.21.15.181:0/529701860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815c4a0 0x7f8de80cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.667+0000 7f8dddd9b640 1 -- 172.21.15.181:0/529701860 >> v1:172.21.15.204:6789/0 conn(0x7f8de80b4090 legacy=0x7f8de8165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.667+0000 7f8dddd9b640 1 -- 172.21.15.181:0/529701860 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de8073710 con 0x7f8de80d2da0 2024-09-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.667+0000 7f8dddd9b640 1 --2- 172.21.15.181:0/529701860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de80d2da0 0x7f8de815c880 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009870 tx=0x7f8dd002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f11d0a698ee33fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.667+0000 7f8de5d9b640 1 -- 172.21.15.181:0/529701860 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0037070 con 0x7f8de80d2da0 2024-09-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8de5d9b640 1 -- 172.21.15.181:0/529701860 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd0032440 con 0x7f8de80d2da0 2024-09-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8de5d9b640 1 -- 172.21.15.181:0/529701860 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0032810 con 0x7f8de80d2da0 2024-09-12T02:35:55.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 -- 172.21.15.181:0/529701860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de80d2da0 msgr2=0x7f8de815c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 --2- 172.21.15.181:0/529701860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de80d2da0 0x7f8de815c880 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009870 tx=0x7f8dd002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 -- 172.21.15.181:0/529701860 shutdown_connections 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 --2- 172.21.15.181:0/529701860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de80d2da0 0x7f8de815c880 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 --2- 172.21.15.181:0/529701860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de815c4a0 0x7f8de80cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 -- 172.21.15.181:0/529701860 >> 172.21.15.181:0/529701860 conn(0x7f8de8067950 msgr2=0x7f8de8067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 -- 172.21.15.181:0/529701860 shutdown_connections 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.668+0000 7f8decd33640 1 -- 172.21.15.181:0/529701860 wait complete. 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 Processor -- start 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 -- start start 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de80b4090 0x7f8de81e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de80d2da0 0x7f8de81f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de815c4a0 0x7f8de81f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8de80b4540 con 0x7f8de815c4a0 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8de80d28e0 con 0x7f8de80b4090 2024-09-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8decd33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8de80b46c0 con 0x7f8de80d2da0 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de815c4a0 0x7f8de81f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8de6d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de815c4a0 0x7f8de81f4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33266/0 (socket says 172.21.15.181:33266) 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8de6d9d640 1 -- 172.21.15.181:0/2847117550 learned_addr learned my addr 172.21.15.181:0/2847117550 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.670+0000 7f8de659c640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de80b4090 0x7f8de81e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8dddd9b640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de80d2da0 0x7f8de81f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8de6d9d640 1 -- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de80d2da0 msgr2=0x7f8de81f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8de6d9d640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de80d2da0 0x7f8de81f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8de6d9d640 1 -- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de80b4090 msgr2=0x7f8de81e59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8de6d9d640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de80b4090 0x7f8de81e59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8de6d9d640 1 -- 172.21.15.181:0/2847117550 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de81e5f80 con 0x7f8de815c4a0 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8de6d9d640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de815c4a0 0x7f8de81f4ac0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8de000c7a0 tx=0x7f8de000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8ddf7fe640 1 -- 172.21.15.181:0/2847117550 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0003b70 con 0x7f8de815c4a0 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8ddf7fe640 1 -- 172.21.15.181:0/2847117550 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de0003d30 con 0x7f8de815c4a0 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8ddf7fe640 1 -- 172.21.15.181:0/2847117550 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de000aa90 con 0x7f8de815c4a0 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de81e6260 con 0x7f8de815c4a0 2024-09-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.671+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de81e6820 con 0x7f8de815c4a0 2024-09-12T02:35:55.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.672+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de80cff80 con 0x7f8de815c4a0 2024-09-12T02:35:55.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.673+0000 7f8ddf7fe640 1 -- 172.21.15.181:0/2847117550 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8de000ac30 con 0x7f8de815c4a0 2024-09-12T02:35:55.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.673+0000 7f8ddf7fe640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dc806be30 0x7f8dc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.673+0000 7f8ddf7fe640 1 -- 172.21.15.181:0/2847117550 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f8de008ad10 con 0x7f8de815c4a0 2024-09-12T02:35:55.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.673+0000 7f8de659c640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dc806be30 0x7f8dc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.673+0000 7f8de659c640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dc806be30 0x7f8dc806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80079a0 tx=0x7f8dd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.677+0000 7f8ddf7fe640 1 -- 172.21.15.181:0/2847117550 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8de0090020 con 0x7f8de815c4a0 2024-09-12T02:35:55.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.877+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8de80b6c00 con 0x7f8de815c4a0 2024-09-12T02:35:55.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.877+0000 7f8ddf7fe640 1 -- 172.21.15.181:0/2847117550 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7f8de0058fd0 con 0x7f8de815c4a0 2024-09-12T02:35:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:55.878 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":69,"btime":"2024-09-12T02:35:49:556212+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4144308809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4144308809},{"type":"v1","addr":"172.21.15.204:6834","nonce":4144308809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6676,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/73375387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":73375387},{"type":"v1","addr":"172.21.15.181:6837","nonce":73375387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3782132497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3782132497},{"type":"v1","addr":"172.21.15.181:6836","nonce":3782132497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:46.889359+0000","modified":"2024-09-12T02:35:48.892202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/3487360283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3487360283},{"type":"v1","addr":"172.21.15.204:6835","nonce":3487360283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":6}]} 2024-09-12T02:35:55.879 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 69 2024-09-12T02:35:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dc806be30 msgr2=0x7f8dc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dc806be30 0x7f8dc806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80079a0 tx=0x7f8dd8008040 comp rx=0 tx=0).stop 2024-09-12T02:35:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de815c4a0 msgr2=0x7f8de81f4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de815c4a0 0x7f8de81f4ac0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8de000c7a0 tx=0x7f8de000cc60 comp rx=0 tx=0).stop 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 shutdown_connections 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8dc806be30 0x7f8dc806e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8de815c4a0 0x7f8de81f4ac0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8de80d2da0 0x7f8de81f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 --2- 172.21.15.181:0/2847117550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8de80b4090 0x7f8de81e59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 >> 172.21.15.181:0/2847117550 conn(0x7f8de8067950 msgr2=0x7f8de8159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 shutdown_connections 2024-09-12T02:35:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:55.879+0000 7f8decd33640 1 -- 172.21.15.181:0/2847117550 wait complete. 2024-09-12T02:35:56.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:35:46.889359+0000', 'modified': '2024-09-12T02:35:48.892202+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7257': {'gid': 7257, 'name': 'd', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6835/3487360283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6832', 'nonce': 3487360283}, {'type': 'v1', 'addr': '172.21.15.204:6835', 'nonce': 3487360283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7257, 'qdb_cluster': [7257]} 2024-09-12T02:35:56.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:35:56.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:35:56.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.399+0000 7f793b3f1640 1 Processor -- start 2024-09-12T02:35:56.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.399+0000 7f793b3f1640 1 -- start start 2024-09-12T02:35:56.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793b3f1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f793415b2e0 0x7f79340b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793b3f1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79340cdfc0 0x7f79340b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793b3f1640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79340ce4f0 con 0x7f79340b22c0 2024-09-12T02:35:56.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793b3f1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f793415b6c0 con 0x7f79340cdfc0 2024-09-12T02:35:56.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793b3f1640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f79340ce7d0 con 0x7f793415b2e0 2024-09-12T02:35:56.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793898c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79340cdfc0 0x7f79340b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793898c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79340cdfc0 0x7f79340b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33272/0 (socket says 172.21.15.181:33272) 2024-09-12T02:35:56.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793898c640 1 -- 172.21.15.181:0/1871283251 learned_addr learned my addr 172.21.15.181:0/1871283251 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793898c640 1 -- 172.21.15.181:0/1871283251 >> v2:172.21.15.204:3300/0 conn(0x7f793415b2e0 msgr2=0x7f79340b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793898c640 1 --2- 172.21.15.181:0/1871283251 >> v2:172.21.15.204:3300/0 conn(0x7f793415b2e0 0x7f79340b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793898c640 1 -- 172.21.15.181:0/1871283251 >> v1:172.21.15.204:6789/0 conn(0x7f79340b22c0 legacy=0x7f79340ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.400+0000 7f793898c640 1 -- 172.21.15.181:0/1871283251 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79340ceab0 con 0x7f79340cdfc0 2024-09-12T02:35:56.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.401+0000 7f793898c640 1 --2- 172.21.15.181:0/1871283251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f79340b1d80 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7934069550 tx=0x7f792402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3c72a358259c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.401+0000 7f792bfff640 1 -- 172.21.15.181:0/1871283251 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924037070 con 0x7f79340cdfc0 2024-09-12T02:35:56.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.401+0000 7f792bfff640 1 -- 172.21.15.181:0/1871283251 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7924032440 con 0x7f79340cdfc0 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.401+0000 7f792bfff640 1 -- 172.21.15.181:0/1871283251 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924032810 con 0x7f79340cdfc0 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 -- 172.21.15.181:0/1871283251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 msgr2=0x7f79340b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 --2- 172.21.15.181:0/1871283251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f79340b1d80 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7934069550 tx=0x7f792402a230 comp rx=0 tx=0).stop 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 -- 172.21.15.181:0/1871283251 shutdown_connections 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 --2- 172.21.15.181:0/1871283251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f79340b1d80 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 --2- 172.21.15.181:0/1871283251 >> v2:172.21.15.204:3300/0 conn(0x7f793415b2e0 0x7f79340b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 -- 172.21.15.181:0/1871283251 >> 172.21.15.181:0/1871283251 conn(0x7f793406bc10 msgr2=0x7f793406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 -- 172.21.15.181:0/1871283251 shutdown_connections 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.402+0000 7f793b3f1640 1 -- 172.21.15.181:0/1871283251 wait complete. 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.403+0000 7f793b3f1640 1 Processor -- start 2024-09-12T02:35:56.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.403+0000 7f793b3f1640 1 -- start start 2024-09-12T02:35:56.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.403+0000 7f793b3f1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79340b22c0 0x7f79340d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793b3f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f793414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793b3f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f793415b2e0 0x7f793415da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793b3f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f79340712b0 con 0x7f79340cdfc0 2024-09-12T02:35:56.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793b3f1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7934071130 con 0x7f79340b22c0 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793b3f1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f79340b4260 con 0x7f793415b2e0 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f793414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f793414c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33280/0 (socket says 172.21.15.181:33280) 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 -- 172.21.15.181:0/2746231274 learned_addr learned my addr 172.21.15.181:0/2746231274 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793918d640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79340b22c0 0x7f79340d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793998e640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f793415b2e0 0x7f793415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 -- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f793415b2e0 msgr2=0x7f793415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f793415b2e0 0x7f793415da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 -- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79340b22c0 msgr2=0x7f79340d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79340b22c0 0x7f79340d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 -- 172.21.15.181:0/2746231274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7934151b30 con 0x7f79340cdfc0 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793998e640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f793415b2e0 0x7f793415da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:56.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793898c640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f793414c080 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7924000c00 tx=0x7f79240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f7929ffb640 1 -- 172.21.15.181:0/2746231274 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924041070 con 0x7f79340cdfc0 2024-09-12T02:35:56.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f7929ffb640 1 -- 172.21.15.181:0/2746231274 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792403c870 con 0x7f79340cdfc0 2024-09-12T02:35:56.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f7929ffb640 1 -- 172.21.15.181:0/2746231274 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924037040 con 0x7f79340cdfc0 2024-09-12T02:35:56.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.404+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7934151e10 con 0x7f79340cdfc0 2024-09-12T02:35:56.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.405+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341523d0 con 0x7f79340cdfc0 2024-09-12T02:35:56.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.406+0000 7f7929ffb640 1 -- 172.21.15.181:0/2746231274 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7924044070 con 0x7f79340cdfc0 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.407+0000 7f7929ffb640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f791806be30 0x7f791806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.407+0000 7f793918d640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f791806be30 0x7f791806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.407+0000 7f7929ffb640 1 -- 172.21.15.181:0/2746231274 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f79240abc60 con 0x7f79340cdfc0 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.407+0000 7f793918d640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f791806be30 0x7f791806e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f793000b810 tx=0x7f7930008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 Processor -- start 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 -- start start 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6bf2c0 0x55852e704a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bca80 0x55852e6bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55852e621520 con 0x55852e6bca80 2024-09-12T02:35:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55852e5c93e0 con 0x55852e6bf2c0 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.408+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55852e61d4e0 con 0x55852e6c0a50 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bca80 0x55852e6bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bca80 0x55852e6bf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33288/0 (socket says 172.21.15.181:33288) 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 -- 172.21.15.181:0/1198222609 learned_addr learned my addr 172.21.15.181:0/1198222609 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793998e640 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793918d640 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6bf2c0 0x55852e704a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 -- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 msgr2=0x55852e6b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 -- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6bf2c0 msgr2=0x55852e704a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6bf2c0 0x55852e704a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 -- 172.21.15.181:0/1198222609 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55852e5e42f0 con 0x55852e6bca80 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f793898c640 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bca80 0x55852e6bf6a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7924035040 tx=0x7f7924079f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0ce620a17ecb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f7916ffd640 1 -- 172.21.15.181:0/1198222609 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792404b040 con 0x55852e6bca80 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f7916ffd640 1 -- 172.21.15.181:0/1198222609 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792407e3d0 con 0x55852e6bca80 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.409+0000 7f7916ffd640 1 -- 172.21.15.181:0/1198222609 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924082c00 con 0x55852e6bca80 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 -- 172.21.15.181:0/1198222609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bca80 msgr2=0x55852e6bf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bca80 0x55852e6bf6a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7924035040 tx=0x7f7924079f20 comp rx=0 tx=0).stop 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 -- 172.21.15.181:0/1198222609 shutdown_connections 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bca80 0x55852e6bf6a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 --2- 172.21.15.181:0/1198222609 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6bf2c0 0x55852e704a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 -- 172.21.15.181:0/1198222609 >> 172.21.15.181:0/1198222609 conn(0x55852e6bba80 msgr2=0x55852e703f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 -- 172.21.15.181:0/1198222609 shutdown_connections 2024-09-12T02:35:56.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 -- 172.21.15.181:0/1198222609 wait complete. 2024-09-12T02:35:56.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 -- start start 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.410+0000 7f793e264740 1 Processor -- start 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793e264740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bf2c0 0x55852e6dfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6d3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e6be490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793e264740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55852e6baf20 con 0x55852e6bf2c0 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55852e5aa450 con 0x55852e6d4300 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55852e705290 con 0x55852e6c0a50 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793e264740 10 client.0 _ll_register_callbacks cb 0x55852e333ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793918d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bf2c0 0x55852e6dfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793918d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bf2c0 0x55852e6dfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33290/0 (socket says 172.21.15.181:33290) 2024-09-12T02:35:56.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.411+0000 7f793918d640 1 -- 172.21.15.181:0/3724532127 learned_addr learned my addr 172.21.15.181:0/3724532127 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793998e640 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e6be490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793898c640 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6d3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793918d640 1 -- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 msgr2=0x55852e6d3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793918d640 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6d3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793918d640 1 -- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 msgr2=0x55852e6be490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793918d640 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e6be490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793918d640 1 -- 172.21.15.181:0/3724532127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852e3342d0 con 0x55852e6bf2c0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793918d640 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bf2c0 0x55852e6dfdc0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f793000dd90 tx=0x7f79300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0441bbfade6bc08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f790ffff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f790ffff640 1 -- 172.21.15.181:0/3724532127 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930020420 con 0x55852e6bf2c0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f790ffff640 1 -- 172.21.15.181:0/3724532127 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f793000f040 con 0x55852e6bf2c0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f792407e3d0 con 0x55852e6bf2c0 2024-09-12T02:35:56.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f790ffff640 1 -- 172.21.15.181:0/3724532127 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f7930005920 con 0x55852e6bf2c0 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 10 client.7410 fetch_fsmap learned FSMap version 69 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55852e3fe6b0 con 0x55852e6bf2c0 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f790ffff640 1 -- 172.21.15.181:0/3724532127 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792407e3d0 con 0x55852e6bf2c0 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f790ffff640 1 -- 172.21.15.181:0/3724532127 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f7930030080 con 0x55852e6bf2c0 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 10 client.7410 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 10 client.7410 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 20 client.7410 populate_metadata read hostname 'smithi181' 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e6b9820 0x55852e6e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 4 client.7410 mds_command: new command op to 7257 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.412+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 --> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55852e62ec50 con 0x55852e6b9820 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.413+0000 7f793898c640 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e6b9820 0x55852e6e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.413+0000 7f793898c640 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e6b9820 0x55852e6e8c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91112605356becca server_cookie=55c91a3f34917373 in_seq=0 out_seq=0 2024-09-12T02:35:56.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.413+0000 7f790ffff640 10 client.7410 ms_handle_connect on v2:172.21.15.204:6832/3487360283 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f790ffff640 1 -- 172.21.15.181:0/3724532127 <== mds.0 v2:172.21.15.204:6832/3487360283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7924082e50 con 0x55852e6b9820 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f790ffff640 10 client.7410 handle_command_reply: tid=0 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 client.7410 shutdown 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bf2c0 msgr2=0x55852e6dfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bf2c0 0x55852e6dfdc0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f793000dd90 tx=0x7f79300046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 shutdown_connections 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e6b9820 0x55852e6e8c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e6be490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6c0a50 0x55852e6d3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f790ffff640 0 client.7410 ms_handle_reset on v2:172.21.15.204:6832/3487360283 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 --2- 172.21.15.181:0/3724532127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6bf2c0 0x55852e6dfdc0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 >> 172.21.15.181:0/3724532127 conn(0x55852e6bca80 msgr2=0x55852e701fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 shutdown_connections 2024-09-12T02:35:56.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 1 -- 172.21.15.181:0/3724532127 wait complete. 2024-09-12T02:35:56.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.414+0000 7f793e264740 20 client.7410 trim_cache size 0 max 16384 2024-09-12T02:35:56.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 Processor -- start 2024-09-12T02:35:56.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 -- start start 2024-09-12T02:35:56.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e728380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6c0a50 0x55852e7021a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6d4300 0x55852e7135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f79341fd810 con 0x55852e6d4300 2024-09-12T02:35:56.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f79341fcb70 con 0x55852e6c0a50 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.432+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f79341fd1c0 con 0x55852e6bf2c0 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6d4300 0x55852e7135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6d4300 0x55852e7135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33304/0 (socket says 172.21.15.181:33304) 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 -- 172.21.15.181:0/202338044 learned_addr learned my addr 172.21.15.181:0/202338044 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793918d640 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e728380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793898c640 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6c0a50 0x55852e7021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 -- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 msgr2=0x55852e728380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e728380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 -- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6c0a50 msgr2=0x55852e7021a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6c0a50 0x55852e7021a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 -- 172.21.15.181:0/202338044 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55852e703960 con 0x55852e6d4300 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793898c640 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6c0a50 0x55852e7021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:56.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793918d640 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e728380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f793998e640 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6d4300 0x55852e7135f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f792c001e70 tx=0x7f792c012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c8a3572b977571 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f79167fc640 1 -- 172.21.15.181:0/202338044 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c006b10 con 0x55852e6d4300 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f79167fc640 1 -- 172.21.15.181:0/202338044 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c006cb0 con 0x55852e6d4300 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.433+0000 7f79167fc640 1 -- 172.21.15.181:0/202338044 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c006e60 con 0x55852e6d4300 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 -- 172.21.15.181:0/202338044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6d4300 msgr2=0x55852e7135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6d4300 0x55852e7135f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f792c001e70 tx=0x7f792c012690 comp rx=0 tx=0).stop 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 -- 172.21.15.181:0/202338044 shutdown_connections 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6c0a50 0x55852e7021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6d4300 0x55852e7135f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 --2- 172.21.15.181:0/202338044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e728380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 -- 172.21.15.181:0/202338044 >> 172.21.15.181:0/202338044 conn(0x55852e6bca80 msgr2=0x55852e703c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 -- 172.21.15.181:0/202338044 shutdown_connections 2024-09-12T02:35:56.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 -- 172.21.15.181:0/202338044 wait complete. 2024-09-12T02:35:56.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 -- start start 2024-09-12T02:35:56.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.434+0000 7f793e264740 1 Processor -- start 2024-09-12T02:35:56.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e786b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793e264740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6c0a50 0x55852e6d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793e264740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e71c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793e264740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55852e6df740 con 0x55852e6c0a50 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55852e6e9bc0 con 0x55852e6d4300 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793e264740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55852e6b9c70 con 0x55852e6bf2c0 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793e264740 10 client.0 _ll_register_callbacks cb 0x7f793000beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793898c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6c0a50 0x55852e6d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793898c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6c0a50 0x55852e6d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33318/0 (socket says 172.21.15.181:33318) 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793898c640 1 -- 172.21.15.181:0/848902174 learned_addr learned my addr 172.21.15.181:0/848902174 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793998e640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e71c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.435+0000 7f793918d640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e786b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793898c640 1 -- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 msgr2=0x55852e786b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793898c640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e786b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793898c640 1 -- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 msgr2=0x55852e71c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793898c640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e71c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793898c640 1 -- 172.21.15.181:0/848902174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852e6e7370 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793998e640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e71c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793898c640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6c0a50 0x55852e6d3d20 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f79240aa180 tx=0x7f7924047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bf78b6bc1eee2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f790ffff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f790ffff640 1 -- 172.21.15.181:0/848902174 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792404b040 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f790ffff640 1 -- 172.21.15.181:0/848902174 <== mon.0 v2:172.21.15.181:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f792407e0d0 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f792c006cb0 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f790ffff640 1 -- 172.21.15.181:0/848902174 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f7924089050 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 10 client.7416 fetch_fsmap learned FSMap version 69 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55852e71d370 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f790ffff640 1 -- 172.21.15.181:0/848902174 <== mon.0 v2:172.21.15.181:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7924082e50 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f790ffff640 1 -- 172.21.15.181:0/848902174 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f7924076690 con 0x55852e6c0a50 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 10 client.7416 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T02:35:56.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 10 client.7416 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 20 client.7416 populate_metadata read hostname 'smithi181' 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e7133c0 0x55852e7137a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 4 client.7416 mds_command: new command op to 7257 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 --> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] -- command(tid 0: {"prefix": "status"}) -- 0x55852e6e16c0 con 0x55852e7133c0 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.436+0000 7f793918d640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e7133c0 0x55852e7137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f790ffff640 10 client.7416 ms_handle_connect on v2:172.21.15.204:6832/3487360283 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793918d640 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e7133c0 0x55852e7137a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffabcb01d08e8cf8 server_cookie=eabfb08af2c3ec1c in_seq=0 out_seq=0 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f790ffff640 1 -- 172.21.15.181:0/848902174 <== mds.0 v2:172.21.15.204:6832/3487360283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55852e6e16c0 con 0x55852e7133c0 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f790ffff640 10 client.7416 handle_command_reply: tid=0 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 client.7416 shutdown 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6c0a50 msgr2=0x55852e6d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6c0a50 0x55852e6d3d20 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f79240aa180 tx=0x7f7924047000 comp rx=0 tx=0).stop 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 shutdown_connections 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:6832/3487360283,v1:172.21.15.204:6835/3487360283] conn(0x55852e7133c0 0x55852e7137a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55852e6d4300 0x55852e71c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f790ffff640 0 client.7416 ms_handle_reset on v2:172.21.15.204:6832/3487360283 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55852e6c0a50 0x55852e6d3d20 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 --2- 172.21.15.181:0/848902174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55852e6bf2c0 0x55852e786b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 >> 172.21.15.181:0/848902174 conn(0x55852e6bca80 msgr2=0x55852e7021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 shutdown_connections 2024-09-12T02:35:56.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 1 -- 172.21.15.181:0/848902174 wait complete. 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.437+0000 7f793e264740 20 client.7416 trim_cache size 0 max 16384 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "cluster_fsid": "d365410a-fe63-4420-b203-62c6d59c25dd", 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "whoami": 0, 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 7257, 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "want_state": "up:active", 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "up:active", 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs", 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "rank_uptime": 8.8966269059999998, 2024-09-12T02:35:56.446 INFO:teuthology.orchestra.run.smithi181.stdout: "mdsmap_epoch": 69, 2024-09-12T02:35:56.447 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch": 87, 2024-09-12T02:35:56.447 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_epoch_barrier": 87, 2024-09-12T02:35:56.447 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 12.956654602 2024-09-12T02:35:56.447 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f791806be30 msgr2=0x7f791806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f791806be30 0x7f791806e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f793000b810 tx=0x7f7930008040 comp rx=0 tx=0).stop 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 msgr2=0x7f793414c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f793414c080 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7924000c00 tx=0x7f79240046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 shutdown_connections 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f791806be30 0x7f791806e2f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f793415b2e0 0x7f793415da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79340cdfc0 0x7f793414c080 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 --2- 172.21.15.181:0/2746231274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f79340b22c0 0x7f79340d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 >> 172.21.15.181:0/2746231274 conn(0x7f793406bc10 msgr2=0x7f7934071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 shutdown_connections 2024-09-12T02:35:56.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.438+0000 7f793b3f1640 1 -- 172.21.15.181:0/2746231274 wait complete. 2024-09-12T02:35:56.450 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:35:56.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.547+0000 7f8d621f6640 1 Processor -- start 2024-09-12T02:35:56.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.547+0000 7f8d621f6640 1 -- start start 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.547+0000 7f8d621f6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8d5c15b2e0 0x7f8d5c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d621f6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8d5c0b2490 0x7f8d5c071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d621f6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c0ce4f0 con 0x7f8d5c0cdfc0 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d621f6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8d5c15b6c0 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d621f6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8d5c0ce7d0 con 0x7f8d5c0b2490 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8d5c15b2e0 0x7f8d5c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8d5c15b2e0 0x7f8d5c0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33326/0 (socket says 172.21.15.181:33326) 2024-09-12T02:35:56.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8d5c0cdfc0 0x7f8d5c0b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:47216/0 (socket says 172.21.15.181:47216) 2024-09-12T02:35:56.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5b7fe640 1 -- 172.21.15.181:0/1108881609 learned_addr learned my addr 172.21.15.181:0/1108881609 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5bfff640 1 --2- 172.21.15.181:0/1108881609 >> v2:172.21.15.204:3300/0 conn(0x7f8d5c0b2490 0x7f8d5c071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5b7fe640 1 -- 172.21.15.181:0/1108881609 >> v2:172.21.15.204:3300/0 conn(0x7f8d5c0b2490 msgr2=0x7f8d5c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:56.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5b7fe640 1 --2- 172.21.15.181:0/1108881609 >> v2:172.21.15.204:3300/0 conn(0x7f8d5c0b2490 0x7f8d5c071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5b7fe640 1 -- 172.21.15.181:0/1108881609 >> v1:172.21.15.181:6789/0 conn(0x7f8d5c0cdfc0 legacy=0x7f8d5c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5b7fe640 1 -- 172.21.15.181:0/1108881609 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c0ceab0 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.548+0000 7f8d5a7fc640 1 -- 172.21.15.181:0/1108881609 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538975801 0 0) 0x7f8d5c0ce4f0 con 0x7f8d5c0cdfc0 2024-09-12T02:35:56.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d5b7fe640 1 --2- 172.21.15.181:0/1108881609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c0b3d20 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0b4830 tx=0x7f8d4c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60819fa4ba2afe49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d5a7fc640 1 -- 172.21.15.181:0/1108881609 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c033640 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d5a7fc640 1 -- 172.21.15.181:0/1108881609 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c038070 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d5a7fc640 1 -- 172.21.15.181:0/1108881609 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c033a00 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 -- 172.21.15.181:0/1108881609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 msgr2=0x7f8d5c0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 --2- 172.21.15.181:0/1108881609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c0b3d20 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0b4830 tx=0x7f8d4c02c8b0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 -- 172.21.15.181:0/1108881609 shutdown_connections 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 --2- 172.21.15.181:0/1108881609 >> v2:172.21.15.204:3300/0 conn(0x7f8d5c0b2490 0x7f8d5c071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 --2- 172.21.15.181:0/1108881609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c0b3d20 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 -- 172.21.15.181:0/1108881609 >> 172.21.15.181:0/1108881609 conn(0x7f8d5c06bc10 msgr2=0x7f8d5c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 -- 172.21.15.181:0/1108881609 shutdown_connections 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.549+0000 7f8d621f6640 1 -- 172.21.15.181:0/1108881609 wait complete. 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 Processor -- start 2024-09-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 -- start start 2024-09-12T02:35:56.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d5c0b2490 0x7f8d5c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d5c0cdfc0 0x7f8d5c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c0712b0 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c071130 con 0x7f8d5c0b2490 2024-09-12T02:35:56.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.551+0000 7f8d621f6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c0b4260 con 0x7f8d5c0cdfc0 2024-09-12T02:35:56.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c15cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33340/0 (socket says 172.21.15.181:33340) 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 -- 172.21.15.181:0/2004420901 learned_addr learned my addr 172.21.15.181:0/2004420901 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5affd640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d5c0cdfc0 0x7f8d5c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5b7fe640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d5c0b2490 0x7f8d5c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 -- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d5c0cdfc0 msgr2=0x7f8d5c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d5c0cdfc0 0x7f8d5c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 -- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d5c0b2490 msgr2=0x7f8d5c1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d5c0b2490 0x7f8d5c1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 -- 172.21.15.181:0/2004420901 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c1efbb0 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5b7fe640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d5c0b2490 0x7f8d5c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d5bfff640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c15cb20 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8d54007de0 tx=0x7f8d5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d43fff640 1 -- 172.21.15.181:0/2004420901 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54014620 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d43fff640 1 -- 172.21.15.181:0/2004420901 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d54019070 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c15d420 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d43fff640 1 -- 172.21.15.181:0/2004420901 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54014a20 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.552+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c1efe20 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.553+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c0b3d20 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.554+0000 7f8d43fff640 1 -- 172.21.15.181:0/2004420901 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d54014bc0 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.554+0000 7f8d43fff640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.554+0000 7f8d43fff640 1 -- 172.21.15.181:0/2004420901 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f8d5408b6c0 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.554+0000 7f8d5b7fe640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:56.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.555+0000 7f8d5b7fe640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c037000 tx=0x7f8d4c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:56.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.558+0000 7f8d43fff640 1 -- 172.21.15.181:0/2004420901 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d5c15d420 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.759+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8d5c0cf350 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.759+0000 7f8d43fff640 1 -- 172.21.15.181:0/2004420901 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) ==== 53+0+73 (secure 0 0 0) 0x7f8d5405a100 con 0x7f8d5c15b2e0 2024-09-12T02:35:56.760 INFO:teuthology.orchestra.run.smithi181.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:35:56.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8d4806be30 msgr2=0x7f8d4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c037000 tx=0x7f8d4c032000 comp rx=0 tx=0).stop 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 msgr2=0x7f8d5c15cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c15cb20 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8d54007de0 tx=0x7f8d5400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 shutdown_connections 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c15b2e0 0x7f8d5c15cb20 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d5c0cdfc0 0x7f8d5c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 --2- 172.21.15.181:0/2004420901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d5c0b2490 0x7f8d5c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.761+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 >> 172.21.15.181:0/2004420901 conn(0x7f8d5c06bc10 msgr2=0x7f8d5c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.762+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 shutdown_connections 2024-09-12T02:35:56.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:56.762+0000 7f8d621f6640 1 -- 172.21.15.181:0/2004420901 wait complete. 2024-09-12T02:35:56.773 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:35:56.773 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:35:56.774 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-12T02:35:56.774 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:35:56.774 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:56.774 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:35:56.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:35:56.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:35:56.774 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:56.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:56.774 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-12T02:35:56.790 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:35:56.790 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:56.791 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42287sec preferred_lft 42287sec 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link noprefixroute 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::707d:30ff:fe54:1e90/64 scope link 2024-09-12T02:35:56.792 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 7e:74:15:f8:6f:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::7c74:15ff:fef8:6fb2/64 scope link 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether b6:ff:30:d0:60:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::b4ff:30ff:fed0:604e/64 scope link 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:56.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:56.794 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:35:56.854 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T02:35:56.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:56.856 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-12T02:35:56.913 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-12T02:35:56.913 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:35:56.913 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:35:56.913 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:35:56.914 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:35:56.914 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:56.914 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-12T02:35:56.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:35:56.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:35:56.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:35:56.914 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-12T02:35:57.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:57.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:57.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:57.039 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:35:57.056 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:35:57.056 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:35:57.057 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:57.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:57.057 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-12T02:35:57.121 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T02:35:57.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:57.122 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:57.177 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:35:57.177 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:57.177 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:57.233 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:35:57.297 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:35:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:57.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:57.357 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:35:57.410 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:35:57.410 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T02:35:57.452 DEBUG:teuthology.orchestra.run.smithi181:> sudo modprobe fuse 2024-09-12T02:35:57.476 DEBUG:teuthology.orchestra.run.smithi181:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:57.533 INFO:teuthology.orchestra.run.smithi181.stdout:/proc 2024-09-12T02:35:57.533 INFO:teuthology.orchestra.run.smithi181.stdout:/sys 2024-09-12T02:35:57.533 INFO:teuthology.orchestra.run.smithi181.stdout:/dev 2024-09-12T02:35:57.533 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/security 2024-09-12T02:35:57.533 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/shm 2024-09-12T02:35:57.533 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/pts 2024-09-12T02:35:57.533 INFO:teuthology.orchestra.run.smithi181.stdout:/run 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/cgroup 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/pstore 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/bpf 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/ 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/selinux 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/mqueue 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/dev/hugepages 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/debug 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/tracing 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:57.534 INFO:teuthology.orchestra.run.smithi181.stdout:/sys/kernel/config 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/user/1000 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:57.535 INFO:teuthology.orchestra.run.smithi181.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:35:57.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:57.536 DEBUG:teuthology.orchestra.run.smithi181:> ls /sys/fs/fuse/connections 2024-09-12T02:35:57.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:2024-09-12T02:35:57.532+0000 7fefa17c4480 -1 init, newargv = 0x565143888c40 newargc=15 2024-09-12T02:35:57.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[65217]: starting ceph client 2024-09-12T02:35:57.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[65217]: starting fuse 2024-09-12T02:35:57.552 INFO:teuthology.orchestra.run.smithi181.stdout:42 2024-09-12T02:35:57.552 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> import glob 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> import re 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> import os 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> import subprocess 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> def _find_admin_socket(client_name): 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> files = glob.glob(asok_path) 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> # Given a non-glob path, it better be there 2024-09-12T02:35:57.553 DEBUG:teuthology.orchestra.run.smithi181:> if "*" not in asok_path: 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> assert(len(files) == 1) 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> return files[0] 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> for f in files: 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> contents = proc_f.read() 2024-09-12T02:35:57.554 DEBUG:teuthology.orchestra.run.smithi181:> if mountpoint in contents: 2024-09-12T02:35:57.555 DEBUG:teuthology.orchestra.run.smithi181:> return f 2024-09-12T02:35:57.555 DEBUG:teuthology.orchestra.run.smithi181:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:35:57.555 DEBUG:teuthology.orchestra.run.smithi181:> 2024-09-12T02:35:57.555 DEBUG:teuthology.orchestra.run.smithi181:> print(_find_admin_socket("client.0")) 2024-09-12T02:35:57.555 DEBUG:teuthology.orchestra.run.smithi181:> ' 2024-09-12T02:35:57.670 INFO:teuthology.orchestra.run.smithi181.stdout:/var/run/ceph/ceph-client.0.65217.asok 2024-09-12T02:35:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:57.680 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.65217.asok 2024-09-12T02:35:57.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:57.680 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.65217.asok status 2024-09-12T02:35:57.814 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "metadata": { 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "entity_id": "0", 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "hostname": "smithi181", 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "pid": "65217", 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "root": "/" 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_count": 0, 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "dentry_pinned_count": 0, 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "id": 7431, 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "inst": { 2024-09-12T02:35:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "name": { 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "client", 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 7431 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 1093854596 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": { 2024-09-12T02:35:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 1093854596 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "inst_str": "client.7431 192.168.0.1:0/1093854596", 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr_str": "192.168.0.1:0/1093854596", 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "inode_count": 1, 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_epoch": 69, 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch": 87, 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "blocklisted": false, 2024-09-12T02:35:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "fs_name": "cephfs" 2024-09-12T02:35:57.818 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:57.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:57.823 DEBUG:teuthology.orchestra.run.smithi181:> stat --file-system '--printf=%T 2024-09-12T02:35:57.823 DEBUG:teuthology.orchestra.run.smithi181:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:57.839 INFO:teuthology.orchestra.run.smithi181.stdout:fuseblk 2024-09-12T02:35:57.839 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:57.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:57.839 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:57.906 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-12T02:35:57.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.985+0000 7f49e6d37280 1 -- start start 2024-09-12T02:35:57.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.985+0000 7f49e6d37280 1 Processor -- start 2024-09-12T02:35:57.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.985+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560106256c00 0x5601062d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.985+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560106257800 0x5601062d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560106257c00 0x5601062d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560107110180 con 0x560106257800 2024-09-12T02:35:57.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x560107110300 con 0x560106257c00 2024-09-12T02:35:57.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x560107110480 con 0x560106256c00 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560106257800 0x5601062d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560106257800 0x5601062d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33362/0 (socket says 172.21.15.181:33362) 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 -- 172.21.15.181:0/2954468870 learned_addr learned my addr 172.21.15.181:0/2954468870 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 -- 172.21.15.181:0/2954468870 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560106256c00 msgr2=0x5601062d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560106256c00 0x5601062d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 -- 172.21.15.181:0/2954468870 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560106257c00 msgr2=0x5601062d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e5296640 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560106257c00 0x5601062d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560106257c00 0x5601062d3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 -- 172.21.15.181:0/2954468870 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010628e780 con 0x560106257800 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e4294640 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560106257800 0x5601062d2b00 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x56010707b350 tx=0x560106ff8b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42d06e91f9106f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e2290640 1 -- 172.21.15.181:0/2954468870 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56010627c680 con 0x560106257800 2024-09-12T02:35:57.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e2290640 1 -- 172.21.15.181:0/2954468870 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560106282700 con 0x560106257800 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e2290640 1 -- 172.21.15.181:0/2954468870 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56010627cb60 con 0x560106257800 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 1 -- 172.21.15.181:0/2954468870 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010628f4a0 con 0x560106257800 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 1 -- 172.21.15.181:0/2954468870 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56010628e000 con 0x560106257800 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 4 waiting for MDS map... 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e2290640 1 -- 172.21.15.181:0/2954468870 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x560107128600 con 0x560106257800 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e2290640 1 -- 172.21.15.181:0/2954468870 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x5601062b1180 con 0x560106257800 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.986+0000 7f49e6d37280 4 Got MDS map 69 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.987+0000 7f49e6d37280 10 main: main 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.987+0000 7f49e6d37280 4 main: connecting to RADOS... 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.987+0000 7f49e6d37280 1 Processor -- start 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.987+0000 7f49e6d37280 1 -- start start 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131400 0x5601062d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131800 0x5601062d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131c00 0x5601062d4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e6d37280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560107110600 con 0x560107131800 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e6d37280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x560107110780 con 0x560107131400 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e6d37280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x560107110900 con 0x560107131c00 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131800 0x5601062d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131800 0x5601062d3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33378/0 (socket says 172.21.15.181:33378) 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 -- 172.21.15.181:0/305605149 learned_addr learned my addr 172.21.15.181:0/305605149 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e5296640 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131400 0x5601062d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 -- 172.21.15.181:0/305605149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131c00 msgr2=0x5601062d4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131c00 0x5601062d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 -- 172.21.15.181:0/305605149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131400 msgr2=0x5601062d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131400 0x5601062d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 -- 172.21.15.181:0/305605149 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010628e3c0 con 0x560107131800 2024-09-12T02:35:57.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e4a95640 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131800 0x5601062d3b80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x56010714c7b0 tx=0x560107144d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b097e692c70f192 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e028c640 1 -- 172.21.15.181:0/305605149 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56010627c9c0 con 0x560107131800 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e028c640 1 -- 172.21.15.181:0/305605149 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560106282fc0 con 0x560107131800 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.988+0000 7f49e028c640 1 -- 172.21.15.181:0/305605149 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56010627c680 con 0x560107131800 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 -- 172.21.15.181:0/305605149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131800 msgr2=0x5601062d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131800 0x5601062d3b80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x56010714c7b0 tx=0x560107144d20 comp rx=0 tx=0).stop 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 -- 172.21.15.181:0/305605149 shutdown_connections 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131c00 0x5601062d4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131800 0x5601062d3b80 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 --2- 172.21.15.181:0/305605149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131400 0x5601062d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 -- 172.21.15.181:0/305605149 >> 172.21.15.181:0/305605149 conn(0x560107131000 msgr2=0x560106343000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 -- 172.21.15.181:0/305605149 shutdown_connections 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 -- 172.21.15.181:0/305605149 wait complete. 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 Processor -- start 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.989+0000 7f49e6d37280 1 -- start start 2024-09-12T02:35:57.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131400 0x5601062d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131800 0x5601062d4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e6d37280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131c00 0x5601062d4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e6d37280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5601062b8180 con 0x560107131c00 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e6d37280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x560107111e00 con 0x560107131800 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e6d37280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x560107110d80 con 0x560107131400 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131c00 0x5601062d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131c00 0x5601062d4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33392/0 (socket says 172.21.15.181:33392) 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 -- 172.21.15.181:0/2736233992 learned_addr learned my addr 172.21.15.181:0/2736233992 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 -- 172.21.15.181:0/2736233992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131400 msgr2=0x5601062d5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4a95640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131800 0x5601062d4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e5296640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131400 0x5601062d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560107131400 0x5601062d5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 -- 172.21.15.181:0/2736233992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131800 msgr2=0x5601062d4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560107131800 0x5601062d4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 -- 172.21.15.181:0/2736233992 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010628e780 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.990+0000 7f49e4294640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131c00 0x5601062d4680 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x56010714d590 tx=0x560106313020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.991+0000 7f49dea89640 1 -- 172.21.15.181:0/2736233992 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56010627c820 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.991+0000 7f49dea89640 1 -- 172.21.15.181:0/2736233992 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560106282e00 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.991+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56010628f4a0 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.991+0000 7f49dea89640 1 -- 172.21.15.181:0/2736233992 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56010627c9c0 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.991+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010628e960 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.991+0000 7f49e6d37280 4 main: resolving pool 12 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49dea89640 1 -- 172.21.15.181:0/2736233992 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56010704cc00 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49dea89640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5601071a1000 0x5601062d5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49dea89640 1 -- 172.21.15.181:0/2736233992 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x560107054600 con 0x560107131c00 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49e5296640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5601071a1000 0x5601062d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49e6d37280 4 main: creating IoCtx.. 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5601071a1400 0x5601062d4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87) -- 0x5601071a1800 con 0x5601071a1400 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.992+0000 7f49e4a95640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5601071a1400 0x5601062d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e5296640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5601071a1000 0x5601062d5700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x56010707b2c0 tx=0x560107145740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e4a95640 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5601071a1400 0x5601062d4100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e4a95640 1 -- 172.21.15.181:0/2736233992 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x560106fe8000 con 0x5601071a1400 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:58.002 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 0, 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: "inotable": { 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: "projected_free": [ 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627776, 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627776 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: "free": [ 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627776, 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627776 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:58.003 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:58.004 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:58.004 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.004 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:58.004 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5601071a1400 msgr2=0x5601062d4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x5601071a1400 0x5601062d4100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5601071a1000 msgr2=0x5601062d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x5601071a1000 0x5601062d5700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x56010707b2c0 tx=0x560107145740 comp rx=0 tx=0).stop 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131c00 msgr2=0x5601062d4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2736233992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560107131c00 0x5601062d4680 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x56010714d590 tx=0x560106313020 comp rx=0 tx=0).stop 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e4a95640 1 -- 172.21.15.181:0/2736233992 reap_dead start 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 shutdown_connections 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 >> 172.21.15.181:0/2736233992 conn(0x560107131000 msgr2=0x560106343000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:58.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 shutdown_connections 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.993+0000 7f49e6d37280 1 -- 172.21.15.181:0/2736233992 wait complete. 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 -- 172.21.15.181:0/2954468870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560106257800 msgr2=0x5601062d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560106257800 0x5601062d2b00 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x56010707b350 tx=0x560106ff8b40 comp rx=0 tx=0).stop 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 -- 172.21.15.181:0/2954468870 shutdown_connections 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x560106257c00 0x5601062d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560106257800 0x5601062d2b00 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 --2- 172.21.15.181:0/2954468870 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x560106256c00 0x5601062d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 -- 172.21.15.181:0/2954468870 >> 172.21.15.181:0/2954468870 conn(0x560106257000 msgr2=0x560106342800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 -- 172.21.15.181:0/2954468870 shutdown_connections 2024-09-12T02:35:58.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:57.994+0000 7f49e6d37280 1 -- 172.21.15.181:0/2954468870 wait complete. 2024-09-12T02:35:58.007 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.101837, result: { "0": { "data": { "version": 0, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-12T02:35:58.008 DEBUG:teuthology.orchestra.run.smithi181:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all take_inos 1099511627876 2024-09-12T02:35:58.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.086+0000 7f9a2a11f280 1 -- start start 2024-09-12T02:35:58.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.086+0000 7f9a2a11f280 1 Processor -- start 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b013c4ec00 0x55b013cca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b013c4f800 0x55b013ccab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b013c4fc00 0x55b013ccb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b014b10180 con 0x55b013c4f800 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b014b10300 con 0x55b013c4fc00 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b014b10480 con 0x55b013c4ec00 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b013c4f800 0x55b013ccab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b013c4f800 0x55b013ccab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33398/0 (socket says 172.21.15.181:33398) 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 -- 172.21.15.181:0/3530083042 learned_addr learned my addr 172.21.15.181:0/3530083042 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a27e5f640 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b013c4ec00 0x55b013cca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a28660640 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b013c4fc00 0x55b013ccb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 -- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b013c4ec00 msgr2=0x55b013cca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b013c4ec00 0x55b013cca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 -- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b013c4fc00 msgr2=0x55b013ccb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b013c4fc00 0x55b013ccb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 -- 172.21.15.181:0/3530083042 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b013c86780 con 0x55b013c4f800 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2765e640 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b013c4f800 0x55b013ccab00 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x55b014a7f350 tx=0x55b0149f22a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55d49b529b2bb23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2565a640 1 -- 172.21.15.181:0/3530083042 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b013c74680 con 0x55b013c4f800 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2565a640 1 -- 172.21.15.181:0/3530083042 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b013c7a700 con 0x55b013c4f800 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2565a640 1 -- 172.21.15.181:0/3530083042 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b013c74b60 con 0x55b013c4f800 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 -- 172.21.15.181:0/3530083042 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b013c874a0 con 0x55b013c4f800 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 1 -- 172.21.15.181:0/3530083042 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b013c86000 con 0x55b013c4f800 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.087+0000 7f9a2a11f280 4 waiting for MDS map... 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.088+0000 7f9a2565a640 1 -- 172.21.15.181:0/3530083042 <== mon.0 v2:172.21.15.181:3300/0 4 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x55b014b30a00 con 0x55b013c4f800 2024-09-12T02:35:58.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.088+0000 7f9a2565a640 1 -- 172.21.15.181:0/3530083042 <== mon.0 v2:172.21.15.181:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x55b013ca9180 con 0x55b013c4f800 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.088+0000 7f9a2a11f280 4 Got MDS map 69 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.088+0000 7f9a2a11f280 10 main: main 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.088+0000 7f9a2a11f280 4 main: connecting to RADOS... 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.088+0000 7f9a2a11f280 1 Processor -- start 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.088+0000 7f9a2a11f280 1 -- start start 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013ccbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b014b10600 con 0x55b014b35400 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b014b10780 con 0x55b014b35c00 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b014b10900 con 0x55b014b35800 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33412/0 (socket says 172.21.15.181:33412) 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 -- 172.21.15.181:0/561452985 learned_addr learned my addr 172.21.15.181:0/561452985 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a27e5f640 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013ccbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a2765e640 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 -- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 msgr2=0x55b013ccbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013ccbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 -- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 msgr2=0x55b013ccc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.089+0000 7f9a28660640 1 -- 172.21.15.181:0/561452985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b013c863c0 con 0x55b014b35400 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a28660640 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccb600 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x55b014b4a5a0 tx=0x55b0149f0b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d09c45ec476687 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a23656640 1 -- 172.21.15.181:0/561452985 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b013c749c0 con 0x55b014b35400 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a23656640 1 -- 172.21.15.181:0/561452985 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b013c7afc0 con 0x55b014b35400 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a23656640 1 -- 172.21.15.181:0/561452985 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b013c74680 con 0x55b014b35400 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 -- 172.21.15.181:0/561452985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 msgr2=0x55b013ccb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccb600 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x55b014b4a5a0 tx=0x55b0149f0b40 comp rx=0 tx=0).stop 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 -- 172.21.15.181:0/561452985 shutdown_connections 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013ccbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/561452985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccb600 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 -- 172.21.15.181:0/561452985 >> 172.21.15.181:0/561452985 conn(0x55b014b35000 msgr2=0x55b013d47000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 -- 172.21.15.181:0/561452985 shutdown_connections 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.090+0000 7f9a2a11f280 1 -- 172.21.15.181:0/561452985 wait complete. 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 Processor -- start 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 -- start start 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013cccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b013cb0180 con 0x55b014b35400 2024-09-12T02:35:58.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55b014b11e00 con 0x55b014b35c00 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2a11f280 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55b014b10d80 con 0x55b014b35800 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a28660640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a28660640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33418/0 (socket says 172.21.15.181:33418) 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a28660640 1 -- 172.21.15.181:0/2923739272 learned_addr learned my addr 172.21.15.181:0/2923739272 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a27e5f640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013cccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.091+0000 7f9a2765e640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a28660640 1 -- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 msgr2=0x55b013cccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a28660640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013cccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a28660640 1 -- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 msgr2=0x55b013ccc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a28660640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a28660640 1 -- 172.21.15.181:0/2923739272 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b013c86780 con 0x55b014b35400 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a2765e640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b014b35c00 0x55b013ccc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a27e5f640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b014b35800 0x55b013cccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:58.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a28660640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccd180 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x55b014b4a8d0 tx=0x55b0149f21e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a21e53640 1 -- 172.21.15.181:0/2923739272 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b013c74b60 con 0x55b014b35400 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a21e53640 1 -- 172.21.15.181:0/2923739272 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b013c7ae00 con 0x55b014b35400 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b013c874a0 con 0x55b014b35400 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a21e53640 1 -- 172.21.15.181:0/2923739272 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b013c744e0 con 0x55b014b35400 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b013c86960 con 0x55b014b35400 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.092+0000 7f9a2a11f280 4 main: resolving pool 12 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.093+0000 7f9a21e53640 1 -- 172.21.15.181:0/2923739272 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55b014b2cc00 con 0x55b014b35400 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.093+0000 7f9a21e53640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b013fd0000 0x55b013ccd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.093+0000 7f9a21e53640 1 -- 172.21.15.181:0/2923739272 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x55b014a58600 con 0x55b014b35400 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.093+0000 7f9a2a11f280 4 main: creating IoCtx.. 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.093+0000 7f9a27e5f640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b013fd0000 0x55b013ccd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.093+0000 7f9a2a11f280 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2024-09-12T02:35:58.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.093+0000 7f9a2a11f280 10 mds.0.inotable: skip_inos now [0x10000000065~0xffffffff9b] 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.094+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b013fd0400 0x55b013ccc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.094+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55b013fd0800 con 0x55b013fd0400 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.094+0000 7f9a2765e640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b013fd0400 0x55b013ccc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.094+0000 7f9a27e5f640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b013fd0000 0x55b013ccd700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55b013d3a780 tx=0x55b014b4d1a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.094+0000 7f9a2765e640 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b013fd0400 0x55b013ccc100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2765e640 1 -- 172.21.15.181:0/2923739272 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v87'3 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x55b013d38000 con 0x55b013fd0400 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "0": { 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "data": { 2024-09-12T02:35:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "version": 1, 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "inotable": { 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "projected_free": [ 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627877, 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627675 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "free": [ 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "start": 1099511627877, 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "len": 1099511627675 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-12T02:35:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-12T02:35:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "result": 0 2024-09-12T02:35:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-12T02:35:58.105 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:35:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b013fd0400 msgr2=0x55b013ccc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x55b013fd0400 0x55b013ccc100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b013fd0000 msgr2=0x55b013ccd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x55b013fd0000 0x55b013ccd700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55b013d3a780 tx=0x55b014b4d1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 msgr2=0x55b013ccd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/2923739272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b014b35400 0x55b013ccd180 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x55b014b4a8d0 tx=0x55b0149f21e0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a27e5f640 1 -- 172.21.15.181:0/2923739272 reap_dead start 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 shutdown_connections 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 >> 172.21.15.181:0/2923739272 conn(0x55b014b35000 msgr2=0x55b013d47000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 shutdown_connections 2024-09-12T02:35:58.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.095+0000 7f9a2a11f280 1 -- 172.21.15.181:0/2923739272 wait complete. 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 -- 172.21.15.181:0/3530083042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b013c4f800 msgr2=0x55b013ccab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b013c4f800 0x55b013ccab00 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x55b014a7f350 tx=0x55b0149f22a0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 -- 172.21.15.181:0/3530083042 shutdown_connections 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55b013c4fc00 0x55b013ccb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b013c4f800 0x55b013ccab00 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 --2- 172.21.15.181:0/3530083042 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55b013c4ec00 0x55b013cca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 -- 172.21.15.181:0/3530083042 >> 172.21.15.181:0/3530083042 conn(0x55b013c4f000 msgr2=0x55b013d46800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 -- 172.21.15.181:0/3530083042 shutdown_connections 2024-09-12T02:35:58.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.096+0000 7f9a2a11f280 1 -- 172.21.15.181:0/3530083042 wait complete. 2024-09-12T02:35:58.108 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'take_inos', '1099511627876'] in time 0:00:00.100770, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627877, "len": 1099511627675 } ], "free": [ { "start": 1099511627877, "len": 1099511627675 } ] } }, "result": 0 } } 2024-09-12T02:35:58.109 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:35:58.109 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:58.203 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:35:58.251 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:35:58.252 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:58.252 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:58.252 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:58.268 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:35:58.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.409+0000 7f40fc837640 1 Processor -- start 2024-09-12T02:35:58.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.410+0000 7f40fc837640 1 -- start start 2024-09-12T02:35:58.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.410+0000 7f40fc837640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f815b2e0 0x7f40f80b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40fc837640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40f80b2490 0x7f40f8071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40fc837640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f80ce4f0 con 0x7f40f80cdfc0 2024-09-12T02:35:58.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40fc837640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f40f815b6c0 con 0x7f40f80b2490 2024-09-12T02:35:58.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40fc837640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40f80ce7d0 con 0x7f40f815b2e0 2024-09-12T02:35:58.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40f80b2490 0x7f40f8071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40f80b2490 0x7f40f8071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33434/0 (socket says 172.21.15.181:33434) 2024-09-12T02:35:58.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f6d9d640 1 -- 172.21.15.181:0/2805757479 learned_addr learned my addr 172.21.15.181:0/2805757479 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:58.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f659c640 1 --2- 172.21.15.181:0/2805757479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f815b2e0 0x7f40f80b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f6d9d640 1 -- 172.21.15.181:0/2805757479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f815b2e0 msgr2=0x7f40f80b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:58.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f6d9d640 1 --2- 172.21.15.181:0/2805757479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f815b2e0 0x7f40f80b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f6d9d640 1 -- 172.21.15.181:0/2805757479 >> v1:172.21.15.204:6789/0 conn(0x7f40f80cdfc0 legacy=0x7f40f80b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:58.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.411+0000 7f40f6d9d640 1 -- 172.21.15.181:0/2805757479 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f80ceab0 con 0x7f40f80b2490 2024-09-12T02:35:58.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.412+0000 7f40f6d9d640 1 --2- 172.21.15.181:0/2805757479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8071750 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d150 tx=0x7f40f002c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186fea77555547c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.412+0000 7f40f559a640 1 -- 172.21.15.181:0/2805757479 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f000b2e0 con 0x7f40f80b2490 2024-09-12T02:35:58.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.412+0000 7f40f559a640 1 -- 172.21.15.181:0/2805757479 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f0009600 con 0x7f40f80b2490 2024-09-12T02:35:58.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.412+0000 7f40f559a640 1 -- 172.21.15.181:0/2805757479 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f000b480 con 0x7f40f80b2490 2024-09-12T02:35:58.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.412+0000 7f40fc837640 1 -- 172.21.15.181:0/2805757479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 msgr2=0x7f40f8071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.412+0000 7f40fc837640 1 --2- 172.21.15.181:0/2805757479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8071750 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d150 tx=0x7f40f002c8e0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.413+0000 7f40fc837640 1 -- 172.21.15.181:0/2805757479 shutdown_connections 2024-09-12T02:35:58.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.413+0000 7f40fc837640 1 --2- 172.21.15.181:0/2805757479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8071750 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.413+0000 7f40fc837640 1 --2- 172.21.15.181:0/2805757479 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f815b2e0 0x7f40f80b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.413+0000 7f40fc837640 1 -- 172.21.15.181:0/2805757479 >> 172.21.15.181:0/2805757479 conn(0x7f40f806bc10 msgr2=0x7f40f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:58.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.413+0000 7f40fc837640 1 -- 172.21.15.181:0/2805757479 shutdown_connections 2024-09-12T02:35:58.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.413+0000 7f40fc837640 1 -- 172.21.15.181:0/2805757479 wait complete. 2024-09-12T02:35:58.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.414+0000 7f40fc837640 1 Processor -- start 2024-09-12T02:35:58.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.414+0000 7f40fc837640 1 -- start start 2024-09-12T02:35:58.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f80cdfc0 0x7f40f80c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f815b2e0 0x7f40f81f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80712b0 con 0x7f40f80b2490 2024-09-12T02:35:58.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f40f8071130 con 0x7f40f815b2e0 2024-09-12T02:35:58.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40f80b4260 con 0x7f40f80cdfc0 2024-09-12T02:35:58.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33444/0 (socket says 172.21.15.181:33444) 2024-09-12T02:35:58.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 -- 172.21.15.181:0/3552159596 learned_addr learned my addr 172.21.15.181:0/3552159596 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f6d9d640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f815b2e0 0x7f40f81f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f5d9b640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f80cdfc0 0x7f40f80c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 -- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f80cdfc0 msgr2=0x7f40f80c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f80cdfc0 0x7f40f80c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 -- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f815b2e0 msgr2=0x7f40f81f4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f815b2e0 0x7f40f81f4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 -- 172.21.15.181:0/3552159596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f80c5b10 con 0x7f40f80b2490 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f5d9b640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f80cdfc0 0x7f40f80c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40f659c640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8156c50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c7f0 tx=0x7f40e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40eeffd640 1 -- 172.21.15.181:0/3552159596 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0015070 con 0x7f40f80b2490 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40eeffd640 1 -- 172.21.15.181:0/3552159596 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e0004220 con 0x7f40f80b2490 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f80c5db0 con 0x7f40f80b2490 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40eeffd640 1 -- 172.21.15.181:0/3552159596 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0007620 con 0x7f40f80b2490 2024-09-12T02:35:58.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.415+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f81f44d0 con 0x7f40f80b2490 2024-09-12T02:35:58.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.416+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f80c61a0 con 0x7f40f80b2490 2024-09-12T02:35:58.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.417+0000 7f40eeffd640 1 -- 172.21.15.181:0/3552159596 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40e00077c0 con 0x7f40f80b2490 2024-09-12T02:35:58.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.417+0000 7f40eeffd640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40d806be30 0x7f40d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:58.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.418+0000 7f40f5d9b640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40d806be30 0x7f40d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:58.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.418+0000 7f40eeffd640 1 -- 172.21.15.181:0/3552159596 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f40e008af70 con 0x7f40f80b2490 2024-09-12T02:35:58.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.418+0000 7f40f5d9b640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40d806be30 0x7f40d806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40f80af500 tx=0x7f40e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:58.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.422+0000 7f40eeffd640 1 -- 172.21.15.181:0/3552159596 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40e0059920 con 0x7f40f80b2490 2024-09-12T02:35:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.600+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f40f80c5f80 con 0x7f40f80b2490 2024-09-12T02:35:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.601+0000 7f40eeffd640 1 -- 172.21.15.181:0/3552159596 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) ==== 80+0+0 (secure 0 0 0) 0x7f40e0059220 con 0x7f40f80b2490 2024-09-12T02:35:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:listed 0 entries 2024-09-12T02:35:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40d806be30 msgr2=0x7f40d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40d806be30 0x7f40d806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40f80af500 tx=0x7f40e8009040 comp rx=0 tx=0).stop 2024-09-12T02:35:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 msgr2=0x7f40f8156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8156c50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c7f0 tx=0x7f40e000ccb0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 shutdown_connections 2024-09-12T02:35:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40d806be30 0x7f40d806e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40f815b2e0 0x7f40f81f4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40f80cdfc0 0x7f40f80c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 --2- 172.21.15.181:0/3552159596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40f80b2490 0x7f40f8156c50 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 >> 172.21.15.181:0/3552159596 conn(0x7f40f806bc10 msgr2=0x7f40f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 shutdown_connections 2024-09-12T02:35:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:58.603+0000 7f40fc837640 1 -- 172.21.15.181:0/3552159596 wait complete. 2024-09-12T02:35:58.615 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi181.front.sepia.ceph.com... 2024-09-12T02:35:58.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:58.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:35:58.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi181.stderr:ceph-fuse[65217]: fuse finished with error 0 and tester_r 0 2024-09-12T02:35:58.640 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:58.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:58.640 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:35:58.722 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:58.722 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:58.722 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:58.741 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:58.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:35:58.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:58.741 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:35:58.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:58.800 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-12T02:35:58.800 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:58.800 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:35:58.800 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:58.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:35:58.817 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:35:58.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:58.817 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:35:58.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:58.872 INFO:teuthology.orchestra.run.smithi181.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T02:35:58.872 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:35:58.872 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:35:58.872 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:58.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:35:58.892 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:35:58.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:58.892 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:35:58.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:35:58.950 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T02:35:58.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.048+0000 7fb375042640 1 Processor -- start 2024-09-12T02:35:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.048+0000 7fb375042640 1 -- start start 2024-09-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb375042640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb37015b1e0 0x7fb3700b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb375042640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3700b41d0 0x7fb3700b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb375042640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700cdfc0 0x7fb3700b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb375042640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb3700ce480 con 0x7fb3700b41d0 2024-09-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb375042640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb3700ce760 con 0x7fb37015b1e0 2024-09-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb375042640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb3700cea40 con 0x7fb3700cdfc0 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3700b41d0 0x7fb3700b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3700b41d0 0x7fb3700b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33460/0 (socket says 172.21.15.181:33460) 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 -- 172.21.15.181:0/2159048532 learned_addr learned my addr 172.21.15.181:0/2159048532 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 -- 172.21.15.181:0/2159048532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700cdfc0 msgr2=0x7fb3700b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 --2- 172.21.15.181:0/2159048532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700cdfc0 0x7fb3700b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 -- 172.21.15.181:0/2159048532 >> v2:172.21.15.204:3300/0 conn(0x7fb37015b1e0 msgr2=0x7fb3700b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 --2- 172.21.15.181:0/2159048532 >> v2:172.21.15.204:3300/0 conn(0x7fb37015b1e0 0x7fb3700b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.049+0000 7fb36659c640 1 -- 172.21.15.181:0/2159048532 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3700ced20 con 0x7fb3700b41d0 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.050+0000 7fb36659c640 1 --2- 172.21.15.181:0/2159048532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3700b41d0 0x7fb3700b1d80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb370069550 tx=0x7fb35802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409410036eff72b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.050+0000 7fb36e59c640 1 -- 172.21.15.181:0/2159048532 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358037070 con 0x7fb3700b41d0 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.050+0000 7fb36e59c640 1 -- 172.21.15.181:0/2159048532 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358032440 con 0x7fb3700b41d0 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.050+0000 7fb36e59c640 1 -- 172.21.15.181:0/2159048532 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358032810 con 0x7fb3700b41d0 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 -- 172.21.15.181:0/2159048532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3700b41d0 msgr2=0x7fb3700b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 --2- 172.21.15.181:0/2159048532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3700b41d0 0x7fb3700b1d80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb370069550 tx=0x7fb35802a200 comp rx=0 tx=0).stop 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 -- 172.21.15.181:0/2159048532 shutdown_connections 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 --2- 172.21.15.181:0/2159048532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700cdfc0 0x7fb3700b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 --2- 172.21.15.181:0/2159048532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3700b41d0 0x7fb3700b1d80 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 --2- 172.21.15.181:0/2159048532 >> v2:172.21.15.204:3300/0 conn(0x7fb37015b1e0 0x7fb3700b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 -- 172.21.15.181:0/2159048532 >> 172.21.15.181:0/2159048532 conn(0x7fb37006bc10 msgr2=0x7fb37006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 -- 172.21.15.181:0/2159048532 shutdown_connections 2024-09-12T02:35:59.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.051+0000 7fb375042640 1 -- 172.21.15.181:0/2159048532 wait complete. 2024-09-12T02:35:59.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.052+0000 7fb375042640 1 Processor -- start 2024-09-12T02:35:59.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.052+0000 7fb375042640 1 -- start start 2024-09-12T02:35:59.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb375042640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700b41d0 0x7fb37014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb375042640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3700cdfc0 0x7fb3700b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb375042640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37015b1e0 0x7fb37015c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb375042640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3700ccad0 con 0x7fb37015b1e0 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb375042640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb370071130 con 0x7fb3700cdfc0 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb375042640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb3700ccc50 con 0x7fb3700b41d0 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37015b1e0 0x7fb37015c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37015b1e0 0x7fb37015c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33468/0 (socket says 172.21.15.181:33468) 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 -- 172.21.15.181:0/2315199979 learned_addr learned my addr 172.21.15.181:0/2315199979 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36659c640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3700cdfc0 0x7fb3700b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36ed9d640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700b41d0 0x7fb37014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 -- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700b41d0 msgr2=0x7fb37014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700b41d0 0x7fb37014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 -- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3700cdfc0 msgr2=0x7fb3700b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3700cdfc0 0x7fb3700b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36f59e640 1 -- 172.21.15.181:0/2315199979 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37015df20 con 0x7fb37015b1e0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.053+0000 7fb36659c640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3700cdfc0 0x7fb3700b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.054+0000 7fb36f59e640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37015b1e0 0x7fb37015c480 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb36800b9e0 tx=0x7fb36800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.054+0000 7fb367fff640 1 -- 172.21.15.181:0/2315199979 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368019070 con 0x7fb37015b1e0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.054+0000 7fb367fff640 1 -- 172.21.15.181:0/2315199979 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36800cb20 con 0x7fb37015b1e0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.054+0000 7fb367fff640 1 -- 172.21.15.181:0/2315199979 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368014440 con 0x7fb37015b1e0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.054+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37015e200 con 0x7fb37015b1e0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.054+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3701f0280 con 0x7fb37015b1e0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.055+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3700b3c90 con 0x7fb37015b1e0 2024-09-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.055+0000 7fb367fff640 1 -- 172.21.15.181:0/2315199979 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb36801c070 con 0x7fb37015b1e0 2024-09-12T02:35:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.056+0000 7fb367fff640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb35006be30 0x7fb35006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.056+0000 7fb367fff640 1 -- 172.21.15.181:0/2315199979 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fb36808ab50 con 0x7fb37015b1e0 2024-09-12T02:35:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.056+0000 7fb36ed9d640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb35006be30 0x7fb35006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.056+0000 7fb36ed9d640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb35006be30 0x7fb35006e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb36000b810 tx=0x7fb360008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.060+0000 7fb367fff640 1 -- 172.21.15.181:0/2315199979 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb368059500 con 0x7fb37015b1e0 2024-09-12T02:35:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.258+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3701598f0 con 0x7fb37015b1e0 2024-09-12T02:35:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.259+0000 7fb367fff640 1 -- 172.21.15.181:0/2315199979 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7fb368058e00 con 0x7fb37015b1e0 2024-09-12T02:35:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:59.260 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":69,"btime":"2024-09-12T02:35:49:556212+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4144308809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4144308809},{"type":"v1","addr":"172.21.15.204:6834","nonce":4144308809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6676,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/73375387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":73375387},{"type":"v1","addr":"172.21.15.181:6837","nonce":73375387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3782132497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3782132497},{"type":"v1","addr":"172.21.15.181:6836","nonce":3782132497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:46.889359+0000","modified":"2024-09-12T02:35:48.892202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/3487360283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3487360283},{"type":"v1","addr":"172.21.15.204:6835","nonce":3487360283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":6}]} 2024-09-12T02:35:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 69 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb35006be30 msgr2=0x7fb35006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb35006be30 0x7fb35006e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb36000b810 tx=0x7fb360008040 comp rx=0 tx=0).stop 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37015b1e0 msgr2=0x7fb37015c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37015b1e0 0x7fb37015c480 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb36800b9e0 tx=0x7fb36800bea0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 shutdown_connections 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb35006be30 0x7fb35006e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb3700cdfc0 0x7fb3700b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb37015b1e0 0x7fb37015c480 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 --2- 172.21.15.181:0/2315199979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb3700b41d0 0x7fb37014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 >> 172.21.15.181:0/2315199979 conn(0x7fb37006bc10 msgr2=0x7fb3700716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 shutdown_connections 2024-09-12T02:35:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.261+0000 7fb375042640 1 -- 172.21.15.181:0/2315199979 wait complete. 2024-09-12T02:35:59.273 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.369+0000 7feedcc84640 1 Processor -- start 2024-09-12T02:35:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.369+0000 7feedcc84640 1 -- start start 2024-09-12T02:35:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feedcc84640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feed80d08f0 0x7feed815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feedcc84640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feed80b2820 con 0x7feed80b3800 2024-09-12T02:35:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feedcc84640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feed80b2b00 con 0x7feed80d0510 2024-09-12T02:35:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feedcc84640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7feed8141730 con 0x7feed80d08f0 2024-09-12T02:35:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feed6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feed80d08f0 0x7feed815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feecdd9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feed80b3800 0x7feed8072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53284/0 (socket says 172.21.15.181:53284) 2024-09-12T02:35:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feed6d9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feed80d08f0 0x7feed815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39346/0 (socket says 172.21.15.181:39346) 2024-09-12T02:35:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feecdd9b640 1 -- 172.21.15.181:0/3965313828 learned_addr learned my addr 172.21.15.181:0/3965313828 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feed6d9d640 1 -- 172.21.15.181:0/3965313828 >> v1:172.21.15.204:6789/0 conn(0x7feed80d0510 legacy=0x7feed80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feed6d9d640 1 -- 172.21.15.181:0/3965313828 >> v1:172.21.15.181:6789/0 conn(0x7feed80b3800 legacy=0x7feed8072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feed6d9d640 1 -- 172.21.15.181:0/3965313828 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed8144320 con 0x7feed80d08f0 2024-09-12T02:35:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.370+0000 7feed5d9b640 1 -- 172.21.15.181:0/3965313828 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020241946 0 0) 0x7feed80b2820 con 0x7feed80b3800 2024-09-12T02:35:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.371+0000 7feed6d9d640 1 --2- 172.21.15.181:0/3965313828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80d08f0 0x7feed815ef90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7feed0009d90 tx=0x7feed002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496926bb87387699 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.371+0000 7feed5d9b640 1 -- 172.21.15.181:0/3965313828 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0007740 con 0x7feed80d08f0 2024-09-12T02:35:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.371+0000 7feed5d9b640 1 -- 172.21.15.181:0/3965313828 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed00078e0 con 0x7feed80d08f0 2024-09-12T02:35:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.371+0000 7feed5d9b640 1 -- 172.21.15.181:0/3965313828 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0007cb0 con 0x7feed80d08f0 2024-09-12T02:35:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.372+0000 7feedcc84640 1 -- 172.21.15.181:0/3965313828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80d08f0 msgr2=0x7feed815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.372+0000 7feedcc84640 1 --2- 172.21.15.181:0/3965313828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80d08f0 0x7feed815ef90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7feed0009d90 tx=0x7feed002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.372+0000 7feedcc84640 1 -- 172.21.15.181:0/3965313828 shutdown_connections 2024-09-12T02:35:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.372+0000 7feedcc84640 1 --2- 172.21.15.181:0/3965313828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80d08f0 0x7feed815ef90 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.372+0000 7feedcc84640 1 -- 172.21.15.181:0/3965313828 >> 172.21.15.181:0/3965313828 conn(0x7feed806bc10 msgr2=0x7feed806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.372+0000 7feedcc84640 1 -- 172.21.15.181:0/3965313828 shutdown_connections 2024-09-12T02:35:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.372+0000 7feedcc84640 1 -- 172.21.15.181:0/3965313828 wait complete. 2024-09-12T02:35:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.373+0000 7feedcc84640 1 Processor -- start 2024-09-12T02:35:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.373+0000 7feedcc84640 1 -- start start 2024-09-12T02:35:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feedcc84640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80b3800 0x7feed815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feedcc84640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80d0510 0x7feed81366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feedcc84640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80d08f0 0x7feed80b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feedcc84640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feed8143bb0 con 0x7feed80b3800 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feedcc84640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7feed8142e70 con 0x7feed80d0510 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feedcc84640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7feed8143d30 con 0x7feed80d08f0 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80b3800 0x7feed815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80b3800 0x7feed815c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39358/0 (socket says 172.21.15.181:39358) 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed659c640 1 -- 172.21.15.181:0/1483404557 learned_addr learned my addr 172.21.15.181:0/1483404557 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feecdd9b640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80d0510 0x7feed81366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed6d9d640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80d08f0 0x7feed80b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed659c640 1 -- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80d08f0 msgr2=0x7feed80b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed659c640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80d08f0 0x7feed80b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed659c640 1 -- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80d0510 msgr2=0x7feed81366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.374+0000 7feed659c640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80d0510 0x7feed81366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feed659c640 1 -- 172.21.15.181:0/1483404557 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed815cec0 con 0x7feed80b3800 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feecdd9b640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80d0510 0x7feed81366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feed659c640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80b3800 0x7feed815c830 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7feec800c480 tx=0x7feec800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feecf7fe640 1 -- 172.21.15.181:0/1483404557 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec80052d0 con 0x7feed80b3800 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feecf7fe640 1 -- 172.21.15.181:0/1483404557 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec8005470 con 0x7feed80b3800 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed815d1a0 con 0x7feed80b3800 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feecf7fe640 1 -- 172.21.15.181:0/1483404557 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8012870 con 0x7feed80b3800 2024-09-12T02:35:59.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.375+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed815a800 con 0x7feed80b3800 2024-09-12T02:35:59.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.376+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed815ef90 con 0x7feed80b3800 2024-09-12T02:35:59.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.376+0000 7feecf7fe640 1 -- 172.21.15.181:0/1483404557 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feec8012a10 con 0x7feed80b3800 2024-09-12T02:35:59.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.377+0000 7feecf7fe640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7feeb806be30 0x7feeb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.377+0000 7feecf7fe640 1 -- 172.21.15.181:0/1483404557 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7feec808aa80 con 0x7feed80b3800 2024-09-12T02:35:59.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.377+0000 7feecdd9b640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7feeb806be30 0x7feeb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.377+0000 7feecdd9b640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7feeb806be30 0x7feeb806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7feed806da90 tx=0x7feec0007c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.381+0000 7feecf7fe640 1 -- 172.21.15.181:0/1483404557 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feec80594c0 con 0x7feed80b3800 2024-09-12T02:35:59.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.578+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feed806d7e0 con 0x7feed80b3800 2024-09-12T02:35:59.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.578+0000 7feecf7fe640 1 -- 172.21.15.181:0/1483404557 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7feec8058dc0 con 0x7feed80b3800 2024-09-12T02:35:59.580 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":69,"btime":"2024-09-12T02:35:49:556212+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4144308809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4144308809},{"type":"v1","addr":"172.21.15.204:6834","nonce":4144308809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6676,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/73375387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":73375387},{"type":"v1","addr":"172.21.15.181:6837","nonce":73375387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3782132497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3782132497},{"type":"v1","addr":"172.21.15.181:6836","nonce":3782132497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:46.889359+0000","modified":"2024-09-12T02:35:48.892202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/3487360283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3487360283},{"type":"v1","addr":"172.21.15.204:6835","nonce":3487360283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":6}]} 2024-09-12T02:35:59.580 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 69 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.580+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7feeb806be30 msgr2=0x7feeb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7feeb806be30 0x7feeb806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7feed806da90 tx=0x7feec0007c50 comp rx=0 tx=0).stop 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80b3800 msgr2=0x7feed815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80b3800 0x7feed815c830 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7feec800c480 tx=0x7feec800c940 comp rx=0 tx=0).stop 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 shutdown_connections 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7feeb806be30 0x7feeb806e2f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80d0510 0x7feed81366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80d08f0 0x7feed80b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 --2- 172.21.15.181:0/1483404557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feed80b3800 0x7feed815c830 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 >> 172.21.15.181:0/1483404557 conn(0x7feed806bc10 msgr2=0x7feed815e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 shutdown_connections 2024-09-12T02:35:59.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.581+0000 7feedcc84640 1 -- 172.21.15.181:0/1483404557 wait complete. 2024-09-12T02:35:59.593 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:35:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.690+0000 7fec5771a640 1 Processor -- start 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.690+0000 7fec5771a640 1 -- start start 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec5771a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec5015e670 0x7fec50070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec5771a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fec500cef50 0x7fec5015f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec5771a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500cf400 con 0x7fec500ceaf0 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec5771a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fec500d0040 con 0x7fec500cef50 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec5771a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fec50072f80 con 0x7fec5015e670 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec55cb7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fec500cef50 0x7fec5015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec54cb5640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fec500ceaf0 0x7fec5015ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53288/0 (socket says 172.21.15.181:53288) 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec54cb5640 1 -- 172.21.15.181:0/4132682061 learned_addr learned my addr 172.21.15.181:0/4132682061 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec55cb7640 1 -- 172.21.15.181:0/4132682061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec5015e670 msgr2=0x7fec50070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec554b6640 1 --2- 172.21.15.181:0/4132682061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec5015e670 0x7fec50070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec47fff640 1 -- 172.21.15.181:0/4132682061 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425289746 0 0) 0x7fec500cf400 con 0x7fec500ceaf0 2024-09-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec55cb7640 1 --2- 172.21.15.181:0/4132682061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec5015e670 0x7fec50070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec55cb7640 1 -- 172.21.15.181:0/4132682061 >> v1:172.21.15.181:6789/0 conn(0x7fec500ceaf0 legacy=0x7fec5015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec55cb7640 1 -- 172.21.15.181:0/4132682061 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500731d0 con 0x7fec500cef50 2024-09-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.691+0000 7fec554b6640 1 --2- 172.21.15.181:0/4132682061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec5015e670 0x7fec50070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.692+0000 7fec55cb7640 1 --2- 172.21.15.181:0/4132682061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec500cef50 0x7fec5015f160 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec480097a0 tx=0x7fec4802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c33371abc2ad9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.692+0000 7fec47fff640 1 -- 172.21.15.181:0/4132682061 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48037070 con 0x7fec500cef50 2024-09-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.692+0000 7fec47fff640 1 -- 172.21.15.181:0/4132682061 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec48032440 con 0x7fec500cef50 2024-09-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.692+0000 7fec47fff640 1 -- 172.21.15.181:0/4132682061 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48032810 con 0x7fec500cef50 2024-09-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 -- 172.21.15.181:0/4132682061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec500cef50 msgr2=0x7fec5015f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 --2- 172.21.15.181:0/4132682061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec500cef50 0x7fec5015f160 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec480097a0 tx=0x7fec4802a210 comp rx=0 tx=0).stop 2024-09-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 -- 172.21.15.181:0/4132682061 shutdown_connections 2024-09-12T02:35:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 --2- 172.21.15.181:0/4132682061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec500cef50 0x7fec5015f160 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 --2- 172.21.15.181:0/4132682061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec5015e670 0x7fec50070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 -- 172.21.15.181:0/4132682061 >> 172.21.15.181:0/4132682061 conn(0x7fec5006f400 msgr2=0x7fec5006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 -- 172.21.15.181:0/4132682061 shutdown_connections 2024-09-12T02:35:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.693+0000 7fec5771a640 1 -- 172.21.15.181:0/4132682061 wait complete. 2024-09-12T02:35:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.694+0000 7fec5771a640 1 Processor -- start 2024-09-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.694+0000 7fec5771a640 1 -- start start 2024-09-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec5771a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec500ceaf0 0x7fec50140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec5771a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec500cef50 0x7fec5015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec5771a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec5015e670 0x7fec5015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec5771a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fec50073790 con 0x7fec5015e670 2024-09-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec5771a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fec50073de0 con 0x7fec500ceaf0 2024-09-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec5771a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fec50073a70 con 0x7fec500cef50 2024-09-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec5015e670 0x7fec5015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec5015e670 0x7fec5015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39380/0 (socket says 172.21.15.181:39380) 2024-09-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 -- 172.21.15.181:0/4219210505 learned_addr learned my addr 172.21.15.181:0/4219210505 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 -- 172.21.15.181:0/4219210505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec500cef50 msgr2=0x7fec5015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec500cef50 0x7fec5015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 -- 172.21.15.181:0/4219210505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec500ceaf0 msgr2=0x7fec50140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec554b6640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec500ceaf0 0x7fec50140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec500ceaf0 0x7fec50140080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 -- 172.21.15.181:0/4219210505 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500d30c0 con 0x7fec5015e670 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.695+0000 7fec55cb7640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec5015e670 0x7fec5015a6c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fec48035040 tx=0x7fec480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.696+0000 7fec45ffb640 1 -- 172.21.15.181:0/4219210505 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48037050 con 0x7fec5015e670 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.696+0000 7fec45ffb640 1 -- 172.21.15.181:0/4219210505 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec48038040 con 0x7fec5015e670 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.696+0000 7fec45ffb640 1 -- 172.21.15.181:0/4219210505 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48004490 con 0x7fec5015e670 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.696+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec500d0d80 con 0x7fec5015e670 2024-09-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.696+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec500d1340 con 0x7fec5015e670 2024-09-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.697+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50071410 con 0x7fec5015e670 2024-09-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.697+0000 7fec45ffb640 1 -- 172.21.15.181:0/4219210505 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec48030980 con 0x7fec5015e670 2024-09-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.698+0000 7fec45ffb640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fec3406be60 0x7fec3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.698+0000 7fec45ffb640 1 -- 172.21.15.181:0/4219210505 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fec480aba60 con 0x7fec5015e670 2024-09-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.698+0000 7fec554b6640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fec3406be60 0x7fec3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.698+0000 7fec554b6640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fec3406be60 0x7fec3406e320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fec4c008ee0 tx=0x7fec4c008430 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.702+0000 7fec45ffb640 1 -- 172.21.15.181:0/4219210505 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec48032e20 con 0x7fec5015e670 2024-09-12T02:35:59.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.868+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec500b1150 con 0x7fec5015e670 2024-09-12T02:35:59.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.870+0000 7fec45ffb640 1 -- 172.21.15.181:0/4219210505 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16792 (secure 0 0 0) 0x7fec4807a4a0 con 0x7fec5015e670 2024-09-12T02:35:59.871 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:35:59.871 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":87,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:48.548645+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:45.493049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:45.855137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fec3406be60 msgr2=0x7fec3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fec3406be60 0x7fec3406e320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fec4c008ee0 tx=0x7fec4c008430 comp rx=0 tx=0).stop 2024-09-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec5015e670 msgr2=0x7fec5015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec5015e670 0x7fec5015a6c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fec48035040 tx=0x7fec480046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 shutdown_connections 2024-09-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fec3406be60 0x7fec3406e320 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec5015e670 0x7fec5015a6c0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fec500cef50 0x7fec5015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 --2- 172.21.15.181:0/4219210505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fec500ceaf0 0x7fec50140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 >> 172.21.15.181:0/4219210505 conn(0x7fec5006f400 msgr2=0x7fec500b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 shutdown_connections 2024-09-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.872+0000 7fec5771a640 1 -- 172.21.15.181:0/4219210505 wait complete. 2024-09-12T02:35:59.884 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:35:59.885 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:35:59.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.981+0000 7fd1324e6640 1 Processor -- start 2024-09-12T02:35:59.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.981+0000 7fd1324e6640 1 -- start start 2024-09-12T02:35:59.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.982+0000 7fd1324e6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0cd880 0x7fd12c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.982+0000 7fd1324e6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd12c0b22c0 0x7fd12c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.982+0000 7fd1324e6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12c0ce160 con 0x7fd12c156990 2024-09-12T02:35:59.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.982+0000 7fd1324e6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd12c156d70 con 0x7fd12c0b22c0 2024-09-12T02:35:59.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.982+0000 7fd1324e6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd12c0cea90 con 0x7fd12c0cd880 2024-09-12T02:35:59.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0cd880 0x7fd12c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd130a83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd12c0b22c0 0x7fd12c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd130a83640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd12c0b22c0 0x7fd12c15c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.181:39644/0 (socket says 172.21.15.181:39644) 2024-09-12T02:35:59.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd130a83640 1 -- 172.21.15.181:0/2702162326 learned_addr learned my addr 172.21.15.181:0/2702162326 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd12b7fe640 1 -- 172.21.15.181:0/2702162326 >> v2:172.21.15.204:3300/0 conn(0x7fd12c0b22c0 msgr2=0x7fd12c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd12b7fe640 1 --2- 172.21.15.181:0/2702162326 >> v2:172.21.15.204:3300/0 conn(0x7fd12c0b22c0 0x7fd12c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd12b7fe640 1 -- 172.21.15.181:0/2702162326 >> v1:172.21.15.204:6789/0 conn(0x7fd12c156990 legacy=0x7fd12c0cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd12b7fe640 1 -- 172.21.15.181:0/2702162326 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c0731f0 con 0x7fd12c0cd880 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.983+0000 7fd130a83640 1 --2- 172.21.15.181:0/2702162326 >> v2:172.21.15.204:3300/0 conn(0x7fd12c0b22c0 0x7fd12c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.984+0000 7fd12b7fe640 1 --2- 172.21.15.181:0/2702162326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0cd880 0x7fd12c0b1d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1200097a0 tx=0x7fd12002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b93afb5eb9b3a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.984+0000 7fd12affd640 1 -- 172.21.15.181:0/2702162326 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120037070 con 0x7fd12c0cd880 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.984+0000 7fd12affd640 1 -- 172.21.15.181:0/2702162326 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12002ae50 con 0x7fd12c0cd880 2024-09-12T02:35:59.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.984+0000 7fd12affd640 1 -- 172.21.15.181:0/2702162326 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120032660 con 0x7fd12c0cd880 2024-09-12T02:35:59.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 -- 172.21.15.181:0/2702162326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0cd880 msgr2=0x7fd12c0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 --2- 172.21.15.181:0/2702162326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0cd880 0x7fd12c0b1d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1200097a0 tx=0x7fd12002a100 comp rx=0 tx=0).stop 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 -- 172.21.15.181:0/2702162326 shutdown_connections 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 --2- 172.21.15.181:0/2702162326 >> v2:172.21.15.204:3300/0 conn(0x7fd12c0b22c0 0x7fd12c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 --2- 172.21.15.181:0/2702162326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0cd880 0x7fd12c0b1d80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 -- 172.21.15.181:0/2702162326 >> 172.21.15.181:0/2702162326 conn(0x7fd12c06bc10 msgr2=0x7fd12c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 -- 172.21.15.181:0/2702162326 shutdown_connections 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.985+0000 7fd1324e6640 1 -- 172.21.15.181:0/2702162326 wait complete. 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.986+0000 7fd1324e6640 1 Processor -- start 2024-09-12T02:35:59.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.986+0000 7fd1324e6640 1 -- start start 2024-09-12T02:35:59.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd1324e6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0b22c0 0x7fd12c0b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd1324e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd12c0cd880 0x7fd12c14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd1324e6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12c156990 0x7fd12c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd1324e6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c0b26d0 con 0x7fd12c0cd880 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd1324e6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c0ce720 con 0x7fd12c156990 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd1324e6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd12c0cef20 con 0x7fd12c0b22c0 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd12c0cd880 0x7fd12c14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd12c0cd880 0x7fd12c14c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39384/0 (socket says 172.21.15.181:39384) 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 -- 172.21.15.181:0/868565208 learned_addr learned my addr 172.21.15.181:0/868565208 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd130a83640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12c156990 0x7fd12c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12bfff640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0b22c0 0x7fd12c0b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 -- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0b22c0 msgr2=0x7fd12c0b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0b22c0 0x7fd12c0b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 -- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12c156990 msgr2=0x7fd12c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12c156990 0x7fd12c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 -- 172.21.15.181:0/868565208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c15e860 con 0x7fd12c0cd880 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.987+0000 7fd12b7fe640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd12c0cd880 0x7fd12c14c510 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd120035040 tx=0x7fd1200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.988+0000 7fd128ff9640 1 -- 172.21.15.181:0/868565208 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120041070 con 0x7fd12c0cd880 2024-09-12T02:35:59.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.988+0000 7fd128ff9640 1 -- 172.21.15.181:0/868565208 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12003c460 con 0x7fd12c0cd880 2024-09-12T02:35:59.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.988+0000 7fd128ff9640 1 -- 172.21.15.181:0/868565208 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120037040 con 0x7fd12c0cd880 2024-09-12T02:35:59.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.988+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12c15eb40 con 0x7fd12c0cd880 2024-09-12T02:35:59.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.988+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd12c15f100 con 0x7fd12c0cd880 2024-09-12T02:35:59.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.989+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12c0b1d80 con 0x7fd12c0cd880 2024-09-12T02:35:59.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.989+0000 7fd128ff9640 1 -- 172.21.15.181:0/868565208 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd12003a070 con 0x7fd12c0cd880 2024-09-12T02:35:59.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.989+0000 7fd128ff9640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd11806be30 0x7fd11806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.989+0000 7fd128ff9640 1 -- 172.21.15.181:0/868565208 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fd1200ab030 con 0x7fd12c0cd880 2024-09-12T02:35:59.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.990+0000 7fd12bfff640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd11806be30 0x7fd11806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.990+0000 7fd12bfff640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd11806be30 0x7fd11806e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd11c001780 tx=0x7fd11c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:35:59.994+0000 7fd128ff9640 1 -- 172.21.15.181:0/868565208 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd120079390 con 0x7fd12c0cd880 2024-09-12T02:36:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.192+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd12c155600 con 0x7fd12c0cd880 2024-09-12T02:36:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.193+0000 7fd128ff9640 1 -- 172.21.15.181:0/868565208 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7fd12007d690 con 0x7fd12c0cd880 2024-09-12T02:36:00.194 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:00.194 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":69,"btime":"2024-09-12T02:35:49:556212+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4144308809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4144308809},{"type":"v1","addr":"172.21.15.204:6834","nonce":4144308809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6676,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/73375387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":73375387},{"type":"v1","addr":"172.21.15.181:6837","nonce":73375387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3782132497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3782132497},{"type":"v1","addr":"172.21.15.181:6836","nonce":3782132497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:46.889359+0000","modified":"2024-09-12T02:35:48.892202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/3487360283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3487360283},{"type":"v1","addr":"172.21.15.204:6835","nonce":3487360283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":6}]} 2024-09-12T02:36:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 69 2024-09-12T02:36:00.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd11806be30 msgr2=0x7fd11806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd11806be30 0x7fd11806e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd11c001780 tx=0x7fd11c009040 comp rx=0 tx=0).stop 2024-09-12T02:36:00.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd12c0cd880 msgr2=0x7fd12c14c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd12c0cd880 0x7fd12c14c510 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd120035040 tx=0x7fd1200046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 shutdown_connections 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd11806be30 0x7fd11806e2f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd12c156990 0x7fd12c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd12c0cd880 0x7fd12c14c510 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 --2- 172.21.15.181:0/868565208 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd12c0b22c0 0x7fd12c0b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 >> 172.21.15.181:0/868565208 conn(0x7fd12c06bc10 msgr2=0x7fd12c0733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 shutdown_connections 2024-09-12T02:36:00.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.195+0000 7fd1324e6640 1 -- 172.21.15.181:0/868565208 wait complete. 2024-09-12T02:36:00.208 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:36:00.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.306+0000 7f0a8b6f8640 1 Processor -- start 2024-09-12T02:36:00.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.306+0000 7f0a8b6f8640 1 -- start start 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a8b6f8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0a8415b2e0 0x7f0a840b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a8b6f8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a840ce4f0 con 0x7f0a840cdfc0 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a8b6f8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a840ce7d0 con 0x7f0a840b2490 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a8b6f8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f0a8415b6c0 con 0x7f0a8415b2e0 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a88c93640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0a840cdfc0 0x7f0a840b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53296/0 (socket says 172.21.15.181:53296) 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a88c93640 1 -- 172.21.15.181:0/553096267 learned_addr learned my addr 172.21.15.181:0/553096267 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a89494640 1 --2- 172.21.15.181:0/553096267 >> v2:172.21.15.204:3300/0 conn(0x7f0a8415b2e0 0x7f0a840b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352443388 0 0) 0x7f0a840ce4f0 con 0x7f0a840cdfc0 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a70003520 con 0x7f0a840cdfc0 2024-09-12T02:36:00.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2075563408 0 0) 0x7f0a70003520 con 0x7f0a840cdfc0 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 >> v2:172.21.15.204:3300/0 conn(0x7f0a8415b2e0 msgr2=0x7f0a840b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 --2- 172.21.15.181:0/553096267 >> v2:172.21.15.204:3300/0 conn(0x7f0a8415b2e0 0x7f0a840b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 >> v1:172.21.15.204:6789/0 conn(0x7f0a840b2490 legacy=0x7f0a84071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a840ceab0 con 0x7f0a840cdfc0 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f0a74001670 con 0x7f0a840cdfc0 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 >> v1:172.21.15.181:6789/0 conn(0x7f0a840cdfc0 legacy=0x7f0a840b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a700039b0 0x7f0a70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a70004800 0x7f0a70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.307+0000 7f0a7bfff640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7000c130 con 0x7f0a700051c0 2024-09-12T02:36:00.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7000c2e0 con 0x7f0a700039b0 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7000c4e0 con 0x7f0a70004800 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89494640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a700039b0 0x7f0a70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89c95640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a88c93640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a70004800 0x7f0a70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89c95640 1 -- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a70004800 msgr2=0x7f0a70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89c95640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a70004800 0x7f0a70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89c95640 1 -- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a700039b0 msgr2=0x7f0a70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89c95640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a700039b0 0x7f0a70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89c95640 1 -- 172.21.15.181:0/553096267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a70003520 con 0x7f0a700051c0 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a88c93640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a70004800 0x7f0a70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.308+0000 7f0a89c95640 1 -- 172.21.15.181:0/553096267 reap_dead start 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a89c95640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a7000b9c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0a84070f00 tx=0x7f0a70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d38335094a437 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c001a70 con 0x7f0a700051c0 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7c02ae10 con 0x7f0a700051c0 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a7bfff640 1 -- 172.21.15.181:0/553096267 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c003bb0 con 0x7f0a700051c0 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/553096267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 msgr2=0x7f0a7000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a7000b9c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0a84070f00 tx=0x7f0a70005830 comp rx=0 tx=0).stop 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/553096267 shutdown_connections 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/553096267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a7000b9c0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/553096267 >> 172.21.15.181:0/553096267 conn(0x7f0a8406bc10 msgr2=0x7f0a8406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/553096267 shutdown_connections 2024-09-12T02:36:00.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.309+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/553096267 wait complete. 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.310+0000 7f0a8b6f8640 1 Processor -- start 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a8b6f8640 1 -- start start 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a8b6f8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a84149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a8b6f8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a8415b6c0 0x7f0a8415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a8b6f8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a84152c40 0x7f0a8415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a8b6f8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a840712b0 con 0x7f0a700051c0 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a8b6f8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84071130 con 0x7f0a8415b6c0 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a8b6f8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0a840b1d80 con 0x7f0a84152c40 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a89494640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a84149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a89494640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a84149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39412/0 (socket says 172.21.15.181:39412) 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a89494640 1 -- 172.21.15.181:0/592275578 learned_addr learned my addr 172.21.15.181:0/592275578 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:00.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a89c95640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a84152c40 0x7f0a8415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.311+0000 7f0a88c93640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a8415b6c0 0x7f0a8415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a89494640 1 -- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a84152c40 msgr2=0x7f0a8415db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a89494640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a84152c40 0x7f0a8415db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a89494640 1 -- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a8415b6c0 msgr2=0x7f0a8415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a89494640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a8415b6c0 0x7f0a8415c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a89494640 1 -- 172.21.15.181:0/592275578 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8414a470 con 0x7f0a700051c0 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a88c93640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a8415b6c0 0x7f0a8415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a89494640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a84149f30 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0a80011940 tx=0x7f0a80011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a79ffb640 1 -- 172.21.15.181:0/592275578 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000fa90 con 0x7f0a700051c0 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a79ffb640 1 -- 172.21.15.181:0/592275578 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8000fc30 con 0x7f0a700051c0 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a84071650 con 0x7f0a700051c0 2024-09-12T02:36:00.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a79ffb640 1 -- 172.21.15.181:0/592275578 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80014440 con 0x7f0a700051c0 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.312+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a84071bf0 con 0x7f0a700051c0 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.313+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a840b2110 con 0x7f0a700051c0 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.314+0000 7f0a79ffb640 1 -- 172.21.15.181:0/592275578 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a80012040 con 0x7f0a700051c0 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.314+0000 7f0a79ffb640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0a6806be60 0x7f0a6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.314+0000 7f0a79ffb640 1 -- 172.21.15.181:0/592275578 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f0a8008b4a0 con 0x7f0a700051c0 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.314+0000 7f0a88c93640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0a6806be60 0x7f0a6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.315+0000 7f0a88c93640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0a6806be60 0x7f0a6806e320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001eb0 tx=0x7f0a74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.318+0000 7f0a79ffb640 1 -- 172.21.15.181:0/592275578 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a8414a470 con 0x7f0a700051c0 2024-09-12T02:36:00.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.518+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a840b4390 con 0x7f0a700051c0 2024-09-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.518+0000 7f0a79ffb640 1 -- 172.21.15.181:0/592275578 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7f0a80019030 con 0x7f0a700051c0 2024-09-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":69,"btime":"2024-09-12T02:35:49:556212+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4144308809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4144308809},{"type":"v1","addr":"172.21.15.204:6834","nonce":4144308809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6676,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/73375387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":73375387},{"type":"v1","addr":"172.21.15.181:6837","nonce":73375387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3782132497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3782132497},{"type":"v1","addr":"172.21.15.181:6836","nonce":3782132497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:46.889359+0000","modified":"2024-09-12T02:35:48.892202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6835/3487360283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3487360283},{"type":"v1","addr":"172.21.15.204:6835","nonce":3487360283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":6}]} 2024-09-12T02:36:00.520 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 69 2024-09-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0a6806be60 msgr2=0x7f0a6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0a6806be60 0x7f0a6806e320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001eb0 tx=0x7f0a74009040 comp rx=0 tx=0).stop 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 msgr2=0x7f0a84149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a84149f30 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0a80011940 tx=0x7f0a80011e00 comp rx=0 tx=0).stop 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 shutdown_connections 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0a6806be60 0x7f0a6806e320 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0a8415b6c0 0x7f0a8415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0a84152c40 0x7f0a8415db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 --2- 172.21.15.181:0/592275578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a700051c0 0x7f0a84149f30 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 >> 172.21.15.181:0/592275578 conn(0x7f0a8406bc10 msgr2=0x7f0a840b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.520+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 shutdown_connections 2024-09-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.521+0000 7f0a8b6f8640 1 -- 172.21.15.181:0/592275578 wait complete. 2024-09-12T02:36:00.533 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:36:00.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.633+0000 7f7cc40dd640 1 Processor -- start 2024-09-12T02:36:00.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.633+0000 7f7cc40dd640 1 -- start start 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc40dd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7cbc0b3800 0x7f7cbc15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc40dd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7cbc0d08f0 0x7f7cbc072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc40dd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cbc0b2820 con 0x7f7cbc0d0510 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc40dd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7cbc0b2b00 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc40dd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7cbc141730 con 0x7f7cbc0b3800 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc267a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7cbc0d08f0 0x7f7cbc072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc1e79640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7cbc0d0510 0x7f7cbc0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53308/0 (socket says 172.21.15.181:53308) 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc1e79640 1 -- 172.21.15.181:0/3750068796 learned_addr learned my addr 172.21.15.181:0/3750068796 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc267a640 1 -- 172.21.15.181:0/3750068796 >> v2:172.21.15.204:3300/0 conn(0x7f7cbc0b3800 msgr2=0x7f7cbc15ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc1678640 1 --2- 172.21.15.181:0/3750068796 >> v2:172.21.15.204:3300/0 conn(0x7f7cbc0b3800 0x7f7cbc15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc267a640 1 --2- 172.21.15.181:0/3750068796 >> v2:172.21.15.204:3300/0 conn(0x7f7cbc0b3800 0x7f7cbc15ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc267a640 1 -- 172.21.15.181:0/3750068796 >> v1:172.21.15.181:6789/0 conn(0x7f7cbc0d0510 legacy=0x7f7cbc0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc0e77640 1 -- 172.21.15.181:0/3750068796 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427272931 0 0) 0x7f7cbc0b2820 con 0x7f7cbc0d0510 2024-09-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc267a640 1 -- 172.21.15.181:0/3750068796 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc144320 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.634+0000 7f7cc1678640 1 --2- 172.21.15.181:0/3750068796 >> v2:172.21.15.204:3300/0 conn(0x7f7cbc0b3800 0x7f7cbc15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.635+0000 7f7cc267a640 1 --2- 172.21.15.181:0/3750068796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc072e70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0697d0 tx=0x7f7cb402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80159ef8969b6c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.635+0000 7f7cc0e77640 1 -- 172.21.15.181:0/3750068796 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4032790 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.635+0000 7f7cc0e77640 1 -- 172.21.15.181:0/3750068796 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb4038070 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.635+0000 7f7cc0e77640 1 -- 172.21.15.181:0/3750068796 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4032b50 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 -- 172.21.15.181:0/3750068796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 msgr2=0x7f7cbc072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/3750068796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc072e70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0697d0 tx=0x7f7cb402c890 comp rx=0 tx=0).stop 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 -- 172.21.15.181:0/3750068796 shutdown_connections 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/3750068796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc072e70 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/3750068796 >> v2:172.21.15.204:3300/0 conn(0x7f7cbc0b3800 0x7f7cbc15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 -- 172.21.15.181:0/3750068796 >> 172.21.15.181:0/3750068796 conn(0x7f7cbc06bc10 msgr2=0x7f7cbc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 -- 172.21.15.181:0/3750068796 shutdown_connections 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.636+0000 7f7cc40dd640 1 -- 172.21.15.181:0/3750068796 wait complete. 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.637+0000 7f7cc40dd640 1 Processor -- start 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.637+0000 7f7cc40dd640 1 -- start start 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc40dd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cbc0b3800 0x7f7cbc1f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc40dd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cbc0d0510 0x7f7cbc0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc40dd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc40dd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc0b1df0 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc40dd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc143dc0 con 0x7f7cbc0b3800 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc40dd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7cbc0b1f70 con 0x7f7cbc0d0510 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39426/0 (socket says 172.21.15.181:39426) 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 -- 172.21.15.181:0/1691908885 learned_addr learned my addr 172.21.15.181:0/1691908885 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc1e79640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cbc0b3800 0x7f7cbc1f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc1678640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cbc0d0510 0x7f7cbc0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 -- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cbc0d0510 msgr2=0x7f7cbc0aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cbc0d0510 0x7f7cbc0aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 -- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cbc0b3800 msgr2=0x7f7cbc1f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cbc0b3800 0x7f7cbc1f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 -- 172.21.15.181:0/1691908885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc1409b0 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc1678640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cbc0d0510 0x7f7cbc0aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.638+0000 7f7cc267a640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc140470 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4035040 tx=0x7f7cb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.639+0000 7f7cb27fc640 1 -- 172.21.15.181:0/1691908885 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4033620 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.639+0000 7f7cb27fc640 1 -- 172.21.15.181:0/1691908885 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb40337e0 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.639+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cbc15b0b0 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.639+0000 7f7cb27fc640 1 -- 172.21.15.181:0/1691908885 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4033bd0 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.639+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cbc1f3580 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.639+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cbc143320 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.640+0000 7f7cb27fc640 1 -- 172.21.15.181:0/1691908885 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cb40473f0 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.640+0000 7f7cb27fc640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7ca006be30 0x7f7ca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.641+0000 7f7cb27fc640 1 -- 172.21.15.181:0/1691908885 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f7cb40ae080 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.641+0000 7f7cc1e79640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7ca006be30 0x7f7ca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.641+0000 7f7cc1e79640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7ca006be30 0x7f7ca006e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000f60 tx=0x7f7cb8007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.645+0000 7f7cb27fc640 1 -- 172.21.15.181:0/1691908885 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cbc143320 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.809+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cbc1f4320 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.810+0000 7f7cb27fc640 1 -- 172.21.15.181:0/1691908885 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16792 (secure 0 0 0) 0x7f7cb4042070 con 0x7f7cbc0d08f0 2024-09-12T02:36:00.811 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:00.812 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":87,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:35:48.548645+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:35:45.493049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:45.855137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:00.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7ca006be30 msgr2=0x7f7ca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7ca006be30 0x7f7ca006e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000f60 tx=0x7f7cb8007b50 comp rx=0 tx=0).stop 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 msgr2=0x7f7cbc140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc140470 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4035040 tx=0x7f7cb4004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 shutdown_connections 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f7ca006be30 0x7f7ca006e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cbc0d08f0 0x7f7cbc140470 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cbc0d0510 0x7f7cbc0aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.812+0000 7f7cc40dd640 1 --2- 172.21.15.181:0/1691908885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cbc0b3800 0x7f7cbc1f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.813+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 >> 172.21.15.181:0/1691908885 conn(0x7f7cbc06bc10 msgr2=0x7f7cbc073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:00.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.813+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 shutdown_connections 2024-09-12T02:36:00.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.813+0000 7f7cc40dd640 1 -- 172.21.15.181:0/1691908885 wait complete. 2024-09-12T02:36:00.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:36:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.923+0000 7f98def0a640 1 Processor -- start 2024-09-12T02:36:00.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.923+0000 7f98def0a640 1 -- start start 2024-09-12T02:36:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98def0a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98d80b3800 0x7f98d815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98def0a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d80b2820 con 0x7f98d80d08f0 2024-09-12T02:36:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98def0a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d80b2b00 con 0x7f98d80d0510 2024-09-12T02:36:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98def0a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f98d8141730 con 0x7f98d80b3800 2024-09-12T02:36:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98cffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98d80b3800 0x7f98d815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98dd4a7640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f98d80d08f0 0x7f98d80b1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53314/0 (socket says 172.21.15.181:53314) 2024-09-12T02:36:00.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98dd4a7640 1 -- 172.21.15.181:0/2117457206 learned_addr learned my addr 172.21.15.181:0/2117457206 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98cffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98d80b3800 0x7f98d815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39442/0 (socket says 172.21.15.181:39442) 2024-09-12T02:36:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98cffff640 1 -- 172.21.15.181:0/2117457206 >> v1:172.21.15.204:6789/0 conn(0x7f98d80d0510 legacy=0x7f98d80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98cffff640 1 -- 172.21.15.181:0/2117457206 >> v1:172.21.15.181:6789/0 conn(0x7f98d80d08f0 legacy=0x7f98d80b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.924+0000 7f98cffff640 1 -- 172.21.15.181:0/2117457206 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d80b2500 con 0x7f98d80b3800 2024-09-12T02:36:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.925+0000 7f98cffff640 1 --2- 172.21.15.181:0/2117457206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80b3800 0x7f98d815ef90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f98c80097a0 tx=0x7f98c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1d6f40d07222ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.925+0000 7f98cf7fe640 1 -- 172.21.15.181:0/2117457206 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8037070 con 0x7f98d80b3800 2024-09-12T02:36:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.925+0000 7f98cf7fe640 1 -- 172.21.15.181:0/2117457206 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c8032440 con 0x7f98d80b3800 2024-09-12T02:36:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.925+0000 7f98cf7fe640 1 -- 172.21.15.181:0/2117457206 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8032810 con 0x7f98d80b3800 2024-09-12T02:36:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.926+0000 7f98def0a640 1 -- 172.21.15.181:0/2117457206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80b3800 msgr2=0x7f98d815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.926+0000 7f98def0a640 1 --2- 172.21.15.181:0/2117457206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80b3800 0x7f98d815ef90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f98c80097a0 tx=0x7f98c802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.926+0000 7f98def0a640 1 -- 172.21.15.181:0/2117457206 shutdown_connections 2024-09-12T02:36:00.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.926+0000 7f98def0a640 1 --2- 172.21.15.181:0/2117457206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80b3800 0x7f98d815ef90 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.926+0000 7f98def0a640 1 -- 172.21.15.181:0/2117457206 >> 172.21.15.181:0/2117457206 conn(0x7f98d806bc10 msgr2=0x7f98d806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:00.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.926+0000 7f98def0a640 1 -- 172.21.15.181:0/2117457206 shutdown_connections 2024-09-12T02:36:00.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.926+0000 7f98def0a640 1 -- 172.21.15.181:0/2117457206 wait complete. 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.927+0000 7f98def0a640 1 Processor -- start 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.927+0000 7f98def0a640 1 -- start start 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98def0a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98d80b3800 0x7f98d81f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98def0a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98d80d0510 0x7f98d815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98def0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80d08f0 0x7f98d8072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98def0a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f98d8142ee0 con 0x7f98d80d08f0 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98def0a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f98d8142d60 con 0x7f98d80d0510 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98def0a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f98d8143bb0 con 0x7f98d80b3800 2024-09-12T02:36:00.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80d08f0 0x7f98d8072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80d08f0 0x7f98d8072440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39448/0 (socket says 172.21.15.181:39448) 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 -- 172.21.15.181:0/4109373247 learned_addr learned my addr 172.21.15.181:0/4109373247 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98cffff640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98d80d0510 0x7f98d815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dcca6640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98d80b3800 0x7f98d81f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 -- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98d80b3800 msgr2=0x7f98d81f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98d80b3800 0x7f98d81f0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 -- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98d80d0510 msgr2=0x7f98d815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98d80d0510 0x7f98d815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.928+0000 7f98dd4a7640 1 -- 172.21.15.181:0/4109373247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d815caf0 con 0x7f98d80d08f0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.929+0000 7f98dd4a7640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80d08f0 0x7f98d8072440 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f98d000caa0 tx=0x7f98d000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.929+0000 7f98cd7fa640 1 -- 172.21.15.181:0/4109373247 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0017070 con 0x7f98d80d08f0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.929+0000 7f98cd7fa640 1 -- 172.21.15.181:0/4109373247 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d000ac00 con 0x7f98d80d08f0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.929+0000 7f98cd7fa640 1 -- 172.21.15.181:0/4109373247 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0012400 con 0x7f98d80d08f0 2024-09-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.929+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d815cdd0 con 0x7f98d80d08f0 2024-09-12T02:36:00.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.929+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d815d390 con 0x7f98d80d08f0 2024-09-12T02:36:00.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.930+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d81411f0 con 0x7f98d80d08f0 2024-09-12T02:36:00.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.930+0000 7f98cd7fa640 1 -- 172.21.15.181:0/4109373247 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98d001a070 con 0x7f98d80d08f0 2024-09-12T02:36:00.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.931+0000 7f98cd7fa640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:00.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.931+0000 7f98dcca6640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:00.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.931+0000 7f98cd7fa640 1 -- 172.21.15.181:0/4109373247 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f98d008aa30 con 0x7f98d80d08f0 2024-09-12T02:36:00.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.931+0000 7f98dcca6640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98c406be30 0x7f98c406e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f98d4004f60 tx=0x7f98d4007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:00.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:00.935+0000 7f98cd7fa640 1 -- 172.21.15.181:0/4109373247 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98d0058d90 con 0x7f98d80d08f0 2024-09-12T02:36:01.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.134+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f98d8068480 con 0x7f98d80d08f0 2024-09-12T02:36:01.135 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-12T02:36:01.135+0000 7f727abdc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:36:01.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.136+0000 7f98cd7fa640 1 -- 172.21.15.181:0/4109373247 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7f98d005d090 con 0x7f98d80d08f0 2024-09-12T02:36:01.137 INFO:teuthology.orchestra.run.smithi181.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98c406be30 msgr2=0x7f98c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98c406be30 0x7f98c406e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f98d4004f60 tx=0x7f98d4007e30 comp rx=0 tx=0).stop 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80d08f0 msgr2=0x7f98d8072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80d08f0 0x7f98d8072440 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f98d000caa0 tx=0x7f98d000cf60 comp rx=0 tx=0).stop 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 shutdown_connections 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98d80d0510 0x7f98d815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d80d08f0 0x7f98d8072440 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 --2- 172.21.15.181:0/4109373247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98d80b3800 0x7f98d81f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 >> 172.21.15.181:0/4109373247 conn(0x7f98d806bc10 msgr2=0x7f98d80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:01.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 shutdown_connections 2024-09-12T02:36:01.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.139+0000 7f98def0a640 1 -- 172.21.15.181:0/4109373247 wait complete. 2024-09-12T02:36:01.145 INFO:tasks.ceph.mds.d.smithi204.stderr: -682> 2024-09-12T02:35:48.803+0000 7fe74e590640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:36:01.151 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:36:01.168 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-09-12T02:36:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.251+0000 7fe9f2c53640 1 Processor -- start 2024-09-12T02:36:01.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.251+0000 7fe9f2c53640 1 -- start start 2024-09-12T02:36:01.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f2c53640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe9ec15ab40 0x7fe9ec0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f2c53640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9ec0cfae0 0x7fe9ec0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f2c53640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec0b5090 con 0x7fe9ec0b4cb0 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f2c53640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec0ce6e0 con 0x7fe9ec15ab40 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f2c53640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec0d0350 con 0x7fe9ec0cfae0 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f09ef640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe9ec15ab40 0x7fe9ec0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f09ef640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe9ec15ab40 0x7fe9ec0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39454/0 (socket says 172.21.15.181:39454) 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f09ef640 1 -- 172.21.15.181:0/2317297279 learned_addr learned my addr 172.21.15.181:0/2317297279 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9ebfff640 1 --2- 172.21.15.181:0/2317297279 >> v2:172.21.15.204:3300/0 conn(0x7fe9ec0cfae0 0x7fe9ec0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f09ef640 1 -- 172.21.15.181:0/2317297279 >> v2:172.21.15.204:3300/0 conn(0x7fe9ec0cfae0 msgr2=0x7fe9ec0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f09ef640 1 --2- 172.21.15.181:0/2317297279 >> v2:172.21.15.204:3300/0 conn(0x7fe9ec0cfae0 0x7fe9ec0b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f09ef640 1 -- 172.21.15.181:0/2317297279 >> v1:172.21.15.204:6789/0 conn(0x7fe9ec0b4cb0 legacy=0x7fe9ec15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.252+0000 7fe9f09ef640 1 -- 172.21.15.181:0/2317297279 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec0d0630 con 0x7fe9ec15ab40 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.253+0000 7fe9f09ef640 1 --2- 172.21.15.181:0/2317297279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0b3c30 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0cf8b0 tx=0x7fe9e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eebe7c367caccda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.253+0000 7fe9eb7fe640 1 -- 172.21.15.181:0/2317297279 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0037070 con 0x7fe9ec15ab40 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.253+0000 7fe9eb7fe640 1 -- 172.21.15.181:0/2317297279 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e0032440 con 0x7fe9ec15ab40 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.253+0000 7fe9eb7fe640 1 -- 172.21.15.181:0/2317297279 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0032810 con 0x7fe9ec15ab40 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 -- 172.21.15.181:0/2317297279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 msgr2=0x7fe9ec0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/2317297279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0b3c30 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0cf8b0 tx=0x7fe9e002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 -- 172.21.15.181:0/2317297279 shutdown_connections 2024-09-12T02:36:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/2317297279 >> v2:172.21.15.204:3300/0 conn(0x7fe9ec0cfae0 0x7fe9ec0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/2317297279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0b3c30 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 -- 172.21.15.181:0/2317297279 >> 172.21.15.181:0/2317297279 conn(0x7fe9ec06bc10 msgr2=0x7fe9ec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 -- 172.21.15.181:0/2317297279 shutdown_connections 2024-09-12T02:36:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.254+0000 7fe9f2c53640 1 -- 172.21.15.181:0/2317297279 wait complete. 2024-09-12T02:36:01.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.255+0000 7fe9f2c53640 1 Processor -- start 2024-09-12T02:36:01.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.255+0000 7fe9f2c53640 1 -- start start 2024-09-12T02:36:01.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9ec0b4cb0 0x7fe9ec14d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9ec0cfae0 0x7fe9ec147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0d00d0 con 0x7fe9ec15ab40 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0cff50 con 0x7fe9ec0cfae0 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec15c0d0 con 0x7fe9ec0b4cb0 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39464/0 (socket says 172.21.15.181:39464) 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 -- 172.21.15.181:0/3596996070 learned_addr learned my addr 172.21.15.181:0/3596996070 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f09ef640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9ec0b4cb0 0x7fe9ec14d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9ebfff640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9ec0cfae0 0x7fe9ec147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 -- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9ec0b4cb0 msgr2=0x7fe9ec14d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9ec0b4cb0 0x7fe9ec14d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 -- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9ec0cfae0 msgr2=0x7fe9ec147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9ec0cfae0 0x7fe9ec147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 -- 172.21.15.181:0/3596996070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec14bba0 con 0x7fe9ec15ab40 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f11f0640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0aafa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c6b0 tx=0x7fe9e400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9e97fa640 1 -- 172.21.15.181:0/3596996070 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4003b70 con 0x7fe9ec15ab40 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9e97fa640 1 -- 172.21.15.181:0/3596996070 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e4003d30 con 0x7fe9ec15ab40 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec14be80 con 0x7fe9ec15ab40 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9e97fa640 1 -- 172.21.15.181:0/3596996070 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4005310 con 0x7fe9ec15ab40 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.256+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec14c440 con 0x7fe9ec15ab40 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.258+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec069170 con 0x7fe9ec15ab40 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.258+0000 7fe9e97fa640 1 -- 172.21.15.181:0/3596996070 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9e40054b0 con 0x7fe9ec15ab40 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.259+0000 7fe9e97fa640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe9d006be30 0x7fe9d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.259+0000 7fe9f09ef640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe9d006be30 0x7fe9d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.259+0000 7fe9e97fa640 1 -- 172.21.15.181:0/3596996070 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7fe9e408ac10 con 0x7fe9ec15ab40 2024-09-12T02:36:01.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.259+0000 7fe9f09ef640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe9d006be30 0x7fe9d006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0034000 tx=0x7fe9e002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:01.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.263+0000 7fe9e97fa640 1 -- 172.21.15.181:0/3596996070 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9e4058f10 con 0x7fe9ec15ab40 2024-09-12T02:36:01.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:01.462+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe9ec0ce860 con 0x7fe9ec15ab40 2024-09-12T02:36:02.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.138+0000 7fe9e97fa640 1 -- 172.21.15.181:0/3596996070 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7fe9ec0ce860 con 0x7fe9ec15ab40 2024-09-12T02:36:02.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe9d006be30 msgr2=0x7fe9d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe9d006be30 0x7fe9d006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0034000 tx=0x7fe9e002e000 comp rx=0 tx=0).stop 2024-09-12T02:36:02.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 msgr2=0x7fe9ec0aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0aafa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c6b0 tx=0x7fe9e400cb70 comp rx=0 tx=0).stop 2024-09-12T02:36:02.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 shutdown_connections 2024-09-12T02:36:02.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fe9d006be30 0x7fe9d006e2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9ec0cfae0 0x7fe9ec147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9ec15ab40 0x7fe9ec0aafa0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 --2- 172.21.15.181:0/3596996070 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9ec0b4cb0 0x7fe9ec14d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 >> 172.21.15.181:0/3596996070 conn(0x7fe9ec06bc10 msgr2=0x7fe9ec0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:02.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 shutdown_connections 2024-09-12T02:36:02.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.140+0000 7fe9f2c53640 1 -- 172.21.15.181:0/3596996070 wait complete. 2024-09-12T02:36:02.153 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:36:02.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.257+0000 7f858719f640 1 Processor -- start 2024-09-12T02:36:02.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.257+0000 7f858719f640 1 -- start start 2024-09-12T02:36:02.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.258+0000 7f858719f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 0x7f858006f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.258+0000 7f858719f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858015b720 con 0x7f8580162e90 2024-09-12T02:36:02.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.258+0000 7f858719f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8580074280 con 0x7f858015b340 2024-09-12T02:36:02.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.258+0000 7f858719f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f858006ff00 con 0x7f858006f580 2024-09-12T02:36:02.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.258+0000 7f858573c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8580162e90 0x7f8580165280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53330/0 (socket says 172.21.15.181:53330) 2024-09-12T02:36:02.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.258+0000 7f858573c640 1 -- 172.21.15.181:0/1001425908 learned_addr learned my addr 172.21.15.181:0/1001425908 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857ffff640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 0x7f858006f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657241486 0 0) 0x7f858015b720 con 0x7f8580162e90 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f856c003520 con 0x7f8580162e90 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116027097 0 0) 0x7f856c003520 con 0x7f8580162e90 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 msgr2=0x7f858006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 0x7f858006f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 >> v1:172.21.15.204:6789/0 conn(0x7f858015b340 legacy=0x7f85800d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8580071ef0 con 0x7f8580162e90 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f8578001670 con 0x7f8580162e90 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 >> v1:172.21.15.181:6789/0 conn(0x7f8580162e90 legacy=0x7f8580165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 0x7f856c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f856c003f80 0x7f856c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f856c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f858006ff00 con 0x7f856c004d40 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f856c00bad0 con 0x7f856c003f80 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f856c00bcd0 con 0x7f858006f580 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f858573c640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f856c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f857ffff640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f856c003f80 0x7f856c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f8584f3b640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 0x7f856c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.259+0000 7f858573c640 1 -- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 msgr2=0x7f856c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f858573c640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f858006f580 0x7f856c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f858573c640 1 -- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f856c003f80 msgr2=0x7f856c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f858573c640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f856c003f80 0x7f856c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f858573c640 1 -- 172.21.15.181:0/1001425908 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c003520 con 0x7f856c004d40 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f858573c640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f856c0051c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f85800b6e60 tx=0x7f856c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e6b9f585de1f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578007d30 con 0x7f856c004d40 2024-09-12T02:36:02.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8578005af0 con 0x7f856c004d40 2024-09-12T02:36:02.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.260+0000 7f857f7fe640 1 -- 172.21.15.181:0/1001425908 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578007070 con 0x7f856c004d40 2024-09-12T02:36:02.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.261+0000 7f858719f640 1 -- 172.21.15.181:0/1001425908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 msgr2=0x7f856c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.261+0000 7f858719f640 1 --2- 172.21.15.181:0/1001425908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f856c0051c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f85800b6e60 tx=0x7f856c005830 comp rx=0 tx=0).stop 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.261+0000 7f858573c640 1 -- 172.21.15.181:0/1001425908 reap_dead start 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.261+0000 7f858719f640 1 -- 172.21.15.181:0/1001425908 shutdown_connections 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.261+0000 7f858719f640 1 -- 172.21.15.181:0/1001425908 >> 172.21.15.181:0/1001425908 conn(0x7f85800d1230 msgr2=0x7f85800d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.261+0000 7f858719f640 1 -- 172.21.15.181:0/1001425908 shutdown_connections 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.261+0000 7f858719f640 1 -- 172.21.15.181:0/1001425908 wait complete. 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.262+0000 7f858719f640 1 Processor -- start 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.262+0000 7f858719f640 1 -- start start 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f858719f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f858014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f858719f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85801606b0 0x7f8580160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f858719f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85801576e0 0x7f8580157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f858719f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8580072790 con 0x7f856c004d40 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f858719f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f85800724b0 con 0x7f85801606b0 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f858719f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8580072a70 con 0x7f85801576e0 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f858014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f858014f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39496/0 (socket says 172.21.15.181:39496) 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 -- 172.21.15.181:0/3392071647 learned_addr learned my addr 172.21.15.181:0/3392071647 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f857ffff640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85801606b0 0x7f8580160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 -- 172.21.15.181:0/3392071647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85801576e0 msgr2=0x7f8580157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85801576e0 0x7f8580157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 -- 172.21.15.181:0/3392071647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85801606b0 msgr2=0x7f8580160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85801606b0 0x7f8580160b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 -- 172.21.15.181:0/3392071647 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858014fca0 con 0x7f856c004d40 2024-09-12T02:36:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.263+0000 7f8584f3b640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f858014f760 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8570011da0 tx=0x7f857000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.264+0000 7f857d7fa640 1 -- 172.21.15.181:0/3392071647 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570003b70 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.264+0000 7f857d7fa640 1 -- 172.21.15.181:0/3392071647 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8570016030 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.264+0000 7f857d7fa640 1 -- 172.21.15.181:0/3392071647 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85700020b0 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.264+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85801622f0 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.264+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8580161250 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.265+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580072d50 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.265+0000 7f857d7fa640 1 -- 172.21.15.181:0/3392071647 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8570005070 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.266+0000 7f857d7fa640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856006bfd0 0x7f856006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.266+0000 7f857d7fa640 1 -- 172.21.15.181:0/3392071647 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7f857008d1a0 con 0x7f856c004d40 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.266+0000 7f857ffff640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856006bfd0 0x7f856006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.266+0000 7f857ffff640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856006bfd0 0x7f856006e490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f85801572f0 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:02.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.270+0000 7f857d7fa640 1 -- 172.21.15.181:0/3392071647 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f858014fca0 con 0x7f856c004d40 2024-09-12T02:36:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:02.434+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f858006edc0 con 0x7f856c004d40 2024-09-12T02:36:03.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.139+0000 7f857d7fa640 1 -- 172.21.15.181:0/3392071647 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7f857005bb80 con 0x7f856c004d40 2024-09-12T02:36:03.140 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:36:03.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856006bfd0 msgr2=0x7f856006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856006bfd0 0x7f856006e490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f85801572f0 tx=0x7f8568008040 comp rx=0 tx=0).stop 2024-09-12T02:36:03.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 msgr2=0x7f858014f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f858014f760 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8570011da0 tx=0x7f857000f730 comp rx=0 tx=0).stop 2024-09-12T02:36:03.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 shutdown_connections 2024-09-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f856006bfd0 0x7f856006e490 secure :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f85801572f0 tx=0x7f8568008040 comp rx=0 tx=0).stop 2024-09-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85801606b0 0x7f8580160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85801576e0 0x7f8580157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 --2- 172.21.15.181:0/3392071647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f856c004d40 0x7f858014f760 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 >> 172.21.15.181:0/3392071647 conn(0x7f85800d1230 msgr2=0x7f858015bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 shutdown_connections 2024-09-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.142+0000 7f858719f640 1 -- 172.21.15.181:0/3392071647 wait complete. 2024-09-12T02:36:03.155 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:36:03.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.259+0000 7fac8a43c640 1 Processor -- start 2024-09-12T02:36:03.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.259+0000 7fac8a43c640 1 -- start start 2024-09-12T02:36:03.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.259+0000 7fac8a43c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fac840d33d0 0x7fac840d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.259+0000 7fac8a43c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac840d4bf0 0x7fac840b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.259+0000 7fac8a43c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac840d3a40 con 0x7fac8415e8a0 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.259+0000 7fac8a43c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fac840d37f0 con 0x7fac840d33d0 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.259+0000 7fac8a43c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fac840d3d20 con 0x7fac840d4bf0 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac837fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fac840d33d0 0x7fac840d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac837fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fac840d33d0 0x7fac840d46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39498/0 (socket says 172.21.15.181:39498) 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac837fe640 1 -- 172.21.15.181:0/1593018175 learned_addr learned my addr 172.21.15.181:0/1593018175 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac889d9640 1 --2- 172.21.15.181:0/1593018175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac840d4bf0 0x7fac840b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac837fe640 1 -- 172.21.15.181:0/1593018175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac840d4bf0 msgr2=0x7fac840b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac837fe640 1 --2- 172.21.15.181:0/1593018175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac840d4bf0 0x7fac840b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac837fe640 1 -- 172.21.15.181:0/1593018175 >> v1:172.21.15.204:6789/0 conn(0x7fac8415e8a0 legacy=0x7fac840cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac837fe640 1 -- 172.21.15.181:0/1593018175 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac840d4000 con 0x7fac840d33d0 2024-09-12T02:36:03.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.260+0000 7fac889d9640 1 --2- 172.21.15.181:0/1593018175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac840d4bf0 0x7fac840b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:03.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.261+0000 7fac837fe640 1 --2- 172.21.15.181:0/1593018175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d33d0 0x7fac840d46b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fac78009870 tx=0x7fac7802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5146ee7ccbf0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:03.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.261+0000 7fac82ffd640 1 -- 172.21.15.181:0/1593018175 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78037070 con 0x7fac840d33d0 2024-09-12T02:36:03.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.261+0000 7fac82ffd640 1 -- 172.21.15.181:0/1593018175 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7802ae50 con 0x7fac840d33d0 2024-09-12T02:36:03.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.261+0000 7fac82ffd640 1 -- 172.21.15.181:0/1593018175 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78032860 con 0x7fac840d33d0 2024-09-12T02:36:03.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.261+0000 7fac8a43c640 1 -- 172.21.15.181:0/1593018175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d33d0 msgr2=0x7fac840d46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.261+0000 7fac8a43c640 1 --2- 172.21.15.181:0/1593018175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d33d0 0x7fac840d46b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fac78009870 tx=0x7fac7802a300 comp rx=0 tx=0).stop 2024-09-12T02:36:03.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.262+0000 7fac8a43c640 1 -- 172.21.15.181:0/1593018175 shutdown_connections 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.262+0000 7fac8a43c640 1 --2- 172.21.15.181:0/1593018175 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac840d4bf0 0x7fac840b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.262+0000 7fac8a43c640 1 --2- 172.21.15.181:0/1593018175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d33d0 0x7fac840d46b0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.262+0000 7fac8a43c640 1 -- 172.21.15.181:0/1593018175 >> 172.21.15.181:0/1593018175 conn(0x7fac840b6270 msgr2=0x7fac840b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.262+0000 7fac8a43c640 1 -- 172.21.15.181:0/1593018175 shutdown_connections 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.262+0000 7fac8a43c640 1 -- 172.21.15.181:0/1593018175 wait complete. 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.263+0000 7fac8a43c640 1 Processor -- start 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.263+0000 7fac8a43c640 1 -- start start 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac840d33d0 0x7fac8414ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d4bf0 0x7fac840cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac8415e8a0 0x7fac840cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fac840b8390 con 0x7fac840d4bf0 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fac840b78c0 con 0x7fac840d33d0 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fac840b8510 con 0x7fac8415e8a0 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d4bf0 0x7fac840cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d4bf0 0x7fac840cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39508/0 (socket says 172.21.15.181:39508) 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 -- 172.21.15.181:0/3495702886 learned_addr learned my addr 172.21.15.181:0/3495702886 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac83fff640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac840d33d0 0x7fac8414ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac889d9640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac8415e8a0 0x7fac840cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 -- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac8415e8a0 msgr2=0x7fac840cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac8415e8a0 0x7fac840cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 -- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac840d33d0 msgr2=0x7fac8414ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac840d33d0 0x7fac8414ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 -- 172.21.15.181:0/3495702886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84161670 con 0x7fac840d4bf0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac889d9640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac8415e8a0 0x7fac840cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac837fe640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d4bf0 0x7fac840cb7f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fac78000c00 tx=0x7fac780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac80ff9640 1 -- 172.21.15.181:0/3495702886 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78041070 con 0x7fac840d4bf0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac80ff9640 1 -- 172.21.15.181:0/3495702886 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7803c670 con 0x7fac840d4bf0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac80ff9640 1 -- 172.21.15.181:0/3495702886 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78037040 con 0x7fac840d4bf0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac84157070 con 0x7fac840d4bf0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.264+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac84157630 con 0x7fac840d4bf0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.265+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac84075a50 con 0x7fac840d4bf0 2024-09-12T02:36:03.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.266+0000 7fac80ff9640 1 -- 172.21.15.181:0/3495702886 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac78044070 con 0x7fac840d4bf0 2024-09-12T02:36:03.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.266+0000 7fac80ff9640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fac7006be30 0x7fac7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.266+0000 7fac83fff640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fac7006be30 0x7fac7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.266+0000 7fac80ff9640 1 -- 172.21.15.181:0/3495702886 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5357+0+0 (secure 0 0 0) 0x7fac780ab570 con 0x7fac840d4bf0 2024-09-12T02:36:03.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.267+0000 7fac83fff640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fac7006be30 0x7fac7006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fac740016e0 tx=0x7fac74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:03.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.271+0000 7fac80ff9640 1 -- 172.21.15.181:0/3495702886 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac78079b60 con 0x7fac840d4bf0 2024-09-12T02:36:03.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:03.436+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac841e7380 con 0x7fac840d4bf0 2024-09-12T02:36:04.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.141+0000 7fac80ff9640 1 -- 172.21.15.181:0/3495702886 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7fac7807de60 con 0x7fac840d4bf0 2024-09-12T02:36:04.142 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'cephfs_data' removed 2024-09-12T02:36:04.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fac7006be30 msgr2=0x7fac7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fac7006be30 0x7fac7006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fac740016e0 tx=0x7fac74009040 comp rx=0 tx=0).stop 2024-09-12T02:36:04.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d4bf0 msgr2=0x7fac840cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d4bf0 0x7fac840cb7f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fac78000c00 tx=0x7fac780046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 shutdown_connections 2024-09-12T02:36:04.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fac7006be30 0x7fac7006e2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac8415e8a0 0x7fac840cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac840d4bf0 0x7fac840cb7f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 --2- 172.21.15.181:0/3495702886 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac840d33d0 0x7fac8414ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 >> 172.21.15.181:0/3495702886 conn(0x7fac840b6270 msgr2=0x7fac840b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 shutdown_connections 2024-09-12T02:36:04.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.143+0000 7fac8a43c640 1 -- 172.21.15.181:0/3495702886 wait complete. 2024-09-12T02:36:04.156 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:36:04.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.261+0000 7fedf9b91640 1 Processor -- start 2024-09-12T02:36:04.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.261+0000 7fedf9b91640 1 -- start start 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.261+0000 7fedf9b91640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fedf415e640 0x7fedf40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.261+0000 7fedf9b91640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fedf40d4710 0x7fedf40d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.261+0000 7fedf9b91640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf40b39d0 con 0x7fedf40cef60 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.261+0000 7fedf9b91640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fedf40cf520 con 0x7fedf415e640 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.261+0000 7fedf9b91640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fedf40cf800 con 0x7fedf40d4710 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf37fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fedf415e640 0x7fedf40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf37fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fedf415e640 0x7fedf40b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39524/0 (socket says 172.21.15.181:39524) 2024-09-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf37fe640 1 -- 172.21.15.181:0/4068020308 learned_addr learned my addr 172.21.15.181:0/4068020308 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf3fff640 1 --2- 172.21.15.181:0/4068020308 >> v2:172.21.15.204:3300/0 conn(0x7fedf40d4710 0x7fedf40d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf37fe640 1 -- 172.21.15.181:0/4068020308 >> v2:172.21.15.204:3300/0 conn(0x7fedf40d4710 msgr2=0x7fedf40d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf37fe640 1 --2- 172.21.15.181:0/4068020308 >> v2:172.21.15.204:3300/0 conn(0x7fedf40d4710 0x7fedf40d4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf37fe640 1 -- 172.21.15.181:0/4068020308 >> v1:172.21.15.204:6789/0 conn(0x7fedf40cef60 legacy=0x7fedf40d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf37fe640 1 -- 172.21.15.181:0/4068020308 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf40cfae0 con 0x7fedf415e640 2024-09-12T02:36:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.262+0000 7fedf3fff640 1 --2- 172.21.15.181:0/4068020308 >> v2:172.21.15.204:3300/0 conn(0x7fedf40d4710 0x7fedf40d4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf37fe640 1 --2- 172.21.15.181:0/4068020308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf415e640 0x7fedf40b3bf0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fedf40d1a20 tx=0x7fede402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34f9b3811734b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf2ffd640 1 -- 172.21.15.181:0/4068020308 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4037070 con 0x7fedf415e640 2024-09-12T02:36:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf2ffd640 1 -- 172.21.15.181:0/4068020308 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede4032440 con 0x7fedf415e640 2024-09-12T02:36:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf2ffd640 1 -- 172.21.15.181:0/4068020308 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4032810 con 0x7fedf415e640 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 -- 172.21.15.181:0/4068020308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf415e640 msgr2=0x7fedf40b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 --2- 172.21.15.181:0/4068020308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf415e640 0x7fedf40b3bf0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fedf40d1a20 tx=0x7fede402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 -- 172.21.15.181:0/4068020308 shutdown_connections 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 --2- 172.21.15.181:0/4068020308 >> v2:172.21.15.204:3300/0 conn(0x7fedf40d4710 0x7fedf40d4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 --2- 172.21.15.181:0/4068020308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf415e640 0x7fedf40b3bf0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 -- 172.21.15.181:0/4068020308 >> 172.21.15.181:0/4068020308 conn(0x7fedf4067d70 msgr2=0x7fedf4068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 -- 172.21.15.181:0/4068020308 shutdown_connections 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.263+0000 7fedf9b91640 1 -- 172.21.15.181:0/4068020308 wait complete. 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.265+0000 7fedf9b91640 1 Processor -- start 2024-09-12T02:36:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.265+0000 7fedf9b91640 1 -- start start 2024-09-12T02:36:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.265+0000 7fedf9b91640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf40cef60 0x7fedf40c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.265+0000 7fedf9b91640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedf40d4710 0x7fedf40cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.265+0000 7fedf9b91640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedf415e640 0x7fedf40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.265+0000 7fedf9b91640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fedf415ea20 con 0x7fedf40cef60 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf9b91640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fedf40d5050 con 0x7fedf415e640 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf9b91640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fedf40d3590 con 0x7fedf40d4710 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf40cef60 0x7fedf40c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf40cef60 0x7fedf40c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39540/0 (socket says 172.21.15.181:39540) 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 -- 172.21.15.181:0/1073434779 learned_addr learned my addr 172.21.15.181:0/1073434779 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedeaffd640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedf40d4710 0x7fedf40cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf3fff640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedf415e640 0x7fedf40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 -- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedf40d4710 msgr2=0x7fedf40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedf40d4710 0x7fedf40cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 -- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedf415e640 msgr2=0x7fedf40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedf415e640 0x7fedf40cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 -- 172.21.15.181:0/1073434779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf40c9c50 con 0x7fedf40cef60 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedeaffd640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedf40d4710 0x7fedf40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf37fe640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf40cef60 0x7fedf40c9710 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fede402a220 tx=0x7fede40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf0ff9640 1 -- 172.21.15.181:0/1073434779 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4041020 con 0x7fedf40cef60 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf0ff9640 1 -- 172.21.15.181:0/1073434779 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede40306c0 con 0x7fedf40cef60 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf40c8950 con 0x7fedf40cef60 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf0ff9640 1 -- 172.21.15.181:0/1073434779 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4037040 con 0x7fedf40cef60 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.266+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf40c8f10 con 0x7fedf40cef60 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.267+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf4069ac0 con 0x7fedf40cef60 2024-09-12T02:36:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.268+0000 7fedf0ff9640 1 -- 172.21.15.181:0/1073434779 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fede4044020 con 0x7fedf40cef60 2024-09-12T02:36:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.268+0000 7fedf0ff9640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedd406be30 0x7fedd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.268+0000 7fedeaffd640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedd406be30 0x7fedd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.268+0000 7fedf0ff9640 1 -- 172.21.15.181:0/1073434779 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fede40ab330 con 0x7fedf40cef60 2024-09-12T02:36:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.269+0000 7fedeaffd640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedd406be30 0x7fedd406e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fedf41ee840 tx=0x7feddc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.273+0000 7fedf0ff9640 1 -- 172.21.15.181:0/1073434779 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedf4069ac0 con 0x7fedf40cef60 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.438+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fedf40d4b10 con 0x7fedf40cef60 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.441+0000 7fedf0ff9640 1 -- 172.21.15.181:0/1073434779 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fede407ee20 con 0x7fedf40cef60 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedd406be30 msgr2=0x7fedd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedd406be30 0x7fedd406e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fedf41ee840 tx=0x7feddc009040 comp rx=0 tx=0).stop 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf40cef60 msgr2=0x7fedf40c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf40cef60 0x7fedf40c9710 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fede402a220 tx=0x7fede40046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 shutdown_connections 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fedd406be30 0x7fedd406e2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fedf415e640 0x7fedf40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fedf40d4710 0x7fedf40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 --2- 172.21.15.181:0/1073434779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedf40cef60 0x7fedf40c9710 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 >> 172.21.15.181:0/1073434779 conn(0x7fedf4067d70 msgr2=0x7fedf40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 shutdown_connections 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.443+0000 7fedf9b91640 1 -- 172.21.15.181:0/1073434779 wait complete. 2024-09-12T02:36:04.455 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos' 2024-09-12T02:36:04.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.551+0000 7f59d2ce4640 1 Processor -- start 2024-09-12T02:36:04.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.552+0000 7f59d2ce4640 1 -- start start 2024-09-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.552+0000 7f59d2ce4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f59cc15e590 0x7f59cc0d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.552+0000 7f59d2ce4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0b7530 0x7f59cc0b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.552+0000 7f59d2ce4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc15e970 con 0x7f59cc0cf840 2024-09-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.552+0000 7f59d2ce4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc0d41f0 con 0x7f59cc15e590 2024-09-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.552+0000 7f59d2ce4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc0d2800 con 0x7f59cc0b7530 2024-09-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59cbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0b7530 0x7f59cc0b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59cbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0b7530 0x7f59cc0b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.181:47322/0 (socket says 172.21.15.181:47322) 2024-09-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59cbfff640 1 -- 172.21.15.181:0/2546352362 learned_addr learned my addr 172.21.15.181:0/2546352362 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59d0a80640 1 --2- 172.21.15.181:0/2546352362 >> v2:172.21.15.204:3300/0 conn(0x7f59cc15e590 0x7f59cc0d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59cbfff640 1 -- 172.21.15.181:0/2546352362 >> v2:172.21.15.204:3300/0 conn(0x7f59cc15e590 msgr2=0x7f59cc0d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:04.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59cbfff640 1 --2- 172.21.15.181:0/2546352362 >> v2:172.21.15.204:3300/0 conn(0x7f59cc15e590 0x7f59cc0d3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59cbfff640 1 -- 172.21.15.181:0/2546352362 >> v1:172.21.15.204:6789/0 conn(0x7f59cc0cf840 legacy=0x7f59cc06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59cbfff640 1 -- 172.21.15.181:0/2546352362 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0d2ae0 con 0x7f59cc0b7530 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.553+0000 7f59d0a80640 1 --2- 172.21.15.181:0/2546352362 >> v2:172.21.15.204:3300/0 conn(0x7f59cc15e590 0x7f59cc0d3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.554+0000 7f59cbfff640 1 --2- 172.21.15.181:0/2546352362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0b7530 0x7f59cc0b5f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009e50 tx=0x7f59bc02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7bd4160354075 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.554+0000 7f59cb7fe640 1 -- 172.21.15.181:0/2546352362 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc036070 con 0x7f59cc0b7530 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.554+0000 7f59cb7fe640 1 -- 172.21.15.181:0/2546352362 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc031600 con 0x7f59cc0b7530 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.554+0000 7f59cb7fe640 1 -- 172.21.15.181:0/2546352362 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0319d0 con 0x7f59cc0b7530 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 -- 172.21.15.181:0/2546352362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0b7530 msgr2=0x7f59cc0b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/2546352362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0b7530 0x7f59cc0b5f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009e50 tx=0x7f59bc02a680 comp rx=0 tx=0).stop 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 -- 172.21.15.181:0/2546352362 shutdown_connections 2024-09-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/2546352362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0b7530 0x7f59cc0b5f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/2546352362 >> v2:172.21.15.204:3300/0 conn(0x7f59cc15e590 0x7f59cc0d3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 -- 172.21.15.181:0/2546352362 >> 172.21.15.181:0/2546352362 conn(0x7f59cc067d70 msgr2=0x7f59cc068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 -- 172.21.15.181:0/2546352362 shutdown_connections 2024-09-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.555+0000 7f59d2ce4640 1 -- 172.21.15.181:0/2546352362 wait complete. 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.556+0000 7f59d2ce4640 1 Processor -- start 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.556+0000 7f59d2ce4640 1 -- start start 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d2ce4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59cc0b7530 0x7f59cc156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d2ce4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0cf840 0x7f59cc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d2ce4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59cc15e590 0x7f59cc06bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d2ce4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0d3e70 con 0x7f59cc15e590 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d2ce4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0d30a0 con 0x7f59cc0b7530 2024-09-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d2ce4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc0b6460 con 0x7f59cc0cf840 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59cc15e590 0x7f59cc06bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59cc15e590 0x7f59cc06bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39542/0 (socket says 172.21.15.181:39542) 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 -- 172.21.15.181:0/1680170056 learned_addr learned my addr 172.21.15.181:0/1680170056 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59cbfff640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0cf840 0x7f59cc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d0a80640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59cc0b7530 0x7f59cc156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 -- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0cf840 msgr2=0x7f59cc0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0cf840 0x7f59cc0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 -- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59cc0b7530 msgr2=0x7f59cc156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59cc0b7530 0x7f59cc156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 -- 172.21.15.181:0/1680170056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0c8a20 con 0x7f59cc15e590 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.557+0000 7f59d1281640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59cc15e590 0x7f59cc06bf40 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001eb0 tx=0x7f59b400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.558+0000 7f59c97fa640 1 -- 172.21.15.181:0/1680170056 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4017070 con 0x7f59cc15e590 2024-09-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.558+0000 7f59c97fa640 1 -- 172.21.15.181:0/1680170056 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b40052d0 con 0x7f59cc15e590 2024-09-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.558+0000 7f59c97fa640 1 -- 172.21.15.181:0/1680170056 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4003810 con 0x7f59cc15e590 2024-09-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.558+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc0c8d00 con 0x7f59cc15e590 2024-09-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.558+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc15f890 con 0x7f59cc15e590 2024-09-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.559+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc0b6890 con 0x7f59cc15e590 2024-09-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.559+0000 7f59c97fa640 1 -- 172.21.15.181:0/1680170056 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59b401a070 con 0x7f59cc15e590 2024-09-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.559+0000 7f59c97fa640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f59ac06be30 0x7f59ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.560+0000 7f59c97fa640 1 -- 172.21.15.181:0/1680170056 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f59b4089e30 con 0x7f59cc15e590 2024-09-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.560+0000 7f59d0a80640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f59ac06be30 0x7f59ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.560+0000 7f59d0a80640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f59ac06be30 0x7f59ac06e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f59cc1f7470 tx=0x7f59c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.564+0000 7f59c97fa640 1 -- 172.21.15.181:0/1680170056 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59b4058490 con 0x7f59cc15e590 2024-09-12T02:36:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:04.800+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]} v 0) -- 0x7f59cc0693a0 con 0x7f59cc15e590 2024-09-12T02:36:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.602+0000 7f59c97fa640 1 -- 172.21.15.181:0/1680170056 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]}]=0 v338) ==== 155+0+0 (secure 0 0 0) 0x7f59b405c790 con 0x7f59cc15e590 2024-09-12T02:36:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f59ac06be30 msgr2=0x7f59ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f59ac06be30 0x7f59ac06e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f59cc1f7470 tx=0x7f59c4009190 comp rx=0 tx=0).stop 2024-09-12T02:36:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59cc15e590 msgr2=0x7f59cc06bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59cc15e590 0x7f59cc06bf40 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001eb0 tx=0x7f59b400c890 comp rx=0 tx=0).stop 2024-09-12T02:36:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 shutdown_connections 2024-09-12T02:36:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f59ac06be30 0x7f59ac06e2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59cc15e590 0x7f59cc06bf40 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f59cc0cf840 0x7f59cc0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 --2- 172.21.15.181:0/1680170056 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59cc0b7530 0x7f59cc156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 >> 172.21.15.181:0/1680170056 conn(0x7f59cc067d70 msgr2=0x7f59cc0b92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 shutdown_connections 2024-09-12T02:36:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:05.605+0000 7f59d2ce4640 1 -- 172.21.15.181:0/1680170056 wait complete. 2024-09-12T02:36:05.618 INFO:tasks.cephfs_test_runner:test_table_tool_take_inos (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-09-12T02:36:05.618 INFO:tasks.cephfs_test_runner: 2024-09-12T02:36:05.618 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:36:05.618 INFO:tasks.cephfs_test_runner:Ran 5 tests in 440.868s 2024-09-12T02:36:05.619 INFO:tasks.cephfs_test_runner: 2024-09-12T02:36:05.619 INFO:tasks.cephfs_test_runner:OK 2024-09-12T02:36:05.619 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-12T02:36:05.628 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T02:36:05.636 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T02:36:05.637 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:36:05.637 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:36:05.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:36:05.654 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T02:36:05.655 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:36:05.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056004,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19599 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497428k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:36:05.711 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:36:05.711 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:36:05.731 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:36:05.731 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-12T02:36:05.731 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:36:05.790 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056007,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=152 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248712k,nr_inodes=812178,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497432k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:36:05.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:05.790 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-12T02:36:05.806 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:36:05.806 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:36:05.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:05.807 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:36:05.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:05.873 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:36:05.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:05.939 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-09-12T02:36:06.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:06.038 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-09-12T02:36:06.057 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:36:06.057 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:36:06.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:06.057 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:36:06.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:06.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:36:06.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:36:06.199 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-09-12T02:36:06.317 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T02:36:06.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:36:06.327 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:36:06.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.426+0000 7f6ac579f640 1 Processor -- start 2024-09-12T02:36:06.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.426+0000 7f6ac579f640 1 -- start start 2024-09-12T02:36:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.427+0000 7f6ac579f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 0x7f6ac00b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.427+0000 7f6ac579f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac00731f0 con 0x7f6ac0156990 2024-09-12T02:36:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.427+0000 7f6ac579f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac00ce160 con 0x7f6ac00b22c0 2024-09-12T02:36:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.427+0000 7f6ac579f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac0156d70 con 0x7f6ac00cd880 2024-09-12T02:36:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.427+0000 7f6abeffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6ac0156990 0x7f6ac00cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53338/0 (socket says 172.21.15.181:53338) 2024-09-12T02:36:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.427+0000 7f6abeffd640 1 -- 172.21.15.181:0/3220769788 learned_addr learned my addr 172.21.15.181:0/3220769788 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307556062 0 0) 0x7f6ac00731f0 con 0x7f6ac0156990 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa8003520 con 0x7f6ac0156990 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 0x7f6ac00b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3559071137 0 0) 0x7f6aa8003520 con 0x7f6ac0156990 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 msgr2=0x7f6ac00b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 0x7f6ac00b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 >> v1:172.21.15.204:6789/0 conn(0x7f6ac00b22c0 legacy=0x7f6ac015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac00ce440 con 0x7f6ac0156990 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f6ab00019f0 con 0x7f6ac0156990 2024-09-12T02:36:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 >> v1:172.21.15.181:6789/0 conn(0x7f6ac0156990 legacy=0x7f6ac00cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 0x7f6aa80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6aa8004010 0x7f6aa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6aa8004d40 0x7f6aa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa800bbd0 con 0x7f6aa8004010 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa800bd80 con 0x7f6aa8004d40 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa800bf80 con 0x7f6ac00cd880 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6aa8004010 0x7f6aa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abeffd640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 0x7f6aa80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abf7fe640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6aa8004d40 0x7f6aa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abe7fc640 1 -- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 msgr2=0x7f6aa80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00cd880 0x7f6aa80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abe7fc640 1 -- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6aa8004d40 msgr2=0x7f6aa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6aa8004d40 0x7f6aa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.428+0000 7f6abe7fc640 1 -- 172.21.15.181:0/3220769788 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa8003520 con 0x7f6aa8004010 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.429+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6aa8004010 0x7f6aa8004800 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400ba30 tx=0x7f6aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74ee5f7dc7f2ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.429+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4030070 con 0x7f6aa8004010 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.429+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab402ade0 con 0x7f6aa8004010 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.429+0000 7f6abdffb640 1 -- 172.21.15.181:0/3220769788 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400b600 con 0x7f6aa8004010 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.430+0000 7f6ac579f640 1 -- 172.21.15.181:0/3220769788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6aa8004010 msgr2=0x7f6aa8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.430+0000 7f6ac579f640 1 --2- 172.21.15.181:0/3220769788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6aa8004010 0x7f6aa8004800 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400ba30 tx=0x7f6aa8005830 comp rx=0 tx=0).stop 2024-09-12T02:36:06.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.430+0000 7f6abf7fe640 1 -- 172.21.15.181:0/3220769788 reap_dead start 2024-09-12T02:36:06.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.430+0000 7f6ac579f640 1 -- 172.21.15.181:0/3220769788 shutdown_connections 2024-09-12T02:36:06.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.430+0000 7f6ac579f640 1 -- 172.21.15.181:0/3220769788 >> 172.21.15.181:0/3220769788 conn(0x7f6ac006bc10 msgr2=0x7f6ac006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.430+0000 7f6ac579f640 1 -- 172.21.15.181:0/3220769788 shutdown_connections 2024-09-12T02:36:06.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.430+0000 7f6ac579f640 1 -- 172.21.15.181:0/3220769788 wait complete. 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.431+0000 7f6ac579f640 1 Processor -- start 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.431+0000 7f6ac579f640 1 -- start start 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6ac579f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6aa8004010 0x7f6ac0141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6ac579f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac0157560 0x7f6ac00c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6ac579f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac00c55a0 0x7f6ac0143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6ac579f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00b26d0 con 0x7f6ac0157560 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6ac579f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00cea90 con 0x7f6ac00c55a0 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6ac579f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac00cef20 con 0x7f6aa8004010 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac0157560 0x7f6ac00c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac0157560 0x7f6ac00c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39570/0 (socket says 172.21.15.181:39570) 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 -- 172.21.15.181:0/666804402 learned_addr learned my addr 172.21.15.181:0/666804402 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abeffd640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6aa8004010 0x7f6ac0141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abf7fe640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac00c55a0 0x7f6ac0143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 -- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6aa8004010 msgr2=0x7f6ac0141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6aa8004010 0x7f6ac0141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 -- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac00c55a0 msgr2=0x7f6ac0143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac00c55a0 0x7f6ac0143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 -- 172.21.15.181:0/666804402 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac0141c60 con 0x7f6ac0157560 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.432+0000 7f6abe7fc640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac0157560 0x7f6ac00c5060 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f6ab402a8d0 tx=0x7f6ab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.433+0000 7f6aa77fe640 1 -- 172.21.15.181:0/666804402 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4043030 con 0x7f6ac0157560 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.433+0000 7f6aa77fe640 1 -- 172.21.15.181:0/666804402 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab402abe0 con 0x7f6ac0157560 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.433+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac0141f40 con 0x7f6ac0157560 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.433+0000 7f6aa77fe640 1 -- 172.21.15.181:0/666804402 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400b600 con 0x7f6ac0157560 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.433+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac0142500 con 0x7f6ac0157560 2024-09-12T02:36:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.434+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac00722b0 con 0x7f6ac0157560 2024-09-12T02:36:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.434+0000 7f6aa77fe640 1 -- 172.21.15.181:0/666804402 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab4046070 con 0x7f6ac0157560 2024-09-12T02:36:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.435+0000 7f6aa77fe640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.435+0000 7f6aa77fe640 1 -- 172.21.15.181:0/666804402 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f6ab40ab080 con 0x7f6ac0157560 2024-09-12T02:36:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.435+0000 7f6abeffd640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.435+0000 7f6abeffd640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00013d0 tx=0x7f6ab0006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.439+0000 7f6aa77fe640 1 -- 172.21.15.181:0/666804402 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab4079650 con 0x7f6ac0157560 2024-09-12T02:36:06.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.602+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ac01556f0 con 0x7f6aac06be30 2024-09-12T02:36:06.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.603+0000 7f6aa77fe640 1 -- 172.21.15.181:0/666804402 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13428 (secure 0 0 0) 0x7f6ac01556f0 con 0x7f6aac06be30 2024-09-12T02:36:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:06.604 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:36:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 msgr2=0x7f6aac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00013d0 tx=0x7f6ab0006040 comp rx=0 tx=0).stop 2024-09-12T02:36:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac0157560 msgr2=0x7f6ac00c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac0157560 0x7f6ac00c5060 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f6ab402a8d0 tx=0x7f6ab40046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 shutdown_connections 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac00c55a0 0x7f6ac0143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac0157560 0x7f6ac00c5060 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 --2- 172.21.15.181:0/666804402 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6aa8004010 0x7f6ac0141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 >> 172.21.15.181:0/666804402 conn(0x7f6ac006bc10 msgr2=0x7f6ac015a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 shutdown_connections 2024-09-12T02:36:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.605+0000 7f6ac579f640 1 -- 172.21.15.181:0/666804402 wait complete. 2024-09-12T02:36:06.617 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-12T02:36:05.712146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285416,"kb_used_data":9548,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689304,"statfs":{"total":773094113280,"available":772801847296,"internally_reserved":0,"allocated":9777152,"data_stored":4850133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2853,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-46,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001364"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":298,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-12T02:36:01.140910+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:36:01.140910+0000","last_peered":"2024-09-12T02:36:01.140910+0000","last_clean":"2024-09-12T02:36:01.140910+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:36:01.140910+0000","last_undegraded":"2024-09-12T02:36:01.140910+0000","last_fullsized":"2024-09-12T02:36:01.140910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1671168,"data_stored":1051961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":462217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":458475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46124,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325716,"statfs":{"total":96636764160,"available":96589533184,"internally_reserved":0,"allocated":1073152,"data_stored":461523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":455636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41128,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330712,"statfs":{"total":96636764160,"available":96594649088,"internally_reserved":0,"allocated":1658880,"data_stored":1045844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":458453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1064960,"data_stored":456024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:06.618 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:36:06.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.716+0000 7f6cc378d640 1 Processor -- start 2024-09-12T02:36:06.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.717+0000 7f6cc378d640 1 -- start start 2024-09-12T02:36:06.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.717+0000 7f6cc378d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6cbc161c60 0x7f6cbc0d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.717+0000 7f6cc378d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6cbc0d0e20 0x7f6cbc0d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.717+0000 7f6cc378d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cbc0d3040 con 0x7f6cbc06cd90 2024-09-12T02:36:06.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.717+0000 7f6cc378d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6cbc0d2df0 con 0x7f6cbc0d0e20 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.717+0000 7f6cc378d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f6cbc073050 con 0x7f6cbc161c60 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.718+0000 7f6cc1d2a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6cbc0d0e20 0x7f6cbc0d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.718+0000 7f6cc1d2a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6cbc0d0e20 0x7f6cbc0d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39582/0 (socket says 172.21.15.181:39582) 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.718+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/3824349313 learned_addr learned my addr 172.21.15.181:0/3824349313 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.718+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/3824349313 >> v2:172.21.15.204:3300/0 conn(0x7f6cbc161c60 msgr2=0x7f6cbc0d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.718+0000 7f6cc1d2a640 1 --2- 172.21.15.181:0/3824349313 >> v2:172.21.15.204:3300/0 conn(0x7f6cbc161c60 0x7f6cbc0d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.718+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/3824349313 >> v1:172.21.15.204:6789/0 conn(0x7f6cbc06cd90 legacy=0x7f6cbc06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.718+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/3824349313 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc073330 con 0x7f6cbc0d0e20 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc1d2a640 1 --2- 172.21.15.181:0/3824349313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc0d0e20 0x7f6cbc0d1250 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0cfef0 tx=0x7f6cac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f8cd2f0cee27f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cbbfff640 1 -- 172.21.15.181:0/3824349313 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac036070 con 0x7f6cbc0d0e20 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cbbfff640 1 -- 172.21.15.181:0/3824349313 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac031600 con 0x7f6cbc0d0e20 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cbbfff640 1 -- 172.21.15.181:0/3824349313 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0319d0 con 0x7f6cbc0d0e20 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 -- 172.21.15.181:0/3824349313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc0d0e20 msgr2=0x7f6cbc0d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 --2- 172.21.15.181:0/3824349313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc0d0e20 0x7f6cbc0d1250 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0cfef0 tx=0x7f6cac02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 -- 172.21.15.181:0/3824349313 shutdown_connections 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 --2- 172.21.15.181:0/3824349313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc0d0e20 0x7f6cbc0d1250 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 --2- 172.21.15.181:0/3824349313 >> v2:172.21.15.204:3300/0 conn(0x7f6cbc161c60 0x7f6cbc0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 -- 172.21.15.181:0/3824349313 >> 172.21.15.181:0/3824349313 conn(0x7f6cbc067950 msgr2=0x7f6cbc067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 -- 172.21.15.181:0/3824349313 shutdown_connections 2024-09-12T02:36:06.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.719+0000 7f6cc378d640 1 -- 172.21.15.181:0/3824349313 wait complete. 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 Processor -- start 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 -- start start 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc06cd90 0x7f6cbc159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0d0e20 0x7f6cbc0b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc161c60 0x7f6cbc159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6cbc0b4090 con 0x7f6cbc161c60 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6cbc074100 con 0x7f6cbc06cd90 2024-09-12T02:36:06.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc378d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6cbc0b4210 con 0x7f6cbc0d0e20 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc1d2a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc161c60 0x7f6cbc159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc1d2a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc161c60 0x7f6cbc159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39592/0 (socket says 172.21.15.181:39592) 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/1173560566 learned_addr learned my addr 172.21.15.181:0/1173560566 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc1529640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc06cd90 0x7f6cbc159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.721+0000 7f6cc0d28640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0d0e20 0x7f6cbc0b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0d0e20 msgr2=0x7f6cbc0b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc1d2a640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0d0e20 0x7f6cbc0b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc06cd90 msgr2=0x7f6cbc159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc1d2a640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc06cd90 0x7f6cbc159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc1d2a640 1 -- 172.21.15.181:0/1173560566 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc159ca0 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc1d2a640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc161c60 0x7f6cbc159fe0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6cac034040 tx=0x7f6cac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cb9ffb640 1 -- 172.21.15.181:0/1173560566 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac041020 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cb9ffb640 1 -- 172.21.15.181:0/1173560566 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac0077a0 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cbc0b5a80 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cb9ffb640 1 -- 172.21.15.181:0/1173560566 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac036040 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.722+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cbc0b6000 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.723+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cbc0d1e10 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.724+0000 7f6cb9ffb640 1 -- 172.21.15.181:0/1173560566 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cac044020 con 0x7f6cbc161c60 2024-09-12T02:36:06.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.724+0000 7f6cb9ffb640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6ca806be30 0x7f6ca806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.724+0000 7f6cb9ffb640 1 -- 172.21.15.181:0/1173560566 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f6cac0ab9d0 con 0x7f6cbc161c60 2024-09-12T02:36:06.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.724+0000 7f6cc1529640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6ca806be30 0x7f6ca806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.724+0000 7f6cc1529640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6ca806be30 0x7f6ca806e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40098e0 tx=0x7f6cb4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.728+0000 7f6cb9ffb640 1 -- 172.21.15.181:0/1173560566 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cac04b030 con 0x7f6cbc161c60 2024-09-12T02:36:06.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.891+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cbc0d1e10 con 0x7f6ca806be30 2024-09-12T02:36:06.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.891+0000 7f6cb9ffb640 1 -- 172.21.15.181:0/1173560566 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13428 (secure 0 0 0) 0x7f6cbc0d1e10 con 0x7f6ca806be30 2024-09-12T02:36:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:06.892 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:36:06.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6ca806be30 msgr2=0x7f6ca806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6ca806be30 0x7f6ca806e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40098e0 tx=0x7f6cb4009060 comp rx=0 tx=0).stop 2024-09-12T02:36:06.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc161c60 msgr2=0x7f6cbc159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc161c60 0x7f6cbc159fe0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6cac034040 tx=0x7f6cac004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 shutdown_connections 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6ca806be30 0x7f6ca806e2f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cbc161c60 0x7f6cbc159fe0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0d0e20 0x7f6cbc0b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 --2- 172.21.15.181:0/1173560566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc06cd90 0x7f6cbc159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 >> 172.21.15.181:0/1173560566 conn(0x7f6cbc067950 msgr2=0x7f6cbc160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 shutdown_connections 2024-09-12T02:36:06.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:06.893+0000 7f6cc378d640 1 -- 172.21.15.181:0/1173560566 wait complete. 2024-09-12T02:36:06.905 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-12T02:36:05.712146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285416,"kb_used_data":9548,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689304,"statfs":{"total":773094113280,"available":772801847296,"internally_reserved":0,"allocated":9777152,"data_stored":4850133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2853,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-46,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001364"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":298,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-12T02:36:01.140910+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:36:01.140910+0000","last_peered":"2024-09-12T02:36:01.140910+0000","last_clean":"2024-09-12T02:36:01.140910+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:36:01.140910+0000","last_undegraded":"2024-09-12T02:36:01.140910+0000","last_fullsized":"2024-09-12T02:36:01.140910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1671168,"data_stored":1051961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":462217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":458475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46124,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325716,"statfs":{"total":96636764160,"available":96589533184,"internally_reserved":0,"allocated":1073152,"data_stored":461523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":455636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41128,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330712,"statfs":{"total":96636764160,"available":96594649088,"internally_reserved":0,"allocated":1658880,"data_stored":1045844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":458453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1064960,"data_stored":456024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:06.906 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:36:06.906 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:36:07.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.003+0000 7ff367627640 1 Processor -- start 2024-09-12T02:36:07.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.003+0000 7ff367627640 1 -- start start 2024-09-12T02:36:07.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff367627640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff360156990 0x7ff3600cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff367627640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff3600b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff367627640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3600ce160 con 0x7ff3600b22c0 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff367627640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff360156d70 con 0x7ff360156990 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff367627640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff3600cdb10 con 0x7ff3600cd6b0 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff3653c3640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff360156990 0x7ff3600cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff3653c3640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff360156990 0x7ff3600cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39604/0 (socket says 172.21.15.181:39604) 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff3653c3640 1 -- 172.21.15.181:0/3886857915 learned_addr learned my addr 172.21.15.181:0/3886857915 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.004+0000 7ff365bc4640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff3600b22c0 0x7ff36015fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53346/0 (socket says 172.21.15.181:53346) 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff364bc2640 1 --2- 172.21.15.181:0/3886857915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff3600b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff3653c3640 1 -- 172.21.15.181:0/3886857915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 msgr2=0x7ff3600b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff3653c3640 1 --2- 172.21.15.181:0/3886857915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff3600b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff3653c3640 1 -- 172.21.15.181:0/3886857915 >> v1:172.21.15.181:6789/0 conn(0x7ff3600b22c0 legacy=0x7ff36015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff35ffff640 1 -- 172.21.15.181:0/3886857915 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655057289 0 0) 0x7ff3600ce160 con 0x7ff3600b22c0 2024-09-12T02:36:07.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff3653c3640 1 -- 172.21.15.181:0/3886857915 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3600731f0 con 0x7ff360156990 2024-09-12T02:36:07.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff364bc2640 1 --2- 172.21.15.181:0/3886857915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff3600b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:07.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff3653c3640 1 --2- 172.21.15.181:0/3886857915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff360156990 0x7ff3600cd170 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff350009e50 tx=0x7ff35002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc805634c95f609 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:07.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff35ffff640 1 -- 172.21.15.181:0/3886857915 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350036070 con 0x7ff360156990 2024-09-12T02:36:07.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff35ffff640 1 -- 172.21.15.181:0/3886857915 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350031600 con 0x7ff360156990 2024-09-12T02:36:07.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.005+0000 7ff35ffff640 1 -- 172.21.15.181:0/3886857915 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3500319d0 con 0x7ff360156990 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 -- 172.21.15.181:0/3886857915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff360156990 msgr2=0x7ff3600cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 --2- 172.21.15.181:0/3886857915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff360156990 0x7ff3600cd170 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff350009e50 tx=0x7ff35002a680 comp rx=0 tx=0).stop 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 -- 172.21.15.181:0/3886857915 shutdown_connections 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 --2- 172.21.15.181:0/3886857915 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff3600b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 --2- 172.21.15.181:0/3886857915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff360156990 0x7ff3600cd170 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 -- 172.21.15.181:0/3886857915 >> 172.21.15.181:0/3886857915 conn(0x7ff36006bc10 msgr2=0x7ff36006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 -- 172.21.15.181:0/3886857915 shutdown_connections 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.006+0000 7ff367627640 1 -- 172.21.15.181:0/3886857915 wait complete. 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.007+0000 7ff367627640 1 Processor -- start 2024-09-12T02:36:07.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.007+0000 7ff367627640 1 -- start start 2024-09-12T02:36:07.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff367627640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3600b22c0 0x7ff360156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff367627640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff360157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff367627640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff360156990 0x7ff360157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff367627640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff3600ce720 con 0x7ff3600b22c0 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff367627640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff3600cea90 con 0x7ff360156990 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff367627640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff3600b26f0 con 0x7ff3600cd6b0 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3600b22c0 0x7ff360156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3600b22c0 0x7ff360156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39608/0 (socket says 172.21.15.181:39608) 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 -- 172.21.15.181:0/4129770199 learned_addr learned my addr 172.21.15.181:0/4129770199 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff364bc2640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff360157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff365bc4640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff360156990 0x7ff360157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 -- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 msgr2=0x7ff360157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff360157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 -- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff360156990 msgr2=0x7ff360157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff360156990 0x7ff360157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff3653c3640 1 -- 172.21.15.181:0/4129770199 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36015f7f0 con 0x7ff3600b22c0 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.008+0000 7ff365bc4640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff360156990 0x7ff360157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.009+0000 7ff3653c3640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3600b22c0 0x7ff360156f00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff350034040 tx=0x7ff350004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.009+0000 7ff35dffb640 1 -- 172.21.15.181:0/4129770199 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350041020 con 0x7ff3600b22c0 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.009+0000 7ff35dffb640 1 -- 172.21.15.181:0/4129770199 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350037040 con 0x7ff3600b22c0 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.009+0000 7ff35dffb640 1 -- 172.21.15.181:0/4129770199 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350036050 con 0x7ff3600b22c0 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.009+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36015f510 con 0x7ff3600b22c0 2024-09-12T02:36:07.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.009+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff360141a70 con 0x7ff3600b22c0 2024-09-12T02:36:07.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.010+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3600cef20 con 0x7ff3600b22c0 2024-09-12T02:36:07.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.010+0000 7ff35dffb640 1 -- 172.21.15.181:0/4129770199 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff350007c70 con 0x7ff3600b22c0 2024-09-12T02:36:07.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.011+0000 7ff35dffb640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.011+0000 7ff35dffb640 1 -- 172.21.15.181:0/4129770199 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7ff3500ab4f0 con 0x7ff3600b22c0 2024-09-12T02:36:07.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.011+0000 7ff364bc2640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.011+0000 7ff364bc2640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34c06be30 0x7ff34c06e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3600cc8e0 tx=0x7ff354008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:07.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.015+0000 7ff35dffb640 1 -- 172.21.15.181:0/4129770199 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff35004b060 con 0x7ff3600b22c0 2024-09-12T02:36:07.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.178+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff360141430 con 0x7ff34c06be30 2024-09-12T02:36:07.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.179+0000 7ff35dffb640 1 -- 172.21.15.181:0/4129770199 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13428 (secure 0 0 0) 0x7ff35400a660 con 0x7ff34c06be30 2024-09-12T02:36:07.180 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:07.180 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34c06be30 msgr2=0x7ff34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34c06be30 0x7ff34c06e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3600cc8e0 tx=0x7ff354008040 comp rx=0 tx=0).stop 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3600b22c0 msgr2=0x7ff360156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3600b22c0 0x7ff360156f00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff350034040 tx=0x7ff350004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 shutdown_connections 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff360156990 0x7ff360157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff3600cd6b0 0x7ff360157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 --2- 172.21.15.181:0/4129770199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3600b22c0 0x7ff360156f00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 >> 172.21.15.181:0/4129770199 conn(0x7ff36006bc10 msgr2=0x7ff36015aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:07.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 shutdown_connections 2024-09-12T02:36:07.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.181+0000 7ff367627640 1 -- 172.21.15.181:0/4129770199 wait complete. 2024-09-12T02:36:07.193 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-12T02:36:05.712146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285416,"kb_used_data":9548,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689304,"statfs":{"total":773094113280,"available":772801847296,"internally_reserved":0,"allocated":9777152,"data_stored":4850133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2853,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-46,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001364"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":298,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-12T02:36:01.140910+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:36:01.140910+0000","last_peered":"2024-09-12T02:36:01.140910+0000","last_clean":"2024-09-12T02:36:01.140910+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:36:01.140910+0000","last_undegraded":"2024-09-12T02:36:01.140910+0000","last_fullsized":"2024-09-12T02:36:01.140910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1671168,"data_stored":1051961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":462217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1077248,"data_stored":458475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46124,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325716,"statfs":{"total":96636764160,"available":96589533184,"internally_reserved":0,"allocated":1073152,"data_stored":461523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":455636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41128,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330712,"statfs":{"total":96636764160,"available":96594649088,"internally_reserved":0,"allocated":1658880,"data_stored":1045844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542242,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":458453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1064960,"data_stored":456024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:07.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:36:07.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.291+0000 7f8c47250640 1 Processor -- start 2024-09-12T02:36:07.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.291+0000 7f8c47250640 1 -- start start 2024-09-12T02:36:07.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c47250640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8c40158c90 0x7f8c4006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c47250640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c4006c150 0x7f8c400b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c47250640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4006e3c0 con 0x7f8c400b0610 2024-09-12T02:36:07.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c47250640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4006e170 con 0x7f8c4006c150 2024-09-12T02:36:07.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c47250640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4015fac0 con 0x7f8c40158c90 2024-09-12T02:36:07.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c3ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c4006c150 0x7f8c400b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c457ed640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8c400b0610 0x7f8c400d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53354/0 (socket says 172.21.15.181:53354) 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c3ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c4006c150 0x7f8c400b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39622/0 (socket says 172.21.15.181:39622) 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c457ed640 1 -- 172.21.15.181:0/3019248231 learned_addr learned my addr 172.21.15.181:0/3019248231 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.292+0000 7f8c44fec640 1 --2- 172.21.15.181:0/3019248231 >> v2:172.21.15.204:3300/0 conn(0x7f8c40158c90 0x7f8c4006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c3ffff640 1 -- 172.21.15.181:0/3019248231 >> v2:172.21.15.204:3300/0 conn(0x7f8c40158c90 msgr2=0x7f8c4006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c3ffff640 1 --2- 172.21.15.181:0/3019248231 >> v2:172.21.15.204:3300/0 conn(0x7f8c40158c90 0x7f8c4006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c3ffff640 1 -- 172.21.15.181:0/3019248231 >> v1:172.21.15.181:6789/0 conn(0x7f8c400b0610 legacy=0x7f8c400d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c3f7fe640 1 -- 172.21.15.181:0/3019248231 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172687113 0 0) 0x7f8c4006e3c0 con 0x7f8c400b0610 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c3ffff640 1 -- 172.21.15.181:0/3019248231 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4006e6a0 con 0x7f8c4006c150 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c44fec640 1 --2- 172.21.15.181:0/3019248231 >> v2:172.21.15.204:3300/0 conn(0x7f8c40158c90 0x7f8c4006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c3ffff640 1 --2- 172.21.15.181:0/3019248231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c4006c150 0x7f8c400b00d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8c400d22c0 tx=0x7f8c3002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17cc08aa4994ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.293+0000 7f8c3f7fe640 1 -- 172.21.15.181:0/3019248231 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30007740 con 0x7f8c4006c150 2024-09-12T02:36:07.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c3f7fe640 1 -- 172.21.15.181:0/3019248231 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c300078e0 con 0x7f8c4006c150 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c3f7fe640 1 -- 172.21.15.181:0/3019248231 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30007cb0 con 0x7f8c4006c150 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 -- 172.21.15.181:0/3019248231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c4006c150 msgr2=0x7f8c400b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 --2- 172.21.15.181:0/3019248231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c4006c150 0x7f8c400b00d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8c400d22c0 tx=0x7f8c3002a680 comp rx=0 tx=0).stop 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 -- 172.21.15.181:0/3019248231 shutdown_connections 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 --2- 172.21.15.181:0/3019248231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c4006c150 0x7f8c400b00d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 --2- 172.21.15.181:0/3019248231 >> v2:172.21.15.204:3300/0 conn(0x7f8c40158c90 0x7f8c4006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 -- 172.21.15.181:0/3019248231 >> 172.21.15.181:0/3019248231 conn(0x7f8c40067b30 msgr2=0x7f8c4006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 -- 172.21.15.181:0/3019248231 shutdown_connections 2024-09-12T02:36:07.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.294+0000 7f8c47250640 1 -- 172.21.15.181:0/3019248231 wait complete. 2024-09-12T02:36:07.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.295+0000 7f8c47250640 1 Processor -- start 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.295+0000 7f8c47250640 1 -- start start 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c47250640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c4006c150 0x7f8c40160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c47250640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c400b0610 0x7f8c40151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c47250640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c40158c90 0x7f8c40151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c47250640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400b0aa0 con 0x7f8c400b0610 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c47250640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4006ec60 con 0x7f8c4006c150 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c47250640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8c400b4210 con 0x7f8c40158c90 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c400b0610 0x7f8c40151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c400b0610 0x7f8c40151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39634/0 (socket says 172.21.15.181:39634) 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.296+0000 7f8c3ffff640 1 -- 172.21.15.181:0/2372374884 learned_addr learned my addr 172.21.15.181:0/2372374884 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c44fec640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c4006c150 0x7f8c40160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c457ed640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c40158c90 0x7f8c40151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3ffff640 1 -- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c40158c90 msgr2=0x7f8c40151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3ffff640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c40158c90 0x7f8c40151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3ffff640 1 -- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c4006c150 msgr2=0x7f8c40160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3ffff640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c4006c150 0x7f8c40160f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3ffff640 1 -- 172.21.15.181:0/2372374884 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c401549d0 con 0x7f8c400b0610 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c457ed640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c40158c90 0x7f8c40151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3ffff640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c400b0610 0x7f8c40151a30 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8c30000f80 tx=0x7f8c30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3d7fa640 1 -- 172.21.15.181:0/2372374884 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30040070 con 0x7f8c400b0610 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3d7fa640 1 -- 172.21.15.181:0/2372374884 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c30031c40 con 0x7f8c400b0610 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c40154cb0 con 0x7f8c400b0610 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c3d7fa640 1 -- 172.21.15.181:0/2372374884 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30009450 con 0x7f8c400b0610 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.297+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c40155550 con 0x7f8c400b0610 2024-09-12T02:36:07.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.298+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c40154e80 con 0x7f8c400b0610 2024-09-12T02:36:07.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.298+0000 7f8c3d7fa640 1 -- 172.21.15.181:0/2372374884 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c30039040 con 0x7f8c400b0610 2024-09-12T02:36:07.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.299+0000 7f8c3d7fa640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8c2006be30 0x7f8c2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:07.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.299+0000 7f8c3d7fa640 1 -- 172.21.15.181:0/2372374884 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f8c300abe80 con 0x7f8c400b0610 2024-09-12T02:36:07.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.299+0000 7f8c44fec640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8c2006be30 0x7f8c2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:07.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.299+0000 7f8c44fec640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8c2006be30 0x7f8c2006e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8c38006fd0 tx=0x7f8c38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:07.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.303+0000 7f8c3d7fa640 1 -- 172.21.15.181:0/2372374884 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c3007aa90 con 0x7f8c400b0610 2024-09-12T02:36:07.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.468+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c400b00d0 con 0x7f8c400b0610 2024-09-12T02:36:07.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.469+0000 7f8c3d7fa640 1 -- 172.21.15.181:0/2372374884 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+13107 (secure 0 0 0) 0x7f8c3007a390 con 0x7f8c400b0610 2024-09-12T02:36:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:07.470 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":90,"fsid":"d365410a-fe63-4420-b203-62c6d59c25dd","created":"2024-09-12T02:27:59.516015+0000","modified":"2024-09-12T02:36:04.140386+0000","last_up_change":"2024-09-12T02:28:11.885400+0000","last_in_change":"2024-09-12T02:28:01.585954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:28:11.641634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4dc3a8d-f8f2-446a-8b5b-07ed9fd3cba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6817","nonce":2346029807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6819","nonce":2346029807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6823","nonce":2346029807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2346029807},{"type":"v1","addr":"172.21.15.181:6821","nonce":2346029807}]},"public_addr":"172.21.15.181:6817/2346029807","cluster_addr":"172.21.15.181:6819/2346029807","heartbeat_back_addr":"172.21.15.181:6823/2346029807","heartbeat_front_addr":"172.21.15.181:6821/2346029807","state":["exists","up"]},{"osd":1,"uuid":"29a06fed-cc29-450c-9b21-db2a7bf77fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6827","nonce":1372590643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6829","nonce":1372590643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6833","nonce":1372590643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1372590643},{"type":"v1","addr":"172.21.15.181:6831","nonce":1372590643}]},"public_addr":"172.21.15.181:6827/1372590643","cluster_addr":"172.21.15.181:6829/1372590643","heartbeat_back_addr":"172.21.15.181:6833/1372590643","heartbeat_front_addr":"172.21.15.181:6831/1372590643","state":["exists","up"]},{"osd":2,"uuid":"19c8ae7a-8bff-43ac-b645-f2a4b7aacdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659790931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659790931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659790931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659790931},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659790931}]},"public_addr":"172.21.15.181:6809/3659790931","cluster_addr":"172.21.15.181:6811/3659790931","heartbeat_back_addr":"172.21.15.181:6815/3659790931","heartbeat_front_addr":"172.21.15.181:6813/3659790931","state":["exists","up"]},{"osd":3,"uuid":"9c94f42d-d96a-4dd2-a8bf-a6a92939b002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6801","nonce":1415662156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6803","nonce":1415662156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6807","nonce":1415662156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1415662156},{"type":"v1","addr":"172.21.15.181:6805","nonce":1415662156}]},"public_addr":"172.21.15.181:6801/1415662156","cluster_addr":"172.21.15.181:6803/1415662156","heartbeat_back_addr":"172.21.15.181:6807/1415662156","heartbeat_front_addr":"172.21.15.181:6805/1415662156","state":["exists","up"]},{"osd":4,"uuid":"3c05e764-f178-4109-8429-5d8c25753834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6817","nonce":3702049597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6819","nonce":3702049597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6823","nonce":3702049597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3702049597},{"type":"v1","addr":"172.21.15.204:6821","nonce":3702049597}]},"public_addr":"172.21.15.204:6817/3702049597","cluster_addr":"172.21.15.204:6819/3702049597","heartbeat_back_addr":"172.21.15.204:6823/3702049597","heartbeat_front_addr":"172.21.15.204:6821/3702049597","state":["exists","up"]},{"osd":5,"uuid":"c88060c6-2a6e-472b-bfc4-2fb186734d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6825","nonce":2921904049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6827","nonce":2921904049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6831","nonce":2921904049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2921904049},{"type":"v1","addr":"172.21.15.204:6829","nonce":2921904049}]},"public_addr":"172.21.15.204:6825/2921904049","cluster_addr":"172.21.15.204:6827/2921904049","heartbeat_back_addr":"172.21.15.204:6831/2921904049","heartbeat_front_addr":"172.21.15.204:6829/2921904049","state":["exists","up"]},{"osd":6,"uuid":"e16fb49f-de57-4edf-85ff-3b5df78f9622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6801","nonce":2226411884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6803","nonce":2226411884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6807","nonce":2226411884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":2226411884},{"type":"v1","addr":"172.21.15.204:6805","nonce":2226411884}]},"public_addr":"172.21.15.204:6801/2226411884","cluster_addr":"172.21.15.204:6803/2226411884","heartbeat_back_addr":"172.21.15.204:6807/2226411884","heartbeat_front_addr":"172.21.15.204:6805/2226411884","state":["exists","up"]},{"osd":7,"uuid":"5cfac978-c0fc-4a3d-a935-cb18a6751dab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6809","nonce":3631554107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6811","nonce":3631554107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6815","nonce":3631554107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3631554107},{"type":"v1","addr":"172.21.15.204:6813","nonce":3631554107}]},"public_addr":"172.21.15.204:6809/3631554107","cluster_addr":"172.21.15.204:6811/3631554107","heartbeat_back_addr":"172.21.15.204:6815/3631554107","heartbeat_front_addr":"172.21.15.204:6813/3631554107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.886343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.162332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.464814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.441242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:09.100070+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.602709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.898157+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:28:08.895074+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.204:6835/3487360283":"2024-09-13T02:36:01.135988+0000","172.21.15.204:6832/3487360283":"2024-09-13T02:36:01.135988+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.470+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8c2006be30 msgr2=0x7f8c2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.470+0000 7f8c47250640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8c2006be30 0x7f8c2006e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8c38006fd0 tx=0x7f8c38008040 comp rx=0 tx=0).stop 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.470+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c400b0610 msgr2=0x7f8c40151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.470+0000 7f8c47250640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c400b0610 0x7f8c40151a30 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8c30000f80 tx=0x7f8c30004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 shutdown_connections 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f8c2006be30 0x7f8c2006e2f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c40158c90 0x7f8c40151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c400b0610 0x7f8c40151a30 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 --2- 172.21.15.181:0/2372374884 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c4006c150 0x7f8c40160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 >> 172.21.15.181:0/2372374884 conn(0x7f8c40067b30 msgr2=0x7f8c40071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 shutdown_connections 2024-09-12T02:36:07.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:07.471+0000 7f8c47250640 1 -- 172.21.15.181:0/2372374884 wait complete. 2024-09-12T02:36:08.484 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T02:36:08.485 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:08.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.593+0000 7fc2bbf18640 1 Processor -- start 2024-09-12T02:36:08.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.593+0000 7fc2bbf18640 1 -- start start 2024-09-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2bbf18640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2b4147f50 0x7fc2b4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2bbf18640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b40b0960 0x7fc2b40739a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2bbf18640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b4074000 con 0x7fc2b4162d10 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2bbf18640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b40742e0 con 0x7fc2b4147f50 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2bbf18640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b4162230 con 0x7fc2b40b0960 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2b9cb4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2b4147f50 0x7fc2b4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2b9cb4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2b4147f50 0x7fc2b4073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39640/0 (socket says 172.21.15.181:39640) 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2b94b3640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc2b4162d10 0x7fc2b40b0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53368/0 (socket says 172.21.15.181:53368) 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/3231514927 learned_addr learned my addr 172.21.15.181:0/3231514927 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.594+0000 7fc2ba4b5640 1 --2- 172.21.15.181:0/3231514927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b40b0960 0x7fc2b40739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/3231514927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b40b0960 msgr2=0x7fc2b40739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b9cb4640 1 --2- 172.21.15.181:0/3231514927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b40b0960 0x7fc2b40739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/3231514927 >> v1:172.21.15.181:6789/0 conn(0x7fc2b4162d10 legacy=0x7fc2b40b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b8cb2640 1 -- 172.21.15.181:0/3231514927 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328486382 0 0) 0x7fc2b4074000 con 0x7fc2b4162d10 2024-09-12T02:36:08.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/3231514927 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b4162510 con 0x7fc2b4147f50 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b9cb4640 1 --2- 172.21.15.181:0/3231514927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b4147f50 0x7fc2b4073460 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009e50 tx=0x7fc2b002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f16b03b98c01413 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b8cb2640 1 -- 172.21.15.181:0/3231514927 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0036070 con 0x7fc2b4147f50 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b8cb2640 1 -- 172.21.15.181:0/3231514927 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b0031600 con 0x7fc2b4147f50 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.595+0000 7fc2b8cb2640 1 -- 172.21.15.181:0/3231514927 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00319d0 con 0x7fc2b4147f50 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 -- 172.21.15.181:0/3231514927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b4147f50 msgr2=0x7fc2b4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 --2- 172.21.15.181:0/3231514927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b4147f50 0x7fc2b4073460 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009e50 tx=0x7fc2b002a710 comp rx=0 tx=0).stop 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 -- 172.21.15.181:0/3231514927 shutdown_connections 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 --2- 172.21.15.181:0/3231514927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b40b0960 0x7fc2b40739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 --2- 172.21.15.181:0/3231514927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b4147f50 0x7fc2b4073460 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 -- 172.21.15.181:0/3231514927 >> 172.21.15.181:0/3231514927 conn(0x7fc2b40b2fa0 msgr2=0x7fc2b40b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 -- 172.21.15.181:0/3231514927 shutdown_connections 2024-09-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.596+0000 7fc2bbf18640 1 -- 172.21.15.181:0/3231514927 wait complete. 2024-09-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.597+0000 7fc2bbf18640 1 Processor -- start 2024-09-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.597+0000 7fc2bbf18640 1 -- start start 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2bbf18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b40b0960 0x7fc2b41f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2bbf18640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2b4147f50 0x7fc2b40b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2bbf18640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b4162d10 0x7fc2b40d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2bbf18640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b40ae8a0 con 0x7fc2b40b0960 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2bbf18640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4070680 con 0x7fc2b4147f50 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2bbf18640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b40aea20 con 0x7fc2b4162d10 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b40b0960 0x7fc2b41f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b40b0960 0x7fc2b41f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39644/0 (socket says 172.21.15.181:39644) 2024-09-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/2228746704 learned_addr learned my addr 172.21.15.181:0/2228746704 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2ba4b5640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b4162d10 0x7fc2b40d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b94b3640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2b4147f50 0x7fc2b40b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/2228746704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b4162d10 msgr2=0x7fc2b40d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2b4162d10 0x7fc2b40d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/2228746704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2b4147f50 msgr2=0x7fc2b40b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2b4147f50 0x7fc2b40b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.598+0000 7fc2b9cb4640 1 -- 172.21.15.181:0/2228746704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b40cdfa0 con 0x7fc2b40b0960 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.599+0000 7fc2b9cb4640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b40b0960 0x7fc2b41f5170 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0034040 tx=0x7fc2b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.599+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0036050 con 0x7fc2b40b0960 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.599+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b0037040 con 0x7fc2b40b0960 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.599+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b40ce560 con 0x7fc2b40b0960 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.599+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0009510 con 0x7fc2b40b0960 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.599+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b40ceb20 con 0x7fc2b40b0960 2024-09-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.600+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2b40b0250 con 0x7fc2b40b0960 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.600+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2b0044020 con 0x7fc2b40b0960 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2aa7fc640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc29806be30 0x7fc29806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2b94b3640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc29806be30 0x7fc29806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fc2b00aae60 con 0x7fc2b40b0960 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2aa7fc640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fc298071cf0 0x7fc298074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2b0041e50 con 0x7fc298071cf0 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fc2b00ad560 con 0x7fc2b40b0960 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2ba4b5640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fc298071cf0 0x7fc298074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2b94b3640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc29806be30 0x7fc29806e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40cd440 tx=0x7fc2a4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.601+0000 7fc2ba4b5640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fc298071cf0 0x7fc298074110 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.602+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== osd.0 v2:172.21.15.181:6816/2346029807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2b0041e50 con 0x7fc298071cf0 2024-09-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.615+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 --> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc2b40b3700 con 0x7fc298071cf0 2024-09-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.615+0000 7fc2aa7fc640 1 -- 172.21.15.181:0/2228746704 <== osd.0 v2:172.21.15.181:6816/2346029807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc2b40b3700 con 0x7fc298071cf0 2024-09-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.615+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fc298071cf0 msgr2=0x7fc298074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.615+0000 7fc2bbf18640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6816/2346029807,v1:172.21.15.181:6817/2346029807] conn(0x7fc298071cf0 0x7fc298074110 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc29806be30 msgr2=0x7fc29806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fc29806be30 0x7fc29806e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40cd440 tx=0x7fc2a4007de0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b40b0960 msgr2=0x7fc2b41f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 --2- 172.21.15.181:0/2228746704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2b40b0960 0x7fc2b41f5170 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0034040 tx=0x7fc2b0004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2ba4b5640 1 -- 172.21.15.181:0/2228746704 reap_dead start 2024-09-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 shutdown_connections 2024-09-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 >> 172.21.15.181:0/2228746704 conn(0x7fc2b40b2fa0 msgr2=0x7fc2b40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 shutdown_connections 2024-09-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.616+0000 7fc2bbf18640 1 -- 172.21.15.181:0/2228746704 wait complete. 2024-09-12T02:36:08.627 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T02:36:08.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.725+0000 7fba5c1c4640 1 Processor -- start 2024-09-12T02:36:08.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.726+0000 7fba5c1c4640 1 -- start start 2024-09-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.726+0000 7fba5c1c4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fba540d08f0 0x7fba5415ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.726+0000 7fba5c1c4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba540b2820 con 0x7fba540d0510 2024-09-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.726+0000 7fba5c1c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba540b2b00 con 0x7fba540b3800 2024-09-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.726+0000 7fba5c1c4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fba54141730 con 0x7fba540d08f0 2024-09-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba59f60640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fba540d0510 0x7fba540b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53376/0 (socket says 172.21.15.181:53376) 2024-09-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba59f60640 1 -- 172.21.15.181:0/1839391441 learned_addr learned my addr 172.21.15.181:0/1839391441 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba5a761640 1 --2- 172.21.15.181:0/1839391441 >> v2:172.21.15.204:3300/0 conn(0x7fba540d08f0 0x7fba5415ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba58f5e640 1 -- 172.21.15.181:0/1839391441 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790074248 0 0) 0x7fba540b2820 con 0x7fba540d0510 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba58f5e640 1 -- 172.21.15.181:0/1839391441 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c003520 con 0x7fba540d0510 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba58f5e640 1 -- 172.21.15.181:0/1839391441 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836532322 0 0) 0x7fba540b2b00 con 0x7fba540b3800 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba58f5e640 1 -- 172.21.15.181:0/1839391441 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba540b2820 con 0x7fba540b3800 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba5a761640 1 -- 172.21.15.181:0/1839391441 >> v1:172.21.15.204:6789/0 conn(0x7fba540b3800 legacy=0x7fba54072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba5a761640 1 -- 172.21.15.181:0/1839391441 >> v1:172.21.15.181:6789/0 conn(0x7fba540d0510 legacy=0x7fba540b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.727+0000 7fba5a761640 1 -- 172.21.15.181:0/1839391441 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba54144320 con 0x7fba540d08f0 2024-09-12T02:36:08.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.728+0000 7fba5a761640 1 --2- 172.21.15.181:0/1839391441 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba5415ef90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fba44009d90 tx=0x7fba4402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9d74dd58528620 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.728+0000 7fba58f5e640 1 -- 172.21.15.181:0/1839391441 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44007740 con 0x7fba540d08f0 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.728+0000 7fba58f5e640 1 -- 172.21.15.181:0/1839391441 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba440078e0 con 0x7fba540d08f0 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.728+0000 7fba58f5e640 1 -- 172.21.15.181:0/1839391441 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44007cb0 con 0x7fba540d08f0 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.728+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1839391441 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 msgr2=0x7fba5415ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.728+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1839391441 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba5415ef90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fba44009d90 tx=0x7fba4402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.729+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1839391441 shutdown_connections 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.729+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1839391441 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba5415ef90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.729+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1839391441 >> 172.21.15.181:0/1839391441 conn(0x7fba5406bc10 msgr2=0x7fba5406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.729+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1839391441 shutdown_connections 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.729+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1839391441 wait complete. 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 Processor -- start 2024-09-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 -- start start 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba540b3800 0x7fba5415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba540d0510 0x7fba541363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba540cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fba54143bb0 con 0x7fba540b3800 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fba54142e70 con 0x7fba540d08f0 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.730+0000 7fba5c1c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fba54143d30 con 0x7fba540d0510 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba540b3800 0x7fba5415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba540b3800 0x7fba5415d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39660/0 (socket says 172.21.15.181:39660) 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 -- 172.21.15.181:0/1806284885 learned_addr learned my addr 172.21.15.181:0/1806284885 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba5a761640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba540cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba5975f640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba540d0510 0x7fba541363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 -- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba540d0510 msgr2=0x7fba541363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba540d0510 0x7fba541363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 -- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 msgr2=0x7fba540cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba540cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 -- 172.21.15.181:0/1806284885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba541355f0 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba5a761640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba540cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba59f60640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba540b3800 0x7fba5415d920 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00c500 tx=0x7fba4c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba527fc640 1 -- 172.21.15.181:0/1806284885 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c017070 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba527fc640 1 -- 172.21.15.181:0/1806284885 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c005ce0 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba527fc640 1 -- 172.21.15.181:0/1806284885 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0072f0 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba541358d0 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.731+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba54135e90 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.732+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5415ef90 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.733+0000 7fba527fc640 1 -- 172.21.15.181:0/1806284885 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba4c01a070 con 0x7fba540b3800 2024-09-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.733+0000 7fba527fc640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fba4006be30 0x7fba4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.733+0000 7fba527fc640 1 -- 172.21.15.181:0/1806284885 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fba4c089ee0 con 0x7fba540b3800 2024-09-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.733+0000 7fba5975f640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fba4006be30 0x7fba4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.733+0000 7fba5975f640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fba4006be30 0x7fba4006e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fba48007fd0 tx=0x7fba48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.737+0000 7fba527fc640 1 -- 172.21.15.181:0/1806284885 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba4c058540 con 0x7fba540b3800 2024-09-12T02:36:08.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.903+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fba540b5150 con 0x7fba4006be30 2024-09-12T02:36:08.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.904+0000 7fba527fc640 1 -- 172.21.15.181:0/1806284885 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fba540b5150 con 0x7fba4006be30 2024-09-12T02:36:08.904 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T02:36:08.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fba4006be30 msgr2=0x7fba4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fba4006be30 0x7fba4006e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fba48007fd0 tx=0x7fba48009040 comp rx=0 tx=0).stop 2024-09-12T02:36:08.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba540b3800 msgr2=0x7fba5415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba540b3800 0x7fba5415d920 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00c500 tx=0x7fba4c00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 shutdown_connections 2024-09-12T02:36:08.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fba4006be30 0x7fba4006e2f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fba540d08f0 0x7fba540cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fba540d0510 0x7fba541363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 --2- 172.21.15.181:0/1806284885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba540b3800 0x7fba5415d920 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 >> 172.21.15.181:0/1806284885 conn(0x7fba5406bc10 msgr2=0x7fba5415e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:08.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 shutdown_connections 2024-09-12T02:36:08.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:08.906+0000 7fba5c1c4640 1 -- 172.21.15.181:0/1806284885 wait complete. 2024-09-12T02:36:08.917 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T02:36:08.918 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:09.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.018+0000 7fd85e6c3640 1 Processor -- start 2024-09-12T02:36:09.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.018+0000 7fd85e6c3640 1 -- start start 2024-09-12T02:36:09.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.019+0000 7fd85e6c3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d33d0 0x7fd8580d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.019+0000 7fd85e6c3640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8580d4bf0 0x7fd8580b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.019+0000 7fd85e6c3640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8580d3a40 con 0x7fd85815e8a0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.019+0000 7fd85e6c3640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd8580d37f0 con 0x7fd8580d4bf0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.019+0000 7fd85e6c3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8580d3d20 con 0x7fd8580d33d0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8580d4bf0 0x7fd8580b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8580d4bf0 0x7fd8580b7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39664/0 (socket says 172.21.15.181:39664) 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 -- 172.21.15.181:0/2022085831 learned_addr learned my addr 172.21.15.181:0/2022085831 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd8577fe640 1 --2- 172.21.15.181:0/2022085831 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d33d0 0x7fd8580d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 -- 172.21.15.181:0/2022085831 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d33d0 msgr2=0x7fd8580d46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 --2- 172.21.15.181:0/2022085831 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d33d0 0x7fd8580d46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 -- 172.21.15.181:0/2022085831 >> v1:172.21.15.204:6789/0 conn(0x7fd85815e8a0 legacy=0x7fd8580cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 -- 172.21.15.181:0/2022085831 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8580d4000 con 0x7fd8580d4bf0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd8577fe640 1 --2- 172.21.15.181:0/2022085831 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d33d0 0x7fd8580d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.020+0000 7fd85cc60640 1 --2- 172.21.15.181:0/2022085831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8580d4bf0 0x7fd8580b7e50 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd850009e50 tx=0x7fd85002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0c186b36019537 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd856ffd640 1 -- 172.21.15.181:0/2022085831 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850036070 con 0x7fd8580d4bf0 2024-09-12T02:36:09.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd856ffd640 1 -- 172.21.15.181:0/2022085831 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd850031600 con 0x7fd8580d4bf0 2024-09-12T02:36:09.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd856ffd640 1 -- 172.21.15.181:0/2022085831 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8500319d0 con 0x7fd8580d4bf0 2024-09-12T02:36:09.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2022085831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8580d4bf0 msgr2=0x7fd8580b7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 --2- 172.21.15.181:0/2022085831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8580d4bf0 0x7fd8580b7e50 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd850009e50 tx=0x7fd85002a7a0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2022085831 shutdown_connections 2024-09-12T02:36:09.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 --2- 172.21.15.181:0/2022085831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8580d4bf0 0x7fd8580b7e50 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 --2- 172.21.15.181:0/2022085831 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d33d0 0x7fd8580d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2022085831 >> 172.21.15.181:0/2022085831 conn(0x7fd8580b6270 msgr2=0x7fd8580b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2022085831 shutdown_connections 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.021+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2022085831 wait complete. 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.022+0000 7fd85e6c3640 1 Processor -- start 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85e6c3640 1 -- start start 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85e6c3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8580d33d0 0x7fd858150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85e6c3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d4bf0 0x7fd858161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85e6c3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd85815e8a0 0x7fd858161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85e6c3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580b8390 con 0x7fd85815e8a0 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85e6c3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580b78c0 con 0x7fd8580d33d0 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85e6c3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8580b8510 con 0x7fd8580d4bf0 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85cc60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd85815e8a0 0x7fd858161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd8577fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d4bf0 0x7fd858161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85cc60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd85815e8a0 0x7fd858161980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39680/0 (socket says 172.21.15.181:39680) 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd857fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8580d33d0 0x7fd858150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.023+0000 7fd85cc60640 1 -- 172.21.15.181:0/2802755170 learned_addr learned my addr 172.21.15.181:0/2802755170 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85cc60640 1 -- 172.21.15.181:0/2802755170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d4bf0 msgr2=0x7fd858161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85cc60640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580d4bf0 0x7fd858161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85cc60640 1 -- 172.21.15.181:0/2802755170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8580d33d0 msgr2=0x7fd858150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85cc60640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8580d33d0 0x7fd858150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85cc60640 1 -- 172.21.15.181:0/2802755170 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85815fcd0 con 0x7fd85815e8a0 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85cc60640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd85815e8a0 0x7fd858161980 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd850034040 tx=0x7fd850004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850036050 con 0x7fd85815e8a0 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd850042070 con 0x7fd85815e8a0 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85815ff70 con 0x7fd85815e8a0 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850009510 con 0x7fd85815e8a0 2024-09-12T02:36:09.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.024+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd858160530 con 0x7fd85815e8a0 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.025+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8580d46b0 con 0x7fd85815e8a0 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd850007bf0 con 0x7fd85815e8a0 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd854ff9640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd84406be30 0x7fd84406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fd8500ab7b0 con 0x7fd85815e8a0 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd857fff640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd84406be30 0x7fd84406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd854ff9640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd844071cf0 0x7fd844074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd850043ec0 con 0x7fd844071cf0 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd8500b02c0 con 0x7fd85815e8a0 2024-09-12T02:36:09.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.026+0000 7fd8577fe640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd844071cf0 0x7fd844074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.027+0000 7fd857fff640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd84406be30 0x7fd84406e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd8480016e0 tx=0x7fd848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.027+0000 7fd8577fe640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd844071cf0 0x7fd844074110 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.027+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== osd.1 v2:172.21.15.181:6826/1372590643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd850043ec0 con 0x7fd844071cf0 2024-09-12T02:36:09.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 --> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd8581609c0 con 0x7fd844071cf0 2024-09-12T02:36:09.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd854ff9640 1 -- 172.21.15.181:0/2802755170 <== osd.1 v2:172.21.15.181:6826/1372590643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd8581609c0 con 0x7fd844071cf0 2024-09-12T02:36:09.041 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:09.041 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:09.041 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:09.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd844071cf0 msgr2=0x7fd844074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6826/1372590643,v1:172.21.15.181:6827/1372590643] conn(0x7fd844071cf0 0x7fd844074110 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd84406be30 msgr2=0x7fd84406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd84406be30 0x7fd84406e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd8480016e0 tx=0x7fd848009040 comp rx=0 tx=0).stop 2024-09-12T02:36:09.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd85815e8a0 msgr2=0x7fd858161980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 --2- 172.21.15.181:0/2802755170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd85815e8a0 0x7fd858161980 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd850034040 tx=0x7fd850004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:09.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85cc60640 1 -- 172.21.15.181:0/2802755170 reap_dead start 2024-09-12T02:36:09.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 shutdown_connections 2024-09-12T02:36:09.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 >> 172.21.15.181:0/2802755170 conn(0x7fd8580b6270 msgr2=0x7fd8580b9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 shutdown_connections 2024-09-12T02:36:09.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.040+0000 7fd85e6c3640 1 -- 172.21.15.181:0/2802755170 wait complete. 2024-09-12T02:36:09.052 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T02:36:09.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.149+0000 7f11406ac640 1 Processor -- start 2024-09-12T02:36:09.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.149+0000 7f11406ac640 1 -- start start 2024-09-12T02:36:09.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f11406ac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f113815b2e0 0x7f11380b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f11406ac640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11380ce4f0 con 0x7f11380b2490 2024-09-12T02:36:09.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f11406ac640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11380ce7d0 con 0x7f11380cdfc0 2024-09-12T02:36:09.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f11406ac640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f113815b6c0 con 0x7f113815b2e0 2024-09-12T02:36:09.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f113e448640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f113815b2e0 0x7f11380b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f113ec49640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f11380b2490 0x7f1138071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53380/0 (socket says 172.21.15.181:53380) 2024-09-12T02:36:09.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f113ec49640 1 -- 172.21.15.181:0/3270892127 learned_addr learned my addr 172.21.15.181:0/3270892127 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:09.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f113e448640 1 -- 172.21.15.181:0/3270892127 >> v1:172.21.15.204:6789/0 conn(0x7f11380cdfc0 legacy=0x7f11380b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f113e448640 1 -- 172.21.15.181:0/3270892127 >> v1:172.21.15.181:6789/0 conn(0x7f11380b2490 legacy=0x7f1138071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f113e448640 1 -- 172.21.15.181:0/3270892127 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11380ceab0 con 0x7f113815b2e0 2024-09-12T02:36:09.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.150+0000 7f113d446640 1 -- 172.21.15.181:0/3270892127 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783327953 0 0) 0x7f11380ce4f0 con 0x7f11380b2490 2024-09-12T02:36:09.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.151+0000 7f113e448640 1 --2- 172.21.15.181:0/3270892127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f113815b2e0 0x7f11380b3d20 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f11340097a0 tx=0x7f113402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756dade291b0ebab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.151+0000 7f113d446640 1 -- 172.21.15.181:0/3270892127 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134037070 con 0x7f113815b2e0 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.151+0000 7f113d446640 1 -- 172.21.15.181:0/3270892127 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1134032440 con 0x7f113815b2e0 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.151+0000 7f113d446640 1 -- 172.21.15.181:0/3270892127 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134032810 con 0x7f113815b2e0 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.152+0000 7f11406ac640 1 -- 172.21.15.181:0/3270892127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f113815b2e0 msgr2=0x7f11380b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.152+0000 7f11406ac640 1 --2- 172.21.15.181:0/3270892127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f113815b2e0 0x7f11380b3d20 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f11340097a0 tx=0x7f113402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.152+0000 7f11406ac640 1 -- 172.21.15.181:0/3270892127 shutdown_connections 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.152+0000 7f11406ac640 1 --2- 172.21.15.181:0/3270892127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f113815b2e0 0x7f11380b3d20 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.152+0000 7f11406ac640 1 -- 172.21.15.181:0/3270892127 >> 172.21.15.181:0/3270892127 conn(0x7f113806bc10 msgr2=0x7f113806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.152+0000 7f11406ac640 1 -- 172.21.15.181:0/3270892127 shutdown_connections 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.152+0000 7f11406ac640 1 -- 172.21.15.181:0/3270892127 wait complete. 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.153+0000 7f11406ac640 1 Processor -- start 2024-09-12T02:36:09.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.153+0000 7f11406ac640 1 -- start start 2024-09-12T02:36:09.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11380b2490 0x7f11381f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11380cdfc0 0x7f11381e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f113815b2e0 0x7f11380ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11380712b0 con 0x7f11380cdfc0 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1138071130 con 0x7f113815b2e0 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11380b4260 con 0x7f11380b2490 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11380cdfc0 0x7f11381e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11380cdfc0 0x7f11381e4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39702/0 (socket says 172.21.15.181:39702) 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 -- 172.21.15.181:0/2095561581 learned_addr learned my addr 172.21.15.181:0/2095561581 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113e448640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11380b2490 0x7f11381f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113ec49640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f113815b2e0 0x7f11380ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 -- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11380b2490 msgr2=0x7f11381f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11380b2490 0x7f11381f1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 -- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f113815b2e0 msgr2=0x7f11380ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f113815b2e0 0x7f11380ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 -- 172.21.15.181:0/2095561581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11381f2590 con 0x7f11380cdfc0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113e448640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11380b2490 0x7f11381f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f113dc47640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11380cdfc0 0x7f11381e4930 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f112800c450 tx=0x7f112800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f112effd640 1 -- 172.21.15.181:0/2095561581 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11280052d0 con 0x7f11380cdfc0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f112effd640 1 -- 172.21.15.181:0/2095561581 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1128005470 con 0x7f11380cdfc0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11381f2870 con 0x7f11380cdfc0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f112effd640 1 -- 172.21.15.181:0/2095561581 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128012870 con 0x7f11380cdfc0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.154+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381f2e30 con 0x7f11380cdfc0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.155+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11380d0e40 con 0x7f11380cdfc0 2024-09-12T02:36:09.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.156+0000 7f112effd640 1 -- 172.21.15.181:0/2095561581 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1128012a10 con 0x7f11380cdfc0 2024-09-12T02:36:09.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.156+0000 7f112effd640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f111c06be30 0x7f111c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.156+0000 7f112effd640 1 -- 172.21.15.181:0/2095561581 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f112808a720 con 0x7f11380cdfc0 2024-09-12T02:36:09.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.156+0000 7f113e448640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f111c06be30 0x7f111c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.157+0000 7f113e448640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f111c06be30 0x7f111c06e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1134034000 tx=0x7f113402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.161+0000 7f112effd640 1 -- 172.21.15.181:0/2095561581 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11280593d0 con 0x7f11380cdfc0 2024-09-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.326+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f11380b3ca0 con 0x7f111c06be30 2024-09-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.326+0000 7f112effd640 1 -- 172.21.15.181:0/2095561581 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f11380b3ca0 con 0x7f111c06be30 2024-09-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f111c06be30 msgr2=0x7f111c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f111c06be30 0x7f111c06e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1134034000 tx=0x7f113402e000 comp rx=0 tx=0).stop 2024-09-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11380cdfc0 msgr2=0x7f11381e4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11380cdfc0 0x7f11381e4930 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f112800c450 tx=0x7f112800c910 comp rx=0 tx=0).stop 2024-09-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 shutdown_connections 2024-09-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f111c06be30 0x7f111c06e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f113815b2e0 0x7f11380ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11380cdfc0 0x7f11381e4930 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 --2- 172.21.15.181:0/2095561581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11380b2490 0x7f11381f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 >> 172.21.15.181:0/2095561581 conn(0x7f113806bc10 msgr2=0x7f11380b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 shutdown_connections 2024-09-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.328+0000 7f11406ac640 1 -- 172.21.15.181:0/2095561581 wait complete. 2024-09-12T02:36:09.339 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T02:36:09.340 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:09.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.441+0000 7f6ac65d6640 1 Processor -- start 2024-09-12T02:36:09.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.441+0000 7f6ac65d6640 1 -- start start 2024-09-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac65d6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6ac013db10 0x7f6ac015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac65d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00b52e0 0x7f6ac015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac65d6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ac015ec00 0x7f6ac00b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac65d6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac015f640 con 0x7f6ac015ec00 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac65d6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac015b5e0 con 0x7f6ac013db10 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac65d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac015f080 con 0x7f6ac00b52e0 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ac015ec00 0x7f6ac00b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ac015ec00 0x7f6ac00b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33834/0 (socket says 172.21.15.181:33834) 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 -- 172.21.15.181:0/3217926337 learned_addr learned my addr 172.21.15.181:0/3217926337 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6abf7fe640 1 --2- 172.21.15.181:0/3217926337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00b52e0 0x7f6ac015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6abffff640 1 --2- 172.21.15.181:0/3217926337 >> v2:172.21.15.204:3300/0 conn(0x7f6ac013db10 0x7f6ac015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 -- 172.21.15.181:0/3217926337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00b52e0 msgr2=0x7f6ac015e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 --2- 172.21.15.181:0/3217926337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00b52e0 0x7f6ac015e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 -- 172.21.15.181:0/3217926337 >> v2:172.21.15.204:3300/0 conn(0x7f6ac013db10 msgr2=0x7f6ac015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 --2- 172.21.15.181:0/3217926337 >> v2:172.21.15.204:3300/0 conn(0x7f6ac013db10 0x7f6ac015ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.442+0000 7f6ac4b73640 1 -- 172.21.15.181:0/3217926337 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac015f360 con 0x7f6ac015ec00 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.443+0000 7f6ac4b73640 1 --2- 172.21.15.181:0/3217926337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac015ec00 0x7f6ac00b3010 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f6ac006c940 tx=0x7f6ab802c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b265695f763f1849 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.443+0000 7f6abeffd640 1 -- 172.21.15.181:0/3217926337 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800b2e0 con 0x7f6ac015ec00 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.443+0000 7f6abeffd640 1 -- 172.21.15.181:0/3217926337 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab8009600 con 0x7f6ac015ec00 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.443+0000 7f6abeffd640 1 -- 172.21.15.181:0/3217926337 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800b480 con 0x7f6ac015ec00 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 -- 172.21.15.181:0/3217926337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac015ec00 msgr2=0x7f6ac00b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 --2- 172.21.15.181:0/3217926337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac015ec00 0x7f6ac00b3010 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f6ac006c940 tx=0x7f6ab802c8a0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 -- 172.21.15.181:0/3217926337 shutdown_connections 2024-09-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 --2- 172.21.15.181:0/3217926337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac015ec00 0x7f6ac00b3010 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 --2- 172.21.15.181:0/3217926337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac00b52e0 0x7f6ac015e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 --2- 172.21.15.181:0/3217926337 >> v2:172.21.15.204:3300/0 conn(0x7f6ac013db10 0x7f6ac015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 -- 172.21.15.181:0/3217926337 >> 172.21.15.181:0/3217926337 conn(0x7f6ac006bc10 msgr2=0x7f6ac006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 -- 172.21.15.181:0/3217926337 shutdown_connections 2024-09-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.444+0000 7f6ac65d6640 1 -- 172.21.15.181:0/3217926337 wait complete. 2024-09-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.445+0000 7f6ac65d6640 1 Processor -- start 2024-09-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.445+0000 7f6ac65d6640 1 -- start start 2024-09-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6ac65d6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac00b52e0 0x7f6ac0143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6ac65d6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac013db10 0x7f6ac013c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6ac65d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac015ec00 0x7f6ac013cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6ac65d6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac013def0 con 0x7f6ac00b52e0 2024-09-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6ac65d6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac015bfb0 con 0x7f6ac013db10 2024-09-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6ac65d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac00b3550 con 0x7f6ac015ec00 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac00b52e0 0x7f6ac0143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac00b52e0 0x7f6ac0143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33846/0 (socket says 172.21.15.181:33846) 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abffff640 1 -- 172.21.15.181:0/718737532 learned_addr learned my addr 172.21.15.181:0/718737532 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abf7fe640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac013db10 0x7f6ac013c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6ac4b73640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac015ec00 0x7f6ac013cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abf7fe640 1 -- 172.21.15.181:0/718737532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac015ec00 msgr2=0x7f6ac013cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abf7fe640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ac015ec00 0x7f6ac013cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abf7fe640 1 -- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac00b52e0 msgr2=0x7f6ac0143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abf7fe640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac00b52e0 0x7f6ac0143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abf7fe640 1 -- 172.21.15.181:0/718737532 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac0142200 con 0x7f6ac013db10 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.446+0000 7f6abffff640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ac00b52e0 0x7f6ac0143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.447+0000 7f6abf7fe640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac013db10 0x7f6ac013c590 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400e840 tx=0x7f6ab400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.447+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4017070 con 0x7f6ac013db10 2024-09-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.447+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab400c940 con 0x7f6ac013db10 2024-09-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.447+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac01424e0 con 0x7f6ac013db10 2024-09-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.447+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400ccf0 con 0x7f6ac013db10 2024-09-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.447+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac0142aa0 con 0x7f6ac013db10 2024-09-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.448+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ac0069170 con 0x7f6ac013db10 2024-09-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.448+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab401a070 con 0x7f6ac013db10 2024-09-12T02:36:09.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6abcff9640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6abffff640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f6ab408aff0 con 0x7f6ac013db10 2024-09-12T02:36:09.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6abcff9640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7f6aac071cf0 0x7f6aac074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ab4001d30 con 0x7f6aac071cf0 2024-09-12T02:36:09.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f6ab408b3e0 con 0x7f6ac013db10 2024-09-12T02:36:09.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6ac4b73640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7f6aac071cf0 0x7f6aac074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6abffff640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00112c0 tx=0x7f6ab0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.449+0000 7f6ac4b73640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7f6aac071cf0 0x7f6aac074110 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.450+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== osd.2 v2:172.21.15.181:6808/3659790931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ab4001d30 con 0x7f6aac071cf0 2024-09-12T02:36:09.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.462+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 --> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ac00b38d0 con 0x7f6aac071cf0 2024-09-12T02:36:09.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6abcff9640 1 -- 172.21.15.181:0/718737532 <== osd.2 v2:172.21.15.181:6808/3659790931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ac00b38d0 con 0x7f6aac071cf0 2024-09-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7f6aac071cf0 msgr2=0x7f6aac074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6808/3659790931,v1:172.21.15.181:6809/3659790931] conn(0x7f6aac071cf0 0x7f6aac074110 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 msgr2=0x7f6aac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6aac06be30 0x7f6aac06e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00112c0 tx=0x7f6ab0009190 comp rx=0 tx=0).stop 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac013db10 msgr2=0x7f6ac013c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 --2- 172.21.15.181:0/718737532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ac013db10 0x7f6ac013c590 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400e840 tx=0x7f6ab400ed00 comp rx=0 tx=0).stop 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac4b73640 1 -- 172.21.15.181:0/718737532 reap_dead start 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 shutdown_connections 2024-09-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 >> 172.21.15.181:0/718737532 conn(0x7f6ac006bc10 msgr2=0x7f6ac006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 shutdown_connections 2024-09-12T02:36:09.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.463+0000 7f6ac65d6640 1 -- 172.21.15.181:0/718737532 wait complete. 2024-09-12T02:36:09.474 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T02:36:09.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.573+0000 7f0eeb5c4640 1 Processor -- start 2024-09-12T02:36:09.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.573+0000 7f0eeb5c4640 1 -- start start 2024-09-12T02:36:09.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0eeb5c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee40af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0eeb5c4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee415f150 con 0x7f0ee40aefb0 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0eeb5c4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee415f430 con 0x7f0ee415ec50 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0eeb5c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee40b34c0 con 0x7f0ee415c2f0 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0ee9b61640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0ee40aefb0 0x7f0ee40b3950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:37196/0 (socket says 172.21.15.181:37196) 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0ee9b61640 1 -- 172.21.15.181:0/3545092894 learned_addr learned my addr 172.21.15.181:0/3545092894 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0ee9360640 1 --2- 172.21.15.181:0/3545092894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee40af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.574+0000 7f0ee3fff640 1 -- 172.21.15.181:0/3545092894 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047620851 0 0) 0x7f0ee415f150 con 0x7f0ee40aefb0 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.575+0000 7f0ee3fff640 1 -- 172.21.15.181:0/3545092894 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ecc003520 con 0x7f0ee40aefb0 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.575+0000 7f0ee3fff640 1 -- 172.21.15.181:0/3545092894 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950817039 0 0) 0x7f0ee415f430 con 0x7f0ee415ec50 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.575+0000 7f0ee3fff640 1 -- 172.21.15.181:0/3545092894 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ee415f150 con 0x7f0ee415ec50 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.575+0000 7f0ee9360640 1 -- 172.21.15.181:0/3545092894 >> v1:172.21.15.204:6789/0 conn(0x7f0ee415ec50 legacy=0x7f0ee40ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.575+0000 7f0ee9360640 1 -- 172.21.15.181:0/3545092894 >> v1:172.21.15.181:6789/0 conn(0x7f0ee40aefb0 legacy=0x7f0ee40b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.575+0000 7f0ee9360640 1 -- 172.21.15.181:0/3545092894 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee415f710 con 0x7f0ee415c2f0 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.575+0000 7f0ee9360640 1 --2- 172.21.15.181:0/3545092894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee40af890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009dc0 tx=0x7f0ed402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd84573440e48663 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0ee3fff640 1 -- 172.21.15.181:0/3545092894 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4007740 con 0x7f0ee415c2f0 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0ee3fff640 1 -- 172.21.15.181:0/3545092894 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40078e0 con 0x7f0ee415c2f0 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0ee3fff640 1 -- 172.21.15.181:0/3545092894 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4007c90 con 0x7f0ee415c2f0 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/3545092894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 msgr2=0x7f0ee40af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/3545092894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee40af890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009dc0 tx=0x7f0ed402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/3545092894 shutdown_connections 2024-09-12T02:36:09.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/3545092894 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee40af890 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/3545092894 >> 172.21.15.181:0/3545092894 conn(0x7f0ee40b21c0 msgr2=0x7f0ee40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/3545092894 shutdown_connections 2024-09-12T02:36:09.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.576+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/3545092894 wait complete. 2024-09-12T02:36:09.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.577+0000 7f0eeb5c4640 1 Processor -- start 2024-09-12T02:36:09.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.577+0000 7f0eeb5c4640 1 -- start start 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0eeb5c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ee40aefb0 0x7f0ee40cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0eeb5c4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee4152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0eeb5c4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ee415ec50 0x7f0ee41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0eeb5c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee40afdd0 con 0x7f0ee40aefb0 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0eeb5c4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee40b4060 con 0x7f0ee415ec50 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0eeb5c4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee41533c0 con 0x7f0ee415c2f0 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ee40aefb0 0x7f0ee40cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ee40aefb0 0x7f0ee40cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33848/0 (socket says 172.21.15.181:33848) 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 -- 172.21.15.181:0/101255421 learned_addr learned my addr 172.21.15.181:0/101255421 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:09.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee8b5f640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee4152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9b61640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ee415ec50 0x7f0ee41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 -- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 msgr2=0x7f0ee4152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee4152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 -- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ee415ec50 msgr2=0x7f0ee41554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ee415ec50 0x7f0ee41554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.578+0000 7f0ee9360640 1 -- 172.21.15.181:0/101255421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee41524c0 con 0x7f0ee40aefb0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.579+0000 7f0ee9360640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ee40aefb0 0x7f0ee40cfd00 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000f80 tx=0x7f0ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.579+0000 7f0ee1ffb640 1 -- 172.21.15.181:0/101255421 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4040070 con 0x7f0ee40aefb0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.579+0000 7f0ee1ffb640 1 -- 172.21.15.181:0/101255421 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4031c40 con 0x7f0ee40aefb0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.579+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee415a9b0 con 0x7f0ee40aefb0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.579+0000 7f0ee1ffb640 1 -- 172.21.15.181:0/101255421 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4009450 con 0x7f0ee40aefb0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.579+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee415af70 con 0x7f0ee40aefb0 2024-09-12T02:36:09.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.580+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee40af890 con 0x7f0ee40aefb0 2024-09-12T02:36:09.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.581+0000 7f0ee1ffb640 1 -- 172.21.15.181:0/101255421 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ed4039040 con 0x7f0ee40aefb0 2024-09-12T02:36:09.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.581+0000 7f0ee1ffb640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ed006be30 0x7f0ed006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.581+0000 7f0ee8b5f640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ed006be30 0x7f0ed006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.581+0000 7f0ee1ffb640 1 -- 172.21.15.181:0/101255421 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f0ed40abe70 con 0x7f0ee40aefb0 2024-09-12T02:36:09.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.582+0000 7f0ee8b5f640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ed006be30 0x7f0ed006e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8007fd0 tx=0x7f0ed8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.586+0000 7f0ee1ffb640 1 -- 172.21.15.181:0/101255421 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ee41524c0 con 0x7f0ee40aefb0 2024-09-12T02:36:09.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.752+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0ee40d02f0 con 0x7f0ed006be30 2024-09-12T02:36:09.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.753+0000 7f0ee1ffb640 1 -- 172.21.15.181:0/101255421 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0ee40d02f0 con 0x7f0ed006be30 2024-09-12T02:36:09.753 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T02:36:09.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.754+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ed006be30 msgr2=0x7f0ed006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.754+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ed006be30 0x7f0ed006e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8007fd0 tx=0x7f0ed8009040 comp rx=0 tx=0).stop 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.754+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ee40aefb0 msgr2=0x7f0ee40cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.754+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ee40aefb0 0x7f0ee40cfd00 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000f80 tx=0x7f0ed4004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 shutdown_connections 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f0ed006be30 0x7f0ed006e2f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ee415ec50 0x7f0ee41554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ee415c2f0 0x7f0ee4152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 --2- 172.21.15.181:0/101255421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ee40aefb0 0x7f0ee40cfd00 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 >> 172.21.15.181:0/101255421 conn(0x7f0ee40b21c0 msgr2=0x7f0ee4071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 shutdown_connections 2024-09-12T02:36:09.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.755+0000 7f0eeb5c4640 1 -- 172.21.15.181:0/101255421 wait complete. 2024-09-12T02:36:09.767 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T02:36:09.767 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:09.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.868+0000 7f00ab391640 1 Processor -- start 2024-09-12T02:36:09.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.869+0000 7f00ab391640 1 -- start start 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.869+0000 7f00ab391640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00a40b41c0 0x7f00a415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.869+0000 7f00ab391640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a4070fc0 con 0x7f00a415f3b0 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.869+0000 7f00ab391640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a415fb80 con 0x7f00a415b230 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f00ab391640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f00a40718b0 con 0x7f00a40b41c0 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f00a992e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f00a415f3b0 0x7f00a4071d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:37202/0 (socket says 172.21.15.181:37202) 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f00a992e640 1 -- 172.21.15.181:0/2153306527 learned_addr learned my addr 172.21.15.181:0/2153306527 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f00a892c640 1 --2- 172.21.15.181:0/2153306527 >> v2:172.21.15.204:3300/0 conn(0x7f00a40b41c0 0x7f00a415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f0097fff640 1 -- 172.21.15.181:0/2153306527 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404096542 0 0) 0x7f00a4070fc0 con 0x7f00a415f3b0 2024-09-12T02:36:09.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f0097fff640 1 -- 172.21.15.181:0/2153306527 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0090003520 con 0x7f00a415f3b0 2024-09-12T02:36:09.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f00a892c640 1 -- 172.21.15.181:0/2153306527 >> v1:172.21.15.204:6789/0 conn(0x7f00a415b230 legacy=0x7f00a40b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f00a892c640 1 -- 172.21.15.181:0/2153306527 >> v1:172.21.15.181:6789/0 conn(0x7f00a415f3b0 legacy=0x7f00a4071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.870+0000 7f00a892c640 1 -- 172.21.15.181:0/2153306527 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a4071260 con 0x7f00a40b41c0 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f00a892c640 1 --2- 172.21.15.181:0/2153306527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40b41c0 0x7f00a415ee70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00a4071a30 tx=0x7f00a002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59472a95395e31e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f0097fff640 1 -- 172.21.15.181:0/2153306527 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0037070 con 0x7f00a40b41c0 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f0097fff640 1 -- 172.21.15.181:0/2153306527 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a0032440 con 0x7f00a40b41c0 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f0097fff640 1 -- 172.21.15.181:0/2153306527 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a00327f0 con 0x7f00a40b41c0 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f00ab391640 1 -- 172.21.15.181:0/2153306527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40b41c0 msgr2=0x7f00a415ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f00ab391640 1 --2- 172.21.15.181:0/2153306527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40b41c0 0x7f00a415ee70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00a4071a30 tx=0x7f00a002a210 comp rx=0 tx=0).stop 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f00ab391640 1 -- 172.21.15.181:0/2153306527 shutdown_connections 2024-09-12T02:36:09.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f00ab391640 1 --2- 172.21.15.181:0/2153306527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a40b41c0 0x7f00a415ee70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.871+0000 7f00ab391640 1 -- 172.21.15.181:0/2153306527 >> 172.21.15.181:0/2153306527 conn(0x7f00a406bc10 msgr2=0x7f00a406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.872+0000 7f00ab391640 1 -- 172.21.15.181:0/2153306527 shutdown_connections 2024-09-12T02:36:09.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.872+0000 7f00ab391640 1 -- 172.21.15.181:0/2153306527 wait complete. 2024-09-12T02:36:09.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 Processor -- start 2024-09-12T02:36:09.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 -- start start 2024-09-12T02:36:09.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40b41c0 0x7f00a414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415b230 0x7f00a414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a415f3b0 0x7f00a414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f00a415b610 con 0x7f00a40b41c0 2024-09-12T02:36:09.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f00a415f820 con 0x7f00a415f3b0 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00ab391640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f00a4072450 con 0x7f00a415b230 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00a912d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40b41c0 0x7f00a414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00a912d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40b41c0 0x7f00a414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33852/0 (socket says 172.21.15.181:33852) 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.873+0000 7f00a912d640 1 -- 172.21.15.181:0/3307186036 learned_addr learned my addr 172.21.15.181:0/3307186036 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a892c640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415b230 0x7f00a414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a992e640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a415f3b0 0x7f00a414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a912d640 1 -- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415b230 msgr2=0x7f00a414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a912d640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415b230 0x7f00a414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a912d640 1 -- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a415f3b0 msgr2=0x7f00a414fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a912d640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a415f3b0 0x7f00a414fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a912d640 1 -- 172.21.15.181:0/3307186036 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a414eda0 con 0x7f00a40b41c0 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a892c640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00a415b230 0x7f00a414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a992e640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00a415f3b0 0x7f00a414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:09.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00a912d640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40b41c0 0x7f00a414db10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f009800c400 tx=0x7f009800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980052d0 con 0x7f00a40b41c0 2024-09-12T02:36:09.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0098005490 con 0x7f00a40b41c0 2024-09-12T02:36:09.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098007260 con 0x7f00a40b41c0 2024-09-12T02:36:09.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a414f360 con 0x7f00a40b41c0 2024-09-12T02:36:09.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.874+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a414f920 con 0x7f00a40b41c0 2024-09-12T02:36:09.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.875+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00a4069170 con 0x7f00a40b41c0 2024-09-12T02:36:09.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0098007400 con 0x7f00a40b41c0 2024-09-12T02:36:09.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f0095ffb640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f008806be60 0x7f008806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f009808a0a0 con 0x7f00a40b41c0 2024-09-12T02:36:09.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f00a892c640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f008806be60 0x7f008806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f0095ffb640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f0088071d20 0x7f0088074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:09.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0098009e50 con 0x7f0088071d20 2024-09-12T02:36:09.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f0098091050 con 0x7f00a40b41c0 2024-09-12T02:36:09.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.876+0000 7f00a992e640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f0088071d20 0x7f0088074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:09.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.877+0000 7f00a892c640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f008806be60 0x7f008806e320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f00a0034000 tx=0x7f00a002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.877+0000 7f00a992e640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f0088071d20 0x7f0088074140 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:09.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.877+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== osd.3 v2:172.21.15.181:6800/1415662156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0098009e50 con 0x7f0088071d20 2024-09-12T02:36:09.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 --> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f00a40cdf80 con 0x7f0088071d20 2024-09-12T02:36:09.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f0095ffb640 1 -- 172.21.15.181:0/3307186036 <== osd.3 v2:172.21.15.181:6800/1415662156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f00a40cdf80 con 0x7f0088071d20 2024-09-12T02:36:09.891 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:09.891 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:09.891 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f0088071d20 msgr2=0x7f0088074140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6800/1415662156,v1:172.21.15.181:6801/1415662156] conn(0x7f0088071d20 0x7f0088074140 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f008806be60 msgr2=0x7f008806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f008806be60 0x7f008806e320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f00a0034000 tx=0x7f00a002e000 comp rx=0 tx=0).stop 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40b41c0 msgr2=0x7f00a414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 --2- 172.21.15.181:0/3307186036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00a40b41c0 0x7f00a414db10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f009800c400 tx=0x7f009800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00a992e640 1 -- 172.21.15.181:0/3307186036 reap_dead start 2024-09-12T02:36:09.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 shutdown_connections 2024-09-12T02:36:09.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 >> 172.21.15.181:0/3307186036 conn(0x7f00a406bc10 msgr2=0x7f00a415cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:09.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 shutdown_connections 2024-09-12T02:36:09.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:09.890+0000 7f00ab391640 1 -- 172.21.15.181:0/3307186036 wait complete. 2024-09-12T02:36:09.901 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T02:36:10.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.000+0000 7fae215bd640 1 Processor -- start 2024-09-12T02:36:10.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.000+0000 7fae215bd640 1 -- start start 2024-09-12T02:36:10.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae215bd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae1c0cdfc0 0x7fae1c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae215bd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fae1c0b22c0 0x7fae1c071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae215bd640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1c0ce4f0 con 0x7fae1c15b2e0 2024-09-12T02:36:10.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae215bd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c15b6c0 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae215bd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c0b4430 con 0x7fae1c0b22c0 2024-09-12T02:36:10.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae1c0cdfc0 0x7fae1c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae1c0cdfc0 0x7fae1c0b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33864/0 (socket says 172.21.15.181:33864) 2024-09-12T02:36:10.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1a7fc640 1 -- 172.21.15.181:0/1571709367 learned_addr learned my addr 172.21.15.181:0/1571709367 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1b7fe640 1 --2- 172.21.15.181:0/1571709367 >> v2:172.21.15.204:3300/0 conn(0x7fae1c0b22c0 0x7fae1c071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1a7fc640 1 -- 172.21.15.181:0/1571709367 >> v2:172.21.15.204:3300/0 conn(0x7fae1c0b22c0 msgr2=0x7fae1c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:10.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1a7fc640 1 --2- 172.21.15.181:0/1571709367 >> v2:172.21.15.204:3300/0 conn(0x7fae1c0b22c0 0x7fae1c071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1a7fc640 1 -- 172.21.15.181:0/1571709367 >> v1:172.21.15.204:6789/0 conn(0x7fae1c15b2e0 legacy=0x7fae1c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:10.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.001+0000 7fae1a7fc640 1 -- 172.21.15.181:0/1571709367 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c0ce7d0 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.002+0000 7fae1a7fc640 1 --2- 172.21.15.181:0/1571709367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0b1d80 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0b5590 tx=0x7fae1002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900f124edabc1726 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.002+0000 7fae19ffb640 1 -- 172.21.15.181:0/1571709367 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10037070 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.002+0000 7fae19ffb640 1 -- 172.21.15.181:0/1571709367 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae10032440 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.002+0000 7fae19ffb640 1 -- 172.21.15.181:0/1571709367 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10032810 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 -- 172.21.15.181:0/1571709367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 msgr2=0x7fae1c0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 --2- 172.21.15.181:0/1571709367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0b1d80 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0b5590 tx=0x7fae1002a2a0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 -- 172.21.15.181:0/1571709367 shutdown_connections 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 --2- 172.21.15.181:0/1571709367 >> v2:172.21.15.204:3300/0 conn(0x7fae1c0b22c0 0x7fae1c071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 --2- 172.21.15.181:0/1571709367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0b1d80 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 -- 172.21.15.181:0/1571709367 >> 172.21.15.181:0/1571709367 conn(0x7fae1c06bc10 msgr2=0x7fae1c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 -- 172.21.15.181:0/1571709367 shutdown_connections 2024-09-12T02:36:10.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.003+0000 7fae215bd640 1 -- 172.21.15.181:0/1571709367 wait complete. 2024-09-12T02:36:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.004+0000 7fae215bd640 1 Processor -- start 2024-09-12T02:36:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.004+0000 7fae215bd640 1 -- start start 2024-09-12T02:36:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae215bd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae1c0b22c0 0x7fae1c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae215bd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae215bd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae1c15b2e0 0x7fae1c0aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae215bd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c071130 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae215bd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0ced90 con 0x7fae1c15b2e0 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae215bd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0712b0 con 0x7fae1c0b22c0 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33870/0 (socket says 172.21.15.181:33870) 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 -- 172.21.15.181:0/2443355540 learned_addr learned my addr 172.21.15.181:0/2443355540 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1b7fe640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae1c15b2e0 0x7fae1c0aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1affd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae1c0b22c0 0x7fae1c0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 -- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae1c0b22c0 msgr2=0x7fae1c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae1c0b22c0 0x7fae1c0c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 -- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae1c15b2e0 msgr2=0x7fae1c0aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae1c15b2e0 0x7fae1c0aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.005+0000 7fae1a7fc640 1 -- 172.21.15.181:0/2443355540 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c148380 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.006+0000 7fae1a7fc640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0ab4e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fae10000c00 tx=0x7fae100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.006+0000 7fae037fe640 1 -- 172.21.15.181:0/2443355540 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10041020 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.006+0000 7fae037fe640 1 -- 172.21.15.181:0/2443355540 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae100306c0 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.006+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c0ac0f0 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.006+0000 7fae037fe640 1 -- 172.21.15.181:0/2443355540 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10037040 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.006+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c0ad9c0 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.007+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1c0b1d80 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.007+0000 7fae037fe640 1 -- 172.21.15.181:0/2443355540 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae10044020 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.008+0000 7fae037fe640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fae0806be30 0x7fae0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.008+0000 7fae037fe640 1 -- 172.21.15.181:0/2443355540 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fae100ab250 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.008+0000 7fae1affd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fae0806be30 0x7fae0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.008+0000 7fae1affd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fae0806be30 0x7fae0806e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fae0c001e70 tx=0x7fae0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.012+0000 7fae037fe640 1 -- 172.21.15.181:0/2443355540 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae1004b030 con 0x7fae1c0cdfc0 2024-09-12T02:36:10.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.180+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fae1c073230 con 0x7fae0806be30 2024-09-12T02:36:10.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.180+0000 7fae037fe640 1 -- 172.21.15.181:0/2443355540 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fae1c073230 con 0x7fae0806be30 2024-09-12T02:36:10.181 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T02:36:10.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fae0806be30 msgr2=0x7fae0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fae0806be30 0x7fae0806e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fae0c001e70 tx=0x7fae0c009040 comp rx=0 tx=0).stop 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 msgr2=0x7fae1c0ab4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0ab4e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fae10000c00 tx=0x7fae100046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 shutdown_connections 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fae0806be30 0x7fae0806e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae1c15b2e0 0x7fae1c0aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae1c0cdfc0 0x7fae1c0ab4e0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 --2- 172.21.15.181:0/2443355540 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae1c0b22c0 0x7fae1c0c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.182+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 >> 172.21.15.181:0/2443355540 conn(0x7fae1c06bc10 msgr2=0x7fae1c0716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.183+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 shutdown_connections 2024-09-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.183+0000 7fae215bd640 1 -- 172.21.15.181:0/2443355540 wait complete. 2024-09-12T02:36:10.195 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T02:36:10.195 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:10.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.296+0000 7fab3a7d6640 1 Processor -- start 2024-09-12T02:36:10.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.296+0000 7fab3a7d6640 1 -- start start 2024-09-12T02:36:10.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.297+0000 7fab3a7d6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fab3415e7c0 0x7fab340cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.297+0000 7fab3a7d6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab3415f7e0 con 0x7fab34162420 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.297+0000 7fab3a7d6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab3415fac0 con 0x7fab340d1a90 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.297+0000 7fab3a7d6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fab3415fda0 con 0x7fab3415e7c0 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.297+0000 7fab33fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fab3415e7c0 0x7fab340cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.297+0000 7fab337fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fab34162420 0x7fab340d1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:37208/0 (socket says 172.21.15.181:37208) 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.297+0000 7fab337fe640 1 -- 172.21.15.181:0/813453821 learned_addr learned my addr 172.21.15.181:0/813453821 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab33fff640 1 -- 172.21.15.181:0/813453821 >> v1:172.21.15.204:6789/0 conn(0x7fab340d1a90 legacy=0x7fab3415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab33fff640 1 -- 172.21.15.181:0/813453821 >> v1:172.21.15.181:6789/0 conn(0x7fab34162420 legacy=0x7fab340d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab33fff640 1 -- 172.21.15.181:0/813453821 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab340cef40 con 0x7fab3415e7c0 2024-09-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab32ffd640 1 -- 172.21.15.181:0/813453821 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586025176 0 0) 0x7fab3415f7e0 con 0x7fab34162420 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab33fff640 1 --2- 172.21.15.181:0/813453821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340cf740 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fab240097a0 tx=0x7fab2402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e613eb3eb3a7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab32ffd640 1 -- 172.21.15.181:0/813453821 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24037070 con 0x7fab3415e7c0 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab32ffd640 1 -- 172.21.15.181:0/813453821 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2402ae50 con 0x7fab3415e7c0 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.298+0000 7fab32ffd640 1 -- 172.21.15.181:0/813453821 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24032660 con 0x7fab3415e7c0 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.299+0000 7fab3a7d6640 1 -- 172.21.15.181:0/813453821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 msgr2=0x7fab340cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.299+0000 7fab3a7d6640 1 --2- 172.21.15.181:0/813453821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340cf740 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fab240097a0 tx=0x7fab2402a140 comp rx=0 tx=0).stop 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.299+0000 7fab3a7d6640 1 -- 172.21.15.181:0/813453821 shutdown_connections 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.299+0000 7fab3a7d6640 1 --2- 172.21.15.181:0/813453821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340cf740 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.299+0000 7fab3a7d6640 1 -- 172.21.15.181:0/813453821 >> 172.21.15.181:0/813453821 conn(0x7fab3406dae0 msgr2=0x7fab3406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.299+0000 7fab3a7d6640 1 -- 172.21.15.181:0/813453821 shutdown_connections 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.299+0000 7fab3a7d6640 1 -- 172.21.15.181:0/813453821 wait complete. 2024-09-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.300+0000 7fab3a7d6640 1 Processor -- start 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.300+0000 7fab3a7d6640 1 -- start start 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab3a7d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab340d1a90 0x7fab340b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab3a7d6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab3a7d6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab34162420 0x7fab3414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab3a7d6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fab340cf2b0 con 0x7fab3415e7c0 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab3a7d6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fab3415f540 con 0x7fab34162420 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab3a7d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fab340cfc80 con 0x7fab340d1a90 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab337fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab337fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340ab100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33890/0 (socket says 172.21.15.181:33890) 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab337fe640 1 -- 172.21.15.181:0/3665836163 learned_addr learned my addr 172.21.15.181:0/3665836163 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab33fff640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab340d1a90 0x7fab340b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.301+0000 7fab38d73640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab34162420 0x7fab3414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab337fe640 1 -- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab340d1a90 msgr2=0x7fab340b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab337fe640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab340d1a90 0x7fab340b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab337fe640 1 -- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab34162420 msgr2=0x7fab3414be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab337fe640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab34162420 0x7fab3414be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab337fe640 1 -- 172.21.15.181:0/3665836163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3414ad60 con 0x7fab3415e7c0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab337fe640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340ab100 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fab2800c430 tx=0x7fab2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab280074e0 con 0x7fab3415e7c0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab280047e0 con 0x7fab3415e7c0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3414b040 con 0x7fab3415e7c0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28004bd0 con 0x7fab3415e7c0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.302+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3414b600 con 0x7fab3415e7c0 2024-09-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.303+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab340cf740 con 0x7fab3415e7c0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.303+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab28011070 con 0x7fab3415e7c0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab30ff9640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fab2006be30 0x7fab2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fab2808a6c0 con 0x7fab3415e7c0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab33fff640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fab2006be30 0x7fab2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab30ff9640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fab20071cf0 0x7fab20074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab200747c0 con 0x7fab20071cf0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fab28091050 con 0x7fab3415e7c0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab38d73640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fab20071cf0 0x7fab20074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.304+0000 7fab33fff640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fab2006be30 0x7fab2006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fab24034000 tx=0x7fab2402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.305+0000 7fab38d73640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fab20071cf0 0x7fab20074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.305+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== osd.4 v2:172.21.15.204:6816/3702049597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab200747c0 con 0x7fab20071cf0 2024-09-12T02:36:10.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.318+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 --> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fab340cabd0 con 0x7fab20071cf0 2024-09-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.318+0000 7fab30ff9640 1 -- 172.21.15.181:0/3665836163 <== osd.4 v2:172.21.15.204:6816/3702049597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fab2c005710 con 0x7fab20071cf0 2024-09-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.318+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fab20071cf0 msgr2=0x7fab20074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.318+0000 7fab3a7d6640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.204:6816/3702049597,v1:172.21.15.204:6817/3702049597] conn(0x7fab20071cf0 0x7fab20074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fab2006be30 msgr2=0x7fab2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fab2006be30 0x7fab2006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fab24034000 tx=0x7fab2402e000 comp rx=0 tx=0).stop 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 msgr2=0x7fab340ab100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 --2- 172.21.15.181:0/3665836163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab3415e7c0 0x7fab340ab100 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fab2800c430 tx=0x7fab2800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab38d73640 1 -- 172.21.15.181:0/3665836163 reap_dead start 2024-09-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 shutdown_connections 2024-09-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 >> 172.21.15.181:0/3665836163 conn(0x7fab3406dae0 msgr2=0x7fab340d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 shutdown_connections 2024-09-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.319+0000 7fab3a7d6640 1 -- 172.21.15.181:0/3665836163 wait complete. 2024-09-12T02:36:10.330 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T02:36:10.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.429+0000 7f7399bf8640 1 Processor -- start 2024-09-12T02:36:10.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.429+0000 7f7399bf8640 1 -- start start 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7399bf8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73940cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7399bf8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f73940b0320 0x7f73940cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7399bf8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73940b61b0 con 0x7f7394156770 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7399bf8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f73940b6490 con 0x7f73940b0320 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7399bf8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f73940b6770 con 0x7f73940afec0 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7393fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f73940b0320 0x7f73940cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7393fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f73940b0320 0x7f73940cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33906/0 (socket says 172.21.15.181:33906) 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7393fff640 1 -- 172.21.15.181:0/2223030360 learned_addr learned my addr 172.21.15.181:0/2223030360 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7392ffd640 1 --2- 172.21.15.181:0/2223030360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73940cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7393fff640 1 -- 172.21.15.181:0/2223030360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 msgr2=0x7f73940cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:10.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7393fff640 1 --2- 172.21.15.181:0/2223030360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73940cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7393fff640 1 -- 172.21.15.181:0/2223030360 >> v1:172.21.15.204:6789/0 conn(0x7f7394156770 legacy=0x7f7394160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.430+0000 7f7393fff640 1 -- 172.21.15.181:0/2223030360 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7394160010 con 0x7f73940b0320 2024-09-12T02:36:10.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.431+0000 7f7393fff640 1 --2- 172.21.15.181:0/2223030360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73940b0320 0x7f73940cfd60 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f738c009e50 tx=0x7f738c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbbba0b747b0b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.431+0000 7f73927fc640 1 -- 172.21.15.181:0/2223030360 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c036070 con 0x7f73940b0320 2024-09-12T02:36:10.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.431+0000 7f73927fc640 1 -- 172.21.15.181:0/2223030360 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738c031600 con 0x7f73940b0320 2024-09-12T02:36:10.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.431+0000 7f73927fc640 1 -- 172.21.15.181:0/2223030360 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c0319d0 con 0x7f73940b0320 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 -- 172.21.15.181:0/2223030360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73940b0320 msgr2=0x7f73940cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 --2- 172.21.15.181:0/2223030360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73940b0320 0x7f73940cfd60 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f738c009e50 tx=0x7f738c02a680 comp rx=0 tx=0).stop 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 -- 172.21.15.181:0/2223030360 shutdown_connections 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 --2- 172.21.15.181:0/2223030360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73940b0320 0x7f73940cfd60 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 --2- 172.21.15.181:0/2223030360 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73940cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 -- 172.21.15.181:0/2223030360 >> 172.21.15.181:0/2223030360 conn(0x7f73940b1770 msgr2=0x7f73940b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 -- 172.21.15.181:0/2223030360 shutdown_connections 2024-09-12T02:36:10.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.432+0000 7f7399bf8640 1 -- 172.21.15.181:0/2223030360 wait complete. 2024-09-12T02:36:10.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.433+0000 7f7399bf8640 1 Processor -- start 2024-09-12T02:36:10.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.433+0000 7f7399bf8640 1 -- start start 2024-09-12T02:36:10.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7399bf8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73941557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7399bf8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73940b0320 0x7f739415eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7399bf8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7394156770 0x7f739415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7399bf8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f739406f0c0 con 0x7f7394156770 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7399bf8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f739406ef40 con 0x7f73940b0320 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7399bf8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f739406f240 con 0x7f73940afec0 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7394156770 0x7f739415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7394156770 0x7f739415f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33922/0 (socket says 172.21.15.181:33922) 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 -- 172.21.15.181:0/178371875 learned_addr learned my addr 172.21.15.181:0/178371875 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f73937fe640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73941557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7392ffd640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73940b0320 0x7f739415eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 -- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 msgr2=0x7f73941557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73941557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 -- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73940b0320 msgr2=0x7f739415eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73940b0320 0x7f739415eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 -- 172.21.15.181:0/178371875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739415d390 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.434+0000 7f7393fff640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7394156770 0x7f739415f020 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f738c009f70 tx=0x7f738c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.435+0000 7f737bfff640 1 -- 172.21.15.181:0/178371875 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c03f020 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.435+0000 7f737bfff640 1 -- 172.21.15.181:0/178371875 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738c037040 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.435+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739415d670 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.435+0000 7f737bfff640 1 -- 172.21.15.181:0/178371875 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c036070 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.435+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739415dc30 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.436+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7394160810 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.436+0000 7f737bfff640 1 -- 172.21.15.181:0/178371875 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f738c042020 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.436+0000 7f737bfff640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f738006be30 0x7f738006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.437+0000 7f737bfff640 1 -- 172.21.15.181:0/178371875 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f738c0aaee0 con 0x7f7394156770 2024-09-12T02:36:10.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.437+0000 7f73937fe640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f738006be30 0x7f738006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.437+0000 7f73937fe640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f738006be30 0x7f738006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7394152d50 tx=0x7f7384009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.441+0000 7f737bfff640 1 -- 172.21.15.181:0/178371875 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f738c049030 con 0x7f7394156770 2024-09-12T02:36:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.606+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7394067e30 con 0x7f738006be30 2024-09-12T02:36:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.606+0000 7f737bfff640 1 -- 172.21.15.181:0/178371875 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7394067e30 con 0x7f738006be30 2024-09-12T02:36:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T02:36:10.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f738006be30 msgr2=0x7f738006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f738006be30 0x7f738006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7394152d50 tx=0x7f7384009040 comp rx=0 tx=0).stop 2024-09-12T02:36:10.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7394156770 msgr2=0x7f739415f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7394156770 0x7f739415f020 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f738c009f70 tx=0x7f738c004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:10.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 shutdown_connections 2024-09-12T02:36:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f738006be30 0x7f738006e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73940b0320 0x7f739415eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7394156770 0x7f739415f020 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 --2- 172.21.15.181:0/178371875 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73940afec0 0x7f73941557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 >> 172.21.15.181:0/178371875 conn(0x7f73940b1770 msgr2=0x7f7394149750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 shutdown_connections 2024-09-12T02:36:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.608+0000 7f7399bf8640 1 -- 172.21.15.181:0/178371875 wait complete. 2024-09-12T02:36:10.622 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T02:36:10.622 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.724+0000 7fd31dcd0640 1 Processor -- start 2024-09-12T02:36:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.724+0000 7fd31dcd0640 1 -- start start 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd31dcd0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd31815e6b0 0x7fd3180d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd31dcd0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd3180b3fb0 0x7fd3180b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd31dcd0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31806db30 con 0x7fd31806d630 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd31dcd0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd3180d0490 con 0x7fd31815e6b0 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd31dcd0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd3180d0770 con 0x7fd3180b3fb0 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd3177fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd31815e6b0 0x7fd3180d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd3177fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd31815e6b0 0x7fd3180d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33926/0 (socket says 172.21.15.181:33926) 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd3177fe640 1 -- 172.21.15.181:0/365023988 learned_addr learned my addr 172.21.15.181:0/365023988 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd317fff640 1 --2- 172.21.15.181:0/365023988 >> v2:172.21.15.204:3300/0 conn(0x7fd3180b3fb0 0x7fd3180b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd3177fe640 1 -- 172.21.15.181:0/365023988 >> v2:172.21.15.204:3300/0 conn(0x7fd3180b3fb0 msgr2=0x7fd3180b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd3177fe640 1 --2- 172.21.15.181:0/365023988 >> v2:172.21.15.204:3300/0 conn(0x7fd3180b3fb0 0x7fd3180b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd3177fe640 1 -- 172.21.15.181:0/365023988 >> v1:172.21.15.204:6789/0 conn(0x7fd31806d630 legacy=0x7fd318073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd3177fe640 1 -- 172.21.15.181:0/365023988 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180d0180 con 0x7fd31815e6b0 2024-09-12T02:36:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.725+0000 7fd317fff640 1 --2- 172.21.15.181:0/365023988 >> v2:172.21.15.204:3300/0 conn(0x7fd3180b3fb0 0x7fd3180b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.726+0000 7fd3177fe640 1 --2- 172.21.15.181:0/365023988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31815e6b0 0x7fd3180d0f70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b4b90 tx=0x7fd30802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586526ec5029a722 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.726+0000 7fd3167fc640 1 -- 172.21.15.181:0/365023988 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308036070 con 0x7fd31815e6b0 2024-09-12T02:36:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.726+0000 7fd3167fc640 1 -- 172.21.15.181:0/365023988 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308031600 con 0x7fd31815e6b0 2024-09-12T02:36:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.726+0000 7fd3167fc640 1 -- 172.21.15.181:0/365023988 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3080319f0 con 0x7fd31815e6b0 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 -- 172.21.15.181:0/365023988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31815e6b0 msgr2=0x7fd3180d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 --2- 172.21.15.181:0/365023988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31815e6b0 0x7fd3180d0f70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b4b90 tx=0x7fd30802a7c0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 -- 172.21.15.181:0/365023988 shutdown_connections 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 --2- 172.21.15.181:0/365023988 >> v2:172.21.15.204:3300/0 conn(0x7fd3180b3fb0 0x7fd3180b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 --2- 172.21.15.181:0/365023988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31815e6b0 0x7fd3180d0f70 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 -- 172.21.15.181:0/365023988 >> 172.21.15.181:0/365023988 conn(0x7fd318067950 msgr2=0x7fd318067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 -- 172.21.15.181:0/365023988 shutdown_connections 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.727+0000 7fd31dcd0640 1 -- 172.21.15.181:0/365023988 wait complete. 2024-09-12T02:36:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.728+0000 7fd31dcd0640 1 Processor -- start 2024-09-12T02:36:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.728+0000 7fd31dcd0640 1 -- start start 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd31dcd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31806d630 0x7fd3180c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd31dcd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3180b3fb0 0x7fd3180b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd31dcd0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd31815e6b0 0x7fd31814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd31dcd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180b5320 con 0x7fd31806d630 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd31dcd0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180d14b0 con 0x7fd31815e6b0 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd31dcd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd3180b54a0 con 0x7fd3180b3fb0 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31806d630 0x7fd3180c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31806d630 0x7fd3180c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33942/0 (socket says 172.21.15.181:33942) 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 -- 172.21.15.181:0/2173460950 learned_addr learned my addr 172.21.15.181:0/2173460950 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd316ffd640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3180b3fb0 0x7fd3180b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd317fff640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd31815e6b0 0x7fd31814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 -- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3180b3fb0 msgr2=0x7fd3180b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3180b3fb0 0x7fd3180b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 -- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd31815e6b0 msgr2=0x7fd31814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd31815e6b0 0x7fd31814fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 -- 172.21.15.181:0/2173460950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180c7970 con 0x7fd31806d630 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.729+0000 7fd3177fe640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31806d630 0x7fd3180c7290 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd308009f40 tx=0x7fd308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.730+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308040020 con 0x7fd31806d630 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.730+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308004040 con 0x7fd31806d630 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.730+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3180c7c50 con 0x7fd31806d630 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.730+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308036040 con 0x7fd31806d630 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.730+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3180c8210 con 0x7fd31806d630 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.730+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3180d0f70 con 0x7fd31806d630 2024-09-12T02:36:10.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.731+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd308043020 con 0x7fd31806d630 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.731+0000 7fd2fffff640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30406be30 0x7fd30406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.731+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fd3080ab3c0 con 0x7fd31806d630 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.731+0000 7fd316ffd640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30406be30 0x7fd30406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.732+0000 7fd2fffff640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd304071cf0 0x7fd304074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.732+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3040747c0 con 0x7fd304071cf0 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.732+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd3080b2050 con 0x7fd31806d630 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.732+0000 7fd316ffd640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30406be30 0x7fd30406e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd318161a80 tx=0x7fd30c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.732+0000 7fd317fff640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd304071cf0 0x7fd304074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.732+0000 7fd317fff640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd304071cf0 0x7fd304074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.733+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== osd.5 v2:172.21.15.204:6824/2921904049 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3040747c0 con 0x7fd304071cf0 2024-09-12T02:36:10.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.745+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 --> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd318073f90 con 0x7fd304071cf0 2024-09-12T02:36:10.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd2fffff640 1 -- 172.21.15.181:0/2173460950 <== osd.5 v2:172.21.15.204:6824/2921904049 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd318073f90 con 0x7fd304071cf0 2024-09-12T02:36:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:10.747 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:10.747 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:10.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd304071cf0 msgr2=0x7fd304074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.204:6824/2921904049,v1:172.21.15.204:6825/2921904049] conn(0x7fd304071cf0 0x7fd304074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30406be30 msgr2=0x7fd30406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fd30406be30 0x7fd30406e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd318161a80 tx=0x7fd30c009040 comp rx=0 tx=0).stop 2024-09-12T02:36:10.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31806d630 msgr2=0x7fd3180c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 --2- 172.21.15.181:0/2173460950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd31806d630 0x7fd3180c7290 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd308009f40 tx=0x7fd308004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:10.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd317fff640 1 -- 172.21.15.181:0/2173460950 reap_dead start 2024-09-12T02:36:10.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 shutdown_connections 2024-09-12T02:36:10.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 >> 172.21.15.181:0/2173460950 conn(0x7fd318067950 msgr2=0x7fd3180b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 shutdown_connections 2024-09-12T02:36:10.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.746+0000 7fd31dcd0640 1 -- 172.21.15.181:0/2173460950 wait complete. 2024-09-12T02:36:10.758 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T02:36:10.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.856+0000 7f4121386640 1 Processor -- start 2024-09-12T02:36:10.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.856+0000 7f4121386640 1 -- start start 2024-09-12T02:36:10.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f4121386640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f411c0cf2b0 0x7f411c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f4121386640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f411c0cf720 0x7f411c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f4121386640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411c15ea20 con 0x7f411c15e640 2024-09-12T02:36:10.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f4121386640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f411c0b3d00 con 0x7f411c0cf720 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f4121386640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f411c0b2860 con 0x7f411c0cf2b0 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f411c15e640 0x7f411c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:37218/0 (socket says 172.21.15.181:37218) 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411affd640 1 -- 172.21.15.181:0/619992964 learned_addr learned my addr 172.21.15.181:0/619992964 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411b7fe640 1 --2- 172.21.15.181:0/619992964 >> v2:172.21.15.181:3300/0 conn(0x7f411c0cf720 0x7f411c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f41127fc640 1 --2- 172.21.15.181:0/619992964 >> v2:172.21.15.204:3300/0 conn(0x7f411c0cf2b0 0x7f411c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411b7fe640 1 -- 172.21.15.181:0/619992964 >> v2:172.21.15.204:3300/0 conn(0x7f411c0cf2b0 msgr2=0x7f411c0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411b7fe640 1 --2- 172.21.15.181:0/619992964 >> v2:172.21.15.204:3300/0 conn(0x7f411c0cf2b0 0x7f411c0d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411b7fe640 1 -- 172.21.15.181:0/619992964 >> v1:172.21.15.181:6789/0 conn(0x7f411c15e640 legacy=0x7f411c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411a7fc640 1 -- 172.21.15.181:0/619992964 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3761622607 0 0) 0x7f411c15ea20 con 0x7f411c15e640 2024-09-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.857+0000 7f411b7fe640 1 -- 172.21.15.181:0/619992964 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c0b1c50 con 0x7f411c0cf720 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.858+0000 7f411b7fe640 1 --2- 172.21.15.181:0/619992964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c0d2b90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f411c15ebf0 tx=0x7f411402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74baeaeb646d4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.858+0000 7f411a7fc640 1 -- 172.21.15.181:0/619992964 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114031600 con 0x7f411c0cf720 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.858+0000 7f411a7fc640 1 -- 172.21.15.181:0/619992964 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41140317a0 con 0x7f411c0cf720 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.858+0000 7f411a7fc640 1 -- 172.21.15.181:0/619992964 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114031b70 con 0x7f411c0cf720 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 -- 172.21.15.181:0/619992964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 msgr2=0x7f411c0d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 --2- 172.21.15.181:0/619992964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c0d2b90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f411c15ebf0 tx=0x7f411402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 -- 172.21.15.181:0/619992964 shutdown_connections 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 --2- 172.21.15.181:0/619992964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c0d2b90 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 --2- 172.21.15.181:0/619992964 >> v2:172.21.15.204:3300/0 conn(0x7f411c0cf2b0 0x7f411c0d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 -- 172.21.15.181:0/619992964 >> 172.21.15.181:0/619992964 conn(0x7f411c09d820 msgr2=0x7f411c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 -- 172.21.15.181:0/619992964 shutdown_connections 2024-09-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.859+0000 7f4121386640 1 -- 172.21.15.181:0/619992964 wait complete. 2024-09-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.860+0000 7f4121386640 1 Processor -- start 2024-09-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.860+0000 7f4121386640 1 -- start start 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f4121386640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f411c0cf2b0 0x7f411c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f4121386640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f4121386640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f411c15e640 0x7f411c1508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f4121386640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f411c0b24f0 con 0x7f411c0cf720 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f4121386640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f411c0b2210 con 0x7f411c15e640 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f4121386640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f411c0cfe40 con 0x7f411c0cf2b0 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c14dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33964/0 (socket says 172.21.15.181:33964) 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 -- 172.21.15.181:0/3692143727 learned_addr learned my addr 172.21.15.181:0/3692143727 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f411affd640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f411c0cf2b0 0x7f411c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f411b7fe640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f411c15e640 0x7f411c1508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 -- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f411c0cf2b0 msgr2=0x7f411c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f411c0cf2b0 0x7f411c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 -- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f411c15e640 msgr2=0x7f411c1508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f411c15e640 0x7f411c1508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.861+0000 7f41127fc640 1 -- 172.21.15.181:0/3692143727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c0c91d0 con 0x7f411c0cf720 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.862+0000 7f41127fc640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c14dde0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f410400d5f0 tx=0x7f410400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.862+0000 7f4113fff640 1 -- 172.21.15.181:0/3692143727 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41040125f0 con 0x7f411c0cf720 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.862+0000 7f4113fff640 1 -- 172.21.15.181:0/3692143727 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4104019070 con 0x7f411c0cf720 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.862+0000 7f4113fff640 1 -- 172.21.15.181:0/3692143727 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41040129d0 con 0x7f411c0cf720 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.862+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411c0c94b0 con 0x7f411c0cf720 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.862+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411c0c9a70 con 0x7f411c0cf720 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.863+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411c068eb0 con 0x7f411c0cf720 2024-09-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.863+0000 7f4113fff640 1 -- 172.21.15.181:0/3692143727 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4104012b70 con 0x7f411c0cf720 2024-09-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.864+0000 7f4113fff640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40fc06be30 0x7f40fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.864+0000 7f4113fff640 1 -- 172.21.15.181:0/3692143727 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f410408ae60 con 0x7f411c0cf720 2024-09-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.864+0000 7f411affd640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40fc06be30 0x7f40fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.864+0000 7f411affd640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40fc06be30 0x7f40fc06e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f410c000f60 tx=0x7f410c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:10.868+0000 7f4113fff640 1 -- 172.21.15.181:0/3692143727 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41040594c0 con 0x7f411c0cf720 2024-09-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.034+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f411c0d2cb0 con 0x7f40fc06be30 2024-09-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.034+0000 7f4113fff640 1 -- 172.21.15.181:0/3692143727 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f411c0d2cb0 con 0x7f40fc06be30 2024-09-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T02:36:11.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40fc06be30 msgr2=0x7f40fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40fc06be30 0x7f40fc06e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f410c000f60 tx=0x7f410c007d50 comp rx=0 tx=0).stop 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 msgr2=0x7f411c14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c14dde0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f410400d5f0 tx=0x7f410400dab0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 shutdown_connections 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f40fc06be30 0x7f40fc06e2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f411c15e640 0x7f411c1508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f411c0cf720 0x7f411c14dde0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 --2- 172.21.15.181:0/3692143727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f411c0cf2b0 0x7f411c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.036+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 >> 172.21.15.181:0/3692143727 conn(0x7f411c09d820 msgr2=0x7f411c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.037+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 shutdown_connections 2024-09-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.037+0000 7f4121386640 1 -- 172.21.15.181:0/3692143727 wait complete. 2024-09-12T02:36:11.048 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T02:36:11.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:11.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.150+0000 7ffbad9d6640 1 Processor -- start 2024-09-12T02:36:11.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.150+0000 7ffbad9d6640 1 -- start start 2024-09-12T02:36:11.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffbad9d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 0x7ffba80d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffbad9d6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffba80d18c0 0x7ffba815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffbad9d6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba815f7e0 con 0x7ffba815e7c0 2024-09-12T02:36:11.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffbad9d6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ffba815fda0 con 0x7ffba80d18c0 2024-09-12T02:36:11.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffbad9d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ffba80cf2b0 con 0x7ffba8162420 2024-09-12T02:36:11.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffba6ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ffba815e7c0 0x7ffba80cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:37230/0 (socket says 172.21.15.181:37230) 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffba6ffd640 1 -- 172.21.15.181:0/4466308 learned_addr learned my addr 172.21.15.181:0/4466308 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffba77fe640 1 --2- 172.21.15.181:0/4466308 >> v2:172.21.15.181:3300/0 conn(0x7ffba80d18c0 0x7ffba815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.151+0000 7ffb9e7fc640 1 --2- 172.21.15.181:0/4466308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 0x7ffba80d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba77fe640 1 -- 172.21.15.181:0/4466308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 msgr2=0x7ffba80d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba77fe640 1 --2- 172.21.15.181:0/4466308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 0x7ffba80d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba77fe640 1 -- 172.21.15.181:0/4466308 >> v1:172.21.15.181:6789/0 conn(0x7ffba815e7c0 legacy=0x7ffba80cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba77fe640 1 -- 172.21.15.181:0/4466308 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba815fac0 con 0x7ffba80d18c0 2024-09-12T02:36:11.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba67fc640 1 -- 172.21.15.181:0/4466308 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831862572 0 0) 0x7ffba815f7e0 con 0x7ffba815e7c0 2024-09-12T02:36:11.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffb9e7fc640 1 --2- 172.21.15.181:0/4466308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 0x7ffba80d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:11.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba77fe640 1 --2- 172.21.15.181:0/4466308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba815eba0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009d90 tx=0x7ffba002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e202b3d436d1313f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba67fc640 1 -- 172.21.15.181:0/4466308 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba0031600 con 0x7ffba80d18c0 2024-09-12T02:36:11.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba67fc640 1 -- 172.21.15.181:0/4466308 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba00317a0 con 0x7ffba80d18c0 2024-09-12T02:36:11.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.152+0000 7ffba67fc640 1 -- 172.21.15.181:0/4466308 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba0031b70 con 0x7ffba80d18c0 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 -- 172.21.15.181:0/4466308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 msgr2=0x7ffba815eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 --2- 172.21.15.181:0/4466308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba815eba0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009d90 tx=0x7ffba002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 -- 172.21.15.181:0/4466308 shutdown_connections 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 --2- 172.21.15.181:0/4466308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba815eba0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 --2- 172.21.15.181:0/4466308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 0x7ffba80d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 -- 172.21.15.181:0/4466308 >> 172.21.15.181:0/4466308 conn(0x7ffba806dae0 msgr2=0x7ffba806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 -- 172.21.15.181:0/4466308 shutdown_connections 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.153+0000 7ffbad9d6640 1 -- 172.21.15.181:0/4466308 wait complete. 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.154+0000 7ffbad9d6640 1 Processor -- start 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.154+0000 7ffbad9d6640 1 -- start start 2024-09-12T02:36:11.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffbad9d6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba81f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffbad9d6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffba815e7c0 0x7ffba80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffbad9d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 0x7ffba80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffbad9d6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffba815f0e0 con 0x7ffba80d18c0 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffbad9d6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ffba80cfe50 con 0x7ffba815e7c0 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffbad9d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ffba815f260 con 0x7ffba8162420 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba81f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba81f5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33986/0 (socket says 172.21.15.181:33986) 2024-09-12T02:36:11.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 -- 172.21.15.181:0/729622470 learned_addr learned my addr 172.21.15.181:0/729622470 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 -- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 msgr2=0x7ffba80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffba8162420 0x7ffba80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 -- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffba815e7c0 msgr2=0x7ffba80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffb9e7fc640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffba815e7c0 0x7ffba80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffba815e7c0 0x7ffba80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffba6ffd640 1 -- 172.21.15.181:0/729622470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba80ccb10 con 0x7ffba80d18c0 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.155+0000 7ffb9e7fc640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffba815e7c0 0x7ffba80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.156+0000 7ffba6ffd640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba81f5440 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c4d0 tx=0x7ffb9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.156+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98018070 con 0x7ffba80d18c0 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.156+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb98007500 con 0x7ffba80d18c0 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.156+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98004a20 con 0x7ffba80d18c0 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.156+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba80b4100 con 0x7ffba80d18c0 2024-09-12T02:36:11.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.156+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba80b46c0 con 0x7ffba80d18c0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.157+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffba815eba0 con 0x7ffba80d18c0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.157+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb9801b070 con 0x7ffba80d18c0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffba4ff9640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffb8806be30 0x7ffb8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7ffb98089ee0 con 0x7ffba80d18c0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffb9e7fc640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffb8806be30 0x7ffb8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffba4ff9640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7ffb88071cf0 0x7ffb88074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb880747c0 con 0x7ffb88071cf0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ffb9808c5e0 con 0x7ffba80d18c0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffb9e7fc640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffb8806be30 0x7ffb8806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006fd0 tx=0x7ffb90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.158+0000 7ffba77fe640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7ffb88071cf0 0x7ffb88074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.159+0000 7ffba77fe640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7ffb88071cf0 0x7ffb88074110 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.159+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== osd.6 v2:172.21.15.204:6800/2226411884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb880747c0 con 0x7ffb88071cf0 2024-09-12T02:36:11.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.172+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 --> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffba80d23a0 con 0x7ffb88071cf0 2024-09-12T02:36:11.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.172+0000 7ffba4ff9640 1 -- 172.21.15.181:0/729622470 <== osd.6 v2:172.21.15.204:6800/2226411884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffba80d23a0 con 0x7ffb88071cf0 2024-09-12T02:36:11.174 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:11.174 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7ffb88071cf0 msgr2=0x7ffb88074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.204:6800/2226411884,v1:172.21.15.204:6801/2226411884] conn(0x7ffb88071cf0 0x7ffb88074110 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffb8806be30 msgr2=0x7ffb8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7ffb8806be30 0x7ffb8806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006fd0 tx=0x7ffb90008040 comp rx=0 tx=0).stop 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 msgr2=0x7ffba81f5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 --2- 172.21.15.181:0/729622470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffba80d18c0 0x7ffba81f5440 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c4d0 tx=0x7ffb9800c990 comp rx=0 tx=0).stop 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffba77fe640 1 -- 172.21.15.181:0/729622470 reap_dead start 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 shutdown_connections 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 >> 172.21.15.181:0/729622470 conn(0x7ffba806dae0 msgr2=0x7ffba80d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 shutdown_connections 2024-09-12T02:36:11.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.173+0000 7ffbad9d6640 1 -- 172.21.15.181:0/729622470 wait complete. 2024-09-12T02:36:11.184 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T02:36:11.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.283+0000 7fb773077640 1 Processor -- start 2024-09-12T02:36:11.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.283+0000 7fb773077640 1 -- start start 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb773077640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb76c15e8c0 0x7fb76c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb773077640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb76c0b6ee0 0x7fb76c0d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb773077640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76c06cec0 con 0x7fb76c15e4e0 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb773077640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb76c0d2d40 con 0x7fb76c15e8c0 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb773077640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb76c06d160 con 0x7fb76c0b6ee0 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb763fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb76c15e8c0 0x7fb76c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb763fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb76c15e8c0 0x7fb76c0d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:33990/0 (socket says 172.21.15.181:33990) 2024-09-12T02:36:11.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb763fff640 1 -- 172.21.15.181:0/854892212 learned_addr learned my addr 172.21.15.181:0/854892212 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb771614640 1 --2- 172.21.15.181:0/854892212 >> v2:172.21.15.204:3300/0 conn(0x7fb76c0b6ee0 0x7fb76c0d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb763fff640 1 -- 172.21.15.181:0/854892212 >> v2:172.21.15.204:3300/0 conn(0x7fb76c0b6ee0 msgr2=0x7fb76c0d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb763fff640 1 --2- 172.21.15.181:0/854892212 >> v2:172.21.15.204:3300/0 conn(0x7fb76c0b6ee0 0x7fb76c0d2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb763fff640 1 -- 172.21.15.181:0/854892212 >> v1:172.21.15.204:6789/0 conn(0x7fb76c15e4e0 legacy=0x7fb76c0b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.284+0000 7fb763fff640 1 -- 172.21.15.181:0/854892212 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c06d440 con 0x7fb76c15e8c0 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.285+0000 7fb763fff640 1 --2- 172.21.15.181:0/854892212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c0d1fc0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb76c072df0 tx=0x7fb75c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a8ce23a44a25e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.285+0000 7fb7637fe640 1 -- 172.21.15.181:0/854892212 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c037070 con 0x7fb76c15e8c0 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.285+0000 7fb7637fe640 1 -- 172.21.15.181:0/854892212 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c032440 con 0x7fb76c15e8c0 2024-09-12T02:36:11.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.285+0000 7fb7637fe640 1 -- 172.21.15.181:0/854892212 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c032810 con 0x7fb76c15e8c0 2024-09-12T02:36:11.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 -- 172.21.15.181:0/854892212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 msgr2=0x7fb76c0d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 --2- 172.21.15.181:0/854892212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c0d1fc0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb76c072df0 tx=0x7fb75c02a200 comp rx=0 tx=0).stop 2024-09-12T02:36:11.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 -- 172.21.15.181:0/854892212 shutdown_connections 2024-09-12T02:36:11.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 --2- 172.21.15.181:0/854892212 >> v2:172.21.15.204:3300/0 conn(0x7fb76c0b6ee0 0x7fb76c0d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 --2- 172.21.15.181:0/854892212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c0d1fc0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 -- 172.21.15.181:0/854892212 >> 172.21.15.181:0/854892212 conn(0x7fb76c06f400 msgr2=0x7fb76c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 -- 172.21.15.181:0/854892212 shutdown_connections 2024-09-12T02:36:11.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.286+0000 7fb773077640 1 -- 172.21.15.181:0/854892212 wait complete. 2024-09-12T02:36:11.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.287+0000 7fb773077640 1 Processor -- start 2024-09-12T02:36:11.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.287+0000 7fb773077640 1 -- start start 2024-09-12T02:36:11.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb773077640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb76c0b6ee0 0x7fb76c0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb773077640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb76c15e4e0 0x7fb76c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb773077640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb773077640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c06dc40 con 0x7fb76c15e8c0 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb773077640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c0d2a40 con 0x7fb76c15e4e0 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb773077640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c06ddc0 con 0x7fb76c0b6ee0 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34002/0 (socket says 172.21.15.181:34002) 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 -- 172.21.15.181:0/1624899344 learned_addr learned my addr 172.21.15.181:0/1624899344 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb770e13640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb76c0b6ee0 0x7fb76c0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb763fff640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb76c15e4e0 0x7fb76c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 -- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb76c0b6ee0 msgr2=0x7fb76c0aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb76c0b6ee0 0x7fb76c0aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 -- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb76c15e4e0 msgr2=0x7fb76c150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb76c15e4e0 0x7fb76c150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 -- 172.21.15.181:0/1624899344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c1504a0 con 0x7fb76c15e8c0 2024-09-12T02:36:11.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.288+0000 7fb771614640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c147650 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb764007e70 tx=0x7fb76400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.289+0000 7fb7617fa640 1 -- 172.21.15.181:0/1624899344 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764014620 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.289+0000 7fb7617fa640 1 -- 172.21.15.181:0/1624899344 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb764019070 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.289+0000 7fb7617fa640 1 -- 172.21.15.181:0/1624899344 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764014a20 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.289+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c151350 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.289+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c151900 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.290+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c0b67d0 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.290+0000 7fb7617fa640 1 -- 172.21.15.181:0/1624899344 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb764014bc0 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.291+0000 7fb7617fa640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb75806be30 0x7fb75806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.291+0000 7fb7617fa640 1 -- 172.21.15.181:0/1624899344 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fb76408b4b0 con 0x7fb76c15e8c0 2024-09-12T02:36:11.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.291+0000 7fb770e13640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb75806be30 0x7fb75806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.291+0000 7fb770e13640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb75806be30 0x7fb75806e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb768003d90 tx=0x7fb768009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.295+0000 7fb7617fa640 1 -- 172.21.15.181:0/1624899344 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb76405a160 con 0x7fb76c15e8c0 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.461+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb76c06e560 con 0x7fb75806be30 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.462+0000 7fb7617fa640 1 -- 172.21.15.181:0/1624899344 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb76c06e560 con 0x7fb75806be30 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb75806be30 msgr2=0x7fb75806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb75806be30 0x7fb75806e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb768003d90 tx=0x7fb768009040 comp rx=0 tx=0).stop 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 msgr2=0x7fb76c147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c147650 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb764007e70 tx=0x7fb76400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 shutdown_connections 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fb75806be30 0x7fb75806e2f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb76c15e4e0 0x7fb76c150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb76c15e8c0 0x7fb76c147650 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 --2- 172.21.15.181:0/1624899344 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb76c0b6ee0 0x7fb76c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 >> 172.21.15.181:0/1624899344 conn(0x7fb76c06f400 msgr2=0x7fb76c0d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 shutdown_connections 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.464+0000 7fb773077640 1 -- 172.21.15.181:0/1624899344 wait complete. 2024-09-12T02:36:11.476 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T02:36:11.476 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:36:11.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.579+0000 7f6da5a23640 1 Processor -- start 2024-09-12T02:36:11.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.579+0000 7f6da5a23640 1 -- start start 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6da5a23640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6da00d4dc0 0x7f6da01692c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6da5a23640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da00d3a40 con 0x7f6da00d33d0 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6da5a23640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da00d3d20 con 0x7f6da015e8a0 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6da5a23640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6da00d37f0 con 0x7f6da00d4dc0 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d9f7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6da00d4dc0 0x7f6da01692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d967fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6da00d33d0 0x7f6da00d46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:37240/0 (socket says 172.21.15.181:37240) 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d9f7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6da00d4dc0 0x7f6da01692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34012/0 (socket says 172.21.15.181:34012) 2024-09-12T02:36:11.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d967fc640 1 -- 172.21.15.181:0/1424435810 learned_addr learned my addr 172.21.15.181:0/1424435810 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:11.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/1424435810 >> v1:172.21.15.204:6789/0 conn(0x7f6da015e8a0 legacy=0x7f6da00cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/1424435810 >> v1:172.21.15.181:6789/0 conn(0x7f6da00d33d0 legacy=0x7f6da00d46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d9e7fc640 1 -- 172.21.15.181:0/1424435810 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674175642 0 0) 0x7f6da00d3a40 con 0x7f6da00d33d0 2024-09-12T02:36:11.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.580+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/1424435810 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da00d4000 con 0x7f6da00d4dc0 2024-09-12T02:36:11.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.581+0000 7f6d9f7fe640 1 --2- 172.21.15.181:0/1424435810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da00d4dc0 0x7f6da01692c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009d90 tx=0x7f6d9802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd90cdf6e544c4a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.581+0000 7f6d9e7fc640 1 -- 172.21.15.181:0/1424435810 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98007740 con 0x7f6da00d4dc0 2024-09-12T02:36:11.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.581+0000 7f6d9e7fc640 1 -- 172.21.15.181:0/1424435810 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d980078e0 con 0x7f6da00d4dc0 2024-09-12T02:36:11.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.581+0000 7f6d9e7fc640 1 -- 172.21.15.181:0/1424435810 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98007cb0 con 0x7f6da00d4dc0 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.582+0000 7f6da5a23640 1 -- 172.21.15.181:0/1424435810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da00d4dc0 msgr2=0x7f6da01692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.582+0000 7f6da5a23640 1 --2- 172.21.15.181:0/1424435810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da00d4dc0 0x7f6da01692c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009d90 tx=0x7f6d9802a730 comp rx=0 tx=0).stop 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.582+0000 7f6da5a23640 1 -- 172.21.15.181:0/1424435810 shutdown_connections 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.582+0000 7f6da5a23640 1 --2- 172.21.15.181:0/1424435810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da00d4dc0 0x7f6da01692c0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.582+0000 7f6da5a23640 1 -- 172.21.15.181:0/1424435810 >> 172.21.15.181:0/1424435810 conn(0x7f6da00b6270 msgr2=0x7f6da00b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.582+0000 7f6da5a23640 1 -- 172.21.15.181:0/1424435810 shutdown_connections 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.582+0000 7f6da5a23640 1 -- 172.21.15.181:0/1424435810 wait complete. 2024-09-12T02:36:11.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.583+0000 7f6da5a23640 1 Processor -- start 2024-09-12T02:36:11.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.583+0000 7f6da5a23640 1 -- start start 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6da5a23640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6da00d33d0 0x7f6da0157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6da5a23640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6da00d4dc0 0x7f6da015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6da5a23640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da015e8a0 0x7f6da0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6da5a23640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6da00b8e60 con 0x7f6da015e8a0 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6da5a23640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6da00b78c0 con 0x7f6da00d4dc0 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6da5a23640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6da00b8fe0 con 0x7f6da00d33d0 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da015e8a0 0x7f6da0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da015e8a0 0x7f6da0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34026/0 (socket says 172.21.15.181:34026) 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/3447011714 learned_addr learned my addr 172.21.15.181:0/3447011714 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9effd640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6da00d33d0 0x7f6da0157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d967fc640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6da00d4dc0 0x7f6da015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6da00d33d0 msgr2=0x7f6da0157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6da00d33d0 0x7f6da0157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6da00d4dc0 msgr2=0x7f6da015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6da00d4dc0 0x7f6da015ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/3447011714 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da00caca0 con 0x7f6da015e8a0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9effd640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6da00d33d0 0x7f6da0157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d967fc640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6da00d4dc0 0x7f6da015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9f7fe640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da015e8a0 0x7f6da0156e90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009eb0 tx=0x7f6d98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.584+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98040070 con 0x7f6da015e8a0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.585+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d98031bc0 con 0x7f6da015e8a0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.585+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da00caf80 con 0x7f6da015e8a0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.585+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98045460 con 0x7f6da015e8a0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.585+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da0158920 con 0x7f6da015e8a0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.585+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6da0158430 con 0x7f6da015e8a0 2024-09-12T02:36:11.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.586+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d98039040 con 0x7f6da015e8a0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.586+0000 7f6d9cff9640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6d8006be30 0x7f6d8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f6d980ac4a0 con 0x7f6da015e8a0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d9effd640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6d8006be30 0x7f6d8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d9cff9640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f6d80071cf0 0x7f6d80074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d800747c0 con 0x7f6d80071cf0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f6d980b3050 con 0x7f6da015e8a0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d9effd640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6d8006be30 0x7f6d8006e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6d90006fd0 tx=0x7f6d90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d967fc640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f6d80071cf0 0x7f6d80074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.587+0000 7f6d967fc640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f6d80071cf0 0x7f6d80074110 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.588+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== osd.7 v2:172.21.15.204:6808/3631554107 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d800747c0 con 0x7f6d80071cf0 2024-09-12T02:36:11.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.600+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 --> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6da00d46b0 con 0x7f6d80071cf0 2024-09-12T02:36:11.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6d9cff9640 1 -- 172.21.15.181:0/3447011714 <== osd.7 v2:172.21.15.204:6808/3631554107 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6da00d46b0 con 0x7f6d80071cf0 2024-09-12T02:36:11.602 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-12T02:36:11.602 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:36:11.602 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f6d80071cf0 msgr2=0x7f6d80074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.204:6808/3631554107,v1:172.21.15.204:6809/3631554107] conn(0x7f6d80071cf0 0x7f6d80074110 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6d8006be30 msgr2=0x7f6d8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f6d8006be30 0x7f6d8006e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6d90006fd0 tx=0x7f6d90008040 comp rx=0 tx=0).stop 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da015e8a0 msgr2=0x7f6da0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 --2- 172.21.15.181:0/3447011714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6da015e8a0 0x7f6da0156e90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009eb0 tx=0x7f6d98004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6d9f7fe640 1 -- 172.21.15.181:0/3447011714 reap_dead start 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 shutdown_connections 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 >> 172.21.15.181:0/3447011714 conn(0x7f6da00b6270 msgr2=0x7f6da00b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 shutdown_connections 2024-09-12T02:36:11.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.601+0000 7f6da5a23640 1 -- 172.21.15.181:0/3447011714 wait complete. 2024-09-12T02:36:11.613 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T02:36:11.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.712+0000 7fbea3186640 1 Processor -- start 2024-09-12T02:36:11.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.712+0000 7fbea3186640 1 -- start start 2024-09-12T02:36:11.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea3186640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 0x7fbe9c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea3186640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbe9c0b22c0 0x7fbe9c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea3186640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9c0ce480 con 0x7fbe9c15b1e0 2024-09-12T02:36:11.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea3186640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fbe9c0ce760 con 0x7fbe9c0b22c0 2024-09-12T02:36:11.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea3186640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9c0cea40 con 0x7fbe9c0cdfc0 2024-09-12T02:36:11.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea0f22640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbe9c15b1e0 0x7fbe9c0b3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:37242/0 (socket says 172.21.15.181:37242) 2024-09-12T02:36:11.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea0f22640 1 -- 172.21.15.181:0/2256335826 learned_addr learned my addr 172.21.15.181:0/2256335826 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 0x7fbe9c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea1723640 1 --2- 172.21.15.181:0/2256335826 >> v2:172.21.15.204:3300/0 conn(0x7fbe9c0b22c0 0x7fbe9c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309944037 0 0) 0x7fbe9c0ce480 con 0x7fbe9c15b1e0 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe8c003520 con 0x7fbe9c15b1e0 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 334118904 0 0) 0x7fbe8c003520 con 0x7fbe9c15b1e0 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 msgr2=0x7fbe9c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 0x7fbe9c0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 >> v2:172.21.15.204:3300/0 conn(0x7fbe9c0b22c0 msgr2=0x7fbe9c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 --2- 172.21.15.181:0/2256335826 >> v2:172.21.15.204:3300/0 conn(0x7fbe9c0b22c0 0x7fbe9c0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c0ced20 con 0x7fbe9c15b1e0 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fbe90001670 con 0x7fbe9c15b1e0 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 0x7fbe9c0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:11.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.713+0000 7fbea1723640 1 --2- 172.21.15.181:0/2256335826 >> v2:172.21.15.204:3300/0 conn(0x7fbe9c0b22c0 0x7fbe9c0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 >> v1:172.21.15.181:6789/0 conn(0x7fbe9c15b1e0 legacy=0x7fbe9c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9b7fe640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 0x7fbe8c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9b7fe640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c003ef0 0x7fbe8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9b7fe640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c004d40 0x7fbe8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c0ce760 con 0x7fbe8c003ef0 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c0cea40 con 0x7fbe8c004d40 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c00dbd0 con 0x7fbe9c0cdfc0 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c003ef0 0x7fbe8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbea0f22640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 0x7fbe8c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbea1723640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c004d40 0x7fbe8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9bfff640 1 -- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 msgr2=0x7fbe8c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c0cdfc0 0x7fbe8c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9bfff640 1 -- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c004d40 msgr2=0x7fbe8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:11.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c004d40 0x7fbe8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.714+0000 7fbe9bfff640 1 -- 172.21.15.181:0/2256335826 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c003520 con 0x7fbe8c003ef0 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c003ef0 0x7fbe8c004800 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009c90 tx=0x7fbe8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8c05787d489904 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88036070 con 0x7fbe8c003ef0 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88031400 con 0x7fbe8c003ef0 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbe9b7fe640 1 -- 172.21.15.181:0/2256335826 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88009860 con 0x7fbe8c003ef0 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbea3186640 1 -- 172.21.15.181:0/2256335826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c003ef0 msgr2=0x7fbe8c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbea3186640 1 --2- 172.21.15.181:0/2256335826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c003ef0 0x7fbe8c004800 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009c90 tx=0x7fbe8c005830 comp rx=0 tx=0).stop 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbea1723640 1 -- 172.21.15.181:0/2256335826 reap_dead start 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbea3186640 1 -- 172.21.15.181:0/2256335826 shutdown_connections 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbea3186640 1 -- 172.21.15.181:0/2256335826 >> 172.21.15.181:0/2256335826 conn(0x7fbe9c06bc10 msgr2=0x7fbe9c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbea3186640 1 -- 172.21.15.181:0/2256335826 shutdown_connections 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.715+0000 7fbea3186640 1 -- 172.21.15.181:0/2256335826 wait complete. 2024-09-12T02:36:11.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 Processor -- start 2024-09-12T02:36:11.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 -- start start 2024-09-12T02:36:11.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c003ef0 0x7fbe9c150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9c150f60 0x7fbe9c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c159170 0x7fbe9c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c071130 con 0x7fbe9c150f60 2024-09-12T02:36:11.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c15b5c0 con 0x7fbe8c003ef0 2024-09-12T02:36:11.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.717+0000 7fbea3186640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9c0b1d80 con 0x7fbe9c159170 2024-09-12T02:36:11.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9c150f60 0x7fbe9c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9c150f60 0x7fbe9c0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34052/0 (socket says 172.21.15.181:34052) 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 -- 172.21.15.181:0/1112633762 learned_addr learned my addr 172.21.15.181:0/1112633762 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbea0f22640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c003ef0 0x7fbe9c150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbea1723640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c159170 0x7fbe9c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 -- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c159170 msgr2=0x7fbe9c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c159170 0x7fbe9c0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 -- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c003ef0 msgr2=0x7fbe9c150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c003ef0 0x7fbe9c150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 -- 172.21.15.181:0/1112633762 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c1514a0 con 0x7fbe9c150f60 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbea0f22640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c003ef0 0x7fbe9c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe9bfff640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9c150f60 0x7fbe9c0ccab0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009db0 tx=0x7fbe88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe997fa640 1 -- 172.21.15.181:0/1112633762 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88040020 con 0x7fbe9c150f60 2024-09-12T02:36:11.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe997fa640 1 -- 172.21.15.181:0/1112633762 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe880093e0 con 0x7fbe9c150f60 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c152220 con 0x7fbe9c150f60 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbe997fa640 1 -- 172.21.15.181:0/1112633762 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88036040 con 0x7fbe9c150f60 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.718+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c150c80 con 0x7fbe9c150f60 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.719+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c158240 con 0x7fbe9c150f60 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.720+0000 7fbe997fa640 1 -- 172.21.15.181:0/1112633762 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe88043020 con 0x7fbe9c150f60 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.720+0000 7fbe997fa640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbe8006be60 0x7fbe8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.720+0000 7fbe997fa640 1 -- 172.21.15.181:0/1112633762 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fbe880aaf70 con 0x7fbe9c150f60 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.720+0000 7fbea0f22640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbe8006be60 0x7fbe8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:11.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.721+0000 7fbea0f22640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbe8006be60 0x7fbe8006e320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c15eb60 tx=0x7fbe90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:11.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.725+0000 7fbe997fa640 1 -- 172.21.15.181:0/1112633762 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe9c158240 con 0x7fbe9c150f60 2024-09-12T02:36:11.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.892+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fbe9c0b3c90 con 0x7fbe8006be60 2024-09-12T02:36:11.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.893+0000 7fbe997fa640 1 -- 172.21.15.181:0/1112633762 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbe9c0b3c90 con 0x7fbe8006be60 2024-09-12T02:36:11.894 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.894+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbe8006be60 msgr2=0x7fbe8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.894+0000 7fbea3186640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbe8006be60 0x7fbe8006e320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c15eb60 tx=0x7fbe90009040 comp rx=0 tx=0).stop 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.894+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9c150f60 msgr2=0x7fbe9c0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.894+0000 7fbea3186640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9c150f60 0x7fbe9c0ccab0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009db0 tx=0x7fbe88004730 comp rx=0 tx=0).stop 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 shutdown_connections 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fbe8006be60 0x7fbe8006e320 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbe9c159170 0x7fbe9c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9c150f60 0x7fbe9c0ccab0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 --2- 172.21.15.181:0/1112633762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbe8c003ef0 0x7fbe9c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:11.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 >> 172.21.15.181:0/1112633762 conn(0x7fbe9c06bc10 msgr2=0x7fbe9c15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:11.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 shutdown_connections 2024-09-12T02:36:11.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:11.895+0000 7fbea3186640 1 -- 172.21.15.181:0/1112633762 wait complete. 2024-09-12T02:36:11.906 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:36:12.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.003+0000 7f3b547a6640 1 Processor -- start 2024-09-12T02:36:12.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.003+0000 7f3b547a6640 1 -- start start 2024-09-12T02:36:12.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b547a6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3b4c156950 0x7f3b4c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b547a6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b4c15fe70 0x7f3b4c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b547a6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b4c06e240 con 0x7f3b4c06c150 2024-09-12T02:36:12.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b547a6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4c156d30 con 0x7f3b4c15fe70 2024-09-12T02:36:12.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b547a6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4c160380 con 0x7f3b4c156950 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51d41640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b4c15fe70 0x7f3b4c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51d41640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b4c15fe70 0x7f3b4c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34060/0 (socket says 172.21.15.181:34060) 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51d41640 1 -- 172.21.15.181:0/2003925853 learned_addr learned my addr 172.21.15.181:0/2003925853 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51d41640 1 -- 172.21.15.181:0/2003925853 >> v2:172.21.15.204:3300/0 conn(0x7f3b4c156950 msgr2=0x7f3b4c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51d41640 1 --2- 172.21.15.181:0/2003925853 >> v2:172.21.15.204:3300/0 conn(0x7f3b4c156950 0x7f3b4c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51d41640 1 -- 172.21.15.181:0/2003925853 >> v1:172.21.15.181:6789/0 conn(0x7f3b4c06c150 legacy=0x7f3b4c0d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51d41640 1 -- 172.21.15.181:0/2003925853 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c160660 con 0x7f3b4c15fe70 2024-09-12T02:36:12.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.004+0000 7f3b51540640 1 -- 172.21.15.181:0/2003925853 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424516657 0 0) 0x7f3b44001490 con 0x7f3b4c06c150 2024-09-12T02:36:12.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.005+0000 7f3b51d41640 1 --2- 172.21.15.181:0/2003925853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c15fe70 0x7f3b4c06bc10 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0d22c0 tx=0x7f3b3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8aa2de0d6adde97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:12.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.005+0000 7f3b51540640 1 -- 172.21.15.181:0/2003925853 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c037070 con 0x7f3b4c15fe70 2024-09-12T02:36:12.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.005+0000 7f3b51540640 1 -- 172.21.15.181:0/2003925853 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c032440 con 0x7f3b4c15fe70 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.005+0000 7f3b51540640 1 -- 172.21.15.181:0/2003925853 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c032810 con 0x7f3b4c15fe70 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 -- 172.21.15.181:0/2003925853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c15fe70 msgr2=0x7f3b4c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2003925853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c15fe70 0x7f3b4c06bc10 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0d22c0 tx=0x7f3b3c02a270 comp rx=0 tx=0).stop 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 -- 172.21.15.181:0/2003925853 shutdown_connections 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2003925853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c15fe70 0x7f3b4c06bc10 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2003925853 >> v2:172.21.15.204:3300/0 conn(0x7f3b4c156950 0x7f3b4c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 -- 172.21.15.181:0/2003925853 >> 172.21.15.181:0/2003925853 conn(0x7f3b4c067b30 msgr2=0x7f3b4c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 -- 172.21.15.181:0/2003925853 shutdown_connections 2024-09-12T02:36:12.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.006+0000 7f3b547a6640 1 -- 172.21.15.181:0/2003925853 wait complete. 2024-09-12T02:36:12.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.007+0000 7f3b547a6640 1 Processor -- start 2024-09-12T02:36:12.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.007+0000 7f3b547a6640 1 -- start start 2024-09-12T02:36:12.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b547a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c06c150 0x7f3b4c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b547a6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b4c156950 0x7f3b4c141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b547a6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b4c15fe70 0x7f3b4c15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b547a6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0cede0 con 0x7f3b4c06c150 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b547a6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c160c20 con 0x7f3b4c15fe70 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b547a6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c0cef60 con 0x7f3b4c156950 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c06c150 0x7f3b4c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c06c150 0x7f3b4c1524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34066/0 (socket says 172.21.15.181:34066) 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 -- 172.21.15.181:0/2218340265 learned_addr learned my addr 172.21.15.181:0/2218340265 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 -- 172.21.15.181:0/2218340265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b4c156950 msgr2=0x7f3b4c141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b4c156950 0x7f3b4c141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 -- 172.21.15.181:0/2218340265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b4c15fe70 msgr2=0x7f3b4c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b4c15fe70 0x7f3b4c15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 -- 172.21.15.181:0/2218340265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c0b0fb0 con 0x7f3b4c06c150 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b52542640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c06c150 0x7f3b4c1524e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800b4a0 tx=0x7f3b4800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:12.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b42ffd640 1 -- 172.21.15.181:0/2218340265 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48014070 con 0x7f3b4c06c150 2024-09-12T02:36:12.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.008+0000 7f3b42ffd640 1 -- 172.21.15.181:0/2218340265 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b48010610 con 0x7f3b4c06c150 2024-09-12T02:36:12.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.009+0000 7f3b42ffd640 1 -- 172.21.15.181:0/2218340265 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48010a00 con 0x7f3b4c06c150 2024-09-12T02:36:12.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.009+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4c0b1290 con 0x7f3b4c06c150 2024-09-12T02:36:12.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.009+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4c0b1850 con 0x7f3b4c06c150 2024-09-12T02:36:12.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.010+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4c06bc10 con 0x7f3b4c06c150 2024-09-12T02:36:12.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.010+0000 7f3b42ffd640 1 -- 172.21.15.181:0/2218340265 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b48017070 con 0x7f3b4c06c150 2024-09-12T02:36:12.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.010+0000 7f3b42ffd640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b3006be60 0x7f3b3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.011+0000 7f3b42ffd640 1 -- 172.21.15.181:0/2218340265 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f3b4808a540 con 0x7f3b4c06c150 2024-09-12T02:36:12.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.011+0000 7f3b51d41640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b3006be60 0x7f3b3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:12.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.011+0000 7f3b51d41640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b3006be60 0x7f3b3006e320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c034000 tx=0x7f3b3c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:12.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.015+0000 7f3b42ffd640 1 -- 172.21.15.181:0/2218340265 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b48059280 con 0x7f3b4c06c150 2024-09-12T02:36:12.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.176+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b4c0b0c60 con 0x7f3b3006be60 2024-09-12T02:36:12.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.177+0000 7f3b42ffd640 1 -- 172.21.15.181:0/2218340265 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13454 (secure 0 0 0) 0x7f3b4c0b0c60 con 0x7f3b3006be60 2024-09-12T02:36:12.178 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:12.178 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:36:12.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b3006be60 msgr2=0x7f3b3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b3006be60 0x7f3b3006e320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c034000 tx=0x7f3b3c02c000 comp rx=0 tx=0).stop 2024-09-12T02:36:12.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c06c150 msgr2=0x7f3b4c1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c06c150 0x7f3b4c1524e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800b4a0 tx=0x7f3b4800b960 comp rx=0 tx=0).stop 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 shutdown_connections 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f3b3006be60 0x7f3b3006e320 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b4c15fe70 0x7f3b4c15de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b4c156950 0x7f3b4c141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 --2- 172.21.15.181:0/2218340265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b4c06c150 0x7f3b4c1524e0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 >> 172.21.15.181:0/2218340265 conn(0x7f3b4c067b30 msgr2=0x7f3b4c153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 shutdown_connections 2024-09-12T02:36:12.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:12.179+0000 7f3b547a6640 1 -- 172.21.15.181:0/2218340265 wait complete. 2024-09-12T02:36:12.191 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-12T02:36:11.713032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":285696,"kb_used_data":9800,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689024,"statfs":{"total":773094113280,"available":772801560576,"internally_reserved":0,"allocated":10035200,"data_stored":4965464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.572261"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":302,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T02:36:04.146454+0000","last_change":"2024-09-12T02:28:12.898213+0000","last_active":"2024-09-12T02:36:04.146454+0000","last_peered":"2024-09-12T02:36:04.146454+0000","last_clean":"2024-09-12T02:36:04.146454+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:36:04.146454+0000","last_undegraded":"2024-09-12T02:36:04.146454+0000","last_fullsized":"2024-09-12T02:36:04.146454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:11.885400+0000","last_clean_scrub_stamp":"2024-09-12T02:28:11.885400+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:07.477042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1699840,"data_stored":1063459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509538,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32272,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46160,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325680,"statfs":{"total":96636764160,"available":96589496320,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32276,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41172,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330668,"statfs":{"total":96636764160,"available":96594604032,"internally_reserved":0,"allocated":1699840,"data_stored":1063459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542244,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:12.194 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T02:28:11.885400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=28, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:36:12.194 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:36:17.412 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:17.415 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:32.195 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:36:32.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.305+0000 7f1bd3c8d640 1 Processor -- start 2024-09-12T02:36:32.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.306+0000 7f1bd3c8d640 1 -- start start 2024-09-12T02:36:32.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd3c8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 0x7f1bcc15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd3c8d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1bcc0d08f0 0x7f1bcc072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd3c8d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bcc0b2820 con 0x7f1bcc0d0510 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd3c8d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1bcc0b2b00 con 0x7f1bcc0d08f0 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd3c8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc141730 con 0x7f1bcc0b3800 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd1a29640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1bcc0d0510 0x7f1bcc0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49148/0 (socket says 172.21.15.181:49148) 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd1a29640 1 -- 172.21.15.181:0/4145460554 learned_addr learned my addr 172.21.15.181:0/4145460554 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764761367 0 0) 0x7f1bcc0b2820 con 0x7f1bcc0d0510 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd1228640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 0x7f1bcc15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb8003520 con 0x7f1bcc0d0510 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd222a640 1 --2- 172.21.15.181:0/4145460554 >> v2:172.21.15.204:3300/0 conn(0x7f1bcc0d08f0 0x7f1bcc072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4265532361 0 0) 0x7f1bb8003520 con 0x7f1bcc0d0510 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 msgr2=0x7f1bcc15ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 0x7f1bcc15ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 >> v2:172.21.15.204:3300/0 conn(0x7f1bcc0d08f0 msgr2=0x7f1bcc072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 --2- 172.21.15.181:0/4145460554 >> v2:172.21.15.204:3300/0 conn(0x7f1bcc0d08f0 0x7f1bcc072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc144320 con 0x7f1bcc0d0510 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7f1bc40019f0 con 0x7f1bcc0d0510 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 >> v1:172.21.15.181:6789/0 conn(0x7f1bcc0d0510 legacy=0x7f1bcc0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 0x7f1bb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bb8004d40 0x7f1bb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0b2b00 con 0x7f1bb8004d40 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc141730 con 0x7f1bb80039b0 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.307+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb800b9c0 con 0x7f1bcc0b3800 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd1a29640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd1228640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 0x7f1bb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd222a640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bb8004d40 0x7f1bb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd222a640 1 -- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 msgr2=0x7f1bb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd222a640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0b3800 0x7f1bb8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd222a640 1 -- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb80039b0 msgr2=0x7f1bb8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd222a640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd222a640 1 -- 172.21.15.181:0/4145460554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8003520 con 0x7f1bb8004d40 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.308+0000 7f1bd222a640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bb8004d40 0x7f1bb80051c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009a90 tx=0x7f1bb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e5f0c4beae2920 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8036070 con 0x7f1bb8004d40 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8031400 con 0x7f1bb8004d40 2024-09-12T02:36:32.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd0a27640 1 -- 172.21.15.181:0/4145460554 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8009690 con 0x7f1bb8004d40 2024-09-12T02:36:32.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/4145460554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bb8004d40 msgr2=0x7f1bb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd3c8d640 1 --2- 172.21.15.181:0/4145460554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bb8004d40 0x7f1bb80051c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009a90 tx=0x7f1bb8005830 comp rx=0 tx=0).stop 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd222a640 1 -- 172.21.15.181:0/4145460554 reap_dead start 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/4145460554 shutdown_connections 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/4145460554 >> 172.21.15.181:0/4145460554 conn(0x7f1bcc06bc10 msgr2=0x7f1bcc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/4145460554 shutdown_connections 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.309+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/4145460554 wait complete. 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 Processor -- start 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 -- start start 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb8004d40 0x7f1bcc154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bcc169430 0x7f1bcc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0723e0 0x7f1bcc1403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc15ef90 con 0x7f1bcc169430 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc143dc0 con 0x7f1bb8004d40 2024-09-12T02:36:32.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd3c8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc15f110 con 0x7f1bcc0723e0 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd1228640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bcc169430 0x7f1bcc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd1228640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bcc169430 0x7f1bcc071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44068/0 (socket says 172.21.15.181:44068) 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd1228640 1 -- 172.21.15.181:0/1918911171 learned_addr learned my addr 172.21.15.181:0/1918911171 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.311+0000 7f1bd222a640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0723e0 0x7f1bcc1403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd1a29640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb8004d40 0x7f1bcc154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd1228640 1 -- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0723e0 msgr2=0x7f1bcc1403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd1228640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0723e0 0x7f1bcc1403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd1228640 1 -- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb8004d40 msgr2=0x7f1bcc154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd1228640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb8004d40 0x7f1bcc154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd1228640 1 -- 172.21.15.181:0/1918911171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc154d60 con 0x7f1bcc169430 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd1228640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bcc169430 0x7f1bcc071ea0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0119a0 tx=0x7f1bbc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bc27fc640 1 -- 172.21.15.181:0/1918911171 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00fa30 con 0x7f1bcc169430 2024-09-12T02:36:32.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bc27fc640 1 -- 172.21.15.181:0/1918911171 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc00fbd0 con 0x7f1bcc169430 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc142fd0 con 0x7f1bcc169430 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bc27fc640 1 -- 172.21.15.181:0/1918911171 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc014440 con 0x7f1bcc169430 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.312+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc140fa0 con 0x7f1bcc169430 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.313+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bcc0727f0 con 0x7f1bcc169430 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.314+0000 7f1bc27fc640 1 -- 172.21.15.181:0/1918911171 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bbc012040 con 0x7f1bcc169430 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.314+0000 7f1bc27fc640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1bb006be60 0x7f1bb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.314+0000 7f1bc27fc640 1 -- 172.21.15.181:0/1918911171 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f1bbc08b100 con 0x7f1bcc169430 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.314+0000 7f1bd1a29640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1bb006be60 0x7f1bb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.315+0000 7f1bd1a29640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1bb006be60 0x7f1bb006e320 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc141410 tx=0x7f1bc400a0e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.318+0000 7f1bc27fc640 1 -- 172.21.15.181:0/1918911171 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bcc0727f0 con 0x7f1bcc169430 2024-09-12T02:36:32.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.481+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 --> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bcc142d80 con 0x7f1bb006be60 2024-09-12T02:36:32.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.482+0000 7f1bc27fc640 1 -- 172.21.15.181:0/1918911171 <== mgr.4104 v2:172.21.15.181:6824/3184205121 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13374 (secure 0 0 0) 0x7f1bcc142d80 con 0x7f1bb006be60 2024-09-12T02:36:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:32.483 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-12T02:36:32.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1bb006be60 msgr2=0x7f1bb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1bb006be60 0x7f1bb006e320 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc141410 tx=0x7f1bc400a0e0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bcc169430 msgr2=0x7f1bcc071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bcc169430 0x7f1bcc071ea0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0119a0 tx=0x7f1bbc011da0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 shutdown_connections 2024-09-12T02:36:32.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f1bb006be60 0x7f1bb006e320 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bcc0723e0 0x7f1bcc1403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bcc169430 0x7f1bcc071ea0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 --2- 172.21.15.181:0/1918911171 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bb8004d40 0x7f1bcc154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 >> 172.21.15.181:0/1918911171 conn(0x7f1bcc06bc10 msgr2=0x7f1bcc0b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:32.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 shutdown_connections 2024-09-12T02:36:32.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.484+0000 7f1bd3c8d640 1 -- 172.21.15.181:0/1918911171 wait complete. 2024-09-12T02:36:32.496 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-12T02:36:31.717078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":285680,"kb_used_data":9800,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754689040,"statfs":{"total":773094113280,"available":772801576960,"internally_reserved":0,"allocated":10035200,"data_stored":4965464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":282316337},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002566"},"pg_stats":[{"pgid":"1.0","version":"90'119","reported_seq":314,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T02:36:12.266964+0000","last_change":"2024-09-12T02:36:12.266964+0000","last_active":"2024-09-12T02:36:12.266964+0000","last_peered":"2024-09-12T02:36:12.266964+0000","last_clean":"2024-09-12T02:36:12.266964+0000","last_became_active":"2024-09-12T02:28:12.897230+0000","last_became_peered":"2024-09-12T02:28:12.897230+0000","last_unstale":"2024-09-12T02:36:12.266964+0000","last_undegraded":"2024-09-12T02:36:12.266964+0000","last_fullsized":"2024-09-12T02:36:12.266964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'119","last_scrub_stamp":"2024-09-12T02:36:12.266795+0000","last_deep_scrub":"90'119","last_deep_scrub_stamp":"2024-09-12T02:36:12.266795+0000","last_clean_scrub_stamp":"2024-09-12T02:36:12.266795+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:59.911078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1699840,"data_stored":1063459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32272,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46160,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325680,"statfs":{"total":96636764160,"available":96589496320,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32276,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41164,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330676,"statfs":{"total":96636764160,"available":96594612224,"internally_reserved":0,"allocated":1699840,"data_stored":1063459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542247,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1105920,"data_stored":473091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:32.497 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T02:36:32.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.594+0000 7f11cea1e640 1 Processor -- start 2024-09-12T02:36:32.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.594+0000 7f11cea1e640 1 -- start start 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11cea1e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11c80b50a0 0x7f11c80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11cea1e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c815f9d0 con 0x7f11c815edf0 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11cea1e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c815fcb0 con 0x7f11c815b2e0 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11cea1e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f11c8073fe0 con 0x7f11c80b50a0 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11c77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11c80b50a0 0x7f11c80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11c77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11c80b50a0 0x7f11c80ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44072/0 (socket says 172.21.15.181:44072) 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11c77fe640 1 -- 172.21.15.181:0/3070313673 learned_addr learned my addr 172.21.15.181:0/3070313673 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11ccfbb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f11c815edf0 0x7f11c80cc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49152/0 (socket says 172.21.15.181:49152) 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11c77fe640 1 -- 172.21.15.181:0/3070313673 >> v1:172.21.15.204:6789/0 conn(0x7f11c815b2e0 legacy=0x7f11c80b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11c77fe640 1 -- 172.21.15.181:0/3070313673 >> v1:172.21.15.181:6789/0 conn(0x7f11c815edf0 legacy=0x7f11c80cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11c77fe640 1 -- 172.21.15.181:0/3070313673 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c80cdea0 con 0x7f11c80b50a0 2024-09-12T02:36:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.595+0000 7f11c6ffd640 1 -- 172.21.15.181:0/3070313673 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335573219 0 0) 0x7f11c815f9d0 con 0x7f11c815edf0 2024-09-12T02:36:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.596+0000 7f11c77fe640 1 --2- 172.21.15.181:0/3070313673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c80ce980 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009870 tx=0x7f11b802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff9311e222df27d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.596+0000 7f11c6ffd640 1 -- 172.21.15.181:0/3070313673 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8037070 con 0x7f11c80b50a0 2024-09-12T02:36:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.596+0000 7f11c6ffd640 1 -- 172.21.15.181:0/3070313673 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8032640 con 0x7f11c80b50a0 2024-09-12T02:36:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.596+0000 7f11c6ffd640 1 -- 172.21.15.181:0/3070313673 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8032a10 con 0x7f11c80b50a0 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.597+0000 7f11cea1e640 1 -- 172.21.15.181:0/3070313673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 msgr2=0x7f11c80ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.597+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3070313673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c80ce980 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009870 tx=0x7f11b802a3c0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.597+0000 7f11cea1e640 1 -- 172.21.15.181:0/3070313673 shutdown_connections 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.597+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3070313673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c80ce980 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.597+0000 7f11cea1e640 1 -- 172.21.15.181:0/3070313673 >> 172.21.15.181:0/3070313673 conn(0x7f11c806bc10 msgr2=0x7f11c806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.597+0000 7f11cea1e640 1 -- 172.21.15.181:0/3070313673 shutdown_connections 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.597+0000 7f11cea1e640 1 -- 172.21.15.181:0/3070313673 wait complete. 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.598+0000 7f11cea1e640 1 Processor -- start 2024-09-12T02:36:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.598+0000 7f11cea1e640 1 -- start start 2024-09-12T02:36:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11c815b2e0 0x7f11c814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11c815edf0 0x7f11c8151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11c815b6c0 con 0x7f11c80b50a0 2024-09-12T02:36:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f11c80ce4f0 con 0x7f11c815edf0 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11c815f260 con 0x7f11c815b2e0 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c814f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44080/0 (socket says 172.21.15.181:44080) 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 -- 172.21.15.181:0/3898375054 learned_addr learned my addr 172.21.15.181:0/3898375054 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c77fe640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11c815b2e0 0x7f11c814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11ccfbb640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11c815edf0 0x7f11c8151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 -- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11c815b2e0 msgr2=0x7f11c814d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11c815b2e0 0x7f11c814d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 -- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11c815edf0 msgr2=0x7f11c8151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11c815edf0 0x7f11c8151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 -- 172.21.15.181:0/3898375054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c814e580 con 0x7f11c80b50a0 2024-09-12T02:36:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c77fe640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11c815b2e0 0x7f11c814d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c7fff640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c814f8b0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c480 tx=0x7f11b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b00052d0 con 0x7f11c80b50a0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b0005470 con 0x7f11c80b50a0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c81e50c0 con 0x7f11c80b50a0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0012870 con 0x7f11c80b50a0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.599+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c81e5680 con 0x7f11c80b50a0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.600+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c8069170 con 0x7f11c80b50a0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.601+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11b0012a10 con 0x7f11c80b50a0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.601+0000 7f11c4ff9640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11a806be30 0x7f11a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.602+0000 7f11c77fe640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11a806be30 0x7f11a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.602+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7f11b008a780 con 0x7f11c80b50a0 2024-09-12T02:36:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.602+0000 7f11c77fe640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11a806be30 0x7f11a806e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f11b8034000 tx=0x7f11b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.606+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11b00594c0 con 0x7f11c80b50a0 2024-09-12T02:36:32.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.772+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f11c815f590 con 0x7f11c80b50a0 2024-09-12T02:36:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.775+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v20)=0 v20) ==== 123+0+0 (secure 0 0 0) 0x7f11b0058dc0 con 0x7f11c80b50a0 2024-09-12T02:36:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.776+0000 7f11c4ff9640 1 -- 172.21.15.181:0/3898375054 <== mon.0 v2:172.21.15.181:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f11b005d170 con 0x7f11c80b50a0 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11a806be30 msgr2=0x7f11a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11a806be30 0x7f11a806e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f11b8034000 tx=0x7f11b802e000 comp rx=0 tx=0).stop 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 msgr2=0x7f11c814f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c814f8b0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c480 tx=0x7f11b000c940 comp rx=0 tx=0).stop 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 shutdown_connections 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7f11a806be30 0x7f11a806e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11c815edf0 0x7f11c8151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.777+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f11c815b2e0 0x7f11c814d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.778+0000 7f11cea1e640 1 --2- 172.21.15.181:0/3898375054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c80b50a0 0x7f11c814f8b0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.778+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 >> 172.21.15.181:0/3898375054 conn(0x7f11c806bc10 msgr2=0x7f11c80ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.778+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 shutdown_connections 2024-09-12T02:36:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.778+0000 7f11cea1e640 1 -- 172.21.15.181:0/3898375054 wait complete. 2024-09-12T02:36:32.790 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:36:32.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:36:32.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.887+0000 7fdf99966640 1 Processor -- start 2024-09-12T02:36:32.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.887+0000 7fdf99966640 1 -- start start 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.888+0000 7fdf99966640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 0x7fdf940cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.888+0000 7fdf99966640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf940d0a30 con 0x7fdf9415c4a0 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.888+0000 7fdf99966640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf940b76f0 con 0x7fdf940b47a0 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.888+0000 7fdf99966640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940d0d30 con 0x7fdf940d2da0 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.888+0000 7fdf92ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdf9415c4a0 0x7fdf940b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49154/0 (socket says 172.21.15.181:49154) 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.888+0000 7fdf92ffd640 1 -- 172.21.15.181:0/3079983274 learned_addr learned my addr 172.21.15.181:0/3079983274 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308048734 0 0) 0x7fdf940d0a30 con 0x7fdf9415c4a0 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf7c003520 con 0x7fdf9415c4a0 2024-09-12T02:36:32.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf937fe640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 0x7fdf940cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 861982911 0 0) 0x7fdf7c003520 con 0x7fdf9415c4a0 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 msgr2=0x7fdf940cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 0x7fdf940cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 >> v1:172.21.15.204:6789/0 conn(0x7fdf940b47a0 legacy=0x7fdf94164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf94073710 con 0x7fdf9415c4a0 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 48182486 0 0) 0x7fdf840019f0 con 0x7fdf9415c4a0 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 >> v1:172.21.15.181:6789/0 conn(0x7fdf9415c4a0 legacy=0x7fdf940b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 0x7fdf7c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf7c003f60 0x7fdf7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c004d40 0x7fdf7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940d0d30 con 0x7fdf7c003f60 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c00bb50 con 0x7fdf7c004d40 2024-09-12T02:36:32.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c00bd50 con 0x7fdf940d2da0 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf927fc640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf7c003f60 0x7fdf7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf92ffd640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 0x7fdf7c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf937fe640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c004d40 0x7fdf7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf927fc640 1 -- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 msgr2=0x7fdf7c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf927fc640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf940d2da0 0x7fdf7c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf927fc640 1 -- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c004d40 msgr2=0x7fdf7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf927fc640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c004d40 0x7fdf7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.889+0000 7fdf927fc640 1 -- 172.21.15.181:0/3079983274 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c003520 con 0x7fdf7c003f60 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.890+0000 7fdf927fc640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf7c003f60 0x7fdf7c004800 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fdf88001750 tx=0x7fdf7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80af654ef38cc3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.890+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88001370 con 0x7fdf7c003f60 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.890+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdf880052d0 con 0x7fdf7c003f60 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.890+0000 7fdf91ffb640 1 -- 172.21.15.181:0/3079983274 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8802ac00 con 0x7fdf7c003f60 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.891+0000 7fdf99966640 1 -- 172.21.15.181:0/3079983274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf7c003f60 msgr2=0x7fdf7c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.891+0000 7fdf99966640 1 --2- 172.21.15.181:0/3079983274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf7c003f60 0x7fdf7c004800 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fdf88001750 tx=0x7fdf7c005830 comp rx=0 tx=0).stop 2024-09-12T02:36:32.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.891+0000 7fdf937fe640 1 -- 172.21.15.181:0/3079983274 reap_dead start 2024-09-12T02:36:32.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.891+0000 7fdf99966640 1 -- 172.21.15.181:0/3079983274 shutdown_connections 2024-09-12T02:36:32.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.891+0000 7fdf99966640 1 -- 172.21.15.181:0/3079983274 >> 172.21.15.181:0/3079983274 conn(0x7fdf94067950 msgr2=0x7fdf94067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:32.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.891+0000 7fdf99966640 1 -- 172.21.15.181:0/3079983274 shutdown_connections 2024-09-12T02:36:32.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.891+0000 7fdf99966640 1 -- 172.21.15.181:0/3079983274 wait complete. 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.892+0000 7fdf99966640 1 Processor -- start 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.892+0000 7fdf99966640 1 -- start start 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf99966640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c003f60 0x7fdf941f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf99966640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94158420 0x7fdf9414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf99966640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf941588a0 0x7fdf94150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf99966640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940cff80 con 0x7fdf941588a0 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf99966640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940d28e0 con 0x7fdf7c003f60 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf99966640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940d0100 con 0x7fdf94158420 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf941588a0 0x7fdf94150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf941588a0 0x7fdf94150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44102/0 (socket says 172.21.15.181:44102) 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 -- 172.21.15.181:0/2800809661 learned_addr learned my addr 172.21.15.181:0/2800809661 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf927fc640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94158420 0x7fdf9414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf92ffd640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c003f60 0x7fdf941f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 -- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94158420 msgr2=0x7fdf9414fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94158420 0x7fdf9414fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 -- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c003f60 msgr2=0x7fdf941f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c003f60 0x7fdf941f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 -- 172.21.15.181:0/2800809661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf941f4110 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.893+0000 7fdf937fe640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf941588a0 0x7fdf94150020 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fdf940b2020 tx=0x7fdf8c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.894+0000 7fdf7bfff640 1 -- 172.21.15.181:0/2800809661 <== mon.0 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c019020 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.894+0000 7fdf7bfff640 1 -- 172.21.15.181:0/2800809661 <== mon.0 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdf8c004240 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.894+0000 7fdf7bfff640 1 -- 172.21.15.181:0/2800809661 <== mon.0 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00f710 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.894+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf94158d70 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.894+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf94156460 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.895+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9415c880 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.895+0000 7fdf7bfff640 1 -- 172.21.15.181:0/2800809661 <== mon.0 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf8c01c020 con 0x7fdf941588a0 2024-09-12T02:36:32.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.895+0000 7fdf7bfff640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf8006be60 0x7fdf8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.896+0000 7fdf7bfff640 1 -- 172.21.15.181:0/2800809661 <== mon.0 v2:172.21.15.181:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 4943+0+0 (secure 0 0 0) 0x7fdf8c08ae50 con 0x7fdf941588a0 2024-09-12T02:36:32.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.896+0000 7fdf92ffd640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf8006be60 0x7fdf8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.896+0000 7fdf92ffd640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf8006be60 0x7fdf8006e320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf84002230 tx=0x7fdf84006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:32.900+0000 7fdf7bfff640 1 -- 172.21.15.181:0/2800809661 <== mon.0 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf8c023020 con 0x7fdf941588a0 2024-09-12T02:36:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.099+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf94067d30 con 0x7fdf941588a0 2024-09-12T02:36:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.099+0000 7fdf7bfff640 1 -- 172.21.15.181:0/2800809661 <== mon.0 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3917 (secure 0 0 0) 0x7fdf8c059b00 con 0x7fdf941588a0 2024-09-12T02:36:33.100 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T02:36:33.100 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":71,"btime":"2024-09-12T02:36:02:137760+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6834/4144308809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6833","nonce":4144308809},{"type":"v1","addr":"172.21.15.204:6834","nonce":4144308809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6676,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/73375387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":73375387},{"type":"v1","addr":"172.21.15.181:6837","nonce":73375387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/2875304806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":2875304806},{"type":"v1","addr":"172.21.15.204:6835","nonce":2875304806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3782132497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3782132497},{"type":"v1","addr":"172.21.15.181:6836","nonce":3782132497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[]} 2024-09-12T02:36:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:dumped fsmap epoch 71 2024-09-12T02:36:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf8006be60 msgr2=0x7fdf8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf8006be60 0x7fdf8006e320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf84002230 tx=0x7fdf84006040 comp rx=0 tx=0).stop 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf941588a0 msgr2=0x7fdf94150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf941588a0 0x7fdf94150020 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fdf940b2020 tx=0x7fdf8c011cf0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 shutdown_connections 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:6824/3184205121,v1:172.21.15.181:6825/3184205121] conn(0x7fdf8006be60 0x7fdf8006e320 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf941588a0 0x7fdf94150020 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf94158420 0x7fdf9414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 --2- 172.21.15.181:0/2800809661 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf7c003f60 0x7fdf941f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 >> 172.21.15.181:0/2800809661 conn(0x7fdf94067950 msgr2=0x7fdf941599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 shutdown_connections 2024-09-12T02:36:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T02:36:33.101+0000 7fdf99966640 1 -- 172.21.15.181:0/2800809661 wait complete. 2024-09-12T02:36:33.113 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-12T02:36:33.114 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T02:36:33.114 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:36:33.114 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.123 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:36:33.123 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:36:33.123 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.172 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:36:33.172 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:36:33.172 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.184 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:36:33.184 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:36:33.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.236 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:36:33.236 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T02:36:33.236 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T02:36:33.236 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.268 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T02:36:33.268 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T02:36:33.268 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.342 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T02:36:33.343 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T02:36:33.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.414 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T02:36:33.414 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.479 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T02:36:33.479 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T02:36:33.479 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.520 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T02:36:33.520 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T02:36:33.520 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.598 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T02:36:33.598 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T02:36:33.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.665 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T02:36:33.665 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T02:36:33.665 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.742 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T02:36:33.742 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T02:36:33.743 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T02:36:33.743 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.770 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T02:36:33.770 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T02:36:33.770 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.815 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T02:36:33.815 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T02:36:33.816 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:36:33.816 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.828 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:36:33.828 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:36:33.828 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.868 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:36:33.868 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:36:33.868 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:36:33.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T02:36:33.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-12T02:36:33.923 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-12T02:36:33.923 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-12T02:36:33.923 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:36:33.923 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T02:36:33.923 DEBUG:teuthology.orchestra.run.smithi181:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'bad backtrace on directory inode' | egrep -v 'error reading table object' | egrep -v 'Metadata damage detected' | egrep -v 'slow requests are blocked' | egrep -v 'Behind on trimming' | egrep -v 'error reading sessionmap' | head -n 1 2024-09-12T02:36:33.959 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:36:33.959 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T02:36:34.149 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:36:34.149 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T02:36:34.268 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:36:34.268 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T02:36:34.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:36:34.318 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T02:36:34.360 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:36:34.360 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T02:36:34.520 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:36:34.520 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T02:36:34.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:36:34.599 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T02:36:34.655 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:36:34.656 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T02:36:34.717 INFO:tasks.ceph:Archiving mon data... 2024-09-12T02:36:34.719 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/data/mon.a.tgz 2024-09-12T02:36:34.719 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-12T02:36:34.735 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.mwsXMRE8SQ 2024-09-12T02:36:34.736 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.mwsXMRE8SQ 2024-09-12T02:36:34.940 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.mwsXMRE8SQ 2024-09-12T02:36:35.024 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.mwsXMRE8SQ is 709KB 2024-09-12T02:36:35.128 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.mwsXMRE8SQ 2024-09-12T02:36:35.143 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/data/mon.b.tgz 2024-09-12T02:36:35.143 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-12T02:36:35.161 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.FuPGGVRXNF 2024-09-12T02:36:35.161 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FuPGGVRXNF 2024-09-12T02:36:35.304 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.FuPGGVRXNF 2024-09-12T02:36:35.389 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.FuPGGVRXNF is 352KB 2024-09-12T02:36:35.485 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.FuPGGVRXNF 2024-09-12T02:36:35.500 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/data/mon.c.tgz 2024-09-12T02:36:35.501 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-12T02:36:35.555 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.mdBbqx3NXB 2024-09-12T02:36:35.556 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mdBbqx3NXB 2024-09-12T02:36:35.686 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.mdBbqx3NXB 2024-09-12T02:36:35.770 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.mdBbqx3NXB is 352KB 2024-09-12T02:36:35.864 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.mdBbqx3NXB 2024-09-12T02:36:35.879 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T02:36:35.880 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:36:35.882 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:36:35.965 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:36:36.000 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:36:36.000 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T02:36:36.002 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/remote/smithi181/crash 2024-09-12T02:36:36.002 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:36:36.031 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/remote/smithi204/crash 2024-09-12T02:36:36.032 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:36:36.064 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T02:36:36.064 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:36.076 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:36.153 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:36.179 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:36.203 INFO:tasks.ceph:Compressing logs... 2024-09-12T02:36:36.203 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:36:36.222 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:36:36.244 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64638.log 2024-09-12T02:36:36.287 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36946.log 2024-09-12T02:36:36.287 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37077.log 2024-09-12T02:36:36.287 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43464.log 2024-09-12T02:36:36.287 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.36946.log: /var/log/ceph/ceph-client.admin.37077.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36946.log.gz 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.3.43464.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37077.log.gz 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36826.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.3.43464.log.gz 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.36826.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36826.log.gz 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36990.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.36990.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.36906.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36990.log.gz 2024-09-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43010.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.1.43010.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.5.log: 87.8% -- replaced with /var/log/ceph/ceph-client.1.43010.log.gz 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr: /var/log/ceph/ceph-client.admin.37037.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.37037.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37037.log.gz 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mgr.x.log: 94.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36786.log 2024-09-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi204.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T02:36:36.306 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36866.log 2024-09-12T02:36:36.307 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.36786.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36786.log.gz 2024-09-12T02:36:36.311 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.36866.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36866.log.gz 2024-09-12T02:36:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T02:36:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66562.log 2024-09-12T02:36:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67208.log 2024-09-12T02:36:36.377 INFO:teuthology.orchestra.run.smithi181.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64638.log.gz 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66478.log 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.67208.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66562.log.gz 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66478.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67208.log.gz 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66982.log 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66478.log.gz 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63759.log 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66982.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz -5 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61216.log 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66982.log.gz 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59021.log 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63759.log.gz 2024-09-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56255.log 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59021.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61216.log.gz 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59389.log 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42744.log 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59021.log.gz 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56255.log.gz 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54507.log 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42744.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59389.log.gz 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42744.log.gz 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60874.log 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60958.log 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60874.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-09-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66730.log 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60874.log.gz 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52018.log 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60958.log: /var/log/ceph/ceph-client.admin.66730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54851.log 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.54507.log.gz 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60958.log.gz 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66730.log.gz 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55840.log 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9%/var/log/ceph/ceph-client.admin.54851.log: -- replaced with /var/log/ceph/ceph-client.admin.52018.log.gz 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61344.log 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54851.log.gz 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.55840.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30345.log 2024-09-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55840.log.gz 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65495.log 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61344.log.gz 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.tmp-client.admin.30345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46630.log 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30345.log.gz 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64957.log 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46630.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65495.log.gz 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54171.log 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62963.log 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64957.log.gz 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36451.log 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60333.log 2024-09-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi181.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54171.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54225.log 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.62963.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36451.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54225.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60333.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53904.log 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.54225.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53904.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55966.log 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55798.log 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53904.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.55966.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-09-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46420.log 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55966.log.gz 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.55798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46420.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55798.log.gz 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57020.log 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46420.log.gz 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60646.log 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45965.log 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60646.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57020.log.gz 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51421.log 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60646.log.gz 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43798.log 2024-09-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45965.log: /var/log/ceph/ceph-client.admin.51421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45965.log.gz 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43798.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51421.log.gz 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51930.log 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51846.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43798.log.gz 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66310.log 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4%/var/log/ceph/ceph-client.admin.51930.log: -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43469.log 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51930.log.gz 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52283.log 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43469.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66310.log.gz 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65986.log 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52283.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43469.log.gz 2024-09-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52283.log.gz 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66814.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47147.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65986.log.gz 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66814.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54561.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66814.log.gz 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60459.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60181.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54561.log: /var/log/ceph/ceph-client.admin.60459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62711.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60459.log.gz 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66646.log 2024-09-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi181.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.54561.log.gz 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62711.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60181.log.gz 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51048.log 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66856.log 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66646.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.62711.log.gz 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63255.log 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66646.log.gz 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51048.log.gz 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57422.log 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66856.log.gz 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50413.log 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63255.log.gz 2024-09-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61768.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57422.log: /var/log/ceph/ceph-client.0.50413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61388.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57422.log.gz 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66772.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61768.log.gz 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62178.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61388.log.gz 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66772.log.gz 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.62178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62795.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46936.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62795.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54399.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2024-09-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi181.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62795.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46936.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54399.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.62178.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66520.log 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52451.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54399.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64100.log 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45668.log 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64100.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66520.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43466.log 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64100.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.50413.log.gz 2024-09-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57924.log 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45668.log.gz 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45812.log 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43466.log: /var/log/ceph/ceph-client.admin.57924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56894.log 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43466.log.gz 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45812.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57924.log.gz 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57314.log 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45812.log.gz 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46733.log 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56894.log: /var/log/ceph/ceph-client.admin.57314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54959.log 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56894.log.gz 2024-09-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46733.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57314.log.gz 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47571.log 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46733.log.gz 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50018.log 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54959.log: /var/log/ceph/ceph-client.admin.47571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58872.log 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54959.log.gz 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46043.log 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47571.log.gz 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58872.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50018.log.gz 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58422.log 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58872.log.gz 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47655.log 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46043.log: /var/log/ceph/ceph-client.admin.58422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59333.log 2024-09-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46043.log.gz 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47655.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58422.log.gz 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47231.log 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47655.log.gz 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59545.log 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59333.log: /var/log/ceph/ceph-client.admin.47231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58459.log 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47231.log.gz 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46546.log 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.59333.log.gz 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59545.log.gz 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54366.log 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58459.log: /var/log/ceph/ceph-client.admin.46546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42492.log 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58459.log.gz 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56102.log 2024-09-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46546.log.gz 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63675.log 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.54366.log.gz 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42492.log.gz 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56978.log 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63465.log 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56102.log.gz 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63675.log.gz 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58830.log 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56978.log.gz 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52325.log 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63465.log: /var/log/ceph/ceph-client.admin.58830.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63465.log.gz 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63507.log 2024-09-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58830.log.gz 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47189.log 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52325.log: /var/log/ceph/ceph-client.admin.63507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54893.log 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52325.log.gz 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63507.log.gz 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66898.log 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47189.log.gz 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65944.log 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62837.log 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66898.log.gz 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54893.log.gz 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60375.log 2024-09-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65944.log.gz 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56465.log 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62837.log.gz 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56423.log 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60375.log: /var/log/ceph/ceph-client.admin.56465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62459.log 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60375.log.gz 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56465.log.gz 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56423.log.gz 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49251.log 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62459.log.gz 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59657.log 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45473.log: /var/log/ceph/ceph-client.admin.49251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42311.log 2024-09-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49459.log 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59657.log.gz 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49251.log.gz 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47613.log 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67066.log 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42311.log.gz 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49459.log.gz 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44256.log 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47613.log.gz 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66352.log 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.67066.log: /var/log/ceph/ceph-client.admin.44256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45907.log 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67066.log.gz 2024-09-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66352.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44256.log.gz 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42404.log 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66352.log.gz 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54534.log 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62352.log 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45907.log.gz 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54534.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42404.log.gz 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66394.log 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.54534.log.gz 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62352.log.gz 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56297.log 2024-09-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56050.log 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66394.log.gz 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60601.log 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56297.log.gz 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50153.log 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58642.log 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60601.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56050.log.gz 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53493.log 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60601.log.gz 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58642.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50153.log.gz 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51589.log 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58642.log.gz 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41961.log 2024-09-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53493.log.gz 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57272.log 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51589.log: /var/log/ceph/ceph-client.admin.41961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42954.log 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51589.log.gz 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41961.log.gz 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44046.log 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42181.log 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42954.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57272.log.gz 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61852.log 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42954.log.gz 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44046.log.gz 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60417.log 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42181.log: /var/log/ceph/ceph-client.admin.61852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66940.log 2024-09-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42181.log.gz 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58320.log 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60417.log.gz 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66940.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61852.log.gz 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49567.log 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66940.log.gz 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52578.log 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58320.log: /var/log/ceph/ceph-client.admin.49567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58320.log.gz 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52578.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49567.log.gz 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64230.log 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52578.log.gz 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60543.log 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47991.log: /var/log/ceph/ceph-client.admin.64230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51234.log 2024-09-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64230.log.gz 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66226.log 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51234.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60543.log.gz 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43136.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51234.log.gz 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61558.log 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66226.log: /var/log/ceph/ceph-client.admin.51684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67024.log 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66226.log.gz 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61558.log: /var/log/ceph/ceph-client.admin.67024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63717.log 2024-09-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61558.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53931.log 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67024.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58937.log 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63717.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56008.log 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:gzip/var/log/ceph/ceph-client.admin.58937.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63171.log 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56008.log: gzip 91.5% -- replaced with /var/log/ceph/ceph-client.admin.53931.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46462.log 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56008.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63171.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.58937.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44298.log 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63171.log.gz 2024-09-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64891.log 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46462.log.gz 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50812.log 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64891.log: /var/log/ceph/ceph-client.admin.43808.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44298.log.gz 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64291.log 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56850.log 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50812.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64891.log.gz 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50812.log.gz 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56850.log: gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.64291.log.gz /var/log/ceph/ceph-client.admin.55924.log 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T02:36:36.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44172.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56850.log.gz 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62879.log 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54285.log 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.55924.log: /var/log/ceph/ceph-client.admin.62879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51547.log 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55924.log.gz 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50922.log 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62879.log.gz 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56722.log 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54285.log.gz 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51547.log.gz 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50922.log.gz 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54710.log 2024-09-12T02:36:36.403 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54480.log 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46978.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56722.log.gz 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54710.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44811.log 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54710.log.gz 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64596.log 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54480.log: /var/log/ceph/ceph-client.0.44811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57146.log 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54480.log.gz 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51505.log 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64596.log.gz 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57146.log: 89.2% -- replaced with /var/log/ceph/ceph-client.0.44811.log.gz 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63896.log 2024-09-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57146.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60790.log 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51505.log: /var/log/ceph/ceph-client.admin.63896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51505.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60790.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63896.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62627.log 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60790.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44130.log: /var/log/ceph/ceph-client.admin.62627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67126.log 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46336.log 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.62627.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.67126.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58385.log 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46336.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67126.log.gz 2024-09-12T02:36:36.405 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53435.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46336.log.gz 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45584.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58385.log: /var/log/ceph/ceph-client.admin.53435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66268.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45584.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53435.log.gz 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56381.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45584.log.gz 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.58385.log.gz 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66268.log: /var/log/ceph/ceph-client.admin.56381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61134.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66268.log.gz 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45431.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56381.log.gz 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60916.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43668.log 2024-09-12T02:36:36.406 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61134.log.gz 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61726.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60916.log: /var/log/ceph/ceph-client.admin.43668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59917.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60916.log.gz 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61726.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43668.log.gz 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63591.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61726.log.gz 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62417.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.59917.log: /var/log/ceph/ceph-client.admin.63591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54312.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63591.log.gz 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61642.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54312.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62417.log.gz 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61642.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54312.log.gz 2024-09-12T02:36:36.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65355.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61642.log.gz 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64186.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55687.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65355.log: /var/log/ceph/ceph-client.admin.64186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.65355.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64186.log.gz 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.55687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51006.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55687.log.gz 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62543.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:gzip/var/log/ceph/ceph-client.admin.46294.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49024.log 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51006.log.gz 2024-09-12T02:36:36.408 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49001.log 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49024.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.62543.log.gz 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53997.log 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49024.log.gz 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60832.log 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53997.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49001.log.gz 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43467.log 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.53997.log.gz 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54138.log 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60832.log: gzip -5/var/log/ceph/ceph-client.admin.43467.log: --verbose -- /var/log/ceph/ceph-client.admin.64058.log 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60832.log.gz 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54138.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43467.log.gz 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58914.log 2024-09-12T02:36:36.409 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57966.log 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: 91.6% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64058.log.gz 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54138.log.gz 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43472.log 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58914.log.gz 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43127.log 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51764.log 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: 91.3% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43472.log.gz 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57966.log.gz/var/log/ceph/ceph-client.admin.43127.log: 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64470.log 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43127.log.gz 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51764.log: /var/log/ceph/ceph-client.admin.64470.log: gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51764.log.gz 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59296.log 2024-09-12T02:36:36.410 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64470.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54078.log 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62753.log 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59296.log: /var/log/ceph/ceph-client.admin.54078.log: gzip -5 --verbose -- 89.9% -- replaced with /var/log/ceph/ceph-client.admin.59296.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr: /var/log/ceph/ceph-client.admin.61258.log 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62753.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54078.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43807.log 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5/var/log/ceph/ceph-client.admin.61258.log: --verbose 90.8% -- replaced with /var/log/ceph/ceph-client.admin.62753.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr: -- /var/log/ceph/ceph-client.admin.56153.log 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43807.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61258.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43807.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65608.log 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46690.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56153.log.gz 2024-09-12T02:36:36.411 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56339.log 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54453.log 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65608.log.gz 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63339.log 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 88.4%/var/log/ceph/ceph-client.admin.54453.log: -- replaced with /var/log/ceph/ceph-client.admin.56339.log.gz 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63339.log: gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54453.log.gz 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63339.log.gz 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr: -- /var/log/ceph/ceph-mon.a.log 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56764.log 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59442.log 2024-09-12T02:36:36.412 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63633.log 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5%/var/log/ceph/ceph-client.admin.59442.log: -- replaced with /var/log/ceph/ceph-client.admin.56764.log.gz 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59442.log.gz 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49214.log 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63633.log: /var/log/ceph/ceph-client.admin.42139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49371.log 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49214.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63633.log.gz 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49214.log.gz 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr: /var/log/ceph/ceph-client.admin.57188.log 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49371.log.gz/var/log/ceph/ceph-client.admin.57188.log: 2024-09-12T02:36:36.413 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58278.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57188.log.gz 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61300.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47739.log: /var/log/ceph/ceph-client.admin.58278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42786.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61300.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58278.log.gz 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45626.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61300.log.gz 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:gzip/var/log/ceph/ceph-client.admin.42786.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45626.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42786.log.gz 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63061.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45626.log.gz 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67166.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43134.log: /var/log/ceph/ceph-client.admin.63061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2024-09-12T02:36:36.414 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.67166.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63061.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67166.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66070.log 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60501.log 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7%/var/log/ceph/ceph-client.admin.66070.log: -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58496.log 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66070.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64333.log 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58362.log 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60501.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58496.log: /var/log/ceph/ceph-client.admin.64333.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.58496.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64333.log.gz 2024-09-12T02:36:36.415 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59259.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52153.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr: 87.6%/var/log/ceph/ceph-client.admin.59259.log: -- replaced with /var/log/ceph/ceph-client.admin.58362.log.gz 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51132.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56560.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52153.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.59259.log.gz 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51132.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52153.log.gz 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51132.log.gz 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41518.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57230.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56560.log.gz 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43804.log: /var/log/ceph/ceph-client.admin.41518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56195.log 2024-09-12T02:36:36.416 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9%/var/log/ceph/ceph-client.admin.57230.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41518.log.gz 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57230.log.gz 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48848.log 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56195.log.gz 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44088.log 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58778.log 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48848.log: /var/log/ceph/ceph-client.admin.44088.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48848.log.gz 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44088.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43135.log 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58778.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58778.log.gz 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60291.log 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64765.log 2024-09-12T02:36:36.417 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43135.log: /var/log/ceph/ceph-client.admin.60291.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43135.log.gz 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49413.log 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60291.log.gz 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63381.log 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64765.log: /var/log/ceph/ceph-client.admin.49413.log: 87.8% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64765.log.gz 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49413.log.gz 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52662.log 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63381.log: /var/log/ceph/ceph-client.admin.42660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63381.log.gz 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42534.log 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52493.log 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42534.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42534.log.gz 2024-09-12T02:36:36.418 INFO:teuthology.orchestra.run.smithi181.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.52662.log.gz 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64427.log 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54763.log 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52493.log.gz 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54763.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64427.log.gz 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54763.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45309.log 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.42362.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49140.log 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.2.45309.log: 88.6% -- replaced with /var/log/ceph/ceph-client.2.45309.log.gz 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66436.log 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49140.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.49140.log.gz 2024-09-12T02:36:36.419 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54024.log 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66436.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66436.log.gz 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54024.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54024.log.gz 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51277.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63976.log 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44004.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43126.log 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63976.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63976.log.gz 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42912.log 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43126.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43126.log.gz 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58032.log 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42912.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42912.log.gz 2024-09-12T02:36:36.420 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54339.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58032.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58032.log.gz 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54198.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54339.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54339.log.gz 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62585.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54198.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54198.log.gz 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48057.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62585.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.62585.log.gz 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61918.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48057.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48057.log.gz 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61918.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61918.log.gz 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57104.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42828.log 2024-09-12T02:36:36.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57104.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57104.log.gz 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45770.log 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42828.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42828.log.gz 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47529.log 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45770.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45770.log.gz 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47529.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47529.log.gz 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61430.log 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42223.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61430.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61430.log.gz 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55219.log 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46775.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-09-12T02:36:36.422 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47273.log 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.55219.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.55219.log.gz 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53877.log 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47273.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47273.log.gz 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52409.log 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53877.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53877.log.gz 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43133.log 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52409.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52409.log.gz 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60706.log 2024-09-12T02:36:36.434 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43133.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43133.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60706.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60706.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58979.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42446.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58979.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.58979.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65776.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47403.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54258.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65776.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65776.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52988.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54258.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54258.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47063.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.52988.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.52988.log.gz 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2024-09-12T02:36:36.435 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47063.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47063.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42267.log 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43468.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59591.log 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42267.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42267.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62375.log 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59591.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59591.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51319.log 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62375.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62375.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48906.log 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51319.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51319.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48906.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64680.log 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47949.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2024-09-12T02:36:36.436 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65650.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64680.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64680.log.gz 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51463.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65650.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65650.log.gz 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56936.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51463.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51463.log.gz 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48317.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56936.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56936.log.gz 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54805.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.48317.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.48317.log.gz 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51174.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54805.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54805.log.gz 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49177.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51174.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51174.log.gz 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2024-09-12T02:36:36.437 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49177.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49177.log.gz 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56806.log 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47697.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42702.log 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56806.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56806.log.gz 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43800.log 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42702.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42702.log.gz 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43800.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43800.log.gz 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57882.log 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45728.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62921.log 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57882.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57882.log.gz 2024-09-12T02:36:36.438 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60748.log 2024-09-12T02:36:36.440 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62921.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62921.log.gz 2024-09-12T02:36:36.440 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2024-09-12T02:36:36.440 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.60748.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60748.log.gz 2024-09-12T02:36:36.440 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61473.log 2024-09-12T02:36:36.440 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42618.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-09-12T02:36:36.440 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44933.log 2024-09-12T02:36:36.441 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61473.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61473.log.gz 2024-09-12T02:36:36.441 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57683.log 2024-09-12T02:36:36.441 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44933.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44933.log.gz 2024-09-12T02:36:36.441 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2024-09-12T02:36:36.452 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.57683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59185.log 2024-09-12T02:36:36.453 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42576.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2024-09-12T02:36:36.461 INFO:teuthology.orchestra.run.smithi181.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T02:36:36.461 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52199.log 2024-09-12T02:36:36.462 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59185.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.59185.log.gz 2024-09-12T02:36:36.464 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65397.log 2024-09-12T02:36:36.464 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52199.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52199.log.gz 2024-09-12T02:36:36.464 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65692.log 2024-09-12T02:36:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65397.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.65397.log.gz 2024-09-12T02:36:36.465 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63801.log 2024-09-12T02:36:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65692.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65692.log.gz 2024-09-12T02:36:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61600.log 2024-09-12T02:36:36.467 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63801.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63801.log.gz 2024-09-12T02:36:36.468 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66688.log 2024-09-12T02:36:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61600.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61600.log.gz 2024-09-12T02:36:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59111.log 2024-09-12T02:36:36.469 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66688.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66688.log.gz 2024-09-12T02:36:36.470 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44400.log 2024-09-12T02:36:36.471 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59111.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.59111.log.gz 2024-09-12T02:36:36.472 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64554.log 2024-09-12T02:36:36.473 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44400.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44400.log.gz 2024-09-12T02:36:36.473 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57840.log 2024-09-12T02:36:36.474 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64554.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64554.log.gz 2024-09-12T02:36:36.475 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52241.log 2024-09-12T02:36:36.476 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57840.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57840.log.gz 2024-09-12T02:36:36.476 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64807.log 2024-09-12T02:36:36.476 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52241.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52241.log.gz 2024-09-12T02:36:36.477 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65217.log 2024-09-12T02:36:36.479 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64807.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64807.log.gz 2024-09-12T02:36:36.479 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64722.log 2024-09-12T02:36:36.480 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.65217.log: 88.1% -- replaced with /var/log/ceph/ceph-client.0.65217.log.gz 2024-09-12T02:36:36.481 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65860.log 2024-09-12T02:36:36.482 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64722.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64722.log.gz 2024-09-12T02:36:36.482 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63297.log 2024-09-12T02:36:36.482 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65860.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65860.log.gz 2024-09-12T02:36:36.483 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43805.log 2024-09-12T02:36:36.484 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63297.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63297.log.gz 2024-09-12T02:36:36.484 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50964.log 2024-09-12T02:36:36.485 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43805.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43805.log.gz 2024-09-12T02:36:36.486 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59063.log 2024-09-12T02:36:36.487 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50964.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50964.log.gz 2024-09-12T02:36:36.487 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65734.log 2024-09-12T02:36:36.488 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59063.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59063.log.gz 2024-09-12T02:36:36.489 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52620.log 2024-09-12T02:36:36.489 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65734.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65734.log.gz 2024-09-12T02:36:36.490 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61684.log 2024-09-12T02:36:36.491 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52620.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52620.log.gz 2024-09-12T02:36:36.491 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36715.log 2024-09-12T02:36:36.492 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61684.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61684.log.gz 2024-09-12T02:36:36.493 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66604.log 2024-09-12T02:36:36.493 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36715.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36715.log.gz 2024-09-12T02:36:36.494 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56640.log 2024-09-12T02:36:36.495 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66604.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66604.log.gz 2024-09-12T02:36:36.495 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2024-09-12T02:36:36.496 INFO:teuthology.orchestra.run.smithi204.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T02:36:36.498 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.56640.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56640.log.gz 2024-09-12T02:36:36.498 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52367.log 2024-09-12T02:36:36.498 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47823.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2024-09-12T02:36:36.498 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62501.log 2024-09-12T02:36:36.499 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52367.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52367.log.gz 2024-09-12T02:36:36.500 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47020.log 2024-09-12T02:36:36.501 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62501.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.62501.log.gz 2024-09-12T02:36:36.501 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61054.log 2024-09-12T02:36:36.502 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47020.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47020.log.gz 2024-09-12T02:36:36.502 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42057.log 2024-09-12T02:36:36.503 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61054.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61054.log.gz 2024-09-12T02:36:36.504 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54594.log 2024-09-12T02:36:36.505 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42057.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42057.log.gz 2024-09-12T02:36:36.505 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47445.log 2024-09-12T02:36:36.506 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54594.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54594.log.gz 2024-09-12T02:36:36.506 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66028.log 2024-09-12T02:36:36.507 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47445.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47445.log.gz 2024-09-12T02:36:36.508 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46588.log 2024-09-12T02:36:36.509 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.66028.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66028.log.gz 2024-09-12T02:36:36.509 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64849.log 2024-09-12T02:36:36.510 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46588.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46588.log.gz 2024-09-12T02:36:36.510 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54426.log 2024-09-12T02:36:36.512 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64849.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64849.log.gz 2024-09-12T02:36:36.512 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65818.log 2024-09-12T02:36:36.513 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54426.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.54426.log.gz 2024-09-12T02:36:36.513 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2024-09-12T02:36:36.515 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65818.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65818.log.gz 2024-09-12T02:36:36.515 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54105.log 2024-09-12T02:36:36.518 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49098.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2024-09-12T02:36:36.519 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53964.log 2024-09-12T02:36:36.520 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54105.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.54105.log.gz 2024-09-12T02:36:36.520 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49318.log 2024-09-12T02:36:36.521 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53964.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53964.log.gz 2024-09-12T02:36:36.522 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49827.log 2024-09-12T02:36:36.522 INFO:teuthology.orchestra.run.smithi204.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T02:36:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49318.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49318.log.gz 2024-09-12T02:36:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65902.log 2024-09-12T02:36:36.526 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.0.49827.log: 94.9% -- replaced with /var/log/ceph/ceph-client.0.59917.log.gz 2024-09-12T02:36:36.526 INFO:teuthology.orchestra.run.smithi181.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.49827.log.gz 2024-09-12T02:36:36.527 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52069.log 2024-09-12T02:36:36.527 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51361.log 2024-09-12T02:36:36.527 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.65902.log: /var/log/ceph/ceph-client.admin.52069.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65902.log.gz 2024-09-12T02:36:36.528 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52069.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64383.log 2024-09-12T02:36:36.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63213.log 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51361.log: /var/log/ceph/ceph-client.admin.64383.log: 88.9% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64383.log.gz 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51361.log.gz 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61810.log 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52728.log 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63213.log.gz 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61810.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61810.log.gz 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43806.log 2024-09-12T02:36:36.531 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59484.log 2024-09-12T02:36:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52728.log: /var/log/ceph/ceph-client.admin.43806.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52728.log.gz 2024-09-12T02:36:36.534 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43806.log.gz 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61516.log 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64142.log 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59484.log.gz 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.61516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43132.log 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61516.log.gz 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47317.log 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64142.log.gz 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43132.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43132.log.gz 2024-09-12T02:36:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63423.log 2024-09-12T02:36:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49061.log 2024-09-12T02:36:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47317.log: /var/log/ceph/ceph-client.admin.63423.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47317.log.gz 2024-09-12T02:36:36.536 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63423.log.gz 2024-09-12T02:36:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46378.log 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49061.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49061.log.gz 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53604.log 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58098.log 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46378.log: /var/log/ceph/ceph-client.admin.53604.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46378.log.gz 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53604.log.gz 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58098.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58098.log.gz 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43471.log 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T02:36:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.43471.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43471.log.gz 2024-09-12T02:36:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52535.log 2024-09-12T02:36:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2024-09-12T02:36:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52535.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52535.log.gz 2024-09-12T02:36:36.567 INFO:teuthology.orchestra.run.smithi181.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T02:36:36.568 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62669.log 2024-09-12T02:36:36.569 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57356.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gz 2024-09-12T02:36:36.569 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54051.log 2024-09-12T02:36:36.570 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.62669.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.62669.log.gz 2024-09-12T02:36:36.571 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46855.log 2024-09-12T02:36:36.572 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.54051.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54051.log.gz 2024-09-12T02:36:36.573 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46159.log 2024-09-12T02:36:36.574 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46855.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46855.log.gz 2024-09-12T02:36:36.574 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64512.log 2024-09-12T02:36:36.574 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46159.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46159.log.gz 2024-09-12T02:36:36.575 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63549.log 2024-09-12T02:36:36.576 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.64512.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64512.log.gz 2024-09-12T02:36:36.577 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46085.log 2024-09-12T02:36:36.577 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.63549.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63549.log.gz 2024-09-12T02:36:36.578 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55882.log 2024-09-12T02:36:36.579 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46085.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46085.log.gz 2024-09-12T02:36:36.579 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58700.log 2024-09-12T02:36:36.580 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.55882.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55882.log.gz 2024-09-12T02:36:36.581 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51974.log 2024-09-12T02:36:36.581 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.58700.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58700.log.gz 2024-09-12T02:36:36.582 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59222.log 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51974.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51974.log.gz 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57062.log 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59222.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.59222.log.gz 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46504.log 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.57062.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57062.log.gz 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59148.log 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46504.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46504.log.gz 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr: 93.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42870.log 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.59148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43131.log 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42870.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59148.log.gz 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42870.log.gz 2024-09-12T02:36:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52111.log 2024-09-12T02:36:36.591 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43131.log: 88.6%/var/log/ceph/ceph-client.admin.52111.log: -- replaced with /var/log/ceph/ceph-client.admin.43131.log.gz 2024-09-12T02:36:36.591 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52111.log.gz 2024-09-12T02:36:36.847 INFO:teuthology.orchestra.run.smithi181.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T02:36:36.925 INFO:teuthology.orchestra.run.smithi181.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T02:36:36.934 INFO:teuthology.orchestra.run.smithi204.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T02:36:36.939 INFO:teuthology.orchestra.run.smithi204.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T02:36:36.956 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T02:36:36.979 INFO:teuthology.orchestra.run.smithi204.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T02:36:37.127 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T02:36:37.299 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T02:36:37.511 INFO:teuthology.orchestra.run.smithi204.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T02:36:37.621 INFO:teuthology.orchestra.run.smithi181.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.57683.log.gz 2024-09-12T02:36:37.622 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T02:36:37.623 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m1.388s 2024-09-12T02:36:37.623 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m5.289s 2024-09-12T02:36:37.623 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.478s 2024-09-12T02:36:37.843 INFO:teuthology.orchestra.run.smithi204.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T02:36:38.532 INFO:teuthology.orchestra.run.smithi204.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T02:36:38.535 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-09-12T02:36:38.535 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m2.277s 2024-09-12T02:36:38.535 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m7.336s 2024-09-12T02:36:38.535 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m0.270s 2024-09-12T02:36:38.535 INFO:tasks.ceph:Archiving logs... 2024-09-12T02:36:38.535 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/remote/smithi181/log 2024-09-12T02:36:38.536 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:36:38.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T02:36:38.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-12T02:36:38.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T02:36:38.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T02:36:38.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-12T02:36:38.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T02:36:38.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T02:36:38.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T02:36:38.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-12T02:36:38.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-12T02:36:38.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-12T02:36:39.515 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/remote/smithi204/log 2024-09-12T02:36:39.516 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:36:40.418 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:36:40.429 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:36:40.429 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:36:40.432 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:36:40.514 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:36:40.523 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:36:40.523 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:36:40.526 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:36:40.540 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:36:40.541 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:36:40.545 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:36:40.545 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-12T02:36:40.545 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 -3546us[-3452us] +/- 65ms 2024-09-12T02:36:40.545 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 +977us[ +977us] +/- 76ms 2024-09-12T02:36:40.546 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +2853us[+2853us] +/- 74ms 2024-09-12T02:36:40.546 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:36:40.547 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:36:40.547 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-12T02:36:40.547 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 -3346us[-3352us] +/- 65ms 2024-09-12T02:36:40.547 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 +1179us[+1173us] +/- 76ms 2024-09-12T02:36:40.547 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +3049us[+3042us] +/- 74ms 2024-09-12T02:36:40.547 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:36:40.548 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:36:40.556 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:36:40.557 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:36:40.567 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:36:40.669 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:36:40.734 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:36:40.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:36:40.764 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:36:40.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:36:40.793 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:36:40.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:36:40.815 INFO:teuthology.task.internal:Duration was 901.867761 seconds 2024-09-12T02:36:40.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:36:40.826 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:36:40.826 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:36:40.829 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:36:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:36:40.871 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:36:41.186 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:36:41.186 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T02:36:41.186 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:36:41.206 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-09-12T02:36:41.206 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:36:41.250 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:36:41.250 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:36:41.254 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:36:41.316 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:36:41.316 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:36:41.320 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:36:41.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:36:41.477 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:36:41.478 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:36:41.510 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:36:41.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:36:41.697 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:36:41.700 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:36:41.721 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-12T02:36:41.724 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-09-12T02:36:41.737 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:36:41.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:36:41.788 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:36:41.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:36:41.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:36:41.814 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:36:41.815 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/remote/smithi181 2024-09-12T02:36:41.815 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:36:41.863 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901623/remote/smithi204 2024-09-12T02:36:41.863 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:36:41.896 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:36:41.896 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:36:41.900 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:36:41.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:36:41.959 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:36:41.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:36:41.974 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:36:41.974 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:36:41.977 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:36:41.991 INFO:teuthology.orchestra.run.smithi181.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:36 /home/ubuntu/cephtest 2024-09-12T02:36:42.002 INFO:teuthology.orchestra.run.smithi204.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:36 /home/ubuntu/cephtest 2024-09-12T02:36:42.003 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:36:42.015 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:36:42.044 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/journal-repair} duration: 901.8677611351013 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:36:42.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:36:42.118 INFO:teuthology.run:pass